Flyte docs migrations

[davidmirror-ops]

The Flyte docs are migrated to a new content manager (Hugo) under the union.ai website.

This is mostly a work in progress and we're working towards making all existing links properly redirected and fixing any broken reference.

When this stabilizes the result should be docs that are easier to navigate and easier to author/contribute to.

We appreciate your patience during the process.

Please use this discussion to report any broken link or missing section/resource you may encounter.

[HansBambel]

I am using the docs quite a lot lately and noticed some broken links or outdated docs.
For example:

1. On task-level-monitoring the first link to (viewing-workflow-executions)[https://www.union.ai/docs/flyte/user-guide/core-concepts/tasks/workflows/viewing-workflow-executions] does not work.
2. All links to other sites are broken on standard-workflows
3. A few months ago I extended the documentation about data-types (https://www.union.ai/docs/flyte/user-guide/data-input-output/) with polars DataFrame and LazyFrame, but I can't find it there anymore.

[ppiegaze]

Ok, now everything should be fixed except for the link to WorkflowFailurePolicy (we will get that sorted out soon)

[HansBambel]

The conditionals and chaining links work now 👍

The following still give me a 404:

• https://www.union.ai/docs/flyte/user-guide/core-concepts/tasks/task-hardware-environment/task-level-monitoring
• https://www.union.ai/docs/flyte/user-guide/core-concepts/development-cycle/running-your-code#running-a-script-in-local-python
• https://www.union.ai/docs/flyte/user-guide/core-concepts/workflows/tasks/task-hardware-environment/interruptible-instances

[ppiegaze]

Yes, there is a problem with our link rendering. Working on it now

[HansBambel]

Yes

[ppiegaze]

I could not find on this page

https://www.union.ai/docs/flyte/user-guide/core-concepts/workflows/standard-workflows/

any reference to

https://www.union.ai/docs/flyte/user-guide/core-concepts/tasks/task-hardware-environment/task-level-monitoring

In any case, such a reference should not exist because that page does not exist. Task-level monitoring is not an OSS feature, it is Union-only.

The other links should work now. We found a bug in our link rendering and (I hope) fixed it.

The link to WorkflowFailurePolicy still goes to the top of Flytekit reference section since we still have to fix the autogeneration to produce the docs for that class.

[HansBambel]

Hello again, I found some more broken links:

The following links on secrets are either broken or don't make sense:

• with flytectl demo start as described here.
• but you can also configure different secret managers.
• [Flytesnacks repo][flytesnacks].
• Configure the {py:class}~flytekitplugins.sqlalchemy.SQLAlchemyConfig (this should probably link to the class?)
• {py:func}flytekit.current_context (should probably link to the function?)

[davidmirror-ops]

cc @ppiegaze

[ppiegaze]

Ok fixed. Thanks

[HansBambel]

• On https://www.union.ai/docs/flyte/user-guide/faq/ at Configuring your data plane a 404 occurs
• also in the FAQ broken:(see Enabling AWS S3 or Enabling Google Cloud Storage).
• https://www.union.ai/docs/flyte/user-guide/data-input-output/task-input-and-output/ all links at the bottom are broken:

For information on setting up your own bucket and enabling access to it, see [Enabling AWS S3](https://www.union.ai/docs/flyte/user-guide/integrations/enabling-aws-resources/enabling-aws-s3), [Enabling Google Cloud Storage](https://www.union.ai/docs/flyte/user-guide/integrations/enabling-gcp-resources/enabling-google-cloud-storage), or [Enabling Azure Blob Storage](https://www.union.ai/docs/flyte/user-guide/integrations/enabling-azure-resources/enabling-azure-blob-storage), depending on your cloud provider.

• Also unsure whether this is intended, but "For more details, see Understand How Flyte Handles Data." links to the same page (not giving "more details")

[HansBambel]

All links on https://www.union.ai/docs/flyte/user-guide/faq/#can-i-use-my-own-blob-store-for-data-storage-that-i-handle-myself called Enabling AWS S3 are broken.

@ppiegaze Is there a way to get access to the page?

[ppiegaze]

Thanks for pointing that out. Those links are indeed broken, but even if they were not they actually shouldn't be there in the flyte version of the FAQ since they point to pages specific to Union. I will correct it all.

Just in case you are interested the AWS S3 one is this: https://www.union.ai/docs/byoc/deployment/enabling-aws-resources/enabling-aws-s3/

But it might not be what you are looking for since it is specific to Union

[HansBambel]

Oh, okay. Thanks for the link.

Indeed, when it is specific to Union, then it won't help that much. Basically, I am missing information about how to enable saving to a specific S3-Bucket. On the one hand, the intermediate results and on the other I am trying to load things from a S3-Bucket using Polars, but get a "Generic S3 Error" from Polars which indicates that I don't have access to the resources even though I supply the credentials

[HansBambel]

The Decks documentation is missing that some decks require installing flytekitplugins-deck-standard such as the ImageRenderer. Took me a while to figure that out

[ppiegaze]

I will fix. Thanks

[ppiegaze]

Ok fixed

[davidmirror-ops]

Broken link :
https://www.union.ai/docs/flyte/user-guide/integrations/agents/bigquery-agent/bigquery-connector-example

[ppiegaze]

where did you find this link?

[ppiegaze]

Anyway I added some redirects for pages with this pattern, including that one