# Flyte Open Source Documentation > **This is legacy (latest) documentation.** Do not use unless explicitly asked about this version. For current documentation, see https://www.union.ai/docs/v2/llms.txt > Full documentation (single file): https://www.union.ai/docs/latest/flyte/llms-full.txt > Site: https://www.union.ai/docs/latest/flyte Each entry below is `- [Page title](URL)` followed by the H2/H3 headings found on that page. Pages link to individual `page.md` files. Sections marked with a "Section bundle" link have a `section.md` that concatenates all pages in the section into a single file — use it to load an entire section into context at once. ## User guide - [Get started](https://www.union.ai/docs/latest/flyte/user-guide/get-started/page.md) - Pure Python, no DSL - Durability - Reproducibility - Recoverability - Built for scale - What this means in practice - Start here - [Quickstart](quickstart/page.md) - [Core concepts](core-concepts/page.md) - [Run modes](run-modes/page.md) - [Get started > Quickstart](https://www.union.ai/docs/latest/flyte/user-guide/get-started/quickstart/page.md) - What you'll need - Install the SDK - Configure - Write your first workflow - Run it - See the results - Next steps - [Get started > Core concepts](https://www.union.ai/docs/latest/flyte/user-guide/get-started/core-concepts/page.md) - How Flyte works > Section bundle (all pages): https://www.union.ai/docs/latest/flyte/user-guide/get-started/core-concepts/section.md - [Get started > Core concepts > TaskEnvironment](https://www.union.ai/docs/latest/flyte/user-guide/get-started/core-concepts/task-environment/page.md) - A minimal example - What TaskEnvironment controls - Configuring resources - Configuring container images - Multiple tasks, one environment - Multiple environments - Next steps - [Get started > Core concepts > Tasks](https://www.union.ai/docs/latest/flyte/user-guide/get-started/core-concepts/tasks/page.md) - Defining a task - Type hints are required - Tasks calling tasks - The top-level task - Running tasks locally - Running tasks remotely - Next steps - [Get started > Core concepts > Runs and actions](https://www.union.ai/docs/latest/flyte/user-guide/get-started/core-concepts/runs-and-actions/page.md) - What is a run? - What is an action? - Runs vs actions in practice - Viewing runs in the UI - Understanding the execution graph - Checking run status - Next steps - [Get started > Core concepts > Where your data lives](https://www.union.ai/docs/latest/flyte/user-guide/get-started/core-concepts/where-data-lives/page.md) - The two stores - What goes in the database - What goes in the bucket - What "literal" and "raw data" mean - What "metadata" means - 1. "Metadata" as in the control plane database (Flyte's usage) - 2. "Metadata bucket" (a deployment/ops term you may see) - Per-run customization: `raw_data_path` - What happens if the bucket is purged - The short version - [Get started > Core concepts > Apps](https://www.union.ai/docs/latest/flyte/user-guide/get-started/core-concepts/introducing-apps/page.md) - Tasks vs apps - AppEnvironment - A hello world app - Understanding the code - Serving the app - When to use apps vs tasks - Common patterns - Next steps - [Get started > Core concepts > Projects and domains](https://www.union.ai/docs/latest/flyte/user-guide/get-started/core-concepts/projects-and-domains/page.md) - How projects and domains are used - Managing projects via CLI - Create a project - List projects - Update a project - Archive a project - Unarchive a project - Listing projects programmatically - Managing projects via the UI - Domains - Targeting a domain - [Get started > Core concepts > Key capabilities](https://www.union.ai/docs/latest/flyte/user-guide/get-started/core-concepts/key-capabilities/page.md) - Environment and resources - Deployment - Data handling - Parallelism and composition - Security and automation - Durability and reliability - Apps and serving - Notebooks - Next steps - [Get started > Core concepts > Basic project: RAG](https://www.union.ai/docs/latest/flyte/user-guide/get-started/core-concepts/basic-project/page.md) - Concepts covered - Part 1: The embedding pipeline - Setting up the environment - Fetching data - Creating embeddings - Orchestrating the pipeline - Running the pipeline - Part 2: The serving application - App environment configuration - The Streamlit application - Deploying the app - Key takeaways - [Get started > Run modes](https://www.union.ai/docs/latest/flyte/user-guide/get-started/run-modes/page.md) - [Local](running-locally/page.md) - [Devbox](running-devbox/page.md) - [Remote](running-remote/page.md) - [Get started > Run modes > Run locally in Python](https://www.union.ai/docs/latest/flyte/user-guide/get-started/run-modes/running-locally/page.md) - Getting started - Running tasks locally - Two ways to run a task - As a script: `python hello.py` - Via the CLI: `flyte run` - Terminal UI - Exploring past runs - What works locally - Local to devbox/remote - Next steps - [Get started > Run modes > Run locally on the devbox](https://www.union.ai/docs/latest/flyte/user-guide/get-started/run-modes/running-devbox/page.md) - What you'll need - Install the SDK - Start the devbox - CPU - GPU - Configure - Run a workflow on the devbox - View results in the UI - Stop the devbox - Inline configuration - Programmatic - CLI - Delete the devbox - Using a CUDA-enabled GPU host - Next steps - [Get started > Run modes > Run on a remote cluster](https://www.union.ai/docs/latest/flyte/user-guide/get-started/run-modes/running-remote/page.md) - Prerequisites - Install the flyte package - Configuration file - Set up local Docker - Using the configuration - Explicit configuration - Programmatic - CLI - Programmatic - CLI - Check current configuration - Inline configuration - Programmatic - CLI - Next steps - [Tasks](https://www.union.ai/docs/latest/flyte/user-guide/tasks/page.md) - [Configure tasks](task-configuration/page.md) - [Build tasks](task-programming/page.md) - [Run and deploy tasks](task-deployment/page.md) - Related - [Apps](../apps/page.md) - [Agents](../agents/page.md) - [Tasks > Configure tasks](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-configuration/page.md) - Task configuration levels - Example - Task configuration parameters > Section bundle (all pages): https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-configuration/section.md - [Tasks > Configure tasks > Container images](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-configuration/container-images/page.md) - Specifying your own image directly - Specifying your own image with the `flyte.Image` object - Example: Defining a custom image with `Image.from_debian_base` - Example: Defining an image based on uv script metadata - Customizing an image with `with_*` methods - Installing dependencies from a `uv` or Poetry project - Installing dependencies from a pixi project - Copying local files into the image - More ways to define a base image - Starting from an existing image - Building from a Dockerfile - Referencing an image defined in configuration - Using different images for different tasks - Image building - Configuring the `builder` - Local image building - Remote `ImageBuilder` - Install private PyPI packages - [Tasks > Configure tasks > Resources](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-configuration/resources/page.md) - Resources data class - Ephemeral storage - Examples - Usage in TaskEnvironment - Usage in a task-specific override - Accelerators - NVIDIA GPUs - Google TPUs - AMD GPUs - AWS Trainium and Inferentia (Neuron) - Intel Habana Gaudi - [Tasks > Configure tasks > Secrets](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-configuration/secrets/page.md) - Creating a literal string secret - Creating a file secret - Scoping secrets - Listing secrets - Deleting secrets - Using a literal string secret - Using a file secret - Overriding secrets at invocation time - [Tasks > Configure tasks > Caching](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-configuration/caching/page.md) - Overview - Basic caching usage - `"auto"` - automatic versioning - `"override"` - `"disable"` - No caching - Advanced caching configuration - Ignoring specific inputs - Cache serialization - Salt for cache key variation - Content-based caching for DataFrames, files, and directories - DataFrames - Files - Directories - Cache policies - Function body policy (default) - Custom cache policies - Caching configuration at different levels - `TaskEnvironment` level - `@env.task` decorator level - `task.override` level - Runtime cache control - Project and domain cache isolation - Local development caching - [Tasks > Configure tasks > Reusable containers](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-configuration/reusable-containers/page.md) - [Tasks > Configure tasks > Pod templates](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-configuration/pod-templates/page.md) - How it works - Requirements - Basic usage - PodTemplate parameters - Volume mounts - GCS/S3 volume mounts - Sidecar containers - Image pull secrets - Cluster-specific configuration - Important notes - Best practices - Learn more - [Tasks > Configure tasks > Multiple environments](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-configuration/multiple-environments/page.md) - Constraints on multiple environments - Task `depends_on` constraints - Dependency inclusion constraints - Example - [Tasks > Configure tasks > Retries and timeouts](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-configuration/retries-and-timeouts/page.md) - The action lifecycle - Retries - Retry count - Retries with exponential backoff - Skip retries for failures that can't be fixed - System retries - Timeouts - `max_runtime`: bound a single attempt's execution - `max_queued_time`: fail fast when capacity isn't available - `deadline`: bound the total wall-clock - Combining the bounds - Combining retries and timeouts - [Tasks > Configure tasks > Triggers](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-configuration/triggers/page.md) - Triggers are set in the task decorator - `flyte.Trigger` - The `automation` parameter with `flyte.FixedRate` - Examples - The `automation` parameter with `flyte.Cron` - Examples - The `inputs` parameter - Basic usage - Using `flyte.TriggerTime` - Required vs optional parameters - Complex input types - Predefined schedule triggers - Available predefined triggers - Trigger time in predefined triggers - Multiple triggers per task - Notifications - Execution phases - Template variables - Slack notifications - Email notifications - Microsoft Teams notifications - Custom webhook notifications - Deploying a task with triggers - Activating and deactivating triggers - Trigger run timing - Cron-based triggers - Fixed-rate triggers without `start_time` - Fixed-rate triggers with `start_time` - Deleting triggers - Schedule time zones - Setting time zone for a cron schedule - `flyte.TriggerTime` is always in UTC - Daylight savings time behavior - [Tasks > Configure tasks > Interruptible tasks](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-configuration/interruptible-tasks-and-queues/page.md) - Setting at different levels - Behavior on preemption - Spot to on-demand fallback - [Tasks > Configure tasks > Task plugins](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-configuration/task-plugins/page.md) - Default execution: containers - Compute plugins - Available compute plugins - How compute plugins work - Using compute plugins - Using plugins on Union - Backend integrations - Next steps - [Tasks > Configure tasks > Additional task settings](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-configuration/additional-task-settings/page.md) - Naming and metadata - `name` - `short_name` - `description` - `docs` - `report` - Source-code link (automatic) - `links` - Default inputs - Environment variables - Inline I/O threshold - [Tasks > Configure tasks > Logging](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-configuration/logging/page.md) - Set the logging level with environment variables - Set the framework verbosity from the CLI - Set the logging level with `flyte.init()` - Write to the user logger - JSON logging and third-party libraries - Set it at registration with `FLYTE_RESET_ROOT_LOGGER` - Related - [Tasks > Configure tasks > Overrides](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-configuration/overrides/page.md) - What you can override - What you cannot override - Overriding when a task is reusable - Overriding secrets - [Tasks > Build tasks](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/page.md) - What you'll learn - When to use these patterns > Section bundle (all pages): https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/section.md - [Tasks > Build tasks > Files and directories](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/files-and-directories/page.md) - Example usage - Synchronous and asynchronous APIs - File methods - Dir methods - Synchronous example - JSONL files - [Tasks > Build tasks > Data classes and structures](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/dataclasses-and-structures/page.md) - Example: Combining dataclasses and Pydantic models - [Tasks > Build tasks > DataFrames](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/dataframes/page.md) - Setting up the environment and sample data - Create a raw DataFrame - Create a flyte.io.DataFrame - Automatically convert between types - Downloading DataFrames - Run the example - Polars DataFrames - Setup - Eager DataFrames - Lazy DataFrames - Run the example - See also - [Tasks > Build tasks > Custom types](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/handling-custom-types/page.md) - Types of extensions - Creating a type transformer - Step 1: Define your custom type - Step 2: Create the type transformer - Step 3: Register the transformer - Distributing type plugins - Configure pyproject.toml - Automatic loading - Controlling plugin loading - Using custom types in tasks - DataFrame extensions - Best practices - See also - [Tasks > Build tasks > Custom context](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/custom-context/page.md) - Overview - When to use it and when not to - Setting custom context - Run-level context - Overriding inside a task (local override that affects nested tasks) - Adding new keys for nested tasks - Accessing custom context - [Tasks > Build tasks > Abort and cancel actions](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/abort-tasks/page.md) - Action lifetime - Canceling actions programmatically - External abort - Aborting via the CLI - Handling external aborts - [Tasks > Build tasks > Run a bioinformatics tool](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/container-tasks/page.md) - What are container tasks? - How data flows in and out - Basic usage - Template syntax for inputs - Using container tasks in workflows - Advanced: Passing files and directories - Use case: Agentic sandbox execution - Use case: Legacy and specialized containers - Use case: Multi-language workflows - Configuration options - ContainerTask parameters - Supported input/output types - Best practices - Local execution - When to use container tasks - [Tasks > Build tasks > Links](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/links/page.md) - Creating a link - Using execution metadata - Dynamic links with override - [Tasks > Build tasks > Reports](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/reports/page.md) - A simple example - A more complex example - Streaming example - Rendering a custom type - [Tasks > Build tasks > Notebooks](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/notebooks/page.md) - Iterating on and running a workflow - Accessing runs and downloading logs - [Tasks > Build tasks > Remote tasks](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/remote-tasks/page.md) - Prerequisites - Basic usage - Understanding lazy loading - When tasks are fetched - Benefits of lazy loading - Error handling - Eager fetching with `fetch()` - Module-level vs dynamic loading - Complete example - Team A: Spark environment - Team B: ML environment - Team C: Orchestration - Invoke remote tasks in a script. - Why use remote tasks? - When to use remote tasks - How remote tasks work - Security model - Type system - Versioning options - Customizing remote tasks - Available overrides - Override examples - Chain overrides - Best practices - 1. Use meaningful task names - 2. Document task interfaces - 3. Prefer module-level loading - 4. Handle versioning thoughtfully - 5. Deploy remote tasks first - Limitations - Next steps - [Tasks > Build tasks > Error handling](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/error-handling/page.md) - How Flyte represents failures - Catching and recovering from errors - Limiting inline I/O - Natively-supported exceptions - Related pages - [Tasks > Build tasks > Traces](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/traces/page.md) - What are traced functions for? - What gets traced - Errors are not recorded - Supported function types - Task orchestration pattern - Relationship to caching and checkpointing - How they work together - Execution flow - Error handling and observability - Examples in practice - LLM pipeline with traces - [Tasks > Build tasks > Intra-task checkpoints](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/intra-task-checkpoints/page.md) - The checkpoint object - Basic usage - Async - Sync - Checkpointing ML training frameworks - PyTorch - PyTorch Lightning - Hugging Face Trainer - scikit-learn - Unsloth - How checkpoints are stored - [Tasks > Build tasks > Grouping actions](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/grouping-actions/page.md) - What are groups? - The problem groups solve - How groups work - Common grouping patterns - Sequential operations - Parallel processing with groups - Multi-phase workflows - Conditional grouping - Key insights - [Tasks > Build tasks > Fanout](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/fanout/page.md) - Understanding fanout - Example - Parallel execution - Running the example - How Flyte handles concurrency and parallelism - Iterative fanout: recursive feature elimination - [Tasks > Build tasks > Mapping over inputs](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/map/page.md) - Minimal example - Mapping from an async task: `flyte.map.aio` - Signature and parameters - Limiting concurrency - Handling errors - Binding constant arguments with `functools.partial` - When to use `flyte.map` - [Tasks > Build tasks > Consuming a message queue](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/consuming-a-message-queue/page.md) - The consumer - Define the task environment - Process a single message - The consumer loop - Run it - The producer - Notes and gotchas - [Tasks > Build tasks > Controlling parallel execution](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/controlling-parallelism/page.md) - The problem: unbounded parallelism - Using asyncio.Semaphore - Using flyte.map with concurrency - Running the example - When to use each approach - [Tasks > Build tasks > Streaming map-reduce](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/streaming-map-reduce/page.md) - When to use it - Example - The driver task - Running the example - How it works - [Tasks > Build tasks > Structured concurrency with anyio](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/structured-concurrency-anyio/page.md) - The task-group pattern - When to use anyio - [Tasks > Build tasks > Task dependencies and ordering](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/task-dependencies/page.md) - The dependency graph is implicit - Ordering without a data dependency - Fan-out and fan-in - Dependency-driven scheduling - When to reach for `as_completed` - Summary - [Tasks > Build tasks > External conditions](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/conditions/page.md) - Supported types - Example: human approval - Example: string input at runtime - Parameters - Signaling a condition - From the CLI - From Python (remote) - Timeout with a fallback - Errors - [Tasks > Build tasks > Test business logic directly](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/unit-testing/page.md) - Understanding task invocation - Direct function invocation - Using `flyte.run()` - Testing business logic - Testing async tasks - Testing nested tasks - Testing type transformations and serialization - Testing type restrictions - Testing nested tasks with serialization - Testing traced functions - Best practices - Quick reference - Example test suite - Future improvements - [Tasks > Build tasks > Higher-order functions](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/higher-order-functions/page.md) - Fallback runner - Retry with increasing memory (OOM retrier) - Circuit breaker - Auto batcher - Composing the patterns - [Tasks > Build tasks > Regular async function (not a task)](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-programming/other-features/page.md) - Task forwarding - Passing tasks and functions as arguments - Custom action names - Set at task definition - Override at call time - Invoking async functions from sync tasks - Async and sync task interoperability - Calling sync tasks from async tasks - Using with `flyte.map.aio()` - Using AnyIO in async tasks - [Tasks > Run and deploy tasks](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-deployment/page.md) - Ephemeral deployment and immediate execution - Programmatic - CLI - Persistent deployment - Programmatic - CLI - Running already deployed tasks - Programmatic - CLI - Configuring runs with `flyte.with_runcontext()` > Section bundle (all pages): https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-deployment/section.md - [Tasks > Run and deploy tasks > How task run works](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-deployment/how-task-run-works/page.md) - Ephemeral deployment + run: The development shortcut - Programmatic - CLI - Running deployed tasks - Programmatic - CLI - Local execution - Programmatic - CLI - Running tasks through the Union UI - Accessing task execution in the Union UI - Execution flow and architecture - Fast registration architecture - Ephemeral preparation logic - Execution modes comparison - [Tasks > Run and deploy tasks > Interact with runs and actions](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-deployment/interacting-with-runs/page.md) - Understanding runs and actions - Key concepts - Working with runs - Retrieving a run - Programmatic - CLI - Filtering runs by label - CLI - Programmatic - UI - Watching run progress - Getting detailed run information - Working with actions - Retrieving an action - Programmatic - CLI - Nested actions - Getting detailed action information - Accessing logs - Retrieving inputs and outputs - Programmatic - CLI - Handling failures - Understanding data storage - Accessing large data from cloud storage - S3 storage access - GCS storage access - Azure Blob Storage access - Complete example - API reference - Key classes - CLI commands - Storage configuration - [Tasks > Run and deploy tasks > View logs](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-deployment/view-logs/page.md) - Stream logs with the CLI - Raw vs. pretty output - View the logs for a specific attempt - Filter out system logs - Scope to a project and domain - Command options - View logs in the console - Related - [Tasks > Run and deploy tasks > Work with local data](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-deployment/work-with-local-data/page.md) - Local execution - Uploading local data to remote runs - Uploading DataFrames - Uploading files - Uploading directories - Passing outputs between runs - Performance considerations - Summary - [Tasks > Run and deploy tasks > Run command options](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-deployment/run-command-options/page.md) - `--project`, `--domain` - `--run-project`, `--run-domain` - `--local` - When to use local execution - `--copy-style` - Copy style options - `--root-dir` - `--raw-data-path` - Use cases - `--service-account` - Use cases - `--name` - Benefits of custom names - `--label` - `--follow` - Behavior - `--image` - Image mapping formats - `--no-sync-local-sys-paths` - Task argument passing - Passing inputs by type - Boolean inputs - Datetime and duration inputs - Enum inputs - List, dict, dataclass, and other structured inputs - File, directory, and dataframe inputs - Optional inputs - Positional arguments - SDK options - [Tasks > Run and deploy tasks > Build a custom CLI](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-deployment/custom-cli/page.md) - The pattern - Example: a typed CLI with `tyro` - Using a different parser - When to use which - [Tasks > Run and deploy tasks > How task deployment works](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-deployment/how-task-deployment-works/page.md) - 1. Module loading and task environment discovery - Single file (default) - `--all` option - `--recursive` option - 2. Task analysis and serialization - 3. Task environment dependency resolution - 4. Code bundle creation and upload - `--copy_style loaded_modules` (default) - `--copy_style all` - `--copy_style none` - `--root-dir` option - 5. Image building - Local image building - Remote image building - 6. Source-code link discovery - How the link is built - Conditions - Understanding option relationships - [Tasks > Run and deploy tasks > Deploy command options](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-deployment/deploy-command-options/page.md) - `--project`, `--domain` - `--version` - When versions are used - `--dry-run` - `--all` and `--recursive` - `--copy-style` - `--copy-style loaded_modules` (default) - `--copy-style all` - `--copy-style none` - `--root-dir` - Default behavior (without `--root-dir`) - Common use cases - How it works - Example with complex project structure - `--image` - Named image mappings - Default image mapping - How it works - `--ignore-load-errors` - `--no-sync-local-sys-paths` - Default behavior (path synchronization enabled) - When to disable path synchronization - Use cases for disabling - How it works - SDK deployment options - [Tasks > Run and deploy tasks > Code packaging for remote execution](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-deployment/packaging/page.md) - Quick comparison - Code bundling - How it works - Automatic code bundling - Manual code bundling - Including additional files with `include` - Controlling the root directory - Code bundling examples - When to use code bundling - Container-based deployment - How it works - Configuration - Image source copying methods - Complete container-based example - Using externally built images - Container-based best practices - When to use container-based deployment - Choosing the right approach - Decision tree - Hybrid approach - Troubleshooting - Import errors - Code changes not reflected - Files missing in container - Container build failures - Version conflicts - [Tasks > Run and deploy tasks > Deployment patterns](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-deployment/deployment-patterns/page.md) - Overview of deployment patterns - Simple file deployment - Example structure - Deployment commands - When to use - Custom Dockerfile deployment - Example structure - Alternative: Dockerfile in different directory - Key considerations - When to use - PyProject package deployment - Example structure - Business logic modules - Flyte orchestration layer - Entrypoint configuration - Dependencies and configuration - Key features - Key learning points - Usage patterns - What this example demonstrates - When to use - Package structure deployment - Example structure - Key concepts - Running with root directory - How `--root-dir` works - Alternative: Using a Python project - When to use - Full build deployment - Overview - Key configuration - Local dependency example - Critical configuration components - Configuration options - Version management best practices - Performance considerations - When to use - Troubleshooting - Python path deployment - Example structure - Implementation - Task environment dependencies - Key considerations - CLI vs direct Python execution - Best practices - Common pitfalls - When to use - Dynamic environment deployment - Domain-based environment selection - Why this pattern works - How it works - Important constraints - Alternative: environment variable approach - Usage patterns - When to use dynamic environments - Dependency and version management - Recommended: use a lockfile - No lockfile? Install against Flyte's published constraints - Choosing an approach - Best practices - Project organization - Image management - Configuration management - Development workflow - Choosing the right pattern - [Tasks > Run and deploy tasks > Run context](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-deployment/run-context/page.md) - Configuring a run with `flyte.with_runcontext()` - Execution target - Storage - Caching - Identity and resources - Logging - Code bundling - Context propagation - Reading context inside a task with `flyte.ctx()` - `TaskContext` fields - `ActionID` fields - Naming external resources - [Tasks > Run and deploy tasks > Entrypoint tasks](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-deployment/entrypoints/page.md) - When to use entrypoints - Mark a task as an entrypoint - Discover entrypoint tasks - CLI - Programmatic - UI - [Tasks > Run and deploy tasks > Run a Python script](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-deployment/run-python-script/page.md) - When to use it - Quickstart - What you can specify - Handling dependencies - 1. Standard library only - 2. Pip packages on top of the default image - 3. Bring your own image - Handling inputs and outputs - Passing inputs - Capturing outputs - Bundling: what gets uploaded - Python API - [Tasks > Run and deploy tasks > Run with notifications](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-deployment/run-with-notifications/page.md) - Execution phases - Template variables - Slack notifications - Email notifications - [Tasks > Run and deploy tasks > Rerun a run](https://www.union.ai/docs/latest/flyte/user-guide/tasks/task-deployment/rerun-runs/page.md) - Rerun from the UI - Rerun an entire run - Rerun a single action - Rerun from the CLI - `flyte rerun`: rerun with the original code and inputs - `flyte run --rerun-from`: rerun with new local code - Choosing between the two - Rerun programmatically - Related - [Apps](https://www.union.ai/docs/latest/flyte/user-guide/apps/page.md) - [Configure apps](configure-apps/page.md) - [Build apps](build-apps/page.md) - [Native app integrations](native-app-integrations/page.md) - [Serve and deploy apps](serve-and-deploy-apps/page.md) - Related - [Tasks](../tasks/page.md) - [Agents](../agents/page.md) - [Apps > Configure apps](https://www.union.ai/docs/latest/flyte/user-guide/apps/configure-apps/page.md) - Hello World example - Using fserve args - Using @app_env.server - Differences from TaskEnvironment - Configuration topics > Section bundle (all pages): https://www.union.ai/docs/latest/flyte/user-guide/apps/configure-apps/section.md - [Apps > Configure apps > App environment settings](https://www.union.ai/docs/latest/flyte/user-guide/apps/configure-apps/app-environment-settings/page.md) - Shared environment settings - App-specific environment settings - Environment variable substitution in `args` - App startup - Server decorator via `@app_env.server` - Container command via `command` vs `args` - Shared settings - [Apps > Configure apps > Including additional files](https://www.union.ai/docs/latest/flyte/user-guide/apps/configure-apps/including-additional-files/page.md) - How include works - When to use include - Examples - Multi-file Streamlit app - Multi-file FastAPI app - App with configuration files - File discovery - Path resolution - Best practices - Limitations - [Apps > Configure apps > Passing parameters into app environments](https://www.union.ai/docs/latest/flyte/user-guide/apps/configure-apps/passing-parameters/page.md) - Parameter types overview - Basic parameter types - Accessing parameters in your app - `mount` - `env_var` - `get_parameter` - Full example - Delayed values - RunOutput - AppEndpoint - Overriding parameters at serve time - Example: FastAPI app with configurable model - Example: Using RunOutput for model serving - Best practices - Limitations - [Apps > Configure apps > /// script](https://www.union.ai/docs/latest/flyte/user-guide/apps/configure-apps/auto-scaling-apps/page.md) - Autoscaling apps - Scaling configuration - Basic scaling example - Scaling patterns - Idle TTL (Time to live) - Autoscaling best practices - Autoscaling limitations - Autoscaling troubleshooting - [Apps > Configure apps > Apps depending on other environments](https://www.union.ai/docs/latest/flyte/user-guide/apps/configure-apps/apps-depending-on-environments/page.md) - Basic usage - Example: App calling another app - Dependency chain - Multiple dependencies - Using AppEndpoint for dependency URLs - Deployment behavior - Task environment dependencies - Best practices - Example: A/B testing with dependencies - Limitations - [Apps > Build apps](https://www.union.ai/docs/latest/flyte/user-guide/apps/build-apps/page.md) - App types - Usage patterns - Next steps > Section bundle (all pages): https://www.union.ai/docs/latest/flyte/user-guide/apps/build-apps/section.md - [Apps > Build apps > Single-script apps](https://www.union.ai/docs/latest/flyte/user-guide/apps/build-apps/single-script-apps/page.md) - Plain Python HTTP server - Streamlit app - FastAPI app - Running single-script apps - When to use single-script apps - [Apps > Build apps > Multi-script apps](https://www.union.ai/docs/latest/flyte/user-guide/apps/build-apps/multi-script-apps/page.md) - FastAPI multi-script app - Project structure - Example: Multi-file FastAPI app - Automatic file discovery - Streamlit multi-script app - Project structure - Example: Multi-file Streamlit app - Deploying multi-file Streamlit app - Complex multi-file example - Project structure - Example code - Deploying complex app - Best practices - Troubleshooting - [Apps > Build apps > Serving graphs](https://www.union.ai/docs/latest/flyte/user-guide/apps/build-apps/serving-graphs/page.md) - Core concepts: a minimal two-app chain - Deploying multiple apps together with `depends_on` - Getting an upstream app's endpoint - Sizing each node independently - Example: CPU / GPU inference split - Disjoint images per node - GPU app: model.forward only - CPU app: pre/postprocess + call GPU - Deploy - Example: A/B testing with Statsig - Statsig client singleton - Variant apps - Root app with Statsig in its lifespan - App environments - Routing endpoint - Deploy - When to split into a serving graph - Best practices - [Apps > Build apps > Hybrid app-task graphs](https://www.union.ai/docs/latest/flyte/user-guide/apps/build-apps/hybrid-graphs/page.md) - Call app from task - Example: FastAPI app called from a task - Example: Call a model inference service from a task - Call task from app (webhooks / APIs) - Example: Basic webhook app - Advanced webhook patterns - Webhook security and best practices - Example: GitHub webhook - Gradio agent UI - Best practices - [Apps > Build apps > WebSocket apps](https://www.union.ai/docs/latest/flyte/user-guide/apps/build-apps/websocket-apps/page.md) - Example: Basic WebSocket app - WebSocket patterns - Using WebSockets with Flyte tasks - WebSocket client example - Best practices - [Apps > Build apps > Browser apps](https://www.union.ai/docs/latest/flyte/user-guide/apps/build-apps/browser-apps/page.md) - Accessing browser-based apps - Common browser-based app types - Streamlit apps - Gradio apps - Custom HTML/JS apps - Best practices - [Apps > Build apps > Secret-based authentication](https://www.union.ai/docs/latest/flyte/user-guide/apps/build-apps/secret-based-authentication/page.md) - Create the secret - Define the FastAPI app - Deploy the FastAPI app - Invoke the endpoint - Authentication for vLLM and SGLang apps - Create the authentication secret - Deploy vLLM app with authentication - Deploy SGLang app with authentication - Invoke authenticated LLM endpoints - Accessing Swagger documentation - Security best practices - Troubleshooting - Next steps - [Apps > Native app integrations](https://www.union.ai/docs/latest/flyte/user-guide/apps/native-app-integrations/page.md) - When to use a native integration - Available integrations - Next steps > Section bundle (all pages): https://www.union.ai/docs/latest/flyte/user-guide/apps/native-app-integrations/section.md - [Apps > Native app integrations > Streamlit app](https://www.union.ai/docs/latest/flyte/user-guide/apps/native-app-integrations/streamlit-app/page.md) - Basic Streamlit app - Single-file Streamlit app - Multi-file Streamlit app - Example: Data visualization dashboard - Best practices - Troubleshooting - [Apps > Native app integrations > FastAPI app](https://www.union.ai/docs/latest/flyte/user-guide/apps/native-app-integrations/fastapi-app/page.md) - Basic FastAPI app - Serving a machine learning model - Accessing Swagger documentation - Example: REST API with multiple endpoints - Multi-file FastAPI app - Local-to-remote model serving - Best practices - Advanced features - Troubleshooting - [Apps > Native app integrations > vLLM app](https://www.union.ai/docs/latest/flyte/user-guide/apps/native-app-integrations/vllm-app/page.md) - Installation - Basic vLLM app - Using prefetched models - Model streaming - Custom vLLM arguments - Using the OpenAI-compatible API - Multi-GPU inference (Tensor parallelism) - Model sharding with prefetch - Autoscaling - Best practices - Troubleshooting - API reference - [Apps > Native app integrations > SGLang app](https://www.union.ai/docs/latest/flyte/user-guide/apps/native-app-integrations/sglang-app/page.md) - Installation - Basic SGLang app - Using prefetched models - Model streaming - Custom SGLang arguments - Using the OpenAI-compatible API - Multi-GPU inference (Tensor parallelism) - Model sharding with prefetch - Autoscaling - Structured generation - Best practices - Troubleshooting - API reference - [Apps > Native app integrations > Ollama app](https://www.union.ai/docs/latest/flyte/user-guide/apps/native-app-integrations/ollama-app/page.md) - Installation - Basic Ollama app - Choosing a model - Using the OpenAI-compatible API - Chat UI with Streamlit - Authentication - Autoscaling - Best practices - Troubleshooting - [Apps > Native app integrations > Flyte webhook](https://www.union.ai/docs/latest/flyte/user-guide/apps/native-app-integrations/flyte-webhook/page.md) - Available endpoints - Basic usage - Filtering endpoints - Endpoint groups - Individual endpoints - Allow-listing - Task allow-list - App allow-list - Trigger allow-list - Calling the webhook - Authentication - Self-reference protection - [Apps > Serve and deploy apps](https://www.union.ai/docs/latest/flyte/user-guide/apps/serve-and-deploy-apps/page.md) - Serve vs deploy - `flyte serve` - `flyte deploy` - Using Python SDK - Serve - Deploy - Using the CLI - Serve - Deploy - Next steps > Section bundle (all pages): https://www.union.ai/docs/latest/flyte/user-guide/apps/serve-and-deploy-apps/section.md - [Apps > Serve and deploy apps > How app serving works](https://www.union.ai/docs/latest/flyte/user-guide/apps/serve-and-deploy-apps/how-app-serving-works/page.md) - Overview - Using the Python SDK - Overriding parameters - Advanced serving options - Using CLI - Return value - Best practices - Troubleshooting - [Apps > Serve and deploy apps > How app custom domains work](https://www.union.ai/docs/latest/flyte/user-guide/apps/serve-and-deploy-apps/how-app-custom-domain-works/page.md) - [Apps > Serve and deploy apps > How app deployment works](https://www.union.ai/docs/latest/flyte/user-guide/apps/serve-and-deploy-apps/how-app-deployment-works/page.md) - Overview - Using the Python SDK - Deployment plan - Overriding app configuration at deployment time - Activation/deactivation - Using the CLI - Example: Full deployment configuration - Best practices - Deployment status and return value - Troubleshooting - [Apps > Serve and deploy apps > Activating and deactivating apps](https://www.union.ai/docs/latest/flyte/user-guide/apps/serve-and-deploy-apps/activating-and-deactivating-apps/page.md) - Activation - Activate after deployment - Activate an app - Check activation status - Deactivation - Lifecycle management - Typical deployment workflow - Blue-green deployment - Using CLI - Activate - Deactivate - Check status - Best practices - Automatic activation with serve - Example: Complete deployment and activation - Troubleshooting - [Apps > Serve and deploy apps > Prefetching models](https://www.union.ai/docs/latest/flyte/user-guide/apps/serve-and-deploy-apps/prefetching-models/page.md) - Why prefetch? - Basic prefetch - Using Python SDK - Using CLI - Using prefetched models - Prefetch options - Custom artifact name - With HuggingFace token - With resources - Sharding models for multi-GPU - vLLM sharding - Using shard config via CLI - Using prefetched sharded models - CLI options - Complete example - Best practices - Troubleshooting - [Agents](https://www.union.ai/docs/latest/flyte/user-guide/agents/page.md) - [Build an agent](build-agent/page.md) - [Build an MCP](build-mcp/page.md) - [Sandboxing](sandboxing/page.md) - Related - [Agent frameworks](../../integrations/agents/page.md) - [Tasks](../tasks/page.md) - [Agents > Build an agent](https://www.union.ai/docs/latest/flyte/user-guide/agents/build-agent/page.md) - How Flyte maps to the agentic world - Ways to build an agent - Deploying an agent - Related > Section bundle (all pages): https://www.union.ai/docs/latest/flyte/user-guide/agents/build-agent/section.md - [Agents > Build an agent > Pure Python agents](https://www.union.ai/docs/latest/flyte/user-guide/agents/build-agent/python-agents/page.md) - ReAct pattern: Reason, Act, Observe (no framework needed) - Plan-and-Execute with parallel fan-out - More agentic patterns - How Flyte's primitives map to the agent stack - Next steps - [Agents > Build an agent > Flyte-native agents](https://www.union.ai/docs/latest/flyte/user-guide/agents/build-agent/flyte-agents/page.md) - How it works - Sync vs async - A minimal agent - Tools - Customizing a tool with `tool(...)` - MCP integration - Skills - Observability - Extending the agent class - `run` is sync-by-default - Strategy 1: wrap the built-in loop - Strategy 2: implement `run` from scratch - Choosing between subclassing and composition - Next steps - [Agents > Build an agent > Bring your own framework](https://www.union.ai/docs/latest/flyte/user-guide/agents/build-agent/bring-your-own-framework/page.md) - How much control does the framework give you? - The core pattern - Make tools durable - Trace the framework's internals - Fan out across containers - Checklist - Next steps - [Agents > Build an agent > Agent memory](https://www.union.ai/docs/latest/flyte/user-guide/agents/build-agent/agent-memory/page.md) - What a `MemoryStore` holds - Sync vs async - Keyed stores: the easy path - Working with a MemoryStore independently - Optimistic concurrency - Optional capabilities - Passing memory to the agent - Lower-level usage - Next steps - [Agents > Build an agent > Agent chat UI](https://www.union.ai/docs/latest/flyte/user-guide/agents/build-agent/agent-chat-ui/page.md) - Option 1: the built-in chat UI - Option 2: a custom FastAPI chat app - Next steps - [Agents > Build an agent > Deploy an agent as a service](https://www.union.ai/docs/latest/flyte/user-guide/agents/build-agent/deploy-agent-as-service/page.md) - As a task - As a scheduled task (via `Trigger`) - Behind a webhook (`AppEnvironment`) - Chat and other app patterns - [Agents > Build an MCP](https://www.union.ai/docs/latest/flyte/user-guide/agents/build-mcp/page.md) - HTTP layout - Quickstart - [Agents > Build an MCP > User-defined MCP server](https://www.union.ai/docs/latest/flyte/user-guide/agents/build-mcp/mcp_server/page.md) - When to use it - How it works - Basic example - HTTP layout - Choosing a transport - Connecting a client - Claude Code - OpenCode - Configuration tips - Best practices - [Agents > Build an MCP > Flyte MCP server](https://www.union.ai/docs/latest/flyte/user-guide/agents/build-mcp/flyte_mcp_server/page.md) - When to use it - How to run it - Running locally with `uvx` - Deploying remotely - Basic example - Scoping the server - 1. Tool groups - 2. Individual tools - 3. Allowlists - Enabling the search tools - Putting it together: a filtered server - Connecting a client - Claude Code: local (stdio) - Claude Code: remote (HTTP) - OpenCode: local - OpenCode: remote - Best practices - MCP tools reference - [Agents > Sandboxing](https://www.union.ai/docs/latest/flyte/user-guide/agents/sandboxing/page.md) - Why sandboxing matters for AI - Types of sandboxes - What Flyte offers - Workflow sandbox (Monty) - Code sandbox (container) - When to use which - Learn more > Section bundle (all pages): https://www.union.ai/docs/latest/flyte/user-guide/agents/sandboxing/section.md - [Agents > Sandboxing > Workflow sandboxing in Flyte](https://www.union.ai/docs/latest/flyte/user-guide/agents/sandboxing/workflow-sandboxing-flyte/page.md) - Why workflow sandboxing? - How it works - Example: sandboxed orchestrator - Example: dynamic code execution - Reusable task from a code string - One-shot local execution - Parameterized code generation - Building agents with programmatic tool calling - Syntax restrictions - Allowed - Not allowed - Type restrictions - Security model - [Agents > Sandboxing > Programmatic tool calling for agents](https://www.union.ai/docs/latest/flyte/user-guide/agents/sandboxing/code-mode/page.md) - Programmatic tool calling vs sequential tool calling - Why programmatic tool calling is powerful - Token efficiency - Performance - Natural programming patterns - Progressive tool discovery - Data privacy - Example: sequential vs programmatic tool calling - Sequential tool calling approach - Programmatic tool calling approach - Example: defining tools - Example: programmatic tool-calling agent - Example: chat app - Example: durable agent - References - [Agents > Sandboxing > Code sandboxing](https://www.union.ai/docs/latest/flyte/user-guide/agents/sandboxing/code-sandboxing/page.md) - Execution modes - Auto-IO mode - Verbatim mode - Command mode - Executing a sandbox - Error handling - Supported types - How types are handled - Configuring the container image - Python packages - System packages - Additional Dockerfile commands - Pre-built images - Image configuration - Runtime configuration - Resources - Retries - Timeout - Environment variables - Secrets - Caching - Deploying a sandbox as a task - End-to-end example - API reference - `flyte.sandbox.create()` - Sandbox methods - [Project patterns](https://www.union.ai/docs/latest/flyte/user-guide/project-patterns/page.md) - [Bring your own image (BYOI)](bring-your-own-image/page.md) - [Monorepo with uv](monorepo-with-uv/page.md) - [CI/CD deployments](cicd/page.md) - [Project patterns > Bring your own image](https://www.union.ai/docs/latest/flyte/user-guide/project-patterns/bring-your-own-image/page.md) - The multi-team problem - Pattern 1: Pure BYOI - Dockerfiles - Build and push - Python code - Run and deploy - Pattern 2: Remote builder - The base images - Adapting with `flyte.Image` - Task definitions - Entry point - Run and deploy - Decision matrix - [Project patterns > Structuring Flyte projects with uv](https://www.union.ai/docs/latest/flyte/user-guide/project-patterns/monorepo-with-uv/page.md) - The two layers - How the image gets built - `with_code_bundle()`: one image for dev and prod - `root_dir` - Monorepo patterns - Pattern A: Shared lockfile (recommended) - Pattern B: Independent packages - Pattern C: uv workspace (`[tool.uv.workspace]`) - The full build path (production) - [Project patterns > CI/CD deployments](https://www.union.ai/docs/latest/flyte/user-guide/project-patterns/cicd/page.md) - What CI needs to do - Authentication: client credentials - Register a client-credentials application - Store the secret as a CI secret - Point the CLI at the credential - Scope and rotation - Project configuration - `config.yaml` - The GitHub Actions workflow - Key flag choices - Splitting build from deploy - [Scale your runs](https://www.union.ai/docs/latest/flyte/user-guide/run-scaling/page.md) - Understanding Flyte execution - Performance optimization - Key concepts for scaling > Section bundle (all pages): https://www.union.ai/docs/latest/flyte/user-guide/run-scaling/section.md - [Scale your runs > Data flow](https://www.union.ai/docs/latest/flyte/user-guide/run-scaling/data-flow/page.md) - Overview - Data types and transport - Passed by reference - Passed by value (inline I/O) - Task execution and data flow - Input download - Output upload - Task-to-task data flow - Caching and data hashing - Cache key computation - Inline data caching - Raw data hashing - Cache control - Traces and data flow - Object stores and latency considerations - Configuring data storage - Organization and project level - Per-run configuration - [Scale your runs > Life of a run](https://www.union.ai/docs/latest/flyte/user-guide/run-scaling/life-of-a-run/page.md) - Overview - Phase 1: Code analysis and preparation - Phase 2: Image building - Phase 3: Code bundling - Default: `copy_style="loaded_modules"` - Alternative: `copy_style="none"` - Phase 4: Upload code bundle - Phase 5: Run creation and queuing - Phase 6: Task execution in data plane - Container startup - Invoking downstream tasks - Execution flow diagram - Action identifiers and crash recovery - Downstream task execution - Reusable containers - Reusable container execution flow - State replication and visualization - Queue service to run service - UI limitations - Optimization opportunities - [Scale your runs > Scale your workflows](https://www.union.ai/docs/latest/flyte/user-guide/run-scaling/scale-your-workflows/page.md) - Understanding performance dimensions - Latency - Throughput - Task execution overhead - The overhead principle - System architecture and data flow - Optimization strategies - 1. Use reusable containers for concurrency - 2. Batch workloads to reduce overhead - 3. Use traces for lightweight operations - 4. Limit fanout for system stability - 5. Optimize data transfer - 6. Use caching - 7. Parallelize with `flyte.map` - Performance tuning workflow - Real-world example: PyIceberg batch processing - Example: Optimizing a data pipeline - Before optimization - After optimization - When to contact the Union team - [Scale your runs > Maximize GPU utilization for batch inference](https://www.union.ai/docs/latest/flyte/user-guide/run-scaling/batch-inference/page.md) - Why GPU utilization drops - Serving vs in-process batch inference - Solution: `DynamicBatcher` - Basic usage - Cost estimation - `TokenBatcher` for LLM inference - Combining with app environments - Example: batch LLM inference with vLLM behind a FastAPI app - Monitoring utilization - [Advanced project: LLM reporting agent](https://www.union.ai/docs/latest/flyte/user-guide/advanced-project/page.md) - What you'll build - Concepts covered - Architecture - Prerequisites - Parts - Key takeaways > Section bundle (all pages): https://www.union.ai/docs/latest/flyte/user-guide/advanced-project/section.md - [Advanced project: LLM reporting agent > Resilient generation](https://www.union.ai/docs/latest/flyte/user-guide/advanced-project/resilient-generation/page.md) - Two environments - Reusable environment for LLM work - ReusePolicy parameters - Standard environment for orchestration - Traced LLM calls - Benefits of tracing - When to use @flyte.trace - Traced helper functions - Retry strategies - Configuring retries - Combining tracing with retries - Structured prompts - Pydantic models for structured output - Next steps - [Advanced project: LLM reporting agent > Agentic refinement](https://www.union.ai/docs/latest/flyte/user-guide/advanced-project/agentic-refinement/page.md) - The agentic pattern - Critique function - Revise function - The refinement loop - How it works - Early exit - Grouping iterations with flyte.group - Why use flyte.group? - Group context - Configuring the loop - Choosing thresholds - Best practices for agentic loops - Next steps - [Advanced project: LLM reporting agent > Parallel outputs](https://www.union.ai/docs/latest/flyte/user-guide/advanced-project/parallel-outputs/page.md) - The formatting functions - When to trace and when not to - Parallel execution with asyncio.gather - How asyncio.gather works - When to use asyncio.gather - Grouping parallel operations - Collecting outputs in a directory - The batch pipeline - Pipeline flow - Running the pipeline - Cost optimization tips - 1. Choose the right model - 2. Tune iteration parameters - 3. Use caching effectively - 4. Scale the batch - Next steps - [Advanced project: LLM reporting agent > Serving app](https://www.union.ai/docs/latest/flyte/user-guide/advanced-project/serving-app/page.md) - App environment configuration - Key configuration - Connecting to pipeline output with RunOutput - The Streamlit application - Displaying multiple reports - Generation instructions - Deploying the app - Workflow: Generate then view - Automatic updates with RunOutput - Complete example structure - Running the complete example - Summary - [Migration](https://www.union.ai/docs/latest/flyte/user-guide/migration/page.md) - [From Flyte 1 to 2](flyte-2/page.md) - [From Airflow to Flyte](from-airflow/page.md) - [Migration > From Flyte 1 to 2](https://www.union.ai/docs/latest/flyte/user-guide/migration/flyte-2/page.md) - Pure Python execution - Sync Python - Async Python - Simplified API - Fine-grained reproducibility and recoverability - Improved remote functionality - Native notebook support > Section bundle (all pages): https://www.union.ai/docs/latest/flyte/user-guide/migration/flyte-2/section.md - [Migration > From Flyte 1 to 2 > Migration overview](https://www.union.ai/docs/latest/flyte/user-guide/migration/flyte-2/overview/page.md) - Pure Python execution - Flyte 1 - Flyte 2 - Asynchronous model - True parallelism for all workloads - Calling sync tasks from async tasks - The `flyte.map` function: Familiar patterns - Sync Map - Async Map - Terminology and concept mapping - Package imports - Flyte 1 - Flyte 2 - The two mechanical changes behind (almost) every migration - 1. Move task configuration into a `TaskEnvironment` - 2. Replace `@task` / `@workflow` / `@dynamic` with `@env.task` - In this section - Quick reference - [Migration > From Flyte 1 to 2 > Tasks and workflows](https://www.union.ai/docs/latest/flyte/user-guide/migration/flyte-2/tasks-and-workflows/page.md) - Hello world: tasks and workflows - Flyte 1 - Flyte 2 - Chaining and ordering - Flyte 1 - Flyte 2 - Subworkflows - Flyte 1 - Flyte 2 - TaskEnvironment configuration - Parameter mapping: `@task` → `TaskEnvironment` + `@env.task` - Next - [Migration > From Flyte 1 to 2 > Task configuration](https://www.union.ai/docs/latest/flyte/user-guide/migration/flyte-2/configuration/page.md) - Image, resources, and caching - Flyte 1 - Flyte 2 - Container images - Resources - Caching - Secrets - Flyte 1 - Flyte 2 - Scheduling - Flyte 1 - Flyte 2 - Next - [Migration > From Flyte 1 to 2 > CLI and configuration](https://www.union.ai/docs/latest/flyte/user-guide/migration/flyte-2/cli-and-configuration/page.md) - CLI command mapping - Running tasks - Flyte 1 - Flyte 2 - Deploying - Flyte 1 - Flyte 2 - Key flag differences - Configuration files - Flyte 1 - Flyte 2 - Configuring in code - Next - [Migration > From Flyte 1 to 2 > Control flow](https://www.union.ai/docs/latest/flyte/user-guide/migration/flyte-2/control-flow/page.md) - Conditional execution - Flyte 1 - Flyte 2 - Dynamic workflows - Flyte 1 - Flyte 2 - Error handling - Flyte 1 - Flyte 2 - Next - [Migration > From Flyte 1 to 2 > Parallelism and fan-out](https://www.union.ai/docs/latest/flyte/user-guide/migration/flyte-2/parallelism/page.md) - Fan-out: `map_task` - Flyte 1 - Flyte 2 (flyte.map) - Flyte 2 (asyncio.gather) - Choosing `flyte.map` vs `asyncio.gather` - Concurrency control and error handling - Data backfills - Flyte 1 - Flyte 2 - Next - [Migration > From Flyte 1 to 2 > Data types and I/O](https://www.union.ai/docs/latest/flyte/user-guide/migration/flyte-2/data-io/page.md) - Files and directories - Flyte 1 - Flyte 2 - DataFrames - Flyte 1 - Flyte 2 - Dataclasses and structured types - Flyte 1 - Flyte 2 - Data ETL - Flyte 1 - Flyte 2 - Next - [Migration > From Flyte 1 to 2 > ML workloads](https://www.union.ai/docs/latest/flyte/user-guide/migration/flyte-2/ml-workloads/page.md) - Small model training (scikit-learn / XGBoost) - Flyte 1 - Flyte 2 - Hyperparameter optimization - Flyte 1 - Flyte 2 - Large model training (deep learning) - Flyte 1 - Flyte 2 - Batch inference - Flyte 1 - Flyte 2 - A complete example: end-to-end ML pipeline - Flyte 1 - Flyte 2 - Next - [Migration > From Flyte 1 to 2 > New in Flyte 2: patterns that weren't possible in Flyte 1](https://www.union.ai/docs/latest/flyte/user-guide/migration/flyte-2/new-in-flyte-2/page.md) - Real-time inference and model serving - LLM serving - App serving (dashboards and APIs) - Dynamic batching for GPU inference - Sandboxed code execution - Next - [Migration > From Flyte 1 to 2 > Hybrid v1 and v2 pipelines](https://www.union.ai/docs/latest/flyte/user-guide/migration/flyte-2/hybrid-pipelines/page.md) - Running a Flyte 2 task from a Flyte 1 workflow - 1. Create the API key and store it - 2. Write the bridging task - Running a Flyte 1 workflow from a Flyte 2 task - Considerations - See also - [Migration > From Flyte 1 to 2 > Gotchas and caveats](https://www.union.ai/docs/latest/flyte/user-guide/migration/flyte-2/gotchas-and-caveats/page.md) - Common gotchas - Non-deterministic behavior - Dealing with non-determinism - Type safety - No global state - Driver pod requirements - OOM risk from materialized I/O - [Migration > From Airflow to Flyte](https://www.union.ai/docs/latest/flyte/user-guide/migration/from-airflow/page.md) - [Part 1: Vanilla Operators](part-1-vanilla-operators/page.md) - [Migration > From Airflow to Flyte > Part 1: vanilla operators](https://www.union.ai/docs/latest/flyte/user-guide/migration/from-airflow/part-1-vanilla-operators/page.md) - 1. Where dependencies are specified - 2. The driver task (in place of DAGs) - 3. Triggers (in place of schedules) - 4. PythonOperator to `@env.task` - File and Dir: for data that doesn't fit in a return value - 5. TaskFlow to `@env.task` - TaskFlow decorator variants - 6. BashOperator to ContainerTask - When to use `ContainerTask` - How the arguments map - 7. KubernetesPodOperator to TaskEnvironment + PodTemplate - Where every KPO knob lands - What a fully-specified task looks like - 8. Orchestration: parallelism, conditionals, error handling - Parallelism - Dynamic mapping - Conditionals - Error handling - What's next - Caching - Reusable containers - Reports - Apps --- ## Tutorials - [Biotech & healthcare](https://www.union.ai/docs/latest/flyte/tutorials/biotech-healthcare/page.md) - [Genomic alignment](genomic-alignment/page.md) - [Cross-species gene comparison](genomic-gene-comparison/page.md) - [Genomic variant effect prediction](genomic-variant-effect/page.md) - [Brain tumor MRI classification](tumor-detection/page.md) - [Drug molecule screening agent](drug-molecule-screening/page.md) - [Biotech & healthcare > Genomic alignment](https://www.union.ai/docs/latest/flyte/tutorials/biotech-healthcare/genomic-alignment/page.md) - Define the container image - Define the task environments - Define the data classes - Fetch assets - Quality filtering with fastp - Build the Bowtie 2 index - Align reads - Orchestrate the workflow - Run the workflow - [Biotech & healthcare > Brain tumor MRI classification](https://www.union.ai/docs/latest/flyte/tutorials/biotech-healthcare/tumor-detection/page.md) - Define the container image - Define the task environments - Configure training - Load the dataset - Train the model - Resumable checkpointing - Generate the report - Orchestrate the pipeline - Run the pipeline - [Biotech & healthcare > Cross-species gene comparison](https://www.union.ai/docs/latest/flyte/tutorials/biotech-healthcare/genomic-gene-comparison/page.md) - Define the task environments - Orchestrate the pipeline - Run the workflow - [Biotech & healthcare > Genomic variant effect prediction](https://www.union.ai/docs/latest/flyte/tutorials/biotech-healthcare/genomic-variant-effect/page.md) - Define the task environments - Orchestrate the pipeline - Run the workflow - [Biotech & healthcare > Drug molecule screening agent](https://www.union.ai/docs/latest/flyte/tutorials/biotech-healthcare/drug-molecule-screening/page.md) - Define the task environment - Define the screening agent - Run the agentic pipeline - Two-round rescreen demo (complex execution graph) - [Geospatial](https://www.union.ai/docs/latest/flyte/tutorials/geospatial/page.md) - [GPU-accelerated climate modeling](climate-modeling/page.md) - [Geospatial > GPU-accelerated climate modeling](https://www.union.ai/docs/latest/flyte/tutorials/geospatial/climate-modeling/page.md) - Overview - Implementation - Dependencies and container image - Simulation parameters and data structures - Task environments - Data ingestion: multiple sources in parallel - Preprocessing with Dask - GPU-accelerated atmospheric simulation - Distributing across multiple GPUs - The main workflow - Running the pipeline - Key concepts - Ensemble forecasting - Adaptive mesh refinement - Real-time event detection - Where to go next - [Financial services & fintech](https://www.union.ai/docs/latest/flyte/tutorials/financial-services/page.md) - [Financial research agent](financial-research-agent/page.md) - [Fraud detection with Feast](fraud-detection-feast/page.md) - [Multi-agent trading simulation](trading-agents/page.md) - [Financial services & fintech > Multi-agent trading simulation](https://www.union.ai/docs/latest/flyte/tutorials/financial-services/trading-agents/page.md) - TL;DR - What is an agent, anyway? - What's different here? - How it works: step-by-step walkthrough - Entry point - Analyst agents - Research agents - Trading agent - Risk agents - Retaining agent memory with S3 vectors - Running the simulation - Why Flyte? _(A quick note before you go)_ - [Financial services & fintech > Fraud detection with Feast](https://www.union.ai/docs/latest/flyte/tutorials/financial-services/fraud-detection-feast/page.md) - Define the task environment - Orchestrate the pipeline - Run the workflow - [Financial services & fintech > Financial research agent](https://www.union.ai/docs/latest/flyte/tutorials/financial-services/financial-research-agent/page.md) - Setting up the environment - Data types - You.com Research and Search APIs - Synthesize briefings with Claude - Research one company - Orchestration - Run the agent - Create secrets - Run locally or remotely - [Frontier AI](https://www.union.ai/docs/latest/flyte/tutorials/frontier-ai/page.md) - [Distributed LLM pretraining](distributed-pretraining/page.md) - [Frontier AI > Distributed LLM pretraining](https://www.union.ai/docs/latest/flyte/tutorials/frontier-ai/distributed-pretraining/page.md) - Overview - Implementation - Setting up the environment - Declaring resource requirements - Model configurations - Building the GPT model - The Lightning training module - Checkpointing for fault tolerance - Real-time metrics with Flyte reports - Streaming data at scale - Distributed training with FSDP - Tying it together - Running the pipeline - Going further - [Computer vision](https://www.union.ai/docs/latest/flyte/tutorials/computer-vision/page.md) - [Fine-tuning a VLM](qwen-vl-finetuning/page.md) - [RT-DETR object detection](detr-object-detection/page.md) - [Multimodal retrieval evaluation](multimodal-retrieval-evaluation/page.md) - [Computer vision > Fine-tuning a VLM](https://www.union.ai/docs/latest/flyte/tutorials/computer-vision/qwen-vl-finetuning/page.md) - Overview - Implementation - Setting up the environment - Preparing the dataset - The adapter - Multi-node training with DeepSpeed - Fault tolerance and recovery - Live observability - Evaluation - Putting it all together - Running the tutorial - Going further - [Computer vision > Multimodal retrieval evaluation](https://www.union.ai/docs/latest/flyte/tutorials/computer-vision/multimodal-retrieval-evaluation/page.md) - Define the container image - Define the task environments - Configuration and data types - Loading, indexing, and search - Run one experiment - Compare experiments - Run the evaluation - [Computer vision > RT-DETR object detection](https://www.union.ai/docs/latest/flyte/tutorials/computer-vision/detr-object-detection/page.md) - Define the task environments - Orchestrate the pipeline - Run the workflow - [Agents](https://www.union.ai/docs/latest/flyte/tutorials/agents/page.md) - [Autoresearch agent](autoresearch/page.md) - [Parallelized autoresearch agent](parallelized-autoresearch-agent/page.md) - [Code mode analytics agent](code-mode-agent/page.md) - [AutoSec researcher agent](autosec-research-agent/page.md) - [Coding agent](code-agent/page.md) - [Competitive intelligence agent](competitive-intelligence-agent/page.md) - [Compliance monitoring agent](compliance-monitoring-agent/page.md) - [Deep research](deep-research/page.md) - [LangGraph research agent](langgraph-agent-research/page.md) - [Field data enrichment agent](field-data-enrichment-agent/page.md) - [MLE Bot: autonomous ML engineer](mle-bot/page.md) - [Support resolution agent](support-resolution-agent/page.md) - [Agents > Autoresearch agent](https://www.union.ai/docs/latest/flyte/tutorials/agents/autoresearch/page.md) - Define the container image - Define the task environment - What changed - All changed files - Model the result - What changed - All changed files - The autoresearch task - What changed - All changed files - What changed - All changed files - Run the agent - Create secrets - Prepare the research repository - Run remotely - [Agents > Parallelized autoresearch agent](https://www.union.ai/docs/latest/flyte/tutorials/agents/parallelized-autoresearch-agent/page.md) - Define the task environments - Right-size experiments with `call_handler` - The fan-out agent task - Run the agent - Create secrets - Run remotely - [Agents > AutoSec researcher agent](https://www.union.ai/docs/latest/flyte/tutorials/agents/autosec-research-agent/page.md) - Define the task environment - Run the security pipeline - Run the agent - Create secrets - Run remotely - [Agents > Coding agent](https://www.union.ai/docs/latest/flyte/tutorials/agents/code-agent/page.md) - What this example demonstrates - Setting up the agent environment - Retrieve docs - Code generation - Running the code agent - [Agents > Competitive intelligence agent](https://www.union.ai/docs/latest/flyte/tutorials/agents/competitive-intelligence-agent/page.md) - Setting up the environment - Data types - Search with the You.com Search API - Extract deltas with Claude - Watch one competitor - Orchestration - Run the agent - Create secrets - Run locally or remotely - [Agents > Deep research](https://www.union.ai/docs/latest/flyte/tutorials/agents/deep-research/page.md) - Setting up the environment - Generate research queries - Search and summarize - Evaluate research completeness - Filter results - Generate the final answer - Orchestration - Run the deep research agent - Evaluate with Weights & Biases Weave - [Agents > LangGraph research agent](https://www.union.ai/docs/latest/flyte/tutorials/agents/langgraph-agent-research/page.md) - Define the task environment - Orchestrate the pipeline - Run the agent - [Agents > MLE bot: an autonomous ML engineer](https://www.union.ai/docs/latest/flyte/tutorials/agents/mle-bot/page.md) - TL;DR - The problem with LLMs and ML pipelines - How it works - What to expect - Declaring task environments - Building durable tool functions - Guiding the LLM with domain knowledge - Dataset context - General ML best practices - The agent loop: profile, design, execute, iterate - Dataset context - General ML best practices — apply these based on the dataset context above - Available tools - Monty sandbox restrictions - Critical patterns for using tool results - When fixing a previous error - Pipeline design — you decide the structure - Response format - Reasoning - Code - Running LLM-generated code in Flyte's sandbox - Dataset context - General ML best practices — apply these based on the dataset context above - Available tools - Monty sandbox restrictions - Critical patterns for using tool results - When fixing a previous error - Pipeline design — you decide the structure - Response format - Reasoning - Code - Streaming results to a live report - Dataset context - General ML best practices — apply these based on the dataset context above - Available tools - Monty sandbox restrictions - Critical patterns for using tool results - When fixing a previous error - Pipeline design — you decide the structure - Response format - Reasoning - Code - Running it - Why Flyte? - [Agents > Compliance monitoring agent](https://www.union.ai/docs/latest/flyte/tutorials/agents/compliance-monitoring-agent/page.md) - Setting up the environment - Data types - Research with the You.com Research API - Triage findings with Claude - Monitor one watch item - Orchestration - Run the agent - Create secrets - Run locally or remotely - [Agents > Field data enrichment agent](https://www.union.ai/docs/latest/flyte/tutorials/agents/field-data-enrichment-agent/page.md) - Setting up the environment - Data types - Search with the You.com Search API - Enrich one event - Orchestration - Run the agent - Create secrets - Run locally or remotely - [Agents > Support resolution agent](https://www.union.ai/docs/latest/flyte/tutorials/agents/support-resolution-agent/page.md) - Setting up the environment - Data types - Ground answers with the You.com Research API - Ground one ticket - Draft a customer-ready reply - Resolve one ticket - Orchestration - Run the agent - Create secrets - Run locally or remotely - [Agents > Code mode analytics agent](https://www.union.ai/docs/latest/flyte/tutorials/agents/code-mode-agent/page.md) - Why code mode - What runs where - The heavy tool: a durable query - Tools are a safety boundary - The durable environment - The native agent - The report collector - Live prices over MCP - The analysis task - Serving it: the native chat app - Deploy and run - Going further - [Context engineering](https://www.union.ai/docs/latest/flyte/tutorials/context-engineering/page.md) - [Automatic prompt engineering](auto_prompt_engineering/page.md) - [Text-to-SQL](text_to_sql/page.md) - [Context engineering > Text-to-SQL prompt optimization](https://www.union.ai/docs/latest/flyte/tutorials/context-engineering/text_to_sql/page.md) - Ingesting data - From question to SQL - Vector indexing - Table retrieval and context building - SQL generation and response synthesis - Building the QA dataset - Schema extraction and chunking - Question and SQL generation - Validation and quality control - Optimizing prompts - Evaluation pipeline - Iterative optimization - Run it - What we observed - The bigger lesson - [Context engineering > Automatic prompt engineering](https://www.union.ai/docs/latest/flyte/tutorials/context-engineering/auto_prompt_engineering/page.md) - Set up the environment - Prepare the evaluation dataset - Define models - Evaluate prompts - Optimize prompts - Build the full pipeline - Run it - Why this matters - Next steps - [Model training](https://www.union.ai/docs/latest/flyte/tutorials/model-training/page.md) - [Hyperparameter optimization](hpo/page.md) - [LLM fine-tuning with LoRA and QLoRA](llm-fine-tuning-lora-qlora/page.md) - [BERT emotion classification](bert-fine-tuning-emotion/page.md) - [Model training > LLM fine-tuning with LoRA and QLoRA](https://www.union.ai/docs/latest/flyte/tutorials/model-training/llm-fine-tuning-lora-qlora/page.md) - Define the task environments - Orchestrate the pipeline - Run the workflow - [Model training > BERT emotion classification](https://www.union.ai/docs/latest/flyte/tutorials/model-training/bert-fine-tuning-emotion/page.md) - Define the task environments - Orchestrate the pipeline - Run the workflow - [Model training > Hyperparameter optimization](https://www.union.ai/docs/latest/flyte/tutorials/model-training/hpo/page.md) - A better way to run HPO - Declare dependencies - Define the task environment - Define the optimizer - Define the objective function - Define the main optimization loop - Run the experiment --- ## Integrations - [Agent frameworks](https://www.union.ai/docs/latest/flyte/integrations/agents/page.md) - Supported frameworks - Two decorators - Quick start - What Flyte adds - Capability matrix - Choosing a framework - Next steps - [Agent frameworks > How it works](https://www.union.ai/docs/latest/flyte/integrations/agents/how-it-works/page.md) - The division of labor - Tools are Flyte tasks - Passing tools - Renaming a tool - Durable model turns - What replay means in practice - Where durability does not reach - Cross-run memory - Observability - Human in the loop - Multi-agent orchestration - Sync and async - Running locally - The shared contract - Next steps - [Agent frameworks > OpenAI Agents SDK](https://www.union.ai/docs/latest/flyte/integrations/agents/openai/page.md) - Installation - Quick start - How it maps to Flyte - Bring your own agent - Custom run configuration - Memory - Building blocks - `run_agent` parameters - Notes - Examples - [Agent frameworks > Claude Agent SDK](https://www.union.ai/docs/latest/flyte/integrations/agents/claude-agent-sdk/page.md) - Installation - Quick start - How it maps to Flyte - Durability - Observability - Bring your own options - Human in the loop - Memory - `run_agent` parameters - Examples - [Agent frameworks > Google ADK](https://www.union.ai/docs/latest/flyte/integrations/agents/google-adk/page.md) - Installation - Quick start - How it maps to Flyte - Bring your own agent - Memory - Bounding a run - `run_agent` parameters - Examples - [Agent frameworks > Mistral Agents](https://www.union.ai/docs/latest/flyte/integrations/agents/mistral/page.md) - Installation - Quick start - How it maps to Flyte - Driving a pre-created agent - Memory - Bounding a run - `run_agent` parameters - Examples - [Agent frameworks > LangChain](https://www.union.ai/docs/latest/flyte/integrations/agents/langchain/page.md) - Installation - Quick start - How it maps to Flyte - Pass a model instance, not a string - Bring your own agent - Memory - `run_agent` parameters - Examples - [Agent frameworks > LangGraph](https://www.union.ai/docs/latest/flyte/integrations/agents/langgraph/page.md) - Installation - Quick start - The node factories - How it maps to Flyte - Skipping the graph - Custom state - Memory - `run_agent` parameters - Examples - [Agent frameworks > Deep Agents](https://www.union.ai/docs/latest/flyte/integrations/agents/deepagents/page.md) - Installation - Quick start - How it maps to Flyte - Bring your own agent - Memory - Composing with Flyte - `run_agent` parameters - Examples - [Agent frameworks > CrewAI](https://www.union.ai/docs/latest/flyte/integrations/agents/crewai/page.md) - Installation - Quick start - How it maps to Flyte - Bring your own agent - Instructions and the built agent - Memory - `run_agent` parameters - Examples - [Agent frameworks > Pydantic AI](https://www.union.ai/docs/latest/flyte/integrations/agents/pydantic-ai/page.md) - Installation - Quick start - How it maps to Flyte - Bring your own agent - Memory - `run_agent` parameters - Examples - [Agent frameworks > Hermes](https://www.union.ai/docs/latest/flyte/integrations/agents/hermes/page.md) - Installation - Quick start - Credentials - How it maps to Flyte - Bring your own agent - Memory - `run_agent` parameters - Examples - [BigQuery](https://www.union.ai/docs/latest/flyte/integrations/bigquery/page.md) - Installation - Quick start - Configuration - `BigQueryConfig` parameters - `BigQueryTask` parameters - Authentication - Query templating - Supported input types - Parameterized query example - Retrieving query results - API reference - [Code generation](https://www.union.ai/docs/latest/flyte/integrations/codegen/page.md) - Installation - Quick start - Two execution backends - LiteLLM (default) - Agent (Claude) - Providing data - Sample data - Schema and constraints - Inputs and outputs - Running generated code - One-shot execution with `result.run()` - Reusable task with `result.as_task()` - Error diagnosis - Durable execution - Replay logs - Caching - Non-determinism in agent mode - Observability - LiteLLM backend - Agent backend - Examples - Processing CSVs with different schemas - DataFrame analysis with constraints - Agent mode - Configuration - LiteLLM parameters - Image configuration - Skipping tests - Base packages - Best practices - API reference - `AutoCoderAgent` constructor - `generate()` parameters - `CodeGenEvalResult` fields - `CodeGenEvalResult` methods - [Dask](https://www.union.ai/docs/latest/flyte/integrations/dask/page.md) - When to use this plugin - Installation - Configuration - `Dask` parameters - `Scheduler` parameters - `WorkerGroup` parameters - Accessing the Dask client - Example - API reference - [Databricks](https://www.union.ai/docs/latest/flyte/integrations/databricks/page.md) - Installation - Quick start - Configuration - Spark fields (inherited) - Databricks-specific fields - `databricks_conf` structure - Authentication - Accessing the Spark session - API reference - [Hydra](https://www.union.ai/docs/latest/flyte/integrations/hydra/page.md) - Installation - Requirements on tasks - A walkthrough config - Execution mode - Hydra launcher (`@hydra.main` scripts) - Python SDK - Single run - Grid sweep - Custom sweepers - Forwarding `flyte.with_runcontext` options - Flyte CLI (`flyte hydra run`) - Single run - Grid sweep - App-level vs Hydra-namespace overrides - `--follow` and `--no-wait` - Shell completion - Override grammar - Sweeps - Grid sweeps (BasicSweeper) - Bayesian / TPE sweeps (Optuna) - Sweep output directories - Task environment overrides - Prebuilt images - Applying overrides to child tasks - Renaming the task-env key - What `task_env` should not model - Structured configs (without YAML) - [JSONL](https://www.union.ai/docs/latest/flyte/integrations/jsonl/page.md) - When to use this plugin - Installation - Working with `JsonlFile` - Working with `JsonlDir` - Configuration and options - Compression - Error handling on read - Arrow batches - Common use cases - API reference - [MLflow](https://www.union.ai/docs/latest/flyte/integrations/mlflow/page.md) - Installation - Quick start - Autologging - Generic autologging - Framework-specific autologging - Run modes - Sharing a run across tasks - Creating independent runs - Nested runs - Workflow-level configuration - Per-task overrides - Configuration priority - Distributed training - MLflow UI links - Setup - Custom URL templates - Explicit links - Link behavior by run mode - Automatic Flyte tags - API reference - `mlflow_run` and `mlflow_config` - `get_mlflow_run` - `get_mlflow_context` - `Mlflow` - [OmegaConf](https://www.union.ai/docs/latest/flyte/integrations/omegaconf/page.md) - Installation - Quick start - When to use this plugin - Building a DictConfig - From a plain dict - From a YAML file - From a dataclass (structured config) - From a base config plus overrides - Variable interpolation - Nested and deeply structured configs - DictConfigs that contain lists - ListConfig as input and output - Lists of primitives - Building a schedule from another task - Nested lists (list of lists) - Lists of DictConfigs - Lists of dataclass instances - Structured configs - Basic structured config - Schema reconstruction in the receiving task - Required (`MISSING`) fields - Advanced field types - Merging overrides on top of a structured base - Embedding rich Python values inside a plain DictConfig - Reserved-looking keys - YAML reports - Wire format - End-to-end example - [OpenTelemetry](https://www.union.ai/docs/latest/flyte/integrations/opentelemetry/page.md) - What Flyte provides - Installation - Configure the tracer - Start a trace and pass it into the run - Re-parent spans inside a task - Propagate into nested tasks - Reusable decorator - Choosing an exporter - [Pandera](https://www.union.ai/docs/latest/flyte/integrations/pandera/page.md) - When to use this plugin - Installation - pandas - Polars - PySpark SQL - Defining schemas - Using schemas in tasks - Error handling with `ValidationConfig` - Image configuration - Pandas - Polars - PySpark SQL - Polars lazy frames - Examples - pandas - Polars - PySpark SQL - [Papermill](https://www.union.ai/docs/latest/flyte/integrations/papermill/page.md) - When to use this plugin - Installation - Quick start - Notebook setup - `parameters` cell - `outputs` cell - Inputs and outputs - Supported input types - Complex types: File, Dir, DataFrame - Outputs: single, multiple, none - Calling Flyte tasks from notebooks - Workflow patterns - Chaining notebooks - Mixing notebooks with regular tasks - Inline definition - Calling from sync vs. async tasks - Running a NotebookTask directly as the entrypoint - Reports and notebook artifacts - HTML report (default) - Notebook artifacts - Clean reports - Failure reports - Spark notebooks - Local testing - Execution options - `NotebookTask` reference - Helper functions - [Polars](https://www.union.ai/docs/latest/flyte/integrations/polars/page.md) - When to use this plugin - Installation - Using Polars DataFrames - Using LazyFrames - Interoperating with `flyte.io.DataFrame` - Common use cases - API reference - [PyTorch](https://www.union.ai/docs/latest/flyte/integrations/pytorch/page.md) - When to use this plugin - Installation - Configuration - `Elastic` parameters - `RunPolicy` parameters - NCCL tuning parameters - Writing a distributed training task - Example - API reference - [Ray](https://www.union.ai/docs/latest/flyte/integrations/ray/page.md) - When to use this plugin - Installation - Configuration - `RayJobConfig` parameters - `WorkerNodeConfig` parameters - `HeadNodeConfig` parameters - Connecting to an existing cluster - Examples - API reference - [Snowflake](https://www.union.ai/docs/latest/flyte/integrations/snowflake/page.md) - Installation - Quick start - Configuration - Required fields - Additional connection parameters - Authentication - Key-pair authentication - Password authentication - OAuth authentication - Query templating - Supported input types - Batched `INSERT` with list inputs - Parameterized `SELECT` - Multiple inputs - Retrieving query results - End-to-end example - [Spark](https://www.union.ai/docs/latest/flyte/integrations/spark/page.md) - When to use this plugin - Installation - Configuration - `Spark` parameters - Accessing the Spark session - Overriding configuration at runtime - Example - API reference - [Weights & Biases](https://www.union.ai/docs/latest/flyte/integrations/wandb/page.md) - Installation - Quick start - What's next - [Weights & Biases > Experiments](https://www.union.ai/docs/latest/flyte/integrations/wandb/experiments/page.md) - Basic usage - Accessing the run object - Parent-child task relationships - Run modes - Using `run_mode="new"` for independent runs - Using `run_mode="shared"` for explicit sharing - Configuration with `wandb_config` - Workflow-level configuration - Overriding configuration for child tasks - Using traces with W&B runs - [Weights & Biases > Distributed training](https://www.union.ai/docs/latest/flyte/integrations/wandb/distributed_training/page.md) - Quick start - Run modes in distributed training - Single-node behavior - Multi-node behavior - Choosing run mode and rank scope - Single-node multi-GPU - Basic example with `auto` mode - Using `shared` mode for per-rank metrics - Using `new` mode for per-rank runs - Multi-node training with `Elastic` - Global scope (default): Single run across all nodes - Worker scope: One run per node - Shared mode: All ranks log to the same run - New mode: Separate run per rank - How it works - Run ID patterns - [Weights & Biases > Sweeps](https://www.union.ai/docs/latest/flyte/integrations/wandb/sweeps/page.md) - Creating a sweep - Running parallel agents - Writing objective functions - [Weights & Biases > Downloading logs](https://www.union.ai/docs/latest/flyte/integrations/wandb/downloading_logs/page.md) - Automatic download - Accessing run directories during execution - [Weights & Biases > Constraints and best practices](https://www.union.ai/docs/latest/flyte/integrations/wandb/constraints_and_best_practices/page.md) - Decorator ordering - Traces cannot use decorators - Maximum sweep agents - Configuration priority - Run ID generation - Sync delay for local files - Shared run mode requirements - Objective functions for sweeps - Error handling - [Weights & Biases > Manual integration](https://www.union.ai/docs/latest/flyte/integrations/wandb/manual/page.md) - Using the Wandb link class - With a custom run ID - Adding links at runtime with override - Using the `WandbSweep` link class --- ## Reference - [LLM-optimized documentation](https://www.union.ai/docs/latest/flyte/api-reference/flyte-context/page.md) - Per-page markdown (`page.md`) - Section bundles (`section.md`) - Page index (`llms.txt`) - Full documentation (`llms-full.txt`) - [Flyte CLI](https://www.union.ai/docs/latest/flyte/api-reference/flyte-cli/page.md) - flyte - flyte abort - flyte build - flyte create - flyte delete - flyte deploy - flyte edit - flyte gen - flyte get - flyte prefetch - flyte rerun - flyte run - flyte serve - flyte signal - flyte start - flyte stop - flyte update - flyte whoami - [Flyte SDK](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/page.md) - Directory - Classes - Protocols - Functions - Packages - [Flyte SDK > flyte](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/page.md) - Directory - Classes - Protocols - Methods - Variables - Methods - [Flyte SDK > flyte > AppHandle](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/apphandle/page.md) - Properties - Methods - activate() - deactivate() - ephemeral_ctx() - ephemeral_ctx_sync() - is_active() - is_deactivated() - [Flyte SDK > flyte > AsyncFunctionTaskTemplate](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/asyncfunctiontasktemplate/page.md) - Parameters - Properties - Methods - aio() - config() - container_args() - custom_config() - data_loading_config() - execute() - forward() - override() - post() - pre() - sql() - [Flyte SDK > flyte > Backoff](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/backoff/page.md) - Parameters - Methods - compute_delay() - [Flyte SDK > flyte > BaseCheckpoint](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/basecheckpoint/page.md) - Properties - Methods - load() - load_sync() - prev_exists() - save() - save_sync() - [Flyte SDK > flyte > Cache](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/cache/page.md) - Parameters - Methods - get_ignored_inputs() - get_version() - is_enabled() - [Flyte SDK > flyte > CachePolicy](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/cachepolicy/page.md) - Methods - get_version() - [Flyte SDK > flyte > Checkpoint](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/checkpoint/page.md) - Parameters - Properties - Methods - load() - load_sync() - prev_exists() - save() - save_sync() - [Flyte SDK > flyte > ConditionWebhook](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/conditionwebhook/page.md) - Parameters - [Flyte SDK > flyte > Cron](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/cron/page.md) - Parameters - Properties - [Flyte SDK > flyte > Device](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/device/page.md) - Parameters - [Flyte SDK > flyte > Environment](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/environment/page.md) - Parameters - Methods - add_dependency() - clone_with() - [Flyte SDK > flyte > FixedRate](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/fixedrate/page.md) - Parameters - [Flyte SDK > flyte > Image](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/image/page.md) - Parameters - Properties - Methods - clone() - from_base() - from_debian_base() - from_dockerfile() - from_ref_name() - from_uv_script() - validate() - with_apt_packages() - with_code_bundle() - with_commands() - with_dockerignore() - with_env_vars() - with_local_rs_controller() - with_local_v2() - with_local_v2_plugins() - with_pip_packages() - with_pixi_project() - with_poetry_project() - with_requirements() - with_source_file() - with_source_folder() - with_uv_project() - with_workdir() - [Flyte SDK > flyte > ImageBuild](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/imagebuild/page.md) - Parameters - [Flyte SDK > flyte > Link](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/link/page.md) - Methods - get_link() - [Flyte SDK > flyte > PodTemplate](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/podtemplate/page.md) - Parameters - Methods - allow_fuse() - allow_nested_sandboxing() - from_spec() - to_k8s_pod() - [Flyte SDK > flyte > Resources](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/resources/page.md) - Parameters - Methods - get_device() - get_shared_memory() - [Flyte SDK > flyte > RetryStrategy](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/retrystrategy/page.md) - Parameters - [Flyte SDK > flyte > ReusePolicy](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/reusepolicy/page.md) - Parameters - Properties - Methods - get_scaledown_ttl() - [Flyte SDK > flyte > Secret](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/secret/page.md) - Parameters - Methods - stable_hash() - [Flyte SDK > flyte > TaskEnvironment](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/taskenvironment/page.md) - Parameters - Properties - Methods - add_dependency() - clone_with() - from_task() - task() - [Flyte SDK > flyte > TaskTemplate](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/tasktemplate/page.md) - Parameters - Properties - Methods - aio() - config() - container_args() - custom_config() - data_loading_config() - execute() - forward() - override() - post() - pre() - sql() - [Flyte SDK > flyte > Timeout](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/timeout/page.md) - Parameters - [Flyte SDK > flyte > Trigger](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte/trigger/page.md) - Parameters - Methods - daily() - hourly() - minutely() - monthly() - weekly() - [Flyte SDK > flyte.ai.agents](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents/page.md) - Directory - Classes - Protocols - Errors - Methods - Variables - Methods - [Flyte SDK > flyte.ai.agents > AccessDenied](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents/accessdenied/page.md) - [Flyte SDK > flyte.ai.agents > Agent](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents/agent/page.md) - Parameters - Properties - Methods - add_tool() - approval_callback() - call_llm() - run() - tool_descriptions() - [Flyte SDK > flyte.ai.agents > AgentEvent](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents/agentevent/page.md) - Parameters - [Flyte SDK > flyte.ai.agents > AgentProtocol](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents/agentprotocol/page.md) - Methods - run() - tool_descriptions() - [Flyte SDK > flyte.ai.agents > AgentResult](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents/agentresult/page.md) - Parameters - [Flyte SDK > flyte.ai.agents > AgentTool](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents/agenttool/page.md) - Parameters - Methods - aio() - to_openai_format() - [Flyte SDK > flyte.ai.agents > ConcurrencyError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents/concurrencyerror/page.md) - Parameters - [Flyte SDK > flyte.ai.agents > LLMMessage](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents/llmmessage/page.md) - Parameters - [Flyte SDK > flyte.ai.agents > MCPServerSpec](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents/mcpserverspec/page.md) - Parameters - [Flyte SDK > flyte.ai.agents > MemoryMeta](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents/memorymeta/page.md) - Parameters - [Flyte SDK > flyte.ai.agents > MemoryStore](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents/memorystore/page.md) - Parameters - Methods - append() - audit_tail() - audit_tail_sync() - create() - current_sha() - exists() - extend() - flush_messages() - flush_messages_sync() - get_meta() - get_or_create() - list_paths() - read_json() - read_text() - remote_path_for_key() - save() - write_json() - write_text() - [Flyte SDK > flyte.ai.agents > MemoryStoreError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents/memorystoreerror/page.md) - [Flyte SDK > flyte.ai.agents > ToolFn](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents/toolfn/page.md) - Parameters - [Flyte SDK > flyte.ai.agents.agent](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents.agent/page.md) - Directory - Classes - Variables - [Flyte SDK > flyte.ai.agents.agent > Agent](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents.agent/agent/page.md) - Parameters - Properties - Methods - add_tool() - approval_callback() - call_llm() - run() - tool_descriptions() - [Flyte SDK > flyte.ai.agents.agent > AgentEvent](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents.agent/agentevent/page.md) - Parameters - [Flyte SDK > flyte.ai.agents.memory](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents.memory/page.md) - Directory - Classes - Errors - Variables - [Flyte SDK > flyte.ai.agents.memory > AccessDenied](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents.memory/accessdenied/page.md) - [Flyte SDK > flyte.ai.agents.memory > ConcurrencyError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents.memory/concurrencyerror/page.md) - Parameters - [Flyte SDK > flyte.ai.agents.memory > MemoryMeta](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents.memory/memorymeta/page.md) - Parameters - [Flyte SDK > flyte.ai.agents.memory > MemoryStore](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents.memory/memorystore/page.md) - Parameters - Methods - append() - audit_tail() - audit_tail_sync() - create() - current_sha() - exists() - extend() - flush_messages() - flush_messages_sync() - get_meta() - get_or_create() - list_paths() - read_json() - read_text() - remote_path_for_key() - save() - write_json() - write_text() - [Flyte SDK > flyte.ai.agents.memory > MemoryStoreError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents.memory/memorystoreerror/page.md) - [Flyte SDK > flyte.ai.agents.protocol](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents.protocol/page.md) - Directory - Classes - Protocols - Variables - [Flyte SDK > flyte.ai.agents.protocol > AgentProtocol](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents.protocol/agentprotocol/page.md) - Methods - run() - tool_descriptions() - [Flyte SDK > flyte.ai.agents.protocol > AgentResult](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.agents.protocol/agentresult/page.md) - Parameters - [Flyte SDK > flyte.ai.chat](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.chat/page.md) - Directory - Classes - Methods - Variables - Methods - [Flyte SDK > flyte.ai.chat > AgentChatAppEnvironment](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.chat/agentchatappenvironment/page.md) - Parameters - Properties - Methods - add_dependency() - build_fastapi_app() - clone_with() - container_args() - container_cmd() - container_command() - get_port() - on_shutdown() - on_startup() - server() - [Flyte SDK > flyte.ai.chat > CustomTheme](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.chat/customtheme/page.md) - Parameters - Methods - to_css() - [Flyte SDK > flyte.ai.chat.app](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.chat.app/page.md) - Directory - Classes - Variables - [Flyte SDK > flyte.ai.chat.app > AgentChatAppEnvironment](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.chat.app/agentchatappenvironment/page.md) - Parameters - Properties - Methods - add_dependency() - build_fastapi_app() - clone_with() - container_args() - container_cmd() - container_command() - get_port() - on_shutdown() - on_startup() - server() - [Flyte SDK > flyte.ai.chat.app > CustomTheme](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.chat.app/customtheme/page.md) - Parameters - Methods - to_css() - [Flyte SDK > flyte.ai.mcp](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.mcp/page.md) - Directory - Classes - [Flyte SDK > flyte.ai.mcp > FlyteMCPAppEnvironment](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.mcp/flytemcpappenvironment/page.md) - Parameters - Properties - Methods - add_dependency() - clone_with() - container_args() - container_cmd() - container_command() - get_port() - on_shutdown() - on_startup() - run_stdio() - run_stdio_async() - server() - [Flyte SDK > flyte.ai.mcp > MCPAppEnvironment](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.ai.mcp/mcpappenvironment/page.md) - Parameters - Properties - Methods - add_dependency() - clone_with() - container_args() - container_cmd() - container_command() - get_port() - on_shutdown() - on_startup() - run_stdio() - run_stdio_async() - server() - [Flyte SDK > flyte.app](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.app/page.md) - Directory - Classes - Methods - Methods - [Flyte SDK > flyte.app > AppEndpoint](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.app/appendpoint/page.md) - Parameters - Methods - check_type() - get() - materialize() - [Flyte SDK > flyte.app > AppEnvironment](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.app/appenvironment/page.md) - Parameters - Properties - Methods - add_dependency() - clone_with() - container_args() - container_cmd() - get_port() - on_shutdown() - on_startup() - server() - [Flyte SDK > flyte.app > ConnectorEnvironment](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.app/connectorenvironment/page.md) - Parameters - Properties - Methods - add_dependency() - clone_with() - container_args() - container_cmd() - get_port() - on_shutdown() - on_startup() - server() - [Flyte SDK > flyte.app > DeployedAppEnvironment](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.app/deployedappenvironment/page.md) - Parameters - Methods - env_repr() - get_name() - summary_repr() - table_repr() - [Flyte SDK > flyte.app > Domain](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.app/domain/page.md) - Parameters - [Flyte SDK > flyte.app > Link](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.app/link/page.md) - Parameters - [Flyte SDK > flyte.app > Parameter](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.app/parameter/page.md) - Parameters - [Flyte SDK > flyte.app > Port](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.app/port/page.md) - Parameters - [Flyte SDK > flyte.app > RunOutput](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.app/runoutput/page.md) - Parameters - Methods - check_type() - get() - materialize() - [Flyte SDK > flyte.app > Scaling](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.app/scaling/page.md) - Parameters - Methods - get_replicas() - [Flyte SDK > flyte.app > Timeouts](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.app/timeouts/page.md) - Parameters - [Flyte SDK > flyte.app.extras](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.app.extras/page.md) - Directory - Classes - [Flyte SDK > flyte.app.extras > FastAPIAppEnvironment](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.app.extras/fastapiappenvironment/page.md) - Parameters - Properties - Methods - add_dependency() - clone_with() - container_args() - container_cmd() - container_command() - get_port() - on_shutdown() - on_startup() - server() - [Flyte SDK > flyte.app.extras > FastAPIPassthroughAuthMiddleware](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.app.extras/fastapipassthroughauthmiddleware/page.md) - Parameters - Methods - dispatch() - extract_authorization_header() - extract_cookie_header() - extract_custom_header() - [Flyte SDK > flyte.app.extras > FlyteWebhookAppEnvironment](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.app.extras/flytewebhookappenvironment/page.md) - Parameters - Properties - Methods - add_dependency() - clone_with() - container_args() - container_cmd() - container_command() - get_port() - on_shutdown() - on_startup() - server() - [Flyte SDK > flyte.clustered](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.clustered/page.md) - Directory - Classes - [Flyte SDK > flyte.clustered > ClusteredTaskEnvironment](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.clustered/clusteredtaskenvironment/page.md) - Parameters - Properties - Methods - add_dependency() - clone_with() - from_task() - task() - to_custom_dict() - [Flyte SDK > flyte.clustered > ClusteredTaskTemplate](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.clustered/clusteredtasktemplate/page.md) - Parameters - Properties - Methods - aio() - config() - container_args() - custom_config() - data_loading_config() - execute() - forward() - override() - post() - pre() - sql() - [Flyte SDK > flyte.clustered > ClusterFailurePolicy](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.clustered/clusterfailurepolicy/page.md) - Parameters - [Flyte SDK > flyte.clustered > TorchRun](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.clustered/torchrun/page.md) - Parameters - [Flyte SDK > flyte.config](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.config/page.md) - Directory - Classes - Methods - Methods - [Flyte SDK > flyte.config > Config](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.config/config/page.md) - Parameters - Methods - auto() - with_params() - [Flyte SDK > flyte.connectors](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.connectors/page.md) - Directory - Classes - [Flyte SDK > flyte.connectors > AsyncConnector](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.connectors/asyncconnector/page.md) - Methods - create() - delete() - get() - get_logs() - get_metrics() - [Flyte SDK > flyte.connectors > AsyncConnectorExecutorMixin](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.connectors/asyncconnectorexecutormixin/page.md) - Methods - execute() - [Flyte SDK > flyte.connectors > ConnectorRegistry](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.connectors/connectorregistry/page.md) - Methods - get_connector() - register() - [Flyte SDK > flyte.connectors > ConnectorService](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.connectors/connectorservice/page.md) - Methods - run() - [Flyte SDK > flyte.connectors > Resource](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.connectors/resource/page.md) - Parameters - [Flyte SDK > flyte.connectors > ResourceMeta](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.connectors/resourcemeta/page.md) - Parameters - Methods - decode() - encode() - [Flyte SDK > flyte.connectors.utils](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.connectors.utils/page.md) - Directory - Methods - Methods - [Flyte SDK > flyte.durable](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.durable/page.md) - Directory - Methods - Methods - [Flyte SDK > flyte.errors](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/page.md) - Directory - Errors - Methods - Methods - [Flyte SDK > flyte.errors > ActionAbortedError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/actionabortederror/page.md) - Parameters - [Flyte SDK > flyte.errors > ActionNotFoundError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/actionnotfounderror/page.md) - [Flyte SDK > flyte.errors > BaseRuntimeError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/baseruntimeerror/page.md) - Parameters - [Flyte SDK > flyte.errors > CodeBundleError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/codebundleerror/page.md) - Parameters - [Flyte SDK > flyte.errors > ConditionAlreadyExistsError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/conditionalreadyexistserror/page.md) - Parameters - [Flyte SDK > flyte.errors > ConditionFailedError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/conditionfailederror/page.md) - Parameters - [Flyte SDK > flyte.errors > ConditionNotFoundError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/conditionnotfounderror/page.md) - Parameters - [Flyte SDK > flyte.errors > ConditionTimedoutError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/conditiontimedouterror/page.md) - Parameters - [Flyte SDK > flyte.errors > CustomError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/customerror/page.md) - Parameters - Methods - from_exception() - [Flyte SDK > flyte.errors > DeploymentError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/deploymenterror/page.md) - Parameters - [Flyte SDK > flyte.errors > ImageBuildError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/imagebuilderror/page.md) - Parameters - [Flyte SDK > flyte.errors > ImagePullBackOffError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/imagepullbackofferror/page.md) - Parameters - [Flyte SDK > flyte.errors > InitializationError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/initializationerror/page.md) - Parameters - [Flyte SDK > flyte.errors > InlineIOMaxBytesBreached](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/inlineiomaxbytesbreached/page.md) - Parameters - [Flyte SDK > flyte.errors > InvalidImageNameError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/invalidimagenameerror/page.md) - Parameters - [Flyte SDK > flyte.errors > InvalidPackageError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/invalidpackageerror/page.md) - Parameters - [Flyte SDK > flyte.errors > LogsNotYetAvailableError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/logsnotyetavailableerror/page.md) - Parameters - [Flyte SDK > flyte.errors > ModuleLoadError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/moduleloaderror/page.md) - Parameters - [Flyte SDK > flyte.errors > NonRecoverableError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/nonrecoverableerror/page.md) - Parameters - [Flyte SDK > flyte.errors > NotInTaskContextError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/notintaskcontexterror/page.md) - Parameters - [Flyte SDK > flyte.errors > OnlyAsyncIOSupportedError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/onlyasynciosupportederror/page.md) - Parameters - [Flyte SDK > flyte.errors > OOMError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/oomerror/page.md) - Parameters - [Flyte SDK > flyte.errors > ParameterMaterializationError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/parametermaterializationerror/page.md) - Parameters - [Flyte SDK > flyte.errors > PrimaryContainerNotFoundError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/primarycontainernotfounderror/page.md) - Parameters - [Flyte SDK > flyte.errors > RemoteTaskNotFoundError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/remotetasknotfounderror/page.md) - Parameters - [Flyte SDK > flyte.errors > RemoteTaskUsageError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/remotetaskusageerror/page.md) - Parameters - [Flyte SDK > flyte.errors > RestrictedTypeError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/restrictedtypeerror/page.md) - Parameters - [Flyte SDK > flyte.errors > RetriesExhaustedError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/retriesexhaustederror/page.md) - Parameters - [Flyte SDK > flyte.errors > RuntimeDataValidationError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/runtimedatavalidationerror/page.md) - Parameters - [Flyte SDK > flyte.errors > RuntimeSystemError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/runtimesystemerror/page.md) - Parameters - [Flyte SDK > flyte.errors > RuntimeUnknownError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/runtimeunknownerror/page.md) - Parameters - [Flyte SDK > flyte.errors > RuntimeUserError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/runtimeusererror/page.md) - Parameters - [Flyte SDK > flyte.errors > SlowDownError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/slowdownerror/page.md) - Parameters - [Flyte SDK > flyte.errors > TaskInterruptedError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/taskinterruptederror/page.md) - Parameters - [Flyte SDK > flyte.errors > TaskTimeoutError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/tasktimeouterror/page.md) - Parameters - [Flyte SDK > flyte.errors > TraceDoesNotAllowNestedTasksError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/tracedoesnotallownestedtaskserror/page.md) - Parameters - [Flyte SDK > flyte.errors > UnionRpcError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.errors/unionrpcerror/page.md) - Parameters - [Flyte SDK > flyte.extend](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extend/page.md) - Directory - Classes - Protocols - Methods - Variables - Methods - [Flyte SDK > flyte.extend > AsyncFunctionTaskTemplate](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extend/asyncfunctiontasktemplate/page.md) - Parameters - Properties - Methods - aio() - config() - container_args() - custom_config() - data_loading_config() - execute() - forward() - override() - post() - pre() - sql() - [Flyte SDK > flyte.extend > ImageBuildEngine](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extend/imagebuildengine/page.md) - [Flyte SDK > flyte.extend > ImageBuilder](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extend/imagebuilder/page.md) - Methods - build_image() - get_checkers() - [Flyte SDK > flyte.extend > ImageChecker](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extend/imagechecker/page.md) - Methods - image_exists() - [Flyte SDK > flyte.extend > TaskTemplate](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extend/tasktemplate/page.md) - Parameters - Properties - Methods - aio() - config() - container_args() - custom_config() - data_loading_config() - execute() - forward() - override() - post() - pre() - sql() - [Flyte SDK > flyte.extras](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extras/page.md) - Directory - Classes - Protocols - [Flyte SDK > flyte.extras > BatchStats](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extras/batchstats/page.md) - Parameters - Properties - [Flyte SDK > flyte.extras > ContainerTask](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extras/containertask/page.md) - Parameters - Properties - Methods - aio() - config() - container_args() - custom_config() - data_loading_config() - execute() - forward() - override() - post() - pre() - sql() - [Flyte SDK > flyte.extras > CostEstimator](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extras/costestimator/page.md) - Methods - estimate_cost() - [Flyte SDK > flyte.extras > DynamicBatcher](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extras/dynamicbatcher/page.md) - Parameters - Properties - Methods - start() - stop() - submit() - submit_batch() - [Flyte SDK > flyte.extras > Prompt](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extras/prompt/page.md) - Parameters - Methods - estimate_tokens() - [Flyte SDK > flyte.extras > Sleep](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extras/sleep/page.md) - Parameters - [Flyte SDK > flyte.extras > SleepTask](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extras/sleeptask/page.md) - Parameters - Properties - Methods - aio() - config() - container_args() - custom_config() - data_loading_config() - execute() - forward() - override() - post() - pre() - sql() - [Flyte SDK > flyte.extras > TokenBatcher](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extras/tokenbatcher/page.md) - Parameters - Properties - Methods - start() - stop() - submit() - submit_batch() - [Flyte SDK > flyte.extras > TokenEstimator](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extras/tokenestimator/page.md) - Methods - estimate_tokens() - [Flyte SDK > flyte.extras.shell](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extras.shell/page.md) - Directory - Classes - Methods - Methods - [Flyte SDK > flyte.extras.shell > FlagSpec](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extras.shell/flagspec/page.md) - Parameters - Methods - coerce() - [Flyte SDK > flyte.extras.shell > Glob](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extras.shell/glob/page.md) - Parameters - [Flyte SDK > flyte.extras.shell > Stderr](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extras.shell/stderr/page.md) - Parameters - [Flyte SDK > flyte.extras.shell > Stdout](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.extras.shell/stdout/page.md) - Parameters - [Flyte SDK > flyte.git](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.git/page.md) - Directory - Classes - Methods - Methods - [Flyte SDK > flyte.git > GitStatus](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.git/gitstatus/page.md) - Parameters - Methods - build_url() - from_current_repo() - [Flyte SDK > flyte.io](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.io/page.md) - IO data types - Directory - Classes - Variables - [Flyte SDK > flyte.io > DataFrame](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.io/dataframe/page.md) - Parameters - Properties - Methods - all() - all_sync() - column_names() - columns() - deserialize_dataframe() - from_df() - from_existing_remote() - from_local() - from_local_sync() - iter() - model_post_init() - open() - schema_match() - serialize_dataframe() - set_literal() - wrap_df() - [Flyte SDK > flyte.io > Dir](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.io/dir/page.md) - Parameters - Properties - Methods - download() - download_sync() - empty() - exists() - exists_sync() - from_existing_remote() - from_local() - from_local_sync() - get_file() - get_file_sync() - list_files() - list_files_sync() - model_post_init() - new_remote() - pre_init() - schema_match() - walk() - walk_sync() - [Flyte SDK > flyte.io > EmptyDir](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.io/emptydir/page.md) - Parameters - Properties - Methods - download() - download_sync() - empty() - exists() - exists_sync() - from_existing_remote() - from_local() - from_local_sync() - get_file() - get_file_sync() - list_files() - list_files_sync() - model_post_init() - new_remote() - pre_init() - schema_match() - walk() - walk_sync() - [Flyte SDK > flyte.io > File](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.io/file/page.md) - Parameters - Properties - Methods - download() - download_sync() - exists() - exists_sync() - from_existing_remote() - from_local() - from_local_sync() - model_post_init() - named_remote() - new_remote() - open() - open_sync() - pre_init() - schema_match() - [Flyte SDK > flyte.io > HashFunction](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.io/hashfunction/page.md) - Parameters - Methods - from_fn() - reset() - result() - update() - [Flyte SDK > flyte.io.extend](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.io.extend/page.md) - Directory - Classes - [Flyte SDK > flyte.io.extend > DataFrameDecoder](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.io.extend/dataframedecoder/page.md) - Parameters - Properties - Methods - decode() - [Flyte SDK > flyte.io.extend > DataFrameEncoder](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.io.extend/dataframeencoder/page.md) - Parameters - Properties - Methods - encode() - [Flyte SDK > flyte.io.extend > DataFrameTransformerEngine](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.io.extend/dataframetransformerengine/page.md) - Parameters - Properties - Methods - assert_type() - encode() - from_binary_idl() - get_decoder() - get_encoder() - get_literal_type() - get_structured_dataset_type() - guess_python_type() - isinstance_generic() - iter_as() - open_as() - register() - register_for_protocol() - register_renderer() - schema_match() - to_html() - to_literal() - to_python_value() - [Flyte SDK > flyte.models](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.models/page.md) - Directory - Classes - Methods - Variables - Methods - [Flyte SDK > flyte.models > ActionID](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.models/actionid/page.md) - Parameters - Methods - create_random() - new_sub_action() - new_sub_action_from() - unique_id_str() - [Flyte SDK > flyte.models > ActionPhase](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.models/actionphase/page.md) - Parameters - [Flyte SDK > flyte.models > CheckpointPaths](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.models/checkpointpaths/page.md) - Parameters - [Flyte SDK > flyte.models > CodeBundle](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.models/codebundle/page.md) - Parameters - Methods - with_downloaded_path() - [Flyte SDK > flyte.models > GroupData](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.models/groupdata/page.md) - Parameters - [Flyte SDK > flyte.models > NativeInterface](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.models/nativeinterface/page.md) - Parameters - Properties - Methods - convert_to_kwargs() - from_callable() - from_types() - get_input_types() - has_outputs() - num_required_inputs() - required_inputs() - [Flyte SDK > flyte.models > PathRewrite](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.models/pathrewrite/page.md) - Parameters - Methods - from_str() - [Flyte SDK > flyte.models > RawDataPath](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.models/rawdatapath/page.md) - Parameters - Methods - from_local_folder() - get_random_remote_path() - [Flyte SDK > flyte.models > SerializationContext](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.models/serializationcontext/page.md) - Parameters - Methods - get_entrypoint_path() - [Flyte SDK > flyte.models > TaskContext](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.models/taskcontext/page.md) - Parameters - Properties - Methods - is_in_cluster() - replace() - [Flyte SDK > flyte.notify](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.notify/page.md) - Directory - Classes - [Flyte SDK > flyte.notify > Email](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.notify/email/page.md) - Parameters - [Flyte SDK > flyte.notify > NamedDelivery](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.notify/nameddelivery/page.md) - Parameters - [Flyte SDK > flyte.notify > NamedRule](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.notify/namedrule/page.md) - Parameters - [Flyte SDK > flyte.notify > Notification](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.notify/notification/page.md) - Parameters - [Flyte SDK > flyte.notify > Slack](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.notify/slack/page.md) - Parameters - [Flyte SDK > flyte.notify > Teams](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.notify/teams/page.md) - Parameters - [Flyte SDK > flyte.notify > Webhook](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.notify/webhook/page.md) - Parameters - [Flyte SDK > flyte.prefetch](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.prefetch/page.md) - Directory - Classes - Methods - Methods - [Flyte SDK > flyte.prefetch > HuggingFaceModelInfo](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.prefetch/huggingfacemodelinfo/page.md) - Parameters - [Flyte SDK > flyte.prefetch > ShardConfig](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.prefetch/shardconfig/page.md) - Parameters - [Flyte SDK > flyte.prefetch > StoredModelInfo](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.prefetch/storedmodelinfo/page.md) - Parameters - [Flyte SDK > flyte.prefetch > VLLMShardArgs](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.prefetch/vllmshardargs/page.md) - Parameters - Methods - get_vllm_args() - [Flyte SDK > flyte.remote](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.remote/page.md) - Directory - Classes - Methods - Methods - [Flyte SDK > flyte.remote > Action](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.remote/action/page.md) - Parameters - Properties - Methods - abort() - details() - done() - get() - get_logs() - listall() - show_logs() - sync() - to_dict() - to_json() - wait() - watch() - [Flyte SDK > flyte.remote > ActionDetails](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.remote/actiondetails/page.md) - Parameters - Properties - Methods - done() - get() - get_details() - get_phase_transitions() - input_literals() - inputs() - logs_available() - output_literals() - outputs() - to_dict() - to_json() - typed_inputs() - typed_outputs() - watch() - watch_updates() - [Flyte SDK > flyte.remote > ActionInputs](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.remote/actioninputs/page.md) - Parameters - Methods - clear() - copy() - fromkeys() - get() - items() - keys() - pop() - popitem() - setdefault() - to_dict() - to_json() - update() - values() - [Flyte SDK > flyte.remote > ActionOutputs](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.remote/actionoutputs/page.md) - Parameters - Properties - Methods - to_dict() - to_json() - [Flyte SDK > flyte.remote > App](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.remote/app/page.md) - Parameters - Properties - Methods - activate() - create() - deactivate() - delete() - ephemeral_ctx() - ephemeral_ctx_sync() - get() - is_active() - is_deactivated() - listall() - replace() - to_dict() - to_json() - update() - watch() - [Flyte SDK > flyte.remote > Condition](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.remote/condition/page.md) - Parameters - Properties - Methods - get() - listall() - signal() - to_dict() - to_json() - [Flyte SDK > flyte.remote > Project](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.remote/project/page.md) - Parameters - Methods - archive() - create() - get() - listall() - to_dict() - to_json() - unarchive() - update() - [Flyte SDK > flyte.remote > Run](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.remote/run/page.md) - Parameters - Properties - Methods - abort() - details() - done() - get() - get_debug_url() - get_logs() - get_report() - input_literals() - inputs() - listall() - output_literals() - outputs() - show_logs() - sync() - to_dict() - to_json() - typed_inputs() - typed_outputs() - wait() - watch() - [Flyte SDK > flyte.remote > RunDetails](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.remote/rundetails/page.md) - Parameters - Properties - Methods - done() - get() - get_details() - input_literals() - inputs() - output_literals() - outputs() - to_dict() - to_json() - typed_inputs() - typed_outputs() - [Flyte SDK > flyte.remote > Secret](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.remote/secret/page.md) - Parameters - Properties - Methods - create() - delete() - get() - listall() - to_dict() - to_json() - [Flyte SDK > flyte.remote > Settings](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.remote/settings/page.md) - Parameters - Methods - available_keys() - effective_values() - get_settings_for_edit() - local_overrides() - parse_yaml() - scope_description() - to_dict() - to_json() - to_yaml() - to_yaml_sections() - update_settings() - [Flyte SDK > flyte.remote > Task](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.remote/task/page.md) - Parameters - Properties - Methods - get() - listall() - to_dict() - to_json() - [Flyte SDK > flyte.remote > TaskDetails](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.remote/taskdetails/page.md) - Parameters - Properties - Methods - fetch() - get() - override() - to_dict() - to_json() - [Flyte SDK > flyte.remote > TimeFilter](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.remote/timefilter/page.md) - Parameters - [Flyte SDK > flyte.remote > Trigger](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.remote/trigger/page.md) - Parameters - Properties - Methods - create() - delete() - get() - get_details() - listall() - to_dict() - to_json() - update() - [Flyte SDK > flyte.remote > User](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.remote/user/page.md) - Parameters - Methods - get() - name() - subject() - to_dict() - to_json() - [Flyte SDK > flyte.report](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.report/page.md) - Directory - Classes - Methods - Methods - [Flyte SDK > flyte.report > Report](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.report/report/page.md) - Parameters - Methods - get_final_report() - get_tab() - [Flyte SDK > flyte.report > Timeline](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.report/timeline/page.md) - Parameters - Methods - heading() - row() - [Flyte SDK > flyte.sandbox](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.sandbox/page.md) - Directory - Classes - Methods - Variables - Methods - [Flyte SDK > flyte.sandbox > CodeTaskTemplate](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.sandbox/codetasktemplate/page.md) - Parameters - Properties - Methods - aio() - config() - container_args() - custom_config() - data_loading_config() - execute() - forward() - override() - post() - pre() - sql() - [Flyte SDK > flyte.sandbox > ImageConfig](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.sandbox/imageconfig/page.md) - Parameters - [Flyte SDK > flyte.sandbox > SandboxedConfig](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.sandbox/sandboxedconfig/page.md) - Parameters - [Flyte SDK > flyte.sandbox > SandboxedTaskTemplate](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.sandbox/sandboxedtasktemplate/page.md) - Parameters - Properties - Methods - aio() - config() - container_args() - custom_config() - data_loading_config() - execute() - forward() - override() - post() - pre() - sql() - [Flyte SDK > flyte.storage](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.storage/page.md) - Directory - Classes - Methods - Methods - [Flyte SDK > flyte.storage > ABFS](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.storage/abfs/page.md) - Parameters - Methods - auto() - get_fsspec_kwargs() - [Flyte SDK > flyte.storage > GCS](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.storage/gcs/page.md) - Parameters - Methods - auto() - get_fsspec_kwargs() - [Flyte SDK > flyte.storage > S3](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.storage/s3/page.md) - Parameters - Methods - auto() - for_sandbox() - get_fsspec_kwargs() - [Flyte SDK > flyte.storage > Storage](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.storage/storage/page.md) - Parameters - Methods - auto() - get_fsspec_kwargs() - [Flyte SDK > flyte.syncify](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.syncify/page.md) - Creating a Syncify Instance - How does it work? - Directory - Classes - [Flyte SDK > flyte.syncify > Syncify](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.syncify/syncify/page.md) - Parameters - [Flyte SDK > flyte.types](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.types/page.md) - Directory - Classes - Protocols - Errors - Methods - Methods - [Flyte SDK > flyte.types > FlytePickle](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.types/flytepickle/page.md) - Methods - from_pickle() - python_type() - to_pickle() - [Flyte SDK > flyte.types > Renderable](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.types/renderable/page.md) - Methods - to_html() - [Flyte SDK > flyte.types > TypeEngine](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.types/typeengine/page.md) - Methods - dict_to_literal_map() - get_available_transformers() - get_transformer() - guess_python_type() - guess_python_types() - lazy_import_transformers() - literal_map_to_kwargs() - named_tuple_to_variable_map() - register() - register_additional_type() - register_restricted_type() - to_html() - to_literal() - to_literal_checks() - to_literal_type() - to_python_value() - unwrap_offloaded_literal() - [Flyte SDK > flyte.types > TypeTransformer](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.types/typetransformer/page.md) - Parameters - Properties - Methods - assert_type() - from_binary_idl() - get_literal_type() - guess_python_type() - isinstance_generic() - schema_match() - to_html() - to_literal() - to_python_value() - [Flyte SDK > flyte.types > TypeTransformerFailedError](https://www.union.ai/docs/latest/flyte/api-reference/flyte-sdk/flyte.types/typetransformerfailederror/page.md) - [Flyte agent plugins](https://www.union.ai/docs/latest/flyte/api-reference/agent-plugins/page.md) - Compatibility - Installation - Skills - SDK & workflow authoring - Migration (Flyte 1 → Flyte 2) - Deployment - MCP servers - [Integrations](https://www.union.ai/docs/latest/flyte/api-reference/integrations/page.md) - [Integrations > Anthropic](https://www.union.ai/docs/latest/flyte/api-reference/integrations/anthropic/page.md) - Directory - Classes - Methods - Methods - [Integrations > Anthropic > Agent](https://www.union.ai/docs/latest/flyte/api-reference/integrations/anthropic/agent/page.md) - Parameters - Methods - get_anthropic_tools() - [Integrations > BigQuery](https://www.union.ai/docs/latest/flyte/api-reference/integrations/bigquery/page.md) - Directory - Classes - [Integrations > BigQuery > BigQueryConfig](https://www.union.ai/docs/latest/flyte/api-reference/integrations/bigquery/bigqueryconfig/page.md) - Parameters - [Integrations > BigQuery > BigQueryConnector](https://www.union.ai/docs/latest/flyte/api-reference/integrations/bigquery/bigqueryconnector/page.md) - Methods - create() - delete() - get() - get_logs() - get_metrics() - [Integrations > BigQuery > BigQueryTask](https://www.union.ai/docs/latest/flyte/api-reference/integrations/bigquery/bigquerytask/page.md) - Parameters - Properties - Methods - aio() - config() - container_args() - custom_config() - data_loading_config() - execute() - forward() - override() - post() - pre() - sql() - [Integrations > Code generation](https://www.union.ai/docs/latest/flyte/api-reference/integrations/codegen/page.md) - Directory - Classes - [Integrations > Code generation > AutoCoderAgent](https://www.union.ai/docs/latest/flyte/api-reference/integrations/codegen/autocoderagent/page.md) - Parameters - Methods - generate() - [Integrations > Code generation > CodeGenEvalResult](https://www.union.ai/docs/latest/flyte/api-reference/integrations/codegen/codegenevalresult/page.md) - Parameters - Methods - as_task() - run() - [Integrations > Code generation > CodePlan](https://www.union.ai/docs/latest/flyte/api-reference/integrations/codegen/codeplan/page.md) - Parameters - [Integrations > Code generation > CodeSolution](https://www.union.ai/docs/latest/flyte/api-reference/integrations/codegen/codesolution/page.md) - Parameters - Methods - normalize_language() - [Integrations > Code generation > ErrorDiagnosis](https://www.union.ai/docs/latest/flyte/api-reference/integrations/codegen/errordiagnosis/page.md) - Parameters - [Integrations > Code generation > ImageConfig](https://www.union.ai/docs/latest/flyte/api-reference/integrations/codegen/imageconfig/page.md) - Parameters - [Integrations > Dask](https://www.union.ai/docs/latest/flyte/api-reference/integrations/dask/page.md) - Directory - Classes - [Integrations > Dask > Dask](https://www.union.ai/docs/latest/flyte/api-reference/integrations/dask/dask/page.md) - Parameters - [Integrations > Dask > Scheduler](https://www.union.ai/docs/latest/flyte/api-reference/integrations/dask/scheduler/page.md) - Parameters - [Integrations > Dask > WorkerGroup](https://www.union.ai/docs/latest/flyte/api-reference/integrations/dask/workergroup/page.md) - Parameters - [Integrations > Databricks](https://www.union.ai/docs/latest/flyte/api-reference/integrations/databricks/page.md) - Directory - Classes - [Integrations > Databricks > Databricks](https://www.union.ai/docs/latest/flyte/api-reference/integrations/databricks/databricks/page.md) - Parameters - [Integrations > Databricks > DatabricksConnector](https://www.union.ai/docs/latest/flyte/api-reference/integrations/databricks/databricksconnector/page.md) - Methods - create() - delete() - get() - get_logs() - get_metrics() - [Integrations > Gemini](https://www.union.ai/docs/latest/flyte/api-reference/integrations/gemini/page.md) - Directory - Classes - Methods - Methods - [Integrations > Gemini > Agent](https://www.union.ai/docs/latest/flyte/api-reference/integrations/gemini/agent/page.md) - Parameters - Methods - get_gemini_tools() - [Integrations > Hydra](https://www.union.ai/docs/latest/flyte/api-reference/integrations/hydra/page.md) - Directory - Methods - Methods - [Integrations > JSONL](https://www.union.ai/docs/latest/flyte/api-reference/integrations/jsonl/page.md) - Directory - Classes - [Integrations > JSONL > JsonlDir](https://www.union.ai/docs/latest/flyte/api-reference/integrations/jsonl/jsonldir/page.md) - Parameters - Properties - Methods - download() - download_sync() - empty() - exists() - exists_sync() - from_existing_remote() - from_local() - from_local_sync() - get_file() - get_file_sync() - iter_arrow_batches() - iter_arrow_batches_sync() - iter_batches() - iter_batches_sync() - iter_records() - iter_records_sync() - list_files() - list_files_sync() - model_post_init() - new_remote() - pre_init() - schema_match() - walk() - walk_sync() - writer() - writer_sync() - [Integrations > JSONL > JsonlFile](https://www.union.ai/docs/latest/flyte/api-reference/integrations/jsonl/jsonlfile/page.md) - Parameters - Properties - Methods - download() - download_sync() - exists() - exists_sync() - from_existing_remote() - from_local() - from_local_sync() - iter_arrow_batches() - iter_arrow_batches_sync() - iter_records() - iter_records_sync() - model_post_init() - named_remote() - new_remote() - open() - open_sync() - pre_init() - schema_match() - writer() - writer_sync() - [Integrations > MLflow](https://www.union.ai/docs/latest/flyte/api-reference/integrations/mlflow/page.md) - Key features: - Basic usage: - Directory - Classes - Methods - Methods - [Integrations > MLflow > Mlflow](https://www.union.ai/docs/latest/flyte/api-reference/integrations/mlflow/mlflow/page.md) - Parameters - Methods - get_link() - [Integrations > OmegaConf](https://www.union.ai/docs/latest/flyte/api-reference/integrations/omegaconf/page.md) - Directory - Methods - Methods - [Integrations > OpenAI](https://www.union.ai/docs/latest/flyte/api-reference/integrations/openai/page.md) - Directory - Methods - Methods - [Integrations > Papermill](https://www.union.ai/docs/latest/flyte/api-reference/integrations/papermill/page.md) - Directory - Classes - Methods - Methods - [Integrations > Papermill > NotebookTask](https://www.union.ai/docs/latest/flyte/api-reference/integrations/papermill/notebooktask/page.md) - Parameters - Properties - Methods - aio() - config() - container_args() - custom_config() - data_loading_config() - execute() - forward() - override() - post() - pre() - sql() - [Integrations > Polars](https://www.union.ai/docs/latest/flyte/api-reference/integrations/polars/page.md) - Directory - Classes - Methods - Variables - Methods - [Integrations > Polars > ParquetToPolarsDecodingHandler](https://www.union.ai/docs/latest/flyte/api-reference/integrations/polars/parquettopolarsdecodinghandler/page.md) - Parameters - Properties - Methods - decode() - [Integrations > Polars > ParquetToPolarsLazyFrameDecodingHandler](https://www.union.ai/docs/latest/flyte/api-reference/integrations/polars/parquettopolarslazyframedecodinghandler/page.md) - Parameters - Properties - Methods - decode() - [Integrations > Polars > PolarsLazyFrameToParquetEncodingHandler](https://www.union.ai/docs/latest/flyte/api-reference/integrations/polars/polarslazyframetoparquetencodinghandler/page.md) - Parameters - Properties - Methods - encode() - [Integrations > Polars > PolarsToParquetEncodingHandler](https://www.union.ai/docs/latest/flyte/api-reference/integrations/polars/polarstoparquetencodinghandler/page.md) - Parameters - Properties - Methods - encode() - [Integrations > PyTorch](https://www.union.ai/docs/latest/flyte/api-reference/integrations/pytorch/page.md) - Directory - Classes - [Integrations > PyTorch > Elastic](https://www.union.ai/docs/latest/flyte/api-reference/integrations/pytorch/elastic/page.md) - Parameters - [Integrations > Ray](https://www.union.ai/docs/latest/flyte/api-reference/integrations/ray/page.md) - Directory - Classes - [Integrations > Ray > HeadNodeConfig](https://www.union.ai/docs/latest/flyte/api-reference/integrations/ray/headnodeconfig/page.md) - Parameters - [Integrations > Ray > RayJobConfig](https://www.union.ai/docs/latest/flyte/api-reference/integrations/ray/rayjobconfig/page.md) - Parameters - [Integrations > Ray > WorkerNodeConfig](https://www.union.ai/docs/latest/flyte/api-reference/integrations/ray/workernodeconfig/page.md) - Parameters - [Integrations > SGLang](https://www.union.ai/docs/latest/flyte/api-reference/integrations/sglang/page.md) - Directory - Classes - Variables - [Integrations > SGLang > SGLangAppEnvironment](https://www.union.ai/docs/latest/flyte/api-reference/integrations/sglang/sglangappenvironment/page.md) - Parameters - Properties - Methods - add_dependency() - clone_with() - container_args() - container_cmd() - get_port() - on_shutdown() - on_startup() - server() - [Integrations > Snowflake](https://www.union.ai/docs/latest/flyte/api-reference/integrations/snowflake/page.md) - Directory - Classes - [Integrations > Snowflake > Snowflake](https://www.union.ai/docs/latest/flyte/api-reference/integrations/snowflake/snowflake/page.md) - Parameters - Properties - Methods - aio() - config() - container_args() - custom_config() - data_loading_config() - execute() - forward() - override() - post() - pre() - sql() - [Integrations > Snowflake > SnowflakeConfig](https://www.union.ai/docs/latest/flyte/api-reference/integrations/snowflake/snowflakeconfig/page.md) - Parameters - [Integrations > Snowflake > SnowflakeConnector](https://www.union.ai/docs/latest/flyte/api-reference/integrations/snowflake/snowflakeconnector/page.md) - Methods - create() - delete() - get() - get_logs() - get_metrics() - [Integrations > Spark](https://www.union.ai/docs/latest/flyte/api-reference/integrations/spark/page.md) - Directory - Classes - [Integrations > Spark > ParquetToSparkDecoder](https://www.union.ai/docs/latest/flyte/api-reference/integrations/spark/parquettosparkdecoder/page.md) - Parameters - Properties - Methods - decode() - [Integrations > Spark > Spark](https://www.union.ai/docs/latest/flyte/api-reference/integrations/spark/spark/page.md) - Parameters - [Integrations > Spark > SparkToParquetEncoder](https://www.union.ai/docs/latest/flyte/api-reference/integrations/spark/sparktoparquetencoder/page.md) - Parameters - Properties - Methods - encode() - [Integrations > vLLM](https://www.union.ai/docs/latest/flyte/api-reference/integrations/vllm/page.md) - Directory - Classes - Variables - [Integrations > vLLM > VLLMAppEnvironment](https://www.union.ai/docs/latest/flyte/api-reference/integrations/vllm/vllmappenvironment/page.md) - Parameters - Properties - Methods - add_dependency() - clone_with() - container_args() - container_cmd() - get_port() - on_shutdown() - on_startup() - server() - [Integrations > Weights & Biases](https://www.union.ai/docs/latest/flyte/api-reference/integrations/wandb/page.md) - Key features: - Basic usage: - Directory - Classes - Methods - Methods - [Integrations > Weights & Biases > Wandb](https://www.union.ai/docs/latest/flyte/api-reference/integrations/wandb/wandb/page.md) - Parameters - Methods - get_link() - [Integrations > Weights & Biases > WandbSweep](https://www.union.ai/docs/latest/flyte/api-reference/integrations/wandb/wandbsweep/page.md) - Parameters - Methods - get_link() --- ## Community - [Joining the community](https://www.union.ai/docs/latest/flyte/community/joining-the-community/page.md) - Community sync - Contributor's sync - Newsletter - Slack guidelines - Abide by the [LF's Code of Conduct](https://lfprojects.org/policies/code-of-conduct/) - Avoid using DMs and @mentions - Make use of threads - Do not post the same question across multiple channels - Do not solicit members of our Slack - [Contributing code](https://www.union.ai/docs/latest/flyte/community/contributing-code/page.md) - Flyte 2 - Becoming a contributor - Before submitting your PR - 🐞 file an issue - Component reference - `flyte` - `flyteidl` - `flytepropeller` - `flyteadmin` - `flytekit` - `flyteconsole` - `datacatalog` - `flyteplugins` - `flytestdlib` - `flytectl` - Development environment setup guide - Requirements - Content - How to setup dev environment for flyteidl, flyteadmin, flyteplugins, flytepropeller, datacatalog and flytestdlib? - How to setup dev environment for flytekit? - How to setup dev environment for flyteconsole? - How to access Flyte UI, minio, postgres, k3s, and endpoints? - [Contributing docs and examples](https://www.union.ai/docs/latest/flyte/community/contributing-docs/page.md) - Where to start - How the docs site works - Versions - Common build infrastructure - Variants - Both Flyte and Union docs are open source > Section bundle (all pages): https://www.union.ai/docs/latest/flyte/community/contributing-docs/section.md - [Contributing docs and examples > Set up a local docs dev environment](https://www.union.ai/docs/latest/flyte/community/contributing-docs/quick-start/page.md) - Prerequisites - Clone the repository - Initialize the submodules - Configure the live preview - Start the live preview - Development settings - Build the production site - Next steps - [Contributing docs and examples > Authoring](https://www.union.ai/docs/latest/flyte/community/contributing-docs/authoring/page.md) - Getting started - Live preview - Page visibility - Page order - Page settings - Conditional content - Linking to the API reference - Sigils for special cases - Warnings and notices - Special content generation - Python generated content - Run on Union instructions - Jupyter notebooks - Mapped keys (`{{}}`) - Mermaid graphs - [Contributing docs and examples > Submit a contribution](https://www.union.ai/docs/latest/flyte/community/contributing-docs/submitting-contributions/page.md) - Target the right branch - Fork and clone - Create a feature branch - Make and preview your changes - Commit with a sign-off - Open a pull request - Check the preview build - Review and merge - [Contributing docs and examples > Writing guidelines](https://www.union.ai/docs/latest/flyte/community/contributing-docs/writing-guidelines/page.md) - Lead with the task - Write in a clear, active voice - Structure a page - Use sentence case for headings - Use notes and warnings deliberately - Keep terminology consistent - Make examples runnable and tested - Link to the API reference by writing the identifier - [Contributing docs and examples > Variants](https://www.union.ai/docs/latest/flyte/community/contributing-docs/variants/page.md) - Variants at the whole-page level - Conditional rendering within a page - {{}} - {{}} - Full example - Adding a new variant - Location - Creating a new variant - Testing the new variant - Building (just) the variant - [Contributing docs and examples > Versions](https://www.union.ai/docs/latest/flyte/community/contributing-docs/versions/page.md) - What a version contains (and what it does not) - Versions are branches - How to create an archive version - How to create an archive version - Publishing an archive version - [Contributing docs and examples > Shortcodes](https://www.union.ai/docs/latest/flyte/community/contributing-docs/shortcodes/page.md) - How to specify a "shortcode" - Variants - Component library - `{{}}` - `{{}}` - `{{}}` - `{{}}` - `{{}}` - `{{}}` - `{{}}` and `{{}}` - `{{}}` - `{{}}` - `{{}}` - `{{}}`, `{{}}`, and `{{}}` - `{{}}` - `{{}}` - [Contributing docs and examples > API docs](https://www.union.ai/docs/latest/flyte/community/contributing-docs/api-docs/page.md) - API naming convention - Package resource resolution - Tips and tricks - Auto-linking - Short vs. fully-qualified names - How auto-linking works - Magic-marker syntax for inline code - [Contributing docs and examples > LLM-optimized documentation](https://www.union.ai/docs/latest/flyte/community/contributing-docs/llm-docs/page.md) - Output files - Discovery hierarchy - How `page.md` files are generated - Enabling section bundles - The `llms-full.txt` link conversion - Regenerating - [Contributing docs and examples > Redirects](https://www.union.ai/docs/latest/flyte/community/contributing-docs/redirects/page.md) - `docs.union.ai` redirects - `docs.flyte.org` redirects - [Contributing docs and examples > Production builds and troubleshooting](https://www.union.ai/docs/latest/flyte/community/contributing-docs/publishing/page.md) - Build the production site - Test the production build - Troubleshooting - Missing content - Page visibility --- ## Platform deployment - [Deployment overview](https://www.union.ai/docs/latest/flyte/oss-deployment/overview/page.md) - Architecture - Networking - External dependencies - Kubernetes cluster - Relational database - Object store - Optional dependencies - Ingress controller - DNS - SSL/TLS - Container images - [Kind deployment](https://www.union.ai/docs/latest/flyte/oss-deployment/kind-deployment/page.md) - 1. Prerequisites - Local machine - DigitalOcean VM - 2. Create the kind cluster - 3. Deploy the dependencies - PostgreSQL - Object store - AWS S3 - Cloudflare R2 - 4. Write the values file - 5. Install Flyte - 6. Access Flyte - Local machine - DigitalOcean VM - Submitting runs from the SDK - 7. Add authentication with a local IdP (optional) - Install the ingress controller - Deploy Dex - Deploy oauth2-proxy - Create the ForwardAuth middleware - Create the Flyte ingress with the middleware - Local machine - DigitalOcean VM - Verify the browser flow - Letting the SDK/CLI authenticate (with auth enabled) - Troubleshooting - 8. Load a local image into kind (optional) - 9. Tear down - [Kind deployment > Set up local OIDC provider](https://www.union.ai/docs/latest/flyte/oss-deployment/kind-deployment/local-oidc/page.md) - The issuer-URL problem - Dex configuration - Install Dex - Route the issuer path through Traefik - Next step - [Kind deployment > Set up external OIDC provider](https://www.union.ai/docs/latest/flyte/oss-deployment/kind-deployment/external-oidc/page.md) - Install the ingress controller - Deploy oauth2-proxy - Create the ForwardAuth middleware - Create the Flyte ingress with the middleware - Split the API and discovery paths off the browser middleware - Advertise your IdP to the SDK/CLI - Letting the SDK/CLI authenticate - Troubleshooting - [AWS deployment](https://www.union.ai/docs/latest/flyte/oss-deployment/aws-deployment/page.md) - 1. Add the Helm repository - 2. Write a values file - 3. Install - 4. Grant object-store access - 5. Expose Flyte with an ingress - 6. Verify the installation - 7. Tear down - Full Values File Example - Default task resources - Default scheduling for task pods - OpenTelemetry - Database password from a Secret - [Authentication and SSO](https://www.union.ai/docs/latest/flyte/oss-deployment/authentication/page.md) - Advertise your identity provider - Enforce auth at the ingress - Single sign-on for the console at the ALB - Prerequisites - 1. Configure the OIDC app - 2. Create the client Secret - 3. Allow the LB controller to read the Secret - 4. Add the auth annotations - 5. Verify - Troubleshooting - Annotation reference - Run attribution (`executed_by`) - Behind a non-ALB proxy (oauth2-proxy / Traefik) - [Enable app serving](https://www.union.ai/docs/latest/flyte/oss-deployment/app-serving/page.md) - How it works - Prerequisites - 1. Install Knative Serving and Kourier - 2. Configure the apps domain - 3. Expose Kourier - LoadBalancer (simplest) - AWS (ALB in front) - 4. Enable app serving in Flyte - 5. Verify - Troubleshooting