Try Flyte 2 locally with the devbox
Get started
Union.ai Docs logo
Union.ai Docs
v2
v1
Support
Signup
Union.ai Docs logo
Union.ai Docs
  • User guide
    • Get started
      • Quickstart
      • Core concepts
        • TaskEnvironment
        • Tasks
        • Runs and actions
        • Where your data lives
        • Apps
        • Projects and domains
        • Key capabilities
        • Settings
        • Basic project
        • Leases
      • Run modes
        • Run locally in Python
        • Run locally on the devbox
        • Run on a remote cluster
    • Tasks
      • Configure tasks
        • Container images
        • Resources
        • Secrets
        • Caching
        • Reusable containers
        • Pod templates
        • Multiple environments
        • Retries and timeouts
        • Triggers
        • Interruptible tasks
        • Queues
        • Task plugins
        • Additional task settings
        • Logging
        • Overrides
      • Build tasks
        • Files and directories
        • Volumes
        • Data classes and structures
        • DataFrames
        • Custom types
        • Custom context
        • Abort and cancel actions
        • Raw Container Tasks
        • Links
        • Reports
        • Notebooks
        • Remote tasks
        • Error handling
        • Traces
        • Intra-task checkpoints
        • Grouping actions
        • Fanout
        • Mapping over inputs
        • Consuming a message queue
        • Controlling parallel execution
        • Streaming map-reduce
        • Structured concurrency with anyio
        • Task dependencies and ordering
        • External conditions
        • Unit Testing Tasks
        • Higher-order functions
        • Other features
      • Run and deploy tasks
        • How task run works
        • Interact with runs and actions
        • View logs
        • Work with local data
        • Run command options
        • Build a custom CLI
        • How task deployment works
        • Deploy command options
        • Packaging
        • Running Tasks via Webhooks
        • Deployment patterns
        • Run context
        • Entrypoint tasks
        • Run a Python script
        • Run with notifications
        • Rerun a run
        • Debug a run
    • Apps
      • Configure apps
        • App environments
        • Including additional files
        • Passing parameters into app environments
        • Autoscaling apps
        • Apps depending on other environments
      • Build apps
        • Single-script apps
        • Multi-script apps
        • Serving graphs
        • Hybrid app-task graphs
        • WebSocket apps
        • Browser apps
        • Secret-based authentication
        • Connector app
      • Native app integrations
        • Streamlit app
        • FastAPI app
        • vLLM app
        • SGLang app
        • Ollama app
        • Flyte webhook
      • Serve and deploy apps
        • How app serving works
        • How app custom domains work
        • How app deployment works
        • Activating and deactivating apps
        • Prefetching models
    • Agents
      • Build an agent
        • Pure Python agents
        • Flyte-native agents
        • Bring your own framework
        • Agent memory
        • Agent chat UI
        • Deploy an agent as a service
      • Build an MCP
        • User-defined MCP server
        • Flyte MCP server
      • Sandboxing
        • Workflow sandboxing
        • Programmatic tool calling for agents
        • Code sandboxing
    • Authenticating
    • User management
    • Cluster and workload management
      • Cluster pools
      • Clusters
      • Managing queues
    • Project patterns
      • Bring your own image (BYOI)
      • Monorepo with uv
      • CI/CD deployments
      • Resource management and multi-team scaling
    • Scale your runs
      • Data flow
      • Life of a run
      • Scale your workflows
      • Batch inference
    • Advanced project
      • Resilient generation
      • Agentic refinement
      • Parallel outputs
      • Serving app
    • Migration
      • From Flyte 1 to 2
        • Migration Overview
        • Tasks and workflows
        • Task configuration
        • CLI and configuration
        • Control flow
        • Parallelism and fan-out
        • Data types and I/O
        • ML workloads
        • New in Flyte 2
        • Union features
        • Hybrid v1 and v2 pipelines
        • Gotchas and caveats
      • From Airflow to Flyte
        • Part 1: vanilla operators
  • Tutorials
    • Biotech & healthcare
      • Genomic alignment
        • Brain tumor MRI classification
          • Cross-species gene comparison
            • Genomic variant effect prediction
              • Drug molecule screening agent
              • Geospatial
                • GPU-accelerated climate modeling
                  • Satellite image classification
                  • Financial services & fintech
                    • Multi-agent trading simulation
                      • Fraud detection with Feast
                        • Financial research agent
                        • Frontier AI
                          • Distributed LLM pretraining
                          • Computer vision
                            • Fine-tuning a VLM
                              • Multimodal retrieval evaluation
                                • RT-DETR object detection
                                • Agents
                                  • Autoresearch agent
                                    • Parallelized autoresearch agent
                                      • AutoSec researcher agent
                                        • Coding agent
                                          • Competitive intelligence agent
                                            • Deep research
                                              • LangGraph research agent
                                                • MLE bot
                                                  • Compliance monitoring agent
                                                    • Field data enrichment agent
                                                      • Support resolution agent
                                                        • Code mode analytics agent
                                                        • Context engineering
                                                          • Text-to-SQL prompt optimization
                                                            • Automatic prompt engineering
                                                            • Model training
                                                              • LLM fine-tuning with LoRA and QLoRA
                                                                • BERT emotion classification
                                                                  • Hyperparameter optimization
                                                                  • Data processing
                                                                    • Batching strategies
                                                                    • Reinforcement learning
                                                                      • RL for LLMs with GRPO and LoRA
                                                                      • Inference
                                                                        • Voice customer-service agent
                                                                      • Reference
                                                                        • LLM-optimized documentation
                                                                        • Flyte CLI
                                                                        • Flyte SDK
                                                                          • flyte
                                                                            • AppHandle
                                                                            • AsyncFunctionTaskTemplate
                                                                            • Backoff
                                                                            • BaseCheckpoint
                                                                            • Cache
                                                                            • CachePolicy
                                                                            • Checkpoint
                                                                            • ConditionWebhook
                                                                            • Cron
                                                                            • Device
                                                                            • Environment
                                                                            • FixedRate
                                                                            • Image
                                                                            • ImageBuild
                                                                            • Link
                                                                            • PodTemplate
                                                                            • Resources
                                                                            • RetryStrategy
                                                                            • ReusePolicy
                                                                            • Secret
                                                                            • TaskEnvironment
                                                                            • TaskTemplate
                                                                            • Timeout
                                                                            • Trigger
                                                                          • flyte.ai.agents
                                                                            • AccessDenied
                                                                            • Agent
                                                                            • AgentEvent
                                                                            • AgentProtocol
                                                                            • AgentResult
                                                                            • AgentTool
                                                                            • ConcurrencyError
                                                                            • LLMMessage
                                                                            • MCPServerSpec
                                                                            • MemoryMeta
                                                                            • MemoryStore
                                                                            • MemoryStoreError
                                                                            • ToolFn
                                                                          • flyte.ai.agents.agent
                                                                            • Agent
                                                                            • AgentEvent
                                                                          • flyte.ai.agents.memory
                                                                            • AccessDenied
                                                                            • ConcurrencyError
                                                                            • MemoryMeta
                                                                            • MemoryStore
                                                                            • MemoryStoreError
                                                                          • flyte.ai.agents.protocol
                                                                            • AgentProtocol
                                                                            • AgentResult
                                                                          • flyte.ai.chat
                                                                            • AgentChatAppEnvironment
                                                                            • CustomTheme
                                                                          • flyte.ai.chat.app
                                                                            • AgentChatAppEnvironment
                                                                            • CustomTheme
                                                                          • flyte.ai.mcp
                                                                            • FlyteMCPAppEnvironment
                                                                            • MCPAppEnvironment
                                                                          • flyte.app
                                                                            • AppEndpoint
                                                                            • AppEnvironment
                                                                            • ConnectorEnvironment
                                                                            • DeployedAppEnvironment
                                                                            • Domain
                                                                            • Link
                                                                            • Parameter
                                                                            • Port
                                                                            • RunOutput
                                                                            • Scaling
                                                                            • Timeouts
                                                                          • flyte.app.extras
                                                                            • FastAPIAppEnvironment
                                                                            • FastAPIPassthroughAuthMiddleware
                                                                            • FlyteWebhookAppEnvironment
                                                                          • flyte.clustered
                                                                            • ClusteredTaskEnvironment
                                                                            • ClusteredTaskTemplate
                                                                            • ClusterFailurePolicy
                                                                            • TorchRun
                                                                          • flyte.config
                                                                            • Config
                                                                          • flyte.connectors
                                                                            • AsyncConnector
                                                                            • AsyncConnectorExecutorMixin
                                                                            • ConnectorRegistry
                                                                            • ConnectorService
                                                                            • Resource
                                                                            • ResourceMeta
                                                                          • flyte.connectors.utils
                                                                            • flyte.durable
                                                                              • flyte.errors
                                                                                • ActionAbortedError
                                                                                • ActionNotFoundError
                                                                                • BaseRuntimeError
                                                                                • CodeBundleError
                                                                                • ConditionAlreadyExistsError
                                                                                • ConditionFailedError
                                                                                • ConditionNotFoundError
                                                                                • ConditionTimedoutError
                                                                                • CustomError
                                                                                • DeploymentError
                                                                                • ImageBuildError
                                                                                • ImagePullBackOffError
                                                                                • InitializationError
                                                                                • InlineIOMaxBytesBreached
                                                                                • InvalidImageNameError
                                                                                • InvalidPackageError
                                                                                • LogsNotYetAvailableError
                                                                                • ModuleLoadError
                                                                                • NonRecoverableError
                                                                                • NotInTaskContextError
                                                                                • OnlyAsyncIOSupportedError
                                                                                • OOMError
                                                                                • ParameterMaterializationError
                                                                                • PrimaryContainerNotFoundError
                                                                                • RemoteTaskNotFoundError
                                                                                • RemoteTaskUsageError
                                                                                • RestrictedTypeError
                                                                                • RetriesExhaustedError
                                                                                • RuntimeDataValidationError
                                                                                • RuntimeSystemError
                                                                                • RuntimeUnknownError
                                                                                • RuntimeUserError
                                                                                • SlowDownError
                                                                                • TaskInterruptedError
                                                                                • TaskTimeoutError
                                                                                • TraceDoesNotAllowNestedTasksError
                                                                                • UnionRpcError
                                                                              • flyte.extend
                                                                                • AsyncFunctionTaskTemplate
                                                                                • ImageBuildEngine
                                                                                • ImageBuilder
                                                                                • ImageChecker
                                                                                • TaskTemplate
                                                                              • flyte.extras
                                                                                • BatchStats
                                                                                • ContainerTask
                                                                                • CostEstimator
                                                                                • DynamicBatcher
                                                                                • Prompt
                                                                                • Sleep
                                                                                • SleepTask
                                                                                • TokenBatcher
                                                                                • TokenEstimator
                                                                              • flyte.extras.shell
                                                                                • FlagSpec
                                                                                • Glob
                                                                                • Stderr
                                                                                • Stdout
                                                                              • flyte.git
                                                                                • GitStatus
                                                                              • flyte.io
                                                                                • DataFrame
                                                                                • Dir
                                                                                • EmptyDir
                                                                                • File
                                                                                • HashFunction
                                                                              • flyte.io.extend
                                                                                • DataFrameDecoder
                                                                                • DataFrameEncoder
                                                                                • DataFrameTransformerEngine
                                                                              • flyte.models
                                                                                • ActionID
                                                                                • ActionPhase
                                                                                • CheckpointPaths
                                                                                • CodeBundle
                                                                                • GroupData
                                                                                • NativeInterface
                                                                                • PathRewrite
                                                                                • RawDataPath
                                                                                • SerializationContext
                                                                                • TaskContext
                                                                              • flyte.notify
                                                                                • Email
                                                                                • NamedDelivery
                                                                                • NamedRule
                                                                                • Notification
                                                                                • Slack
                                                                                • Teams
                                                                                • Webhook
                                                                              • flyte.prefetch
                                                                                • HuggingFaceModelInfo
                                                                                • ShardConfig
                                                                                • StoredModelInfo
                                                                                • VLLMShardArgs
                                                                              • flyte.remote
                                                                                • Action
                                                                                • ActionDetails
                                                                                • ActionInputs
                                                                                • ActionOutputs
                                                                                • App
                                                                                • Condition
                                                                                • Project
                                                                                • Run
                                                                                • RunDetails
                                                                                • Secret
                                                                                • Settings
                                                                                • Task
                                                                                • TaskDetails
                                                                                • TimeFilter
                                                                                • Trigger
                                                                                • User
                                                                              • flyte.report
                                                                                • Report
                                                                                • Timeline
                                                                              • flyte.sandbox
                                                                                • CodeTaskTemplate
                                                                                • ImageConfig
                                                                                • SandboxedConfig
                                                                                • SandboxedTaskTemplate
                                                                              • flyte.storage
                                                                                • ABFS
                                                                                • GCS
                                                                                • S3
                                                                                • Storage
                                                                              • flyte.syncify
                                                                                • Syncify
                                                                              • flyte.types
                                                                                • FlytePickle
                                                                                • Renderable
                                                                                • TypeEngine
                                                                                • TypeTransformer
                                                                                • TypeTransformerFailedError
                                                                            • Flyte agent plugins
                                                                            • Union plugin
                                                                              • Integrations
                                                                                • Agent frameworks
                                                                                  • Claude Agent SDK
                                                                                    • Core
                                                                                      • ReportTimeline
                                                                                      • ToolTaskResolver
                                                                                    • CrewAI
                                                                                      • Deep Agents
                                                                                        • DurableChatModel
                                                                                      • Google ADK
                                                                                        • FlyteLlm
                                                                                      • Hermes
                                                                                        • LangChain
                                                                                          • LangGraph
                                                                                            • Mistral
                                                                                              • OpenAI Agents SDK
                                                                                                • FlyteModel
                                                                                                • FlyteModelProvider
                                                                                                • FlyteSession
                                                                                                • FlyteTracingProcessor
                                                                                                • FunctionTool
                                                                                              • Pydantic AI
                                                                                                • FlyteModel
                                                                                            • Anthropic
                                                                                              • Agent
                                                                                            • BigQuery
                                                                                              • BigQueryConfig
                                                                                              • BigQueryConnector
                                                                                              • BigQueryTask
                                                                                            • Code generation
                                                                                              • AutoCoderAgent
                                                                                              • CodeGenEvalResult
                                                                                              • CodePlan
                                                                                              • CodeSolution
                                                                                              • ErrorDiagnosis
                                                                                              • ImageConfig
                                                                                            • Dask
                                                                                              • Dask
                                                                                              • Scheduler
                                                                                              • WorkerGroup
                                                                                            • Databricks
                                                                                              • Databricks
                                                                                              • DatabricksConnector
                                                                                            • Gemini
                                                                                              • Agent
                                                                                            • Hydra
                                                                                              • JSONL
                                                                                                • JsonlDir
                                                                                                • JsonlFile
                                                                                              • MLflow
                                                                                                • Mlflow
                                                                                              • OmegaConf
                                                                                                • OpenAI
                                                                                                  • Papermill
                                                                                                    • NotebookTask
                                                                                                  • Polars
                                                                                                    • ParquetToPolarsDecodingHandler
                                                                                                    • ParquetToPolarsLazyFrameDecodingHandler
                                                                                                    • PolarsLazyFrameToParquetEncodingHandler
                                                                                                    • PolarsToParquetEncodingHandler
                                                                                                  • PyTorch
                                                                                                    • Elastic
                                                                                                  • Ray
                                                                                                    • HeadNodeConfig
                                                                                                    • RayJobConfig
                                                                                                    • WorkerNodeConfig
                                                                                                  • SGLang
                                                                                                    • SGLangAppEnvironment
                                                                                                  • Snowflake
                                                                                                    • Snowflake
                                                                                                    • SnowflakeConfig
                                                                                                    • SnowflakeConnector
                                                                                                  • Spark
                                                                                                    • ParquetToSparkDecoder
                                                                                                    • Spark
                                                                                                    • SparkToParquetEncoder
                                                                                                  • vLLM
                                                                                                    • VLLMAppEnvironment
                                                                                                  • Weights & Biases
                                                                                                    • Wandb
                                                                                                    • WandbSweep
                                                                                                • Uctl CLI
                                                                                                • Integrations
                                                                                                  • Agent frameworks
                                                                                                    • How it works
                                                                                                    • OpenAI
                                                                                                    • Claude
                                                                                                    • Google ADK
                                                                                                    • Mistral
                                                                                                    • LangChain
                                                                                                    • LangGraph
                                                                                                    • Deep Agents
                                                                                                    • CrewAI
                                                                                                    • Pydantic AI
                                                                                                    • Hermes
                                                                                                  • BigQuery
                                                                                                    • Code generation
                                                                                                      • Dask
                                                                                                        • Databricks
                                                                                                          • Grafana Agent Observability
                                                                                                            • Hydra
                                                                                                              • JSONL
                                                                                                                • MLflow
                                                                                                                  • OmegaConf
                                                                                                                    • OpenTelemetry
                                                                                                                      • Exporters and configuration
                                                                                                                      • Traces across crashes and resumes
                                                                                                                    • Pandera
                                                                                                                      • Papermill
                                                                                                                        • Polars
                                                                                                                          • PyTorch
                                                                                                                            • Ray
                                                                                                                              • Snowflake
                                                                                                                                • Spark
                                                                                                                                  • Weights & Biases
                                                                                                                                    • Experiments
                                                                                                                                    • Distributed training
                                                                                                                                    • Sweeps
                                                                                                                                    • Downloading logs
                                                                                                                                    • Constraints and best practices
                                                                                                                                    • Manual integration
                                                                                                                                • Platform deployment
                                                                                                                                  • BYOC deployment
                                                                                                                                    • Platform architecture
                                                                                                                                    • Configuring your data plane
                                                                                                                                    • Multi-cluster and multi-cloud
                                                                                                                                    • Data plane setup on AWS
                                                                                                                                    • Data plane setup on GCP
                                                                                                                                    • Data plane setup on Azure
                                                                                                                                    • Data retention policy
                                                                                                                                    • Enabling AWS resources
                                                                                                                                      • Enabling AWS S3
                                                                                                                                      • Enabling AWS ECR
                                                                                                                                      • Enabling AWS Secrets Manager
                                                                                                                                    • Enabling GCP resources
                                                                                                                                      • Enabling Google Cloud Storage
                                                                                                                                      • Enabling Google Artifact Registry
                                                                                                                                      • Enabling Google Secret Manager
                                                                                                                                      • Enabling BigQuery
                                                                                                                                    • Enabling Azure resources
                                                                                                                                      • Enabling Azure Blob Storage
                                                                                                                                      • Enabling Azure Container Registry (ACR)
                                                                                                                                      • Enabling Azure Key Vault
                                                                                                                                    • Single sign on setup
                                                                                                                                      • Google OpenID Connect
                                                                                                                                      • Microsoft Entra ID (formerly Azure AD)
                                                                                                                                      • Other identity providers
                                                                                                                                  • Self-managed deployment
                                                                                                                                    • Architecture
                                                                                                                                      • Overview
                                                                                                                                      • Kubernetes Access Controls
                                                                                                                                    • Cluster recommendations
                                                                                                                                    • Data plane setup on generic Kubernetes
                                                                                                                                      • Prepare infrastructure
                                                                                                                                      • Deploy the dataplane
                                                                                                                                    • Data plane setup on AWS
                                                                                                                                      • Prepare infrastructure
                                                                                                                                      • Deploy the dataplane
                                                                                                                                    • Data plane setup on GCP
                                                                                                                                      • Prepare infrastructure
                                                                                                                                      • Deploy the dataplane
                                                                                                                                    • Data plane setup on Azure
                                                                                                                                      • Prepare infrastructure
                                                                                                                                      • Deploy the dataplane
                                                                                                                                    • Data plane setup on OCI
                                                                                                                                      • Prepare infrastructure
                                                                                                                                      • Deploy the dataplane
                                                                                                                                    • Data plane setup on CoreWeave
                                                                                                                                      • Prepare infrastructure
                                                                                                                                      • Deploy the dataplane
                                                                                                                                    • Data plane setup on Crusoe
                                                                                                                                      • Prepare infrastructure
                                                                                                                                      • Deploy the dataplane
                                                                                                                                    • Data plane setup on Nebius
                                                                                                                                      • Prepare infrastructure
                                                                                                                                      • Deploy the dataplane
                                                                                                                                    • Configuration
                                                                                                                                      • Interruptible task scheduling
                                                                                                                                      • Node pools
                                                                                                                                      • Authentication
                                                                                                                                      • Code Viewer
                                                                                                                                      • Image Builder
                                                                                                                                      • Multiple Clusters
                                                                                                                                      • Persistent logs
                                                                                                                                      • Monitoring
                                                                                                                                      • Secrets
                                                                                                                                      • Data retention policies
                                                                                                                                      • Compute plugins
                                                                                                                                      • Namespace mapping
                                                                                                                                      • Volumes
                                                                                                                                    • Helm chart reference
                                                                                                                                      • Dataplane chart
                                                                                                                                      • Knative Operator chart
                                                                                                                                  • Manage Union through Terraform
                                                                                                                                    • Installation
                                                                                                                                    • Resource management
                                                                                                                                    • Security best practices
                                                                                                                                • Zero Trust security
                                                                                                                                  • Architecture
                                                                                                                                    • Two-plane separation
                                                                                                                                    • Control plane
                                                                                                                                    • Data plane
                                                                                                                                    • Network architecture
                                                                                                                                    • Sovereign Data Plane
                                                                                                                                    • Private connectivity (BYOC)
                                                                                                                                  • Data protection
                                                                                                                                    • Data classification and residency
                                                                                                                                    • Secrets management
                                                                                                                                    • Logging and audit
                                                                                                                                  • Identity and access
                                                                                                                                    • Authentication
                                                                                                                                    • Role-based access control
                                                                                                                                    • Human access controls
                                                                                                                                  • Compliance and governance
                                                                                                                                    • Certifications and Trust Center
                                                                                                                                    • HIPAA compliance
                                                                                                                                    • GDPR alignment
                                                                                                                                    • Standards compliance
                                                                                                                                    • Shared responsibility model
                                                                                                                                    • Organizational security
                                                                                                                                    • Vulnerability management
                                                                                                                                • Community
                                                                                                                                  • Contributing docs and examples
                                                                                                                                    • Set up a local docs dev environment
                                                                                                                                    • Authoring
                                                                                                                                    • Submit a contribution
                                                                                                                                    • Writing guidelines
                                                                                                                                    • Variants
                                                                                                                                    • Versions
                                                                                                                                    • Shortcodes
                                                                                                                                    • API docs
                                                                                                                                    • LLM-optimized documentation
                                                                                                                                    • Redirects
                                                                                                                                    • Production builds and troubleshooting
                                                                                                                                • Release notes
                                                                                                                                  Documentation navigation for Union including user guides, tutorials, API references, and integration examples
                                                                                                                                  • User guide
                                                                                                                                    • Get started
                                                                                                                                      • Quickstart
                                                                                                                                      • Core concepts
                                                                                                                                        • TaskEnvironment
                                                                                                                                        • Tasks
                                                                                                                                        • Runs and actions
                                                                                                                                        • Where your data lives
                                                                                                                                        • Apps
                                                                                                                                        • Projects and domains
                                                                                                                                        • Key capabilities
                                                                                                                                        • Settings
                                                                                                                                        • Basic project
                                                                                                                                        • Leases
                                                                                                                                      • Run modes
                                                                                                                                        • Run locally in Python
                                                                                                                                        • Run locally on the devbox
                                                                                                                                        • Run on a remote cluster
                                                                                                                                    • Tasks
                                                                                                                                      • Configure tasks
                                                                                                                                        • Container images
                                                                                                                                        • Resources
                                                                                                                                        • Secrets
                                                                                                                                        • Caching
                                                                                                                                        • Reusable containers
                                                                                                                                        • Pod templates
                                                                                                                                        • Multiple environments
                                                                                                                                        • Retries and timeouts
                                                                                                                                        • Triggers
                                                                                                                                        • Interruptible tasks
                                                                                                                                        • Queues
                                                                                                                                        • Task plugins
                                                                                                                                        • Additional task settings
                                                                                                                                        • Logging
                                                                                                                                        • Overrides
                                                                                                                                      • Build tasks
                                                                                                                                        • Files and directories
                                                                                                                                        • Volumes
                                                                                                                                        • Data classes and structures
                                                                                                                                        • DataFrames
                                                                                                                                        • Custom types
                                                                                                                                        • Custom context
                                                                                                                                        • Abort and cancel actions
                                                                                                                                        • Raw Container Tasks
                                                                                                                                        • Links
                                                                                                                                        • Reports
                                                                                                                                        • Notebooks
                                                                                                                                        • Remote tasks
                                                                                                                                        • Error handling
                                                                                                                                        • Traces
                                                                                                                                        • Intra-task checkpoints
                                                                                                                                        • Grouping actions
                                                                                                                                        • Fanout
                                                                                                                                        • Mapping over inputs
                                                                                                                                        • Consuming a message queue
                                                                                                                                        • Controlling parallel execution
                                                                                                                                        • Streaming map-reduce
                                                                                                                                        • Structured concurrency with anyio
                                                                                                                                        • Task dependencies and ordering
                                                                                                                                        • External conditions
                                                                                                                                        • Unit Testing Tasks
                                                                                                                                        • Higher-order functions
                                                                                                                                        • Other features
                                                                                                                                      • Run and deploy tasks
                                                                                                                                        • How task run works
                                                                                                                                        • Interact with runs and actions
                                                                                                                                        • View logs
                                                                                                                                        • Work with local data
                                                                                                                                        • Run command options
                                                                                                                                        • Build a custom CLI
                                                                                                                                        • How task deployment works
                                                                                                                                        • Deploy command options
                                                                                                                                        • Packaging
                                                                                                                                        • Running Tasks via Webhooks
                                                                                                                                        • Deployment patterns
                                                                                                                                        • Run context
                                                                                                                                        • Entrypoint tasks
                                                                                                                                        • Run a Python script
                                                                                                                                        • Run with notifications
                                                                                                                                        • Rerun a run
                                                                                                                                        • Debug a run
                                                                                                                                    • Apps
                                                                                                                                      • Configure apps
                                                                                                                                        • App environments
                                                                                                                                        • Including additional files
                                                                                                                                        • Passing parameters into app environments
                                                                                                                                        • Autoscaling apps
                                                                                                                                        • Apps depending on other environments
                                                                                                                                      • Build apps
                                                                                                                                        • Single-script apps
                                                                                                                                        • Multi-script apps
                                                                                                                                        • Serving graphs
                                                                                                                                        • Hybrid app-task graphs
                                                                                                                                        • WebSocket apps
                                                                                                                                        • Browser apps
                                                                                                                                        • Secret-based authentication
                                                                                                                                        • Connector app
                                                                                                                                      • Native app integrations
                                                                                                                                        • Streamlit app
                                                                                                                                        • FastAPI app
                                                                                                                                        • vLLM app
                                                                                                                                        • SGLang app
                                                                                                                                        • Ollama app
                                                                                                                                        • Flyte webhook
                                                                                                                                      • Serve and deploy apps
                                                                                                                                        • How app serving works
                                                                                                                                        • How app custom domains work
                                                                                                                                        • How app deployment works
                                                                                                                                        • Activating and deactivating apps
                                                                                                                                        • Prefetching models
                                                                                                                                    • Agents
                                                                                                                                      • Build an agent
                                                                                                                                        • Pure Python agents
                                                                                                                                        • Flyte-native agents
                                                                                                                                        • Bring your own framework
                                                                                                                                        • Agent memory
                                                                                                                                        • Agent chat UI
                                                                                                                                        • Deploy an agent as a service
                                                                                                                                      • Build an MCP
                                                                                                                                        • User-defined MCP server
                                                                                                                                        • Flyte MCP server
                                                                                                                                      • Sandboxing
                                                                                                                                        • Workflow sandboxing
                                                                                                                                        • Programmatic tool calling for agents
                                                                                                                                        • Code sandboxing
                                                                                                                                    • Authenticating
                                                                                                                                    • User management
                                                                                                                                    • Cluster and workload management
                                                                                                                                      • Cluster pools
                                                                                                                                      • Clusters
                                                                                                                                      • Managing queues
                                                                                                                                    • Project patterns
                                                                                                                                      • Bring your own image (BYOI)
                                                                                                                                      • Monorepo with uv
                                                                                                                                      • CI/CD deployments
                                                                                                                                      • Resource management and multi-team scaling
                                                                                                                                    • Scale your runs
                                                                                                                                      • Data flow
                                                                                                                                      • Life of a run
                                                                                                                                      • Scale your workflows
                                                                                                                                      • Batch inference
                                                                                                                                    • Advanced project
                                                                                                                                      • Resilient generation
                                                                                                                                      • Agentic refinement
                                                                                                                                      • Parallel outputs
                                                                                                                                      • Serving app
                                                                                                                                    • Migration
                                                                                                                                      • From Flyte 1 to 2
                                                                                                                                        • Migration Overview
                                                                                                                                        • Tasks and workflows
                                                                                                                                        • Task configuration
                                                                                                                                        • CLI and configuration
                                                                                                                                        • Control flow
                                                                                                                                        • Parallelism and fan-out
                                                                                                                                        • Data types and I/O
                                                                                                                                        • ML workloads
                                                                                                                                        • New in Flyte 2
                                                                                                                                        • Union features
                                                                                                                                        • Hybrid v1 and v2 pipelines
                                                                                                                                        • Gotchas and caveats
                                                                                                                                      • From Airflow to Flyte
                                                                                                                                        • Part 1: vanilla operators
                                                                                                                                  • Tutorials
                                                                                                                                    • Biotech & healthcare
                                                                                                                                      • Genomic alignment
                                                                                                                                        • Brain tumor MRI classification
                                                                                                                                          • Cross-species gene comparison
                                                                                                                                            • Genomic variant effect prediction
                                                                                                                                              • Drug molecule screening agent
                                                                                                                                              • Geospatial
                                                                                                                                                • GPU-accelerated climate modeling
                                                                                                                                                  • Satellite image classification
                                                                                                                                                  • Financial services & fintech
                                                                                                                                                    • Multi-agent trading simulation
                                                                                                                                                      • Fraud detection with Feast
                                                                                                                                                        • Financial research agent
                                                                                                                                                        • Frontier AI
                                                                                                                                                          • Distributed LLM pretraining
                                                                                                                                                          • Computer vision
                                                                                                                                                            • Fine-tuning a VLM
                                                                                                                                                              • Multimodal retrieval evaluation
                                                                                                                                                                • RT-DETR object detection
                                                                                                                                                                • Agents
                                                                                                                                                                  • Autoresearch agent
                                                                                                                                                                    • Parallelized autoresearch agent
                                                                                                                                                                      • AutoSec researcher agent
                                                                                                                                                                        • Coding agent
                                                                                                                                                                          • Competitive intelligence agent
                                                                                                                                                                            • Deep research
                                                                                                                                                                              • LangGraph research agent
                                                                                                                                                                                • MLE bot
                                                                                                                                                                                  • Compliance monitoring agent
                                                                                                                                                                                    • Field data enrichment agent
                                                                                                                                                                                      • Support resolution agent
                                                                                                                                                                                        • Code mode analytics agent
                                                                                                                                                                                        • Context engineering
                                                                                                                                                                                          • Text-to-SQL prompt optimization
                                                                                                                                                                                            • Automatic prompt engineering
                                                                                                                                                                                            • Model training
                                                                                                                                                                                              • LLM fine-tuning with LoRA and QLoRA
                                                                                                                                                                                                • BERT emotion classification
                                                                                                                                                                                                  • Hyperparameter optimization
                                                                                                                                                                                                  • Data processing
                                                                                                                                                                                                    • Batching strategies
                                                                                                                                                                                                    • Reinforcement learning
                                                                                                                                                                                                      • RL for LLMs with GRPO and LoRA
                                                                                                                                                                                                      • Inference
                                                                                                                                                                                                        • Voice customer-service agent
                                                                                                                                                                                                      • Reference
                                                                                                                                                                                                        • LLM-optimized documentation
                                                                                                                                                                                                        • Flyte CLI
                                                                                                                                                                                                        • Flyte SDK
                                                                                                                                                                                                          • flyte
                                                                                                                                                                                                            • AppHandle
                                                                                                                                                                                                            • AsyncFunctionTaskTemplate
                                                                                                                                                                                                            • Backoff
                                                                                                                                                                                                            • BaseCheckpoint
                                                                                                                                                                                                            • Cache
                                                                                                                                                                                                            • CachePolicy
                                                                                                                                                                                                            • Checkpoint
                                                                                                                                                                                                            • ConditionWebhook
                                                                                                                                                                                                            • Cron
                                                                                                                                                                                                            • Device
                                                                                                                                                                                                            • Environment
                                                                                                                                                                                                            • FixedRate
                                                                                                                                                                                                            • Image
                                                                                                                                                                                                            • ImageBuild
                                                                                                                                                                                                            • Link
                                                                                                                                                                                                            • PodTemplate
                                                                                                                                                                                                            • Resources
                                                                                                                                                                                                            • RetryStrategy
                                                                                                                                                                                                            • ReusePolicy
                                                                                                                                                                                                            • Secret
                                                                                                                                                                                                            • TaskEnvironment
                                                                                                                                                                                                            • TaskTemplate
                                                                                                                                                                                                            • Timeout
                                                                                                                                                                                                            • Trigger
                                                                                                                                                                                                          • flyte.ai.agents
                                                                                                                                                                                                            • AccessDenied
                                                                                                                                                                                                            • Agent
                                                                                                                                                                                                            • AgentEvent
                                                                                                                                                                                                            • AgentProtocol
                                                                                                                                                                                                            • AgentResult
                                                                                                                                                                                                            • AgentTool
                                                                                                                                                                                                            • ConcurrencyError
                                                                                                                                                                                                            • LLMMessage
                                                                                                                                                                                                            • MCPServerSpec
                                                                                                                                                                                                            • MemoryMeta
                                                                                                                                                                                                            • MemoryStore
                                                                                                                                                                                                            • MemoryStoreError
                                                                                                                                                                                                            • ToolFn
                                                                                                                                                                                                          • flyte.ai.agents.agent
                                                                                                                                                                                                            • Agent
                                                                                                                                                                                                            • AgentEvent
                                                                                                                                                                                                          • flyte.ai.agents.memory
                                                                                                                                                                                                            • AccessDenied
                                                                                                                                                                                                            • ConcurrencyError
                                                                                                                                                                                                            • MemoryMeta
                                                                                                                                                                                                            • MemoryStore
                                                                                                                                                                                                            • MemoryStoreError
                                                                                                                                                                                                          • flyte.ai.agents.protocol
                                                                                                                                                                                                            • AgentProtocol
                                                                                                                                                                                                            • AgentResult
                                                                                                                                                                                                          • flyte.ai.chat
                                                                                                                                                                                                            • AgentChatAppEnvironment
                                                                                                                                                                                                            • CustomTheme
                                                                                                                                                                                                          • flyte.ai.chat.app
                                                                                                                                                                                                            • AgentChatAppEnvironment
                                                                                                                                                                                                            • CustomTheme
                                                                                                                                                                                                          • flyte.ai.mcp
                                                                                                                                                                                                            • FlyteMCPAppEnvironment
                                                                                                                                                                                                            • MCPAppEnvironment
                                                                                                                                                                                                          • flyte.app
                                                                                                                                                                                                            • AppEndpoint
                                                                                                                                                                                                            • AppEnvironment
                                                                                                                                                                                                            • ConnectorEnvironment
                                                                                                                                                                                                            • DeployedAppEnvironment
                                                                                                                                                                                                            • Domain
                                                                                                                                                                                                            • Link
                                                                                                                                                                                                            • Parameter
                                                                                                                                                                                                            • Port
                                                                                                                                                                                                            • RunOutput
                                                                                                                                                                                                            • Scaling
                                                                                                                                                                                                            • Timeouts
                                                                                                                                                                                                          • flyte.app.extras
                                                                                                                                                                                                            • FastAPIAppEnvironment
                                                                                                                                                                                                            • FastAPIPassthroughAuthMiddleware
                                                                                                                                                                                                            • FlyteWebhookAppEnvironment
                                                                                                                                                                                                          • flyte.clustered
                                                                                                                                                                                                            • ClusteredTaskEnvironment
                                                                                                                                                                                                            • ClusteredTaskTemplate
                                                                                                                                                                                                            • ClusterFailurePolicy
                                                                                                                                                                                                            • TorchRun
                                                                                                                                                                                                          • flyte.config
                                                                                                                                                                                                            • Config
                                                                                                                                                                                                          • flyte.connectors
                                                                                                                                                                                                            • AsyncConnector
                                                                                                                                                                                                            • AsyncConnectorExecutorMixin
                                                                                                                                                                                                            • ConnectorRegistry
                                                                                                                                                                                                            • ConnectorService
                                                                                                                                                                                                            • Resource
                                                                                                                                                                                                            • ResourceMeta
                                                                                                                                                                                                          • flyte.connectors.utils
                                                                                                                                                                                                            • flyte.durable
                                                                                                                                                                                                              • flyte.errors
                                                                                                                                                                                                                • ActionAbortedError
                                                                                                                                                                                                                • ActionNotFoundError
                                                                                                                                                                                                                • BaseRuntimeError
                                                                                                                                                                                                                • CodeBundleError
                                                                                                                                                                                                                • ConditionAlreadyExistsError
                                                                                                                                                                                                                • ConditionFailedError
                                                                                                                                                                                                                • ConditionNotFoundError
                                                                                                                                                                                                                • ConditionTimedoutError
                                                                                                                                                                                                                • CustomError
                                                                                                                                                                                                                • DeploymentError
                                                                                                                                                                                                                • ImageBuildError
                                                                                                                                                                                                                • ImagePullBackOffError
                                                                                                                                                                                                                • InitializationError
                                                                                                                                                                                                                • InlineIOMaxBytesBreached
                                                                                                                                                                                                                • InvalidImageNameError
                                                                                                                                                                                                                • InvalidPackageError
                                                                                                                                                                                                                • LogsNotYetAvailableError
                                                                                                                                                                                                                • ModuleLoadError
                                                                                                                                                                                                                • NonRecoverableError
                                                                                                                                                                                                                • NotInTaskContextError
                                                                                                                                                                                                                • OnlyAsyncIOSupportedError
                                                                                                                                                                                                                • OOMError
                                                                                                                                                                                                                • ParameterMaterializationError
                                                                                                                                                                                                                • PrimaryContainerNotFoundError
                                                                                                                                                                                                                • RemoteTaskNotFoundError
                                                                                                                                                                                                                • RemoteTaskUsageError
                                                                                                                                                                                                                • RestrictedTypeError
                                                                                                                                                                                                                • RetriesExhaustedError
                                                                                                                                                                                                                • RuntimeDataValidationError
                                                                                                                                                                                                                • RuntimeSystemError
                                                                                                                                                                                                                • RuntimeUnknownError
                                                                                                                                                                                                                • RuntimeUserError
                                                                                                                                                                                                                • SlowDownError
                                                                                                                                                                                                                • TaskInterruptedError
                                                                                                                                                                                                                • TaskTimeoutError
                                                                                                                                                                                                                • TraceDoesNotAllowNestedTasksError
                                                                                                                                                                                                                • UnionRpcError
                                                                                                                                                                                                              • flyte.extend
                                                                                                                                                                                                                • AsyncFunctionTaskTemplate
                                                                                                                                                                                                                • ImageBuildEngine
                                                                                                                                                                                                                • ImageBuilder
                                                                                                                                                                                                                • ImageChecker
                                                                                                                                                                                                                • TaskTemplate
                                                                                                                                                                                                              • flyte.extras
                                                                                                                                                                                                                • BatchStats
                                                                                                                                                                                                                • ContainerTask
                                                                                                                                                                                                                • CostEstimator
                                                                                                                                                                                                                • DynamicBatcher
                                                                                                                                                                                                                • Prompt
                                                                                                                                                                                                                • Sleep
                                                                                                                                                                                                                • SleepTask
                                                                                                                                                                                                                • TokenBatcher
                                                                                                                                                                                                                • TokenEstimator
                                                                                                                                                                                                              • flyte.extras.shell
                                                                                                                                                                                                                • FlagSpec
                                                                                                                                                                                                                • Glob
                                                                                                                                                                                                                • Stderr
                                                                                                                                                                                                                • Stdout
                                                                                                                                                                                                              • flyte.git
                                                                                                                                                                                                                • GitStatus
                                                                                                                                                                                                              • flyte.io
                                                                                                                                                                                                                • DataFrame
                                                                                                                                                                                                                • Dir
                                                                                                                                                                                                                • EmptyDir
                                                                                                                                                                                                                • File
                                                                                                                                                                                                                • HashFunction
                                                                                                                                                                                                              • flyte.io.extend
                                                                                                                                                                                                                • DataFrameDecoder
                                                                                                                                                                                                                • DataFrameEncoder
                                                                                                                                                                                                                • DataFrameTransformerEngine
                                                                                                                                                                                                              • flyte.models
                                                                                                                                                                                                                • ActionID
                                                                                                                                                                                                                • ActionPhase
                                                                                                                                                                                                                • CheckpointPaths
                                                                                                                                                                                                                • CodeBundle
                                                                                                                                                                                                                • GroupData
                                                                                                                                                                                                                • NativeInterface
                                                                                                                                                                                                                • PathRewrite
                                                                                                                                                                                                                • RawDataPath
                                                                                                                                                                                                                • SerializationContext
                                                                                                                                                                                                                • TaskContext
                                                                                                                                                                                                              • flyte.notify
                                                                                                                                                                                                                • Email
                                                                                                                                                                                                                • NamedDelivery
                                                                                                                                                                                                                • NamedRule
                                                                                                                                                                                                                • Notification
                                                                                                                                                                                                                • Slack
                                                                                                                                                                                                                • Teams
                                                                                                                                                                                                                • Webhook
                                                                                                                                                                                                              • flyte.prefetch
                                                                                                                                                                                                                • HuggingFaceModelInfo
                                                                                                                                                                                                                • ShardConfig
                                                                                                                                                                                                                • StoredModelInfo
                                                                                                                                                                                                                • VLLMShardArgs
                                                                                                                                                                                                              • flyte.remote
                                                                                                                                                                                                                • Action
                                                                                                                                                                                                                • ActionDetails
                                                                                                                                                                                                                • ActionInputs
                                                                                                                                                                                                                • ActionOutputs
                                                                                                                                                                                                                • App
                                                                                                                                                                                                                • Condition
                                                                                                                                                                                                                • Project
                                                                                                                                                                                                                • Run
                                                                                                                                                                                                                • RunDetails
                                                                                                                                                                                                                • Secret
                                                                                                                                                                                                                • Settings
                                                                                                                                                                                                                • Task
                                                                                                                                                                                                                • TaskDetails
                                                                                                                                                                                                                • TimeFilter
                                                                                                                                                                                                                • Trigger
                                                                                                                                                                                                                • User
                                                                                                                                                                                                              • flyte.report
                                                                                                                                                                                                                • Report
                                                                                                                                                                                                                • Timeline
                                                                                                                                                                                                              • flyte.sandbox
                                                                                                                                                                                                                • CodeTaskTemplate
                                                                                                                                                                                                                • ImageConfig
                                                                                                                                                                                                                • SandboxedConfig
                                                                                                                                                                                                                • SandboxedTaskTemplate
                                                                                                                                                                                                              • flyte.storage
                                                                                                                                                                                                                • ABFS
                                                                                                                                                                                                                • GCS
                                                                                                                                                                                                                • S3
                                                                                                                                                                                                                • Storage
                                                                                                                                                                                                              • flyte.syncify
                                                                                                                                                                                                                • Syncify
                                                                                                                                                                                                              • flyte.types
                                                                                                                                                                                                                • FlytePickle
                                                                                                                                                                                                                • Renderable
                                                                                                                                                                                                                • TypeEngine
                                                                                                                                                                                                                • TypeTransformer
                                                                                                                                                                                                                • TypeTransformerFailedError
                                                                                                                                                                                                            • Flyte agent plugins
                                                                                                                                                                                                            • Union plugin
                                                                                                                                                                                                              • Integrations
                                                                                                                                                                                                                • Agent frameworks
                                                                                                                                                                                                                  • Claude Agent SDK
                                                                                                                                                                                                                    • Core
                                                                                                                                                                                                                      • ReportTimeline
                                                                                                                                                                                                                      • ToolTaskResolver
                                                                                                                                                                                                                    • CrewAI
                                                                                                                                                                                                                      • Deep Agents
                                                                                                                                                                                                                        • DurableChatModel
                                                                                                                                                                                                                      • Google ADK
                                                                                                                                                                                                                        • FlyteLlm
                                                                                                                                                                                                                      • Hermes
                                                                                                                                                                                                                        • LangChain
                                                                                                                                                                                                                          • LangGraph
                                                                                                                                                                                                                            • Mistral
                                                                                                                                                                                                                              • OpenAI Agents SDK
                                                                                                                                                                                                                                • FlyteModel
                                                                                                                                                                                                                                • FlyteModelProvider
                                                                                                                                                                                                                                • FlyteSession
                                                                                                                                                                                                                                • FlyteTracingProcessor
                                                                                                                                                                                                                                • FunctionTool
                                                                                                                                                                                                                              • Pydantic AI
                                                                                                                                                                                                                                • FlyteModel
                                                                                                                                                                                                                            • Anthropic
                                                                                                                                                                                                                              • Agent
                                                                                                                                                                                                                            • BigQuery
                                                                                                                                                                                                                              • BigQueryConfig
                                                                                                                                                                                                                              • BigQueryConnector
                                                                                                                                                                                                                              • BigQueryTask
                                                                                                                                                                                                                            • Code generation
                                                                                                                                                                                                                              • AutoCoderAgent
                                                                                                                                                                                                                              • CodeGenEvalResult
                                                                                                                                                                                                                              • CodePlan
                                                                                                                                                                                                                              • CodeSolution
                                                                                                                                                                                                                              • ErrorDiagnosis
                                                                                                                                                                                                                              • ImageConfig
                                                                                                                                                                                                                            • Dask
                                                                                                                                                                                                                              • Dask
                                                                                                                                                                                                                              • Scheduler
                                                                                                                                                                                                                              • WorkerGroup
                                                                                                                                                                                                                            • Databricks
                                                                                                                                                                                                                              • Databricks
                                                                                                                                                                                                                              • DatabricksConnector
                                                                                                                                                                                                                            • Gemini
                                                                                                                                                                                                                              • Agent
                                                                                                                                                                                                                            • Hydra
                                                                                                                                                                                                                              • JSONL
                                                                                                                                                                                                                                • JsonlDir
                                                                                                                                                                                                                                • JsonlFile
                                                                                                                                                                                                                              • MLflow
                                                                                                                                                                                                                                • Mlflow
                                                                                                                                                                                                                              • OmegaConf
                                                                                                                                                                                                                                • OpenAI
                                                                                                                                                                                                                                  • Papermill
                                                                                                                                                                                                                                    • NotebookTask
                                                                                                                                                                                                                                  • Polars
                                                                                                                                                                                                                                    • ParquetToPolarsDecodingHandler
                                                                                                                                                                                                                                    • ParquetToPolarsLazyFrameDecodingHandler
                                                                                                                                                                                                                                    • PolarsLazyFrameToParquetEncodingHandler
                                                                                                                                                                                                                                    • PolarsToParquetEncodingHandler
                                                                                                                                                                                                                                  • PyTorch
                                                                                                                                                                                                                                    • Elastic
                                                                                                                                                                                                                                  • Ray
                                                                                                                                                                                                                                    • HeadNodeConfig
                                                                                                                                                                                                                                    • RayJobConfig
                                                                                                                                                                                                                                    • WorkerNodeConfig
                                                                                                                                                                                                                                  • SGLang
                                                                                                                                                                                                                                    • SGLangAppEnvironment
                                                                                                                                                                                                                                  • Snowflake
                                                                                                                                                                                                                                    • Snowflake
                                                                                                                                                                                                                                    • SnowflakeConfig
                                                                                                                                                                                                                                    • SnowflakeConnector
                                                                                                                                                                                                                                  • Spark
                                                                                                                                                                                                                                    • ParquetToSparkDecoder
                                                                                                                                                                                                                                    • Spark
                                                                                                                                                                                                                                    • SparkToParquetEncoder
                                                                                                                                                                                                                                  • vLLM
                                                                                                                                                                                                                                    • VLLMAppEnvironment
                                                                                                                                                                                                                                  • Weights & Biases
                                                                                                                                                                                                                                    • Wandb
                                                                                                                                                                                                                                    • WandbSweep
                                                                                                                                                                                                                                • Uctl CLI
                                                                                                                                                                                                                                • Integrations
                                                                                                                                                                                                                                  • Agent frameworks
                                                                                                                                                                                                                                    • How it works
                                                                                                                                                                                                                                    • OpenAI
                                                                                                                                                                                                                                    • Claude
                                                                                                                                                                                                                                    • Google ADK
                                                                                                                                                                                                                                    • Mistral
                                                                                                                                                                                                                                    • LangChain
                                                                                                                                                                                                                                    • LangGraph
                                                                                                                                                                                                                                    • Deep Agents
                                                                                                                                                                                                                                    • CrewAI
                                                                                                                                                                                                                                    • Pydantic AI
                                                                                                                                                                                                                                    • Hermes
                                                                                                                                                                                                                                  • BigQuery
                                                                                                                                                                                                                                    • Code generation
                                                                                                                                                                                                                                      • Dask
                                                                                                                                                                                                                                        • Databricks
                                                                                                                                                                                                                                          • Grafana Agent Observability
                                                                                                                                                                                                                                            • Hydra
                                                                                                                                                                                                                                              • JSONL
                                                                                                                                                                                                                                                • MLflow
                                                                                                                                                                                                                                                  • OmegaConf
                                                                                                                                                                                                                                                    • OpenTelemetry
                                                                                                                                                                                                                                                      • Exporters and configuration
                                                                                                                                                                                                                                                      • Traces across crashes and resumes
                                                                                                                                                                                                                                                    • Pandera
                                                                                                                                                                                                                                                      • Papermill
                                                                                                                                                                                                                                                        • Polars
                                                                                                                                                                                                                                                          • PyTorch
                                                                                                                                                                                                                                                            • Ray
                                                                                                                                                                                                                                                              • Snowflake
                                                                                                                                                                                                                                                                • Spark
                                                                                                                                                                                                                                                                  • Weights & Biases
                                                                                                                                                                                                                                                                    • Experiments
                                                                                                                                                                                                                                                                    • Distributed training
                                                                                                                                                                                                                                                                    • Sweeps
                                                                                                                                                                                                                                                                    • Downloading logs
                                                                                                                                                                                                                                                                    • Constraints and best practices
                                                                                                                                                                                                                                                                    • Manual integration
                                                                                                                                                                                                                                                                • Platform deployment
                                                                                                                                                                                                                                                                  • BYOC deployment
                                                                                                                                                                                                                                                                    • Platform architecture
                                                                                                                                                                                                                                                                    • Configuring your data plane
                                                                                                                                                                                                                                                                    • Multi-cluster and multi-cloud
                                                                                                                                                                                                                                                                    • Data plane setup on AWS
                                                                                                                                                                                                                                                                    • Data plane setup on GCP
                                                                                                                                                                                                                                                                    • Data plane setup on Azure
                                                                                                                                                                                                                                                                    • Data retention policy
                                                                                                                                                                                                                                                                    • Enabling AWS resources
                                                                                                                                                                                                                                                                      • Enabling AWS S3
                                                                                                                                                                                                                                                                      • Enabling AWS ECR
                                                                                                                                                                                                                                                                      • Enabling AWS Secrets Manager
                                                                                                                                                                                                                                                                    • Enabling GCP resources
                                                                                                                                                                                                                                                                      • Enabling Google Cloud Storage
                                                                                                                                                                                                                                                                      • Enabling Google Artifact Registry
                                                                                                                                                                                                                                                                      • Enabling Google Secret Manager
                                                                                                                                                                                                                                                                      • Enabling BigQuery
                                                                                                                                                                                                                                                                    • Enabling Azure resources
                                                                                                                                                                                                                                                                      • Enabling Azure Blob Storage
                                                                                                                                                                                                                                                                      • Enabling Azure Container Registry (ACR)
                                                                                                                                                                                                                                                                      • Enabling Azure Key Vault
                                                                                                                                                                                                                                                                    • Single sign on setup
                                                                                                                                                                                                                                                                      • Google OpenID Connect
                                                                                                                                                                                                                                                                      • Microsoft Entra ID (formerly Azure AD)
                                                                                                                                                                                                                                                                      • Other identity providers
                                                                                                                                                                                                                                                                  • Self-managed deployment
                                                                                                                                                                                                                                                                    • Architecture
                                                                                                                                                                                                                                                                      • Overview
                                                                                                                                                                                                                                                                      • Kubernetes Access Controls
                                                                                                                                                                                                                                                                    • Cluster recommendations
                                                                                                                                                                                                                                                                    • Data plane setup on generic Kubernetes
                                                                                                                                                                                                                                                                      • Prepare infrastructure
                                                                                                                                                                                                                                                                      • Deploy the dataplane
                                                                                                                                                                                                                                                                    • Data plane setup on AWS
                                                                                                                                                                                                                                                                      • Prepare infrastructure
                                                                                                                                                                                                                                                                      • Deploy the dataplane
                                                                                                                                                                                                                                                                    • Data plane setup on GCP
                                                                                                                                                                                                                                                                      • Prepare infrastructure
                                                                                                                                                                                                                                                                      • Deploy the dataplane
                                                                                                                                                                                                                                                                    • Data plane setup on Azure
                                                                                                                                                                                                                                                                      • Prepare infrastructure
                                                                                                                                                                                                                                                                      • Deploy the dataplane
                                                                                                                                                                                                                                                                    • Data plane setup on OCI
                                                                                                                                                                                                                                                                      • Prepare infrastructure
                                                                                                                                                                                                                                                                      • Deploy the dataplane
                                                                                                                                                                                                                                                                    • Data plane setup on CoreWeave
                                                                                                                                                                                                                                                                      • Prepare infrastructure
                                                                                                                                                                                                                                                                      • Deploy the dataplane
                                                                                                                                                                                                                                                                    • Data plane setup on Crusoe
                                                                                                                                                                                                                                                                      • Prepare infrastructure
                                                                                                                                                                                                                                                                      • Deploy the dataplane
                                                                                                                                                                                                                                                                    • Data plane setup on Nebius
                                                                                                                                                                                                                                                                      • Prepare infrastructure
                                                                                                                                                                                                                                                                      • Deploy the dataplane
                                                                                                                                                                                                                                                                    • Configuration
                                                                                                                                                                                                                                                                      • Interruptible task scheduling
                                                                                                                                                                                                                                                                      • Node pools
                                                                                                                                                                                                                                                                      • Authentication
                                                                                                                                                                                                                                                                      • Code Viewer
                                                                                                                                                                                                                                                                      • Image Builder
                                                                                                                                                                                                                                                                      • Multiple Clusters
                                                                                                                                                                                                                                                                      • Persistent logs
                                                                                                                                                                                                                                                                      • Monitoring
                                                                                                                                                                                                                                                                      • Secrets
                                                                                                                                                                                                                                                                      • Data retention policies
                                                                                                                                                                                                                                                                      • Compute plugins
                                                                                                                                                                                                                                                                      • Namespace mapping
                                                                                                                                                                                                                                                                      • Volumes
                                                                                                                                                                                                                                                                    • Helm chart reference
                                                                                                                                                                                                                                                                      • Dataplane chart
                                                                                                                                                                                                                                                                      • Knative Operator chart
                                                                                                                                                                                                                                                                  • Manage Union through Terraform
                                                                                                                                                                                                                                                                    • Installation
                                                                                                                                                                                                                                                                    • Resource management
                                                                                                                                                                                                                                                                    • Security best practices
                                                                                                                                                                                                                                                                • Zero Trust security
                                                                                                                                                                                                                                                                  • Architecture
                                                                                                                                                                                                                                                                    • Two-plane separation
                                                                                                                                                                                                                                                                    • Control plane
                                                                                                                                                                                                                                                                    • Data plane
                                                                                                                                                                                                                                                                    • Network architecture
                                                                                                                                                                                                                                                                    • Sovereign Data Plane
                                                                                                                                                                                                                                                                    • Private connectivity (BYOC)
                                                                                                                                                                                                                                                                  • Data protection
                                                                                                                                                                                                                                                                    • Data classification and residency
                                                                                                                                                                                                                                                                    • Secrets management
                                                                                                                                                                                                                                                                    • Logging and audit
                                                                                                                                                                                                                                                                  • Identity and access
                                                                                                                                                                                                                                                                    • Authentication
                                                                                                                                                                                                                                                                    • Role-based access control
                                                                                                                                                                                                                                                                    • Human access controls
                                                                                                                                                                                                                                                                  • Compliance and governance
                                                                                                                                                                                                                                                                    • Certifications and Trust Center
                                                                                                                                                                                                                                                                    • HIPAA compliance
                                                                                                                                                                                                                                                                    • GDPR alignment
                                                                                                                                                                                                                                                                    • Standards compliance
                                                                                                                                                                                                                                                                    • Shared responsibility model
                                                                                                                                                                                                                                                                    • Organizational security
                                                                                                                                                                                                                                                                    • Vulnerability management
                                                                                                                                                                                                                                                                • Community
                                                                                                                                                                                                                                                                  • Contributing docs and examples
                                                                                                                                                                                                                                                                    • Set up a local docs dev environment
                                                                                                                                                                                                                                                                    • Authoring
                                                                                                                                                                                                                                                                    • Submit a contribution
                                                                                                                                                                                                                                                                    • Writing guidelines
                                                                                                                                                                                                                                                                    • Variants
                                                                                                                                                                                                                                                                    • Versions
                                                                                                                                                                                                                                                                    • Shortcodes
                                                                                                                                                                                                                                                                    • API docs
                                                                                                                                                                                                                                                                    • LLM-optimized documentation
                                                                                                                                                                                                                                                                    • Redirects
                                                                                                                                                                                                                                                                    • Production builds and troubleshooting
                                                                                                                                                                                                                                                                • Release notes
                                                                                                                                                                                                                                                                  Union.ai
                                                                                                                                                                                                                                                                  Reference
                                                                                                                                                                                                                                                                  Integrations
                                                                                                                                                                                                                                                                  SGLang
                                                                                                                                                                                                                                                                  2.5.18

                                                                                                                                                                                                                                                                  SGLang

                                                                                                                                                                                                                                                                  Directory

                                                                                                                                                                                                                                                                  Classes

                                                                                                                                                                                                                                                                  Class Description
                                                                                                                                                                                                                                                                  SGLangAppEnvironment App environment backed by SGLang for serving large language models.

                                                                                                                                                                                                                                                                  Variables

                                                                                                                                                                                                                                                                  Property Type Description
                                                                                                                                                                                                                                                                  DEFAULT_SGLANG_IMAGE Image
                                                                                                                                                                                                                                                                  Docs: unionai/unionai-docs 2.5.18.3SDK: flyteorg/flyte-sdk 2.5.18 flyteplugins-union 0.5.2
                                                                                                                                                                                                                                                                  On this page
                                                                                                                                                                                                                                                                  404

                                                                                                                                                                                                                                                                  Page not found

                                                                                                                                                                                                                                                                  Showing closest match