Try Flyte on Union.ai free for 30 days
Get started
Flyte OSS Docs logo
Flyte OSS Docs
v2
v1
Signup
Flyte OSS Docs logo
Flyte OSS Docs
  • User guide
    • Get started
      • Quickstart
      • Core concepts
        • TaskEnvironment
        • Tasks
        • Runs and actions
        • Where your data lives
        • Apps
        • Projects and domains
        • Key capabilities
        • Basic project
      • Run modes
        • Run locally in Python
        • Run on the Devbox
        • Run on a deployed cluster
    • Tasks
      • Configure tasks
        • Container images
        • Resources
        • Secrets
        • Caching
        • Reusable containers
        • Pod templates
        • Multiple environments
        • Clustered task environment
        • Retries and timeouts
        • Interruptible tasks
        • Task plugins
        • Additional task settings
        • Logging
        • Overrides
      • Build tasks
        • Files and directories
        • Data classes and structures
        • DataFrames
        • Custom types
        • Custom context
        • Abort and cancel actions
        • Raw Container Tasks
        • Links
        • Reports
        • Notebooks
        • Remote tasks
        • Error handling
        • Traces
        • Intra-task checkpoints
        • Grouping actions
        • Fanout
        • Mapping over inputs
        • Consuming a message queue
        • Controlling parallel execution
        • Streaming map-reduce
        • Structured concurrency with anyio
        • Task dependencies and ordering
        • External conditions
        • Unit Testing Tasks
        • Higher-order functions
        • Other features
      • Run and deploy tasks
        • How task run works
        • Interact with runs and actions
        • View logs
        • Work with local data
        • Run command options
        • Build a custom CLI
        • How task deployment works
        • Deploy command options
        • Packaging
        • Deployment patterns
        • Run context
        • Entrypoint tasks
        • Run a Python script
        • Send notifications from your code
        • Rerun a run
        • Recover a failed run
    • Apps
      • Configure apps
        • App environments
        • Including additional files
        • Passing parameters into app environments
        • Autoscaling apps
        • Apps depending on other environments
      • Build apps
        • Single-script apps
        • Multi-script apps
        • Serving graphs
        • Hybrid app-task graphs
        • WebSocket apps
        • Browser apps
        • Secret-based authentication
      • Native app integrations
        • Streamlit app
        • FastAPI app
        • Flyte webhook
      • Serve and deploy apps
        • How app serving works
        • How app custom domains work
        • How app deployment works
        • Activating and deactivating apps
    • Triggers
      • Configure a trigger
      • Schedule triggers
      • When scheduled runs start
      • Manual triggers and firing on demand
      • Deploy and manage triggers
    • Model training
      • Pre-training
      • Post-training
      • Classical machine learning
      • Hyperparameter optimization
      • Evaluation
      • Durable training
    • Reinforcement learning
      • Training environment
      • Reward setup
      • Inference rollouts
      • Training loop
      • Evaluation
    • Inference
      • Providers
        • Fireworks
        • OpenAI
        • Anthropic
        • AWS Bedrock
        • Google Vertex AI
      • Self-hosted endpoints
        • vLLM
        • SGLang
        • Ollama
        • llama.cpp
        • FastAPI
        • Other frameworks
      • Prefetching models
      • Deploy trained models
      • Batch inference
      • Stream model weights
      • Decision models
        • Typed decisions with Jev
    • Agents
      • Build an agent
        • Pure Python agents
        • Flyte-native agents
        • Bring your own framework
        • Agent memory
        • Agent chat UI
        • Deploy an agent as a service
      • Build an MCP
        • User-defined MCP server
        • Flyte MCP server
      • Sandboxing
        • Workflow sandboxing
        • Programmatic tool calling for agents
        • Code sandboxing
    • Project patterns
      • Bring your own image (BYOI)
      • Monorepo with uv
      • CI/CD deployments
      • Software development lifecycle
        • Event-driven automation
        • Review and release gates
        • Human gates and approvals
        • Evaluation gates
        • Notifications and observability
      • Advanced project
        • Resilient generation
        • Agentic refinement
        • Parallel outputs
        • Serving app
    • Scale your runs
      • Data flow
      • Life of a run
      • Scale your workflows
    • Migration
      • From Flyte 1 to 2
        • Migration Overview
        • Tasks and workflows
        • Task configuration
        • CLI and configuration
        • Control flow
        • Parallelism and fan-out
        • Data types and I/O
        • ML workloads
        • New in Flyte 2
        • Hybrid v1 and v2 pipelines
        • Gotchas and caveats
      • From Airflow to Flyte
        • Part 1: vanilla operators
      • From Slurm to Flyte
    • Telemetry
  • Tutorials
    • Biotech & healthcare
      • Genomic alignment
        • Brain tumor MRI classification
          • Cross-species gene comparison
            • Genomic variant effect prediction
              • Drug molecule screening agent
              • Geospatial
                • GPU-accelerated climate modeling
                • Financial services & fintech
                  • Multi-agent trading simulation
                    • Fraud detection with Feast
                      • Financial research agent
                      • Frontier AI
                        • Distributed LLM pretraining
                        • Computer vision
                          • Fine-tuning a VLM
                            • Multimodal retrieval evaluation
                              • RT-DETR object detection
                              • Agents
                                • Autoresearch agent
                                  • Parallelized autoresearch agent
                                    • AutoSec researcher agent
                                      • Coding agent
                                        • Competitive intelligence agent
                                          • Deep research
                                            • LangGraph research agent
                                              • MLE bot
                                                • Compliance monitoring agent
                                                  • Field data enrichment agent
                                                    • Support resolution agent
                                                      • Code mode analytics agent
                                                        • Typed decisions for agentic pipelines
                                                        • Context engineering
                                                          • Text-to-SQL prompt optimization
                                                            • Automatic prompt engineering
                                                            • Model training
                                                              • LLM fine-tuning with LoRA and QLoRA
                                                                • BERT emotion classification
                                                                  • Hyperparameter optimization
                                                                  • Speculative decoding models
                                                                    • Train an EAGLE-3 draft head
                                                                    • Train a DFlash block drafter
                                                                    • Train a DSpark drafter
                                                                    • Benchmark draft models
                                                                    • Serve and retrain draft models
                                                                  • Reinforcement learning
                                                                    • Durable agentic RL with SkyRL and Harbor
                                                                    • Inference
                                                                      • Voice customer-service agent
                                                                    • Reference
                                                                      • Flyte CLI
                                                                      • Flyte SDK
                                                                        • flyte
                                                                          • AppHandle
                                                                          • AsyncFunctionTaskTemplate
                                                                          • Backoff
                                                                          • BaseCheckpoint
                                                                          • Cache
                                                                          • CachePolicy
                                                                          • Checkpoint
                                                                          • ConditionWebhook
                                                                          • Cron
                                                                          • Device
                                                                          • Documentation
                                                                          • Environment
                                                                          • FixedRate
                                                                          • Image
                                                                          • ImageBuild
                                                                          • Link
                                                                          • OnArtifact
                                                                          • PodTemplate
                                                                          • Resources
                                                                          • RetryStrategy
                                                                          • ReusePolicy
                                                                          • Secret
                                                                          • TaskEnvironment
                                                                          • TaskTemplate
                                                                          • Timeout
                                                                          • Trigger
                                                                          • TriggeredPartition
                                                                        • flyte.ai.agents
                                                                          • AccessDenied
                                                                          • Agent
                                                                          • AgentEvent
                                                                          • AgentProtocol
                                                                          • AgentResult
                                                                          • AgentTool
                                                                          • ConcurrencyError
                                                                          • LLMMessage
                                                                          • MCPServerSpec
                                                                          • MemoryMeta
                                                                          • MemoryStore
                                                                          • MemoryStoreError
                                                                          • ToolFn
                                                                        • flyte.ai.agents.agent
                                                                          • Agent
                                                                          • AgentEvent
                                                                        • flyte.ai.agents.memory
                                                                          • AccessDenied
                                                                          • ConcurrencyError
                                                                          • MemoryMeta
                                                                          • MemoryStore
                                                                          • MemoryStoreError
                                                                        • flyte.ai.agents.protocol
                                                                          • AgentProtocol
                                                                          • AgentResult
                                                                        • flyte.ai.chat
                                                                          • AgentChatAppEnvironment
                                                                          • CustomTheme
                                                                        • flyte.ai.chat.app
                                                                          • AgentChatAppEnvironment
                                                                          • CustomTheme
                                                                        • flyte.ai.mcp
                                                                          • FlyteMCPAppEnvironment
                                                                          • MCPAppEnvironment
                                                                        • flyte.app
                                                                          • AppEndpoint
                                                                          • AppEnvironment
                                                                          • ArtifactValue
                                                                          • ConnectorEnvironment
                                                                          • DeployedAppEnvironment
                                                                          • Domain
                                                                          • Link
                                                                          • Parameter
                                                                          • Port
                                                                          • RunOutput
                                                                          • Scaling
                                                                          • Subdomain
                                                                          • Timeouts
                                                                        • flyte.app.extras
                                                                          • FastAPIAppEnvironment
                                                                          • FastAPIPassthroughAuthMiddleware
                                                                          • FlyteWebhookAppEnvironment
                                                                        • flyte.artifacts
                                                                          • Artifact
                                                                          • ArtifactKey
                                                                          • ArtifactVersionId
                                                                          • Card
                                                                          • Metadata
                                                                          • TimePartition
                                                                        • flyte.cli.main
                                                                          • RootGroup
                                                                        • flyte.clustered
                                                                          • ClusteredTaskEnvironment
                                                                          • ClusteredTaskTemplate
                                                                          • ClusterFailurePolicy
                                                                          • JaxRun
                                                                          • TorchRun
                                                                        • flyte.config
                                                                          • Config
                                                                        • flyte.connectors
                                                                          • AsyncConnector
                                                                          • AsyncConnectorExecutorMixin
                                                                          • ConnectorRegistry
                                                                          • ConnectorService
                                                                          • Resource
                                                                          • ResourceMeta
                                                                        • flyte.connectors.utils
                                                                          • flyte.durable
                                                                            • flyte.errors
                                                                              • ActionAbortedError
                                                                              • ActionNotFoundError
                                                                              • AppleSiliconBridgeUnreachableError
                                                                              • AppleSiliconDaemonOOMError
                                                                              • AppleSiliconDaemonStartFailedError
                                                                              • AppleSiliconError
                                                                              • AppleSiliconHostExecFailedError
                                                                              • AppleSiliconModelNotFoundError
                                                                              • AppleSiliconNotAvailableError
                                                                              • BaseRuntimeError
                                                                              • CodeBundleError
                                                                              • ConditionAlreadyExistsError
                                                                              • ConditionFailedError
                                                                              • ConditionNotFoundError
                                                                              • ConditionTimedoutError
                                                                              • CustomError
                                                                              • DeadlineExceededError
                                                                              • DeploymentError
                                                                              • GPUFaultError
                                                                              • GPUFaultSystemError
                                                                              • GPUFaultUserError
                                                                              • ImageBuildError
                                                                              • ImagePullBackOffError
                                                                              • InitializationError
                                                                              • InlineIOMaxBytesBreached
                                                                              • InvalidImageNameError
                                                                              • InvalidPackageError
                                                                              • LogsNotYetAvailableError
                                                                              • MaxQueuedTimeExceededError
                                                                              • MaxRuntimeExceededError
                                                                              • ModuleLoadError
                                                                              • NonRecoverableError
                                                                              • NotInTaskContextError
                                                                              • OnlyAsyncIOSupportedError
                                                                              • OOMError
                                                                              • ParameterMaterializationError
                                                                              • PrimaryContainerNotFoundError
                                                                              • RemoteTaskNotFoundError
                                                                              • RemoteTaskUsageError
                                                                              • ResourceExhaustedError
                                                                              • RestrictedTypeError
                                                                              • RetriesExhaustedError
                                                                              • RuntimeDataValidationError
                                                                              • RuntimeSystemError
                                                                              • RuntimeUnknownError
                                                                              • RuntimeUserError
                                                                              • SlowDownError
                                                                              • SyncTaskCallInAsyncContextError
                                                                              • TaskInterruptedError
                                                                              • TaskTimeoutError
                                                                              • TraceDoesNotAllowNestedTasksError
                                                                              • UnionRpcError
                                                                            • flyte.extend
                                                                              • AsyncFunctionTaskTemplate
                                                                              • ImageBuildEngine
                                                                              • ImageBuilder
                                                                              • ImageChecker
                                                                              • RuntimeTaskTemplate
                                                                              • SessionAddress
                                                                              • SessionRoutingInfo
                                                                              • TaskTemplate
                                                                            • flyte.extras
                                                                              • BatchStats
                                                                              • ContainerTask
                                                                              • CostEstimator
                                                                              • DynamicBatcher
                                                                              • Prompt
                                                                              • Sleep
                                                                              • SleepTask
                                                                              • TokenBatcher
                                                                              • TokenEstimator
                                                                            • flyte.extras.model_streamer
                                                                              • LoadResult
                                                                              • ModelStreamer
                                                                            • flyte.extras.shell
                                                                              • FlagSpec
                                                                              • Glob
                                                                              • Stderr
                                                                              • Stdout
                                                                            • flyte.extras.webhooks
                                                                              • EventType
                                                                              • Provider
                                                                              • RunOnceResult
                                                                              • SignatureError
                                                                              • WebhookAppEnvironment
                                                                              • WebhookEvent
                                                                              • WebhookPluginError
                                                                            • flyte.extras.webhooks.testing
                                                                              • ProviderFactory
                                                                            • flyte.git
                                                                              • GitStatus
                                                                            • flyte.io
                                                                              • DataFrame
                                                                              • Dir
                                                                              • EmptyDir
                                                                              • File
                                                                              • HashFunction
                                                                            • flyte.io.extend
                                                                              • DataFrameDecoder
                                                                              • DataFrameEncoder
                                                                              • DataFrameTransformerEngine
                                                                            • flyte.models
                                                                              • ActionID
                                                                              • ActionPhase
                                                                              • CallCounter
                                                                              • CheckpointPaths
                                                                              • CodeBundle
                                                                              • GroupData
                                                                              • NativeInterface
                                                                              • PathRewrite
                                                                              • RawDataPath
                                                                              • SerializationContext
                                                                              • TaskContext
                                                                            • flyte.notify
                                                                              • Email
                                                                              • NamedDelivery
                                                                              • NamedRule
                                                                              • Notification
                                                                              • Slack
                                                                              • Teams
                                                                              • Webhook
                                                                            • flyte.orchestrator
                                                                              • OrchestratorTaskTemplate
                                                                            • flyte.prefetch
                                                                              • HuggingFaceModelInfo
                                                                              • ShardConfig
                                                                              • StoredModelInfo
                                                                              • VLLMShardArgs
                                                                            • flyte.remote
                                                                              • Action
                                                                              • ActionDetails
                                                                              • ActionInputs
                                                                              • ActionOutputs
                                                                              • App
                                                                              • Artifact
                                                                              • Condition
                                                                              • PartitionSchema
                                                                              • Project
                                                                              • Run
                                                                              • RunDetails
                                                                              • Secret
                                                                              • Settings
                                                                              • Task
                                                                              • TaskDetails
                                                                              • TimeFilter
                                                                              • Trigger
                                                                              • TriggerDetails
                                                                              • User
                                                                            • flyte.report
                                                                              • Report
                                                                              • Timeline
                                                                            • flyte.sandbox
                                                                              • CodeTaskTemplate
                                                                              • ImageConfig
                                                                              • SandboxedConfig
                                                                              • SandboxedTaskTemplate
                                                                            • flyte.storage
                                                                              • ABFS
                                                                              • GCS
                                                                              • S3
                                                                              • Storage
                                                                            • flyte.syncify
                                                                              • Syncify
                                                                            • flyte.types
                                                                              • FlytePickle
                                                                              • Renderable
                                                                              • TypeEngine
                                                                              • TypeTransformer
                                                                              • TypeTransformerFailedError
                                                                          • Flyte agent plugins
                                                                          • Integrations
                                                                            • Agent frameworks
                                                                              • Claude Agent SDK
                                                                                • Core
                                                                                  • ReportTimeline
                                                                                  • ToolTaskResolver
                                                                                • CrewAI
                                                                                  • Deep Agents
                                                                                    • DurableChatModel
                                                                                  • Google ADK
                                                                                    • FlyteLlm
                                                                                  • Hermes
                                                                                    • LangChain
                                                                                      • LangGraph
                                                                                        • Mistral
                                                                                          • OpenAI Agents SDK
                                                                                            • FlyteModel
                                                                                            • FlyteModelProvider
                                                                                            • FlyteSession
                                                                                            • FlyteTracingProcessor
                                                                                            • FunctionTool
                                                                                          • Pydantic AI
                                                                                            • FlyteModel
                                                                                        • Software development tools
                                                                                          • ClickUp
                                                                                            • ClickUpProvider
                                                                                          • GitHub
                                                                                            • GitHubProvider
                                                                                            • ReviewComment
                                                                                            • ReviewContext
                                                                                            • ReviewDecision
                                                                                          • GitLab
                                                                                            • GitLabProvider
                                                                                          • Jira
                                                                                            • JiraProvider
                                                                                          • Linear
                                                                                            • LinearProvider
                                                                                          • Slack
                                                                                            • SlackProvider
                                                                                        • Anthropic
                                                                                          • Agent
                                                                                        • BigQuery
                                                                                          • BigQueryConfig
                                                                                          • BigQueryConnector
                                                                                          • BigQueryTask
                                                                                          • BQToPandasDecodingHandler
                                                                                        • Code generation
                                                                                          • AutoCoderAgent
                                                                                          • CodeGenEvalResult
                                                                                          • CodePlan
                                                                                          • CodeSolution
                                                                                          • ErrorDiagnosis
                                                                                          • ImageConfig
                                                                                        • Dask
                                                                                          • Dask
                                                                                          • Scheduler
                                                                                          • WorkerGroup
                                                                                        • Databricks
                                                                                          • Databricks
                                                                                          • DatabricksConnector
                                                                                        • dbt
                                                                                          • DbtInvocationError
                                                                                          • DbtNodeResult
                                                                                          • DbtTask
                                                                                          • DbtTaskResolver
                                                                                        • Gemini
                                                                                          • Agent
                                                                                        • Grafana Agent Observability
                                                                                          • FlyteIdentityBinding
                                                                                          • GrafanaAgentObservability
                                                                                        • Hugging Face
                                                                                          • HFSource
                                                                                        • Human-in-the-loop
                                                                                          • Event
                                                                                        • Hydra
                                                                                          • JSONL
                                                                                            • JsonlDir
                                                                                            • JsonlFile
                                                                                          • Lance
                                                                                            • llama.cpp
                                                                                              • LlamaCppAppEnvironment
                                                                                            • MLflow
                                                                                              • Mlflow
                                                                                            • Nextflow
                                                                                              • NextflowError
                                                                                            • NVIDIA Nsight Systems
                                                                                              • flyteplugins.nsight
                                                                                                • flyteplugins.nsight.nsys
                                                                                                  • flyteplugins.nsight.nvtx
                                                                                                  • OmegaConf
                                                                                                    • oMLX
                                                                                                      • OMLXAppEnvironment
                                                                                                    • OpenAI
                                                                                                      • OpenTelemetry
                                                                                                        • OtelObserver
                                                                                                        • RunScopedIdGenerator
                                                                                                      • Pandera
                                                                                                        • ValidationConfig
                                                                                                      • Papermill
                                                                                                        • NotebookTask
                                                                                                      • Polars
                                                                                                        • ParquetToPolarsDecodingHandler
                                                                                                        • ParquetToPolarsLazyFrameDecodingHandler
                                                                                                        • PolarsLazyFrameToParquetEncodingHandler
                                                                                                        • PolarsToParquetEncodingHandler
                                                                                                      • PyTorch
                                                                                                        • Elastic
                                                                                                      • Ray
                                                                                                        • AutoscalerOptionsConfig
                                                                                                        • HeadNodeConfig
                                                                                                        • RayJobConfig
                                                                                                        • WorkerNodeConfig
                                                                                                      • SGLang
                                                                                                        • SGLangAppEnvironment
                                                                                                      • Slurm
                                                                                                        • Slurm
                                                                                                        • SlurmConnector
                                                                                                        • SlurmFunctionTask
                                                                                                        • SlurmJobMetadata
                                                                                                        • SlurmScriptConnector
                                                                                                        • SlurmScriptTask
                                                                                                      • Snowflake
                                                                                                        • Snowflake
                                                                                                        • SnowflakeConfig
                                                                                                        • SnowflakeConnector
                                                                                                      • Spark
                                                                                                        • ParquetToSparkDecoder
                                                                                                        • Spark
                                                                                                        • SparkToParquetEncoder
                                                                                                      • Trackio
                                                                                                        • Trackio
                                                                                                      • TypeSafe AI
                                                                                                        • BatteryError
                                                                                                        • CallInfo
                                                                                                        • Choice
                                                                                                        • MissingAPIKey
                                                                                                        • Noul
                                                                                                        • Score
                                                                                                      • vLLM
                                                                                                        • VLLMAppEnvironment
                                                                                                      • Weights & Biases
                                                                                                        • Wandb
                                                                                                        • WandbSweep
                                                                                                    • LLM-optimized documentation
                                                                                                  • Integrations
                                                                                                    • Agent frameworks
                                                                                                      • How it works
                                                                                                      • OpenAI
                                                                                                      • Claude
                                                                                                      • Google ADK
                                                                                                      • Mistral
                                                                                                      • LangChain
                                                                                                      • LangGraph
                                                                                                      • Deep Agents
                                                                                                      • CrewAI
                                                                                                      • Pydantic AI
                                                                                                      • Hermes
                                                                                                    • Software development tools
                                                                                                      • GitHub
                                                                                                      • Slack
                                                                                                      • Linear
                                                                                                      • ClickUp
                                                                                                      • Jira
                                                                                                      • GitLab
                                                                                                    • BigQuery
                                                                                                      • Code generation
                                                                                                        • Dask
                                                                                                          • Databricks
                                                                                                            • DBT
                                                                                                              • Grafana Agent Observability
                                                                                                                • Hugging Face
                                                                                                                  • Hydra
                                                                                                                    • JSONL
                                                                                                                      • Lance
                                                                                                                        • llama.cpp
                                                                                                                          • MLflow
                                                                                                                            • Nextflow
                                                                                                                              • NVIDIA Nsight Systems
                                                                                                                                • OmegaConf
                                                                                                                                  • OpenTelemetry
                                                                                                                                    • Exporters and configuration
                                                                                                                                    • Traces across crashes and resumes
                                                                                                                                  • Pandera
                                                                                                                                    • Papermill
                                                                                                                                      • Polars
                                                                                                                                        • PyTorch
                                                                                                                                          • Ray
                                                                                                                                            • Slurm
                                                                                                                                              • Snowflake
                                                                                                                                                • Spark
                                                                                                                                                  • TypeSafe AI
                                                                                                                                                    • Weights & Biases
                                                                                                                                                      • Experiments
                                                                                                                                                      • Distributed training
                                                                                                                                                      • Sweeps
                                                                                                                                                      • Downloading logs
                                                                                                                                                      • Constraints and best practices
                                                                                                                                                      • Manual integration
                                                                                                                                                  • Platform deployment
                                                                                                                                                    • Deployment overview
                                                                                                                                                    • Kind deployment
                                                                                                                                                      • Set up local OIDC provider
                                                                                                                                                      • Set up external OIDC provider
                                                                                                                                                    • AWS deployment
                                                                                                                                                      • flyte-binary deployment
                                                                                                                                                      • flyte-core deployment
                                                                                                                                                    • Authentication and SSO
                                                                                                                                                    • Enable app serving
                                                                                                                                                    • Plugin setup
                                                                                                                                                      • Flyte copilot storage configuration
                                                                                                                                                  • Community
                                                                                                                                                    • Joining the community
                                                                                                                                                    • Contributing code
                                                                                                                                                    • Contributing docs and examples
                                                                                                                                                      • Set up a local docs dev environment
                                                                                                                                                      • Authoring
                                                                                                                                                      • Submit a contribution
                                                                                                                                                      • Writing guidelines
                                                                                                                                                      • Variants
                                                                                                                                                      • Versions
                                                                                                                                                      • Shortcodes
                                                                                                                                                      • API docs
                                                                                                                                                      • LLM-optimized documentation
                                                                                                                                                      • Redirects
                                                                                                                                                      • Production builds and troubleshooting
                                                                                                                                                  Documentation navigation for Flyte including user guides, tutorials, API references, and integration examples
                                                                                                                                                  • User guide
                                                                                                                                                    • Get started
                                                                                                                                                      • Quickstart
                                                                                                                                                      • Core concepts
                                                                                                                                                        • TaskEnvironment
                                                                                                                                                        • Tasks
                                                                                                                                                        • Runs and actions
                                                                                                                                                        • Where your data lives
                                                                                                                                                        • Apps
                                                                                                                                                        • Projects and domains
                                                                                                                                                        • Key capabilities
                                                                                                                                                        • Basic project
                                                                                                                                                      • Run modes
                                                                                                                                                        • Run locally in Python
                                                                                                                                                        • Run on the Devbox
                                                                                                                                                        • Run on a deployed cluster
                                                                                                                                                    • Tasks
                                                                                                                                                      • Configure tasks
                                                                                                                                                        • Container images
                                                                                                                                                        • Resources
                                                                                                                                                        • Secrets
                                                                                                                                                        • Caching
                                                                                                                                                        • Reusable containers
                                                                                                                                                        • Pod templates
                                                                                                                                                        • Multiple environments
                                                                                                                                                        • Clustered task environment
                                                                                                                                                        • Retries and timeouts
                                                                                                                                                        • Interruptible tasks
                                                                                                                                                        • Task plugins
                                                                                                                                                        • Additional task settings
                                                                                                                                                        • Logging
                                                                                                                                                        • Overrides
                                                                                                                                                      • Build tasks
                                                                                                                                                        • Files and directories
                                                                                                                                                        • Data classes and structures
                                                                                                                                                        • DataFrames
                                                                                                                                                        • Custom types
                                                                                                                                                        • Custom context
                                                                                                                                                        • Abort and cancel actions
                                                                                                                                                        • Raw Container Tasks
                                                                                                                                                        • Links
                                                                                                                                                        • Reports
                                                                                                                                                        • Notebooks
                                                                                                                                                        • Remote tasks
                                                                                                                                                        • Error handling
                                                                                                                                                        • Traces
                                                                                                                                                        • Intra-task checkpoints
                                                                                                                                                        • Grouping actions
                                                                                                                                                        • Fanout
                                                                                                                                                        • Mapping over inputs
                                                                                                                                                        • Consuming a message queue
                                                                                                                                                        • Controlling parallel execution
                                                                                                                                                        • Streaming map-reduce
                                                                                                                                                        • Structured concurrency with anyio
                                                                                                                                                        • Task dependencies and ordering
                                                                                                                                                        • External conditions
                                                                                                                                                        • Unit Testing Tasks
                                                                                                                                                        • Higher-order functions
                                                                                                                                                        • Other features
                                                                                                                                                      • Run and deploy tasks
                                                                                                                                                        • How task run works
                                                                                                                                                        • Interact with runs and actions
                                                                                                                                                        • View logs
                                                                                                                                                        • Work with local data
                                                                                                                                                        • Run command options
                                                                                                                                                        • Build a custom CLI
                                                                                                                                                        • How task deployment works
                                                                                                                                                        • Deploy command options
                                                                                                                                                        • Packaging
                                                                                                                                                        • Deployment patterns
                                                                                                                                                        • Run context
                                                                                                                                                        • Entrypoint tasks
                                                                                                                                                        • Run a Python script
                                                                                                                                                        • Send notifications from your code
                                                                                                                                                        • Rerun a run
                                                                                                                                                        • Recover a failed run
                                                                                                                                                    • Apps
                                                                                                                                                      • Configure apps
                                                                                                                                                        • App environments
                                                                                                                                                        • Including additional files
                                                                                                                                                        • Passing parameters into app environments
                                                                                                                                                        • Autoscaling apps
                                                                                                                                                        • Apps depending on other environments
                                                                                                                                                      • Build apps
                                                                                                                                                        • Single-script apps
                                                                                                                                                        • Multi-script apps
                                                                                                                                                        • Serving graphs
                                                                                                                                                        • Hybrid app-task graphs
                                                                                                                                                        • WebSocket apps
                                                                                                                                                        • Browser apps
                                                                                                                                                        • Secret-based authentication
                                                                                                                                                      • Native app integrations
                                                                                                                                                        • Streamlit app
                                                                                                                                                        • FastAPI app
                                                                                                                                                        • Flyte webhook
                                                                                                                                                      • Serve and deploy apps
                                                                                                                                                        • How app serving works
                                                                                                                                                        • How app custom domains work
                                                                                                                                                        • How app deployment works
                                                                                                                                                        • Activating and deactivating apps
                                                                                                                                                    • Triggers
                                                                                                                                                      • Configure a trigger
                                                                                                                                                      • Schedule triggers
                                                                                                                                                      • When scheduled runs start
                                                                                                                                                      • Manual triggers and firing on demand
                                                                                                                                                      • Deploy and manage triggers
                                                                                                                                                    • Model training
                                                                                                                                                      • Pre-training
                                                                                                                                                      • Post-training
                                                                                                                                                      • Classical machine learning
                                                                                                                                                      • Hyperparameter optimization
                                                                                                                                                      • Evaluation
                                                                                                                                                      • Durable training
                                                                                                                                                    • Reinforcement learning
                                                                                                                                                      • Training environment
                                                                                                                                                      • Reward setup
                                                                                                                                                      • Inference rollouts
                                                                                                                                                      • Training loop
                                                                                                                                                      • Evaluation
                                                                                                                                                    • Inference
                                                                                                                                                      • Providers
                                                                                                                                                        • Fireworks
                                                                                                                                                        • OpenAI
                                                                                                                                                        • Anthropic
                                                                                                                                                        • AWS Bedrock
                                                                                                                                                        • Google Vertex AI
                                                                                                                                                      • Self-hosted endpoints
                                                                                                                                                        • vLLM
                                                                                                                                                        • SGLang
                                                                                                                                                        • Ollama
                                                                                                                                                        • llama.cpp
                                                                                                                                                        • FastAPI
                                                                                                                                                        • Other frameworks
                                                                                                                                                      • Prefetching models
                                                                                                                                                      • Deploy trained models
                                                                                                                                                      • Batch inference
                                                                                                                                                      • Stream model weights
                                                                                                                                                      • Decision models
                                                                                                                                                        • Typed decisions with Jev
                                                                                                                                                    • Agents
                                                                                                                                                      • Build an agent
                                                                                                                                                        • Pure Python agents
                                                                                                                                                        • Flyte-native agents
                                                                                                                                                        • Bring your own framework
                                                                                                                                                        • Agent memory
                                                                                                                                                        • Agent chat UI
                                                                                                                                                        • Deploy an agent as a service
                                                                                                                                                      • Build an MCP
                                                                                                                                                        • User-defined MCP server
                                                                                                                                                        • Flyte MCP server
                                                                                                                                                      • Sandboxing
                                                                                                                                                        • Workflow sandboxing
                                                                                                                                                        • Programmatic tool calling for agents
                                                                                                                                                        • Code sandboxing
                                                                                                                                                    • Project patterns
                                                                                                                                                      • Bring your own image (BYOI)
                                                                                                                                                      • Monorepo with uv
                                                                                                                                                      • CI/CD deployments
                                                                                                                                                      • Software development lifecycle
                                                                                                                                                        • Event-driven automation
                                                                                                                                                        • Review and release gates
                                                                                                                                                        • Human gates and approvals
                                                                                                                                                        • Evaluation gates
                                                                                                                                                        • Notifications and observability
                                                                                                                                                      • Advanced project
                                                                                                                                                        • Resilient generation
                                                                                                                                                        • Agentic refinement
                                                                                                                                                        • Parallel outputs
                                                                                                                                                        • Serving app
                                                                                                                                                    • Scale your runs
                                                                                                                                                      • Data flow
                                                                                                                                                      • Life of a run
                                                                                                                                                      • Scale your workflows
                                                                                                                                                    • Migration
                                                                                                                                                      • From Flyte 1 to 2
                                                                                                                                                        • Migration Overview
                                                                                                                                                        • Tasks and workflows
                                                                                                                                                        • Task configuration
                                                                                                                                                        • CLI and configuration
                                                                                                                                                        • Control flow
                                                                                                                                                        • Parallelism and fan-out
                                                                                                                                                        • Data types and I/O
                                                                                                                                                        • ML workloads
                                                                                                                                                        • New in Flyte 2
                                                                                                                                                        • Hybrid v1 and v2 pipelines
                                                                                                                                                        • Gotchas and caveats
                                                                                                                                                      • From Airflow to Flyte
                                                                                                                                                        • Part 1: vanilla operators
                                                                                                                                                      • From Slurm to Flyte
                                                                                                                                                    • Telemetry
                                                                                                                                                  • Tutorials
                                                                                                                                                    • Biotech & healthcare
                                                                                                                                                      • Genomic alignment
                                                                                                                                                        • Brain tumor MRI classification
                                                                                                                                                          • Cross-species gene comparison
                                                                                                                                                            • Genomic variant effect prediction
                                                                                                                                                              • Drug molecule screening agent
                                                                                                                                                              • Geospatial
                                                                                                                                                                • GPU-accelerated climate modeling
                                                                                                                                                                • Financial services & fintech
                                                                                                                                                                  • Multi-agent trading simulation
                                                                                                                                                                    • Fraud detection with Feast
                                                                                                                                                                      • Financial research agent
                                                                                                                                                                      • Frontier AI
                                                                                                                                                                        • Distributed LLM pretraining
                                                                                                                                                                        • Computer vision
                                                                                                                                                                          • Fine-tuning a VLM
                                                                                                                                                                            • Multimodal retrieval evaluation
                                                                                                                                                                              • RT-DETR object detection
                                                                                                                                                                              • Agents
                                                                                                                                                                                • Autoresearch agent
                                                                                                                                                                                  • Parallelized autoresearch agent
                                                                                                                                                                                    • AutoSec researcher agent
                                                                                                                                                                                      • Coding agent
                                                                                                                                                                                        • Competitive intelligence agent
                                                                                                                                                                                          • Deep research
                                                                                                                                                                                            • LangGraph research agent
                                                                                                                                                                                              • MLE bot
                                                                                                                                                                                                • Compliance monitoring agent
                                                                                                                                                                                                  • Field data enrichment agent
                                                                                                                                                                                                    • Support resolution agent
                                                                                                                                                                                                      • Code mode analytics agent
                                                                                                                                                                                                        • Typed decisions for agentic pipelines
                                                                                                                                                                                                        • Context engineering
                                                                                                                                                                                                          • Text-to-SQL prompt optimization
                                                                                                                                                                                                            • Automatic prompt engineering
                                                                                                                                                                                                            • Model training
                                                                                                                                                                                                              • LLM fine-tuning with LoRA and QLoRA
                                                                                                                                                                                                                • BERT emotion classification
                                                                                                                                                                                                                  • Hyperparameter optimization
                                                                                                                                                                                                                  • Speculative decoding models
                                                                                                                                                                                                                    • Train an EAGLE-3 draft head
                                                                                                                                                                                                                    • Train a DFlash block drafter
                                                                                                                                                                                                                    • Train a DSpark drafter
                                                                                                                                                                                                                    • Benchmark draft models
                                                                                                                                                                                                                    • Serve and retrain draft models
                                                                                                                                                                                                                  • Reinforcement learning
                                                                                                                                                                                                                    • Durable agentic RL with SkyRL and Harbor
                                                                                                                                                                                                                    • Inference
                                                                                                                                                                                                                      • Voice customer-service agent
                                                                                                                                                                                                                    • Reference
                                                                                                                                                                                                                      • Flyte CLI
                                                                                                                                                                                                                      • Flyte SDK
                                                                                                                                                                                                                        • flyte
                                                                                                                                                                                                                          • AppHandle
                                                                                                                                                                                                                          • AsyncFunctionTaskTemplate
                                                                                                                                                                                                                          • Backoff
                                                                                                                                                                                                                          • BaseCheckpoint
                                                                                                                                                                                                                          • Cache
                                                                                                                                                                                                                          • CachePolicy
                                                                                                                                                                                                                          • Checkpoint
                                                                                                                                                                                                                          • ConditionWebhook
                                                                                                                                                                                                                          • Cron
                                                                                                                                                                                                                          • Device
                                                                                                                                                                                                                          • Documentation
                                                                                                                                                                                                                          • Environment
                                                                                                                                                                                                                          • FixedRate
                                                                                                                                                                                                                          • Image
                                                                                                                                                                                                                          • ImageBuild
                                                                                                                                                                                                                          • Link
                                                                                                                                                                                                                          • OnArtifact
                                                                                                                                                                                                                          • PodTemplate
                                                                                                                                                                                                                          • Resources
                                                                                                                                                                                                                          • RetryStrategy
                                                                                                                                                                                                                          • ReusePolicy
                                                                                                                                                                                                                          • Secret
                                                                                                                                                                                                                          • TaskEnvironment
                                                                                                                                                                                                                          • TaskTemplate
                                                                                                                                                                                                                          • Timeout
                                                                                                                                                                                                                          • Trigger
                                                                                                                                                                                                                          • TriggeredPartition
                                                                                                                                                                                                                        • flyte.ai.agents
                                                                                                                                                                                                                          • AccessDenied
                                                                                                                                                                                                                          • Agent
                                                                                                                                                                                                                          • AgentEvent
                                                                                                                                                                                                                          • AgentProtocol
                                                                                                                                                                                                                          • AgentResult
                                                                                                                                                                                                                          • AgentTool
                                                                                                                                                                                                                          • ConcurrencyError
                                                                                                                                                                                                                          • LLMMessage
                                                                                                                                                                                                                          • MCPServerSpec
                                                                                                                                                                                                                          • MemoryMeta
                                                                                                                                                                                                                          • MemoryStore
                                                                                                                                                                                                                          • MemoryStoreError
                                                                                                                                                                                                                          • ToolFn
                                                                                                                                                                                                                        • flyte.ai.agents.agent
                                                                                                                                                                                                                          • Agent
                                                                                                                                                                                                                          • AgentEvent
                                                                                                                                                                                                                        • flyte.ai.agents.memory
                                                                                                                                                                                                                          • AccessDenied
                                                                                                                                                                                                                          • ConcurrencyError
                                                                                                                                                                                                                          • MemoryMeta
                                                                                                                                                                                                                          • MemoryStore
                                                                                                                                                                                                                          • MemoryStoreError
                                                                                                                                                                                                                        • flyte.ai.agents.protocol
                                                                                                                                                                                                                          • AgentProtocol
                                                                                                                                                                                                                          • AgentResult
                                                                                                                                                                                                                        • flyte.ai.chat
                                                                                                                                                                                                                          • AgentChatAppEnvironment
                                                                                                                                                                                                                          • CustomTheme
                                                                                                                                                                                                                        • flyte.ai.chat.app
                                                                                                                                                                                                                          • AgentChatAppEnvironment
                                                                                                                                                                                                                          • CustomTheme
                                                                                                                                                                                                                        • flyte.ai.mcp
                                                                                                                                                                                                                          • FlyteMCPAppEnvironment
                                                                                                                                                                                                                          • MCPAppEnvironment
                                                                                                                                                                                                                        • flyte.app
                                                                                                                                                                                                                          • AppEndpoint
                                                                                                                                                                                                                          • AppEnvironment
                                                                                                                                                                                                                          • ArtifactValue
                                                                                                                                                                                                                          • ConnectorEnvironment
                                                                                                                                                                                                                          • DeployedAppEnvironment
                                                                                                                                                                                                                          • Domain
                                                                                                                                                                                                                          • Link
                                                                                                                                                                                                                          • Parameter
                                                                                                                                                                                                                          • Port
                                                                                                                                                                                                                          • RunOutput
                                                                                                                                                                                                                          • Scaling
                                                                                                                                                                                                                          • Subdomain
                                                                                                                                                                                                                          • Timeouts
                                                                                                                                                                                                                        • flyte.app.extras
                                                                                                                                                                                                                          • FastAPIAppEnvironment
                                                                                                                                                                                                                          • FastAPIPassthroughAuthMiddleware
                                                                                                                                                                                                                          • FlyteWebhookAppEnvironment
                                                                                                                                                                                                                        • flyte.artifacts
                                                                                                                                                                                                                          • Artifact
                                                                                                                                                                                                                          • ArtifactKey
                                                                                                                                                                                                                          • ArtifactVersionId
                                                                                                                                                                                                                          • Card
                                                                                                                                                                                                                          • Metadata
                                                                                                                                                                                                                          • TimePartition
                                                                                                                                                                                                                        • flyte.cli.main
                                                                                                                                                                                                                          • RootGroup
                                                                                                                                                                                                                        • flyte.clustered
                                                                                                                                                                                                                          • ClusteredTaskEnvironment
                                                                                                                                                                                                                          • ClusteredTaskTemplate
                                                                                                                                                                                                                          • ClusterFailurePolicy
                                                                                                                                                                                                                          • JaxRun
                                                                                                                                                                                                                          • TorchRun
                                                                                                                                                                                                                        • flyte.config
                                                                                                                                                                                                                          • Config
                                                                                                                                                                                                                        • flyte.connectors
                                                                                                                                                                                                                          • AsyncConnector
                                                                                                                                                                                                                          • AsyncConnectorExecutorMixin
                                                                                                                                                                                                                          • ConnectorRegistry
                                                                                                                                                                                                                          • ConnectorService
                                                                                                                                                                                                                          • Resource
                                                                                                                                                                                                                          • ResourceMeta
                                                                                                                                                                                                                        • flyte.connectors.utils
                                                                                                                                                                                                                          • flyte.durable
                                                                                                                                                                                                                            • flyte.errors
                                                                                                                                                                                                                              • ActionAbortedError
                                                                                                                                                                                                                              • ActionNotFoundError
                                                                                                                                                                                                                              • AppleSiliconBridgeUnreachableError
                                                                                                                                                                                                                              • AppleSiliconDaemonOOMError
                                                                                                                                                                                                                              • AppleSiliconDaemonStartFailedError
                                                                                                                                                                                                                              • AppleSiliconError
                                                                                                                                                                                                                              • AppleSiliconHostExecFailedError
                                                                                                                                                                                                                              • AppleSiliconModelNotFoundError
                                                                                                                                                                                                                              • AppleSiliconNotAvailableError
                                                                                                                                                                                                                              • BaseRuntimeError
                                                                                                                                                                                                                              • CodeBundleError
                                                                                                                                                                                                                              • ConditionAlreadyExistsError
                                                                                                                                                                                                                              • ConditionFailedError
                                                                                                                                                                                                                              • ConditionNotFoundError
                                                                                                                                                                                                                              • ConditionTimedoutError
                                                                                                                                                                                                                              • CustomError
                                                                                                                                                                                                                              • DeadlineExceededError
                                                                                                                                                                                                                              • DeploymentError
                                                                                                                                                                                                                              • GPUFaultError
                                                                                                                                                                                                                              • GPUFaultSystemError
                                                                                                                                                                                                                              • GPUFaultUserError
                                                                                                                                                                                                                              • ImageBuildError
                                                                                                                                                                                                                              • ImagePullBackOffError
                                                                                                                                                                                                                              • InitializationError
                                                                                                                                                                                                                              • InlineIOMaxBytesBreached
                                                                                                                                                                                                                              • InvalidImageNameError
                                                                                                                                                                                                                              • InvalidPackageError
                                                                                                                                                                                                                              • LogsNotYetAvailableError
                                                                                                                                                                                                                              • MaxQueuedTimeExceededError
                                                                                                                                                                                                                              • MaxRuntimeExceededError
                                                                                                                                                                                                                              • ModuleLoadError
                                                                                                                                                                                                                              • NonRecoverableError
                                                                                                                                                                                                                              • NotInTaskContextError
                                                                                                                                                                                                                              • OnlyAsyncIOSupportedError
                                                                                                                                                                                                                              • OOMError
                                                                                                                                                                                                                              • ParameterMaterializationError
                                                                                                                                                                                                                              • PrimaryContainerNotFoundError
                                                                                                                                                                                                                              • RemoteTaskNotFoundError
                                                                                                                                                                                                                              • RemoteTaskUsageError
                                                                                                                                                                                                                              • ResourceExhaustedError
                                                                                                                                                                                                                              • RestrictedTypeError
                                                                                                                                                                                                                              • RetriesExhaustedError
                                                                                                                                                                                                                              • RuntimeDataValidationError
                                                                                                                                                                                                                              • RuntimeSystemError
                                                                                                                                                                                                                              • RuntimeUnknownError
                                                                                                                                                                                                                              • RuntimeUserError
                                                                                                                                                                                                                              • SlowDownError
                                                                                                                                                                                                                              • SyncTaskCallInAsyncContextError
                                                                                                                                                                                                                              • TaskInterruptedError
                                                                                                                                                                                                                              • TaskTimeoutError
                                                                                                                                                                                                                              • TraceDoesNotAllowNestedTasksError
                                                                                                                                                                                                                              • UnionRpcError
                                                                                                                                                                                                                            • flyte.extend
                                                                                                                                                                                                                              • AsyncFunctionTaskTemplate
                                                                                                                                                                                                                              • ImageBuildEngine
                                                                                                                                                                                                                              • ImageBuilder
                                                                                                                                                                                                                              • ImageChecker
                                                                                                                                                                                                                              • RuntimeTaskTemplate
                                                                                                                                                                                                                              • SessionAddress
                                                                                                                                                                                                                              • SessionRoutingInfo
                                                                                                                                                                                                                              • TaskTemplate
                                                                                                                                                                                                                            • flyte.extras
                                                                                                                                                                                                                              • BatchStats
                                                                                                                                                                                                                              • ContainerTask
                                                                                                                                                                                                                              • CostEstimator
                                                                                                                                                                                                                              • DynamicBatcher
                                                                                                                                                                                                                              • Prompt
                                                                                                                                                                                                                              • Sleep
                                                                                                                                                                                                                              • SleepTask
                                                                                                                                                                                                                              • TokenBatcher
                                                                                                                                                                                                                              • TokenEstimator
                                                                                                                                                                                                                            • flyte.extras.model_streamer
                                                                                                                                                                                                                              • LoadResult
                                                                                                                                                                                                                              • ModelStreamer
                                                                                                                                                                                                                            • flyte.extras.shell
                                                                                                                                                                                                                              • FlagSpec
                                                                                                                                                                                                                              • Glob
                                                                                                                                                                                                                              • Stderr
                                                                                                                                                                                                                              • Stdout
                                                                                                                                                                                                                            • flyte.extras.webhooks
                                                                                                                                                                                                                              • EventType
                                                                                                                                                                                                                              • Provider
                                                                                                                                                                                                                              • RunOnceResult
                                                                                                                                                                                                                              • SignatureError
                                                                                                                                                                                                                              • WebhookAppEnvironment
                                                                                                                                                                                                                              • WebhookEvent
                                                                                                                                                                                                                              • WebhookPluginError
                                                                                                                                                                                                                            • flyte.extras.webhooks.testing
                                                                                                                                                                                                                              • ProviderFactory
                                                                                                                                                                                                                            • flyte.git
                                                                                                                                                                                                                              • GitStatus
                                                                                                                                                                                                                            • flyte.io
                                                                                                                                                                                                                              • DataFrame
                                                                                                                                                                                                                              • Dir
                                                                                                                                                                                                                              • EmptyDir
                                                                                                                                                                                                                              • File
                                                                                                                                                                                                                              • HashFunction
                                                                                                                                                                                                                            • flyte.io.extend
                                                                                                                                                                                                                              • DataFrameDecoder
                                                                                                                                                                                                                              • DataFrameEncoder
                                                                                                                                                                                                                              • DataFrameTransformerEngine
                                                                                                                                                                                                                            • flyte.models
                                                                                                                                                                                                                              • ActionID
                                                                                                                                                                                                                              • ActionPhase
                                                                                                                                                                                                                              • CallCounter
                                                                                                                                                                                                                              • CheckpointPaths
                                                                                                                                                                                                                              • CodeBundle
                                                                                                                                                                                                                              • GroupData
                                                                                                                                                                                                                              • NativeInterface
                                                                                                                                                                                                                              • PathRewrite
                                                                                                                                                                                                                              • RawDataPath
                                                                                                                                                                                                                              • SerializationContext
                                                                                                                                                                                                                              • TaskContext
                                                                                                                                                                                                                            • flyte.notify
                                                                                                                                                                                                                              • Email
                                                                                                                                                                                                                              • NamedDelivery
                                                                                                                                                                                                                              • NamedRule
                                                                                                                                                                                                                              • Notification
                                                                                                                                                                                                                              • Slack
                                                                                                                                                                                                                              • Teams
                                                                                                                                                                                                                              • Webhook
                                                                                                                                                                                                                            • flyte.orchestrator
                                                                                                                                                                                                                              • OrchestratorTaskTemplate
                                                                                                                                                                                                                            • flyte.prefetch
                                                                                                                                                                                                                              • HuggingFaceModelInfo
                                                                                                                                                                                                                              • ShardConfig
                                                                                                                                                                                                                              • StoredModelInfo
                                                                                                                                                                                                                              • VLLMShardArgs
                                                                                                                                                                                                                            • flyte.remote
                                                                                                                                                                                                                              • Action
                                                                                                                                                                                                                              • ActionDetails
                                                                                                                                                                                                                              • ActionInputs
                                                                                                                                                                                                                              • ActionOutputs
                                                                                                                                                                                                                              • App
                                                                                                                                                                                                                              • Artifact
                                                                                                                                                                                                                              • Condition
                                                                                                                                                                                                                              • PartitionSchema
                                                                                                                                                                                                                              • Project
                                                                                                                                                                                                                              • Run
                                                                                                                                                                                                                              • RunDetails
                                                                                                                                                                                                                              • Secret
                                                                                                                                                                                                                              • Settings
                                                                                                                                                                                                                              • Task
                                                                                                                                                                                                                              • TaskDetails
                                                                                                                                                                                                                              • TimeFilter
                                                                                                                                                                                                                              • Trigger
                                                                                                                                                                                                                              • TriggerDetails
                                                                                                                                                                                                                              • User
                                                                                                                                                                                                                            • flyte.report
                                                                                                                                                                                                                              • Report
                                                                                                                                                                                                                              • Timeline
                                                                                                                                                                                                                            • flyte.sandbox
                                                                                                                                                                                                                              • CodeTaskTemplate
                                                                                                                                                                                                                              • ImageConfig
                                                                                                                                                                                                                              • SandboxedConfig
                                                                                                                                                                                                                              • SandboxedTaskTemplate
                                                                                                                                                                                                                            • flyte.storage
                                                                                                                                                                                                                              • ABFS
                                                                                                                                                                                                                              • GCS
                                                                                                                                                                                                                              • S3
                                                                                                                                                                                                                              • Storage
                                                                                                                                                                                                                            • flyte.syncify
                                                                                                                                                                                                                              • Syncify
                                                                                                                                                                                                                            • flyte.types
                                                                                                                                                                                                                              • FlytePickle
                                                                                                                                                                                                                              • Renderable
                                                                                                                                                                                                                              • TypeEngine
                                                                                                                                                                                                                              • TypeTransformer
                                                                                                                                                                                                                              • TypeTransformerFailedError
                                                                                                                                                                                                                          • Flyte agent plugins
                                                                                                                                                                                                                          • Integrations
                                                                                                                                                                                                                            • Agent frameworks
                                                                                                                                                                                                                              • Claude Agent SDK
                                                                                                                                                                                                                                • Core
                                                                                                                                                                                                                                  • ReportTimeline
                                                                                                                                                                                                                                  • ToolTaskResolver
                                                                                                                                                                                                                                • CrewAI
                                                                                                                                                                                                                                  • Deep Agents
                                                                                                                                                                                                                                    • DurableChatModel
                                                                                                                                                                                                                                  • Google ADK
                                                                                                                                                                                                                                    • FlyteLlm
                                                                                                                                                                                                                                  • Hermes
                                                                                                                                                                                                                                    • LangChain
                                                                                                                                                                                                                                      • LangGraph
                                                                                                                                                                                                                                        • Mistral
                                                                                                                                                                                                                                          • OpenAI Agents SDK
                                                                                                                                                                                                                                            • FlyteModel
                                                                                                                                                                                                                                            • FlyteModelProvider
                                                                                                                                                                                                                                            • FlyteSession
                                                                                                                                                                                                                                            • FlyteTracingProcessor
                                                                                                                                                                                                                                            • FunctionTool
                                                                                                                                                                                                                                          • Pydantic AI
                                                                                                                                                                                                                                            • FlyteModel
                                                                                                                                                                                                                                        • Software development tools
                                                                                                                                                                                                                                          • ClickUp
                                                                                                                                                                                                                                            • ClickUpProvider
                                                                                                                                                                                                                                          • GitHub
                                                                                                                                                                                                                                            • GitHubProvider
                                                                                                                                                                                                                                            • ReviewComment
                                                                                                                                                                                                                                            • ReviewContext
                                                                                                                                                                                                                                            • ReviewDecision
                                                                                                                                                                                                                                          • GitLab
                                                                                                                                                                                                                                            • GitLabProvider
                                                                                                                                                                                                                                          • Jira
                                                                                                                                                                                                                                            • JiraProvider
                                                                                                                                                                                                                                          • Linear
                                                                                                                                                                                                                                            • LinearProvider
                                                                                                                                                                                                                                          • Slack
                                                                                                                                                                                                                                            • SlackProvider
                                                                                                                                                                                                                                        • Anthropic
                                                                                                                                                                                                                                          • Agent
                                                                                                                                                                                                                                        • BigQuery
                                                                                                                                                                                                                                          • BigQueryConfig
                                                                                                                                                                                                                                          • BigQueryConnector
                                                                                                                                                                                                                                          • BigQueryTask
                                                                                                                                                                                                                                          • BQToPandasDecodingHandler
                                                                                                                                                                                                                                        • Code generation
                                                                                                                                                                                                                                          • AutoCoderAgent
                                                                                                                                                                                                                                          • CodeGenEvalResult
                                                                                                                                                                                                                                          • CodePlan
                                                                                                                                                                                                                                          • CodeSolution
                                                                                                                                                                                                                                          • ErrorDiagnosis
                                                                                                                                                                                                                                          • ImageConfig
                                                                                                                                                                                                                                        • Dask
                                                                                                                                                                                                                                          • Dask
                                                                                                                                                                                                                                          • Scheduler
                                                                                                                                                                                                                                          • WorkerGroup
                                                                                                                                                                                                                                        • Databricks
                                                                                                                                                                                                                                          • Databricks
                                                                                                                                                                                                                                          • DatabricksConnector
                                                                                                                                                                                                                                        • dbt
                                                                                                                                                                                                                                          • DbtInvocationError
                                                                                                                                                                                                                                          • DbtNodeResult
                                                                                                                                                                                                                                          • DbtTask
                                                                                                                                                                                                                                          • DbtTaskResolver
                                                                                                                                                                                                                                        • Gemini
                                                                                                                                                                                                                                          • Agent
                                                                                                                                                                                                                                        • Grafana Agent Observability
                                                                                                                                                                                                                                          • FlyteIdentityBinding
                                                                                                                                                                                                                                          • GrafanaAgentObservability
                                                                                                                                                                                                                                        • Hugging Face
                                                                                                                                                                                                                                          • HFSource
                                                                                                                                                                                                                                        • Human-in-the-loop
                                                                                                                                                                                                                                          • Event
                                                                                                                                                                                                                                        • Hydra
                                                                                                                                                                                                                                          • JSONL
                                                                                                                                                                                                                                            • JsonlDir
                                                                                                                                                                                                                                            • JsonlFile
                                                                                                                                                                                                                                          • Lance
                                                                                                                                                                                                                                            • llama.cpp
                                                                                                                                                                                                                                              • LlamaCppAppEnvironment
                                                                                                                                                                                                                                            • MLflow
                                                                                                                                                                                                                                              • Mlflow
                                                                                                                                                                                                                                            • Nextflow
                                                                                                                                                                                                                                              • NextflowError
                                                                                                                                                                                                                                            • NVIDIA Nsight Systems
                                                                                                                                                                                                                                              • flyteplugins.nsight
                                                                                                                                                                                                                                                • flyteplugins.nsight.nsys
                                                                                                                                                                                                                                                  • flyteplugins.nsight.nvtx
                                                                                                                                                                                                                                                  • OmegaConf
                                                                                                                                                                                                                                                    • oMLX
                                                                                                                                                                                                                                                      • OMLXAppEnvironment
                                                                                                                                                                                                                                                    • OpenAI
                                                                                                                                                                                                                                                      • OpenTelemetry
                                                                                                                                                                                                                                                        • OtelObserver
                                                                                                                                                                                                                                                        • RunScopedIdGenerator
                                                                                                                                                                                                                                                      • Pandera
                                                                                                                                                                                                                                                        • ValidationConfig
                                                                                                                                                                                                                                                      • Papermill
                                                                                                                                                                                                                                                        • NotebookTask
                                                                                                                                                                                                                                                      • Polars
                                                                                                                                                                                                                                                        • ParquetToPolarsDecodingHandler
                                                                                                                                                                                                                                                        • ParquetToPolarsLazyFrameDecodingHandler
                                                                                                                                                                                                                                                        • PolarsLazyFrameToParquetEncodingHandler
                                                                                                                                                                                                                                                        • PolarsToParquetEncodingHandler
                                                                                                                                                                                                                                                      • PyTorch
                                                                                                                                                                                                                                                        • Elastic
                                                                                                                                                                                                                                                      • Ray
                                                                                                                                                                                                                                                        • AutoscalerOptionsConfig
                                                                                                                                                                                                                                                        • HeadNodeConfig
                                                                                                                                                                                                                                                        • RayJobConfig
                                                                                                                                                                                                                                                        • WorkerNodeConfig
                                                                                                                                                                                                                                                      • SGLang
                                                                                                                                                                                                                                                        • SGLangAppEnvironment
                                                                                                                                                                                                                                                      • Slurm
                                                                                                                                                                                                                                                        • Slurm
                                                                                                                                                                                                                                                        • SlurmConnector
                                                                                                                                                                                                                                                        • SlurmFunctionTask
                                                                                                                                                                                                                                                        • SlurmJobMetadata
                                                                                                                                                                                                                                                        • SlurmScriptConnector
                                                                                                                                                                                                                                                        • SlurmScriptTask
                                                                                                                                                                                                                                                      • Snowflake
                                                                                                                                                                                                                                                        • Snowflake
                                                                                                                                                                                                                                                        • SnowflakeConfig
                                                                                                                                                                                                                                                        • SnowflakeConnector
                                                                                                                                                                                                                                                      • Spark
                                                                                                                                                                                                                                                        • ParquetToSparkDecoder
                                                                                                                                                                                                                                                        • Spark
                                                                                                                                                                                                                                                        • SparkToParquetEncoder
                                                                                                                                                                                                                                                      • Trackio
                                                                                                                                                                                                                                                        • Trackio
                                                                                                                                                                                                                                                      • TypeSafe AI
                                                                                                                                                                                                                                                        • BatteryError
                                                                                                                                                                                                                                                        • CallInfo
                                                                                                                                                                                                                                                        • Choice
                                                                                                                                                                                                                                                        • MissingAPIKey
                                                                                                                                                                                                                                                        • Noul
                                                                                                                                                                                                                                                        • Score
                                                                                                                                                                                                                                                      • vLLM
                                                                                                                                                                                                                                                        • VLLMAppEnvironment
                                                                                                                                                                                                                                                      • Weights & Biases
                                                                                                                                                                                                                                                        • Wandb
                                                                                                                                                                                                                                                        • WandbSweep
                                                                                                                                                                                                                                                    • LLM-optimized documentation
                                                                                                                                                                                                                                                  • Integrations
                                                                                                                                                                                                                                                    • Agent frameworks
                                                                                                                                                                                                                                                      • How it works
                                                                                                                                                                                                                                                      • OpenAI
                                                                                                                                                                                                                                                      • Claude
                                                                                                                                                                                                                                                      • Google ADK
                                                                                                                                                                                                                                                      • Mistral
                                                                                                                                                                                                                                                      • LangChain
                                                                                                                                                                                                                                                      • LangGraph
                                                                                                                                                                                                                                                      • Deep Agents
                                                                                                                                                                                                                                                      • CrewAI
                                                                                                                                                                                                                                                      • Pydantic AI
                                                                                                                                                                                                                                                      • Hermes
                                                                                                                                                                                                                                                    • Software development tools
                                                                                                                                                                                                                                                      • GitHub
                                                                                                                                                                                                                                                      • Slack
                                                                                                                                                                                                                                                      • Linear
                                                                                                                                                                                                                                                      • ClickUp
                                                                                                                                                                                                                                                      • Jira
                                                                                                                                                                                                                                                      • GitLab
                                                                                                                                                                                                                                                    • BigQuery
                                                                                                                                                                                                                                                      • Code generation
                                                                                                                                                                                                                                                        • Dask
                                                                                                                                                                                                                                                          • Databricks
                                                                                                                                                                                                                                                            • DBT
                                                                                                                                                                                                                                                              • Grafana Agent Observability
                                                                                                                                                                                                                                                                • Hugging Face
                                                                                                                                                                                                                                                                  • Hydra
                                                                                                                                                                                                                                                                    • JSONL
                                                                                                                                                                                                                                                                      • Lance
                                                                                                                                                                                                                                                                        • llama.cpp
                                                                                                                                                                                                                                                                          • MLflow
                                                                                                                                                                                                                                                                            • Nextflow
                                                                                                                                                                                                                                                                              • NVIDIA Nsight Systems
                                                                                                                                                                                                                                                                                • OmegaConf
                                                                                                                                                                                                                                                                                  • OpenTelemetry
                                                                                                                                                                                                                                                                                    • Exporters and configuration
                                                                                                                                                                                                                                                                                    • Traces across crashes and resumes
                                                                                                                                                                                                                                                                                  • Pandera
                                                                                                                                                                                                                                                                                    • Papermill
                                                                                                                                                                                                                                                                                      • Polars
                                                                                                                                                                                                                                                                                        • PyTorch
                                                                                                                                                                                                                                                                                          • Ray
                                                                                                                                                                                                                                                                                            • Slurm
                                                                                                                                                                                                                                                                                              • Snowflake
                                                                                                                                                                                                                                                                                                • Spark
                                                                                                                                                                                                                                                                                                  • TypeSafe AI
                                                                                                                                                                                                                                                                                                    • Weights & Biases
                                                                                                                                                                                                                                                                                                      • Experiments
                                                                                                                                                                                                                                                                                                      • Distributed training
                                                                                                                                                                                                                                                                                                      • Sweeps
                                                                                                                                                                                                                                                                                                      • Downloading logs
                                                                                                                                                                                                                                                                                                      • Constraints and best practices
                                                                                                                                                                                                                                                                                                      • Manual integration
                                                                                                                                                                                                                                                                                                  • Platform deployment
                                                                                                                                                                                                                                                                                                    • Deployment overview
                                                                                                                                                                                                                                                                                                    • Kind deployment
                                                                                                                                                                                                                                                                                                      • Set up local OIDC provider
                                                                                                                                                                                                                                                                                                      • Set up external OIDC provider
                                                                                                                                                                                                                                                                                                    • AWS deployment
                                                                                                                                                                                                                                                                                                      • flyte-binary deployment
                                                                                                                                                                                                                                                                                                      • flyte-core deployment
                                                                                                                                                                                                                                                                                                    • Authentication and SSO
                                                                                                                                                                                                                                                                                                    • Enable app serving
                                                                                                                                                                                                                                                                                                    • Plugin setup
                                                                                                                                                                                                                                                                                                      • Flyte copilot storage configuration
                                                                                                                                                                                                                                                                                                  • Community
                                                                                                                                                                                                                                                                                                    • Joining the community
                                                                                                                                                                                                                                                                                                    • Contributing code
                                                                                                                                                                                                                                                                                                    • Contributing docs and examples
                                                                                                                                                                                                                                                                                                      • Set up a local docs dev environment
                                                                                                                                                                                                                                                                                                      • Authoring
                                                                                                                                                                                                                                                                                                      • Submit a contribution
                                                                                                                                                                                                                                                                                                      • Writing guidelines
                                                                                                                                                                                                                                                                                                      • Variants
                                                                                                                                                                                                                                                                                                      • Versions
                                                                                                                                                                                                                                                                                                      • Shortcodes
                                                                                                                                                                                                                                                                                                      • API docs
                                                                                                                                                                                                                                                                                                      • LLM-optimized documentation
                                                                                                                                                                                                                                                                                                      • Redirects
                                                                                                                                                                                                                                                                                                      • Production builds and troubleshooting
                                                                                                                                                                                                                                                                                                  Flyte OSS
                                                                                                                                                                                                                                                                                                  Tutorials
                                                                                                                                                                                                                                                                                                  Inference
                                                                                                                                                                                                                                                                                                  Open in Claude Open in Claude Ask questions about this page Open in ChatGPT Ask questions about this page Copy page Copy page as Markdown for LLMs View as Markdown View this page as plain text

                                                                                                                                                                                                                                                                                                  Serving models and building inference applications as Flyte apps.

                                                                                                                                                                                                                                                                                                  Inference

                                                                                                                                                                                                                                                                                                  Tutorials for serving models and building inference applications as Flyte apps.

                                                                                                                                                                                                                                                                                                  Voice customer-service agent Serve an LLM with vLLM and a browser voice UI as two composed Flyte apps, with switchable text-to-speech and a live latency comparison.
                                                                                                                                                                                                                                                                                                  ← Durable agentic RL with SkyRL and HarborVoice customer-service agent →
                                                                                                                                                                                                                                                                                                  Docs: unionai/unionai-docs 2.13.1.1SDK: flyteorg/flyte-sdk 2.13.1Backend: flyteorg/flyte v2.0.54
                                                                                                                                                                                                                                                                                                  On this page
                                                                                                                                                                                                                                                                                                  404

                                                                                                                                                                                                                                                                                                  Page not found

                                                                                                                                                                                                                                                                                                  Showing closest match