Try Flyte on Union.ai free for 30 days
Get started
Flyte OSS Docs logo
Flyte OSS Docs
v2
v1
Signup
Flyte OSS Docs logo
Flyte OSS Docs
  • User guide
    • Get started
      • Quickstart
      • Core concepts
        • TaskEnvironment
        • Tasks
        • Runs and actions
        • Where your data lives
        • Apps
        • Projects and domains
        • Key capabilities
        • Basic project
      • Run modes
        • Run locally in Python
        • Run on the Devbox
        • Run on a deployed cluster
    • Tasks
      • Configure tasks
        • Container images
        • Resources
        • Secrets
        • Caching
        • Reusable containers
        • Pod templates
        • Multiple environments
        • Clustered task environment
        • Retries and timeouts
        • Interruptible tasks
        • Task plugins
        • Additional task settings
        • Logging
        • Overrides
      • Build tasks
        • Files and directories
        • Data classes and structures
        • DataFrames
        • Custom types
        • Custom context
        • Abort and cancel actions
        • Raw Container Tasks
        • Links
        • Reports
        • Notebooks
        • Remote tasks
        • Error handling
        • Traces
        • Intra-task checkpoints
        • Grouping actions
        • Fanout
        • Mapping over inputs
        • Consuming a message queue
        • Controlling parallel execution
        • Streaming map-reduce
        • Structured concurrency with anyio
        • Task dependencies and ordering
        • External conditions
        • Unit Testing Tasks
        • Higher-order functions
        • Other features
      • Run and deploy tasks
        • How task run works
        • Interact with runs and actions
        • View logs
        • Work with local data
        • Run command options
        • Build a custom CLI
        • How task deployment works
        • Deploy command options
        • Packaging
        • Deployment patterns
        • Run context
        • Entrypoint tasks
        • Run a Python script
        • Send notifications from your code
        • Rerun a run
        • Recover a failed run
    • Apps
      • Configure apps
        • App environments
        • Including additional files
        • Passing parameters into app environments
        • Autoscaling apps
        • Apps depending on other environments
      • Build apps
        • Single-script apps
        • Multi-script apps
        • Serving graphs
        • Hybrid app-task graphs
        • WebSocket apps
        • Browser apps
        • Secret-based authentication
      • Native app integrations
        • Streamlit app
        • FastAPI app
        • Flyte webhook
      • Serve and deploy apps
        • How app serving works
        • How app custom domains work
        • How app deployment works
        • Activating and deactivating apps
    • Triggers
      • Configure a trigger
      • Schedule triggers
      • When scheduled runs start
      • Manual triggers and firing on demand
      • Deploy and manage triggers
    • Model training
      • Pre-training
      • Post-training
      • Classical machine learning
      • Hyperparameter optimization
      • Evaluation
      • Durable training
    • Reinforcement learning
      • Training environment
      • Reward setup
      • Inference rollouts
      • Training loop
      • Evaluation
    • Inference
      • Providers
        • Fireworks
        • OpenAI
        • Anthropic
        • AWS Bedrock
        • Google Vertex AI
      • Self-hosted endpoints
        • vLLM
        • SGLang
        • Ollama
        • llama.cpp
        • FastAPI
        • Other frameworks
      • Prefetching models
      • Deploy trained models
      • Batch inference
      • Stream model weights
      • Decision models
        • Typed decisions with Jev
    • Agents
      • Build an agent
        • Pure Python agents
        • Flyte-native agents
        • Bring your own framework
        • Agent memory
        • Agent chat UI
        • Deploy an agent as a service
      • Build an MCP
        • User-defined MCP server
        • Flyte MCP server
      • Sandboxing
        • Workflow sandboxing
        • Programmatic tool calling for agents
        • Code sandboxing
    • Project patterns
      • Bring your own image (BYOI)
      • Monorepo with uv
      • CI/CD deployments
      • Software development lifecycle
        • Event-driven automation
        • Review and release gates
        • Human gates and approvals
        • Evaluation gates
        • Notifications and observability
      • Advanced project
        • Resilient generation
        • Agentic refinement
        • Parallel outputs
        • Serving app
    • Scale your runs
      • Data flow
      • Life of a run
      • Scale your workflows
    • Migration
      • From Flyte 1 to 2
        • Migration Overview
        • Tasks and workflows
        • Task configuration
        • CLI and configuration
        • Control flow
        • Parallelism and fan-out
        • Data types and I/O
        • ML workloads
        • New in Flyte 2
        • Hybrid v1 and v2 pipelines
        • Gotchas and caveats
      • From Airflow to Flyte
        • Part 1: vanilla operators
      • From Slurm to Flyte
    • Telemetry
  • Tutorials
    • Biotech & healthcare
      • Genomic alignment
        • Brain tumor MRI classification
          • Cross-species gene comparison
            • Genomic variant effect prediction
              • Drug molecule screening agent
              • Geospatial
                • GPU-accelerated climate modeling
                • Financial services & fintech
                  • Multi-agent trading simulation
                    • Fraud detection with Feast
                      • Financial research agent
                      • Frontier AI
                        • Distributed LLM pretraining
                        • Computer vision
                          • Fine-tuning a VLM
                            • Multimodal retrieval evaluation
                              • RT-DETR object detection
                              • Agents
                                • Autoresearch agent
                                  • Parallelized autoresearch agent
                                    • AutoSec researcher agent
                                      • Coding agent
                                        • Competitive intelligence agent
                                          • Deep research
                                            • LangGraph research agent
                                              • MLE bot
                                                • Compliance monitoring agent
                                                  • Field data enrichment agent
                                                    • Support resolution agent
                                                      • Code mode analytics agent
                                                        • Typed decisions for agentic pipelines
                                                        • Context engineering
                                                          • Text-to-SQL prompt optimization
                                                            • Automatic prompt engineering
                                                            • Model training
                                                              • LLM fine-tuning with LoRA and QLoRA
                                                                • BERT emotion classification
                                                                  • Hyperparameter optimization
                                                                  • Speculative decoding models
                                                                    • Train an EAGLE-3 draft head
                                                                    • Train a DFlash block drafter
                                                                    • Train a DSpark drafter
                                                                    • Benchmark draft models
                                                                    • Serve and retrain draft models
                                                                  • Reinforcement learning
                                                                    • Durable agentic RL with SkyRL and Harbor
                                                                    • Inference
                                                                      • Voice customer-service agent
                                                                      • Data validation
                                                                        • Per-batch validation overhead
                                                                          • Whole-dataset validation
                                                                            • The cost of not validating
                                                                          • Reference
                                                                            • Flyte CLI
                                                                            • Flyte SDK
                                                                              • flyte
                                                                                • AppHandle
                                                                                • AsyncFunctionTaskTemplate
                                                                                • Backoff
                                                                                • BaseCheckpoint
                                                                                • Cache
                                                                                • CachePolicy
                                                                                • Checkpoint
                                                                                • ConditionWebhook
                                                                                • Cron
                                                                                • Device
                                                                                • Documentation
                                                                                • Environment
                                                                                • FixedRate
                                                                                • Image
                                                                                • ImageBuild
                                                                                • Link
                                                                                • OnArtifact
                                                                                • PodTemplate
                                                                                • Resources
                                                                                • RetryStrategy
                                                                                • ReusePolicy
                                                                                • Secret
                                                                                • TaskEnvironment
                                                                                • TaskTemplate
                                                                                • Timeout
                                                                                • Trigger
                                                                                • TriggeredPartition
                                                                              • flyte.ai.agents
                                                                                • AccessDenied
                                                                                • Agent
                                                                                • AgentEvent
                                                                                • AgentProtocol
                                                                                • AgentResult
                                                                                • AgentTool
                                                                                • ConcurrencyError
                                                                                • LLMMessage
                                                                                • MCPServerSpec
                                                                                • MemoryMeta
                                                                                • MemoryStore
                                                                                • MemoryStoreError
                                                                                • ToolFn
                                                                              • flyte.ai.agents.agent
                                                                                • Agent
                                                                                • AgentEvent
                                                                              • flyte.ai.agents.memory
                                                                                • AccessDenied
                                                                                • ConcurrencyError
                                                                                • MemoryMeta
                                                                                • MemoryStore
                                                                                • MemoryStoreError
                                                                              • flyte.ai.agents.protocol
                                                                                • AgentProtocol
                                                                                • AgentResult
                                                                              • flyte.ai.chat
                                                                                • AgentChatAppEnvironment
                                                                                • CustomTheme
                                                                              • flyte.ai.chat.app
                                                                                • AgentChatAppEnvironment
                                                                                • CustomTheme
                                                                              • flyte.ai.mcp
                                                                                • FlyteMCPAppEnvironment
                                                                                • MCPAppEnvironment
                                                                              • flyte.app
                                                                                • AppEndpoint
                                                                                • AppEnvironment
                                                                                • ArtifactValue
                                                                                • ConnectorEnvironment
                                                                                • DeployedAppEnvironment
                                                                                • Domain
                                                                                • Link
                                                                                • Parameter
                                                                                • Port
                                                                                • RunOutput
                                                                                • Scaling
                                                                                • Subdomain
                                                                                • Timeouts
                                                                              • flyte.app.extras
                                                                                • FastAPIAppEnvironment
                                                                                • FastAPIPassthroughAuthMiddleware
                                                                                • FlyteWebhookAppEnvironment
                                                                              • flyte.artifacts
                                                                                • Artifact
                                                                                • ArtifactKey
                                                                                • ArtifactVersionId
                                                                                • Card
                                                                                • Metadata
                                                                                • TimePartition
                                                                              • flyte.cli.main
                                                                                • RootGroup
                                                                              • flyte.clustered
                                                                                • ClusteredTaskEnvironment
                                                                                • ClusteredTaskTemplate
                                                                                • ClusterFailurePolicy
                                                                                • JaxRun
                                                                                • TorchRun
                                                                              • flyte.config
                                                                                • Config
                                                                              • flyte.connectors
                                                                                • AsyncConnector
                                                                                • AsyncConnectorExecutorMixin
                                                                                • ConnectorRegistry
                                                                                • ConnectorService
                                                                                • Resource
                                                                                • ResourceMeta
                                                                              • flyte.connectors.utils
                                                                                • flyte.durable
                                                                                  • flyte.errors
                                                                                    • ActionAbortedError
                                                                                    • ActionNotFoundError
                                                                                    • AppleSiliconBridgeUnreachableError
                                                                                    • AppleSiliconDaemonOOMError
                                                                                    • AppleSiliconDaemonStartFailedError
                                                                                    • AppleSiliconError
                                                                                    • AppleSiliconHostExecFailedError
                                                                                    • AppleSiliconModelNotFoundError
                                                                                    • AppleSiliconNotAvailableError
                                                                                    • BaseRuntimeError
                                                                                    • CodeBundleError
                                                                                    • ConditionAlreadyExistsError
                                                                                    • ConditionFailedError
                                                                                    • ConditionNotFoundError
                                                                                    • ConditionTimedoutError
                                                                                    • CustomError
                                                                                    • DeadlineExceededError
                                                                                    • DeploymentError
                                                                                    • GPUFaultError
                                                                                    • GPUFaultSystemError
                                                                                    • GPUFaultUserError
                                                                                    • ImageBuildError
                                                                                    • ImagePullBackOffError
                                                                                    • InitializationError
                                                                                    • InlineIOMaxBytesBreached
                                                                                    • InvalidImageNameError
                                                                                    • InvalidPackageError
                                                                                    • LogsNotYetAvailableError
                                                                                    • MaxQueuedTimeExceededError
                                                                                    • MaxRuntimeExceededError
                                                                                    • ModuleLoadError
                                                                                    • NonRecoverableError
                                                                                    • NotInTaskContextError
                                                                                    • OnlyAsyncIOSupportedError
                                                                                    • OOMError
                                                                                    • OrgLimitExceededError
                                                                                    • ParameterMaterializationError
                                                                                    • PrimaryContainerNotFoundError
                                                                                    • RemoteTaskNotFoundError
                                                                                    • RemoteTaskUsageError
                                                                                    • ResourceExhaustedError
                                                                                    • RestrictedTypeError
                                                                                    • RetriesExhaustedError
                                                                                    • RuntimeDataValidationError
                                                                                    • RuntimeSystemError
                                                                                    • RuntimeUnknownError
                                                                                    • RuntimeUserError
                                                                                    • SlowDownError
                                                                                    • SyncTaskCallInAsyncContextError
                                                                                    • TaskInterruptedError
                                                                                    • TaskTimeoutError
                                                                                    • TraceDoesNotAllowNestedTasksError
                                                                                    • UnionRpcError
                                                                                  • flyte.extend
                                                                                    • AsyncFunctionTaskTemplate
                                                                                    • ImageBuildEngine
                                                                                    • ImageBuilder
                                                                                    • ImageChecker
                                                                                    • RuntimeTaskTemplate
                                                                                    • SessionAddress
                                                                                    • SessionRoutingInfo
                                                                                    • TaskTemplate
                                                                                  • flyte.extras
                                                                                    • BatchStats
                                                                                    • ContainerTask
                                                                                    • CostEstimator
                                                                                    • DynamicBatcher
                                                                                    • Prompt
                                                                                    • Sleep
                                                                                    • SleepTask
                                                                                    • TokenBatcher
                                                                                    • TokenEstimator
                                                                                  • flyte.extras.model_streamer
                                                                                    • LoadResult
                                                                                    • ModelStreamer
                                                                                  • flyte.extras.shell
                                                                                    • FlagSpec
                                                                                    • Glob
                                                                                    • Stderr
                                                                                    • Stdout
                                                                                  • flyte.extras.webhooks
                                                                                    • EventType
                                                                                    • Provider
                                                                                    • RunOnceResult
                                                                                    • SignatureError
                                                                                    • WebhookAppEnvironment
                                                                                    • WebhookEvent
                                                                                    • WebhookPluginError
                                                                                  • flyte.extras.webhooks.testing
                                                                                    • ProviderFactory
                                                                                  • flyte.git
                                                                                    • GitStatus
                                                                                  • flyte.io
                                                                                    • DataFrame
                                                                                    • Dir
                                                                                    • EmptyDir
                                                                                    • File
                                                                                    • HashFunction
                                                                                  • flyte.io.extend
                                                                                    • DataFrameDecoder
                                                                                    • DataFrameEncoder
                                                                                    • DataFrameTransformerEngine
                                                                                  • flyte.models
                                                                                    • ActionID
                                                                                    • ActionPhase
                                                                                    • CallCounter
                                                                                    • CheckpointPaths
                                                                                    • CodeBundle
                                                                                    • GroupData
                                                                                    • NativeInterface
                                                                                    • PathRewrite
                                                                                    • RawDataPath
                                                                                    • SerializationContext
                                                                                    • TaskContext
                                                                                  • flyte.notify
                                                                                    • Email
                                                                                    • NamedDelivery
                                                                                    • NamedRule
                                                                                    • Notification
                                                                                    • Slack
                                                                                    • Teams
                                                                                    • Webhook
                                                                                  • flyte.orchestrator
                                                                                    • OrchestratorTaskTemplate
                                                                                  • flyte.prefetch
                                                                                    • HuggingFaceModelInfo
                                                                                    • ShardConfig
                                                                                    • StoredModelInfo
                                                                                    • VLLMShardArgs
                                                                                  • flyte.remote
                                                                                    • Action
                                                                                    • ActionDetails
                                                                                    • ActionInputs
                                                                                    • ActionOutputs
                                                                                    • App
                                                                                    • Artifact
                                                                                    • Condition
                                                                                    • PartitionSchema
                                                                                    • Project
                                                                                    • Run
                                                                                    • RunDetails
                                                                                    • Secret
                                                                                    • Settings
                                                                                    • Task
                                                                                    • TaskDetails
                                                                                    • TimeFilter
                                                                                    • Trigger
                                                                                    • TriggerDetails
                                                                                    • User
                                                                                  • flyte.report
                                                                                    • Report
                                                                                    • Timeline
                                                                                  • flyte.sandbox
                                                                                    • CodeTaskTemplate
                                                                                    • ImageConfig
                                                                                    • SandboxedConfig
                                                                                    • SandboxedTaskTemplate
                                                                                  • flyte.storage
                                                                                    • ABFS
                                                                                    • GCS
                                                                                    • S3
                                                                                    • Storage
                                                                                  • flyte.syncify
                                                                                    • Syncify
                                                                                  • flyte.types
                                                                                    • FlytePickle
                                                                                    • Renderable
                                                                                    • TypeEngine
                                                                                    • TypeTransformer
                                                                                    • TypeTransformerFailedError
                                                                                • Flyte agent plugins
                                                                                • Integrations
                                                                                  • Agent frameworks
                                                                                    • Claude Agent SDK
                                                                                      • Core
                                                                                        • ReportTimeline
                                                                                        • ToolTaskResolver
                                                                                      • CrewAI
                                                                                        • Deep Agents
                                                                                          • DurableChatModel
                                                                                        • Google ADK
                                                                                          • FlyteLlm
                                                                                        • Hermes
                                                                                          • LangChain
                                                                                            • LangGraph
                                                                                              • Mistral
                                                                                                • OpenAI Agents SDK
                                                                                                  • FlyteModel
                                                                                                  • FlyteModelProvider
                                                                                                  • FlyteSession
                                                                                                  • FlyteTracingProcessor
                                                                                                  • FunctionTool
                                                                                                • Pydantic AI
                                                                                                  • FlyteModel
                                                                                              • Software development tools
                                                                                                • ClickUp
                                                                                                  • ClickUpProvider
                                                                                                • GitHub
                                                                                                  • GitHubProvider
                                                                                                  • ReviewComment
                                                                                                  • ReviewContext
                                                                                                  • ReviewDecision
                                                                                                • GitLab
                                                                                                  • GitLabProvider
                                                                                                • Jira
                                                                                                  • JiraProvider
                                                                                                • Linear
                                                                                                  • LinearProvider
                                                                                                • Slack
                                                                                                  • SlackProvider
                                                                                              • Anthropic
                                                                                                • Agent
                                                                                              • BigQuery
                                                                                                • BigQueryConfig
                                                                                                • BigQueryConnector
                                                                                                • BigQueryTask
                                                                                                • BQToPandasDecodingHandler
                                                                                              • Code generation
                                                                                                • AutoCoderAgent
                                                                                                • CodeGenEvalResult
                                                                                                • CodePlan
                                                                                                • CodeSolution
                                                                                                • ErrorDiagnosis
                                                                                                • ImageConfig
                                                                                              • Dask
                                                                                                • Dask
                                                                                                • Scheduler
                                                                                                • WorkerGroup
                                                                                              • Databricks
                                                                                                • Databricks
                                                                                                • DatabricksConnector
                                                                                              • dbt
                                                                                                • DbtInvocationError
                                                                                                • DbtNodeResult
                                                                                                • DbtTask
                                                                                                • DbtTaskResolver
                                                                                              • Gemini
                                                                                                • Agent
                                                                                              • Grafana Agent Observability
                                                                                                • FlyteIdentityBinding
                                                                                                • GrafanaAgentObservability
                                                                                              • Hugging Face
                                                                                                • HFSource
                                                                                              • Human-in-the-loop
                                                                                                • Event
                                                                                              • Hydra
                                                                                                • JSONL
                                                                                                  • JsonlDir
                                                                                                  • JsonlFile
                                                                                                • Lance
                                                                                                  • llama.cpp
                                                                                                    • LlamaCppAppEnvironment
                                                                                                  • MLflow
                                                                                                    • Mlflow
                                                                                                  • Nextflow
                                                                                                    • NextflowError
                                                                                                  • NVIDIA Nsight Systems
                                                                                                    • flyteplugins.nsight
                                                                                                      • flyteplugins.nsight.nsys
                                                                                                        • flyteplugins.nsight.nvtx
                                                                                                        • OmegaConf
                                                                                                          • oMLX
                                                                                                            • OMLXAppEnvironment
                                                                                                          • OpenAI
                                                                                                            • OpenTelemetry
                                                                                                              • OtelObserver
                                                                                                              • RunScopedIdGenerator
                                                                                                            • Pandera
                                                                                                              • ValidationConfig
                                                                                                            • Papermill
                                                                                                              • NotebookTask
                                                                                                            • Polars
                                                                                                              • ParquetToPolarsDecodingHandler
                                                                                                              • ParquetToPolarsLazyFrameDecodingHandler
                                                                                                              • PolarsLazyFrameToParquetEncodingHandler
                                                                                                              • PolarsToParquetEncodingHandler
                                                                                                            • PyTorch
                                                                                                              • Elastic
                                                                                                            • Ray
                                                                                                              • AutoscalerOptionsConfig
                                                                                                              • HeadNodeConfig
                                                                                                              • RayJobConfig
                                                                                                              • WorkerNodeConfig
                                                                                                            • SGLang
                                                                                                              • SGLangAppEnvironment
                                                                                                            • Slurm
                                                                                                              • Slurm
                                                                                                              • SlurmConnector
                                                                                                              • SlurmFunctionTask
                                                                                                              • SlurmJobMetadata
                                                                                                              • SlurmScriptConnector
                                                                                                              • SlurmScriptTask
                                                                                                            • Snowflake
                                                                                                              • Snowflake
                                                                                                              • SnowflakeConfig
                                                                                                              • SnowflakeConnector
                                                                                                            • Spark
                                                                                                              • ParquetToSparkDecoder
                                                                                                              • Spark
                                                                                                              • SparkToParquetEncoder
                                                                                                            • Trackio
                                                                                                              • Trackio
                                                                                                            • TypeSafe AI
                                                                                                              • BatteryError
                                                                                                              • CallInfo
                                                                                                              • Choice
                                                                                                              • MissingAPIKey
                                                                                                              • Noul
                                                                                                              • Score
                                                                                                            • vLLM
                                                                                                              • VLLMAppEnvironment
                                                                                                            • Weights & Biases
                                                                                                              • Wandb
                                                                                                              • WandbSweep
                                                                                                          • LLM-optimized documentation
                                                                                                        • Integrations
                                                                                                          • Agent frameworks
                                                                                                            • How it works
                                                                                                            • OpenAI
                                                                                                            • Claude
                                                                                                            • Google ADK
                                                                                                            • Mistral
                                                                                                            • LangChain
                                                                                                            • LangGraph
                                                                                                            • Deep Agents
                                                                                                            • CrewAI
                                                                                                            • Pydantic AI
                                                                                                            • Hermes
                                                                                                          • Software development tools
                                                                                                            • GitHub
                                                                                                            • Slack
                                                                                                            • Linear
                                                                                                            • ClickUp
                                                                                                            • Jira
                                                                                                            • GitLab
                                                                                                          • BigQuery
                                                                                                            • Code generation
                                                                                                              • Dask
                                                                                                                • Databricks
                                                                                                                  • DBT
                                                                                                                    • Grafana Agent Observability
                                                                                                                      • Hugging Face
                                                                                                                        • Hydra
                                                                                                                          • JSONL
                                                                                                                            • Lance
                                                                                                                              • llama.cpp
                                                                                                                                • MLflow
                                                                                                                                  • Nextflow
                                                                                                                                    • NVIDIA Nsight Systems
                                                                                                                                      • OmegaConf
                                                                                                                                        • OpenTelemetry
                                                                                                                                          • Exporters and configuration
                                                                                                                                          • Traces across crashes and resumes
                                                                                                                                        • Pandera
                                                                                                                                          • Papermill
                                                                                                                                            • Polars
                                                                                                                                              • PyTorch
                                                                                                                                                • Ray
                                                                                                                                                  • Slurm
                                                                                                                                                    • Snowflake
                                                                                                                                                      • Spark
                                                                                                                                                        • TypeSafe AI
                                                                                                                                                          • Weights & Biases
                                                                                                                                                            • Experiments
                                                                                                                                                            • Distributed training
                                                                                                                                                            • Sweeps
                                                                                                                                                            • Downloading logs
                                                                                                                                                            • Constraints and best practices
                                                                                                                                                            • Manual integration
                                                                                                                                                        • Platform deployment
                                                                                                                                                          • Deployment overview
                                                                                                                                                          • Kind deployment
                                                                                                                                                            • Set up local OIDC provider
                                                                                                                                                            • Set up external OIDC provider
                                                                                                                                                          • AWS deployment
                                                                                                                                                            • flyte-binary deployment
                                                                                                                                                            • flyte-core deployment
                                                                                                                                                          • Authentication and SSO
                                                                                                                                                          • Enable app serving
                                                                                                                                                          • Plugin setup
                                                                                                                                                            • Flyte copilot storage configuration
                                                                                                                                                        • Community
                                                                                                                                                          • Joining the community
                                                                                                                                                          • Contributing code
                                                                                                                                                          • Contributing docs and examples
                                                                                                                                                            • Set up a local docs dev environment
                                                                                                                                                            • Authoring
                                                                                                                                                            • Submit a contribution
                                                                                                                                                            • Writing guidelines
                                                                                                                                                            • Variants
                                                                                                                                                            • Versions
                                                                                                                                                            • Shortcodes
                                                                                                                                                            • API docs
                                                                                                                                                            • LLM-optimized documentation
                                                                                                                                                            • Redirects
                                                                                                                                                            • Production builds and troubleshooting
                                                                                                                                                        Documentation navigation for Flyte including user guides, tutorials, API references, and integration examples
                                                                                                                                                        • User guide
                                                                                                                                                          • Get started
                                                                                                                                                            • Quickstart
                                                                                                                                                            • Core concepts
                                                                                                                                                              • TaskEnvironment
                                                                                                                                                              • Tasks
                                                                                                                                                              • Runs and actions
                                                                                                                                                              • Where your data lives
                                                                                                                                                              • Apps
                                                                                                                                                              • Projects and domains
                                                                                                                                                              • Key capabilities
                                                                                                                                                              • Basic project
                                                                                                                                                            • Run modes
                                                                                                                                                              • Run locally in Python
                                                                                                                                                              • Run on the Devbox
                                                                                                                                                              • Run on a deployed cluster
                                                                                                                                                          • Tasks
                                                                                                                                                            • Configure tasks
                                                                                                                                                              • Container images
                                                                                                                                                              • Resources
                                                                                                                                                              • Secrets
                                                                                                                                                              • Caching
                                                                                                                                                              • Reusable containers
                                                                                                                                                              • Pod templates
                                                                                                                                                              • Multiple environments
                                                                                                                                                              • Clustered task environment
                                                                                                                                                              • Retries and timeouts
                                                                                                                                                              • Interruptible tasks
                                                                                                                                                              • Task plugins
                                                                                                                                                              • Additional task settings
                                                                                                                                                              • Logging
                                                                                                                                                              • Overrides
                                                                                                                                                            • Build tasks
                                                                                                                                                              • Files and directories
                                                                                                                                                              • Data classes and structures
                                                                                                                                                              • DataFrames
                                                                                                                                                              • Custom types
                                                                                                                                                              • Custom context
                                                                                                                                                              • Abort and cancel actions
                                                                                                                                                              • Raw Container Tasks
                                                                                                                                                              • Links
                                                                                                                                                              • Reports
                                                                                                                                                              • Notebooks
                                                                                                                                                              • Remote tasks
                                                                                                                                                              • Error handling
                                                                                                                                                              • Traces
                                                                                                                                                              • Intra-task checkpoints
                                                                                                                                                              • Grouping actions
                                                                                                                                                              • Fanout
                                                                                                                                                              • Mapping over inputs
                                                                                                                                                              • Consuming a message queue
                                                                                                                                                              • Controlling parallel execution
                                                                                                                                                              • Streaming map-reduce
                                                                                                                                                              • Structured concurrency with anyio
                                                                                                                                                              • Task dependencies and ordering
                                                                                                                                                              • External conditions
                                                                                                                                                              • Unit Testing Tasks
                                                                                                                                                              • Higher-order functions
                                                                                                                                                              • Other features
                                                                                                                                                            • Run and deploy tasks
                                                                                                                                                              • How task run works
                                                                                                                                                              • Interact with runs and actions
                                                                                                                                                              • View logs
                                                                                                                                                              • Work with local data
                                                                                                                                                              • Run command options
                                                                                                                                                              • Build a custom CLI
                                                                                                                                                              • How task deployment works
                                                                                                                                                              • Deploy command options
                                                                                                                                                              • Packaging
                                                                                                                                                              • Deployment patterns
                                                                                                                                                              • Run context
                                                                                                                                                              • Entrypoint tasks
                                                                                                                                                              • Run a Python script
                                                                                                                                                              • Send notifications from your code
                                                                                                                                                              • Rerun a run
                                                                                                                                                              • Recover a failed run
                                                                                                                                                          • Apps
                                                                                                                                                            • Configure apps
                                                                                                                                                              • App environments
                                                                                                                                                              • Including additional files
                                                                                                                                                              • Passing parameters into app environments
                                                                                                                                                              • Autoscaling apps
                                                                                                                                                              • Apps depending on other environments
                                                                                                                                                            • Build apps
                                                                                                                                                              • Single-script apps
                                                                                                                                                              • Multi-script apps
                                                                                                                                                              • Serving graphs
                                                                                                                                                              • Hybrid app-task graphs
                                                                                                                                                              • WebSocket apps
                                                                                                                                                              • Browser apps
                                                                                                                                                              • Secret-based authentication
                                                                                                                                                            • Native app integrations
                                                                                                                                                              • Streamlit app
                                                                                                                                                              • FastAPI app
                                                                                                                                                              • Flyte webhook
                                                                                                                                                            • Serve and deploy apps
                                                                                                                                                              • How app serving works
                                                                                                                                                              • How app custom domains work
                                                                                                                                                              • How app deployment works
                                                                                                                                                              • Activating and deactivating apps
                                                                                                                                                          • Triggers
                                                                                                                                                            • Configure a trigger
                                                                                                                                                            • Schedule triggers
                                                                                                                                                            • When scheduled runs start
                                                                                                                                                            • Manual triggers and firing on demand
                                                                                                                                                            • Deploy and manage triggers
                                                                                                                                                          • Model training
                                                                                                                                                            • Pre-training
                                                                                                                                                            • Post-training
                                                                                                                                                            • Classical machine learning
                                                                                                                                                            • Hyperparameter optimization
                                                                                                                                                            • Evaluation
                                                                                                                                                            • Durable training
                                                                                                                                                          • Reinforcement learning
                                                                                                                                                            • Training environment
                                                                                                                                                            • Reward setup
                                                                                                                                                            • Inference rollouts
                                                                                                                                                            • Training loop
                                                                                                                                                            • Evaluation
                                                                                                                                                          • Inference
                                                                                                                                                            • Providers
                                                                                                                                                              • Fireworks
                                                                                                                                                              • OpenAI
                                                                                                                                                              • Anthropic
                                                                                                                                                              • AWS Bedrock
                                                                                                                                                              • Google Vertex AI
                                                                                                                                                            • Self-hosted endpoints
                                                                                                                                                              • vLLM
                                                                                                                                                              • SGLang
                                                                                                                                                              • Ollama
                                                                                                                                                              • llama.cpp
                                                                                                                                                              • FastAPI
                                                                                                                                                              • Other frameworks
                                                                                                                                                            • Prefetching models
                                                                                                                                                            • Deploy trained models
                                                                                                                                                            • Batch inference
                                                                                                                                                            • Stream model weights
                                                                                                                                                            • Decision models
                                                                                                                                                              • Typed decisions with Jev
                                                                                                                                                          • Agents
                                                                                                                                                            • Build an agent
                                                                                                                                                              • Pure Python agents
                                                                                                                                                              • Flyte-native agents
                                                                                                                                                              • Bring your own framework
                                                                                                                                                              • Agent memory
                                                                                                                                                              • Agent chat UI
                                                                                                                                                              • Deploy an agent as a service
                                                                                                                                                            • Build an MCP
                                                                                                                                                              • User-defined MCP server
                                                                                                                                                              • Flyte MCP server
                                                                                                                                                            • Sandboxing
                                                                                                                                                              • Workflow sandboxing
                                                                                                                                                              • Programmatic tool calling for agents
                                                                                                                                                              • Code sandboxing
                                                                                                                                                          • Project patterns
                                                                                                                                                            • Bring your own image (BYOI)
                                                                                                                                                            • Monorepo with uv
                                                                                                                                                            • CI/CD deployments
                                                                                                                                                            • Software development lifecycle
                                                                                                                                                              • Event-driven automation
                                                                                                                                                              • Review and release gates
                                                                                                                                                              • Human gates and approvals
                                                                                                                                                              • Evaluation gates
                                                                                                                                                              • Notifications and observability
                                                                                                                                                            • Advanced project
                                                                                                                                                              • Resilient generation
                                                                                                                                                              • Agentic refinement
                                                                                                                                                              • Parallel outputs
                                                                                                                                                              • Serving app
                                                                                                                                                          • Scale your runs
                                                                                                                                                            • Data flow
                                                                                                                                                            • Life of a run
                                                                                                                                                            • Scale your workflows
                                                                                                                                                          • Migration
                                                                                                                                                            • From Flyte 1 to 2
                                                                                                                                                              • Migration Overview
                                                                                                                                                              • Tasks and workflows
                                                                                                                                                              • Task configuration
                                                                                                                                                              • CLI and configuration
                                                                                                                                                              • Control flow
                                                                                                                                                              • Parallelism and fan-out
                                                                                                                                                              • Data types and I/O
                                                                                                                                                              • ML workloads
                                                                                                                                                              • New in Flyte 2
                                                                                                                                                              • Hybrid v1 and v2 pipelines
                                                                                                                                                              • Gotchas and caveats
                                                                                                                                                            • From Airflow to Flyte
                                                                                                                                                              • Part 1: vanilla operators
                                                                                                                                                            • From Slurm to Flyte
                                                                                                                                                          • Telemetry
                                                                                                                                                        • Tutorials
                                                                                                                                                          • Biotech & healthcare
                                                                                                                                                            • Genomic alignment
                                                                                                                                                              • Brain tumor MRI classification
                                                                                                                                                                • Cross-species gene comparison
                                                                                                                                                                  • Genomic variant effect prediction
                                                                                                                                                                    • Drug molecule screening agent
                                                                                                                                                                    • Geospatial
                                                                                                                                                                      • GPU-accelerated climate modeling
                                                                                                                                                                      • Financial services & fintech
                                                                                                                                                                        • Multi-agent trading simulation
                                                                                                                                                                          • Fraud detection with Feast
                                                                                                                                                                            • Financial research agent
                                                                                                                                                                            • Frontier AI
                                                                                                                                                                              • Distributed LLM pretraining
                                                                                                                                                                              • Computer vision
                                                                                                                                                                                • Fine-tuning a VLM
                                                                                                                                                                                  • Multimodal retrieval evaluation
                                                                                                                                                                                    • RT-DETR object detection
                                                                                                                                                                                    • Agents
                                                                                                                                                                                      • Autoresearch agent
                                                                                                                                                                                        • Parallelized autoresearch agent
                                                                                                                                                                                          • AutoSec researcher agent
                                                                                                                                                                                            • Coding agent
                                                                                                                                                                                              • Competitive intelligence agent
                                                                                                                                                                                                • Deep research
                                                                                                                                                                                                  • LangGraph research agent
                                                                                                                                                                                                    • MLE bot
                                                                                                                                                                                                      • Compliance monitoring agent
                                                                                                                                                                                                        • Field data enrichment agent
                                                                                                                                                                                                          • Support resolution agent
                                                                                                                                                                                                            • Code mode analytics agent
                                                                                                                                                                                                              • Typed decisions for agentic pipelines
                                                                                                                                                                                                              • Context engineering
                                                                                                                                                                                                                • Text-to-SQL prompt optimization
                                                                                                                                                                                                                  • Automatic prompt engineering
                                                                                                                                                                                                                  • Model training
                                                                                                                                                                                                                    • LLM fine-tuning with LoRA and QLoRA
                                                                                                                                                                                                                      • BERT emotion classification
                                                                                                                                                                                                                        • Hyperparameter optimization
                                                                                                                                                                                                                        • Speculative decoding models
                                                                                                                                                                                                                          • Train an EAGLE-3 draft head
                                                                                                                                                                                                                          • Train a DFlash block drafter
                                                                                                                                                                                                                          • Train a DSpark drafter
                                                                                                                                                                                                                          • Benchmark draft models
                                                                                                                                                                                                                          • Serve and retrain draft models
                                                                                                                                                                                                                        • Reinforcement learning
                                                                                                                                                                                                                          • Durable agentic RL with SkyRL and Harbor
                                                                                                                                                                                                                          • Inference
                                                                                                                                                                                                                            • Voice customer-service agent
                                                                                                                                                                                                                            • Data validation
                                                                                                                                                                                                                              • Per-batch validation overhead
                                                                                                                                                                                                                                • Whole-dataset validation
                                                                                                                                                                                                                                  • The cost of not validating
                                                                                                                                                                                                                                • Reference
                                                                                                                                                                                                                                  • Flyte CLI
                                                                                                                                                                                                                                  • Flyte SDK
                                                                                                                                                                                                                                    • flyte
                                                                                                                                                                                                                                      • AppHandle
                                                                                                                                                                                                                                      • AsyncFunctionTaskTemplate
                                                                                                                                                                                                                                      • Backoff
                                                                                                                                                                                                                                      • BaseCheckpoint
                                                                                                                                                                                                                                      • Cache
                                                                                                                                                                                                                                      • CachePolicy
                                                                                                                                                                                                                                      • Checkpoint
                                                                                                                                                                                                                                      • ConditionWebhook
                                                                                                                                                                                                                                      • Cron
                                                                                                                                                                                                                                      • Device
                                                                                                                                                                                                                                      • Documentation
                                                                                                                                                                                                                                      • Environment
                                                                                                                                                                                                                                      • FixedRate
                                                                                                                                                                                                                                      • Image
                                                                                                                                                                                                                                      • ImageBuild
                                                                                                                                                                                                                                      • Link
                                                                                                                                                                                                                                      • OnArtifact
                                                                                                                                                                                                                                      • PodTemplate
                                                                                                                                                                                                                                      • Resources
                                                                                                                                                                                                                                      • RetryStrategy
                                                                                                                                                                                                                                      • ReusePolicy
                                                                                                                                                                                                                                      • Secret
                                                                                                                                                                                                                                      • TaskEnvironment
                                                                                                                                                                                                                                      • TaskTemplate
                                                                                                                                                                                                                                      • Timeout
                                                                                                                                                                                                                                      • Trigger
                                                                                                                                                                                                                                      • TriggeredPartition
                                                                                                                                                                                                                                    • flyte.ai.agents
                                                                                                                                                                                                                                      • AccessDenied
                                                                                                                                                                                                                                      • Agent
                                                                                                                                                                                                                                      • AgentEvent
                                                                                                                                                                                                                                      • AgentProtocol
                                                                                                                                                                                                                                      • AgentResult
                                                                                                                                                                                                                                      • AgentTool
                                                                                                                                                                                                                                      • ConcurrencyError
                                                                                                                                                                                                                                      • LLMMessage
                                                                                                                                                                                                                                      • MCPServerSpec
                                                                                                                                                                                                                                      • MemoryMeta
                                                                                                                                                                                                                                      • MemoryStore
                                                                                                                                                                                                                                      • MemoryStoreError
                                                                                                                                                                                                                                      • ToolFn
                                                                                                                                                                                                                                    • flyte.ai.agents.agent
                                                                                                                                                                                                                                      • Agent
                                                                                                                                                                                                                                      • AgentEvent
                                                                                                                                                                                                                                    • flyte.ai.agents.memory
                                                                                                                                                                                                                                      • AccessDenied
                                                                                                                                                                                                                                      • ConcurrencyError
                                                                                                                                                                                                                                      • MemoryMeta
                                                                                                                                                                                                                                      • MemoryStore
                                                                                                                                                                                                                                      • MemoryStoreError
                                                                                                                                                                                                                                    • flyte.ai.agents.protocol
                                                                                                                                                                                                                                      • AgentProtocol
                                                                                                                                                                                                                                      • AgentResult
                                                                                                                                                                                                                                    • flyte.ai.chat
                                                                                                                                                                                                                                      • AgentChatAppEnvironment
                                                                                                                                                                                                                                      • CustomTheme
                                                                                                                                                                                                                                    • flyte.ai.chat.app
                                                                                                                                                                                                                                      • AgentChatAppEnvironment
                                                                                                                                                                                                                                      • CustomTheme
                                                                                                                                                                                                                                    • flyte.ai.mcp
                                                                                                                                                                                                                                      • FlyteMCPAppEnvironment
                                                                                                                                                                                                                                      • MCPAppEnvironment
                                                                                                                                                                                                                                    • flyte.app
                                                                                                                                                                                                                                      • AppEndpoint
                                                                                                                                                                                                                                      • AppEnvironment
                                                                                                                                                                                                                                      • ArtifactValue
                                                                                                                                                                                                                                      • ConnectorEnvironment
                                                                                                                                                                                                                                      • DeployedAppEnvironment
                                                                                                                                                                                                                                      • Domain
                                                                                                                                                                                                                                      • Link
                                                                                                                                                                                                                                      • Parameter
                                                                                                                                                                                                                                      • Port
                                                                                                                                                                                                                                      • RunOutput
                                                                                                                                                                                                                                      • Scaling
                                                                                                                                                                                                                                      • Subdomain
                                                                                                                                                                                                                                      • Timeouts
                                                                                                                                                                                                                                    • flyte.app.extras
                                                                                                                                                                                                                                      • FastAPIAppEnvironment
                                                                                                                                                                                                                                      • FastAPIPassthroughAuthMiddleware
                                                                                                                                                                                                                                      • FlyteWebhookAppEnvironment
                                                                                                                                                                                                                                    • flyte.artifacts
                                                                                                                                                                                                                                      • Artifact
                                                                                                                                                                                                                                      • ArtifactKey
                                                                                                                                                                                                                                      • ArtifactVersionId
                                                                                                                                                                                                                                      • Card
                                                                                                                                                                                                                                      • Metadata
                                                                                                                                                                                                                                      • TimePartition
                                                                                                                                                                                                                                    • flyte.cli.main
                                                                                                                                                                                                                                      • RootGroup
                                                                                                                                                                                                                                    • flyte.clustered
                                                                                                                                                                                                                                      • ClusteredTaskEnvironment
                                                                                                                                                                                                                                      • ClusteredTaskTemplate
                                                                                                                                                                                                                                      • ClusterFailurePolicy
                                                                                                                                                                                                                                      • JaxRun
                                                                                                                                                                                                                                      • TorchRun
                                                                                                                                                                                                                                    • flyte.config
                                                                                                                                                                                                                                      • Config
                                                                                                                                                                                                                                    • flyte.connectors
                                                                                                                                                                                                                                      • AsyncConnector
                                                                                                                                                                                                                                      • AsyncConnectorExecutorMixin
                                                                                                                                                                                                                                      • ConnectorRegistry
                                                                                                                                                                                                                                      • ConnectorService
                                                                                                                                                                                                                                      • Resource
                                                                                                                                                                                                                                      • ResourceMeta
                                                                                                                                                                                                                                    • flyte.connectors.utils
                                                                                                                                                                                                                                      • flyte.durable
                                                                                                                                                                                                                                        • flyte.errors
                                                                                                                                                                                                                                          • ActionAbortedError
                                                                                                                                                                                                                                          • ActionNotFoundError
                                                                                                                                                                                                                                          • AppleSiliconBridgeUnreachableError
                                                                                                                                                                                                                                          • AppleSiliconDaemonOOMError
                                                                                                                                                                                                                                          • AppleSiliconDaemonStartFailedError
                                                                                                                                                                                                                                          • AppleSiliconError
                                                                                                                                                                                                                                          • AppleSiliconHostExecFailedError
                                                                                                                                                                                                                                          • AppleSiliconModelNotFoundError
                                                                                                                                                                                                                                          • AppleSiliconNotAvailableError
                                                                                                                                                                                                                                          • BaseRuntimeError
                                                                                                                                                                                                                                          • CodeBundleError
                                                                                                                                                                                                                                          • ConditionAlreadyExistsError
                                                                                                                                                                                                                                          • ConditionFailedError
                                                                                                                                                                                                                                          • ConditionNotFoundError
                                                                                                                                                                                                                                          • ConditionTimedoutError
                                                                                                                                                                                                                                          • CustomError
                                                                                                                                                                                                                                          • DeadlineExceededError
                                                                                                                                                                                                                                          • DeploymentError
                                                                                                                                                                                                                                          • GPUFaultError
                                                                                                                                                                                                                                          • GPUFaultSystemError
                                                                                                                                                                                                                                          • GPUFaultUserError
                                                                                                                                                                                                                                          • ImageBuildError
                                                                                                                                                                                                                                          • ImagePullBackOffError
                                                                                                                                                                                                                                          • InitializationError
                                                                                                                                                                                                                                          • InlineIOMaxBytesBreached
                                                                                                                                                                                                                                          • InvalidImageNameError
                                                                                                                                                                                                                                          • InvalidPackageError
                                                                                                                                                                                                                                          • LogsNotYetAvailableError
                                                                                                                                                                                                                                          • MaxQueuedTimeExceededError
                                                                                                                                                                                                                                          • MaxRuntimeExceededError
                                                                                                                                                                                                                                          • ModuleLoadError
                                                                                                                                                                                                                                          • NonRecoverableError
                                                                                                                                                                                                                                          • NotInTaskContextError
                                                                                                                                                                                                                                          • OnlyAsyncIOSupportedError
                                                                                                                                                                                                                                          • OOMError
                                                                                                                                                                                                                                          • OrgLimitExceededError
                                                                                                                                                                                                                                          • ParameterMaterializationError
                                                                                                                                                                                                                                          • PrimaryContainerNotFoundError
                                                                                                                                                                                                                                          • RemoteTaskNotFoundError
                                                                                                                                                                                                                                          • RemoteTaskUsageError
                                                                                                                                                                                                                                          • ResourceExhaustedError
                                                                                                                                                                                                                                          • RestrictedTypeError
                                                                                                                                                                                                                                          • RetriesExhaustedError
                                                                                                                                                                                                                                          • RuntimeDataValidationError
                                                                                                                                                                                                                                          • RuntimeSystemError
                                                                                                                                                                                                                                          • RuntimeUnknownError
                                                                                                                                                                                                                                          • RuntimeUserError
                                                                                                                                                                                                                                          • SlowDownError
                                                                                                                                                                                                                                          • SyncTaskCallInAsyncContextError
                                                                                                                                                                                                                                          • TaskInterruptedError
                                                                                                                                                                                                                                          • TaskTimeoutError
                                                                                                                                                                                                                                          • TraceDoesNotAllowNestedTasksError
                                                                                                                                                                                                                                          • UnionRpcError
                                                                                                                                                                                                                                        • flyte.extend
                                                                                                                                                                                                                                          • AsyncFunctionTaskTemplate
                                                                                                                                                                                                                                          • ImageBuildEngine
                                                                                                                                                                                                                                          • ImageBuilder
                                                                                                                                                                                                                                          • ImageChecker
                                                                                                                                                                                                                                          • RuntimeTaskTemplate
                                                                                                                                                                                                                                          • SessionAddress
                                                                                                                                                                                                                                          • SessionRoutingInfo
                                                                                                                                                                                                                                          • TaskTemplate
                                                                                                                                                                                                                                        • flyte.extras
                                                                                                                                                                                                                                          • BatchStats
                                                                                                                                                                                                                                          • ContainerTask
                                                                                                                                                                                                                                          • CostEstimator
                                                                                                                                                                                                                                          • DynamicBatcher
                                                                                                                                                                                                                                          • Prompt
                                                                                                                                                                                                                                          • Sleep
                                                                                                                                                                                                                                          • SleepTask
                                                                                                                                                                                                                                          • TokenBatcher
                                                                                                                                                                                                                                          • TokenEstimator
                                                                                                                                                                                                                                        • flyte.extras.model_streamer
                                                                                                                                                                                                                                          • LoadResult
                                                                                                                                                                                                                                          • ModelStreamer
                                                                                                                                                                                                                                        • flyte.extras.shell
                                                                                                                                                                                                                                          • FlagSpec
                                                                                                                                                                                                                                          • Glob
                                                                                                                                                                                                                                          • Stderr
                                                                                                                                                                                                                                          • Stdout
                                                                                                                                                                                                                                        • flyte.extras.webhooks
                                                                                                                                                                                                                                          • EventType
                                                                                                                                                                                                                                          • Provider
                                                                                                                                                                                                                                          • RunOnceResult
                                                                                                                                                                                                                                          • SignatureError
                                                                                                                                                                                                                                          • WebhookAppEnvironment
                                                                                                                                                                                                                                          • WebhookEvent
                                                                                                                                                                                                                                          • WebhookPluginError
                                                                                                                                                                                                                                        • flyte.extras.webhooks.testing
                                                                                                                                                                                                                                          • ProviderFactory
                                                                                                                                                                                                                                        • flyte.git
                                                                                                                                                                                                                                          • GitStatus
                                                                                                                                                                                                                                        • flyte.io
                                                                                                                                                                                                                                          • DataFrame
                                                                                                                                                                                                                                          • Dir
                                                                                                                                                                                                                                          • EmptyDir
                                                                                                                                                                                                                                          • File
                                                                                                                                                                                                                                          • HashFunction
                                                                                                                                                                                                                                        • flyte.io.extend
                                                                                                                                                                                                                                          • DataFrameDecoder
                                                                                                                                                                                                                                          • DataFrameEncoder
                                                                                                                                                                                                                                          • DataFrameTransformerEngine
                                                                                                                                                                                                                                        • flyte.models
                                                                                                                                                                                                                                          • ActionID
                                                                                                                                                                                                                                          • ActionPhase
                                                                                                                                                                                                                                          • CallCounter
                                                                                                                                                                                                                                          • CheckpointPaths
                                                                                                                                                                                                                                          • CodeBundle
                                                                                                                                                                                                                                          • GroupData
                                                                                                                                                                                                                                          • NativeInterface
                                                                                                                                                                                                                                          • PathRewrite
                                                                                                                                                                                                                                          • RawDataPath
                                                                                                                                                                                                                                          • SerializationContext
                                                                                                                                                                                                                                          • TaskContext
                                                                                                                                                                                                                                        • flyte.notify
                                                                                                                                                                                                                                          • Email
                                                                                                                                                                                                                                          • NamedDelivery
                                                                                                                                                                                                                                          • NamedRule
                                                                                                                                                                                                                                          • Notification
                                                                                                                                                                                                                                          • Slack
                                                                                                                                                                                                                                          • Teams
                                                                                                                                                                                                                                          • Webhook
                                                                                                                                                                                                                                        • flyte.orchestrator
                                                                                                                                                                                                                                          • OrchestratorTaskTemplate
                                                                                                                                                                                                                                        • flyte.prefetch
                                                                                                                                                                                                                                          • HuggingFaceModelInfo
                                                                                                                                                                                                                                          • ShardConfig
                                                                                                                                                                                                                                          • StoredModelInfo
                                                                                                                                                                                                                                          • VLLMShardArgs
                                                                                                                                                                                                                                        • flyte.remote
                                                                                                                                                                                                                                          • Action
                                                                                                                                                                                                                                          • ActionDetails
                                                                                                                                                                                                                                          • ActionInputs
                                                                                                                                                                                                                                          • ActionOutputs
                                                                                                                                                                                                                                          • App
                                                                                                                                                                                                                                          • Artifact
                                                                                                                                                                                                                                          • Condition
                                                                                                                                                                                                                                          • PartitionSchema
                                                                                                                                                                                                                                          • Project
                                                                                                                                                                                                                                          • Run
                                                                                                                                                                                                                                          • RunDetails
                                                                                                                                                                                                                                          • Secret
                                                                                                                                                                                                                                          • Settings
                                                                                                                                                                                                                                          • Task
                                                                                                                                                                                                                                          • TaskDetails
                                                                                                                                                                                                                                          • TimeFilter
                                                                                                                                                                                                                                          • Trigger
                                                                                                                                                                                                                                          • TriggerDetails
                                                                                                                                                                                                                                          • User
                                                                                                                                                                                                                                        • flyte.report
                                                                                                                                                                                                                                          • Report
                                                                                                                                                                                                                                          • Timeline
                                                                                                                                                                                                                                        • flyte.sandbox
                                                                                                                                                                                                                                          • CodeTaskTemplate
                                                                                                                                                                                                                                          • ImageConfig
                                                                                                                                                                                                                                          • SandboxedConfig
                                                                                                                                                                                                                                          • SandboxedTaskTemplate
                                                                                                                                                                                                                                        • flyte.storage
                                                                                                                                                                                                                                          • ABFS
                                                                                                                                                                                                                                          • GCS
                                                                                                                                                                                                                                          • S3
                                                                                                                                                                                                                                          • Storage
                                                                                                                                                                                                                                        • flyte.syncify
                                                                                                                                                                                                                                          • Syncify
                                                                                                                                                                                                                                        • flyte.types
                                                                                                                                                                                                                                          • FlytePickle
                                                                                                                                                                                                                                          • Renderable
                                                                                                                                                                                                                                          • TypeEngine
                                                                                                                                                                                                                                          • TypeTransformer
                                                                                                                                                                                                                                          • TypeTransformerFailedError
                                                                                                                                                                                                                                      • Flyte agent plugins
                                                                                                                                                                                                                                      • Integrations
                                                                                                                                                                                                                                        • Agent frameworks
                                                                                                                                                                                                                                          • Claude Agent SDK
                                                                                                                                                                                                                                            • Core
                                                                                                                                                                                                                                              • ReportTimeline
                                                                                                                                                                                                                                              • ToolTaskResolver
                                                                                                                                                                                                                                            • CrewAI
                                                                                                                                                                                                                                              • Deep Agents
                                                                                                                                                                                                                                                • DurableChatModel
                                                                                                                                                                                                                                              • Google ADK
                                                                                                                                                                                                                                                • FlyteLlm
                                                                                                                                                                                                                                              • Hermes
                                                                                                                                                                                                                                                • LangChain
                                                                                                                                                                                                                                                  • LangGraph
                                                                                                                                                                                                                                                    • Mistral
                                                                                                                                                                                                                                                      • OpenAI Agents SDK
                                                                                                                                                                                                                                                        • FlyteModel
                                                                                                                                                                                                                                                        • FlyteModelProvider
                                                                                                                                                                                                                                                        • FlyteSession
                                                                                                                                                                                                                                                        • FlyteTracingProcessor
                                                                                                                                                                                                                                                        • FunctionTool
                                                                                                                                                                                                                                                      • Pydantic AI
                                                                                                                                                                                                                                                        • FlyteModel
                                                                                                                                                                                                                                                    • Software development tools
                                                                                                                                                                                                                                                      • ClickUp
                                                                                                                                                                                                                                                        • ClickUpProvider
                                                                                                                                                                                                                                                      • GitHub
                                                                                                                                                                                                                                                        • GitHubProvider
                                                                                                                                                                                                                                                        • ReviewComment
                                                                                                                                                                                                                                                        • ReviewContext
                                                                                                                                                                                                                                                        • ReviewDecision
                                                                                                                                                                                                                                                      • GitLab
                                                                                                                                                                                                                                                        • GitLabProvider
                                                                                                                                                                                                                                                      • Jira
                                                                                                                                                                                                                                                        • JiraProvider
                                                                                                                                                                                                                                                      • Linear
                                                                                                                                                                                                                                                        • LinearProvider
                                                                                                                                                                                                                                                      • Slack
                                                                                                                                                                                                                                                        • SlackProvider
                                                                                                                                                                                                                                                    • Anthropic
                                                                                                                                                                                                                                                      • Agent
                                                                                                                                                                                                                                                    • BigQuery
                                                                                                                                                                                                                                                      • BigQueryConfig
                                                                                                                                                                                                                                                      • BigQueryConnector
                                                                                                                                                                                                                                                      • BigQueryTask
                                                                                                                                                                                                                                                      • BQToPandasDecodingHandler
                                                                                                                                                                                                                                                    • Code generation
                                                                                                                                                                                                                                                      • AutoCoderAgent
                                                                                                                                                                                                                                                      • CodeGenEvalResult
                                                                                                                                                                                                                                                      • CodePlan
                                                                                                                                                                                                                                                      • CodeSolution
                                                                                                                                                                                                                                                      • ErrorDiagnosis
                                                                                                                                                                                                                                                      • ImageConfig
                                                                                                                                                                                                                                                    • Dask
                                                                                                                                                                                                                                                      • Dask
                                                                                                                                                                                                                                                      • Scheduler
                                                                                                                                                                                                                                                      • WorkerGroup
                                                                                                                                                                                                                                                    • Databricks
                                                                                                                                                                                                                                                      • Databricks
                                                                                                                                                                                                                                                      • DatabricksConnector
                                                                                                                                                                                                                                                    • dbt
                                                                                                                                                                                                                                                      • DbtInvocationError
                                                                                                                                                                                                                                                      • DbtNodeResult
                                                                                                                                                                                                                                                      • DbtTask
                                                                                                                                                                                                                                                      • DbtTaskResolver
                                                                                                                                                                                                                                                    • Gemini
                                                                                                                                                                                                                                                      • Agent
                                                                                                                                                                                                                                                    • Grafana Agent Observability
                                                                                                                                                                                                                                                      • FlyteIdentityBinding
                                                                                                                                                                                                                                                      • GrafanaAgentObservability
                                                                                                                                                                                                                                                    • Hugging Face
                                                                                                                                                                                                                                                      • HFSource
                                                                                                                                                                                                                                                    • Human-in-the-loop
                                                                                                                                                                                                                                                      • Event
                                                                                                                                                                                                                                                    • Hydra
                                                                                                                                                                                                                                                      • JSONL
                                                                                                                                                                                                                                                        • JsonlDir
                                                                                                                                                                                                                                                        • JsonlFile
                                                                                                                                                                                                                                                      • Lance
                                                                                                                                                                                                                                                        • llama.cpp
                                                                                                                                                                                                                                                          • LlamaCppAppEnvironment
                                                                                                                                                                                                                                                        • MLflow
                                                                                                                                                                                                                                                          • Mlflow
                                                                                                                                                                                                                                                        • Nextflow
                                                                                                                                                                                                                                                          • NextflowError
                                                                                                                                                                                                                                                        • NVIDIA Nsight Systems
                                                                                                                                                                                                                                                          • flyteplugins.nsight
                                                                                                                                                                                                                                                            • flyteplugins.nsight.nsys
                                                                                                                                                                                                                                                              • flyteplugins.nsight.nvtx
                                                                                                                                                                                                                                                              • OmegaConf
                                                                                                                                                                                                                                                                • oMLX
                                                                                                                                                                                                                                                                  • OMLXAppEnvironment
                                                                                                                                                                                                                                                                • OpenAI
                                                                                                                                                                                                                                                                  • OpenTelemetry
                                                                                                                                                                                                                                                                    • OtelObserver
                                                                                                                                                                                                                                                                    • RunScopedIdGenerator
                                                                                                                                                                                                                                                                  • Pandera
                                                                                                                                                                                                                                                                    • ValidationConfig
                                                                                                                                                                                                                                                                  • Papermill
                                                                                                                                                                                                                                                                    • NotebookTask
                                                                                                                                                                                                                                                                  • Polars
                                                                                                                                                                                                                                                                    • ParquetToPolarsDecodingHandler
                                                                                                                                                                                                                                                                    • ParquetToPolarsLazyFrameDecodingHandler
                                                                                                                                                                                                                                                                    • PolarsLazyFrameToParquetEncodingHandler
                                                                                                                                                                                                                                                                    • PolarsToParquetEncodingHandler
                                                                                                                                                                                                                                                                  • PyTorch
                                                                                                                                                                                                                                                                    • Elastic
                                                                                                                                                                                                                                                                  • Ray
                                                                                                                                                                                                                                                                    • AutoscalerOptionsConfig
                                                                                                                                                                                                                                                                    • HeadNodeConfig
                                                                                                                                                                                                                                                                    • RayJobConfig
                                                                                                                                                                                                                                                                    • WorkerNodeConfig
                                                                                                                                                                                                                                                                  • SGLang
                                                                                                                                                                                                                                                                    • SGLangAppEnvironment
                                                                                                                                                                                                                                                                  • Slurm
                                                                                                                                                                                                                                                                    • Slurm
                                                                                                                                                                                                                                                                    • SlurmConnector
                                                                                                                                                                                                                                                                    • SlurmFunctionTask
                                                                                                                                                                                                                                                                    • SlurmJobMetadata
                                                                                                                                                                                                                                                                    • SlurmScriptConnector
                                                                                                                                                                                                                                                                    • SlurmScriptTask
                                                                                                                                                                                                                                                                  • Snowflake
                                                                                                                                                                                                                                                                    • Snowflake
                                                                                                                                                                                                                                                                    • SnowflakeConfig
                                                                                                                                                                                                                                                                    • SnowflakeConnector
                                                                                                                                                                                                                                                                  • Spark
                                                                                                                                                                                                                                                                    • ParquetToSparkDecoder
                                                                                                                                                                                                                                                                    • Spark
                                                                                                                                                                                                                                                                    • SparkToParquetEncoder
                                                                                                                                                                                                                                                                  • Trackio
                                                                                                                                                                                                                                                                    • Trackio
                                                                                                                                                                                                                                                                  • TypeSafe AI
                                                                                                                                                                                                                                                                    • BatteryError
                                                                                                                                                                                                                                                                    • CallInfo
                                                                                                                                                                                                                                                                    • Choice
                                                                                                                                                                                                                                                                    • MissingAPIKey
                                                                                                                                                                                                                                                                    • Noul
                                                                                                                                                                                                                                                                    • Score
                                                                                                                                                                                                                                                                  • vLLM
                                                                                                                                                                                                                                                                    • VLLMAppEnvironment
                                                                                                                                                                                                                                                                  • Weights & Biases
                                                                                                                                                                                                                                                                    • Wandb
                                                                                                                                                                                                                                                                    • WandbSweep
                                                                                                                                                                                                                                                                • LLM-optimized documentation
                                                                                                                                                                                                                                                              • Integrations
                                                                                                                                                                                                                                                                • Agent frameworks
                                                                                                                                                                                                                                                                  • How it works
                                                                                                                                                                                                                                                                  • OpenAI
                                                                                                                                                                                                                                                                  • Claude
                                                                                                                                                                                                                                                                  • Google ADK
                                                                                                                                                                                                                                                                  • Mistral
                                                                                                                                                                                                                                                                  • LangChain
                                                                                                                                                                                                                                                                  • LangGraph
                                                                                                                                                                                                                                                                  • Deep Agents
                                                                                                                                                                                                                                                                  • CrewAI
                                                                                                                                                                                                                                                                  • Pydantic AI
                                                                                                                                                                                                                                                                  • Hermes
                                                                                                                                                                                                                                                                • Software development tools
                                                                                                                                                                                                                                                                  • GitHub
                                                                                                                                                                                                                                                                  • Slack
                                                                                                                                                                                                                                                                  • Linear
                                                                                                                                                                                                                                                                  • ClickUp
                                                                                                                                                                                                                                                                  • Jira
                                                                                                                                                                                                                                                                  • GitLab
                                                                                                                                                                                                                                                                • BigQuery
                                                                                                                                                                                                                                                                  • Code generation
                                                                                                                                                                                                                                                                    • Dask
                                                                                                                                                                                                                                                                      • Databricks
                                                                                                                                                                                                                                                                        • DBT
                                                                                                                                                                                                                                                                          • Grafana Agent Observability
                                                                                                                                                                                                                                                                            • Hugging Face
                                                                                                                                                                                                                                                                              • Hydra
                                                                                                                                                                                                                                                                                • JSONL
                                                                                                                                                                                                                                                                                  • Lance
                                                                                                                                                                                                                                                                                    • llama.cpp
                                                                                                                                                                                                                                                                                      • MLflow
                                                                                                                                                                                                                                                                                        • Nextflow
                                                                                                                                                                                                                                                                                          • NVIDIA Nsight Systems
                                                                                                                                                                                                                                                                                            • OmegaConf
                                                                                                                                                                                                                                                                                              • OpenTelemetry
                                                                                                                                                                                                                                                                                                • Exporters and configuration
                                                                                                                                                                                                                                                                                                • Traces across crashes and resumes
                                                                                                                                                                                                                                                                                              • Pandera
                                                                                                                                                                                                                                                                                                • Papermill
                                                                                                                                                                                                                                                                                                  • Polars
                                                                                                                                                                                                                                                                                                    • PyTorch
                                                                                                                                                                                                                                                                                                      • Ray
                                                                                                                                                                                                                                                                                                        • Slurm
                                                                                                                                                                                                                                                                                                          • Snowflake
                                                                                                                                                                                                                                                                                                            • Spark
                                                                                                                                                                                                                                                                                                              • TypeSafe AI
                                                                                                                                                                                                                                                                                                                • Weights & Biases
                                                                                                                                                                                                                                                                                                                  • Experiments
                                                                                                                                                                                                                                                                                                                  • Distributed training
                                                                                                                                                                                                                                                                                                                  • Sweeps
                                                                                                                                                                                                                                                                                                                  • Downloading logs
                                                                                                                                                                                                                                                                                                                  • Constraints and best practices
                                                                                                                                                                                                                                                                                                                  • Manual integration
                                                                                                                                                                                                                                                                                                              • Platform deployment
                                                                                                                                                                                                                                                                                                                • Deployment overview
                                                                                                                                                                                                                                                                                                                • Kind deployment
                                                                                                                                                                                                                                                                                                                  • Set up local OIDC provider
                                                                                                                                                                                                                                                                                                                  • Set up external OIDC provider
                                                                                                                                                                                                                                                                                                                • AWS deployment
                                                                                                                                                                                                                                                                                                                  • flyte-binary deployment
                                                                                                                                                                                                                                                                                                                  • flyte-core deployment
                                                                                                                                                                                                                                                                                                                • Authentication and SSO
                                                                                                                                                                                                                                                                                                                • Enable app serving
                                                                                                                                                                                                                                                                                                                • Plugin setup
                                                                                                                                                                                                                                                                                                                  • Flyte copilot storage configuration
                                                                                                                                                                                                                                                                                                              • Community
                                                                                                                                                                                                                                                                                                                • Joining the community
                                                                                                                                                                                                                                                                                                                • Contributing code
                                                                                                                                                                                                                                                                                                                • Contributing docs and examples
                                                                                                                                                                                                                                                                                                                  • Set up a local docs dev environment
                                                                                                                                                                                                                                                                                                                  • Authoring
                                                                                                                                                                                                                                                                                                                  • Submit a contribution
                                                                                                                                                                                                                                                                                                                  • Writing guidelines
                                                                                                                                                                                                                                                                                                                  • Variants
                                                                                                                                                                                                                                                                                                                  • Versions
                                                                                                                                                                                                                                                                                                                  • Shortcodes
                                                                                                                                                                                                                                                                                                                  • API docs
                                                                                                                                                                                                                                                                                                                  • LLM-optimized documentation
                                                                                                                                                                                                                                                                                                                  • Redirects
                                                                                                                                                                                                                                                                                                                  • Production builds and troubleshooting
                                                                                                                                                                                                                                                                                                              Flyte OSS
                                                                                                                                                                                                                                                                                                              Reference
                                                                                                                                                                                                                                                                                                              Integrations
                                                                                                                                                                                                                                                                                                              SGLang
                                                                                                                                                                                                                                                                                                              Open in Claude Open in Claude Ask questions about this page Open in ChatGPT Ask questions about this page Copy page Copy page as Markdown for LLMs View as Markdown View this page as plain text
                                                                                                                                                                                                                                                                                                              2.13.2

                                                                                                                                                                                                                                                                                                              SGLang

                                                                                                                                                                                                                                                                                                              Directory

                                                                                                                                                                                                                                                                                                              Classes

                                                                                                                                                                                                                                                                                                              Class Description
                                                                                                                                                                                                                                                                                                              SGLangAppEnvironment App environment backed by SGLang for serving large language models.

                                                                                                                                                                                                                                                                                                              Variables

                                                                                                                                                                                                                                                                                                              Property Type Description
                                                                                                                                                                                                                                                                                                              DEFAULT_SGLANG_IMAGE Image
                                                                                                                                                                                                                                                                                                              Docs: unionai/unionai-docs 2.13.2.0SDK: flyteorg/flyte-sdk 2.13.2Backend: flyteorg/flyte v2.0.54
                                                                                                                                                                                                                                                                                                              On this page
                                                                                                                                                                                                                                                                                                              404

                                                                                                                                                                                                                                                                                                              Page not found

                                                                                                                                                                                                                                                                                                              Showing closest match