Try Flyte 2 locally with the devbox
Get started
Flyte OSS Docs logo
Flyte OSS Docs
v2
v1
Signup
Flyte OSS Docs logo
Flyte OSS Docs
  • User guide
    • Get started
      • Quickstart
      • Core concepts
        • TaskEnvironment
        • Tasks
        • Runs and actions
        • Where your data lives
        • Apps
        • Projects and domains
        • Key capabilities
        • Basic project
      • Run modes
        • Run locally in Python
        • Run on the Devbox
        • Run on a remote cluster
    • Tasks
      • Configure tasks
        • Container images
        • Resources
        • Secrets
        • Caching
        • Reusable containers
        • Pod templates
        • Multiple environments
        • Clustered task environment
        • Retries and timeouts
        • Triggers
        • Interruptible tasks
        • Task plugins
        • Additional task settings
        • Logging
        • Overrides
      • Build tasks
        • Files and directories
        • Data classes and structures
        • DataFrames
        • Custom types
        • Custom context
        • Abort and cancel actions
        • Raw Container Tasks
        • Links
        • Reports
        • Notebooks
        • Remote tasks
        • Error handling
        • Traces
        • Intra-task checkpoints
        • Grouping actions
        • Fanout
        • Mapping over inputs
        • Consuming a message queue
        • Controlling parallel execution
        • Streaming map-reduce
        • Structured concurrency with anyio
        • Task dependencies and ordering
        • External conditions
        • Unit Testing Tasks
        • Higher-order functions
        • Other features
      • Run and deploy tasks
        • How task run works
        • Interact with runs and actions
        • View logs
        • Work with local data
        • Run command options
        • Build a custom CLI
        • How task deployment works
        • Deploy command options
        • Packaging
        • Deployment patterns
        • Run context
        • Entrypoint tasks
        • Run a Python script
        • Run with notifications
        • Rerun a run
        • Recover a failed run
    • Apps
      • Configure apps
        • App environments
        • Including additional files
        • Passing parameters into app environments
        • Autoscaling apps
        • Apps depending on other environments
      • Build apps
        • Single-script apps
        • Multi-script apps
        • Serving graphs
        • Hybrid app-task graphs
        • WebSocket apps
        • Browser apps
        • Secret-based authentication
      • Native app integrations
        • Streamlit app
        • FastAPI app
        • vLLM app
        • SGLang app
        • Ollama app
        • Flyte webhook
      • Serve and deploy apps
        • How app serving works
        • How app custom domains work
        • How app deployment works
        • Activating and deactivating apps
        • Prefetching models
    • Agents
      • Build an agent
        • Pure Python agents
        • Flyte-native agents
        • Bring your own framework
        • Agent memory
        • Agent chat UI
        • Deploy an agent as a service
      • Build an MCP
        • User-defined MCP server
        • Flyte MCP server
      • Sandboxing
        • Workflow sandboxing
        • Programmatic tool calling for agents
        • Code sandboxing
    • Project patterns
      • Bring your own image (BYOI)
      • Monorepo with uv
      • CI/CD deployments
    • Scale your runs
      • Data flow
      • Life of a run
      • Scale your workflows
      • Batch inference
    • Advanced project
      • Resilient generation
      • Agentic refinement
      • Parallel outputs
      • Serving app
    • Migration
      • From Flyte 1 to 2
        • Migration Overview
        • Tasks and workflows
        • Task configuration
        • CLI and configuration
        • Control flow
        • Parallelism and fan-out
        • Data types and I/O
        • ML workloads
        • New in Flyte 2
        • Hybrid v1 and v2 pipelines
        • Gotchas and caveats
      • From Airflow to Flyte
        • Part 1: vanilla operators
      • From Slurm to Flyte
  • Tutorials
    • Biotech & healthcare
      • Genomic alignment
        • Brain tumor MRI classification
          • Cross-species gene comparison
            • Genomic variant effect prediction
              • Drug molecule screening agent
              • Geospatial
                • GPU-accelerated climate modeling
                • Financial services & fintech
                  • Multi-agent trading simulation
                    • Fraud detection with Feast
                      • Financial research agent
                      • Frontier AI
                        • Distributed LLM pretraining
                        • Computer vision
                          • Fine-tuning a VLM
                            • Multimodal retrieval evaluation
                              • RT-DETR object detection
                              • Agents
                                • Autoresearch agent
                                  • Parallelized autoresearch agent
                                    • AutoSec researcher agent
                                      • Coding agent
                                        • Competitive intelligence agent
                                          • Deep research
                                            • LangGraph research agent
                                              • MLE bot
                                                • Compliance monitoring agent
                                                  • Field data enrichment agent
                                                    • Support resolution agent
                                                      • Code mode analytics agent
                                                      • Context engineering
                                                        • Text-to-SQL prompt optimization
                                                          • Automatic prompt engineering
                                                          • Model training
                                                            • LLM fine-tuning with LoRA and QLoRA
                                                              • BERT emotion classification
                                                                • Hyperparameter optimization
                                                              • Reference
                                                                • Flyte CLI
                                                                • Flyte SDK
                                                                  • flyte
                                                                    • AppHandle
                                                                    • AsyncFunctionTaskTemplate
                                                                    • Backoff
                                                                    • BaseCheckpoint
                                                                    • Cache
                                                                    • CachePolicy
                                                                    • Checkpoint
                                                                    • ConditionWebhook
                                                                    • Cron
                                                                    • Device
                                                                    • Environment
                                                                    • FixedRate
                                                                    • Image
                                                                    • ImageBuild
                                                                    • Link
                                                                    • OnArtifact
                                                                    • PodTemplate
                                                                    • Resources
                                                                    • RetryStrategy
                                                                    • ReusePolicy
                                                                    • Secret
                                                                    • TaskEnvironment
                                                                    • TaskTemplate
                                                                    • Timeout
                                                                    • Trigger
                                                                  • flyte.ai.agents
                                                                    • AccessDenied
                                                                    • Agent
                                                                    • AgentEvent
                                                                    • AgentProtocol
                                                                    • AgentResult
                                                                    • AgentTool
                                                                    • ConcurrencyError
                                                                    • LLMMessage
                                                                    • MCPServerSpec
                                                                    • MemoryMeta
                                                                    • MemoryStore
                                                                    • MemoryStoreError
                                                                    • ToolFn
                                                                  • flyte.ai.agents.agent
                                                                    • Agent
                                                                    • AgentEvent
                                                                  • flyte.ai.agents.memory
                                                                    • AccessDenied
                                                                    • ConcurrencyError
                                                                    • MemoryMeta
                                                                    • MemoryStore
                                                                    • MemoryStoreError
                                                                  • flyte.ai.agents.protocol
                                                                    • AgentProtocol
                                                                    • AgentResult
                                                                  • flyte.ai.chat
                                                                    • AgentChatAppEnvironment
                                                                    • CustomTheme
                                                                  • flyte.ai.chat.app
                                                                    • AgentChatAppEnvironment
                                                                    • CustomTheme
                                                                  • flyte.ai.mcp
                                                                    • FlyteMCPAppEnvironment
                                                                    • MCPAppEnvironment
                                                                  • flyte.app
                                                                    • AppEndpoint
                                                                    • AppEnvironment
                                                                    • ArtifactValue
                                                                    • ConnectorEnvironment
                                                                    • DeployedAppEnvironment
                                                                    • Domain
                                                                    • Link
                                                                    • Parameter
                                                                    • Port
                                                                    • RunOutput
                                                                    • Scaling
                                                                    • Subdomain
                                                                    • Timeouts
                                                                  • flyte.app.extras
                                                                    • FastAPIAppEnvironment
                                                                    • FastAPIPassthroughAuthMiddleware
                                                                    • FlyteWebhookAppEnvironment
                                                                  • flyte.artifacts
                                                                    • Artifact
                                                                    • Card
                                                                    • Metadata
                                                                  • flyte.clustered
                                                                    • ClusteredTaskEnvironment
                                                                    • ClusteredTaskTemplate
                                                                    • ClusterFailurePolicy
                                                                    • TorchRun
                                                                  • flyte.config
                                                                    • Config
                                                                  • flyte.connectors
                                                                    • AsyncConnector
                                                                    • AsyncConnectorExecutorMixin
                                                                    • ConnectorRegistry
                                                                    • ConnectorService
                                                                    • Resource
                                                                    • ResourceMeta
                                                                  • flyte.connectors.utils
                                                                    • flyte.durable
                                                                      • flyte.errors
                                                                        • ActionAbortedError
                                                                        • ActionNotFoundError
                                                                        • BaseRuntimeError
                                                                        • CodeBundleError
                                                                        • ConditionAlreadyExistsError
                                                                        • ConditionFailedError
                                                                        • ConditionNotFoundError
                                                                        • ConditionTimedoutError
                                                                        • CustomError
                                                                        • DeploymentError
                                                                        • ImageBuildError
                                                                        • ImagePullBackOffError
                                                                        • InitializationError
                                                                        • InlineIOMaxBytesBreached
                                                                        • InvalidImageNameError
                                                                        • InvalidPackageError
                                                                        • LogsNotYetAvailableError
                                                                        • ModuleLoadError
                                                                        • NonRecoverableError
                                                                        • NotInTaskContextError
                                                                        • OnlyAsyncIOSupportedError
                                                                        • OOMError
                                                                        • ParameterMaterializationError
                                                                        • PrimaryContainerNotFoundError
                                                                        • RemoteTaskNotFoundError
                                                                        • RemoteTaskUsageError
                                                                        • ResourceExhaustedError
                                                                        • RestrictedTypeError
                                                                        • RetriesExhaustedError
                                                                        • RuntimeDataValidationError
                                                                        • RuntimeSystemError
                                                                        • RuntimeUnknownError
                                                                        • RuntimeUserError
                                                                        • SlowDownError
                                                                        • SyncTaskCallInAsyncContextError
                                                                        • TaskInterruptedError
                                                                        • TaskTimeoutError
                                                                        • TraceDoesNotAllowNestedTasksError
                                                                        • UnionRpcError
                                                                      • flyte.extend
                                                                        • AsyncFunctionTaskTemplate
                                                                        • ImageBuildEngine
                                                                        • ImageBuilder
                                                                        • ImageChecker
                                                                        • TaskTemplate
                                                                      • flyte.extras
                                                                        • BatchStats
                                                                        • ContainerTask
                                                                        • CostEstimator
                                                                        • DynamicBatcher
                                                                        • Prompt
                                                                        • Sleep
                                                                        • SleepTask
                                                                        • TokenBatcher
                                                                        • TokenEstimator
                                                                      • flyte.extras.shell
                                                                        • FlagSpec
                                                                        • Glob
                                                                        • Stderr
                                                                        • Stdout
                                                                      • flyte.extras.webhooks
                                                                        • EventType
                                                                        • Provider
                                                                        • RunOnceResult
                                                                        • SignatureError
                                                                        • WebhookAppEnvironment
                                                                        • WebhookEvent
                                                                        • WebhookPluginError
                                                                      • flyte.extras.webhooks.testing
                                                                        • ProviderFactory
                                                                      • flyte.git
                                                                        • GitStatus
                                                                      • flyte.io
                                                                        • DataFrame
                                                                        • Dir
                                                                        • EmptyDir
                                                                        • File
                                                                        • HashFunction
                                                                      • flyte.io.extend
                                                                        • DataFrameDecoder
                                                                        • DataFrameEncoder
                                                                        • DataFrameTransformerEngine
                                                                      • flyte.models
                                                                        • ActionID
                                                                        • ActionPhase
                                                                        • CheckpointPaths
                                                                        • CodeBundle
                                                                        • GroupData
                                                                        • NativeInterface
                                                                        • PathRewrite
                                                                        • RawDataPath
                                                                        • SerializationContext
                                                                        • TaskContext
                                                                      • flyte.notify
                                                                        • Email
                                                                        • NamedDelivery
                                                                        • NamedRule
                                                                        • Notification
                                                                        • Slack
                                                                        • Teams
                                                                        • Webhook
                                                                      • flyte.prefetch
                                                                        • HuggingFaceModelInfo
                                                                        • ShardConfig
                                                                        • StoredModelInfo
                                                                        • VLLMShardArgs
                                                                      • flyte.remote
                                                                        • Action
                                                                        • ActionDetails
                                                                        • ActionInputs
                                                                        • ActionOutputs
                                                                        • App
                                                                        • Artifact
                                                                        • Condition
                                                                        • Project
                                                                        • Run
                                                                        • RunDetails
                                                                        • Secret
                                                                        • Settings
                                                                        • Task
                                                                        • TaskDetails
                                                                        • TimeFilter
                                                                        • Trigger
                                                                        • TriggerDetails
                                                                        • User
                                                                      • flyte.report
                                                                        • Report
                                                                        • Timeline
                                                                      • flyte.sandbox
                                                                        • CodeTaskTemplate
                                                                        • ImageConfig
                                                                        • SandboxedConfig
                                                                        • SandboxedTaskTemplate
                                                                      • flyte.storage
                                                                        • ABFS
                                                                        • GCS
                                                                        • S3
                                                                        • Storage
                                                                      • flyte.syncify
                                                                        • Syncify
                                                                      • flyte.types
                                                                        • FlytePickle
                                                                        • Renderable
                                                                        • TypeEngine
                                                                        • TypeTransformer
                                                                        • TypeTransformerFailedError
                                                                    • Flyte agent plugins
                                                                    • Integrations
                                                                      • Agent frameworks
                                                                        • Claude Agent SDK
                                                                          • Core
                                                                            • ReportTimeline
                                                                            • ToolTaskResolver
                                                                          • CrewAI
                                                                            • Deep Agents
                                                                              • DurableChatModel
                                                                            • Google ADK
                                                                              • FlyteLlm
                                                                            • Hermes
                                                                              • LangChain
                                                                                • LangGraph
                                                                                  • Mistral
                                                                                    • OpenAI Agents SDK
                                                                                      • FlyteModel
                                                                                      • FlyteModelProvider
                                                                                      • FlyteSession
                                                                                      • FlyteTracingProcessor
                                                                                      • FunctionTool
                                                                                    • Pydantic AI
                                                                                      • FlyteModel
                                                                                  • Anthropic
                                                                                    • Agent
                                                                                  • BigQuery
                                                                                    • BigQueryConfig
                                                                                    • BigQueryConnector
                                                                                    • BigQueryTask
                                                                                  • Code generation
                                                                                    • AutoCoderAgent
                                                                                    • CodeGenEvalResult
                                                                                    • CodePlan
                                                                                    • CodeSolution
                                                                                    • ErrorDiagnosis
                                                                                    • ImageConfig
                                                                                  • Dask
                                                                                    • Dask
                                                                                    • Scheduler
                                                                                    • WorkerGroup
                                                                                  • Databricks
                                                                                    • Databricks
                                                                                    • DatabricksConnector
                                                                                  • Gemini
                                                                                    • Agent
                                                                                  • Hugging Face
                                                                                    • HFSource
                                                                                  • Hydra
                                                                                    • JSONL
                                                                                      • JsonlDir
                                                                                      • JsonlFile
                                                                                    • MLflow
                                                                                      • Mlflow
                                                                                    • OmegaConf
                                                                                      • OpenAI
                                                                                        • Papermill
                                                                                          • NotebookTask
                                                                                        • Polars
                                                                                          • ParquetToPolarsDecodingHandler
                                                                                          • ParquetToPolarsLazyFrameDecodingHandler
                                                                                          • PolarsLazyFrameToParquetEncodingHandler
                                                                                          • PolarsToParquetEncodingHandler
                                                                                        • PyTorch
                                                                                          • Elastic
                                                                                        • Ray
                                                                                          • AutoscalerOptionsConfig
                                                                                          • HeadNodeConfig
                                                                                          • RayJobConfig
                                                                                          • WorkerNodeConfig
                                                                                        • SGLang
                                                                                          • SGLangAppEnvironment
                                                                                        • Snowflake
                                                                                          • Snowflake
                                                                                          • SnowflakeConfig
                                                                                          • SnowflakeConnector
                                                                                        • Spark
                                                                                          • ParquetToSparkDecoder
                                                                                          • Spark
                                                                                          • SparkToParquetEncoder
                                                                                        • vLLM
                                                                                          • VLLMAppEnvironment
                                                                                        • Weights & Biases
                                                                                          • Wandb
                                                                                          • WandbSweep
                                                                                      • LLM-optimized documentation
                                                                                    • Integrations
                                                                                      • Agent frameworks
                                                                                        • How it works
                                                                                        • OpenAI
                                                                                        • Claude
                                                                                        • Google ADK
                                                                                        • Mistral
                                                                                        • LangChain
                                                                                        • LangGraph
                                                                                        • Deep Agents
                                                                                        • CrewAI
                                                                                        • Pydantic AI
                                                                                        • Hermes
                                                                                      • BigQuery
                                                                                        • Code generation
                                                                                          • Dask
                                                                                            • Databricks
                                                                                              • Grafana Agent Observability
                                                                                                • Hugging Face
                                                                                                  • Hydra
                                                                                                    • JSONL
                                                                                                      • Lance
                                                                                                        • MLflow
                                                                                                          • OmegaConf
                                                                                                            • OpenTelemetry
                                                                                                              • Exporters and configuration
                                                                                                              • Traces across crashes and resumes
                                                                                                            • Pandera
                                                                                                              • Papermill
                                                                                                                • Polars
                                                                                                                  • PyTorch
                                                                                                                    • Ray
                                                                                                                      • Snowflake
                                                                                                                        • Spark
                                                                                                                          • Weights & Biases
                                                                                                                            • Experiments
                                                                                                                            • Distributed training
                                                                                                                            • Sweeps
                                                                                                                            • Downloading logs
                                                                                                                            • Constraints and best practices
                                                                                                                            • Manual integration
                                                                                                                        • Platform deployment
                                                                                                                          • Deployment overview
                                                                                                                          • Kind deployment
                                                                                                                            • Set up local OIDC provider
                                                                                                                            • Set up external OIDC provider
                                                                                                                          • AWS deployment
                                                                                                                          • Authentication and SSO
                                                                                                                          • Enable app serving
                                                                                                                          • Plugin setup
                                                                                                                            • Flyte copilot storage configuration
                                                                                                                        • Community
                                                                                                                          • Joining the community
                                                                                                                          • Contributing code
                                                                                                                          • Contributing docs and examples
                                                                                                                            • Set up a local docs dev environment
                                                                                                                            • Authoring
                                                                                                                            • Submit a contribution
                                                                                                                            • Writing guidelines
                                                                                                                            • Variants
                                                                                                                            • Versions
                                                                                                                            • Shortcodes
                                                                                                                            • API docs
                                                                                                                            • LLM-optimized documentation
                                                                                                                            • Redirects
                                                                                                                            • Production builds and troubleshooting
                                                                                                                        Documentation navigation for Flyte including user guides, tutorials, API references, and integration examples
                                                                                                                        • User guide
                                                                                                                          • Get started
                                                                                                                            • Quickstart
                                                                                                                            • Core concepts
                                                                                                                              • TaskEnvironment
                                                                                                                              • Tasks
                                                                                                                              • Runs and actions
                                                                                                                              • Where your data lives
                                                                                                                              • Apps
                                                                                                                              • Projects and domains
                                                                                                                              • Key capabilities
                                                                                                                              • Basic project
                                                                                                                            • Run modes
                                                                                                                              • Run locally in Python
                                                                                                                              • Run on the Devbox
                                                                                                                              • Run on a remote cluster
                                                                                                                          • Tasks
                                                                                                                            • Configure tasks
                                                                                                                              • Container images
                                                                                                                              • Resources
                                                                                                                              • Secrets
                                                                                                                              • Caching
                                                                                                                              • Reusable containers
                                                                                                                              • Pod templates
                                                                                                                              • Multiple environments
                                                                                                                              • Clustered task environment
                                                                                                                              • Retries and timeouts
                                                                                                                              • Triggers
                                                                                                                              • Interruptible tasks
                                                                                                                              • Task plugins
                                                                                                                              • Additional task settings
                                                                                                                              • Logging
                                                                                                                              • Overrides
                                                                                                                            • Build tasks
                                                                                                                              • Files and directories
                                                                                                                              • Data classes and structures
                                                                                                                              • DataFrames
                                                                                                                              • Custom types
                                                                                                                              • Custom context
                                                                                                                              • Abort and cancel actions
                                                                                                                              • Raw Container Tasks
                                                                                                                              • Links
                                                                                                                              • Reports
                                                                                                                              • Notebooks
                                                                                                                              • Remote tasks
                                                                                                                              • Error handling
                                                                                                                              • Traces
                                                                                                                              • Intra-task checkpoints
                                                                                                                              • Grouping actions
                                                                                                                              • Fanout
                                                                                                                              • Mapping over inputs
                                                                                                                              • Consuming a message queue
                                                                                                                              • Controlling parallel execution
                                                                                                                              • Streaming map-reduce
                                                                                                                              • Structured concurrency with anyio
                                                                                                                              • Task dependencies and ordering
                                                                                                                              • External conditions
                                                                                                                              • Unit Testing Tasks
                                                                                                                              • Higher-order functions
                                                                                                                              • Other features
                                                                                                                            • Run and deploy tasks
                                                                                                                              • How task run works
                                                                                                                              • Interact with runs and actions
                                                                                                                              • View logs
                                                                                                                              • Work with local data
                                                                                                                              • Run command options
                                                                                                                              • Build a custom CLI
                                                                                                                              • How task deployment works
                                                                                                                              • Deploy command options
                                                                                                                              • Packaging
                                                                                                                              • Deployment patterns
                                                                                                                              • Run context
                                                                                                                              • Entrypoint tasks
                                                                                                                              • Run a Python script
                                                                                                                              • Run with notifications
                                                                                                                              • Rerun a run
                                                                                                                              • Recover a failed run
                                                                                                                          • Apps
                                                                                                                            • Configure apps
                                                                                                                              • App environments
                                                                                                                              • Including additional files
                                                                                                                              • Passing parameters into app environments
                                                                                                                              • Autoscaling apps
                                                                                                                              • Apps depending on other environments
                                                                                                                            • Build apps
                                                                                                                              • Single-script apps
                                                                                                                              • Multi-script apps
                                                                                                                              • Serving graphs
                                                                                                                              • Hybrid app-task graphs
                                                                                                                              • WebSocket apps
                                                                                                                              • Browser apps
                                                                                                                              • Secret-based authentication
                                                                                                                            • Native app integrations
                                                                                                                              • Streamlit app
                                                                                                                              • FastAPI app
                                                                                                                              • vLLM app
                                                                                                                              • SGLang app
                                                                                                                              • Ollama app
                                                                                                                              • Flyte webhook
                                                                                                                            • Serve and deploy apps
                                                                                                                              • How app serving works
                                                                                                                              • How app custom domains work
                                                                                                                              • How app deployment works
                                                                                                                              • Activating and deactivating apps
                                                                                                                              • Prefetching models
                                                                                                                          • Agents
                                                                                                                            • Build an agent
                                                                                                                              • Pure Python agents
                                                                                                                              • Flyte-native agents
                                                                                                                              • Bring your own framework
                                                                                                                              • Agent memory
                                                                                                                              • Agent chat UI
                                                                                                                              • Deploy an agent as a service
                                                                                                                            • Build an MCP
                                                                                                                              • User-defined MCP server
                                                                                                                              • Flyte MCP server
                                                                                                                            • Sandboxing
                                                                                                                              • Workflow sandboxing
                                                                                                                              • Programmatic tool calling for agents
                                                                                                                              • Code sandboxing
                                                                                                                          • Project patterns
                                                                                                                            • Bring your own image (BYOI)
                                                                                                                            • Monorepo with uv
                                                                                                                            • CI/CD deployments
                                                                                                                          • Scale your runs
                                                                                                                            • Data flow
                                                                                                                            • Life of a run
                                                                                                                            • Scale your workflows
                                                                                                                            • Batch inference
                                                                                                                          • Advanced project
                                                                                                                            • Resilient generation
                                                                                                                            • Agentic refinement
                                                                                                                            • Parallel outputs
                                                                                                                            • Serving app
                                                                                                                          • Migration
                                                                                                                            • From Flyte 1 to 2
                                                                                                                              • Migration Overview
                                                                                                                              • Tasks and workflows
                                                                                                                              • Task configuration
                                                                                                                              • CLI and configuration
                                                                                                                              • Control flow
                                                                                                                              • Parallelism and fan-out
                                                                                                                              • Data types and I/O
                                                                                                                              • ML workloads
                                                                                                                              • New in Flyte 2
                                                                                                                              • Hybrid v1 and v2 pipelines
                                                                                                                              • Gotchas and caveats
                                                                                                                            • From Airflow to Flyte
                                                                                                                              • Part 1: vanilla operators
                                                                                                                            • From Slurm to Flyte
                                                                                                                        • Tutorials
                                                                                                                          • Biotech & healthcare
                                                                                                                            • Genomic alignment
                                                                                                                              • Brain tumor MRI classification
                                                                                                                                • Cross-species gene comparison
                                                                                                                                  • Genomic variant effect prediction
                                                                                                                                    • Drug molecule screening agent
                                                                                                                                    • Geospatial
                                                                                                                                      • GPU-accelerated climate modeling
                                                                                                                                      • Financial services & fintech
                                                                                                                                        • Multi-agent trading simulation
                                                                                                                                          • Fraud detection with Feast
                                                                                                                                            • Financial research agent
                                                                                                                                            • Frontier AI
                                                                                                                                              • Distributed LLM pretraining
                                                                                                                                              • Computer vision
                                                                                                                                                • Fine-tuning a VLM
                                                                                                                                                  • Multimodal retrieval evaluation
                                                                                                                                                    • RT-DETR object detection
                                                                                                                                                    • Agents
                                                                                                                                                      • Autoresearch agent
                                                                                                                                                        • Parallelized autoresearch agent
                                                                                                                                                          • AutoSec researcher agent
                                                                                                                                                            • Coding agent
                                                                                                                                                              • Competitive intelligence agent
                                                                                                                                                                • Deep research
                                                                                                                                                                  • LangGraph research agent
                                                                                                                                                                    • MLE bot
                                                                                                                                                                      • Compliance monitoring agent
                                                                                                                                                                        • Field data enrichment agent
                                                                                                                                                                          • Support resolution agent
                                                                                                                                                                            • Code mode analytics agent
                                                                                                                                                                            • Context engineering
                                                                                                                                                                              • Text-to-SQL prompt optimization
                                                                                                                                                                                • Automatic prompt engineering
                                                                                                                                                                                • Model training
                                                                                                                                                                                  • LLM fine-tuning with LoRA and QLoRA
                                                                                                                                                                                    • BERT emotion classification
                                                                                                                                                                                      • Hyperparameter optimization
                                                                                                                                                                                    • Reference
                                                                                                                                                                                      • Flyte CLI
                                                                                                                                                                                      • Flyte SDK
                                                                                                                                                                                        • flyte
                                                                                                                                                                                          • AppHandle
                                                                                                                                                                                          • AsyncFunctionTaskTemplate
                                                                                                                                                                                          • Backoff
                                                                                                                                                                                          • BaseCheckpoint
                                                                                                                                                                                          • Cache
                                                                                                                                                                                          • CachePolicy
                                                                                                                                                                                          • Checkpoint
                                                                                                                                                                                          • ConditionWebhook
                                                                                                                                                                                          • Cron
                                                                                                                                                                                          • Device
                                                                                                                                                                                          • Environment
                                                                                                                                                                                          • FixedRate
                                                                                                                                                                                          • Image
                                                                                                                                                                                          • ImageBuild
                                                                                                                                                                                          • Link
                                                                                                                                                                                          • OnArtifact
                                                                                                                                                                                          • PodTemplate
                                                                                                                                                                                          • Resources
                                                                                                                                                                                          • RetryStrategy
                                                                                                                                                                                          • ReusePolicy
                                                                                                                                                                                          • Secret
                                                                                                                                                                                          • TaskEnvironment
                                                                                                                                                                                          • TaskTemplate
                                                                                                                                                                                          • Timeout
                                                                                                                                                                                          • Trigger
                                                                                                                                                                                        • flyte.ai.agents
                                                                                                                                                                                          • AccessDenied
                                                                                                                                                                                          • Agent
                                                                                                                                                                                          • AgentEvent
                                                                                                                                                                                          • AgentProtocol
                                                                                                                                                                                          • AgentResult
                                                                                                                                                                                          • AgentTool
                                                                                                                                                                                          • ConcurrencyError
                                                                                                                                                                                          • LLMMessage
                                                                                                                                                                                          • MCPServerSpec
                                                                                                                                                                                          • MemoryMeta
                                                                                                                                                                                          • MemoryStore
                                                                                                                                                                                          • MemoryStoreError
                                                                                                                                                                                          • ToolFn
                                                                                                                                                                                        • flyte.ai.agents.agent
                                                                                                                                                                                          • Agent
                                                                                                                                                                                          • AgentEvent
                                                                                                                                                                                        • flyte.ai.agents.memory
                                                                                                                                                                                          • AccessDenied
                                                                                                                                                                                          • ConcurrencyError
                                                                                                                                                                                          • MemoryMeta
                                                                                                                                                                                          • MemoryStore
                                                                                                                                                                                          • MemoryStoreError
                                                                                                                                                                                        • flyte.ai.agents.protocol
                                                                                                                                                                                          • AgentProtocol
                                                                                                                                                                                          • AgentResult
                                                                                                                                                                                        • flyte.ai.chat
                                                                                                                                                                                          • AgentChatAppEnvironment
                                                                                                                                                                                          • CustomTheme
                                                                                                                                                                                        • flyte.ai.chat.app
                                                                                                                                                                                          • AgentChatAppEnvironment
                                                                                                                                                                                          • CustomTheme
                                                                                                                                                                                        • flyte.ai.mcp
                                                                                                                                                                                          • FlyteMCPAppEnvironment
                                                                                                                                                                                          • MCPAppEnvironment
                                                                                                                                                                                        • flyte.app
                                                                                                                                                                                          • AppEndpoint
                                                                                                                                                                                          • AppEnvironment
                                                                                                                                                                                          • ArtifactValue
                                                                                                                                                                                          • ConnectorEnvironment
                                                                                                                                                                                          • DeployedAppEnvironment
                                                                                                                                                                                          • Domain
                                                                                                                                                                                          • Link
                                                                                                                                                                                          • Parameter
                                                                                                                                                                                          • Port
                                                                                                                                                                                          • RunOutput
                                                                                                                                                                                          • Scaling
                                                                                                                                                                                          • Subdomain
                                                                                                                                                                                          • Timeouts
                                                                                                                                                                                        • flyte.app.extras
                                                                                                                                                                                          • FastAPIAppEnvironment
                                                                                                                                                                                          • FastAPIPassthroughAuthMiddleware
                                                                                                                                                                                          • FlyteWebhookAppEnvironment
                                                                                                                                                                                        • flyte.artifacts
                                                                                                                                                                                          • Artifact
                                                                                                                                                                                          • Card
                                                                                                                                                                                          • Metadata
                                                                                                                                                                                        • flyte.clustered
                                                                                                                                                                                          • ClusteredTaskEnvironment
                                                                                                                                                                                          • ClusteredTaskTemplate
                                                                                                                                                                                          • ClusterFailurePolicy
                                                                                                                                                                                          • TorchRun
                                                                                                                                                                                        • flyte.config
                                                                                                                                                                                          • Config
                                                                                                                                                                                        • flyte.connectors
                                                                                                                                                                                          • AsyncConnector
                                                                                                                                                                                          • AsyncConnectorExecutorMixin
                                                                                                                                                                                          • ConnectorRegistry
                                                                                                                                                                                          • ConnectorService
                                                                                                                                                                                          • Resource
                                                                                                                                                                                          • ResourceMeta
                                                                                                                                                                                        • flyte.connectors.utils
                                                                                                                                                                                          • flyte.durable
                                                                                                                                                                                            • flyte.errors
                                                                                                                                                                                              • ActionAbortedError
                                                                                                                                                                                              • ActionNotFoundError
                                                                                                                                                                                              • BaseRuntimeError
                                                                                                                                                                                              • CodeBundleError
                                                                                                                                                                                              • ConditionAlreadyExistsError
                                                                                                                                                                                              • ConditionFailedError
                                                                                                                                                                                              • ConditionNotFoundError
                                                                                                                                                                                              • ConditionTimedoutError
                                                                                                                                                                                              • CustomError
                                                                                                                                                                                              • DeploymentError
                                                                                                                                                                                              • ImageBuildError
                                                                                                                                                                                              • ImagePullBackOffError
                                                                                                                                                                                              • InitializationError
                                                                                                                                                                                              • InlineIOMaxBytesBreached
                                                                                                                                                                                              • InvalidImageNameError
                                                                                                                                                                                              • InvalidPackageError
                                                                                                                                                                                              • LogsNotYetAvailableError
                                                                                                                                                                                              • ModuleLoadError
                                                                                                                                                                                              • NonRecoverableError
                                                                                                                                                                                              • NotInTaskContextError
                                                                                                                                                                                              • OnlyAsyncIOSupportedError
                                                                                                                                                                                              • OOMError
                                                                                                                                                                                              • ParameterMaterializationError
                                                                                                                                                                                              • PrimaryContainerNotFoundError
                                                                                                                                                                                              • RemoteTaskNotFoundError
                                                                                                                                                                                              • RemoteTaskUsageError
                                                                                                                                                                                              • ResourceExhaustedError
                                                                                                                                                                                              • RestrictedTypeError
                                                                                                                                                                                              • RetriesExhaustedError
                                                                                                                                                                                              • RuntimeDataValidationError
                                                                                                                                                                                              • RuntimeSystemError
                                                                                                                                                                                              • RuntimeUnknownError
                                                                                                                                                                                              • RuntimeUserError
                                                                                                                                                                                              • SlowDownError
                                                                                                                                                                                              • SyncTaskCallInAsyncContextError
                                                                                                                                                                                              • TaskInterruptedError
                                                                                                                                                                                              • TaskTimeoutError
                                                                                                                                                                                              • TraceDoesNotAllowNestedTasksError
                                                                                                                                                                                              • UnionRpcError
                                                                                                                                                                                            • flyte.extend
                                                                                                                                                                                              • AsyncFunctionTaskTemplate
                                                                                                                                                                                              • ImageBuildEngine
                                                                                                                                                                                              • ImageBuilder
                                                                                                                                                                                              • ImageChecker
                                                                                                                                                                                              • TaskTemplate
                                                                                                                                                                                            • flyte.extras
                                                                                                                                                                                              • BatchStats
                                                                                                                                                                                              • ContainerTask
                                                                                                                                                                                              • CostEstimator
                                                                                                                                                                                              • DynamicBatcher
                                                                                                                                                                                              • Prompt
                                                                                                                                                                                              • Sleep
                                                                                                                                                                                              • SleepTask
                                                                                                                                                                                              • TokenBatcher
                                                                                                                                                                                              • TokenEstimator
                                                                                                                                                                                            • flyte.extras.shell
                                                                                                                                                                                              • FlagSpec
                                                                                                                                                                                              • Glob
                                                                                                                                                                                              • Stderr
                                                                                                                                                                                              • Stdout
                                                                                                                                                                                            • flyte.extras.webhooks
                                                                                                                                                                                              • EventType
                                                                                                                                                                                              • Provider
                                                                                                                                                                                              • RunOnceResult
                                                                                                                                                                                              • SignatureError
                                                                                                                                                                                              • WebhookAppEnvironment
                                                                                                                                                                                              • WebhookEvent
                                                                                                                                                                                              • WebhookPluginError
                                                                                                                                                                                            • flyte.extras.webhooks.testing
                                                                                                                                                                                              • ProviderFactory
                                                                                                                                                                                            • flyte.git
                                                                                                                                                                                              • GitStatus
                                                                                                                                                                                            • flyte.io
                                                                                                                                                                                              • DataFrame
                                                                                                                                                                                              • Dir
                                                                                                                                                                                              • EmptyDir
                                                                                                                                                                                              • File
                                                                                                                                                                                              • HashFunction
                                                                                                                                                                                            • flyte.io.extend
                                                                                                                                                                                              • DataFrameDecoder
                                                                                                                                                                                              • DataFrameEncoder
                                                                                                                                                                                              • DataFrameTransformerEngine
                                                                                                                                                                                            • flyte.models
                                                                                                                                                                                              • ActionID
                                                                                                                                                                                              • ActionPhase
                                                                                                                                                                                              • CheckpointPaths
                                                                                                                                                                                              • CodeBundle
                                                                                                                                                                                              • GroupData
                                                                                                                                                                                              • NativeInterface
                                                                                                                                                                                              • PathRewrite
                                                                                                                                                                                              • RawDataPath
                                                                                                                                                                                              • SerializationContext
                                                                                                                                                                                              • TaskContext
                                                                                                                                                                                            • flyte.notify
                                                                                                                                                                                              • Email
                                                                                                                                                                                              • NamedDelivery
                                                                                                                                                                                              • NamedRule
                                                                                                                                                                                              • Notification
                                                                                                                                                                                              • Slack
                                                                                                                                                                                              • Teams
                                                                                                                                                                                              • Webhook
                                                                                                                                                                                            • flyte.prefetch
                                                                                                                                                                                              • HuggingFaceModelInfo
                                                                                                                                                                                              • ShardConfig
                                                                                                                                                                                              • StoredModelInfo
                                                                                                                                                                                              • VLLMShardArgs
                                                                                                                                                                                            • flyte.remote
                                                                                                                                                                                              • Action
                                                                                                                                                                                              • ActionDetails
                                                                                                                                                                                              • ActionInputs
                                                                                                                                                                                              • ActionOutputs
                                                                                                                                                                                              • App
                                                                                                                                                                                              • Artifact
                                                                                                                                                                                              • Condition
                                                                                                                                                                                              • Project
                                                                                                                                                                                              • Run
                                                                                                                                                                                              • RunDetails
                                                                                                                                                                                              • Secret
                                                                                                                                                                                              • Settings
                                                                                                                                                                                              • Task
                                                                                                                                                                                              • TaskDetails
                                                                                                                                                                                              • TimeFilter
                                                                                                                                                                                              • Trigger
                                                                                                                                                                                              • TriggerDetails
                                                                                                                                                                                              • User
                                                                                                                                                                                            • flyte.report
                                                                                                                                                                                              • Report
                                                                                                                                                                                              • Timeline
                                                                                                                                                                                            • flyte.sandbox
                                                                                                                                                                                              • CodeTaskTemplate
                                                                                                                                                                                              • ImageConfig
                                                                                                                                                                                              • SandboxedConfig
                                                                                                                                                                                              • SandboxedTaskTemplate
                                                                                                                                                                                            • flyte.storage
                                                                                                                                                                                              • ABFS
                                                                                                                                                                                              • GCS
                                                                                                                                                                                              • S3
                                                                                                                                                                                              • Storage
                                                                                                                                                                                            • flyte.syncify
                                                                                                                                                                                              • Syncify
                                                                                                                                                                                            • flyte.types
                                                                                                                                                                                              • FlytePickle
                                                                                                                                                                                              • Renderable
                                                                                                                                                                                              • TypeEngine
                                                                                                                                                                                              • TypeTransformer
                                                                                                                                                                                              • TypeTransformerFailedError
                                                                                                                                                                                          • Flyte agent plugins
                                                                                                                                                                                          • Integrations
                                                                                                                                                                                            • Agent frameworks
                                                                                                                                                                                              • Claude Agent SDK
                                                                                                                                                                                                • Core
                                                                                                                                                                                                  • ReportTimeline
                                                                                                                                                                                                  • ToolTaskResolver
                                                                                                                                                                                                • CrewAI
                                                                                                                                                                                                  • Deep Agents
                                                                                                                                                                                                    • DurableChatModel
                                                                                                                                                                                                  • Google ADK
                                                                                                                                                                                                    • FlyteLlm
                                                                                                                                                                                                  • Hermes
                                                                                                                                                                                                    • LangChain
                                                                                                                                                                                                      • LangGraph
                                                                                                                                                                                                        • Mistral
                                                                                                                                                                                                          • OpenAI Agents SDK
                                                                                                                                                                                                            • FlyteModel
                                                                                                                                                                                                            • FlyteModelProvider
                                                                                                                                                                                                            • FlyteSession
                                                                                                                                                                                                            • FlyteTracingProcessor
                                                                                                                                                                                                            • FunctionTool
                                                                                                                                                                                                          • Pydantic AI
                                                                                                                                                                                                            • FlyteModel
                                                                                                                                                                                                        • Anthropic
                                                                                                                                                                                                          • Agent
                                                                                                                                                                                                        • BigQuery
                                                                                                                                                                                                          • BigQueryConfig
                                                                                                                                                                                                          • BigQueryConnector
                                                                                                                                                                                                          • BigQueryTask
                                                                                                                                                                                                        • Code generation
                                                                                                                                                                                                          • AutoCoderAgent
                                                                                                                                                                                                          • CodeGenEvalResult
                                                                                                                                                                                                          • CodePlan
                                                                                                                                                                                                          • CodeSolution
                                                                                                                                                                                                          • ErrorDiagnosis
                                                                                                                                                                                                          • ImageConfig
                                                                                                                                                                                                        • Dask
                                                                                                                                                                                                          • Dask
                                                                                                                                                                                                          • Scheduler
                                                                                                                                                                                                          • WorkerGroup
                                                                                                                                                                                                        • Databricks
                                                                                                                                                                                                          • Databricks
                                                                                                                                                                                                          • DatabricksConnector
                                                                                                                                                                                                        • Gemini
                                                                                                                                                                                                          • Agent
                                                                                                                                                                                                        • Hugging Face
                                                                                                                                                                                                          • HFSource
                                                                                                                                                                                                        • Hydra
                                                                                                                                                                                                          • JSONL
                                                                                                                                                                                                            • JsonlDir
                                                                                                                                                                                                            • JsonlFile
                                                                                                                                                                                                          • MLflow
                                                                                                                                                                                                            • Mlflow
                                                                                                                                                                                                          • OmegaConf
                                                                                                                                                                                                            • OpenAI
                                                                                                                                                                                                              • Papermill
                                                                                                                                                                                                                • NotebookTask
                                                                                                                                                                                                              • Polars
                                                                                                                                                                                                                • ParquetToPolarsDecodingHandler
                                                                                                                                                                                                                • ParquetToPolarsLazyFrameDecodingHandler
                                                                                                                                                                                                                • PolarsLazyFrameToParquetEncodingHandler
                                                                                                                                                                                                                • PolarsToParquetEncodingHandler
                                                                                                                                                                                                              • PyTorch
                                                                                                                                                                                                                • Elastic
                                                                                                                                                                                                              • Ray
                                                                                                                                                                                                                • AutoscalerOptionsConfig
                                                                                                                                                                                                                • HeadNodeConfig
                                                                                                                                                                                                                • RayJobConfig
                                                                                                                                                                                                                • WorkerNodeConfig
                                                                                                                                                                                                              • SGLang
                                                                                                                                                                                                                • SGLangAppEnvironment
                                                                                                                                                                                                              • Snowflake
                                                                                                                                                                                                                • Snowflake
                                                                                                                                                                                                                • SnowflakeConfig
                                                                                                                                                                                                                • SnowflakeConnector
                                                                                                                                                                                                              • Spark
                                                                                                                                                                                                                • ParquetToSparkDecoder
                                                                                                                                                                                                                • Spark
                                                                                                                                                                                                                • SparkToParquetEncoder
                                                                                                                                                                                                              • vLLM
                                                                                                                                                                                                                • VLLMAppEnvironment
                                                                                                                                                                                                              • Weights & Biases
                                                                                                                                                                                                                • Wandb
                                                                                                                                                                                                                • WandbSweep
                                                                                                                                                                                                            • LLM-optimized documentation
                                                                                                                                                                                                          • Integrations
                                                                                                                                                                                                            • Agent frameworks
                                                                                                                                                                                                              • How it works
                                                                                                                                                                                                              • OpenAI
                                                                                                                                                                                                              • Claude
                                                                                                                                                                                                              • Google ADK
                                                                                                                                                                                                              • Mistral
                                                                                                                                                                                                              • LangChain
                                                                                                                                                                                                              • LangGraph
                                                                                                                                                                                                              • Deep Agents
                                                                                                                                                                                                              • CrewAI
                                                                                                                                                                                                              • Pydantic AI
                                                                                                                                                                                                              • Hermes
                                                                                                                                                                                                            • BigQuery
                                                                                                                                                                                                              • Code generation
                                                                                                                                                                                                                • Dask
                                                                                                                                                                                                                  • Databricks
                                                                                                                                                                                                                    • Grafana Agent Observability
                                                                                                                                                                                                                      • Hugging Face
                                                                                                                                                                                                                        • Hydra
                                                                                                                                                                                                                          • JSONL
                                                                                                                                                                                                                            • Lance
                                                                                                                                                                                                                              • MLflow
                                                                                                                                                                                                                                • OmegaConf
                                                                                                                                                                                                                                  • OpenTelemetry
                                                                                                                                                                                                                                    • Exporters and configuration
                                                                                                                                                                                                                                    • Traces across crashes and resumes
                                                                                                                                                                                                                                  • Pandera
                                                                                                                                                                                                                                    • Papermill
                                                                                                                                                                                                                                      • Polars
                                                                                                                                                                                                                                        • PyTorch
                                                                                                                                                                                                                                          • Ray
                                                                                                                                                                                                                                            • Snowflake
                                                                                                                                                                                                                                              • Spark
                                                                                                                                                                                                                                                • Weights & Biases
                                                                                                                                                                                                                                                  • Experiments
                                                                                                                                                                                                                                                  • Distributed training
                                                                                                                                                                                                                                                  • Sweeps
                                                                                                                                                                                                                                                  • Downloading logs
                                                                                                                                                                                                                                                  • Constraints and best practices
                                                                                                                                                                                                                                                  • Manual integration
                                                                                                                                                                                                                                              • Platform deployment
                                                                                                                                                                                                                                                • Deployment overview
                                                                                                                                                                                                                                                • Kind deployment
                                                                                                                                                                                                                                                  • Set up local OIDC provider
                                                                                                                                                                                                                                                  • Set up external OIDC provider
                                                                                                                                                                                                                                                • AWS deployment
                                                                                                                                                                                                                                                • Authentication and SSO
                                                                                                                                                                                                                                                • Enable app serving
                                                                                                                                                                                                                                                • Plugin setup
                                                                                                                                                                                                                                                  • Flyte copilot storage configuration
                                                                                                                                                                                                                                              • Community
                                                                                                                                                                                                                                                • Joining the community
                                                                                                                                                                                                                                                • Contributing code
                                                                                                                                                                                                                                                • Contributing docs and examples
                                                                                                                                                                                                                                                  • Set up a local docs dev environment
                                                                                                                                                                                                                                                  • Authoring
                                                                                                                                                                                                                                                  • Submit a contribution
                                                                                                                                                                                                                                                  • Writing guidelines
                                                                                                                                                                                                                                                  • Variants
                                                                                                                                                                                                                                                  • Versions
                                                                                                                                                                                                                                                  • Shortcodes
                                                                                                                                                                                                                                                  • API docs
                                                                                                                                                                                                                                                  • LLM-optimized documentation
                                                                                                                                                                                                                                                  • Redirects
                                                                                                                                                                                                                                                  • Production builds and troubleshooting
                                                                                                                                                                                                                                              Try Flyte 2 for enterprise, hosted on Union.ai
                                                                                                                                                                                                                                              Flyte OSS
                                                                                                                                                                                                                                              Tutorials
                                                                                                                                                                                                                                              Frontier AI
                                                                                                                                                                                                                                              Open in Claude Open in Claude Ask questions about this page Open in ChatGPT Ask questions about this page Copy page Copy page as Markdown for LLMs View as Markdown View this page as plain text

                                                                                                                                                                                                                                              Frontier-model pretraining, automated experimentation, and large-scale AI workloads.

                                                                                                                                                                                                                                              Frontier AI

                                                                                                                                                                                                                                              Tutorials for frontier-model pretraining, automated experimentation, and large-scale AI workloads.

                                                                                                                                                                                                                                              Distributed LLM pretraining Pretrain large language models at scale with PyTorch Lightning, FSDP, and H200 GPUs, featuring streaming data and real-time metrics.
                                                                                                                                                                                                                                              ← Financial research agentDistributed LLM pretraining →
                                                                                                                                                                                                                                              Docs: unionai/unionai-docs 2.7.2.0SDK: flyteorg/flyte-sdk 2.7.2Backend: flyteorg/flyte v2.0.48
                                                                                                                                                                                                                                              On this page
                                                                                                                                                                                                                                              404

                                                                                                                                                                                                                                              Page not found

                                                                                                                                                                                                                                              Showing closest match