Preview Flyte 2 for production, hosted on Union.ai
Register now
↗
Flyte OSS Docs
Union.ai
Flyte OSS
v2
LATEST
v2
LATEST
v1
Search
⌘
K
Ask AI
⇧
⌘
K
Signup
User guide
Tutorials
Reference
Integrations
Community
Flyte OSS Docs
User guide
Overview
Quickstart
Core concepts
TaskEnvironment
Tasks
Runs and actions
Apps
Projects and domains
Key capabilities
Run modes
Running locally
Running on the devbox
Basic project
Advanced project
Resilient generation
Agentic refinement
Parallel outputs
Serving app
Configure tasks
Container images
Resources
Secrets
Caching
Reusable containers
Pod templates
Multiple environments
Retries and timeouts
Triggers
Interruptible tasks and queues
Task plugins
Additional task settings
Build tasks
Files and directories
Data classes and structures
DataFrames
Custom types
Custom context
Abort and cancel actions
Raw Container Tasks
Links
Reports
Notebooks
Remote tasks
Error handling
Traces
Grouping actions
Fanout
Controlling parallel execution
Human-in-the-loop
Unit Testing Tasks
Other features
Run and deploy tasks
How task run works
Interact with runs and actions
Work with local data
Run command options
How task deployment works
Deploy command options
Packaging
Deployment patterns
Run context
Entrypoint tasks
Run a Python script
Project patterns
Bring your own image (BYOI)
Monorepo with uv
Scale your runs
Data flow
Life of a run
Scale your workflows
Batch inference
Configure apps
App environments
Including additional files
Passing parameters into app environments
Autoscaling apps
Apps depending on other environments
Build apps
Single-script apps
Multi-script apps
App usage patterns
Secret-based authentication
Streamlit app
FastAPI app
vLLM app
SGLang app
Flyte webhook
Serve and deploy apps
How app serving works
How app custom domains work
How app deployment works
Activating and deactivating apps
Prefetching models
Build an agent
Building agentic workflows
Deploy an agent as a service
Sandboxing
Workflow sandboxing
Programmatic tool calling for agents
Code sandboxing
Migration
From Flyte 1 to 2
Pure Python
Asynchronous model
Migration
Considerations
From Airflow to Flyte
Part 1 — Vanilla Operators
Tutorials
Distributed LLM pretraining
Fine-tuning a vision-language model with a frozen backbone
GPU-accelerated climate modeling
MLE Bot
Multi-agent trading simulation
Run LLM-generated code
Text-to-SQL
Automatic prompt engineering
Deep research
Hyperparameter optimization
Reference
LLM-optimized documentation
Migration from Flyte 1
Philosophy and imports
Container images
Configuration and CLI
Tasks and workflows
Secrets, resources, and caching
Parallelism and async
Triggers and dynamic workflows
Examples and common gotchas
Flyte CLI
Flyte SDK
Classes & Protocols
Packages
flyte
AppHandle
BaseCheckpoint
Cache
CachePolicy
Checkpoint
Cron
Device
Environment
FixedRate
Image
ImageBuild
Link
PodTemplate
Resources
RetryStrategy
ReusePolicy
Secret
TaskEnvironment
Timeout
Trigger
flyte.app
AppEndpoint
AppEnvironment
ConnectorEnvironment
Domain
Link
Parameter
Port
RunOutput
Scaling
Timeouts
flyte.app.extras
FastAPIAppEnvironment
FastAPIPassthroughAuthMiddleware
FlyteWebhookAppEnvironment
flyte.config
Config
flyte.connectors
AsyncConnector
AsyncConnectorExecutorMixin
ConnectorRegistry
ConnectorService
Resource
ResourceMeta
flyte.connectors.utils
flyte.durable
flyte.errors
ActionAbortedError
ActionNotFoundError
BaseRuntimeError
CodeBundleError
CustomError
DeploymentError
ImageBuildError
ImagePullBackOffError
InitializationError
InlineIOMaxBytesBreached
InvalidImageNameError
InvalidPackageError
LogsNotYetAvailableError
ModuleLoadError
NonRecoverableError
NotInTaskContextError
OnlyAsyncIOSupportedError
OOMError
ParameterMaterializationError
PrimaryContainerNotFoundError
RemoteTaskNotFoundError
RemoteTaskUsageError
RestrictedTypeError
RetriesExhaustedError
RuntimeDataValidationError
RuntimeSystemError
RuntimeUnknownError
RuntimeUserError
SlowDownError
TaskInterruptedError
TaskTimeoutError
TraceDoesNotAllowNestedTasksError
UnionRpcError
flyte.extend
AsyncFunctionTaskTemplate
ImageBuildEngine
ImageBuilder
ImageChecker
TaskTemplate
flyte.extras
BatchStats
ContainerTask
CostEstimator
DynamicBatcher
Prompt
Sleep
SleepTask
TokenBatcher
TokenEstimator
flyte.git
GitStatus
flyte.io
DataFrame
Dir
EmptyDir
File
HashFunction
flyte.io.extend
DataFrameDecoder
DataFrameEncoder
DataFrameTransformerEngine
flyte.models
ActionID
ActionPhase
CheckpointPaths
CodeBundle
GroupData
NativeInterface
PathRewrite
RawDataPath
SerializationContext
TaskContext
flyte.notify
Email
NamedDelivery
NamedRule
Notification
Slack
Teams
Webhook
flyte.prefetch
HuggingFaceModelInfo
ShardConfig
StoredModelInfo
VLLMShardArgs
flyte.remote
Action
ActionDetails
ActionInputs
ActionOutputs
App
Project
Run
RunDetails
Secret
Settings
Task
TaskDetails
TimeFilter
Trigger
User
flyte.report
Report
flyte.sandbox
CodeTaskTemplate
ImageConfig
SandboxedConfig
SandboxedTaskTemplate
flyte.storage
ABFS
GCS
S3
Storage
flyte.syncify
Syncify
flyte.types
FlytePickle
Renderable
TypeEngine
TypeTransformer
TypeTransformerFailedError
Integrations
Anthropic
Classes
Packages
flyteplugins.anthropic
Agent
BigQuery
Classes
Packages
flyteplugins.bigquery
BigQueryConfig
BigQueryConnector
BigQueryTask
Code generation
Classes
Packages
flyteplugins.codegen
AutoCoderAgent
CodeGenEvalResult
CodePlan
CodeSolution
ErrorDiagnosis
ImageConfig
Dask
Classes
Packages
flyteplugins.dask
Dask
Scheduler
WorkerGroup
Databricks
Classes
Packages
flyteplugins.databricks
Databricks
DatabricksConnector
Gemini
Classes
Packages
flyteplugins.gemini
Agent
Human-in-the-Loop
Classes
Packages
flyteplugins.hitl
Event
Hydra
flyteplugins.hydra
JSONL
Classes
Packages
flyteplugins.jsonl
JsonlDir
JsonlFile
MLflow
Classes
Packages
flyteplugins.mlflow
Mlflow
OmegaConf
flyteplugins.omegaconf
OpenAI
flyteplugins.openai.agents
Papermill
Classes
Packages
flyteplugins.papermill
NotebookTask
Polars
Classes
Packages
flyteplugins.polars.df_transformer
ParquetToPolarsDecodingHandler
ParquetToPolarsLazyFrameDecodingHandler
PolarsLazyFrameToParquetEncodingHandler
PolarsToParquetEncodingHandler
PyTorch
Classes
Packages
flyteplugins.pytorch
Elastic
Ray
Classes
Packages
flyteplugins.ray
HeadNodeConfig
RayJobConfig
WorkerNodeConfig
SGLang
Classes
Packages
flyteplugins.sglang
SGLangAppEnvironment
Snowflake
Classes
Packages
flyteplugins.snowflake
Snowflake
SnowflakeConfig
SnowflakeConnector
Spark
Classes
Packages
flyteplugins.spark
ParquetToSparkDecoder
Spark
SparkToParquetEncoder
Union
Classes
Packages
flyteplugins.union.cli
flyteplugins.union.internal.validate.validate.validate_pb2
flyteplugins.union.remote
ApiKey
Assignment
Cluster
Member
Policy
Role
User
flyteplugins.union.utils.auth
AppClientCredentials
vLLM
Classes
Packages
flyteplugins.vllm
VLLMAppEnvironment
Weights & Biases
Classes
Packages
flyteplugins.wandb
Wandb
WandbSweep
Integrations
Anthropic
BigQuery
Code generation
Dask
Databricks
Gemini
Hydra
MLflow
OmegaConf
OpenAI
Agent tools
Pandera
Papermill
PyTorch
Ray
Snowflake
Spark
Weights & Biases
Experiments
Distributed training
Sweeps
Downloading logs
Constraints and best practices
Manual integration
Community
Joining the community
Contributing code
Contributing docs and examples
Quick start
Variants
Versions
Authoring
Shortcodes
Redirects
API docs
LLM-optimized documentation
Publishing
Documentation navigation for Flyte including user guides, tutorials, API references, and integration examples
LLM-optimized documentation
Migration from Flyte 1
Philosophy and imports
Container images
Configuration and CLI
Tasks and workflows
Secrets, resources, and caching
Parallelism and async
Triggers and dynamic workflows
Examples and common gotchas
Flyte CLI
Flyte SDK
Classes & Protocols
Packages
flyte
AppHandle
BaseCheckpoint
Cache
CachePolicy
Checkpoint
Cron
Device
Environment
FixedRate
Image
ImageBuild
Link
PodTemplate
Resources
RetryStrategy
ReusePolicy
Secret
TaskEnvironment
Timeout
Trigger
flyte.app
AppEndpoint
AppEnvironment
ConnectorEnvironment
Domain
Link
Parameter
Port
RunOutput
Scaling
Timeouts
flyte.app.extras
FastAPIAppEnvironment
FastAPIPassthroughAuthMiddleware
FlyteWebhookAppEnvironment
flyte.config
Config
flyte.connectors
AsyncConnector
AsyncConnectorExecutorMixin
ConnectorRegistry
ConnectorService
Resource
ResourceMeta
flyte.connectors.utils
flyte.durable
flyte.errors
ActionAbortedError
ActionNotFoundError
BaseRuntimeError
CodeBundleError
CustomError
DeploymentError
ImageBuildError
ImagePullBackOffError
InitializationError
InlineIOMaxBytesBreached
InvalidImageNameError
InvalidPackageError
LogsNotYetAvailableError
ModuleLoadError
NonRecoverableError
NotInTaskContextError
OnlyAsyncIOSupportedError
OOMError
ParameterMaterializationError
PrimaryContainerNotFoundError
RemoteTaskNotFoundError
RemoteTaskUsageError
RestrictedTypeError
RetriesExhaustedError
RuntimeDataValidationError
RuntimeSystemError
RuntimeUnknownError
RuntimeUserError
SlowDownError
TaskInterruptedError
TaskTimeoutError
TraceDoesNotAllowNestedTasksError
UnionRpcError
flyte.extend
AsyncFunctionTaskTemplate
ImageBuildEngine
ImageBuilder
ImageChecker
TaskTemplate
flyte.extras
BatchStats
ContainerTask
CostEstimator
DynamicBatcher
Prompt
Sleep
SleepTask
TokenBatcher
TokenEstimator
flyte.git
GitStatus
flyte.io
DataFrame
Dir
EmptyDir
File
HashFunction
flyte.io.extend
DataFrameDecoder
DataFrameEncoder
DataFrameTransformerEngine
flyte.models
ActionID
ActionPhase
CheckpointPaths
CodeBundle
GroupData
NativeInterface
PathRewrite
RawDataPath
SerializationContext
TaskContext
flyte.notify
Email
NamedDelivery
NamedRule
Notification
Slack
Teams
Webhook
flyte.prefetch
HuggingFaceModelInfo
ShardConfig
StoredModelInfo
VLLMShardArgs
flyte.remote
Action
ActionDetails
ActionInputs
ActionOutputs
App
Project
Run
RunDetails
Secret
Settings
Task
TaskDetails
TimeFilter
Trigger
User
flyte.report
Report
flyte.sandbox
CodeTaskTemplate
ImageConfig
SandboxedConfig
SandboxedTaskTemplate
flyte.storage
ABFS
GCS
S3
Storage
flyte.syncify
Syncify
flyte.types
FlytePickle
Renderable
TypeEngine
TypeTransformer
TypeTransformerFailedError
Integrations
Anthropic
Classes
Packages
flyteplugins.anthropic
Agent
BigQuery
Classes
Packages
flyteplugins.bigquery
BigQueryConfig
BigQueryConnector
BigQueryTask
Code generation
Classes
Packages
flyteplugins.codegen
AutoCoderAgent
CodeGenEvalResult
CodePlan
CodeSolution
ErrorDiagnosis
ImageConfig
Dask
Classes
Packages
flyteplugins.dask
Dask
Scheduler
WorkerGroup
Databricks
Classes
Packages
flyteplugins.databricks
Databricks
DatabricksConnector
Gemini
Classes
Packages
flyteplugins.gemini
Agent
Human-in-the-Loop
Classes
Packages
flyteplugins.hitl
Event
Hydra
flyteplugins.hydra
JSONL
Classes
Packages
flyteplugins.jsonl
JsonlDir
JsonlFile
MLflow
Classes
Packages
flyteplugins.mlflow
Mlflow
OmegaConf
flyteplugins.omegaconf
OpenAI
flyteplugins.openai.agents
Papermill
Classes
Packages
flyteplugins.papermill
NotebookTask
Polars
Classes
Packages
flyteplugins.polars.df_transformer
ParquetToPolarsDecodingHandler
ParquetToPolarsLazyFrameDecodingHandler
PolarsLazyFrameToParquetEncodingHandler
PolarsToParquetEncodingHandler
PyTorch
Classes
Packages
flyteplugins.pytorch
Elastic
Ray
Classes
Packages
flyteplugins.ray
HeadNodeConfig
RayJobConfig
WorkerNodeConfig
SGLang
Classes
Packages
flyteplugins.sglang
SGLangAppEnvironment
Snowflake
Classes
Packages
flyteplugins.snowflake
Snowflake
SnowflakeConfig
SnowflakeConnector
Spark
Classes
Packages
flyteplugins.spark
ParquetToSparkDecoder
Spark
SparkToParquetEncoder
Union
Classes
Packages
flyteplugins.union.cli
flyteplugins.union.internal.validate.validate.validate_pb2
flyteplugins.union.remote
ApiKey
Assignment
Cluster
Member
Policy
Role
User
flyteplugins.union.utils.auth
AppClientCredentials
vLLM
Classes
Packages
flyteplugins.vllm
VLLMAppEnvironment
Weights & Biases
Classes
Packages
flyteplugins.wandb
Wandb
WandbSweep
Flyte 2 Devbox
is available today to run a full Flyte backend and UI locally.
Preview Flyte 2 for production
, hosted on
Union.ai
Flyte OSS
Reference
Integrations
Human-in-the-Loop
Packages
2.2.2
Packages
Package
Description
flyteplugins.hitl
Human-in-the-Loop (HITL) plugin for Flyte.
LLM-optimized
This page
Full docs index
On this page
404
Page not found
Showing closest match
