Preview Flyte 2 for production, hosted on Union.ai
Register now ↗
Union.ai Docs
Signup
User guide
Tutorials
Reference
Integrations
Platform deployment
Security
Community
Release notes
Union.ai Docs
  • User guide
    • Overview
    • Quickstart
    • Core concepts
      • TaskEnvironment
      • Tasks
      • Runs and actions
      • Apps
      • Key capabilities
    • Running locally
    • Connecting to a cluster
    • Projects and domains
    • Basic project
    • Advanced project
      • Resilient generation
      • Agentic refinement
      • Parallel outputs
      • Serving app
    • From Flyte 1 to 2
      • Pure Python
      • Asynchronous model
      • Migration
      • Considerations
    • Configure tasks
      • Container images
      • Resources
      • Secrets
      • Caching
      • Reusable containers
      • Pod templates
      • Multiple environments
      • Retries and timeouts
      • Triggers
      • Interruptible tasks and queues
      • Task plugins
      • Additional task settings
    • Build tasks
      • Files and directories
      • Data classes and structures
      • DataFrames
      • Custom types
      • Custom context
      • Abort and cancel actions
      • Raw Container Tasks
      • Links
      • Reports
      • Notebooks
      • Remote tasks
      • Error handling
      • Traces
      • Grouping actions
      • Fanout
      • Controlling parallel execution
      • Human-in-the-loop
      • Other features
      • Unit Testing Tasks
    • Run and deploy tasks
      • How task run works
      • Interact with runs and actions
      • Work with local data
      • Run command options
      • How task deployment works
      • Deploy command options
      • Packaging
      • Running Tasks via Webhooks
      • Deployment patterns
      • Run context
    • Project patterns
      • Bring your own image (BYOI)
      • Monorepo with uv
    • Scale your runs
      • Data flow
      • Life of a run
      • Scale your workflows
      • Batch inference
    • Configure apps
      • App environments
      • Including additional files
      • Passing parameters into app environments
      • Autoscaling apps
      • Apps depending on other environments
    • Build apps
      • Single-script apps
      • Multi-script apps
      • App usage patterns
      • Secret-based authentication
      • Streamlit app
      • FastAPI app
      • vLLM app
      • SGLang app
      • Flyte webhook
    • Serve and deploy apps
      • How app serving works
      • How app deployment works
      • Activating and deactivating apps
      • Prefetching models
    • Build an agent
      • Building agentic workflows
      • Deploy an agent as a service
    • Sandboxing
      • Workflow sandboxing
      • Programmatic tool calling for agents
      • Code sandboxing
    • Authenticating
    • User management
  • Tutorials
    • Distributed LLM pretraining
      • Fine-tuning a vision-language model with a frozen backbone
        • GPU-accelerated climate modeling
          • MLE Bot
            • Multi-agent trading simulation
              • Run LLM-generated code
                • Text-to-SQL
                  • Automatic prompt engineering
                    • Batching strategies
                      • Deep research
                        • Hyperparameter optimization
                        • Reference
                          • LLM-optimized documentation
                          • Migration from Flyte 1
                            • Philosophy and imports
                            • Container images
                            • Configuration and CLI
                            • Tasks and workflows
                            • Secrets, resources, and caching
                            • Parallelism and async
                            • Triggers and dynamic workflows
                            • Examples and common gotchas
                          • Flyte CLI
                          • Flyte SDK
                            • Classes & Protocols
                              • Packages
                                • flyte
                                  • AppHandle
                                  • BaseCheckpoint
                                  • Cache
                                  • CachePolicy
                                  • Checkpoint
                                  • Cron
                                  • Device
                                  • Environment
                                  • FixedRate
                                  • Image
                                  • ImageBuild
                                  • Link
                                  • PodTemplate
                                  • Resources
                                  • RetryStrategy
                                  • ReusePolicy
                                  • Secret
                                  • TaskEnvironment
                                  • Timeout
                                  • Trigger
                                • flyte.app
                                  • AppEndpoint
                                  • AppEnvironment
                                  • ConnectorEnvironment
                                  • Domain
                                  • Link
                                  • Parameter
                                  • Port
                                  • RunOutput
                                  • Scaling
                                  • Timeouts
                                • flyte.app.extras
                                  • FastAPIAppEnvironment
                                  • FastAPIPassthroughAuthMiddleware
                                  • FlyteWebhookAppEnvironment
                                • flyte.config
                                  • Config
                                • flyte.connectors
                                  • AsyncConnector
                                  • AsyncConnectorExecutorMixin
                                  • ConnectorRegistry
                                  • ConnectorService
                                  • Resource
                                  • ResourceMeta
                                • flyte.connectors.utils
                                  • flyte.durable
                                    • flyte.errors
                                      • ActionAbortedError
                                      • ActionNotFoundError
                                      • BaseRuntimeError
                                      • CodeBundleError
                                      • CustomError
                                      • DeploymentError
                                      • ImageBuildError
                                      • ImagePullBackOffError
                                      • InitializationError
                                      • InlineIOMaxBytesBreached
                                      • InvalidImageNameError
                                      • InvalidPackageError
                                      • LogsNotYetAvailableError
                                      • ModuleLoadError
                                      • NonRecoverableError
                                      • NotInTaskContextError
                                      • OnlyAsyncIOSupportedError
                                      • OOMError
                                      • ParameterMaterializationError
                                      • PrimaryContainerNotFoundError
                                      • RemoteTaskNotFoundError
                                      • RemoteTaskUsageError
                                      • RestrictedTypeError
                                      • RetriesExhaustedError
                                      • RuntimeDataValidationError
                                      • RuntimeSystemError
                                      • RuntimeUnknownError
                                      • RuntimeUserError
                                      • SlowDownError
                                      • TaskInterruptedError
                                      • TaskTimeoutError
                                      • TraceDoesNotAllowNestedTasksError
                                      • UnionRpcError
                                    • flyte.extend
                                      • AsyncFunctionTaskTemplate
                                      • ImageBuildEngine
                                      • ImageBuilder
                                      • ImageChecker
                                      • TaskTemplate
                                    • flyte.extras
                                      • BatchStats
                                      • ContainerTask
                                      • CostEstimator
                                      • DynamicBatcher
                                      • Prompt
                                      • TokenBatcher
                                      • TokenEstimator
                                    • flyte.git
                                      • GitStatus
                                    • flyte.io
                                      • DataFrame
                                      • Dir
                                      • File
                                      • HashFunction
                                    • flyte.io.extend
                                      • DataFrameDecoder
                                      • DataFrameEncoder
                                      • DataFrameTransformerEngine
                                    • flyte.models
                                      • ActionID
                                      • ActionPhase
                                      • CheckpointPaths
                                      • CodeBundle
                                      • GroupData
                                      • NativeInterface
                                      • PathRewrite
                                      • RawDataPath
                                      • SerializationContext
                                      • TaskContext
                                    • flyte.notify
                                      • Email
                                      • NamedDelivery
                                      • NamedRule
                                      • Notification
                                      • Slack
                                      • Teams
                                      • Webhook
                                    • flyte.prefetch
                                      • HuggingFaceModelInfo
                                      • ShardConfig
                                      • StoredModelInfo
                                      • VLLMShardArgs
                                    • flyte.remote
                                      • Action
                                      • ActionDetails
                                      • ActionInputs
                                      • ActionOutputs
                                      • App
                                      • Project
                                      • Run
                                      • RunDetails
                                      • Secret
                                      • Task
                                      • TaskDetails
                                      • TimeFilter
                                      • Trigger
                                      • User
                                    • flyte.report
                                      • Report
                                    • flyte.sandbox
                                      • CodeTaskTemplate
                                      • ImageConfig
                                      • SandboxedConfig
                                      • SandboxedTaskTemplate
                                    • flyte.storage
                                      • ABFS
                                      • GCS
                                      • S3
                                      • Storage
                                    • flyte.syncify
                                      • Syncify
                                    • flyte.types
                                      • FlytePickle
                                      • Renderable
                                      • TypeEngine
                                      • TypeTransformer
                                      • TypeTransformerFailedError
                                • Integrations
                                  • Anthropic
                                    • Classes
                                      • Packages
                                        • flyteplugins.anthropic
                                          • Agent
                                    • BigQuery
                                      • Classes
                                        • Packages
                                          • flyteplugins.bigquery
                                            • BigQueryConfig
                                            • BigQueryConnector
                                            • BigQueryTask
                                      • Code generation
                                        • Classes
                                          • Packages
                                            • flyteplugins.codegen
                                              • AutoCoderAgent
                                              • CodeGenEvalResult
                                              • CodePlan
                                              • CodeSolution
                                              • ErrorDiagnosis
                                              • ImageConfig
                                        • Dask
                                          • Classes
                                            • Packages
                                              • flyteplugins.dask
                                                • Dask
                                                • Scheduler
                                                • WorkerGroup
                                          • Databricks
                                            • Classes
                                              • Packages
                                                • flyteplugins.databricks
                                                  • Databricks
                                                  • DatabricksConnector
                                            • Gemini
                                              • Classes
                                                • Packages
                                                  • flyteplugins.gemini
                                                    • Agent
                                              • Human-in-the-Loop
                                                • Classes
                                                  • Packages
                                                    • flyteplugins.hitl
                                                      • Event
                                                • JSONL
                                                  • Classes
                                                    • Packages
                                                      • flyteplugins.jsonl
                                                        • JsonlDir
                                                        • JsonlFile
                                                  • MLflow
                                                    • Classes
                                                      • Packages
                                                        • flyteplugins.mlflow
                                                          • Mlflow
                                                    • OpenAI
                                                      • flyteplugins.openai.agents
                                                      • Polars
                                                        • Classes
                                                          • Packages
                                                            • flyteplugins.polars.df_transformer
                                                              • ParquetToPolarsDecodingHandler
                                                              • ParquetToPolarsLazyFrameDecodingHandler
                                                              • PolarsLazyFrameToParquetEncodingHandler
                                                              • PolarsToParquetEncodingHandler
                                                        • PyTorch
                                                          • Classes
                                                            • Packages
                                                              • flyteplugins.pytorch
                                                                • Elastic
                                                          • Ray
                                                            • Classes
                                                              • Packages
                                                                • flyteplugins.ray
                                                                  • HeadNodeConfig
                                                                  • RayJobConfig
                                                                  • WorkerNodeConfig
                                                            • SGLang
                                                              • Classes
                                                                • Packages
                                                                  • flyteplugins.sglang
                                                                    • SGLangAppEnvironment
                                                              • Snowflake
                                                                • Classes
                                                                  • Packages
                                                                    • flyteplugins.snowflake
                                                                      • Snowflake
                                                                      • SnowflakeConfig
                                                                      • SnowflakeConnector
                                                                • Spark
                                                                  • Classes
                                                                    • Packages
                                                                      • flyteplugins.spark
                                                                        • ParquetToSparkDecoder
                                                                        • Spark
                                                                        • SparkToParquetEncoder
                                                                  • Union
                                                                    • Classes
                                                                      • Packages
                                                                        • flyteplugins.union.cli
                                                                          • flyteplugins.union.internal.validate.validate.validate_pb2
                                                                            • flyteplugins.union.remote
                                                                              • ApiKey
                                                                              • Assignment
                                                                              • Cluster
                                                                              • Member
                                                                              • Policy
                                                                              • Role
                                                                              • User
                                                                            • flyteplugins.union.utils.auth
                                                                              • AppClientCredentials
                                                                        • vLLM
                                                                          • Classes
                                                                            • Packages
                                                                              • flyteplugins.vllm
                                                                                • VLLMAppEnvironment
                                                                          • Weights & Biases
                                                                            • Classes
                                                                              • Packages
                                                                                • flyteplugins.wandb
                                                                                  • Wandb
                                                                                  • WandbSweep
                                                                          • Uctl CLI
                                                                            • uctl
                                                                            • uctl version
                                                                            • uctl append
                                                                              • uctl append identityassignments
                                                                            • uctl apply
                                                                              • uctl apply app
                                                                              • uctl apply clusterconfig
                                                                              • uctl apply clusterconfigid
                                                                              • uctl apply clusterpoolconfig
                                                                            • uctl config
                                                                              • uctl config discover
                                                                              • uctl config docs
                                                                              • uctl config init
                                                                              • uctl config validate
                                                                            • uctl create
                                                                              • uctl create app
                                                                              • uctl create clusterpool
                                                                              • uctl create clusterpoolassignment
                                                                              • uctl create execution
                                                                              • uctl create policy
                                                                              • uctl create project
                                                                              • uctl create role
                                                                            • uctl delete
                                                                              • uctl delete app
                                                                              • uctl delete cluster
                                                                              • uctl delete cluster-pool-attributes
                                                                              • uctl delete cluster-resource-attribute
                                                                              • uctl delete clusterconfig
                                                                              • uctl delete clusterpool
                                                                              • uctl delete clusterpoolassignment
                                                                              • uctl delete execution
                                                                              • uctl delete execution-cluster-label
                                                                              • uctl delete execution-queue-attribute
                                                                              • uctl delete identityassignments
                                                                              • uctl delete plugin-override
                                                                              • uctl delete policy
                                                                              • uctl delete role
                                                                              • uctl delete task-resource-attribute
                                                                              • uctl delete workflow-execution-config
                                                                            • uctl demo
                                                                              • uctl demo exec
                                                                              • uctl demo reload
                                                                              • uctl demo start
                                                                              • uctl demo status
                                                                              • uctl demo teardown
                                                                            • uctl get
                                                                              • uctl get app
                                                                              • uctl get cluster
                                                                              • uctl get cluster-pool-attributes
                                                                              • uctl get cluster-resource-attribute
                                                                              • uctl get clusterconfig
                                                                              • uctl get clusterconfigs
                                                                              • uctl get clusterpool
                                                                              • uctl get clusterpoolconfig
                                                                              • uctl get clusterswithconfig
                                                                              • uctl get echo
                                                                              • uctl get execution
                                                                              • uctl get execution-cluster-label
                                                                              • uctl get execution-queue-attribute
                                                                              • uctl get executionoperation
                                                                              • uctl get identityassignment
                                                                              • uctl get launchplan
                                                                              • uctl get plugin-override
                                                                              • uctl get policy
                                                                              • uctl get project
                                                                              • uctl get role
                                                                              • uctl get task
                                                                              • uctl get task-resource-attribute
                                                                              • uctl get workflow
                                                                              • uctl get workflow-execution-config
                                                                            • uctl register
                                                                              • uctl register examples
                                                                              • uctl register files
                                                                            • uctl update
                                                                              • uctl update cluster-pool-attributes
                                                                              • uctl update cluster-resource-attribute
                                                                              • uctl update execution
                                                                              • uctl update execution-cluster-label
                                                                              • uctl update execution-queue-attribute
                                                                              • uctl update launchplan
                                                                              • uctl update launchplan-meta
                                                                              • uctl update plugin-override
                                                                              • uctl update project
                                                                              • uctl update task-meta
                                                                              • uctl update task-resource-attribute
                                                                              • uctl update workflow-execution-config
                                                                              • uctl update workflow-meta
                                                                        • Integrations
                                                                          • Anthropic
                                                                            • BigQuery
                                                                              • Dask
                                                                                • Databricks
                                                                                  • Gemini
                                                                                    • OpenAI
                                                                                      • Agent tools
                                                                                    • Pandera
                                                                                      • PyTorch
                                                                                        • Ray
                                                                                          • Snowflake
                                                                                            • Spark
                                                                                              • Weights & Biases
                                                                                                • Experiments
                                                                                                • Distributed training
                                                                                                • Sweeps
                                                                                                • Downloading logs
                                                                                                • Constraints and best practices
                                                                                                • Manual integration
                                                                                              • Code generation
                                                                                                • MLflow
                                                                                                • Platform deployment
                                                                                                  • BYOC deployment
                                                                                                    • Platform architecture
                                                                                                    • Configuring your data plane
                                                                                                    • Multi-cluster and multi-cloud
                                                                                                    • Data plane setup on AWS
                                                                                                    • Data plane setup on GCP
                                                                                                    • Data plane setup on Azure
                                                                                                    • Data retention policy
                                                                                                    • Enabling AWS resources
                                                                                                      • Enabling AWS S3
                                                                                                      • Enabling AWS ECR
                                                                                                      • Enabling AWS Secrets Manager
                                                                                                    • Enabling GCP resources
                                                                                                      • Enabling Google Cloud Storage
                                                                                                      • Enabling Google Artifact Registry
                                                                                                      • Enabling Google Secret Manager
                                                                                                      • Enabling BigQuery
                                                                                                    • Enabling Azure resources
                                                                                                      • Enabling Azure Blob Storage
                                                                                                      • Enabling Azure Container Registry (ACR)
                                                                                                      • Enabling Azure Key Vault
                                                                                                    • Single sign on setup
                                                                                                      • Google OpenID Connect
                                                                                                      • Microsoft Entra ID (formerly Azure AD)
                                                                                                      • Other identity providers
                                                                                                  • Self-managed deployment
                                                                                                    • Architecture
                                                                                                      • Overview
                                                                                                      • Kubernetes Access Controls
                                                                                                    • Cluster Recommendations
                                                                                                    • Data plane setup on generic Kubernetes
                                                                                                      • Prepare infrastructure
                                                                                                      • Deploy the dataplane
                                                                                                    • Data plane setup on AWS
                                                                                                      • Prepare infrastructure
                                                                                                      • Deploy the dataplane
                                                                                                    • Data plane setup on GCP
                                                                                                      • Prepare infrastructure
                                                                                                      • Deploy the dataplane
                                                                                                    • Data plane setup on Azure
                                                                                                      • Prepare infrastructure
                                                                                                      • Deploy the dataplane
                                                                                                    • Data plane setup on OCI
                                                                                                      • Prepare infrastructure
                                                                                                      • Deploy the dataplane
                                                                                                    • Configuration
                                                                                                      • Node Pools
                                                                                                      • Authentication
                                                                                                      • Code Viewer
                                                                                                      • Image Builder
                                                                                                      • Multiple Clusters
                                                                                                      • Persistent logs
                                                                                                      • Monitoring
                                                                                                      • Secrets
                                                                                                      • Data retention policies
                                                                                                      • Namespace mapping
                                                                                                    • Helm chart reference
                                                                                                      • Dataplane chart
                                                                                                      • Knative Operator chart
                                                                                                  • Manage Union through Terraform
                                                                                                    • Installation
                                                                                                    • Resource Management
                                                                                                    • Security Best Practices
                                                                                                • Security
                                                                                                  • Security architecture
                                                                                                  • Data protection
                                                                                                  • Identity and access management
                                                                                                  • Secrets management
                                                                                                  • Infrastructure security
                                                                                                  • Logging, monitoring, and audit
                                                                                                  • Compliance and certifications
                                                                                                  • Workflow execution security
                                                                                                  • Multi-cloud and region support
                                                                                                  • Organizational and physical security practices
                                                                                                  • Compute and control plane components
                                                                                                  • Vulnerability and risk management
                                                                                                  • BYOC deployment differences
                                                                                                  • Data residency summary
                                                                                                  • Presigned URL data types
                                                                                                  • Kubernetes RBAC: Control plane
                                                                                                  • Kubernetes RBAC: Data plane
                                                                                                  • AWS IAM roles
                                                                                                • Community
                                                                                                  • Contributing docs and examples
                                                                                                    • Quick start
                                                                                                    • Variants
                                                                                                    • Versions
                                                                                                    • Authoring
                                                                                                    • Shortcodes
                                                                                                    • Redirects
                                                                                                    • API docs
                                                                                                    • LLM-optimized documentation
                                                                                                    • Publishing
                                                                                                • Release notes
                                                                                                Documentation navigation for Union including user guides, tutorials, API references, and integration examples
                                                                                                • LLM-optimized documentation
                                                                                                • Migration from Flyte 1
                                                                                                  • Philosophy and imports
                                                                                                  • Container images
                                                                                                  • Configuration and CLI
                                                                                                  • Tasks and workflows
                                                                                                  • Secrets, resources, and caching
                                                                                                  • Parallelism and async
                                                                                                  • Triggers and dynamic workflows
                                                                                                  • Examples and common gotchas
                                                                                                • Flyte CLI
                                                                                                • Flyte SDK
                                                                                                  • Classes & Protocols
                                                                                                    • Packages
                                                                                                      • flyte
                                                                                                        • AppHandle
                                                                                                        • BaseCheckpoint
                                                                                                        • Cache
                                                                                                        • CachePolicy
                                                                                                        • Checkpoint
                                                                                                        • Cron
                                                                                                        • Device
                                                                                                        • Environment
                                                                                                        • FixedRate
                                                                                                        • Image
                                                                                                        • ImageBuild
                                                                                                        • Link
                                                                                                        • PodTemplate
                                                                                                        • Resources
                                                                                                        • RetryStrategy
                                                                                                        • ReusePolicy
                                                                                                        • Secret
                                                                                                        • TaskEnvironment
                                                                                                        • Timeout
                                                                                                        • Trigger
                                                                                                      • flyte.app
                                                                                                        • AppEndpoint
                                                                                                        • AppEnvironment
                                                                                                        • ConnectorEnvironment
                                                                                                        • Domain
                                                                                                        • Link
                                                                                                        • Parameter
                                                                                                        • Port
                                                                                                        • RunOutput
                                                                                                        • Scaling
                                                                                                        • Timeouts
                                                                                                      • flyte.app.extras
                                                                                                        • FastAPIAppEnvironment
                                                                                                        • FastAPIPassthroughAuthMiddleware
                                                                                                        • FlyteWebhookAppEnvironment
                                                                                                      • flyte.config
                                                                                                        • Config
                                                                                                      • flyte.connectors
                                                                                                        • AsyncConnector
                                                                                                        • AsyncConnectorExecutorMixin
                                                                                                        • ConnectorRegistry
                                                                                                        • ConnectorService
                                                                                                        • Resource
                                                                                                        • ResourceMeta
                                                                                                      • flyte.connectors.utils
                                                                                                        • flyte.durable
                                                                                                          • flyte.errors
                                                                                                            • ActionAbortedError
                                                                                                            • ActionNotFoundError
                                                                                                            • BaseRuntimeError
                                                                                                            • CodeBundleError
                                                                                                            • CustomError
                                                                                                            • DeploymentError
                                                                                                            • ImageBuildError
                                                                                                            • ImagePullBackOffError
                                                                                                            • InitializationError
                                                                                                            • InlineIOMaxBytesBreached
                                                                                                            • InvalidImageNameError
                                                                                                            • InvalidPackageError
                                                                                                            • LogsNotYetAvailableError
                                                                                                            • ModuleLoadError
                                                                                                            • NonRecoverableError
                                                                                                            • NotInTaskContextError
                                                                                                            • OnlyAsyncIOSupportedError
                                                                                                            • OOMError
                                                                                                            • ParameterMaterializationError
                                                                                                            • PrimaryContainerNotFoundError
                                                                                                            • RemoteTaskNotFoundError
                                                                                                            • RemoteTaskUsageError
                                                                                                            • RestrictedTypeError
                                                                                                            • RetriesExhaustedError
                                                                                                            • RuntimeDataValidationError
                                                                                                            • RuntimeSystemError
                                                                                                            • RuntimeUnknownError
                                                                                                            • RuntimeUserError
                                                                                                            • SlowDownError
                                                                                                            • TaskInterruptedError
                                                                                                            • TaskTimeoutError
                                                                                                            • TraceDoesNotAllowNestedTasksError
                                                                                                            • UnionRpcError
                                                                                                          • flyte.extend
                                                                                                            • AsyncFunctionTaskTemplate
                                                                                                            • ImageBuildEngine
                                                                                                            • ImageBuilder
                                                                                                            • ImageChecker
                                                                                                            • TaskTemplate
                                                                                                          • flyte.extras
                                                                                                            • BatchStats
                                                                                                            • ContainerTask
                                                                                                            • CostEstimator
                                                                                                            • DynamicBatcher
                                                                                                            • Prompt
                                                                                                            • TokenBatcher
                                                                                                            • TokenEstimator
                                                                                                          • flyte.git
                                                                                                            • GitStatus
                                                                                                          • flyte.io
                                                                                                            • DataFrame
                                                                                                            • Dir
                                                                                                            • File
                                                                                                            • HashFunction
                                                                                                          • flyte.io.extend
                                                                                                            • DataFrameDecoder
                                                                                                            • DataFrameEncoder
                                                                                                            • DataFrameTransformerEngine
                                                                                                          • flyte.models
                                                                                                            • ActionID
                                                                                                            • ActionPhase
                                                                                                            • CheckpointPaths
                                                                                                            • CodeBundle
                                                                                                            • GroupData
                                                                                                            • NativeInterface
                                                                                                            • PathRewrite
                                                                                                            • RawDataPath
                                                                                                            • SerializationContext
                                                                                                            • TaskContext
                                                                                                          • flyte.notify
                                                                                                            • Email
                                                                                                            • NamedDelivery
                                                                                                            • NamedRule
                                                                                                            • Notification
                                                                                                            • Slack
                                                                                                            • Teams
                                                                                                            • Webhook
                                                                                                          • flyte.prefetch
                                                                                                            • HuggingFaceModelInfo
                                                                                                            • ShardConfig
                                                                                                            • StoredModelInfo
                                                                                                            • VLLMShardArgs
                                                                                                          • flyte.remote
                                                                                                            • Action
                                                                                                            • ActionDetails
                                                                                                            • ActionInputs
                                                                                                            • ActionOutputs
                                                                                                            • App
                                                                                                            • Project
                                                                                                            • Run
                                                                                                            • RunDetails
                                                                                                            • Secret
                                                                                                            • Task
                                                                                                            • TaskDetails
                                                                                                            • TimeFilter
                                                                                                            • Trigger
                                                                                                            • User
                                                                                                          • flyte.report
                                                                                                            • Report
                                                                                                          • flyte.sandbox
                                                                                                            • CodeTaskTemplate
                                                                                                            • ImageConfig
                                                                                                            • SandboxedConfig
                                                                                                            • SandboxedTaskTemplate
                                                                                                          • flyte.storage
                                                                                                            • ABFS
                                                                                                            • GCS
                                                                                                            • S3
                                                                                                            • Storage
                                                                                                          • flyte.syncify
                                                                                                            • Syncify
                                                                                                          • flyte.types
                                                                                                            • FlytePickle
                                                                                                            • Renderable
                                                                                                            • TypeEngine
                                                                                                            • TypeTransformer
                                                                                                            • TypeTransformerFailedError
                                                                                                      • Integrations
                                                                                                        • Anthropic
                                                                                                          • Classes
                                                                                                            • Packages
                                                                                                              • flyteplugins.anthropic
                                                                                                                • Agent
                                                                                                          • BigQuery
                                                                                                            • Classes
                                                                                                              • Packages
                                                                                                                • flyteplugins.bigquery
                                                                                                                  • BigQueryConfig
                                                                                                                  • BigQueryConnector
                                                                                                                  • BigQueryTask
                                                                                                            • Code generation
                                                                                                              • Classes
                                                                                                                • Packages
                                                                                                                  • flyteplugins.codegen
                                                                                                                    • AutoCoderAgent
                                                                                                                    • CodeGenEvalResult
                                                                                                                    • CodePlan
                                                                                                                    • CodeSolution
                                                                                                                    • ErrorDiagnosis
                                                                                                                    • ImageConfig
                                                                                                              • Dask
                                                                                                                • Classes
                                                                                                                  • Packages
                                                                                                                    • flyteplugins.dask
                                                                                                                      • Dask
                                                                                                                      • Scheduler
                                                                                                                      • WorkerGroup
                                                                                                                • Databricks
                                                                                                                  • Classes
                                                                                                                    • Packages
                                                                                                                      • flyteplugins.databricks
                                                                                                                        • Databricks
                                                                                                                        • DatabricksConnector
                                                                                                                  • Gemini
                                                                                                                    • Classes
                                                                                                                      • Packages
                                                                                                                        • flyteplugins.gemini
                                                                                                                          • Agent
                                                                                                                    • Human-in-the-Loop
                                                                                                                      • Classes
                                                                                                                        • Packages
                                                                                                                          • flyteplugins.hitl
                                                                                                                            • Event
                                                                                                                      • JSONL
                                                                                                                        • Classes
                                                                                                                          • Packages
                                                                                                                            • flyteplugins.jsonl
                                                                                                                              • JsonlDir
                                                                                                                              • JsonlFile
                                                                                                                        • MLflow
                                                                                                                          • Classes
                                                                                                                            • Packages
                                                                                                                              • flyteplugins.mlflow
                                                                                                                                • Mlflow
                                                                                                                          • OpenAI
                                                                                                                            • flyteplugins.openai.agents
                                                                                                                            • Polars
                                                                                                                              • Classes
                                                                                                                                • Packages
                                                                                                                                  • flyteplugins.polars.df_transformer
                                                                                                                                    • ParquetToPolarsDecodingHandler
                                                                                                                                    • ParquetToPolarsLazyFrameDecodingHandler
                                                                                                                                    • PolarsLazyFrameToParquetEncodingHandler
                                                                                                                                    • PolarsToParquetEncodingHandler
                                                                                                                              • PyTorch
                                                                                                                                • Classes
                                                                                                                                  • Packages
                                                                                                                                    • flyteplugins.pytorch
                                                                                                                                      • Elastic
                                                                                                                                • Ray
                                                                                                                                  • Classes
                                                                                                                                    • Packages
                                                                                                                                      • flyteplugins.ray
                                                                                                                                        • HeadNodeConfig
                                                                                                                                        • RayJobConfig
                                                                                                                                        • WorkerNodeConfig
                                                                                                                                  • SGLang
                                                                                                                                    • Classes
                                                                                                                                      • Packages
                                                                                                                                        • flyteplugins.sglang
                                                                                                                                          • SGLangAppEnvironment
                                                                                                                                    • Snowflake
                                                                                                                                      • Classes
                                                                                                                                        • Packages
                                                                                                                                          • flyteplugins.snowflake
                                                                                                                                            • Snowflake
                                                                                                                                            • SnowflakeConfig
                                                                                                                                            • SnowflakeConnector
                                                                                                                                      • Spark
                                                                                                                                        • Classes
                                                                                                                                          • Packages
                                                                                                                                            • flyteplugins.spark
                                                                                                                                              • ParquetToSparkDecoder
                                                                                                                                              • Spark
                                                                                                                                              • SparkToParquetEncoder
                                                                                                                                        • Union
                                                                                                                                          • Classes
                                                                                                                                            • Packages
                                                                                                                                              • flyteplugins.union.cli
                                                                                                                                                • flyteplugins.union.internal.validate.validate.validate_pb2
                                                                                                                                                  • flyteplugins.union.remote
                                                                                                                                                    • ApiKey
                                                                                                                                                    • Assignment
                                                                                                                                                    • Cluster
                                                                                                                                                    • Member
                                                                                                                                                    • Policy
                                                                                                                                                    • Role
                                                                                                                                                    • User
                                                                                                                                                  • flyteplugins.union.utils.auth
                                                                                                                                                    • AppClientCredentials
                                                                                                                                              • vLLM
                                                                                                                                                • Classes
                                                                                                                                                  • Packages
                                                                                                                                                    • flyteplugins.vllm
                                                                                                                                                      • VLLMAppEnvironment
                                                                                                                                                • Weights & Biases
                                                                                                                                                  • Classes
                                                                                                                                                    • Packages
                                                                                                                                                      • flyteplugins.wandb
                                                                                                                                                        • Wandb
                                                                                                                                                        • WandbSweep
                                                                                                                                                • Uctl CLI
                                                                                                                                                  • uctl
                                                                                                                                                  • uctl version
                                                                                                                                                  • uctl append
                                                                                                                                                    • uctl append identityassignments
                                                                                                                                                  • uctl apply
                                                                                                                                                    • uctl apply app
                                                                                                                                                    • uctl apply clusterconfig
                                                                                                                                                    • uctl apply clusterconfigid
                                                                                                                                                    • uctl apply clusterpoolconfig
                                                                                                                                                  • uctl config
                                                                                                                                                    • uctl config discover
                                                                                                                                                    • uctl config docs
                                                                                                                                                    • uctl config init
                                                                                                                                                    • uctl config validate
                                                                                                                                                  • uctl create
                                                                                                                                                    • uctl create app
                                                                                                                                                    • uctl create clusterpool
                                                                                                                                                    • uctl create clusterpoolassignment
                                                                                                                                                    • uctl create execution
                                                                                                                                                    • uctl create policy
                                                                                                                                                    • uctl create project
                                                                                                                                                    • uctl create role
                                                                                                                                                  • uctl delete
                                                                                                                                                    • uctl delete app
                                                                                                                                                    • uctl delete cluster
                                                                                                                                                    • uctl delete cluster-pool-attributes
                                                                                                                                                    • uctl delete cluster-resource-attribute
                                                                                                                                                    • uctl delete clusterconfig
                                                                                                                                                    • uctl delete clusterpool
                                                                                                                                                    • uctl delete clusterpoolassignment
                                                                                                                                                    • uctl delete execution
                                                                                                                                                    • uctl delete execution-cluster-label
                                                                                                                                                    • uctl delete execution-queue-attribute
                                                                                                                                                    • uctl delete identityassignments
                                                                                                                                                    • uctl delete plugin-override
                                                                                                                                                    • uctl delete policy
                                                                                                                                                    • uctl delete role
                                                                                                                                                    • uctl delete task-resource-attribute
                                                                                                                                                    • uctl delete workflow-execution-config
                                                                                                                                                  • uctl demo
                                                                                                                                                    • uctl demo exec
                                                                                                                                                    • uctl demo reload
                                                                                                                                                    • uctl demo start
                                                                                                                                                    • uctl demo status
                                                                                                                                                    • uctl demo teardown
                                                                                                                                                  • uctl get
                                                                                                                                                    • uctl get app
                                                                                                                                                    • uctl get cluster
                                                                                                                                                    • uctl get cluster-pool-attributes
                                                                                                                                                    • uctl get cluster-resource-attribute
                                                                                                                                                    • uctl get clusterconfig
                                                                                                                                                    • uctl get clusterconfigs
                                                                                                                                                    • uctl get clusterpool
                                                                                                                                                    • uctl get clusterpoolconfig
                                                                                                                                                    • uctl get clusterswithconfig
                                                                                                                                                    • uctl get echo
                                                                                                                                                    • uctl get execution
                                                                                                                                                    • uctl get execution-cluster-label
                                                                                                                                                    • uctl get execution-queue-attribute
                                                                                                                                                    • uctl get executionoperation
                                                                                                                                                    • uctl get identityassignment
                                                                                                                                                    • uctl get launchplan
                                                                                                                                                    • uctl get plugin-override
                                                                                                                                                    • uctl get policy
                                                                                                                                                    • uctl get project
                                                                                                                                                    • uctl get role
                                                                                                                                                    • uctl get task
                                                                                                                                                    • uctl get task-resource-attribute
                                                                                                                                                    • uctl get workflow
                                                                                                                                                    • uctl get workflow-execution-config
                                                                                                                                                  • uctl register
                                                                                                                                                    • uctl register examples
                                                                                                                                                    • uctl register files
                                                                                                                                                  • uctl update
                                                                                                                                                    • uctl update cluster-pool-attributes
                                                                                                                                                    • uctl update cluster-resource-attribute
                                                                                                                                                    • uctl update execution
                                                                                                                                                    • uctl update execution-cluster-label
                                                                                                                                                    • uctl update execution-queue-attribute
                                                                                                                                                    • uctl update launchplan
                                                                                                                                                    • uctl update launchplan-meta
                                                                                                                                                    • uctl update plugin-override
                                                                                                                                                    • uctl update project
                                                                                                                                                    • uctl update task-meta
                                                                                                                                                    • uctl update task-resource-attribute
                                                                                                                                                    • uctl update workflow-execution-config
                                                                                                                                                    • uctl update workflow-meta

                                                                                                                                                The page you navigated to () does not exist, so we brought you to the closest page to it.

                                                                                                                                                You have switched from the to the variant of this site. There is no equivalent of . We have taken you to the closest page in the variant.

                                                                                                                                                Union.ai
                                                                                                                                                Reference
                                                                                                                                                Integrations
                                                                                                                                                Polars
                                                                                                                                                Classes
                                                                                                                                                2.1.7

                                                                                                                                                Classes

                                                                                                                                                Class Description
                                                                                                                                                flyteplugins.polars.df_transformer.ParquetToPolarsDecodingHandler
                                                                                                                                                flyteplugins.polars.df_transformer.ParquetToPolarsLazyFrameDecodingHandler
                                                                                                                                                flyteplugins.polars.df_transformer.PolarsLazyFrameToParquetEncodingHandler
                                                                                                                                                flyteplugins.polars.df_transformer.PolarsToParquetEncodingHandler
                                                                                                                                                LLM-optimized
                                                                                                                                                This page Full docs index
                                                                                                                                                On this page