Flyte + Union 2.0: Now accepting interest in our invite-only beta
Register now ↗
Flyte Docs
|
Version:
Signup
User guide
Tutorials
Reference
Integrations
Community
Flyte Docs
Signup
Documentation navigation for Flyte including user guides, tutorials, API references, and integration examples
  • Flyte CLI
  • LLM context document
  • Flyte SDK
    • Classes & Protocols
      • Packages
        • flyte
          • Cache
          • CachePolicy
          • Cron
          • Device
          • Environment
          • FixedRate
          • Image
          • ImageBuild
          • Link
          • PodTemplate
          • Resources
          • RetryStrategy
          • ReusePolicy
          • Secret
          • TaskEnvironment
          • Timeout
          • Trigger
        • flyte.app
          • AppEndpoint
          • AppEnvironment
          • ConnectorEnvironment
          • Domain
          • Link
          • Parameter
          • Port
          • RunOutput
          • Scaling
        • flyte.app.extras
          • FastAPIAppEnvironment
          • FastAPIPassthroughAuthMiddleware
        • flyte.config
          • Config
        • flyte.connectors
          • AsyncConnector
          • AsyncConnectorExecutorMixin
          • ConnectorRegistry
          • ConnectorService
          • Resource
          • ResourceMeta
        • flyte.connectors.utils
          • flyte.errors
            • ActionAbortedError
            • ActionNotFoundError
            • BaseRuntimeError
            • CodeBundleError
            • CustomError
            • DeploymentError
            • ImageBuildError
            • ImagePullBackOffError
            • InitializationError
            • InlineIOMaxBytesBreached
            • InvalidImageNameError
            • LogsNotYetAvailableError
            • ModuleLoadError
            • NotInTaskContextError
            • OnlyAsyncIOSupportedError
            • OOMError
            • ParameterMaterializationError
            • PrimaryContainerNotFoundError
            • RemoteTaskNotFoundError
            • RemoteTaskUsageError
            • RestrictedTypeError
            • RetriesExhaustedError
            • RuntimeDataValidationError
            • RuntimeSystemError
            • RuntimeUnknownError
            • RuntimeUserError
            • SlowDownError
            • TaskInterruptedError
            • TaskTimeoutError
            • UnionRpcError
          • flyte.extend
            • AsyncFunctionTaskTemplate
            • ImageBuildEngine
            • ImageBuilder
            • ImageChecker
            • TaskTemplate
          • flyte.extras
            • ContainerTask
          • flyte.git
            • GitStatus
          • flyte.io
            • DataFrame
            • Dir
            • File
          • flyte.io.extend
            • DataFrameDecoder
            • DataFrameEncoder
            • DataFrameTransformerEngine
          • flyte.models
            • ActionID
            • ActionPhase
            • Checkpoints
            • CodeBundle
            • GroupData
            • NativeInterface
            • PathRewrite
            • RawDataPath
            • SerializationContext
            • TaskContext
          • flyte.prefetch
            • HuggingFaceModelInfo
            • ShardConfig
            • StoredModelInfo
            • VLLMShardArgs
          • flyte.remote
            • Action
            • ActionDetails
            • ActionInputs
            • ActionOutputs
            • App
            • Project
            • Run
            • RunDetails
            • Secret
            • Task
            • TaskDetails
            • Trigger
            • User
          • flyte.report
            • Report
          • flyte.storage
            • ABFS
            • GCS
            • S3
            • Storage
          • flyte.syncify
            • Syncify
          • flyte.types
            • FlytePickle
            • Renderable
            • TypeEngine
            • TypeTransformer
            • TypeTransformerFailedError
      • Integrations
        • Connectors
          • Classes
            • Packages
              • flyteplugins.connectors.bigquery
                • BigQueryConfig
                • BigQueryConnector
                • BigQueryTask
              • flyteplugins.connectors.bigquery.connector
                • BigQueryConnector
                • BigQueryMetadata
              • flyteplugins.connectors.bigquery.task
                • BigQueryConfig
                • BigQueryTask
              • flyteplugins.connectors.databricks
                • Databricks
                • DatabricksConnector
              • flyteplugins.connectors.databricks.connector
                • DatabricksConnector
                • DatabricksJobMetadata
              • flyteplugins.connectors.databricks.task
                • Databricks
                • DatabricksFunctionTask
              • flyteplugins.connectors.snowflake
                • Snowflake
                • SnowflakeConfig
                • SnowflakeConnector
              • flyteplugins.connectors.snowflake.connector
                • SnowflakeConnector
                • SnowflakeJobMetadata
              • flyteplugins.connectors.snowflake.task
                • Snowflake
                • SnowflakeConfig
          • Dask
            • Classes
              • Packages
                • flyteplugins.dask
                  • Dask
                  • Scheduler
                  • WorkerGroup
                • flyteplugins.dask.task
                  • Dask
                  • DaskTask
                  • DownloadCodeBundleSchedulerPlugin
                  • DownloadCodeBundleWorkerPlugin
                  • Scheduler
                  • WorkerGroup
            • OpenAI
              • flyteplugins.openai.agents
              • Polars
                • Classes
                  • Packages
                    • flyteplugins.polars.df_transformer
                      • ParquetToPolarsDecodingHandler
                      • ParquetToPolarsLazyFrameDecodingHandler
                      • PolarsLazyFrameToParquetEncodingHandler
                      • PolarsToParquetEncodingHandler
                • PyTorch
                  • Classes
                    • Packages
                      • flyteplugins.pytorch
                        • Elastic
                      • flyteplugins.pytorch.task
                        • Elastic
                        • RunPolicy
                        • TorchFunctionTask
                  • Ray
                    • Classes
                      • Packages
                        • flyteplugins.ray
                          • HeadNodeConfig
                          • RayJobConfig
                          • WorkerNodeConfig
                        • flyteplugins.ray.task
                          • HeadNodeConfig
                          • RayFunctionTask
                          • RayJobConfig
                          • WorkerNodeConfig
                    • SGLang
                      • Classes
                        • Packages
                          • flyteplugins.sglang
                            • SGLangAppEnvironment
                      • Spark
                        • Classes
                          • Packages
                            • flyteplugins.spark
                              • ParquetToSparkDecoder
                              • Spark
                              • SparkToParquetEncoder
                            • flyteplugins.spark.df_transformer
                              • ParquetToSparkDecoder
                              • SparkToParquetEncoder
                            • flyteplugins.spark.task
                              • PysparkFunctionTask
                              • Spark
                        • Union
                          • Classes
                            • Packages
                              • flyteplugins.union.internal.validate.validate.validate_pb2
                                • flyteplugins.union.internal.validate.validate.validate_pb2_grpc
                                  • flyteplugins.union.remote
                                    • ApiKey
                                  • flyteplugins.union.utils.auth
                                    • AppClientCredentials
                              • vLLM
                                • Classes
                                  • Packages
                                    • flyteplugins.vllm
                                      • VLLMAppEnvironment
                                • Weights & Biases
                                  • Classes
                                    • Packages
                                      • flyteplugins.wandb
                                        • Wandb
                                        • WandbSweep
                                The page you navigated to does not exist, so we brought you to the closest page to it.
                                Flyte OSS
                                Reference
                                Integrations
                                Spark
                                Packages
                                2.0.0b53

                                Packages

                                Package Description
                                flyteplugins.spark
                                flyteplugins.spark.df_transformer
                                flyteplugins.spark.task
                                On this page