Preview Flyte 2 for production, hosted on Union.ai
Register now
↗
Flyte Docs
|
Product:
Flyte OSS
Union.ai BYOC
Union.ai Self-managed
Version:
v2
v1
Signup
User guide
Tutorials
Reference
Platform deployment
Integrations
Architecture
Community
Flyte Docs
User guide
Tutorials
Reference
Platform deployment
Integrations
Architecture
Community
Signup
Documentation navigation for Flyte including user guides, tutorials, API references, and integration examples
LLM context documents
Pyflyte CLI
Flytectl CLI
flytectl
flytectl version
flytectl append
flytectl append identityassignments
flytectl apply
flytectl apply app
flytectl apply clusterconfig
flytectl apply clusterconfigid
flytectl apply clusterpoolconfig
flytectl config
flytectl config discover
flytectl config docs
flytectl config init
flytectl config validate
flytectl create
flytectl create app
flytectl create clusterpool
flytectl create clusterpoolassignment
flytectl create execution
flytectl create policy
flytectl create project
flytectl create role
flytectl delete
flytectl delete app
flytectl delete cluster
flytectl delete cluster-pool-attributes
flytectl delete cluster-resource-attribute
flytectl delete clusterconfig
flytectl delete clusterpool
flytectl delete clusterpoolassignment
flytectl delete execution
flytectl delete execution-cluster-label
flytectl delete execution-queue-attribute
flytectl delete identityassignments
flytectl delete plugin-override
flytectl delete policy
flytectl delete role
flytectl delete task-resource-attribute
flytectl delete workflow-execution-config
flytectl demo
flytectl demo exec
flytectl demo reload
flytectl demo start
flytectl demo status
flytectl demo teardown
flytectl get
flytectl get app
flytectl get cluster
flytectl get cluster-pool-attributes
flytectl get cluster-resource-attribute
flytectl get clusterconfig
flytectl get clusterconfigs
flytectl get clusterpool
flytectl get clusterpoolconfig
flytectl get clusterswithconfig
flytectl get echo
flytectl get execution
flytectl get execution-cluster-label
flytectl get execution-queue-attribute
flytectl get executionoperation
flytectl get identityassignment
flytectl get launchplan
flytectl get plugin-override
flytectl get policy
flytectl get project
flytectl get role
flytectl get task
flytectl get task-resource-attribute
flytectl get workflow
flytectl get workflow-execution-config
flytectl register
flytectl register examples
flytectl register files
flytectl update
flytectl update cluster-pool-attributes
flytectl update cluster-resource-attribute
flytectl update execution
flytectl update execution-cluster-label
flytectl update execution-queue-attribute
flytectl update launchplan
flytectl update launchplan-meta
flytectl update plugin-override
flytectl update project
flytectl update task-meta
flytectl update task-resource-attribute
flytectl update workflow-execution-config
flytectl update workflow-meta
Flyteidl
FlyteKit Plugins
Apache Airflow
Classes
Packages
flytekitplugins.airflow.connector
flytekitplugins.airflow.task
Async FSSpec
Classes
Packages
flytekitplugins.async_fsspec.s3fs.constants
flytekitplugins.async_fsspec.s3fs.s3fs
AWS Athena
Classes
Packages
flytekitplugins.athena.task
AWS Batch
Classes
Packages
flytekitplugins.awsbatch.task
AWS SageMaker
BigQuery
Classes
Packages
flytekitplugins.bigquery.connector
flytekitplugins.bigquery.task
Comet ML
flytekitplugins.comet_ml
Dask
Classes
Packages
flytekitplugins.dask.models
flytekitplugins.dask.task
DBT
Classes
Packages
flytekitplugins.dbt.error
flytekitplugins.dbt.schema
flytekitplugins.dbt.task
flytekitplugins.dbt.util
Deck
Dolt
DuckDB
Classes
Packages
flytekitplugins.duckdb.task
Envd
Classes
Packages
flytekitplugins.envd.image_builder
Flyte Interactive
Classes
Packages
flytekitplugins.flyteinteractive
flytekitplugins.flyteinteractive.constants
flytekitplugins.flyteinteractive.jupyter_lib.decorator
flytekitplugins.flyteinteractive.jupyter_lib.jupyter_constants
flytekitplugins.flyteinteractive.vscode_lib.config
flytekitplugins.flyteinteractive.vscode_lib.decorator
flytekitplugins.flyteinteractive.vscode_lib.vscode_constants
FSSpec
Google IAP
Classes
Packages
flytekitplugins.identity_aware_proxy.cli
Great Expectations
Classes
Packages
flytekitplugins.great_expectations.schema
flytekitplugins.great_expectations.task
Hive
Classes
Packages
flytekitplugins.hive.task
Hugging Face
Classes
Packages
flytekitplugins.huggingface.sd_transformers
Inference
Classes
Packages
flytekitplugins.inference.nim.serve
flytekitplugins.inference.ollama.serve
flytekitplugins.inference.sidecar_template
flytekitplugins.inference.vllm.serve
Kubeflow MPI
Classes
Packages
flytekitplugins.kfmpi.task
Kubeflow PyTorch
Classes
Packages
flytekitplugins.kfpytorch.error_handling
flytekitplugins.kfpytorch.pod_template
flytekitplugins.kfpytorch.task
Kubeflow TensorFlow
Classes
Packages
flytekitplugins.kftensorflow.task
Kubernetes Pod
Classes
Packages
flytekitplugins.pod.task
Memory Machine Cloud
Classes
Packages
flytekitplugins.mmcloud.connector
flytekitplugins.mmcloud.task
flytekitplugins.mmcloud.utils
Memray Profiling
Classes
Packages
flytekitplugins.memray
MLflow
flytekitplugins.mlflow.tracking
Modin
Neptune
flytekitplugins.neptune
OmegaConf
Classes
Packages
flytekitplugins.omegaconf
ONNX PyTorch
ONNX ScikitLearn
Classes
Packages
flytekitplugins.onnxscikitlearn.schema
ONNX TensorFlow
OpenAI
Classes
Packages
flytekitplugins.openai.batch.connector
flytekitplugins.openai.batch.task
flytekitplugins.openai.batch.workflow
flytekitplugins.openai.chatgpt.connector
flytekitplugins.openai.chatgpt.task
Optuna
Classes
Packages
flytekitplugins.optuna
Pandera
Classes
Packages
flytekitplugins.pandera.config
flytekitplugins.pandera.pandas_renderer
flytekitplugins.pandera.pandas_transformer
Papermill
Classes
Packages
flytekitplugins.papermill.task
Perian Job Platform
Classes
Packages
flytekitplugins.perian_job.agent
flytekitplugins.perian_job.task
Polars
Classes
Packages
flytekitplugins.polars.sd_transformers
Ray
Classes
Packages
flytekitplugins.ray.models
flytekitplugins.ray.task
Slurm
Classes
Packages
flytekitplugins.slurm.ssh_utils
Snowflake
Classes
Packages
flytekitplugins.snowflake.connector
flytekitplugins.snowflake.task
Spark
Classes
Packages
flytekitplugins.spark.connector
flytekitplugins.spark.generic_task
flytekitplugins.spark.models
flytekitplugins.spark.pyspark_transformers
flytekitplugins.spark.schema
flytekitplugins.spark.sd_transformers
flytekitplugins.spark.task
SQLAlchemy
Classes
Packages
flytekitplugins.sqlalchemy.task
Vaex
Weights & Biases
Classes
Packages
flytekitplugins.wandb
whylogs
Classes
Packages
flytekitplugins.whylogs
Flytekit SDK
Classes & Protocols
Packages
flytekit
flytekit.bin.entrypoint
flytekit.clients.auth_helper
flytekit.clients.auth.auth_client
flytekit.clients.auth.authenticator
flytekit.clients.auth.default_html
flytekit.clients.auth.exceptions
flytekit.clients.auth.keyring
flytekit.clients.auth.token_client
flytekit.clients.friendly
flytekit.clients.grpc_utils.auth_interceptor
flytekit.clients.grpc_utils.default_metadata_interceptor
flytekit.clients.grpc_utils.wrap_exception_interceptor
flytekit.clients.helpers
flytekit.clients.raw
flytekit.clis.helpers
flytekit.clis.sdk_in_container.backfill
flytekit.clis.sdk_in_container.constants
flytekit.clis.sdk_in_container.executions
flytekit.clis.sdk_in_container.helpers
flytekit.clis.sdk_in_container.metrics
flytekit.clis.sdk_in_container.package
flytekit.clis.sdk_in_container.serialize
flytekit.clis.sdk_in_container.serve
flytekit.clis.sdk_in_container.utils
flytekit.clis.version
flytekit.configuration
flytekit.configuration.default_images
flytekit.configuration.feature_flags
flytekit.configuration.file
flytekit.configuration.internal
flytekit.configuration.plugin
flytekit.constants
flytekit.core.annotation
flytekit.core.array_node
flytekit.core.array_node_map_task
flytekit.core.artifact
flytekit.core.artifact_utils
flytekit.core.base_sql_task
flytekit.core.base_task
flytekit.core.cache
flytekit.core.checkpointer
flytekit.core.class_based_resolver
flytekit.core.condition
flytekit.core.constants
flytekit.core.container_task
flytekit.core.context_manager
flytekit.core.data_persistence
flytekit.core.docstring
flytekit.core.environment
flytekit.core.gate
flytekit.core.hash
flytekit.core.interface
flytekit.core.launch_plan
flytekit.core.legacy_map_task
flytekit.core.local_cache
flytekit.core.local_fsspec
flytekit.core.mock_stats
flytekit.core.node
flytekit.core.node_creation
flytekit.core.notification
flytekit.core.options
flytekit.core.pod_template
flytekit.core.promise
flytekit.core.python_auto_container
flytekit.core.python_customized_container_task
flytekit.core.python_function_task
flytekit.core.reference
flytekit.core.reference_entity
flytekit.core.resources
flytekit.core.schedule
flytekit.core.shim_task
flytekit.core.task
flytekit.core.testing
flytekit.core.tracked_abc
flytekit.core.tracker
flytekit.core.type_engine
flytekit.core.type_helpers
flytekit.core.type_match_checking
flytekit.core.utils
flytekit.core.worker_queue
flytekit.core.workflow
flytekit.deck.deck
flytekit.deck.renderer
flytekit.exceptions.base
flytekit.exceptions.eager
flytekit.exceptions.scopes
flytekit.exceptions.system
flytekit.exceptions.user
flytekit.exceptions.utils
flytekit.experimental.eager_function
flytekit.extend.backend.base_connector
flytekit.extend.backend.connector_service
flytekit.extend.backend.utils
flytekit.extras.accelerators
flytekit.extras.cloud_pickle_resolver
flytekit.extras.pydantic_transformer.transformer
flytekit.extras.pytorch.checkpoint
flytekit.extras.pytorch.native
flytekit.extras.sklearn.native
flytekit.extras.sqlite3.task
flytekit.extras.tasks.shell
flytekit.extras.tensorflow.model
flytekit.extras.tensorflow.record
flytekit.extras.webhook
flytekit.extras.webhook.connector
flytekit.extras.webhook.constants
flytekit.extras.webhook.task
flytekit.image_spec.default_builder
flytekit.image_spec.image_spec
flytekit.image_spec.noop_builder
flytekit.interaction.click_types
flytekit.interaction.parse_stdin
flytekit.interaction.rich_utils
flytekit.interaction.string_literals
flytekit.interactive
flytekit.interactive.constants
flytekit.interactive.utils
flytekit.interactive.vscode_lib.config
flytekit.interactive.vscode_lib.decorator
flytekit.interactive.vscode_lib.vscode_constants
flytekit.interfaces.cli_identifiers
flytekit.interfaces.random
flytekit.interfaces.stats.client
flytekit.interfaces.stats.taggable
flytekit.lazy_import.lazy_module
flytekit.loggers
flytekit.models.admin.common
flytekit.models.admin.task_execution
flytekit.models.admin.workflow
flytekit.models.annotation
flytekit.models.array_job
flytekit.models.common
flytekit.models.concurrency
flytekit.models.core.catalog
flytekit.models.core.compiler
flytekit.models.core.condition
flytekit.models.core.errors
flytekit.models.core.execution
flytekit.models.core.identifier
flytekit.models.core.types
flytekit.models.core.workflow
flytekit.models.documentation
flytekit.models.domain
flytekit.models.dynamic_job
flytekit.models.event
flytekit.models.execution
flytekit.models.filters
flytekit.models.interface
flytekit.models.launch_plan
flytekit.models.literals
flytekit.models.matchable_resource
flytekit.models.named_entity
flytekit.models.node_execution
flytekit.models.presto
flytekit.models.project
flytekit.models.qubole
flytekit.models.schedule
flytekit.models.security
flytekit.models.task
flytekit.models.types
flytekit.models.workflow_closure
flytekit.remote.backfill
flytekit.remote.data
flytekit.remote.entities
flytekit.remote.executions
flytekit.remote.interface
flytekit.remote.lazy_entity
flytekit.remote.metrics
flytekit.remote.remote
flytekit.remote.remote_callable
flytekit.remote.remote_fs
flytekit.sensor.base_sensor
flytekit.sensor.file_sensor
flytekit.sensor.sensor_engine
flytekit.tools.fast_registration
flytekit.tools.ignore
flytekit.tools.interactive
flytekit.tools.module_loader
flytekit.tools.repo
flytekit.tools.script_mode
flytekit.tools.serialize_helpers
flytekit.tools.subprocess
flytekit.tools.translator
flytekit.types.directory
flytekit.types.directory.types
flytekit.types.error.error
flytekit.types.file
flytekit.types.file.file
flytekit.types.file.image
flytekit.types.iterator.iterator
flytekit.types.iterator.json_iterator
flytekit.types.numpy.ndarray
flytekit.types.pickle.pickle
flytekit.types.schema.types
flytekit.types.schema.types_pandas
flytekit.types.structured
flytekit.types.structured.basic_dfs
flytekit.types.structured.bigquery
flytekit.types.structured.snowflake
flytekit.types.structured.structured_dataset
flytekit.utils.asyn
flytekit.utils.dict_formatter
flytekit.utils.pbhash
flytekit.utils.rate_limiter
The page you navigated to
does not exist, so we brought you to the closest page to it.
Flyte OSS
Reference
FlyteKit Plugins
Spark
1.16.14
Spark
LLM-optimized
This page
Full docs index
On this page
Ask AI
