Preview Flyte 2 for production, hosted on Union.ai
Register now ↗
Flyte Docs
|
Version:
Signup
User guide
Tutorials
Reference
Platform deployment
Integrations
Architecture
Community
Flyte Docs
Signup
Documentation navigation for Flyte including user guides, tutorials, API references, and integration examples
  • LLM context documents
  • Pyflyte CLI
  • Flytectl CLI
    • flytectl
    • flytectl version
    • flytectl append
      • flytectl append identityassignments
    • flytectl apply
      • flytectl apply app
      • flytectl apply clusterconfig
      • flytectl apply clusterconfigid
      • flytectl apply clusterpoolconfig
    • flytectl config
      • flytectl config discover
      • flytectl config docs
      • flytectl config init
      • flytectl config validate
    • flytectl create
      • flytectl create app
      • flytectl create clusterpool
      • flytectl create clusterpoolassignment
      • flytectl create execution
      • flytectl create policy
      • flytectl create project
      • flytectl create role
    • flytectl delete
      • flytectl delete app
      • flytectl delete cluster
      • flytectl delete cluster-pool-attributes
      • flytectl delete cluster-resource-attribute
      • flytectl delete clusterconfig
      • flytectl delete clusterpool
      • flytectl delete clusterpoolassignment
      • flytectl delete execution
      • flytectl delete execution-cluster-label
      • flytectl delete execution-queue-attribute
      • flytectl delete identityassignments
      • flytectl delete plugin-override
      • flytectl delete policy
      • flytectl delete role
      • flytectl delete task-resource-attribute
      • flytectl delete workflow-execution-config
    • flytectl demo
      • flytectl demo exec
      • flytectl demo reload
      • flytectl demo start
      • flytectl demo status
      • flytectl demo teardown
    • flytectl get
      • flytectl get app
      • flytectl get cluster
      • flytectl get cluster-pool-attributes
      • flytectl get cluster-resource-attribute
      • flytectl get clusterconfig
      • flytectl get clusterconfigs
      • flytectl get clusterpool
      • flytectl get clusterpoolconfig
      • flytectl get clusterswithconfig
      • flytectl get echo
      • flytectl get execution
      • flytectl get execution-cluster-label
      • flytectl get execution-queue-attribute
      • flytectl get executionoperation
      • flytectl get identityassignment
      • flytectl get launchplan
      • flytectl get plugin-override
      • flytectl get policy
      • flytectl get project
      • flytectl get role
      • flytectl get task
      • flytectl get task-resource-attribute
      • flytectl get workflow
      • flytectl get workflow-execution-config
    • flytectl register
      • flytectl register examples
      • flytectl register files
    • flytectl update
      • flytectl update cluster-pool-attributes
      • flytectl update cluster-resource-attribute
      • flytectl update execution
      • flytectl update execution-cluster-label
      • flytectl update execution-queue-attribute
      • flytectl update launchplan
      • flytectl update launchplan-meta
      • flytectl update plugin-override
      • flytectl update project
      • flytectl update task-meta
      • flytectl update task-resource-attribute
      • flytectl update workflow-execution-config
      • flytectl update workflow-meta
  • Flyteidl
  • FlyteKit Plugins
    • Apache Airflow
      • Classes
      • Packages
        • flytekitplugins.airflow.connector
        • flytekitplugins.airflow.task
    • Async FSSpec
      • Classes
      • Packages
        • flytekitplugins.async_fsspec.s3fs.constants
        • flytekitplugins.async_fsspec.s3fs.s3fs
    • AWS Athena
      • Classes
      • Packages
        • flytekitplugins.athena.task
    • AWS Batch
      • Classes
      • Packages
        • flytekitplugins.awsbatch.task
    • AWS SageMaker
      • BigQuery
        • Classes
        • Packages
          • flytekitplugins.bigquery.connector
          • flytekitplugins.bigquery.task
      • Comet ML
        • flytekitplugins.comet_ml
      • Dask
        • Classes
        • Packages
          • flytekitplugins.dask.models
          • flytekitplugins.dask.task
      • DBT
        • Classes
        • Packages
          • flytekitplugins.dbt.error
          • flytekitplugins.dbt.schema
          • flytekitplugins.dbt.task
          • flytekitplugins.dbt.util
      • Deck
        • Dolt
          • DuckDB
            • Classes
            • Packages
              • flytekitplugins.duckdb.task
          • Envd
            • Classes
            • Packages
              • flytekitplugins.envd.image_builder
          • Flyte Interactive
            • Classes
            • Packages
              • flytekitplugins.flyteinteractive
              • flytekitplugins.flyteinteractive.constants
              • flytekitplugins.flyteinteractive.jupyter_lib.decorator
              • flytekitplugins.flyteinteractive.jupyter_lib.jupyter_constants
              • flytekitplugins.flyteinteractive.vscode_lib.config
              • flytekitplugins.flyteinteractive.vscode_lib.decorator
              • flytekitplugins.flyteinteractive.vscode_lib.vscode_constants
          • FSSpec
            • Google IAP
              • Classes
              • Packages
                • flytekitplugins.identity_aware_proxy.cli
            • Great Expectations
              • Classes
              • Packages
                • flytekitplugins.great_expectations.schema
                • flytekitplugins.great_expectations.task
            • Hive
              • Classes
              • Packages
                • flytekitplugins.hive.task
            • Hugging Face
              • Classes
              • Packages
                • flytekitplugins.huggingface.sd_transformers
            • Inference
              • Classes
              • Packages
                • flytekitplugins.inference.nim.serve
                • flytekitplugins.inference.ollama.serve
                • flytekitplugins.inference.sidecar_template
                • flytekitplugins.inference.vllm.serve
            • Kubeflow MPI
              • Classes
              • Packages
                • flytekitplugins.kfmpi.task
            • Kubeflow PyTorch
              • Classes
              • Packages
                • flytekitplugins.kfpytorch.error_handling
                • flytekitplugins.kfpytorch.pod_template
                • flytekitplugins.kfpytorch.task
            • Kubeflow TensorFlow
              • Classes
              • Packages
                • flytekitplugins.kftensorflow.task
            • Kubernetes Pod
              • Classes
              • Packages
                • flytekitplugins.pod.task
            • Memory Machine Cloud
              • Classes
              • Packages
                • flytekitplugins.mmcloud.connector
                • flytekitplugins.mmcloud.task
                • flytekitplugins.mmcloud.utils
            • Memray Profiling
              • Classes
              • Packages
                • flytekitplugins.memray
            • MLflow
              • flytekitplugins.mlflow.tracking
            • Modin
              • Neptune
                • flytekitplugins.neptune
              • OmegaConf
                • Classes
                • Packages
                  • flytekitplugins.omegaconf
              • ONNX PyTorch
                • ONNX ScikitLearn
                  • Classes
                  • Packages
                    • flytekitplugins.onnxscikitlearn.schema
                • ONNX TensorFlow
                  • OpenAI
                    • Classes
                    • Packages
                      • flytekitplugins.openai.batch.connector
                      • flytekitplugins.openai.batch.task
                      • flytekitplugins.openai.batch.workflow
                      • flytekitplugins.openai.chatgpt.connector
                      • flytekitplugins.openai.chatgpt.task
                  • Optuna
                    • Classes
                    • Packages
                      • flytekitplugins.optuna
                  • Pandera
                    • Classes
                    • Packages
                      • flytekitplugins.pandera.config
                      • flytekitplugins.pandera.pandas_renderer
                      • flytekitplugins.pandera.pandas_transformer
                  • Papermill
                    • Classes
                    • Packages
                      • flytekitplugins.papermill.task
                  • Perian Job Platform
                    • Classes
                    • Packages
                      • flytekitplugins.perian_job.agent
                      • flytekitplugins.perian_job.task
                  • Polars
                    • Classes
                    • Packages
                      • flytekitplugins.polars.sd_transformers
                  • Ray
                    • Classes
                    • Packages
                      • flytekitplugins.ray.models
                      • flytekitplugins.ray.task
                  • Slurm
                    • Classes
                    • Packages
                      • flytekitplugins.slurm.ssh_utils
                  • Snowflake
                    • Classes
                    • Packages
                      • flytekitplugins.snowflake.connector
                      • flytekitplugins.snowflake.task
                  • Spark
                    • Classes
                    • Packages
                      • flytekitplugins.spark.connector
                      • flytekitplugins.spark.generic_task
                      • flytekitplugins.spark.models
                      • flytekitplugins.spark.pyspark_transformers
                      • flytekitplugins.spark.schema
                      • flytekitplugins.spark.sd_transformers
                      • flytekitplugins.spark.task
                  • SQLAlchemy
                    • Classes
                    • Packages
                      • flytekitplugins.sqlalchemy.task
                  • Vaex
                    • Weights & Biases
                      • Classes
                      • Packages
                        • flytekitplugins.wandb
                    • whylogs
                      • Classes
                      • Packages
                        • flytekitplugins.whylogs
                  • Flytekit SDK
                    • Classes & Protocols
                    • Packages
                      • flytekit
                      • flytekit.bin.entrypoint
                      • flytekit.clients.auth_helper
                      • flytekit.clients.auth.auth_client
                      • flytekit.clients.auth.authenticator
                      • flytekit.clients.auth.default_html
                      • flytekit.clients.auth.exceptions
                      • flytekit.clients.auth.keyring
                      • flytekit.clients.auth.token_client
                      • flytekit.clients.friendly
                      • flytekit.clients.grpc_utils.auth_interceptor
                      • flytekit.clients.grpc_utils.default_metadata_interceptor
                      • flytekit.clients.grpc_utils.wrap_exception_interceptor
                      • flytekit.clients.helpers
                      • flytekit.clients.raw
                      • flytekit.clis.helpers
                      • flytekit.clis.sdk_in_container.backfill
                      • flytekit.clis.sdk_in_container.constants
                      • flytekit.clis.sdk_in_container.executions
                      • flytekit.clis.sdk_in_container.helpers
                      • flytekit.clis.sdk_in_container.metrics
                      • flytekit.clis.sdk_in_container.package
                      • flytekit.clis.sdk_in_container.serialize
                      • flytekit.clis.sdk_in_container.serve
                      • flytekit.clis.sdk_in_container.utils
                      • flytekit.clis.version
                      • flytekit.configuration
                      • flytekit.configuration.default_images
                      • flytekit.configuration.feature_flags
                      • flytekit.configuration.file
                      • flytekit.configuration.internal
                      • flytekit.configuration.plugin
                      • flytekit.constants
                      • flytekit.core.annotation
                      • flytekit.core.array_node
                      • flytekit.core.array_node_map_task
                      • flytekit.core.artifact
                      • flytekit.core.artifact_utils
                      • flytekit.core.base_sql_task
                      • flytekit.core.base_task
                      • flytekit.core.cache
                      • flytekit.core.checkpointer
                      • flytekit.core.class_based_resolver
                      • flytekit.core.condition
                      • flytekit.core.constants
                      • flytekit.core.container_task
                      • flytekit.core.context_manager
                      • flytekit.core.data_persistence
                      • flytekit.core.docstring
                      • flytekit.core.environment
                      • flytekit.core.gate
                      • flytekit.core.hash
                      • flytekit.core.interface
                      • flytekit.core.launch_plan
                      • flytekit.core.legacy_map_task
                      • flytekit.core.local_cache
                      • flytekit.core.local_fsspec
                      • flytekit.core.mock_stats
                      • flytekit.core.node
                      • flytekit.core.node_creation
                      • flytekit.core.notification
                      • flytekit.core.options
                      • flytekit.core.pod_template
                      • flytekit.core.promise
                      • flytekit.core.python_auto_container
                      • flytekit.core.python_customized_container_task
                      • flytekit.core.python_function_task
                      • flytekit.core.reference
                      • flytekit.core.reference_entity
                      • flytekit.core.resources
                      • flytekit.core.schedule
                      • flytekit.core.shim_task
                      • flytekit.core.task
                      • flytekit.core.testing
                      • flytekit.core.tracked_abc
                      • flytekit.core.tracker
                      • flytekit.core.type_engine
                      • flytekit.core.type_helpers
                      • flytekit.core.type_match_checking
                      • flytekit.core.utils
                      • flytekit.core.worker_queue
                      • flytekit.core.workflow
                      • flytekit.deck.deck
                      • flytekit.deck.renderer
                      • flytekit.exceptions.base
                      • flytekit.exceptions.eager
                      • flytekit.exceptions.scopes
                      • flytekit.exceptions.system
                      • flytekit.exceptions.user
                      • flytekit.exceptions.utils
                      • flytekit.experimental.eager_function
                      • flytekit.extend.backend.base_connector
                      • flytekit.extend.backend.connector_service
                      • flytekit.extend.backend.utils
                      • flytekit.extras.accelerators
                      • flytekit.extras.cloud_pickle_resolver
                      • flytekit.extras.pydantic_transformer.transformer
                      • flytekit.extras.pytorch.checkpoint
                      • flytekit.extras.pytorch.native
                      • flytekit.extras.sklearn.native
                      • flytekit.extras.sqlite3.task
                      • flytekit.extras.tasks.shell
                      • flytekit.extras.tensorflow.model
                      • flytekit.extras.tensorflow.record
                      • flytekit.extras.webhook
                      • flytekit.extras.webhook.connector
                      • flytekit.extras.webhook.constants
                      • flytekit.extras.webhook.task
                      • flytekit.image_spec.default_builder
                      • flytekit.image_spec.image_spec
                      • flytekit.image_spec.noop_builder
                      • flytekit.interaction.click_types
                      • flytekit.interaction.parse_stdin
                      • flytekit.interaction.rich_utils
                      • flytekit.interaction.string_literals
                      • flytekit.interactive
                      • flytekit.interactive.constants
                      • flytekit.interactive.utils
                      • flytekit.interactive.vscode_lib.config
                      • flytekit.interactive.vscode_lib.decorator
                      • flytekit.interactive.vscode_lib.vscode_constants
                      • flytekit.interfaces.cli_identifiers
                      • flytekit.interfaces.random
                      • flytekit.interfaces.stats.client
                      • flytekit.interfaces.stats.taggable
                      • flytekit.lazy_import.lazy_module
                      • flytekit.loggers
                      • flytekit.models.admin.common
                      • flytekit.models.admin.task_execution
                      • flytekit.models.admin.workflow
                      • flytekit.models.annotation
                      • flytekit.models.array_job
                      • flytekit.models.common
                      • flytekit.models.concurrency
                      • flytekit.models.core.catalog
                      • flytekit.models.core.compiler
                      • flytekit.models.core.condition
                      • flytekit.models.core.errors
                      • flytekit.models.core.execution
                      • flytekit.models.core.identifier
                      • flytekit.models.core.types
                      • flytekit.models.core.workflow
                      • flytekit.models.documentation
                      • flytekit.models.domain
                      • flytekit.models.dynamic_job
                      • flytekit.models.event
                      • flytekit.models.execution
                      • flytekit.models.filters
                      • flytekit.models.interface
                      • flytekit.models.launch_plan
                      • flytekit.models.literals
                      • flytekit.models.matchable_resource
                      • flytekit.models.named_entity
                      • flytekit.models.node_execution
                      • flytekit.models.presto
                      • flytekit.models.project
                      • flytekit.models.qubole
                      • flytekit.models.schedule
                      • flytekit.models.security
                      • flytekit.models.task
                      • flytekit.models.types
                      • flytekit.models.workflow_closure
                      • flytekit.remote.backfill
                      • flytekit.remote.data
                      • flytekit.remote.entities
                      • flytekit.remote.executions
                      • flytekit.remote.interface
                      • flytekit.remote.lazy_entity
                      • flytekit.remote.metrics
                      • flytekit.remote.remote
                      • flytekit.remote.remote_callable
                      • flytekit.remote.remote_fs
                      • flytekit.sensor.base_sensor
                      • flytekit.sensor.file_sensor
                      • flytekit.sensor.sensor_engine
                      • flytekit.tools.fast_registration
                      • flytekit.tools.ignore
                      • flytekit.tools.interactive
                      • flytekit.tools.module_loader
                      • flytekit.tools.repo
                      • flytekit.tools.script_mode
                      • flytekit.tools.serialize_helpers
                      • flytekit.tools.subprocess
                      • flytekit.tools.translator
                      • flytekit.types.directory
                      • flytekit.types.directory.types
                      • flytekit.types.error.error
                      • flytekit.types.file
                      • flytekit.types.file.file
                      • flytekit.types.file.image
                      • flytekit.types.iterator.iterator
                      • flytekit.types.iterator.json_iterator
                      • flytekit.types.numpy.ndarray
                      • flytekit.types.pickle.pickle
                      • flytekit.types.schema.types
                      • flytekit.types.schema.types_pandas
                      • flytekit.types.structured
                      • flytekit.types.structured.basic_dfs
                      • flytekit.types.structured.bigquery
                      • flytekit.types.structured.snowflake
                      • flytekit.types.structured.structured_dataset
                      • flytekit.utils.asyn
                      • flytekit.utils.dict_formatter
                      • flytekit.utils.pbhash
                      • flytekit.utils.rate_limiter
                  The page you navigated to does not exist, so we brought you to the closest page to it.
                  Flyte OSS
                  Reference
                  FlyteKit Plugins
                  OpenAI
                  Classes
                  1.16.14

                  Classes

                  Class Description
                  flytekitplugins.openai.batch.connector.BatchEndpointConnector
                  flytekitplugins.openai.batch.connector.BatchEndpointMetadata
                  flytekitplugins.openai.batch.connector.State
                  flytekitplugins.openai.batch.task.BatchEndpointTask
                  flytekitplugins.openai.batch.task.BatchResult
                  flytekitplugins.openai.batch.task.DownloadJSONFilesExecutor
                  flytekitplugins.openai.batch.task.DownloadJSONFilesTask
                  flytekitplugins.openai.batch.task.OpenAIFileConfig
                  flytekitplugins.openai.batch.task.OpenAIFileDefaultImages Default images for the openai batch plugin.
                  flytekitplugins.openai.batch.task.UploadJSONLFileExecutor
                  flytekitplugins.openai.batch.task.UploadJSONLFileTask
                  flytekitplugins.openai.chatgpt.connector.ChatGPTConnector
                  flytekitplugins.openai.chatgpt.task.ChatGPTTask This is the simplest form of a ChatGPT Task, you can define the model and the input you want.
                  LLM-optimized This page Full docs index
                  On this page