# Classes

| Class | Description |
|-|-|
| [`flytekitplugins.spark.connector.DatabricksConnector`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.connector/page.md#flytekitpluginssparkconnectordatabricksconnector) | |
| [`flytekitplugins.spark.connector.DatabricksConnectorV2`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.connector/page.md#flytekitpluginssparkconnectordatabricksconnectorv2) |Add DatabricksConnectorV2 to support running the k8s spark and databricks spark together in the same workflow. |
| [`flytekitplugins.spark.connector.DatabricksJobMetadata`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.connector/page.md#flytekitpluginssparkconnectordatabricksjobmetadata) | |
| [`flytekitplugins.spark.generic_task.GenericSparkConf`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.generic_task/page.md#flytekitpluginssparkgeneric_taskgenericsparkconf) | |
| [`flytekitplugins.spark.generic_task.GenericSparkTask`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.generic_task/page.md#flytekitpluginssparkgeneric_taskgenericsparktask) | |
| [`flytekitplugins.spark.models.SparkJob`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.models/page.md#flytekitpluginssparkmodelssparkjob) | |
| [`flytekitplugins.spark.models.SparkType`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.models/page.md#flytekitpluginssparkmodelssparktype) | |
| [`flytekitplugins.spark.pyspark_transformers.PySparkPipelineModelTransformer`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.pyspark_transformers/page.md#flytekitpluginssparkpyspark_transformerspysparkpipelinemodeltransformer) | |
| [`flytekitplugins.spark.schema.ClassicSparkDataFrameSchemaReader`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.schema/page.md#flytekitpluginssparkschemaclassicsparkdataframeschemareader) |Implements how Classic SparkDataFrame should be read using the ``open`` method of FlyteSchema. |
| [`flytekitplugins.spark.schema.ClassicSparkDataFrameSchemaWriter`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.schema/page.md#flytekitpluginssparkschemaclassicsparkdataframeschemawriter) |Implements how Classic SparkDataFrame should be written using ``open`` method of FlyteSchema. |
| [`flytekitplugins.spark.schema.ClassicSparkDataFrameTransformer`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.schema/page.md#flytekitpluginssparkschemaclassicsparkdataframetransformer) |Transforms Classic Spark DataFrame's to and from a Schema (typed/untyped). |
| [`flytekitplugins.spark.schema.SparkDataFrameSchemaReader`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.schema/page.md#flytekitpluginssparkschemasparkdataframeschemareader) |Implements how SparkDataFrame should be read using the ``open`` method of FlyteSchema. |
| [`flytekitplugins.spark.schema.SparkDataFrameSchemaWriter`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.schema/page.md#flytekitpluginssparkschemasparkdataframeschemawriter) |Implements how SparkDataFrame should be written to using ``open`` method of FlyteSchema. |
| [`flytekitplugins.spark.schema.SparkDataFrameTransformer`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.schema/page.md#flytekitpluginssparkschemasparkdataframetransformer) |Transforms Spark DataFrame's to and from a Schema (typed/untyped). |
| [`flytekitplugins.spark.sd_transformers.ClassicSparkToParquetEncodingHandler`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.sd_transformers/page.md#flytekitpluginssparksd_transformersclassicsparktoparquetencodinghandler) | |
| [`flytekitplugins.spark.sd_transformers.ParquetToClassicSparkDecodingHandler`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.sd_transformers/page.md#flytekitpluginssparksd_transformersparquettoclassicsparkdecodinghandler) | |
| [`flytekitplugins.spark.sd_transformers.ParquetToSparkDecodingHandler`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.sd_transformers/page.md#flytekitpluginssparksd_transformersparquettosparkdecodinghandler) | |
| [`flytekitplugins.spark.sd_transformers.SparkDataFrameRenderer`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.sd_transformers/page.md#flytekitpluginssparksd_transformerssparkdataframerenderer) |Render a Spark dataframe schema as an HTML table. |
| [`flytekitplugins.spark.sd_transformers.SparkToParquetEncodingHandler`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.sd_transformers/page.md#flytekitpluginssparksd_transformerssparktoparquetencodinghandler) | |
| [`flytekitplugins.spark.task.Databricks`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.task/page.md#flytekitpluginssparktaskdatabricks) |Deprecated. |
| [`flytekitplugins.spark.task.DatabricksV2`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.task/page.md#flytekitpluginssparktaskdatabricksv2) |Use this to configure a Databricks task. |
| [`flytekitplugins.spark.task.PysparkFunctionTask`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.task/page.md#flytekitpluginssparktaskpysparkfunctiontask) |Actual Plugin that transforms the local python code for execution within a spark context. |
| [`flytekitplugins.spark.task.Spark`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/packages/flytekitplugins.spark.task/page.md#flytekitpluginssparktaskspark) |Use this to configure a SparkContext for a your task. |

---
**Source**: https://github.com/unionai/unionai-docs/blob/main/content/api-reference/plugins/spark/classes.md
**HTML**: https://www.union.ai/docs/v1/flyte/api-reference/plugins/spark/classes/