Snowflake connector

Flyte can be seamlessly integrated with the Snowflake service, providing you with a straightforward means to query data in Snowflake.

Installation

To use the Snowflake connector, run the following command:

$ pip install flytekitplugins-snowflake

Example usage

For a usage example, see Snowflake connector example usage.

Local testing

To test the Snowflake connector locally, create a class for the connector task that inherits from AsyncConnectorExecutorMixin. This mixin can handle asynchronous tasks and allows flytekit to mimic FlytePropeller’s behavior in calling the connector.

In some cases, you will need to store credentials in your local environment when testing locally.

Flyte deployment configuration

If you are using a managed deployment of Flyte, you will need to contact your deployment administrator to configure connectors in your deployment.

To enable the Snowflake connector in your Flyte deployment, see the Snowflake connector setup guide.