AWS SageMaker Inference Connector
The AWS SageMaker inference connector allows you to deploy models, and create and trigger inference endpoints. You can also fully remove the SageMaker deployment.
Installation
To use the AWS SageMaker inference connector, run the following command:
$ pip install flytekitplugins-awssagemakerExample usage
For a usage example, see AWS SageMaker inference connector example usage
Local testing
To test an connector locally, create a class for the connector task that inherits from SyncConnectorExecutorMixin or AsyncConnectorExecutorMixin. These mixins can handle synchronous and synchronous tasks, respectively, and allow flytekit to mimic FlytePropeller’s behavior in calling the connector.
Flyte deployment configuration
If you are using a managed deployment of Flyte, you will need to contact your deployment administrator to configure connectors in your deployment.
To enable the AWS SageMaker inference connector in your Flyte deployment, refer to the AWS SageMaker inference connector setup guide.