AWS SageMaker inference connector

The AWS SageMaker inference connector allows you to deploy models, and create and trigger inference endpoints. You can also fully remove the SageMaker deployment.

Installation

To use the AWS SageMaker inference connector, run the following command:

pip install flytekitplugins-awssagemaker

Example usage

For a usage example, see AWS SageMaker inference connector example.

Local testing

To test the SageMaker inference connector locally, create a class for the connector task that inherits from AsyncConnctorExecutorMixin. This mixin can handle synchronous tasks and allows Union to mimic FlytePropeller’s behavior in calling the connector.