MemVerge Memory Machine Cloud (MMC) connector

MemVerge Memory Machine Cloud (MMCloud)—available on AWS, GCP, and AliCloud—empowers users to continuously optimize cloud resources during runtime, safely execute stateful tasks on spot instances, and monitor resource usage in real time. These capabilities make it an excellent fit for long-running batch workloads. Union.ai can be integrated with MMCloud, allowing you to execute Union.ai tasks using MMCloud.

Installation

To install the MMCloud connector, run the following command:

pip install flytekitplugins-mmcloud

To get started with Memory Machine Cloud, see the Memory Machine Cloud user guide.

Example usage

For a usage example, see Memory Machine Cloud connector example.

Local testing

To test the MMCloud connector locally, create a class for the connector task that inherits from AsyncConnectorExecutorMixin. This mixin allows flytekit to mimic FlytePropeller’s behavior in calling the connector.

In some cases, you will need to store credentials in your local environment when

Union.ai cluster deployment

After you have finished testing the connector locally, contact the Union.ai team to enable it in your cluster.