# Classes

| Class | Description |
|-|-|
| [`flytekitplugins.inference.nim.serve.NIM`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/inference/packages/flytekitplugins.inference.nim.serve/page.md#flytekitpluginsinferencenimservenim) | |
| [`flytekitplugins.inference.nim.serve.NIMSecrets`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/inference/packages/flytekitplugins.inference.nim.serve/page.md#flytekitpluginsinferencenimservenimsecrets) | |
| [`flytekitplugins.inference.ollama.serve.Model`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/inference/packages/flytekitplugins.inference.ollama.serve/page.md#flytekitpluginsinferenceollamaservemodel) |Represents the configuration for a model used in a Kubernetes pod template. |
| [`flytekitplugins.inference.ollama.serve.Ollama`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/inference/packages/flytekitplugins.inference.ollama.serve/page.md#flytekitpluginsinferenceollamaserveollama) | |
| [`flytekitplugins.inference.sidecar_template.ModelInferenceTemplate`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/inference/packages/flytekitplugins.inference.sidecar_template/page.md#flytekitpluginsinferencesidecar_templatemodelinferencetemplate) | |
| [`flytekitplugins.inference.vllm.serve.HFSecret`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/inference/packages/flytekitplugins.inference.vllm.serve/page.md#flytekitpluginsinferencevllmservehfsecret) | |
| [`flytekitplugins.inference.vllm.serve.VLLM`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/inference/packages/flytekitplugins.inference.vllm.serve/page.md#flytekitpluginsinferencevllmservevllm) | |

---
**Source**: https://github.com/unionai/unionai-docs/blob/main/content/api-reference/plugins/inference/classes.md
**HTML**: https://www.union.ai/docs/v1/flyte/api-reference/plugins/inference/classes/