# Packages

| Package | Description |
|-|-|
| [`flytekitplugins.inference.nim.serve`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/inference/packages/flytekitplugins.inference.nim.serve/page.md) |  |
| [`flytekitplugins.inference.ollama.serve`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/inference/packages/flytekitplugins.inference.ollama.serve/page.md) |  |
| [`flytekitplugins.inference.sidecar_template`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/inference/packages/flytekitplugins.inference.sidecar_template/page.md) |  |
| [`flytekitplugins.inference.vllm.serve`](https://www.union.ai/docs/v1/flyte/api-reference/plugins/inference/packages/flytekitplugins.inference.vllm.serve/page.md) |  |

## Subpages

- [flytekitplugins.inference.nim.serve](https://www.union.ai/docs/v1/flyte/api-reference/plugins/inference/packages/flytekitplugins.inference.nim.serve/page.md)
  - Directory
  - Classes
  - flytekitplugins.inference.nim.serve.NIM
  - Parameters
  - Properties
  - Methods
  - flytekitplugins.inference.nim.serve.NIMSecrets
  - Parameters
- [flytekitplugins.inference.ollama.serve](https://www.union.ai/docs/v1/flyte/api-reference/plugins/inference/packages/flytekitplugins.inference.ollama.serve/page.md)
  - Directory
  - Classes
  - flytekitplugins.inference.ollama.serve.Model
  - Parameters
  - flytekitplugins.inference.ollama.serve.Ollama
  - Parameters
  - Properties
  - Methods
- [flytekitplugins.inference.sidecar_template](https://www.union.ai/docs/v1/flyte/api-reference/plugins/inference/packages/flytekitplugins.inference.sidecar_template/page.md)
  - Directory
  - Classes
  - flytekitplugins.inference.sidecar_template.ModelInferenceTemplate
  - Parameters
  - Properties
- [flytekitplugins.inference.vllm.serve](https://www.union.ai/docs/v1/flyte/api-reference/plugins/inference/packages/flytekitplugins.inference.vllm.serve/page.md)
  - Directory
  - Classes
  - flytekitplugins.inference.vllm.serve.HFSecret
  - Parameters
  - flytekitplugins.inference.vllm.serve.VLLM
  - Parameters
  - Properties
  - Methods

---
**Source**: https://github.com/unionai/unionai-docs/blob/main/content/api-reference/plugins/inference/packages/_index.md
**HTML**: https://www.union.ai/docs/v1/flyte/api-reference/plugins/inference/packages/