1.16.28
Inference
Directory
Classes
| Class | Description |
|---|---|
flytekitplugins.inference.nim.serve.NIM |
|
flytekitplugins.inference.nim.serve.NIMSecrets |
|
flytekitplugins.inference.ollama.serve.Model |
Represents the configuration for a model used in a Kubernetes pod template. |
flytekitplugins.inference.ollama.serve.Ollama |
|
flytekitplugins.inference.sidecar_template.ModelInferenceTemplate |
|
flytekitplugins.inference.vllm.serve.HFSecret |
|
flytekitplugins.inference.vllm.serve.VLLM |
Packages
| Package | Description |
|---|---|
flytekitplugins.inference.nim.serve |
|
flytekitplugins.inference.ollama.serve |
|
flytekitplugins.inference.sidecar_template |
|
flytekitplugins.inference.vllm.serve |