1.16.32
Inference
Directory
Classes
| Class | Description |
|---|---|
flytekitplugins.inference.nim.serve.NIM |
|
flytekitplugins.inference.nim.serve.NIMSecrets |
|
flytekitplugins.inference.ollama.serve.Model |
Represents the configuration for a model used in a Kubernetes pod template. |
flytekitplugins.inference.ollama.serve.Ollama |
|
flytekitplugins.inference.sidecar_template.ModelInferenceTemplate |
|
flytekitplugins.inference.vllm.serve.HFSecret |
|
flytekitplugins.inference.vllm.serve.VLLM |