2.0.9
ShardConfig
Package: flyte.prefetch
Configuration for model sharding.
Parameters
class ShardConfig(
engine: typing.Literal['vllm'],
args: *args,
)Create a new model by parsing and validating input data from keyword arguments.
Raises
ValidationError if the input data cannot be
validated to form a valid model.
self is explicitly positional-only to allow self as a field name.
| Parameter | Type | Description |
|---|---|---|
engine |
typing.Literal['vllm'] |
The sharding engine to use (currently only “vllm” is supported). |
args |
*args |
Arguments for the sharding engine. |