Flyte 2 is available today for local execution - distributed execution coming to open source soon. Preview Flyte 2 for production, hosted on Union.ai
2.0.9

Classes

Class Description
flyteplugins.sglang.SGLangAppEnvironment App environment backed by SGLang for serving large language models.