FlyteModel

Package: flyteplugins.agents.openai

Wrap a agents.models.interface.Model so each turn is durable.

get_response is recorded/replayed via durable_step. stream_response is delegated unchanged: streamed turns are not memoized in this version (tool calls remain durable regardless).

Parameters

class FlyteModel(
    inner: Model,
)

Methods

close()

def close()

Release any resources held by the model.

Models that maintain persistent connections can override this. The default implementation is a no-op.

get_response()

def get_response(
    *args: typing.Any,
    **kwargs: typing.Any,
) -> typing.Any

Get a response from the model.

Returns: The full model response.

stream_response()

def stream_response(
    *args: typing.Any,
    **kwargs: typing.Any,
) -> AsyncIterator[typing.Any]

Stream a response from the model.

Returns: An iterator of response stream events, in OpenAI Responses format.