2.0.6

BatchStats

Package: flyte.extras

Monitoring statistics exposed by :attr:DynamicBatcher.stats.

Attributes: total_submitted: Total records submitted via :meth:submit. total_completed: Total records whose futures have been resolved. total_batches: Number of batches dispatched. total_batch_cost: Sum of estimated cost across all batches. avg_batch_size: Running average records per batch. avg_batch_cost: Running average cost per batch. busy_time_s: Cumulative seconds spent inside process_fn. idle_time_s: Cumulative seconds the processing loop waited for a batch to be assembled.

class BatchStats(
    total_submitted: int,
    total_completed: int,
    total_batches: int,
    total_batch_cost: int,
    avg_batch_size: float,
    avg_batch_cost: float,
    busy_time_s: float,
    idle_time_s: float,
)
Parameter Type Description
total_submitted int
total_completed int
total_batches int
total_batch_cost int
avg_batch_size float
avg_batch_cost float
busy_time_s float
idle_time_s float

Properties

Property Type Description
utilization None Fraction of wall-clock time spent processing (0.0-1.0).