aiq.profiler.callbacks.token_usage_base_model

Classes

TokenUsageBaseModel

Base model for token usage callbacks.

Module Contents

class TokenUsageBaseModel(/, **data: Any)

Bases: pydantic.BaseModel

Base model for token usage callbacks.

Create a new model by parsing and validating input data from keyword arguments.

Raises [ValidationError][pydantic_core.ValidationError] if the input data cannot be validated to form a valid model.

self is explicitly positional-only to allow self as a field name.

prompt_tokens: int = None

completion_tokens: int = None

total_tokens: int = None