UsageInfo

class nemo_microservices.types.shared.UsageInfo(*args: Any, **kwargs: Any)

Bases: BaseModel

completion_tokens: int | None = None

Number of tokens in the generated completion.

prompt_tokens: int | None = None

Number of tokens in the prompt.

total_tokens: int | None = None

Total number of tokens used in the request (prompt + completion).