`nemo_microservices.types.shared.usage_info`#

Module Contents#

class nemo_microservices.types.shared.usage_info.UsageInfo(/, **data: typing.Any)#

Bases: nemo_microservices._models.BaseModel

completion_tokens: Optional[int]#

None

Number of tokens in the generated completion.

prompt_tokens: Optional[int]#

None

Number of tokens in the prompt.

total_tokens: Optional[int]#

None

Total number of tokens used in the request (prompt + completion).