nemo_microservices.types.shared.usage_info#
Module Contents#
Classes#
API#
- class nemo_microservices.types.shared.usage_info.UsageInfo(/, **data: Any)#
Bases:
nemo_microservices._models.BaseModel- completion_tokens: int | None#
None
Number of tokens in the generated completion.
- prompt_tokens: int | None#
None
Number of tokens in the prompt.
- total_tokens: int | None#
None
Total number of tokens used in the request (prompt + completion).