nemo_microservices.types.shared.chat_completion_token_logprob#
Module Contents#
Classes#
API#
- class nemo_microservices.types.shared.chat_completion_token_logprob.ChatCompletionTokenLogprob(/, **data: typing.Any)#
Bases:
nemo_microservices._models.BaseModel- bytes: Optional[List[int]]#
None
UTF-8 bytes representation of the token.
- logprob: float#
None
The log probability of this token.
- token: str#
None
The token.
- top_logprobs: Optional[List[nemo_microservices.types.shared.top_logprob.TopLogprob]]#
None
List of the most likely tokens and their log probability at this position.