nemo_microservices.types.shared.chat_completion_token_logprob#
Module Contents#
Classes#
API#
- class nemo_microservices.types.shared.chat_completion_token_logprob.ChatCompletionTokenLogprob(/, **data: Any)#
Bases:
nemo_microservices._models.BaseModel- bytes: List[int] | None#
None
UTF-8 bytes representation of the token.
- logprob: float#
None
The log probability of this token.
- token: str#
None
The token.
- top_logprobs: List[nemo_microservices.types.shared.top_logprob.TopLogprob] | None#
None
List of the most likely tokens and their log probability at this position.