ChatCompletionTokenLogprob#
- class nemo_microservices.types.shared.ChatCompletionTokenLogprob(*args: Any, **kwargs: Any)
Bases:
BaseModel- token: str
The token.
- logprob: float
The log probability of this token.
- bytes: List[int] | None = None
UTF-8 bytes representation of the token.
- top_logprobs: List[TopLogprob] | None = None
List of the most likely tokens and their log probability at this position.