ChatCompletionTokenLogprob#

class nemo_microservices.types.shared.ChatCompletionTokenLogprob(*args: Any, **kwargs: Any)

Bases: BaseModel

token: str

The token.

logprob: float

The log probability of this token.

bytes: List[int] | None = None

UTF-8 bytes representation of the token.

top_logprobs: List[TopLogprob] | None = None

List of the most likely tokens and their log probability at this position.