nemo_microservices.types.shared.top_logprob#
Module Contents#
Classes#
API#
- class nemo_microservices.types.shared.top_logprob.TopLogprob(/, **data: Any)#
Bases:
nemo_microservices._models.BaseModel- bytes: List[int] | None#
None
UTF-8 bytes representation of the token.
- logprob: float#
None
The log probability of this token.
- token: str#
None
The token.