`nemo_microservices.types.model_spec_de`#

Module Contents#

Classes#

API#

class nemo_microservices.types.model_spec_de.ModelSpecDe(/, **data: Any)#

Bases: nemo_microservices._models.BaseModel

context_size: int#: None

is_chat: bool#

None

Whether or not this is a chat model

num_parameters: int#: None

num_virtual_tokens: int#: None