ModelSpecDeParam#
- class nemo_microservices.types.ModelSpecDeParam
Bases:
TypedDict- context_size: Required[int]
- is_chat: Required[bool]
Whether or not this is a chat model
- num_parameters: Required[int]
- num_virtual_tokens: Required[int]
Bases: TypedDict
Whether or not this is a chat model