`nemo_microservices.types.v2.inference.served_model_mapping_param`#

Module Contents#

class nemo_microservices.types.v2.inference.served_model_mapping_param.ServedModelMappingParam#

Bases: typing_extensions.TypedDict

model_entity_id: typing_extensions.Required[str]#

None

Model Entity identifier as namespace/name (e.g., ‘my-ns/my-model’)

served_model_name: typing_extensions.Required[str]#

None

The actual model name to send to the backend endpoint in the ‘model’ field