`nemo_microservices.types.v2.inference.served_model_mapping`#

Module Contents#

class nemo_microservices.types.v2.inference.served_model_mapping.ServedModelMapping(/, **data: typing.Any)#

Bases: nemo_microservices._models.BaseModel

model_entity_id: str#

None

Model Entity identifier as namespace/name (e.g., ‘my-ns/my-model’)

served_model_name: str#

None

The actual model name to send to the backend endpoint in the ‘model’ field