nemo_microservices.types.v2.inference.model_provider#
Module Contents#
Classes#
API#
- class nemo_microservices.types.v2.inference.model_provider.ModelProvider(/, **data: typing.Any)#
Bases:
nemo_microservices._models.BaseModel- api_key_id: Optional[str]#
None
Reference to the API key stored in Secrets service
- created_at: Optional[datetime.datetime]#
None
- description: Optional[str]#
None
Optional description of the model provider
- enabled_models: Optional[List[str]]#
None
Optional list of specific models to enable from this provider.
If not set, all discovered models are enabled.
- host_url: str#
None
The network endpoint URL for the model provider
- id: Optional[str]#
None
Unique identifier for the model provider
- model_deployment_id: Optional[str]#
None
Optional reference to the ModelDeployment ID if this provider was auto-created for a deployment
- name: str#
None
Name of the entity. Name/namespace combo must be unique across all entities.
- namespace: str#
None
The namespace of the entity.
- project: Optional[str]#
None
The URN of the project associated with this entity.
- served_models: Optional[List[nemo_microservices.types.v2.inference.served_model_mapping.ServedModelMapping]]#
None
List of models served by this provider with routing information for IGW
- status: Optional[nemo_microservices.types.v2.inference.model_provider_status.ModelProviderStatus]#
None
Status enum for ModelProvider objects.
- status_message: Optional[str]#
None
Detailed status message, populated by models service
- updated_at: Optional[datetime.datetime]#
None