`nemo_microservices.types.v2.inference.model_provider`#

Module Contents#

class nemo_microservices.types.v2.inference.model_provider.ModelProvider(/, **data: Any)#

api_key_id: str | None#

None

Reference to the API key stored in Secrets service

description: str | None#

None

Optional description of the model provider

enabled_models: List[str] | None#

None

Optional list of specific models to enable from this provider.

If not set, all discovered models are enabled.

host_url: str#

None

The network endpoint URL for the model provider

id: str | None#

None

Unique identifier for the model provider

models: List[str] | None#

None

List of Model Entity namespace/name resource names that this provider serves

name: str#

None

Name of the entity. Name/namespace combo must be unique across all entities.

namespace: str | None#

None

The namespace of the entity.

project: str | None#

None

The URN of the project associated with this entity.

status: nemo_microservices.types.v2.inference.model_provider_status.ModelProviderStatus | None#

None

Status enum for ModelProvider objects.

status_message: str | None#

None

Detailed status message, populated by models service