APIEndpointData

class nemo_microservices.types.shared.APIEndpointData(*args: Any, **kwargs: Any)

Bases: BaseModel

model_id: str

The id of the model. How this is used depends on the API endpoint format.

url: str

The API endpoint URL.

api_key: str | None = None

The API key that should be used to access the endpoint.

format: Literal['nim', 'openai', 'lama_stack'] | None = None

API endpoint format.

The format dictates the structure of the request and response.

## Values

• “nim” - NVIDIA NIM format

• “openai” - OpenAI format

• “lama_stack” - Llama Stack format