APIEndpointData

class nemo_microservices.types.shared_params.APIEndpointData

Bases: TypedDict

model_id: Required[str]

The id of the model. How this is used depends on the API endpoint format.

url: Required[str]

The API endpoint URL.

api_key: str

The API key that should be used to access the endpoint.

format: Literal['nim', 'openai', 'lama_stack']

API endpoint format.

The format dictates the structure of the request and response.

## Values

• “nim” - NVIDIA NIM format

• “openai” - OpenAI format

• “lama_stack” - Llama Stack format