nemo_microservices.types.shared.api_endpoint_data#

Module Contents#

Classes#

APIEndpointData

API#

class nemo_microservices.types.shared.api_endpoint_data.APIEndpointData(/, **data: Any)#

Bases: nemo_microservices._models.BaseModel

api_key: str | None#

None

The API key that should be used to access the endpoint.

format: nemo_microservices.types.shared.api_endpoint_format.APIEndpointFormat | None#

None

API endpoint format.

The format dictates the structure of the request and response.

Values

  • "nim" - NVIDIA NIM format

  • "openai" - OpenAI format

  • "lama_stack" - Llama Stack format

model_id: str#

None

The id of the model. How this is used depends on the API endpoint format.

url: str#

None

The API endpoint URL.