`nemo_microservices.resources.guardrail.models`#

Module Contents#

Classes#

`AsyncModelsResource`
`AsyncModelsResourceWithRawResponse`
`AsyncModelsResourceWithStreamingResponse`
`ModelsResource`
`ModelsResourceWithRawResponse`
`ModelsResourceWithStreamingResponse`

API#

class nemo_microservices.resources.guardrail.models.AsyncModelsResource( client: nemo_microservices._client.AsyncNeMoMicroservices, )#

Bases: nemo_microservices._resource.AsyncAPIResource

Initialization

async list( *, x_model_authorization: str | nemo_microservices._types.Omit = omit, extra_headers: nemo_microservices._types.Headers | None = None, extra_query: nemo_microservices._types.Query | None = None, extra_body: nemo_microservices._types.Body | None = None, timeout: float | httpx.Timeout | None | nemo_microservices._types.NotGiven = not_given, ) → nemo_microservices.types.guardrail.models_response.ModelsResponse#

Fetch all hosted models from NIM (or NIM Proxy).

The base url is defined by the NIM_ENDPOINT_URL environment variable { “object”: “list”, “data”: [ { “id”: “gpt-4o-audio-preview-2024-12-17”, “object”: “model”, “created”: 1734034239, “owned_by”: “system” }, … ] }

Args: x_model_authorization: The authentication token to use for requesting models from NIM_ENDPOINT_URL

extra_headers: Send extra headers

extra_query: Add additional query parameters to the request

extra_body: Add additional JSON properties to the request

timeout: Override the client-level default timeout for this request, in seconds

property with_raw_response: nemo_microservices.resources.guardrail.models.AsyncModelsResourceWithRawResponse#

This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content.

For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#accessing-raw-response-data-e-g-headers

property with_streaming_response: nemo_microservices.resources.guardrail.models.AsyncModelsResourceWithStreamingResponse#

An alternative to .with_raw_response that doesn’t eagerly read the response body.

For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#with_streaming_response

class nemo_microservices.resources.guardrail.models.AsyncModelsResourceWithRawResponse( models: nemo_microservices.resources.guardrail.models.AsyncModelsResource, )#: Initialization

class nemo_microservices.resources.guardrail.models.AsyncModelsResourceWithStreamingResponse( models: nemo_microservices.resources.guardrail.models.AsyncModelsResource, )#: Initialization

class nemo_microservices.resources.guardrail.models.ModelsResource(client: nemo_microservices._client.NeMoMicroservices)#

Bases: nemo_microservices._resource.SyncAPIResource