`nemo_microservices.resources.v2.inference.gateway.model`#

Module Contents#

Classes#

`AsyncModelResource`
`AsyncModelResourceWithRawResponse`
`AsyncModelResourceWithStreamingResponse`
`ModelResource`
`ModelResourceWithRawResponse`
`ModelResourceWithStreamingResponse`

API#

class nemo_microservices.resources.v2.inference.gateway.model.AsyncModelResource( client: nemo_microservices._client.AsyncNeMoMicroservices, )#

Bases: nemo_microservices._resource.AsyncAPIResource

Initialization

async delete( trailing_uri: str, *, namespace: str, model_name: str, extra_headers: nemo_microservices._types.Headers | None = None, extra_query: nemo_microservices._types.Query | None = None, extra_body: nemo_microservices._types.Body | None = None, timeout: float | httpx.Timeout | None | nemo_microservices._types.NotGiven = not_given, ) → object#

Proxy requests to model entity inference endpoints.

This is a stub implementation that returns request details.

Args: extra_headers: Send extra headers

extra_query: Add additional query parameters to the request

extra_body: Add additional JSON properties to the request

timeout: Override the client-level default timeout for this request, in seconds

async get( trailing_uri: str, *, namespace: str, model_name: str, extra_headers: nemo_microservices._types.Headers | None = None, extra_query: nemo_microservices._types.Query | None = None, extra_body: nemo_microservices._types.Body | None = None, timeout: float | httpx.Timeout | None | nemo_microservices._types.NotGiven = not_given, ) → object#

Proxy requests to model entity inference endpoints.

This is a stub implementation that returns request details.

Args: extra_headers: Send extra headers

extra_query: Add additional query parameters to the request

extra_body: Add additional JSON properties to the request

timeout: Override the client-level default timeout for this request, in seconds

async patch( trailing_uri: str, *, namespace: str, model_name: str, extra_headers: nemo_microservices._types.Headers | None = None, extra_query: nemo_microservices._types.Query | None = None, extra_body: nemo_microservices._types.Body | None = None, timeout: float | httpx.Timeout | None | nemo_microservices._types.NotGiven = not_given, ) → object#

Proxy requests to model entity inference endpoints.

This is a stub implementation that returns request details.

Args: extra_headers: Send extra headers

extra_query: Add additional query parameters to the request

extra_body: Add additional JSON properties to the request

timeout: Override the client-level default timeout for this request, in seconds

async post( trailing_uri: str, *, namespace: str, model_name: str, extra_headers: nemo_microservices._types.Headers | None = None, extra_query: nemo_microservices._types.Query | None = None, extra_body: nemo_microservices._types.Body | None = None, timeout: float | httpx.Timeout | None | nemo_microservices._types.NotGiven = not_given, ) → object#

Proxy requests to model entity inference endpoints.

This is a stub implementation that returns request details.

Args: extra_headers: Send extra headers

extra_query: Add additional query parameters to the request

extra_body: Add additional JSON properties to the request

timeout: Override the client-level default timeout for this request, in seconds

async put( trailing_uri: str, *, namespace: str, model_name: str, extra_headers: nemo_microservices._types.Headers | None = None, extra_query: nemo_microservices._types.Query | None = None, extra_body: nemo_microservices._types.Body | None = None, timeout: float | httpx.Timeout | None | nemo_microservices._types.NotGiven = not_given, ) → object#

Proxy requests to model entity inference endpoints.

This is a stub implementation that returns request details.

Args: extra_headers: Send extra headers

extra_query: Add additional query parameters to the request

extra_body: Add additional JSON properties to the request

timeout: Override the client-level default timeout for this request, in seconds

property with_raw_response: nemo_microservices.resources.v2.inference.gateway.model.AsyncModelResourceWithRawResponse#

This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content.

For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#accessing-raw-response-data-e-g-headers

property with_streaming_response: nemo_microservices.resources.v2.inference.gateway.model.AsyncModelResourceWithStreamingResponse#

An alternative to .with_raw_response that doesn’t eagerly read the response body.

For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#with_streaming_response

class nemo_microservices.resources.v2.inference.gateway.model.AsyncModelResourceWithRawResponse( model: nemo_microservices.resources.v2.inference.gateway.model.AsyncModelResource, )#: Initialization

class nemo_microservices.resources.v2.inference.gateway.model.AsyncModelResourceWithStreamingResponse( model: nemo_microservices.resources.v2.inference.gateway.model.AsyncModelResource, )#: Initialization

class nemo_microservices.resources.v2.inference.gateway.model.ModelResource(client: nemo_microservices._client.NeMoMicroservices)#

Bases: nemo_microservices._resource.SyncAPIResource

Initialization

delete( trailing_uri: str, *, namespace: str, model_name: str, extra_headers: nemo_microservices._types.Headers | None = None, extra_query: nemo_microservices._types.Query | None = None, extra_body: nemo_microservices._types.Body | None = None, timeout: float | httpx.Timeout | None | nemo_microservices._types.NotGiven = not_given, ) → object#

Proxy requests to model entity inference endpoints.

This is a stub implementation that returns request details.

Args: extra_headers: Send extra headers

extra_query: Add additional query parameters to the request

extra_body: Add additional JSON properties to the request

timeout: Override the client-level default timeout for this request, in seconds

get( trailing_uri: str, *, namespace: str, model_name: str, extra_headers: nemo_microservices._types.Headers | None = None, extra_query: nemo_microservices._types.Query | None = None, extra_body: nemo_microservices._types.Body | None = None, timeout: float | httpx.Timeout | None | nemo_microservices._types.NotGiven = not_given, ) → object#

Proxy requests to model entity inference endpoints.

This is a stub implementation that returns request details.

Args: extra_headers: Send extra headers

extra_query: Add additional query parameters to the request

extra_body: Add additional JSON properties to the request

timeout: Override the client-level default timeout for this request, in seconds

patch( trailing_uri: str, *, namespace: str, model_name: str, extra_headers: nemo_microservices._types.Headers | None = None, extra_query: nemo_microservices._types.Query | None = None, extra_body: nemo_microservices._types.Body | None = None, timeout: float | httpx.Timeout | None | nemo_microservices._types.NotGiven = not_given, ) → object#

Proxy requests to model entity inference endpoints.

This is a stub implementation that returns request details.

Args: extra_headers: Send extra headers

extra_query: Add additional query parameters to the request

extra_body: Add additional JSON properties to the request

timeout: Override the client-level default timeout for this request, in seconds

post( trailing_uri: str, *, namespace: str, model_name: str, extra_headers: nemo_microservices._types.Headers | None = None, extra_query: nemo_microservices._types.Query | None = None, extra_body: nemo_microservices._types.Body | None = None, timeout: float | httpx.Timeout | None | nemo_microservices._types.NotGiven = not_given, ) → object#

Proxy requests to model entity inference endpoints.

This is a stub implementation that returns request details.

Args: extra_headers: Send extra headers

extra_query: Add additional query parameters to the request

extra_body: Add additional JSON properties to the request

timeout: Override the client-level default timeout for this request, in seconds

put( trailing_uri: str, *, namespace: str, model_name: str, extra_headers: nemo_microservices._types.Headers | None = None, extra_query: nemo_microservices._types.Query | None = None, extra_body: nemo_microservices._types.Body | None = None, timeout: float | httpx.Timeout | None | nemo_microservices._types.NotGiven = not_given, ) → object#

Proxy requests to model entity inference endpoints.

This is a stub implementation that returns request details.

Args: extra_headers: Send extra headers

extra_query: Add additional query parameters to the request

extra_body: Add additional JSON properties to the request

timeout: Override the client-level default timeout for this request, in seconds

property with_raw_response: nemo_microservices.resources.v2.inference.gateway.model.ModelResourceWithRawResponse#

This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content.

For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#accessing-raw-response-data-e-g-headers

property with_streaming_response: nemo_microservices.resources.v2.inference.gateway.model.ModelResourceWithStreamingResponse#

An alternative to .with_raw_response that doesn’t eagerly read the response body.

For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#with_streaming_response

class nemo_microservices.resources.v2.inference.gateway.model.ModelResourceWithRawResponse( model: nemo_microservices.resources.v2.inference.gateway.model.ModelResource, )#: Initialization

class nemo_microservices.resources.v2.inference.gateway.model.ModelResourceWithStreamingResponse( model: nemo_microservices.resources.v2.inference.gateway.model.ModelResource, )#: Initialization

nemo_microservices.resources.v2.inference.gateway.model#

Module Contents#

Classes#

API#

`nemo_microservices.resources.v2.inference.gateway.model`#