Deployment Model Deployments Resource#

class nemo_microservices.resources.deployment.ModelDeploymentsResource(client: NeMoMicroservices)#

Bases: SyncAPIResource

property with_raw_response: ModelDeploymentsResourceWithRawResponse#

This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content.

For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#accessing-raw-response-data-e-g-headers

property with_streaming_response: ModelDeploymentsResourceWithStreamingResponse#

An alternative to .with_raw_response that doesn’t eagerly read the response body.

For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#with_streaming_response

create(
*,
config: model_deployment_create_params.Config,
async_enabled: bool | NotGiven = NOT_GIVEN,
custom_fields: object | NotGiven = NOT_GIVEN,
description: str | NotGiven = NOT_GIVEN,
models: List[str] | NotGiven = NOT_GIVEN,
name: str | NotGiven = NOT_GIVEN,
namespace: str | NotGiven = NOT_GIVEN,
ownership: Ownership | NotGiven = NOT_GIVEN,
project: str | NotGiven = NOT_GIVEN,
extra_headers: Headers | None = None,
extra_query: Query | None = None,
extra_body: Body | None = None,
timeout: float | httpx.Timeout | None | NotGiven = NOT_GIVEN,
) → ModelDeployment#

Create a new deployment model_deployment.

Parameters:

  • config – The deployment configuration.

  • async_enabled – Whether the async mode is enabled.

  • custom_fields – A set of custom fields that the user can define and use for various purposes.

  • description – The description of the entity.

  • models – The models served by this deployment.

  • name – The name of the identity. Must be unique inside the namespace. If not specified, it will be the same as the automatically generated id.

  • namespace – The if of the namespace of the entity. This can be missing for namespace entities or in deployments that don’t use namespaces.

  • ownership –

    Information about ownership of an entity.

    If the entity is a namespace, the access_policies will typically apply to all entities inside the namespace.

  • project – The id of project associated with this entity.

  • extra_headers – Send extra headers

  • extra_query – Add additional query parameters to the request

  • extra_body – Add additional JSON properties to the request

  • timeout – Override the client-level default timeout for this request, in seconds

retrieve(
deployment_name: str,
*,
namespace: str,
extra_headers: Headers | None = None,
extra_query: Query | None = None,
extra_body: Body | None = None,
timeout: float | httpx.Timeout | None | NotGiven = NOT_GIVEN,
) → ModelDeployment#

Get info about a model deployment.

Parameters:

  • extra_headers – Send extra headers

  • extra_query – Add additional query parameters to the request

  • extra_body – Add additional JSON properties to the request

  • timeout – Override the client-level default timeout for this request, in seconds

update(
deployment_name: str,
*,
namespace: str,
async_enabled: bool | NotGiven = NOT_GIVEN,
config: model_deployment_update_params.Config | NotGiven = NOT_GIVEN,
custom_fields: object | NotGiven = NOT_GIVEN,
description: str | NotGiven = NOT_GIVEN,
models: List[str] | NotGiven = NOT_GIVEN,
ownership: Ownership | NotGiven = NOT_GIVEN,
project: str | NotGiven = NOT_GIVEN,
schema_version: str | NotGiven = NOT_GIVEN,
extra_headers: Headers | None = None,
extra_query: Query | None = None,
extra_body: Body | None = None,
timeout: float | httpx.Timeout | None | NotGiven = NOT_GIVEN,
) → ModelDeployment#

Update model deployment

Parameters:

  • async_enabled – Whether the async mode is enabled.

  • config – The deployment configuration.

  • custom_fields – A set of custom fields that the user can define and use for various purposes.

  • description – The description of the entity.

  • models – The models served by this deployment.

  • ownership –

    Information about ownership of an entity.

    If the entity is a namespace, the access_policies will typically apply to all entities inside the namespace.

  • project – The id of project associated with this entity.

  • schema_version – The version of the schema for the object. Internal use only.

  • extra_headers – Send extra headers

  • extra_query – Add additional query parameters to the request

  • extra_body – Add additional JSON properties to the request

  • timeout – Override the client-level default timeout for this request, in seconds

list(
*,
filter: ModelDeploymentFilterParam | NotGiven = NOT_GIVEN,
page: int | NotGiven = NOT_GIVEN,
page_size: int | NotGiven = NOT_GIVEN,
sort: GenericSortField | NotGiven = NOT_GIVEN,
extra_headers: Headers | None = None,
extra_query: Query | None = None,
extra_body: Body | None = None,
timeout: float | httpx.Timeout | None | NotGiven = NOT_GIVEN,
) → SyncDefaultPagination[ModelDeployment]#

List available deployment model_deployments.

Parameters:

  • filter – Filter model_deployments on various criteria.

  • page – Page number.

  • page_size – Page size.

  • sort – The field to sort by. To sort in decreasing order, use - in front of the field name.

  • extra_headers – Send extra headers

  • extra_query – Add additional query parameters to the request

  • extra_body – Add additional JSON properties to the request

  • timeout – Override the client-level default timeout for this request, in seconds

delete(
deployment_name: str,
*,
namespace: str,
extra_headers: Headers | None = None,
extra_query: Query | None = None,
extra_body: Body | None = None,
timeout: float | httpx.Timeout | None | NotGiven = NOT_GIVEN,
) → DeleteResponse#

Delete Model Deployment

Parameters:

  • extra_headers – Send extra headers

  • extra_query – Add additional query parameters to the request

  • extra_body – Add additional JSON properties to the request

  • timeout – Override the client-level default timeout for this request, in seconds

create_from_dict(
data: dict[str, object],
) → object#
class nemo_microservices.resources.deployment.AsyncModelDeploymentsResource(client: AsyncNeMoMicroservices)#

Bases: AsyncAPIResource

property with_raw_response: AsyncModelDeploymentsResourceWithRawResponse#

This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content.

For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#accessing-raw-response-data-e-g-headers

property with_streaming_response: AsyncModelDeploymentsResourceWithStreamingResponse#

An alternative to .with_raw_response that doesn’t eagerly read the response body.

For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#with_streaming_response

async create(
*,
config: model_deployment_create_params.Config,
async_enabled: bool | NotGiven = NOT_GIVEN,
custom_fields: object | NotGiven = NOT_GIVEN,
description: str | NotGiven = NOT_GIVEN,
models: List[str] | NotGiven = NOT_GIVEN,
name: str | NotGiven = NOT_GIVEN,
namespace: str | NotGiven = NOT_GIVEN,
ownership: Ownership | NotGiven = NOT_GIVEN,
project: str | NotGiven = NOT_GIVEN,
extra_headers: Headers | None = None,
extra_query: Query | None = None,
extra_body: Body | None = None,
timeout: float | httpx.Timeout | None | NotGiven = NOT_GIVEN,
) → ModelDeployment#

Create a new deployment model_deployment.

Parameters:

  • config – The deployment configuration.

  • async_enabled – Whether the async mode is enabled.

  • custom_fields – A set of custom fields that the user can define and use for various purposes.

  • description – The description of the entity.

  • models – The models served by this deployment.

  • name – The name of the identity. Must be unique inside the namespace. If not specified, it will be the same as the automatically generated id.

  • namespace – The if of the namespace of the entity. This can be missing for namespace entities or in deployments that don’t use namespaces.

  • ownership –

    Information about ownership of an entity.

    If the entity is a namespace, the access_policies will typically apply to all entities inside the namespace.

  • project – The id of project associated with this entity.

  • extra_headers – Send extra headers

  • extra_query – Add additional query parameters to the request

  • extra_body – Add additional JSON properties to the request

  • timeout – Override the client-level default timeout for this request, in seconds

async retrieve(
deployment_name: str,
*,
namespace: str,
extra_headers: Headers | None = None,
extra_query: Query | None = None,
extra_body: Body | None = None,
timeout: float | httpx.Timeout | None | NotGiven = NOT_GIVEN,
) → ModelDeployment#

Get info about a model deployment.

Parameters:

  • extra_headers – Send extra headers

  • extra_query – Add additional query parameters to the request

  • extra_body – Add additional JSON properties to the request

  • timeout – Override the client-level default timeout for this request, in seconds

async update(
deployment_name: str,
*,
namespace: str,
async_enabled: bool | NotGiven = NOT_GIVEN,
config: model_deployment_update_params.Config | NotGiven = NOT_GIVEN,
custom_fields: object | NotGiven = NOT_GIVEN,
description: str | NotGiven = NOT_GIVEN,
models: List[str] | NotGiven = NOT_GIVEN,
ownership: Ownership | NotGiven = NOT_GIVEN,
project: str | NotGiven = NOT_GIVEN,
schema_version: str | NotGiven = NOT_GIVEN,
extra_headers: Headers | None = None,
extra_query: Query | None = None,
extra_body: Body | None = None,
timeout: float | httpx.Timeout | None | NotGiven = NOT_GIVEN,
) → ModelDeployment#

Update model deployment

Parameters:

  • async_enabled – Whether the async mode is enabled.

  • config – The deployment configuration.

  • custom_fields – A set of custom fields that the user can define and use for various purposes.

  • description – The description of the entity.

  • models – The models served by this deployment.

  • ownership –

    Information about ownership of an entity.

    If the entity is a namespace, the access_policies will typically apply to all entities inside the namespace.

  • project – The id of project associated with this entity.

  • schema_version – The version of the schema for the object. Internal use only.

  • extra_headers – Send extra headers

  • extra_query – Add additional query parameters to the request

  • extra_body – Add additional JSON properties to the request

  • timeout – Override the client-level default timeout for this request, in seconds

list(
*,
filter: ModelDeploymentFilterParam | NotGiven = NOT_GIVEN,
page: int | NotGiven = NOT_GIVEN,
page_size: int | NotGiven = NOT_GIVEN,
sort: GenericSortField | NotGiven = NOT_GIVEN,
extra_headers: Headers | None = None,
extra_query: Query | None = None,
extra_body: Body | None = None,
timeout: float | httpx.Timeout | None | NotGiven = NOT_GIVEN,
) → AsyncPaginator[ModelDeployment, AsyncDefaultPagination[ModelDeployment]]#

List available deployment model_deployments.

Parameters:

  • filter – Filter model_deployments on various criteria.

  • page – Page number.

  • page_size – Page size.

  • sort – The field to sort by. To sort in decreasing order, use - in front of the field name.

  • extra_headers – Send extra headers

  • extra_query – Add additional query parameters to the request

  • extra_body – Add additional JSON properties to the request

  • timeout – Override the client-level default timeout for this request, in seconds

async delete(
deployment_name: str,
*,
namespace: str,
extra_headers: Headers | None = None,
extra_query: Query | None = None,
extra_body: Body | None = None,
timeout: float | httpx.Timeout | None | NotGiven = NOT_GIVEN,
) → DeleteResponse#

Delete Model Deployment

Parameters:

  • extra_headers – Send extra headers

  • extra_query – Add additional query parameters to the request

  • extra_body – Add additional JSON properties to the request

  • timeout – Override the client-level default timeout for this request, in seconds

create_from_dict(
data: dict[str, object],
) → object#