Deployment Configs Resource#

class nemo_microservices.resources.deployment.ConfigsResource(client: NeMoMicroservices)#

Bases: SyncAPIResource

property with_raw_response: ConfigsResourceWithRawResponse#

This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content.

For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#accessing-raw-response-data-e-g-headers

property with_streaming_response: ConfigsResourceWithStreamingResponse#

An alternative to .with_raw_response that doesn’t eagerly read the response body.

For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#with_streaming_response

Create a new deployment config.

Parameters:

custom_fields – A set of custom fields that the user can define and use for various purposes.
description – The description of the entity.
external_endpoint – Configuration for an external endpoint.
model – The model to be deployed.
name – The name of the identity. Must be unique inside the namespace. If not specified, it will be the same as the automatically generated id.
namespace – The if of the namespace of the entity. This can be missing for namespace entities or in deployments that don’t use namespaces.
nim_deployment – Configuration for a NIM deployment.
ownership –
Information about ownership of an entity.

If the entity is a namespace, the access_policies will typically apply to all entities inside the namespace.
project – The id of project associated with this entity.
extra_headers – Send extra headers
extra_query – Add additional query parameters to the request
extra_body – Add additional JSON properties to the request
timeout – Override the client-level default timeout for this request, in seconds

Get info about a deployment configuration.

Parameters:

extra_headers – Send extra headers
extra_query – Add additional query parameters to the request
extra_body – Add additional JSON properties to the request
timeout – Override the client-level default timeout for this request, in seconds

update( config_name: str, *, namespace: str, custom_fields: object | NotGiven = NOT_GIVEN, description: str | NotGiven = NOT_GIVEN, external_endpoint: ExternalEndpointConfigParam | NotGiven = NOT_GIVEN, model: config_update_params.Model | NotGiven = NOT_GIVEN, nim_deployment: NIMDeploymentConfigParam | NotGiven = NOT_GIVEN, ownership: Ownership | NotGiven = NOT_GIVEN, project: str | NotGiven = NOT_GIVEN, schema_version: str | NotGiven = NOT_GIVEN, extra_headers: Headers | None = None, extra_query: Query | None = None, extra_body: Body | None = None, timeout: float | httpx.Timeout | None | NotGiven = NOT_GIVEN, ) → DeploymentConfig#

Update model metadata.

If the request body has an empty field, keep the old value.

Parameters:

custom_fields – A set of custom fields that the user can define and use for various purposes.
description – The description of the entity.
external_endpoint – Configuration for an external endpoint.
model – The model to be deployed.
nim_deployment – Configuration for a NIM deployment.
ownership –
Information about ownership of an entity.

If the entity is a namespace, the access_policies will typically apply to all entities inside the namespace.
project – The id of project associated with this entity.
schema_version – The version of the schema for the object. Internal use only.
extra_headers – Send extra headers
extra_query – Add additional query parameters to the request
extra_body – Add additional JSON properties to the request
timeout – Override the client-level default timeout for this request, in seconds

List available deployment configs.

Parameters:

filter – Filter configs on various criteria.
page – Page number.
page_size – Page size.
sort – The field to sort by. To sort in decreasing order, use - in front of the field name.
extra_headers – Send extra headers
extra_query – Add additional query parameters to the request
extra_body – Add additional JSON properties to the request
timeout – Override the client-level default timeout for this request, in seconds

Delete Config

Parameters:

extra_headers – Send extra headers
extra_query – Add additional query parameters to the request
extra_body – Add additional JSON properties to the request
timeout – Override the client-level default timeout for this request, in seconds

create_from_dict(data: dict[str, object]) → object#

class nemo_microservices.resources.deployment.AsyncConfigsResource(client: AsyncNeMoMicroservices)#

Bases: AsyncAPIResource

property with_raw_response: AsyncConfigsResourceWithRawResponse#

This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content.

For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#accessing-raw-response-data-e-g-headers

property with_streaming_response: AsyncConfigsResourceWithStreamingResponse#

An alternative to .with_raw_response that doesn’t eagerly read the response body.

For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#with_streaming_response

Create a new deployment config.

Parameters:

custom_fields – A set of custom fields that the user can define and use for various purposes.
description – The description of the entity.
external_endpoint – Configuration for an external endpoint.
model – The model to be deployed.
name – The name of the identity. Must be unique inside the namespace. If not specified, it will be the same as the automatically generated id.
namespace – The if of the namespace of the entity. This can be missing for namespace entities or in deployments that don’t use namespaces.
nim_deployment – Configuration for a NIM deployment.
ownership –
Information about ownership of an entity.

If the entity is a namespace, the access_policies will typically apply to all entities inside the namespace.
project – The id of project associated with this entity.
extra_headers – Send extra headers
extra_query – Add additional query parameters to the request
extra_body – Add additional JSON properties to the request
timeout – Override the client-level default timeout for this request, in seconds

Get info about a deployment configuration.

Parameters:

extra_headers – Send extra headers
extra_query – Add additional query parameters to the request
extra_body – Add additional JSON properties to the request
timeout – Override the client-level default timeout for this request, in seconds

async update( config_name: str, *, namespace: str, custom_fields: object | NotGiven = NOT_GIVEN, description: str | NotGiven = NOT_GIVEN, external_endpoint: ExternalEndpointConfigParam | NotGiven = NOT_GIVEN, model: config_update_params.Model | NotGiven = NOT_GIVEN, nim_deployment: NIMDeploymentConfigParam | NotGiven = NOT_GIVEN, ownership: Ownership | NotGiven = NOT_GIVEN, project: str | NotGiven = NOT_GIVEN, schema_version: str | NotGiven = NOT_GIVEN, extra_headers: Headers | None = None, extra_query: Query | None = None, extra_body: Body | None = None, timeout: float | httpx.Timeout | None | NotGiven = NOT_GIVEN, ) → DeploymentConfig#

Update model metadata.

If the request body has an empty field, keep the old value.

Parameters:

custom_fields – A set of custom fields that the user can define and use for various purposes.
description – The description of the entity.
external_endpoint – Configuration for an external endpoint.
model – The model to be deployed.
nim_deployment – Configuration for a NIM deployment.
ownership –
Information about ownership of an entity.

If the entity is a namespace, the access_policies will typically apply to all entities inside the namespace.
project – The id of project associated with this entity.
schema_version – The version of the schema for the object. Internal use only.
extra_headers – Send extra headers
extra_query – Add additional query parameters to the request
extra_body – Add additional JSON properties to the request
timeout – Override the client-level default timeout for this request, in seconds

List available deployment configs.

Parameters:

filter – Filter configs on various criteria.
page – Page number.
page_size – Page size.
sort – The field to sort by. To sort in decreasing order, use - in front of the field name.
extra_headers – Send extra headers
extra_query – Add additional query parameters to the request
extra_body – Add additional JSON properties to the request
timeout – Override the client-level default timeout for this request, in seconds

Delete Config

Parameters:

extra_headers – Send extra headers
extra_query – Add additional query parameters to the request
extra_body – Add additional JSON properties to the request
timeout – Override the client-level default timeout for this request, in seconds

create_from_dict( data: dict[str, object], ) → object#