nemo_microservices.resources.v2.inference.inference
#
Module Contents#
Classes#
API#
- class nemo_microservices.resources.v2.inference.inference.AsyncInferenceResource( )#
Bases:
nemo_microservices._resource.AsyncAPIResource
Initialization
- property deployment_configs: nemo_microservices.resources.v2.inference.deployment_configs.deployment_configs.AsyncDeploymentConfigsResource#
- property deployments: nemo_microservices.resources.v2.inference.deployments.deployments.AsyncDeploymentsResource#
- property providers: nemo_microservices.resources.v2.inference.providers.AsyncProvidersResource#
- property with_raw_response: nemo_microservices.resources.v2.inference.inference.AsyncInferenceResourceWithRawResponse#
This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content.
For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#accessing-raw-response-data-e-g-headers
- property with_streaming_response: nemo_microservices.resources.v2.inference.inference.AsyncInferenceResourceWithStreamingResponse#
An alternative to
.with_raw_response
that doesn’t eagerly read the response body.For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#with_streaming_response
- class nemo_microservices.resources.v2.inference.inference.AsyncInferenceResourceWithRawResponse( )#
Initialization
- property deployment_configs: nemo_microservices.resources.v2.inference.deployment_configs.deployment_configs.AsyncDeploymentConfigsResourceWithRawResponse#
- property deployments: nemo_microservices.resources.v2.inference.deployments.deployments.AsyncDeploymentsResourceWithRawResponse#
- class nemo_microservices.resources.v2.inference.inference.AsyncInferenceResourceWithStreamingResponse( )#
Initialization
- property deployment_configs: nemo_microservices.resources.v2.inference.deployment_configs.deployment_configs.AsyncDeploymentConfigsResourceWithStreamingResponse#
- property deployments: nemo_microservices.resources.v2.inference.deployments.deployments.AsyncDeploymentsResourceWithStreamingResponse#
- class nemo_microservices.resources.v2.inference.inference.InferenceResource( )#
Bases:
nemo_microservices._resource.SyncAPIResource
Initialization
- property deployment_configs: nemo_microservices.resources.v2.inference.deployment_configs.deployment_configs.DeploymentConfigsResource#
- property deployments: nemo_microservices.resources.v2.inference.deployments.deployments.DeploymentsResource#
- property providers: nemo_microservices.resources.v2.inference.providers.ProvidersResource#
- property with_raw_response: nemo_microservices.resources.v2.inference.inference.InferenceResourceWithRawResponse#
This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content.
For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#accessing-raw-response-data-e-g-headers
- property with_streaming_response: nemo_microservices.resources.v2.inference.inference.InferenceResourceWithStreamingResponse#
An alternative to
.with_raw_response
that doesn’t eagerly read the response body.For more information, see https://docs.nvidia.com/nemo/microservices/latest/pysdk/index.html#with_streaming_response
- class nemo_microservices.resources.v2.inference.inference.InferenceResourceWithRawResponse( )#
Initialization
- property deployment_configs: nemo_microservices.resources.v2.inference.deployment_configs.deployment_configs.DeploymentConfigsResourceWithRawResponse#
- property deployments: nemo_microservices.resources.v2.inference.deployments.deployments.DeploymentsResourceWithRawResponse#
- class nemo_microservices.resources.v2.inference.inference.InferenceResourceWithStreamingResponse( )#
Initialization
- property deployment_configs: nemo_microservices.resources.v2.inference.deployment_configs.deployment_configs.DeploymentConfigsResourceWithStreamingResponse#
- property deployments: nemo_microservices.resources.v2.inference.deployments.deployments.DeploymentsResourceWithStreamingResponse#