NIMDeploymentConfigParam

class nemo_microservices.types.NIMDeploymentConfigParam

Bases: TypedDict

gpu: Required[int]

The number of GPUs needed for a deployment.

image_name: Required[str]

The name of the Docker image.

image_tag: Required[str]

The tag of the Docker image.

additional_envs: Dict[str, str]

Additional environment variables to pass to the deployment.

namespace: str

The Kubernetes namespace of the deployment.