Kubernetes Deployment

NIM LLM supports deployment on Kubernetes using Helm charts, NIM Operator, and other orchestration platforms. Select your deployment or platform below for detailed setup instructions.

Note

For CSP-managed Kubernetes environments (such as GKE, EKS, and AKS), refer to the CSP Deployment guides.

Helm

Deploy NVIDIA NIM for LLMs on Kubernetes with Helm.

how-to

Helm and Kubernetes

NIM Operator

Deploy NVIDIA NIM for LLMs on Kubernetes with the NVIDIA NIM Operator.

how-to

NIM Operator Deployment

KServe

Deploy NVIDIA NIM for LLMs on Kubernetes with KServe.

how-to

KServe

OpenShift

Deploy NVIDIA NIM for LLMs on Red Hat OpenShift with Helm.

how-to

OpenShift

Run:ai

Deploy NVIDIA NIM for LLMs on Run:ai.

how-to

Run:ai