Kubernetes Deployment

NIM LLM and VLM supports deployment on Kubernetes using Helm charts, NIM Operator, and other orchestration platforms. Select your deployment or platform below for detailed setup instructions.

Note

For CSP-managed Kubernetes environments (such as GKE, EKS, and AKS), refer to the CSP Deployment guides.

Helm

Deploy NVIDIA NIM for Large Language Models (LLM) and Vision Language Models (VLM) on Kubernetes with Helm.

how-to

Helm and Kubernetes

NIM Operator

Deploy NVIDIA NIM for Large Language Models (LLM) and Vision Language Models (VLM) on Kubernetes with the NVIDIA NIM Operator.

how-to

NIM Operator Deployment

KServe

Deploy NVIDIA NIM for Large Language Models (LLM) and Vision Language Models (VLM) on Kubernetes with KServe.

how-to

KServe

OpenShift

Deploy NVIDIA NIM for Large Language Models (LLM) and Vision Language Models (VLM) on Red Hat OpenShift with Helm.

how-to

OpenShift

Run:ai

Deploy NVIDIA NIM for Large Language Models (LLM) and Vision Language Models (VLM) on Run:ai.

how-to

Run:ai