Skip to navigation
DocumentationKubernetes Deployment

About Platform Setup

View as Markdown

This section describes how to deploy NeMo Helix to a Kubernetes cluster using the NeMo Helix Helm chart. The chart is the supported path for self-managed clusters such as minikube, kind, EKS, AKS, GKE, OKE, OpenShift, and on-prem Kubernetes.

This Platform Setup chapter is for the following personas.

  • Cloud administrators: Manage Kubernetes clusters and compute/storage resources. Deploy NeMo Helix to the Kubernetes clusters on premises or cloud.

NeMo Helix Helm Chart

The NeMo Helix Helm chart is published in the nvidia/nemo-helix NGC org. The chart deploys the platform API, controllers, storage integration, and dependencies required for a full self-managed deployment.

Customize the installation by updating a pinned values.yaml file for your target cluster. For chart assets and additional details, see the NeMo Helix artifacts in NGC.

The install guide uses NHX_HELM_CHART_VERSION so every install and upgrade is tied to a specific chart version.

Deploy the NeMo Helix with Helm

The following sections provide detailed instructions on how to deploy the NeMo Helix using the NeMo Helix Helm Chart.

Install

Install NeMo Helix with Helm on a Kubernetes cluster.

cluster-admin

Other Configurations

Review and manage other cluster settings.

OpenTelemetry

Review and configure how NeMo Helix uses OpenTelemetry for observability.

Milvus

Review and configure how NeMo Helix uses Milvus for vector database storage.