This page is for version 0.7.2.
For other versions, use one of these documentation indexes:
- Latest (default): https://docs.nvidia.com/nemo-helix/latest/llms.txt
- 0.8.0: https://docs.nvidia.com/nemo-helix/v0.8.0/llms.txt
- 0.7.3: https://docs.nvidia.com/nemo-helix/v0.7.3/llms.txt
- 0.7.2: https://docs.nvidia.com/nemo-helix/v0.7.2/llms.txt
- 0.7.1: https://docs.nvidia.com/nemo-helix/v0.7.1/llms.txt
- 0.7.0: https://docs.nvidia.com/nemo-helix/v0.7.0/llms.txt
- 0.6.0: https://docs.nvidia.com/nemo-helix/v0.6.0/llms.txt
- 0.5.1: https://docs.nvidia.com/nemo-helix/v0.5.1/llms.txt
- 0.5.0: https://docs.nvidia.com/nemo-helix/v0.5.0/llms.txt
- 0.4.0: https://docs.nvidia.com/nemo-helix/v0.4.0/llms.txt
- 0.3.0: https://docs.nvidia.com/nemo-helix/v0.3.0/llms.txt
- 0.2.0: https://docs.nvidia.com/nemo-helix/v0.2.0/llms.txt
This matrix defines the supported OSS targets for NeMo Helix. It covers the
Python package, CLI, SDK, local services started by nemo setup, and
self-managed Kubernetes deployments installed with the NeMo Helix Helm chart.
Host Platforms
| Area | Supported | Notes |
|---|---|---|
| Deployment mode | nemo setup local install; Helm chart on Kubernetes | nemo setup starts local services, registers a model provider, and configures the CLI and SDK. The Helm chart is the supported path for self-managed Kubernetes clusters. |
| Python | 3.12, 3.13, 3.14 | Use an isolated virtual environment. Python 3.12 is the lowest supported Python version and Python 3.14 is the highest supported Python version. |
| Linux | Ubuntu 22.04 LTS, Ubuntu 24.04 LTS, RHEL 9, Rocky Linux 9, Debian 12 | Supported for CLI, SDK, local services, and NVIDIA GPU workloads. |
| macOS | macOS Tahoe 26 and macOS Sequoia 15 | Supported for CLI, SDK, local services, and cloud/provider workflows. Local NVIDIA GPU workloads are not supported on macOS. |
| Architecture | x86_64 Linux; Apple Silicon and Intel macOS | NVIDIA GPU workloads require x86_64 Linux. |
| Windows and WSL | Not supported for the OSS local install path | Use a supported Linux or macOS host for the local install path. |
| Kubernetes clusters | minikube, kind, EKS, AKS, GKE, OKE, OpenShift, and on-prem Kubernetes | See Install NeMo Helix with Helm for prerequisites and cluster-specific notes. |
Local Runtime
| Area | Supported | Notes |
|---|---|---|
| Package installation | uv>=0.10.10 recommended for source checkouts; pip supported for published packages | The one-line installer sets up uv automatically. Published packages can also be installed with pip install "nemo-helix[all]". |
| Shell | Bash or zsh | Used by the installer, setup commands, and documented examples. |
| Browser | Current Chrome, Edge, Firefox, or Safari | Required for the Studio UI and generated documentation. |
GPU Support
| Area | Supported | Notes |
|---|---|---|
| CUDA | CUDA 13 or later | GPU workloads require CUDA 13 or later. |
| NVIDIA driver | CUDA 13-capable driver, R580 branch or later | See the CUDA 13.0 release notes for exact driver minimums by operating system. |
| GPU memory | 40 GB VRAM minimum; 80 GB VRAM recommended | Smaller GPUs can run provider or client workflows, but local model and GPU-accelerated jobs require larger GPUs. |
| Recommended GPUs | NVIDIA A100 80GB, H100 80GB, B200 180GB | Use comparable data center GPUs that meet the CUDA and memory requirements for the model or job. |
| GPU platform | Linux x86_64 | macOS and Windows are not supported for local NVIDIA GPU workloads. |
Resource Profiles
| Profile | CPU and memory | Storage | GPU |
|---|---|---|---|
| CLI, SDK, and hosted-provider setup | 8 GB RAM minimum | 16 GB free disk space | Not required |
| Local GPU workloads | 16 GB RAM minimum; 32 GB recommended | Additional tens to hundreds of GB for model artifacts and job outputs | 40 GB VRAM minimum; 80 GB recommended |
Model Providers
| Provider | Support | Notes |
|---|---|---|
| NVIDIA Build | Supported | Configure with NVIDIA_API_KEY. |
| OpenAI | Supported | Configure with OPENAI_API_KEY. |
| Anthropic | Supported | Configure with ANTHROPIC_API_KEY. |
| Google Gemini | Supported | Configure with GEMINI_API_KEY. |
| Ollama | Supported for local provider workflows | Ollama must be installed and running before setup. |
| Custom OpenAI-compatible endpoint | Supported | Configure NEMO_DEFAULT_INFERENCE_BASE_URL and NEMO_DEFAULT_INFERENCE_KEY. |
Out of Scope
The following are not part of the OSS support matrix:
- Native Windows local install.
- Docker Compose deployment guides.
- WSL-based local install or GPU validation.
- macOS local GPU workloads.
- Python earlier than 3.12 or Python 3.15 and later.
- CUDA versions earlier than 13 for GPU workloads.