Hardware and Software Requirements for NeMo Platform

View as Markdown

This page lists the requirements for the OSS local-install path and self-managed Kubernetes deployments. For the full compatibility table, see the Support Matrix.

For local setup, use the Python package and nemo setup. For self-managed clusters, use the NeMo Platform Helm chart on Kubernetes.

Local Setup Requirements

ComponentRequirementNotes
Python3.12 or 3.13Use an isolated virtual environment.
Package installeruv>=0.9.14,<0.10.0 recommended; pip supportedThe one-line installer sets up uv automatically when needed.
Operating systemRecent Linux or macOS releaseSee the Support Matrix for the supported OS list.
Memory8 GB RAM minimum16 GB or more is recommended for larger local workflows.
Disk space16 GB free disk space minimumAdditional space is needed for datasets, job outputs, and local model artifacts.
NetworkOutbound HTTPS accessRequired for package installation and hosted model-provider APIs.
Model providerNVIDIA Build, OpenAI, Anthropic, Google Gemini, Ollama, or a custom OpenAI-compatible endpointnemo setup configures one provider as part of the setup flow.
BrowserCurrent Chrome, Edge, Firefox, or SafariRequired for the Studio UI.

Self-Managed Kubernetes Requirements

ComponentRequirementNotes
Kubernetesminikube, kind, EKS, AKS, GKE, OKE, OpenShift, or on-prem KubernetesUse a cluster with storage, networking, and image-pull access configured before installing the chart.
HelmHelm 3Required to install and upgrade the NeMo Platform chart.
StorageReadWriteMany-capable persistent storageRequired for shared files and job storage in multi-pod deployments.
Image accessNGC credentials and Kubernetes image pull secretsRequired to pull NeMo Platform container images.

GPU Requirements

Local provider workflows do not require a local GPU. GPU requirements apply only when you run local model or GPU-accelerated workloads.

ComponentRequirementNotes
GPUNVIDIA data center GPU with 40 GB VRAM minimum; 80 GB recommendedA100 80GB, H100 80GB, and B200 180GB meet the recommended profile.
CUDACUDA 13 or laterGPU workloads require CUDA 13 or later.
NVIDIA driverCUDA 13-capable driver, R580 branch or laterSee the CUDA 13.0 release notes for exact driver minimums by operating system.
PlatformLinux x86_64Local NVIDIA GPU workloads are not supported on macOS or Windows.

Verify Your Environment

$python --version
$nemo --help
$curl -s http://localhost:8080/health/ready

For setup instructions, see Setup.