Is this page helpful?

Infrastructure Support Matrix

Supported NVIDIA Infrastructure Software

Supported Infrastructure Software

Product	Version	x86	ARM
NVIDIA GPU Data Center Driver	535.216.01	Supported	Supported
NVIDIA vGPU (C-Series Drivers Host and Guest)	16.8	Supported	Not Supported
NVIDIA Container Toolkit	v1.16.2	Supported	Supported
NVIDIA GPU Operator	v24.6.2	Supported	Supported
NVIDIA Network Operator	v24.7.0	Supported	Supported
NVIDIA Base Command Manager Essentials (BCME)	10.24.09	Supported	Not Supported

Supported NVIDIA GPUs and Networking

NVIDIA AI Enterprise is supported on the following NVIDIA GPUs with compatible third-party servers listed on the NVIDIA-certified systems page.

Specific NVIDIA AI Enterprise supported products may not support all OS or GPU; refer to the individual product release notes for any discrepancies.

NVIDIA Hopper

• NVIDIA H800

• NVIDIA H800 NVL

• NVIDIA H100

• NVIDIA H100 NVL [1]

NVIDIA Grace Hopper

• NVIDIA GH200 [11]

NVIDIA Ampere

• NVIDIA A800

• NVIDIA AX800

• NVIDIA A100X

• NVIDIA A100

• NVIDIA A40

• NVIDIA A30X

• NVIDIA A30

• NVIDIA A16

• NVIDIA A10

• NVIDIA A10G

• NVIDIA A10M

• NVIDIA A2

• NVIDIA RTX A6000

• NVIDIA RTX A5000

• NVIDIA RTX A4000

NVIDIA Ada Lovelace

• NVIDIA L40S

• NVIDIA L40

• NVIDIA L20

• NVIDIA L4

• NVIDIA L2

• NVIDIA RTX 6000 Ada Generation

• NVIDIA RTX 4000 SFF Ada Generation

NVIDIA Turing

• NVIDIA T4

• NVIDIA T4G

• NVIDIA Quadro RTX 8000

• NVIDIA Quadro RTX 6000

• NVIDIA Quadro RTX 4000

NVIDIA Volta

• NVIDIA V100

Multi-node requires an Ethernet NIC that supports RoCE. For best performance, NVIDIA recommends using an NVIDIA Mellanox ConnectX and an NVIDIA GPU.

Supported Ethernet NICs and SuperNICs

Product Family	Architecture
NVIDIA ConnectX-6 NIC	NVIDIA ConnectX-6
NVIDIA ConnectX-6 Dx NIC	NVIDIA ConnectX-6 Dx
NVIDIA ConnectX-7 NIC	NVIDIA ConnectX-7
NVIDIA BlueField-3 SuperNIC	NVIDIA BlueField-3

Supported Platforms

NVIDIA AI Enterprise is supported on NVIDIA DGX servers in bare-metal deployments with the NVIDIA data center driver for Linux, which is included in the DGX OS software.

Supported Platforms

Accelerated Platform	Architecture
NVIDIA DGX H100	NVIDIA Hopper
NVIDIA DGX A100	NVIDIA Ampere
NVIDIA HGX H800	NVIDIA Hopper
NVIDIA HGX H100	NVIDIA Hopper
NVIDIA HGX H20	NVIDIA Hopper
NVIDIA HGX A800	NVIDIA Ampere
NVIDIA HGX A100	NVIDIA Ampere
NVIDIA IGX Orin [2]	NVIDIA Ada Lovelace

Note

DGX platforms, HGX platforms with KVM hypervisors, and IGX Orin are not supported with NVIDIA vGPU (C-Series).

For NVIDIA IGX, refer to the NVIDIA AI Enterprise - IGX Packaging, Pricing, and Licensing Guide.

Bare Metal

Refer to the following platform support matrix for NVIDIA AI Enterprise if you have a dedicated physical server on-premises.

Containers Orchestrated with Kubernetes on Bare Metal

Orchestration Platform			Operating System		NVIDIA AI Enterprise Infrastructure Support
Name	Versions	Engine	Name	Versions	GPU Operator	Network Operator	GPU Driver Support [3]
Charmed Kubernetes	1.28 1.29 1.30	Containerd	Ubuntu	20.04 LTS 22.04 LTS	Supported	Supported	vGPU Guest/Data center
HPE Ezmeral Runtime Enterprise	5.6	Containerd	Red Hat Enterprise Linux	8.6 8.8 8.10	Supported	Not Supported	vGPU Guest/Data center
Red Hat OpenShift [4]	4.13 4.14 4.15 4.16	CRI-O	Red Hat CoreOS	4.13 4.14 4.15 4.16	Supported	Supported	vGPU Guest/Data center
Nutanix NKP	2.12 2.13	Containerd	Ubuntu	20.04 LTS 22.04 LTS	Supported	Not Supported	vGPU Guest/Data center
Upstream Kubernetes	1.24 1.25 1.26 1.27 1.28 1.29 1.30	Containerd	Red Hat Enterprise Linux	8.6 8.8 8.10	Supported	Supported [5]	vGPU Guest/Data center
		Containerd	Ubuntu	20.04 LTS 22.04 LTS	Supported	Supported [5]	vGPU Guest/Data center
		CRI-O	Red Hat Enterprise Linux	8.6 8.8 8.10	Supported	Not Supported	vGPU Guest/Data center
		CRI-O	Ubuntu	20.04 LTS 22.04 LTS	Supported	Not Supported	vGPU Guest/Data center

Standalone Containers on Bare Metal

Container			Operating System		NVIDIA AI Enterprise Infrastructure Support
Name	Versions	Engine	Name	Versions	GPU Operator	Network Operator	GPU Driver Support
Non-Kubernetes (standalone containers)		Docker/Podman	Red Hat Enterprise Linux	7.9 8.6 8.8 8.10 9.2 9.4	N/A	N/A	vGPU Guest/Data center
		Docker/Podman	SUSE Linux Enterprise Server	15 SP2 and later	N/A	N/A	vGPU Guest/Data center
		Docker/Podman	Ubuntu	20.04 LTS 22.04 LTS	N/A	N/A	vGPU Guest/Data center

Virtualized

Refer to the following platform support matrix for NVIDIA AI Enterprise if you have a physical server separated into multiple virtual servers on-premises.

Containers Orchestrated with Kubernetes on Virtualized Environments

Orchestration Platform			Guest Operating System		Hypervisor		NVIDIA AI Enterprise Infrastructure Support
Name	Versions	Engine	Name	Versions	Name	Versions	GPU Operator	Network Operator	GPU Driver Support (inside the virtual machine)
									vGPU	Passthrough [6]
Charmed Kubernetes	1.28 1.29 1.30	Containerd	Ubuntu	20.04 LTS 22.04 LTS	Ubuntu [7] [10]	20.04 LTS 22.04 LTS	Supported	Supported	vGPU Guest	vGPU Guest/Data center
		Containerd	Ubuntu	20.04 LTS 22.04 LTS	VMware vSphere	7.0 update 2 and later 8.0 and later	Supported	Supported	vGPU Guest	vGPU Guest/Data center
Red Hat OpenShift [8]	4.13 4.14 4.15 4.16	CRI-O	Red Hat CoreOS	4.13 4.14 4.15 4.16	Red Hat Enterprise Linux [7] [10]	7.9 8.6 8.8 8.10 9.2 9.4	Supported	Supported	vGPU Guest	vGPU Guest/Data center
		CRI-O	Red Hat CoreOS	4.13 4.14 4.15 4.16	VMware vSphere	7.0 update 2 and later 8.0 and later	Supported	Supported	vGPU Guest	vGPU Guest/Data center
VMware vSphere with Tanzu	TKR 1.23 - TKR 1.30	Containerd	Ubuntu	20.04 LTS 22.04 LTS	VMware vSphere	7.0 update 2 and later 8.0 and later	Supported	Supported	vGPU Guest	vGPU Guest/Data center
Nutanix NKP	2.12 2.13	Containerd	Ubuntu	20.04 LTS 22.04 LTS	Nutanix AOS/AHV [7] [10]	6.5 6.6 6.7 6.8 6.9 6.10	Supported	Not Supported	vGPU Guest	vGPU Guest/Data center
Upstream Kubernetes	1.24 1.25 1.26 1.27 1.28 1.29 1.30	Containerd	Red Hat Enterprise Linux	8.6 8.8 8.10	Red Hat Enterprise Linux [7] [10]	7.9 8.6 8.8 8.10 9.2 9.4	Supported	Supported [5]	vGPU Guest	vGPU Guest/Data center
		Containerd	Red Hat Enterprise Linux	8.6 8.8 8.10	VMware vSphere	7.0 update 2 and later 8.0 and later	Supported	Supported [5]	vGPU Guest	vGPU Guest/Data center
		Containerd	Red Hat Enterprise Linux	8.6 8.8	Nutanix AOS/AHV [7] [10]	6.5 6.6 6.7 6.8 6.9 6.10	Supported	Supported [5]	vGPU Guest	vGPU Guest/Data center
Upstream Kubernetes	1.24 1.25 1.26 1.27 1.28 1.29 1.30	Containerd	Ubuntu	20.04 LTS 22.04 LTS	Ubuntu [7] [10]	20.04 LTS 22.04 LTS	Supported	Supported [5]	vGPU Guest	vGPU Guest/Data center
		Containerd	Ubuntu	20.04 LTS 22.04 LTS	VMware vSphere	7.0 update 2 and later 8.0	Supported	Supported [5]	vGPU Guest	vGPU Guest/Data center
		Containerd	Ubuntu	20.04 LTS 22.04 LTS	Nutanix AOS/AHV [7] [10]	6.5 6.6 6.7 6.8 6.9 6.10	Supported	Supported [5]	vGPU Guest	vGPU Guest/Data center
Upstream Kubernetes	1.24 1.25 1.26 1.27 1.28 1.29 1.30	CRI-O	Red Hat Enterprise Linux	8.6 8.8 8.10	Red Hat Enterprise Linux [7] [10]	7.9 8.6 8.8 8.10 9.2 9.4	Supported	Supported [5]	vGPU Guest	vGPU Guest/Data center
		CRI-O	Red Hat Enterprise Linux	8.6 8.8 8.10	VMware vSphere	7.0 update 2 and later 8.0 and later	Supported	Supported [5]	vGPU Guest	vGPU Guest/Data center
		CRI-O	Red Hat Enterprise Linux	8.6 8.8 8.10	Nutanix AOS/AHV [7] [10]	6.5 6.6 6.7 6.8 6.9 6.10	Supported	Supported [5]	vGPU Guest	vGPU Guest/Data center
Upstream Kubernetes	1.24 1.25 1.26 1.27 1.28 1.29 1.30	CRI-O	Ubuntu	20.04 LTS 22.04 LTS	Ubuntu [7] [10]	20.04 LTS 22.04 LTS	Supported	Not Supported [5]	vGPU Guest	vGPU Guest/Data center
		CRI-O	Ubuntu	20.04 LTS 22.04 LTS	VMware vSphere	7.0 update 2 and later 8.0 and later	Supported	Not Supported [5]	vGPU Guest	vGPU Guest/Data center
		CRI-O	Ubuntu	20.04 LTS 22.04 LTS	Nutanix AOS/AHV [7] [10]	6.5 6.6 6.7 6.8 6.9 6.10	Supported	Not Supported [5]	vGPU Guest	vGPU Guest/Data center

Note

If the NVIDIA AI Enterprise release that you need is not available from the My Nutanix portal, contact Nutanix. Then, follow the instructions on the My Nutanix portal to obtain the correct NVIDIA AI Enterprise graphics drivers from the NVIDIA Licensing Portal.

Standalone Containers on Virtualized Environments

Container			Guest Operating System		Hypervisor		NVIDIA AI Enterprise Infrastructure Support
Name	Versions	Engine	Name	Versions	Name	Versions	GPU Operator	Network Operator	GPU Driver Support (inside the virtual machine)
									vGPU	Passthrough [6]
Non-Kubernetes (standalone containers)		Docker/Podman	Red Hat Enterprise Linux	7.9 8.6 8.8 8.10 9.2 9.4	Red Hat Enterprise Linux [7]	7.9 8.6 8.8 8.9 9.2 9.4	N/A	N/A	vGPU Guest	vGPU Guest/Data center
			Red Hat Enterprise Linux	7.9 8.6 8.8 8.10 9.2 9.4	VMware vSphere	7.0 update 2 and later 8.0 and later	N/A	N/A	vGPU Guest	vGPU Guest/Data center
Non-Kubernetes (standalone containers)		Docker/Podman	SUSE Linux Enterprise Server	15 SP2 and later	VMWare vSphere	7.0 update 2 and later 8.0 and later	N/A	N/A	vGPU Guest	vGPU Guest/Data center
Non-Kubernetes (standalone containers)		Docker/Podman	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	Ubuntu [7] [10]	20.04 LTS 22.04 LTS	N/A	N/A	vGPU Guest	vGPU Guest/Data center
			Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	VMware vSphere	7.0 update 2 and later 8.0 and later	N/A	N/A	vGPU Guest	vGPU Guest/Data center
			Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	Nutanix AOS/AHV [7] [9] [10]	6.5 6.6 6.7 6.8 6.9 6.10	N/A	N/A	vGPU Guest	vGPU Guest/Data center

Note

If the NVIDIA AI Enterprise release that you need is not available from the My Nutanix portal, contact Nutanix. Then, follow the instructions on the My Nutanix portal to obtain the correct NVIDIA AI Enterprise graphics drivers from the NVIDIA Licensing Portal.

Non-containerized Applications on Hypervisors and Guest Operating Systems Supported with vGPU

Hypervisor		Guest Operating System		NVIDIA AI Enterprise Infrastructure Support
Name	Version	Name	Version	vGPU
VMware ESX	ESXi 8.0	Debian	12	vGPU Guest
	ESXi 8.0	Red Hat Enterprise Linux	8.8 8.10 9.2 9.4	vGPU Guest
	ESXi 8.0	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	vGPU Guest
	ESXi 8.0	SUSE Linux Enterprise Server	12 SP3+ 12 SP5 15 SP2	vGPU Guest
VMware ESX	ESXi 7.0 Update 2	Red Hat Enterprise Linux	8.8 8.10 9.2 9.4	vGPU Guest
	ESXi 7.0 Update 2	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	vGPU Guest
	ESXi 7.0 Update 2	SUSE Linux Enterprise Server	12 SP3+ 12 SP5 15 SP2	vGPU Guest
Ubuntu [7] [10]	20.04 LTS 22.04 LTS 24.04 LTS	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	vGPU Guest
Red Hat Enterprise Linux (RHEL) with KVM [7] [10]	RHEL 8.8	Red Hat Enterprise Linux	8.8 8.10	vGPU Guest
	RHEL 8.10	Red Hat Enterprise Linux	8.8 8.10	vGPU Guest
Red Hat Enterprise Linux (RHEL) with KVM [7] [10]	RHEL 9.2	Red Hat Enterprise Linux	8.8 8.10 9.2 9.4	vGPU Guest
	RHEL 9.4	Red Hat Enterprise Linux	8.8 8.10 9.2 9.4	vGPU Guest
Nutanix AOS/AHV [7] [10]	AOS/AHV 6.5 AOS/AHV 6.6 AOS/AHV 6.7 AOS/AHV 6.8 AOS/AHV 6.9 AOS/AHV 6.10	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	vGPU Guest
	AOS/AHV 6.5 AOS/AHV 6.6 AOS/AHV 6.7 AOS/AHV 6.8 AOS/AHV 6.9 AOS/AHV 6.10	Debian	12	vGPU Guest
	AOS/AHV 6.5 AOS/AHV 6.6 AOS/AHV 6.7 AOS/AHV 6.8 AOS/AHV 6.9 AOS/AHV 6.10	Red Hat Enterprise Linux	8.8 8.10 9.2 9.4	vGPU Guest
	AOS/AHV 6.5 AOS/AHV 6.6 AOS/AHV 6.7 AOS/AHV 6.8 AOS/AHV 6.9 AOS/AHV 6.10	SUSE Linux Enterprise Server	12 15	vGPU Guest

Note

If the NVIDIA AI Enterprise release that you need is not available from the My Nutanix portal, contact Nutanix. Then, follow the instructions on the My Nutanix portal to obtain the correct NVIDIA AI Enterprise graphics drivers from the NVIDIA Licensing Portal.

Base Command Manager Essentials

Base Command Manager

Orchestration Platform			Operating System		NVIDIA AI Enterprise Infrastructure Support
Name	Versions	Engine	Name	Versions	GPU Operator	Network Operator	GPU Driver Support [2]
Upstream Kubernetes	1.27 1.28 1.29 1.30	Containerd	Ubuntu	20.04 LTS 22.04 LTS	Supported	Supported	Data center
		Containerd	Red Hat Enterprise Linux	8 9	Supported	Supported	Data center
Slurm (non-Kubernetes)	23.02 23.11 24.05	N/A	Ubuntu	20.04 LTS 22.04 LTS	N/A	N/A	Data center
		N/A	Red Hat Enterprise Linux	8 9	N/A	N/A	Data center
PBS Pro	2024.1.1 2022.1.6	N/A	Ubuntu	20.04 LTS 22.04 LTS	N/A	N/A	Data center
		N/A	Red Hat Enterprise Linux	8 9	N/A	N/A	Data center

Public Cloud

Managed Kubernetes

Refer to the following platform support matrix for NVIDIA AI Enterprise if you have a virtual server that runs in a cloud computing environment and is accessible remotely.

Managed Kubernetes

Cloud Service Provider	Orchestration Platform			Operating System		NVIDIA AI Enterprise Infrastructure Support
	Name	K8s Versions	Engine	Name	Versions	GPU Operator	Network Operator	GPU Driver Support
AWS	Amazon Elastic Kubernetes Service (EKS)	1.24 1.25 1.26 1.27 1.28 1.29 1.30	Containerd	Ubuntu	20.04 LTS 22.04 LTS	Supported	Not Supported	vGPU Guest/Data center
Google	Google Kubernetes Engine (GKE)	1.24 1.25 1.26 1.27 1.28 1.29 1.30	Containerd	Ubuntu	22.04 LTS	Supported	Not Supported	vGPU Guest/Data center
Microsoft	Azure Kubernetes Service (AKS)	1.24 1.25 1.26 1.27 1.28 1.29 1.30	Containerd	Ubuntu	22.04 LTS	Supported	Not Supported	vGPU Guest/Data center
N/A	Red Hat OpenShift (Managed Service)	4.13 4.14 4.15 4.16	CRI-O	Red Hat CoreOS	4.13 4.14 4.15 4.16	Supported	Not Supported	vGPU Guest/Data center

Standard GPU Instances

Standard Instances for Kubernetes and Standalone Containers

Cloud Service Provider	Virtual Machine (VM) Instance with GPU	Product Family
Alibaba	gn7e	NVIDIA A10
	gn7i	NVIDIA A10
	gn7s	NVIDIA A30
	gn6i	NVIDIA T4
	gn6e	NVIDIA V100
	gn6v	NVIDIA V100
Amazon Web Services (AWS)	EC2 P3	NVIDIA V100
	EC2 P4	NVIDIA A100
	EC2 P5	NVIDIA H100
	EC2 G4	NVIDIA T4
	EC2 G5	NVIDIA A10G
	EC2 G6	NVIDIA L4
	EC2 G6e	NVIDIA L40S
Azure	NCads_H100_v5-series	NVIDIA H100
	NCCads_H100_v5-series	NVIDIA H100
	NCv3-series	NVIDIA V100
	NCasT4_v3-series	NVIDIA T4
	NC_A100_v4-series	NVIDIA A100
Google Cloud Platform (GCP)	A3 VM	NVIDIA H100
	A2 VM	NVIDIA A100
	G2 VM	NVIDIA L4
	N1 VM	NVIDIA T4 NVIDIA V100
Oracle Cloud Infrastructure (OCI)	BM.GPU3	NVIDIA V100
	BM.GPU4 BM.GPU.A100	NVIDIA A100
	BM.GPU.A10	NVIDIA A10
	BM.GPU.H100.8	NVIDIA H100
	VM.GPU3	NVIDIA V100
	VM.GPU.A10	NVIDIA A10
Tencent Cloud	PNV4	NVIDIA A10
	GT4	NVIDIA A100
	GN10Xp GN10X	NVIDIA V100
	GN7 GN7vi GI3X	NVIDIA T4
Volcano Engine	ecs.gni2	NVIDIA A10

NVIDIA GPU Optimized VMI on CSP Marketplace

For ease of use in the cloud, NVIDIA provides compute-optimized and validated base Virtual Machine Instances (VMI) to run standalone NVIDIA AI containers through CSP marketplaces. Each VMI includes key technologies and software from NVIDIA for rapid deployment, management, and scaling of AI workloads in the modern hybrid cloud.

NVIDIA GPU Optimized VMI on CSP Marketplace

Cloud Service Provider	VMI Name	GPUs	K8s Support	Standalone Container
AWS	NVIDIA AI Enterprise	Listed in Standard GPU Instances	Not Supported	Supported
Azure	NVIDIA AI Enterprise	Listed in Standard GPU Instances	Not Supported	Supported
GCP	NVIDIA AI Enterprise	Listed in Standard GPU Instances	Not Supported	Supported

CPU-Only Server Support

NVIDIA AI Enterprise will support the following CPU-enabled frameworks:

• TensorFlow

• PyTorch

• Triton Inference Server with FIL backend

• NVIDIA RAPIDS with XGBoost and Dask

The CPU-enabled frameworks are supported on CPU-only servers that are part of the NVIDIA Certified Systems list.

Footnotes

[1]

NVIDIA H200 is not supported with NVIDIA vGPU (C-Series) 17 branch.

[2] (1,2)

With optional RTX 6000 Ada Lovelace GPU.

[3]

The NVIDIA vGPU Guest Driver is optional in bare metal deployments. Use of the NVIDIA vGPU Guest Driver allows licensing enforcement.

[4]

Red Hat OpenShift Virtualization is supported with Red Hat OpenShift 4.15 and 4.16 and only with GPU Passthrough and NVIDIA vGPU C-Series (exclusive of MIG-backed NVIDIA vGPUs).

[5] (1,2,3,4,5,6,7,8,9,10,11,12,13,14)

Network Operator is supported with RHEL 8.6, 8.8, and 8.10.

[6] (1,2)

NVIDIA vGPU provides management (GPU Partitioning, live migration, etc.) and monitoring capabilities that aren’t available with GPU Passthrough and the Datacenter GPU Driver.

[7] (1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18)

NVIDIA vGPU (C-Series) software is supported on Linux with KVM platforms only by specific hypervisor software vendors. For information about which NVIDIA vGPU software releases and hypervisor software releases are supported, consult the documentation from your hypervisor vendor. For information about Linux distributions supported as a guest OS, consult the documentation from your hypervisor vendor. A guest OS release must be supported not only by NVIDIA vGPU (C-Series) software but also by your virtualization software vendor.

[8]

NVIDIA AI Enterprise supports every patch release for the listed Red Hat OpenShift release provided that Red Hat also supports it. When a release or patch release is no longer supported by Red Hat, it is no longer supported by NVIDIA AI Enterprise.

[9]

Obtain the NVIDIA Virtual GPU Manager software directly from Nutanix through the My Nutanix portal (My Nutanix account required). If the NVIDIA AI Enterprise release is not available from the My Nutanix portal, contact Nutanix.

[10] (1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17)

NVIDIA AI Enterprise only supports running workloads on a single-node setup for KVM hypervisors.

[11]

NVIDIA GH200 is not supported with vGPU (C-Series) 16 branch.