Support Matrix

This page is the version-pinned support matrix for NVIDIA AI Enterprise Infrastructure Release 4.6. Use it before you install or upgrade to confirm that your GPUs, networking, system platform, operating system, hypervisor or cloud, and orchestration stack are supported on this release. It covers the deployment prerequisites, supported NVIDIA infrastructure software components and versions, qualified GPUs and networking products, and the operating systems, hypervisors, Kubernetes distributions, and cloud instance types validated for bare metal, virtualized, and public cloud deployments.

If you need to compare configurations across releases (4.4 through 4.6) or filter by deployment type, OS, hypervisor, or orchestration, use the Interactive Support Matrix instead. For a summary of new features and updated component versions in this release, see the Release Notes.

Prerequisites

Supported configurations require all of the following.

On-Premises Servers

1. GPU supported by NVIDIA AI Enterprise (and optionally a supported networking card)

2. NVIDIA-Certified Systems

3. Supported infrastructure management software - bare-metal or virtualized (OS, orchestration platform, hypervisor)

Cloud Servers

1. Supported orchestration platform

2. Supported virtual machine instance - standard or optimized

Supported NVIDIA Infrastructure Software

Table 3 Supported Infrastructure Software

Product	Version	x86	ARM
NVIDIA GPU Data Center Driver	535.247.01	Supported	Supported
NVIDIA DOCA-OFED Driver for Networking	v24.10 (DOCA 2.9.1)	Supported	Supported
NVIDIA vGPU (C-Series Drivers Host and Guest)	16.10	Supported	Not Supported
NVIDIA Container Toolkit	v1.17.4	Supported	Supported
NVIDIA GPU Operator	v25.3.0	Supported	Supported
NVIDIA Network Operator	v25.1.0	Supported	Supported
NVIDIA Base Command Manager Essentials (BCME)	10.25.03	Supported	Not Supported

Supported NVIDIA GPUs and Networking

NVIDIA AI Enterprise is supported on the following NVIDIA GPUs with compatible third-party servers listed on the NVIDIA-Certified Systems page.

Specific NVIDIA AI Enterprise-supported products may not support all operating systems or GPUs. Refer to the individual product release notes for discrepancies.

Note

For HGX support information, refer to the Supported Platforms section.

NVIDIA Hopper

• NVIDIA H800

• NVIDIA H800 NVL

• NVIDIA H100

• NVIDIA H100 NVL [1]

• NVIDIA H20

NVIDIA Grace Hopper

• NVIDIA GH200 [11]

NVIDIA Ampere

• NVIDIA A800

• NVIDIA AX800

• NVIDIA A100X

• NVIDIA A100

• NVIDIA A40

• NVIDIA A30X

• NVIDIA A30

• NVIDIA A16

• NVIDIA A10

• NVIDIA A10G

• NVIDIA A10M

• NVIDIA A2

• NVIDIA RTX A6000

• NVIDIA RTX A5000

• NVIDIA RTX A4000

NVIDIA Ada Lovelace

• NVIDIA L40S

• NVIDIA L40

• NVIDIA L20

• NVIDIA L4

• NVIDIA L2

• NVIDIA RTX 6000 Ada Generation

• NVIDIA RTX 4000 SFF Ada Generation

NVIDIA Turing

• NVIDIA T4

• NVIDIA T4G

• NVIDIA Quadro RTX 8000

• NVIDIA Quadro RTX 6000

• NVIDIA Quadro RTX 4000

NVIDIA Volta

• NVIDIA V100

Multi-node requires an Ethernet NIC that supports RoCE. NVIDIA recommends using an NVIDIA Mellanox ConnectX and an NVIDIA GPU for best performance.

Table 4 Supported Ethernet NICs and SuperNICs

Product Family	Architecture
NVIDIA ConnectX-6 NIC	NVIDIA ConnectX-6
NVIDIA ConnectX-6 Dx NIC	NVIDIA ConnectX-6 Dx
NVIDIA ConnectX-7 NIC	NVIDIA ConnectX-7
NVIDIA BlueField-3 SuperNIC	NVIDIA BlueField-3

Supported Platforms

NVIDIA AI Enterprise is supported on NVIDIA DGX servers in bare-metal deployments with the NVIDIA data center driver for Linux included in the DGX OS software.

Note

DGX platforms, HGX platforms with KVM hypervisors, and IGX Orin are not supported with NVIDIA vGPU for Compute. For NVIDIA IGX licensing information, refer to the NVIDIA AI Enterprise Licensing Documentation.

Table 5 Supported Platforms

Accelerated Platform	Architecture
NVIDIA DGX H100	NVIDIA Hopper
NVIDIA DGX A100	NVIDIA Ampere
NVIDIA HGX H800	NVIDIA Hopper
NVIDIA HGX H100	NVIDIA Hopper
NVIDIA HGX H20	NVIDIA Hopper
NVIDIA HGX A800	NVIDIA Ampere
NVIDIA HGX A100	NVIDIA Ampere
NVIDIA IGX Orin [2]	NVIDIA Ada Lovelace

Bare Metal

Use the following tables to verify compatibility for NVIDIA AI Enterprise on dedicated physical servers.

Table 6 Containers Orchestrated with Kubernetes on Bare Metal

Orchestration Platform			Operating System		NVIDIA AI Enterprise Infrastructure Support
Name	Versions	Engine	Name	Versions	GPU Operator	Network Operator	GPU Driver Support [3]
Charmed Kubernetes	1.29 1.30 1.31 1.32	Containerd	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	Supported	Supported	vGPU Guest/Data center
HPE Ezmeral Runtime Enterprise	5.6	Containerd	Red Hat Enterprise Linux	8.6 8.8 8.10	Supported	Not Supported	vGPU Guest/Data center
Red Hat OpenShift [4]	4.14 4.15 4.16 4.17 4.18	CRI-O	Red Hat CoreOS	4.14 4.15 4.16 4.17 4.18	Supported	Supported [12]	vGPU Guest/Data center
Nutanix NKP	2.12 2.13	Containerd	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	Supported	Not Supported	vGPU Guest/Data center
Upstream Kubernetes	1.29 1.30 1.31 1.32	Containerd	Red Hat Enterprise Linux	8.6 8.8 8.10	Supported	Supported [5]	vGPU Guest/Data center
Upstream Kubernetes	1.29 1.30 1.31 1.32	Containerd	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	Supported	Supported [5]	vGPU Guest/Data center
Upstream Kubernetes	1.29 1.30 1.31 1.32	CRI-O	Red Hat Enterprise Linux	8.6 8.8 8.10	Supported	Supported	vGPU Guest/Data center
Upstream Kubernetes	1.29 1.30 1.31 1.32	CRI-O	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	Supported	Not Supported	vGPU Guest/Data center

Table 7 Standalone Containers on Bare Metal

Container			Operating System		NVIDIA AI Enterprise Infrastructure Support
Name	Versions	Engine	Name	Versions	GPU Operator	Network Operator	GPU Driver Support
Non-Kubernetes (standalone containers)		Docker/Podman	Red Hat Enterprise Linux	7.9 8.6 8.8 8.10 9.2 9.4 9.5	N/A	N/A	vGPU Guest/Data center
Non-Kubernetes (standalone containers)		Docker/Podman	SUSE Linux Enterprise Server	15 SP2 and later	N/A	N/A	vGPU Guest/Data center
Non-Kubernetes (standalone containers)		Docker/Podman	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	N/A	N/A	vGPU Guest/Data center

Virtualized

Use the following tables to verify compatibility for NVIDIA AI Enterprise in virtualized environments with NVIDIA vGPU for Compute.

Table 8 Containers Orchestrated with Kubernetes on Virtualized Environments

Orchestration Platform			Guest Operating System		Hypervisor		NVIDIA AI Enterprise Infrastructure Support
Name	Versions	Engine	Name	Versions	Name	Versions	GPU Operator	Network Operator	GPU Driver Support (inside the virtual machine)
									vGPU	Passthrough [6]
Charmed Kubernetes	1.29 1.30 1.31 1.32	Containerd	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	Ubuntu [7] [10]	20.04 LTS 22.04 LTS 24.04 LTS	Supported	Supported	vGPU Guest	vGPU Guest/Data center
Charmed Kubernetes	1.29 1.30 1.31 1.32	Containerd	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	VMware vSphere	8.0 and later	Supported	Supported	vGPU Guest	vGPU Guest/Data center
Red Hat OpenShift [8]	4.14 4.15 4.16 4.17 4.18	CRI-O	Red Hat CoreOS	4.14 4.15 4.16 4.17 4.18	Red Hat Enterprise Linux [7] [10]	8.10 9.4 9.6	Supported	Supported [12]	vGPU Guest	vGPU Guest/Data center
Red Hat OpenShift [8]	4.14 4.15 4.16 4.17 4.18	CRI-O	Red Hat CoreOS	4.14 4.15 4.16 4.17 4.18	VMware vSphere	8.0 and later	Supported	Supported [12]	vGPU Guest	vGPU Guest/Data center
VMware vSphere Kubernetes Service	TKR 1.29 TKR 1.30 TKR 1.31 TKR 1.32	Containerd	Ubuntu	20.04 LTS 22.04 LTS	VMware vSphere	8.0 and later	Supported	Not Supported	vGPU Guest	vGPU Guest/Data center
Nutanix NKP	2.12 2.13	Containerd	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	Nutanix AOS/AHV [7] [10]	6.5 6.6 6.7 6.8 6.9 6.10	Supported	Supported	vGPU Guest	vGPU Guest/Data center
Upstream Kubernetes	1.29 1.30 1.31 1.32	Containerd	Red Hat Enterprise Linux	8.6 8.8 8.10	Red Hat Enterprise Linux [7] [10]	8.10 9.4 9.6	Supported	Supported [5]	vGPU Guest	vGPU Guest/Data center
Upstream Kubernetes	1.29 1.30 1.31 1.32	Containerd	Red Hat Enterprise Linux	8.6 8.8 8.10	VMware vSphere	8.0 and later	Supported	Supported [5]	vGPU Guest	vGPU Guest/Data center
Upstream Kubernetes	1.29 1.30 1.31 1.32	Containerd	Red Hat Enterprise Linux	8.6 8.8 8.10	Nutanix AOS/AHV [7] [10]	6.5 6.6 6.7 6.8 6.9 6.10	Supported	Supported [5]	vGPU Guest	vGPU Guest/Data center
Upstream Kubernetes	1.29 1.30 1.31 1.32	Containerd	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	Ubuntu [7] [10]	20.04 LTS 22.04 LTS	Supported	Supported [5]	vGPU Guest	vGPU Guest/Data center
Upstream Kubernetes	1.29 1.30 1.31 1.32	Containerd	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	VMware vSphere	8.0 and later	Supported	Supported [5]	vGPU Guest	vGPU Guest/Data center
Upstream Kubernetes	1.29 1.30 1.31 1.32	Containerd	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	Nutanix AOS/AHV [7] [10]	6.5 6.6 6.7 6.8 6.9 6.10	Supported	Supported [5]	vGPU Guest	vGPU Guest/Data center
Upstream Kubernetes	1.29 1.30 1.31 1.32	CRI-O	Red Hat Enterprise Linux	8.6 8.8 8.10	Red Hat Enterprise Linux [7] [10]	8.10 9.4 9.6	Supported	Supported [5]	vGPU Guest	vGPU Guest/Data center
Upstream Kubernetes	1.29 1.30 1.31 1.32	CRI-O	Red Hat Enterprise Linux	8.6 8.8 8.10	VMware vSphere	8.0 and later	Supported	Supported [5]	vGPU Guest	vGPU Guest/Data center
Upstream Kubernetes	1.29 1.30 1.31 1.32	CRI-O	Red Hat Enterprise Linux	8.6 8.8 8.10	Nutanix AOS/AHV [7] [10]	6.5 6.6 6.7 6.8 6.9 6.10	Supported	Supported [5]	vGPU Guest	vGPU Guest/Data center
Upstream Kubernetes	1.29 1.30 1.31 1.32	CRI-O	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	Ubuntu [7] [10]	20.04 LTS 22.04 LTS 24.04 LTS	Supported	Not Supported [5]	vGPU Guest	vGPU Guest/Data center
Upstream Kubernetes	1.29 1.30 1.31 1.32	CRI-O	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	VMware vSphere	8.0 and later	Supported	Not Supported [5]	vGPU Guest	vGPU Guest/Data center
Upstream Kubernetes	1.29 1.30 1.31 1.32	CRI-O	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	Nutanix AOS/AHV [7] [10]	6.5 6.6 6.7 6.8 6.9 6.10	Supported	Not Supported [5]	vGPU Guest	vGPU Guest/Data center

Note

If the NVIDIA AI Enterprise release you need is unavailable from the My Nutanix portal, contact Nutanix. Then, follow the instructions on the My Nutanix portal to obtain the correct NVIDIA AI Enterprise graphics drivers from the NVIDIA Licensing Portal.

Table 9 Standalone Containers on Virtualized Environments

Container		Guest Operating System		Hypervisor		NVIDIA AI Enterprise Infrastructure Support
Name	Engine	Name	Versions	Name	Versions	GPU Operator	Network Operator	GPU Driver Support (inside the virtual machine)
								vGPU	Passthrough [6]
Non-Kubernetes (standalone containers)	Docker/Podman	Red Hat Enterprise Linux	7.9 8.6 8.8 8.10 9.2 9.4 9.5	Red Hat Enterprise Linux [7]	8.10 9.4 9.6	N/A	N/A	vGPU Guest	vGPU Guest/Data center
Non-Kubernetes (standalone containers)	Docker/Podman	Red Hat Enterprise Linux	7.9 8.6 8.8 8.10 9.2 9.4 9.5	VMware vSphere	8.0 and later	N/A	N/A	vGPU Guest	vGPU Guest/Data center
Non-Kubernetes (standalone containers)	Docker/Podman	SUSE Linux Enterprise Server	15 SP2 and later	VMWare vSphere	8.0 and later	N/A	N/A	vGPU Guest	vGPU Guest/Data center
Non-Kubernetes (standalone containers)	Docker/Podman	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	Ubuntu [7] [10]	20.04 LTS 22.04 LTS 24.04 LTS	N/A	N/A	vGPU Guest	vGPU Guest/Data center
Non-Kubernetes (standalone containers)	Docker/Podman	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	VMware vSphere	8.0 and later	N/A	N/A	vGPU Guest	vGPU Guest/Data center
Non-Kubernetes (standalone containers)	Docker/Podman	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	Nutanix AOS/AHV [7] [9] [10]	6.5 6.6 6.7 6.8 6.9 6.10	N/A	N/A	vGPU Guest	vGPU Guest/Data center

Note

If the NVIDIA AI Enterprise release you need is unavailable from the My Nutanix portal, contact Nutanix. Then, follow the instructions on the My Nutanix portal to obtain the correct NVIDIA AI Enterprise graphics drivers from the NVIDIA Licensing Portal.

Table 10 Non-containerized Applications on Hypervisors and Guest Operating Systems Supported with vGPU

Hypervisor		Guest Operating System		NVIDIA AI Enterprise Infrastructure Support
Name	Versions	Name	Versions	vGPU
VMware ESX	ESXi 8.0 and later	Debian	12	vGPU Guest
VMware ESX	ESXi 8.0 and later	Red Hat Enterprise Linux	8.10 9.4 9.6	vGPU Guest
VMware ESX	ESXi 8.0 and later	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	vGPU Guest
VMware ESX	ESXi 8.0 and later	SUSE Linux Enterprise Server	12 SP3+ 12 SP5 15 SP2	vGPU Guest
VMware ESX	ESXi 8.0 and later	Microsoft Windows	Server 2022 Windows 11, 10	vGPU Guest
Ubuntu [7] [10]	20.04 LTS 22.04 LTS 24.04 LTS	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	vGPU Guest
Red Hat Enterprise Linux (RHEL) with KVM [7] [10]	RHEL 8.10	Red Hat Enterprise Linux	8.10	vGPU Guest
Red Hat Enterprise Linux (RHEL) with KVM [7] [10]	RHEL 8.10	Microsoft Windows	Server 2022	vGPU Guest
Red Hat Enterprise Linux (RHEL) with KVM [7] [10]	RHEL 9.4	Red Hat Enterprise Linux	8.10 9.4 9.6	vGPU Guest
Red Hat Enterprise Linux (RHEL) with KVM [7] [10]	RHEL 9.4	Microsoft Windows	Server 2022	vGPU Guest
Red Hat Enterprise Linux (RHEL) with KVM [7] [10]	RHEL 9.6	Red Hat Enterprise Linux	8.10 9.4 9.6	vGPU Guest
Red Hat Enterprise Linux (RHEL) with KVM [7] [10]	RHEL 9.6	Microsoft Windows	Server 2022	vGPU Guest
Red Hat Enterprise Linux (RHEL) with KVM [7] [10]	Red Hat OpenStack Platform Red Hat OpenStack Services on OpenShift	Product Documentation for Red Hat OpenStack	Product Documentation for Red Hat OpenStack	vGPU Guest
Nutanix AOS/AHV [7] [10]	AOS/AHV 6.5 AOS/AHV 6.6 AOS/AHV 6.7 AOS/AHV 6.8 AOS/AHV 6.9 AOS/AHV 6.10	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	vGPU Guest
Nutanix AOS/AHV [7] [10]	AOS/AHV 6.5 AOS/AHV 6.6 AOS/AHV 6.7 AOS/AHV 6.8 AOS/AHV 6.9 AOS/AHV 6.10	Debian	12	vGPU Guest
Nutanix AOS/AHV [7] [10]	AOS/AHV 6.5 AOS/AHV 6.6 AOS/AHV 6.7 AOS/AHV 6.8 AOS/AHV 6.9 AOS/AHV 6.10	Red Hat Enterprise Linux	8.8 8.10 9.2 9.4 9.5	vGPU Guest
Nutanix AOS/AHV [7] [10]	AOS/AHV 6.5 AOS/AHV 6.6 AOS/AHV 6.7 AOS/AHV 6.8 AOS/AHV 6.9 AOS/AHV 6.10	SUSE Linux Enterprise Server	12 15	vGPU Guest

Note

If the NVIDIA AI Enterprise release you need is unavailable from the My Nutanix portal, contact Nutanix. Then, follow the instructions on the My Nutanix portal to obtain the correct NVIDIA AI Enterprise graphics drivers from the NVIDIA Licensing Portal.

Base Command Manager Essentials

NVIDIA Base Command Manager provides cluster provisioning, workload management, and infrastructure monitoring for data centers.

Table 11 Base Command Manager

Orchestration Platform			Operating System		NVIDIA AI Enterprise Infrastructure Support
Name	Versions	Engine	Name	Versions	GPU Operator	Network Operator	GPU Driver Support [2]
Upstream Kubernetes	1.29 1.30 1.31 1.32	Containerd	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	Supported	Supported	Data center
Upstream Kubernetes	1.29 1.30 1.31 1.32	Containerd	Red Hat Enterprise Linux	8 9	Supported	Supported	Data center
Slurm (non-Kubernetes)	23.02 23.11 24.05	N/A	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	N/A	N/A	Data center
Slurm (non-Kubernetes)	23.02 23.11 24.05	N/A	Red Hat Enterprise Linux	8 9	N/A	N/A	Data center
PBS Pro	2024.1.1 2022.1.6	N/A	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	N/A	N/A	Data center
PBS Pro	2024.1.1 2022.1.6	N/A	Red Hat Enterprise Linux	8 9	N/A	N/A	Data center

Public Cloud

Managed Kubernetes

Verify compatibility for NVIDIA AI Enterprise on cloud-managed Kubernetes services.

Table 12 Managed Kubernetes

Cloud Service Provider	Orchestration Platform			Operating System		NVIDIA AI Enterprise Infrastructure Support
	Name	K8s Versions	Engine	Name	Versions	GPU Operator	Network Operator	GPU Driver Support
AWS	Amazon Elastic Kubernetes Service (EKS)	1.29 1.30 1.31 1.32	Containerd	Ubuntu	20.04 LTS 22.04 LTS 24.04 LTS	Supported	Not Supported	vGPU Guest/Data center
Google	Google Kubernetes Engine (GKE)	1.29 1.30 1.31 1.32	Containerd	Ubuntu	22.04 LTS 24.04 LTS	Supported	Not Supported	vGPU Guest/Data center
Microsoft	Azure Kubernetes Service (AKS)	1.29 1.30 1.31 1.32	Containerd	Ubuntu	22.04 LTS 24.04 LTS	Supported	Not Supported	vGPU Guest/Data center
N/A	Red Hat OpenShift (Managed Service)	4.14 4.15 4.16 4.17 4.18	CRI-O	Red Hat CoreOS	4.14 4.15 4.16 4.17 4.18	Supported	Not Supported	vGPU Guest/Data center

Standard GPU Instances

Standard GPU virtual machine instances across major cloud providers support NVIDIA AI Enterprise for both Kubernetes and standalone containers.

Table 13 Standard Instances for Kubernetes and Standalone Containers

Cloud Service Provider	Virtual Machine (VM) Instance with GPU	Product Family
Alibaba	gn7e	NVIDIA A10
Alibaba	gn7i	NVIDIA A10
Alibaba	gn7s	NVIDIA A30
Alibaba	gn6i	NVIDIA T4
Alibaba	gn6e	NVIDIA V100
Alibaba	gn6v	NVIDIA V100
Alibaba	ecs.ebmgn8v	NVIDIA H20
Alibaba	ecs.gn8v	NVIDIA H20
Alibaba	ecs.ebmgn8is	NVIDIA L20
Alibaba	ecs.gn8is	NVIDIA L20
Amazon Web Services (AWS)	EC2 P3	NVIDIA V100
Amazon Web Services (AWS)	EC2 P4	NVIDIA A100
Amazon Web Services (AWS)	EC2 P5	NVIDIA H100
Amazon Web Services (AWS)	EC2 G4	NVIDIA T4
Amazon Web Services (AWS)	EC2 G5	NVIDIA A10G
Amazon Web Services (AWS)	EC2 G6	NVIDIA L4
Amazon Web Services (AWS)	EC2 G6e	NVIDIA L40S
Azure	NCads_H100_v5-series	NVIDIA H100
Azure	NCCads_H100_v5-series	NVIDIA H100
Azure	NCv3-series	NVIDIA V100
Azure	NCasT4_v3-series	NVIDIA T4
Azure	NC_A100_v4-series	NVIDIA A100
Google Cloud Platform (GCP)	A3 VM	NVIDIA H100
Google Cloud Platform (GCP)	A2 VM	NVIDIA A100
Google Cloud Platform (GCP)	G2 VM	NVIDIA L4
Google Cloud Platform (GCP)	N1 VM	NVIDIA T4 NVIDIA V100
Oracle Cloud Infrastructure (OCI)	BM.GPU3	NVIDIA V100
Oracle Cloud Infrastructure (OCI)	BM.GPU4 BM.GPU.A100	NVIDIA A100
Oracle Cloud Infrastructure (OCI)	BM.GPU.A10	NVIDIA A10
Oracle Cloud Infrastructure (OCI)	BM.GPU.H100.8	NVIDIA H100
Oracle Cloud Infrastructure (OCI)	VM.GPU3	NVIDIA V100
Oracle Cloud Infrastructure (OCI)	VM.GPU.A10	NVIDIA A10
Tencent Cloud	PNV4	NVIDIA A10
Oracle Cloud Infrastructure (OCI)	GT4	NVIDIA A100
Oracle Cloud Infrastructure (OCI)	GN10Xp GN10X	NVIDIA V100
Oracle Cloud Infrastructure (OCI)	GN7 GN7vi GI3X	NVIDIA T4
Volcano Engine	ecs.gni2	NVIDIA A10

NVIDIA GPU Optimized VMI on CSP Marketplace

NVIDIA provides pre-configured, validated Virtual Machine Instances (VMI) for rapid AI deployment on cloud marketplaces.

Table 14 NVIDIA GPU Optimized VMI on CSP Marketplace

Cloud Service Provider	VMI Name	GPUs	K8s Support	Standalone Container
AWS	NVIDIA AI Enterprise	Listed in Standard GPU Instances	Not Supported	Supported
Azure	NVIDIA AI Enterprise	Listed in Standard GPU Instances	Not Supported	Supported
GCP	NVIDIA AI Enterprise	Listed in Standard GPU Instances	Not Supported	Supported

CPU-Only Server Support

NVIDIA AI Enterprise will support the following CPU-enabled frameworks:

• TensorFlow

• PyTorch

• Triton Inference Server with FIL backend

• NVIDIA RAPIDS with XGBoost and Dask

The CPU-enabled frameworks are supported on CPU-only servers that are part of the NVIDIA Certified Systems list.

Footnotes

[1]

NVIDIA H200 is not supported by the NVIDIA vGPU (C-Series) 17 branch.

[2] (1,2)

With optional RTX 6000 Ada Lovelace GPU.

[3]

The NVIDIA vGPU Guest Driver is optional in bare metal deployments. Its use allows licensing enforcement.

[4]

Red Hat OpenShift Virtualization is supported with Red Hat OpenShift 4.15 and 4.16 and only with GPU Passthrough and NVIDIA vGPU C-Series (exclusive of MIG-backed NVIDIA vGPUs).

[5] (1,2,3,4,5,6,7,8,9,10,11,12,13,14)

Network Operator is supported with RHEL 8.6, 8.8, and 8.10.

[6] (1,2)

NVIDIA vGPU provides management (GPU Partitioning, live migration, etc.) and monitoring capabilities that aren’t available with GPU Passthrough and the Datacenter GPU Driver.

[7] (1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26)

NVIDIA vGPU (C-Series) software is supported on Linux with KVM platforms only by specific hypervisor software vendors. For information about which NVIDIA vGPU software releases and hypervisor software releases are supported, consult the documentation from your hypervisor vendor. For information about Linux distributions supported as a guest OS, consult the documentation from your hypervisor vendor. NVIDIA vGPU (C-Series) software and your virtualization software vendor must support a guest OS release.

[8] (1,2)

NVIDIA AI Enterprise supports every patch release for the listed Red Hat OpenShift release, provided that Red Hat also supports it. When Red Hat no longer supports a release or patch release, it is no longer supported by NVIDIA AI Enterprise.

[9]

Obtain the NVIDIA Virtual GPU Manager software directly from Nutanix through the My Nutanix portal (a My Nutanix account is required). Contact if the NVIDIA AI Enterprise release is unavailable from the My Nutanix portal, contact Nutanix.

[10] (1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25)

NVIDIA AI Enterprise only supports running workloads on a single-node setup for KVM hypervisors.

[11]

NVIDIA GH200 is not supported by the vGPU (C-Series) 16 branch.

[12] (1,2,3)

Network Operator support is only applicable with OpenShift versions 4.14 - 4.17.