NVIDIA AI Enterprise Infra 4.9 Support Matrix#

Use this support matrix to verify your infrastructure is compatible with NVIDIA AI Enterprise release 4.9. This page provides comprehensive compatibility information for GPUs, operating systems, hypervisors, orchestration platforms, and cloud providers.

How to Use This Matrix

  1. Identify your deployment type - On-premises (bare metal or virtualized) or public cloud

  2. Verify your GPU - Check the Supported GPUs section

  3. Confirm your platform - Match your OS, hypervisor, and orchestration platform

  4. Check software versions - Ensure your infrastructure software versions are supported

Quick Navigation

Requirements#

For NVIDIA AI Enterprise to be supported, ensure you meet the following requirements.

On-Premises Servers

  1. GPU supported by NVIDIA AI Enterprise (and optionally a supported networking card)

  2. NVIDIA-Certified Systems

  3. Supported infrastructure management software - bare-metal or virtualized (OS, orchestration platform, hypervisor)

Cloud Servers

  1. Supported orchestration platform

  2. Supported virtual machine instance - standard or optimized

Supported NVIDIA Infrastructure Software#

Table 2 Supported Infrastructure Software#

Product

Version

x86

ARM

Core Infrastructure Drivers

NVIDIA GPU Data Center Driver

535.288.01

Supported

Supported

NVIDIA Fabric Manager

535.288.01

Supported

Supported

NVIDIA DOCA-OFED Driver for Networking

3.2.0

Supported

Supported

Virtualization

NVIDIA vGPU for Compute (Virtual GPU Manager and Guest Drivers)

16.13

Supported

N/A

Container Platform

NVIDIA Container Toolkit

1.18.1

Supported

Supported

Kubernetes Operators

NVIDIA GPU Operator

25.10.1

Supported

Supported

NVIDIA Network Operator

25.10.0

Supported

Supported

Cluster Management & Orchestration

NVIDIA Base Command Manager (BCM)

11.25.05

Supported

Supported

Supported NVIDIA GPUs and Networking#

NVIDIA AI Enterprise is supported on the following NVIDIA GPUs with compatible third-party servers listed on the NVIDIA-Certified Systems page.

Specific NVIDIA AI Enterprise-supported products may not support all operating systems or GPUs. Refer to the individual product release notes for discrepancies.

Note

For HGX support information, refer to the Supported Platforms section.

  • NVIDIA H800

  • NVIDIA H800 NVL

  • NVIDIA H200 NVL

  • NVIDIA H100

  • NVIDIA H100 NVL

  • NVIDIA H20

  • NVIDIA L40S

  • NVIDIA L40

  • NVIDIA L20

  • NVIDIA L4

  • NVIDIA L2

  • NVIDIA RTX 6000 Ada Generation

  • NVIDIA RTX 5880 Ada Generation

  • NVIDIA RTX 5000 Ada Generation

  • NVIDIA RTX 4000 SFF Ada Generation

  • NVIDIA A800

  • NVIDIA AX800

  • NVIDIA A100X

  • NVIDIA A100

  • NVIDIA A40

  • NVIDIA A30X

  • NVIDIA A30

  • NVIDIA A16

  • NVIDIA A10

  • NVIDIA A10G

  • NVIDIA A10M

  • NVIDIA A2

  • NVIDIA RTX A6000

  • NVIDIA RTX A5000

  • NVIDIA RTX A4000

  • NVIDIA T4

  • NVIDIA T4G

  • NVIDIA Quadro RTX 8000

  • NVIDIA Quadro RTX 6000

  • NVIDIA Quadro RTX 4000

  • NVIDIA V100

Multi-node requires an Ethernet NIC that supports RoCE. NVIDIA recommends using an NVIDIA Mellanox ConnectX and an NVIDIA GPU.

Table 3 Supported Ethernet NICs and SuperNICs#

Product Family

Architecture

NVIDIA ConnectX-6 NIC

NVIDIA ConnectX-6

NVIDIA ConnectX-6 Dx NIC

NVIDIA ConnectX-6 Dx

NVIDIA ConnectX-7 NIC

NVIDIA ConnectX-7

NVIDIA ConnectX-8 NIC

NVIDIA ConnectX-8

NVIDIA BlueField-3 SuperNIC

NVIDIA BlueField-3

Supported Platforms#

NVIDIA AI Enterprise is supported on NVIDIA DGX servers in bare-metal deployments with the NVIDIA data center driver for Linux included in the DGX OS software.

Note

DGX platforms, HGX platforms with KVM hypervisors, and IGX Orin are not supported with NVIDIA vGPU for Compute. For NVIDIA IGX licensing information, refer to the NVIDIA AI Enterprise Licensing Documentation.

Table 4 Supported Platforms#

Accelerated Platform

Architecture

NVIDIA DGX H100

NVIDIA Hopper

NVIDIA HGX H100

NVIDIA Hopper

NVIDIA HGX H800

NVIDIA Hopper

NVIDIA HGX H200

NVIDIA Hopper

NVIDIA HGX H20

NVIDIA Hopper

NVIDIA IGX Orin [1]

NVIDIA Ada Lovelace

NVIDIA DGX A100

NVIDIA Ampere

NVIDIA HGX A100

NVIDIA Ampere

NVIDIA HGX A800

NVIDIA Ampere

Bare Metal Deployments#

Use the following tables to verify compatibility for NVIDIA AI Enterprise on dedicated physical servers.

What’s Covered

  • Kubernetes-orchestrated containers with supported distributions (Charmed, Red Hat OpenShift, SUSE RKE2, Upstream Kubernetes)

  • Standalone Docker/Podman containers on Red Hat Enterprise Linux, SUSE Linux Enterprise Server, and Ubuntu

  • GPU Operator, Network Operator, and DPU Operator support by platform

Table 5 Containers Orchestrated with Kubernetes on Bare Metal#

Orchestration Platform

Operating System

NVIDIA AI Enterprise Infrastructure Support

Name

Versions

Engine

Name

Versions

GPU Operator

Network Operator

GPU Driver Support [2]

Charmed Kubernetes

1.30 - 1.34

Containerd

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

Supported

Supported

vGPU Guest/Data Center

HPE Ezmeral Runtime Enterprise

5.6

Containerd

Red Hat Enterprise Linux

8.6, 8.8, 8.10, 9.4, 9.6

Supported

N/A

vGPU Guest/Data Center

Nutanix NKP

2.12, 2.13

Containerd

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

Supported

Supported

vGPU Guest/Data Center

Red Hat OpenShift [3] [6]

4.16 - 4.20

CRI-O

Red Hat CoreOS

4.16 - 4.20

Supported

Supported

vGPU Guest/Data Center

SUSE RKE2

1.30 - 1.34

Containerd

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

Supported

Supported

vGPU Guest/Data Center

SUSE RKE2

1.30 - 1.34

Containerd

Red Hat Enterprise Linux

8.6, 8.8, 8.10, 9.4, 9.6

Supported

Supported

vGPU Guest/Data Center

Upstream Kubernetes

1.30 - 1.34

Containerd

Red Hat Enterprise Linux

8.6, 8.8, 8.10, 9.4, 9.6

Supported

Supported

vGPU Guest/Data Center

Upstream Kubernetes

1.30 - 1.34

Containerd

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

Supported

Supported

vGPU Guest/Data Center

Upstream Kubernetes

1.30 - 1.34

CRI-O

Red Hat Enterprise Linux

8.6, 8.8, 8.10, 9.4, 9.6

Supported

Supported

vGPU Guest/Data Center

Upstream Kubernetes

1.30 - 1.34

CRI-O

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

Supported

N/A

vGPU Guest/Data Center

Table 6 Standalone Containers on Bare Metal#

Container

Operating System

NVIDIA AI Enterprise Infrastructure Support

Name

Engine

Name

Versions

GPU Operator

Network Operator

GPU Driver Support [2]

Non-Kubernetes (standalone containers)

Docker/Podman

Red Hat Enterprise Linux

7.9, 8.6, 8.8, 8.10, 9.2, 9.4, 9.6

N/A

N/A

vGPU Guest/Data Center

Non-Kubernetes (standalone containers)

Docker/Podman

SUSE Linux Enterprise Server

15 SP2 and later

N/A

N/A

vGPU Guest/Data Center

Non-Kubernetes (standalone containers)

Docker/Podman

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

N/A

N/A

vGPU Guest/Data Center

Virtualized Deployments#

Use the following tables to verify compatibility for NVIDIA AI Enterprise in virtualized environments with NVIDIA vGPU for Compute.

What’s Covered

  • Kubernetes-orchestrated containers on VMware vSphere, Red Hat KVM, Ubuntu KVM, and Nutanix AHV

  • Standalone Docker/Podman containers with supported hypervisor and guest OS combinations

  • Non-containerized applications on supported hypervisors with vGPU

  • Both vGPU and GPU passthrough modes (where applicable)

Table 7 Containers Orchestrated with Kubernetes on Virtualized Environments#

Orchestration Platform

Guest Operating System

Hypervisor

NVIDIA AI Enterprise Infrastructure Support

Name

Versions

Engine

Name

Versions

Name

Versions

GPU Operator

Network Operator

GPU Driver Support (inside the virtual machine)

vGPU

Passthrough [4]

Charmed Kubernetes

1.30 - 1.34

Containerd

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

Ubuntu [5] [8]

20.04 LTS, 22.04 LTS, 24.04 LTS

Supported

Supported

vGPU Guest

vGPU Guest/Data Center

Charmed Kubernetes

1.30 - 1.34

Containerd

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

VMware vSphere

8.0 and later

Supported

Supported

vGPU Guest

vGPU Guest/Data Center

Nutanix NKP

2.12, 2.13

Containerd

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

Nutanix AOS/AHV [5] [7] [8]

6.5 - 6.10

Supported

Supported

vGPU Guest

vGPU Guest/Data Center

Red Hat OpenShift [6]

4.16 - 4.20

CRI-O

Red Hat CoreOS

4.16 - 4.20

Red Hat Enterprise Linux [5] [8]

8.10, 9.4, 9.5, 9.6, 9.7

Supported

Supported

vGPU Guest

vGPU Guest/Data Center

Red Hat OpenShift [6]

4.16 - 4.20

CRI-O

Red Hat CoreOS

4.16 - 4.20

VMware vSphere

8.0 and later

Supported

Supported

vGPU Guest

vGPU Guest/Data Center

Upstream Kubernetes

1.30 - 1.34

Containerd, CRI-O

Red Hat Enterprise Linux

8.6, 8.8, 8.10, 9.4, 9.5, 9.6, 9.7

Red Hat Enterprise Linux [5] [8]

8.10, 9.4, 9.5, 9.6, 9.7

Supported

Supported

vGPU Guest

vGPU Guest/Data Center

Upstream Kubernetes

1.30 - 1.34

Containerd, CRI-O

Red Hat Enterprise Linux

8.6, 8.8, 8.10, 9.4, 9.5, 9.6, 9.7

VMware vSphere

8.0 and later

Supported

Supported

vGPU Guest

vGPU Guest/Data Center

Upstream Kubernetes

1.30 - 1.34

Containerd, CRI-O

Red Hat Enterprise Linux

8.6, 8.8, 8.10, 9.4,9.5, 9.6, 9.7

Nutanix AOS/AHV [5] [7] [8]

6.5 - 6.10

Supported

Supported

vGPU Guest

vGPU Guest/Data Center

Upstream Kubernetes

1.30 - 1.34

Containerd, CRI-O

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

Ubuntu [5] [8]

20.04 LTS, 22.04 LTS, 24.04 LTS

Supported

Supported

vGPU Guest

vGPU Guest/Data Center

Upstream Kubernetes

1.30 - 1.34

Containerd, CRI-O

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

VMware vSphere

8.0 and later

Supported

Supported

vGPU Guest

vGPU Guest/Data Center

Upstream Kubernetes

1.30 - 1.34

Containerd, CRI-O

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

Nutanix AOS/AHV [5] [7] [8]

6.5 - 6.10

Supported

Supported

vGPU Guest

vGPU Guest/Data Center

VMware vSphere Kubernetes Service

VMware K8 1.30 - 1.34

Containerd

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

VMware vSphere

8.0 and later

Supported

N/A

vGPU Guest

vGPU Guest/Data Center

Table 8 Standalone Containers on Virtualized Environments#

Container

Guest Operating System

Hypervisor

NVIDIA AI Enterprise Infrastructure Support

Name

Engine

Name

Versions

Name

Versions

GPU Operator

Network Operator

GPU Driver Support (inside the virtual machine)

vGPU

Passthrough [4]

Non-Kubernetes (standalone containers)

Docker/Podman

Red Hat Enterprise Linux

7.9, 8.6, 8.8, 8.10, 9.2, 9.4, 9.5, 9.6, 9.7

Red Hat Enterprise Linux [5]

8.10, 9.4, 9.5, 9.6, 9.7

N/A

N/A

vGPU Guest

vGPU Guest/Data Center

Non-Kubernetes (standalone containers)

Docker/Podman

Red Hat Enterprise Linux

7.9, 8.6, 8.8, 8.10, 9.2, 9.4, 9.5, 9.6, 9.7

VMware vSphere

8.0 and later

N/A

N/A

vGPU Guest

vGPU Guest/Data Center

Non-Kubernetes (standalone containers)

Docker/Podman

SUSE Linux Enterprise Server

15 SP2 and later

VMWare vSphere

8.0 and later

N/A

N/A

vGPU Guest

vGPU Guest/Data Center

Non-Kubernetes (standalone containers)

Docker/Podman

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

Ubuntu [5] [8]

20.04 LTS, 22.04 LTS, 24.04 LTS

N/A

N/A

vGPU Guest

vGPU Guest/Data Center

Non-Kubernetes (standalone containers)

Docker/Podman

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

VMware vSphere

8.0 and later

N/A

N/A

vGPU Guest

vGPU Guest/Data Center

Non-Kubernetes (standalone containers)

Docker/Podman

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

Nutanix AOS/AHV [5] [7] [8]

6.5 - 6.10

N/A

N/A

vGPU Guest

vGPU Guest/Data Center

Table 9 Non-containerized Applications on Hypervisors and Guest Operating Systems Supported with vGPU#

Hypervisor

Guest Operating System

NVIDIA AI Enterprise Infrastructure Support

Name

Versions

Name

Versions

vGPU

VMware ESX

ESXi 8.0 and later

Debian

12

vGPU Guest

VMware ESX

ESXi 8.0 and later

Red Hat Enterprise Linux

8.10, 9.4, 9.6

vGPU Guest

VMware ESX

ESXi 8.0 and later

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

vGPU Guest

VMware ESX

ESXi 8.0 and later

SUSE Linux Enterprise Server

12 SP3+, 12 SP5, 15 SP2

vGPU Guest

VMware ESX

ESXi 8.0 and later

Microsoft Windows

Server 2022, Windows 10, Windows 11

vGPU Guest

Ubuntu [5] [8]

20.04 LTS, 22.04 LTS, 24.04 LTS

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

vGPU Guest

Red Hat Enterprise Linux (RHEL) with KVM [5] [8]

8.10, 9.4, 9.5, 9.6, 9.7

Red Hat Enterprise Linux

8.10, 9.4, 9.5, 9.6, 9.7

vGPU Guest

Red Hat Enterprise Linux (RHEL) with KVM [5] [8]

8.10, 9.4, 9.5, 9.6, 9.7

Microsoft Windows

Server 2022

vGPU Guest

Red Hat Enterprise Linux (RHEL) with KVM [5] [8]

Red Hat OpenStack Platform, Red Hat OpenStack Services on OpenShift

Product Documentation for Red Hat OpenStack

Product Documentation for Red Hat OpenStack

vGPU Guest

Nutanix AOS/AHV [5] [7] [8]

AOS/AHV 6.5 - 6.10

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

vGPU Guest

Nutanix AOS/AHV [5] [7] [8]

AOS/AHV 6.5 - 6.10

Debian

12

vGPU Guest

Nutanix AOS/AHV [5] [7] [8]

AOS/AHV 6.5 - 6.10

Red Hat Enterprise Linux

8.8, 8.10, 9.2, 9.4, 9.6

vGPU Guest

Nutanix AOS/AHV [5] [7] [8]

AOS/AHV 6.5 - 6.10

SUSE Linux Enterprise Server

12, 15

vGPU Guest

Base Command Manager#

NVIDIA Base Command Manager provides cluster provisioning, workload management, and infrastructure monitoring for data centers.

Supported Configurations

  • Kubernetes orchestration (Upstream Kubernetes)

  • Slurm workload manager (non-Kubernetes)

  • Red Hat Enterprise Linux and Ubuntu operating systems

Table 10 Base Command Manager#

Orchestration Platform

Operating System

NVIDIA AI Enterprise Infrastructure Support

Name

Versions

Engine

Name

Versions

GPU Operator

Network Operator

GPU Driver Support

Upstream Kubernetes

1.31 - 1.34

Containerd

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

Supported

Supported

Data Center

Upstream Kubernetes

1.31 - 1.34

Containerd

Red Hat Enterprise Linux

8, 9

Supported

Supported

Data Center

Slurm (non-Kubernetes)

24.05, 24.11, 25.05

N/A

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

N/A

N/A

Data Center

Slurm (non-Kubernetes)

24.05, 24.11, 25.05

N/A

Red Hat Enterprise Linux

8, 9

N/A

N/A

Data Center

Public Cloud#

Managed Kubernetes#

Verify compatibility for NVIDIA AI Enterprise on cloud-managed Kubernetes services.

Supported Cloud Providers

  • Amazon Web Services (EKS)

  • Google Cloud Platform (GKE)

  • Microsoft Azure (AKS)

  • Red Hat OpenShift (Managed Service - multi-cloud)

Table 11 Managed Kubernetes#

Cloud Service Provider

Orchestration Platform

Operating System

NVIDIA AI Enterprise Infrastructure Support

Name

K8s Versions

Engine

Name

Versions

GPU Operator

Network Operator

GPU Driver Support

AWS

Amazon Elastic Kubernetes Service (EKS)

1.30 - 1.34

Containerd

Ubuntu

20.04 LTS, 22.04 LTS, 24.04 LTS

Supported

N/A

vGPU Guest/Data Center

Google

Google Kubernetes Engine (GKE)

1.30 - 1.34

Containerd

Ubuntu

22.04 LTS, 24.04 LTS

Supported

N/A

vGPU Guest/Data Center

Microsoft

Azure Kubernetes Service (AKS)

1.30 - 1.34

Containerd

Ubuntu

22.04 LTS, 24.04 LTS

Supported

N/A

vGPU Guest/Data Center

N/A

Red Hat OpenShift (Managed Service)

4.16 - 4.20

CRI-O

Red Hat CoreOS

4.16 - 4.20

Supported

N/A

vGPU Guest/Data Center

Standard GPU Instances#

Standard GPU virtual machine instances across major cloud providers support NVIDIA AI Enterprise for both Kubernetes and standalone containers.

Table 12 Standard Instances for Kubernetes and Standalone Containers#

Cloud Service Provider

Virtual Machine (VM) Instance with GPU

Product Family

Alibaba

gn7e, gn7i

NVIDIA A10

Alibaba

gn7s

NVIDIA A30

Alibaba

gn6i

NVIDIA T4

Alibaba

gn6e, gn6v

NVIDIA V100

Alibaba

ecs.ebmgn8v, ecs.gn8v

NVIDIA H20

Alibaba

ecs.ebmgn8is, ecs.gn8is

NVIDIA L20

Amazon Web Services (AWS)

EC2 P3

NVIDIA V100

Amazon Web Services (AWS)

EC2 P4

NVIDIA A100

Amazon Web Services (AWS)

EC2 P5

NVIDIA H100

Amazon Web Services (AWS)

EC2 G4

NVIDIA T4

Amazon Web Services (AWS)

EC2 G5

NVIDIA A10G

Amazon Web Services (AWS)

EC2 G6

NVIDIA L4

Amazon Web Services (AWS)

EC2 G6e

NVIDIA L40S

Microsoft Azure

NCads_H100_v5-series, NCCads_H100_v5-series

NVIDIA H100

Microsoft Azure

NCv3-series

NVIDIA V100

Microsoft Azure

NCasT4_v3-series

NVIDIA T4

Microsoft Azure

NC_A100_v4-series

NVIDIA A100

Google Cloud Platform (GCP)

A3 VM

NVIDIA H100, H200

Google Cloud Platform (GCP)

A2 VM

NVIDIA A100

Google Cloud Platform (GCP)

G2 VM

NVIDIA L4

Google Cloud Platform (GCP)

N1 VM

NVIDIA T4, V100

Oracle Cloud Infrastructure (OCI)

BM.GPU3, VM.GPU3

NVIDIA V100

Oracle Cloud Infrastructure (OCI)

BM.GPU4, BM.GPU.A100

NVIDIA A100

Oracle Cloud Infrastructure (OCI)

BM.GPU.A10, VM.GPU.A10

NVIDIA A10

Oracle Cloud Infrastructure (OCI)

BM.GPU.H100.8

NVIDIA H100

Tencent Cloud

PNV4

NVIDIA A10

Tencent Cloud

GT4

NVIDIA A100

Tencent Cloud

GN10Xp, GN10X

NVIDIA V100

Tencent Cloud

GN7, GN7vi, GI3X

NVIDIA T4

Volcano Engine

ecs.gni2

NVIDIA A10

NVIDIA GPU Optimized VMI on CSP Marketplace#

NVIDIA provides pre-configured, validated Virtual Machine Instances (VMI) for rapid AI deployment on cloud marketplaces.

What’s Included

  • Pre-installed NVIDIA GPU drivers and Container Toolkit

  • Optimized for standalone NVIDIA AI containers

  • Available on AWS, Azure, Google Cloud, and Oracle Cloud Infrastructure

  • Supports all standard GPU instance types listed in Standard GPU Instances

Table 13 NVIDIA GPU Optimized VMI on CSP Marketplace#

Cloud Service Provider

VMI Name

GPUs

K8s Support

Standalone Container

AWS

NVIDIA AI Enterprise

Refer to Standard GPU Instances

N/A

Supported

Microsoft Azure

NVIDIA AI Enterprise

Refer to Standard GPU Instances

N/A

Supported

GCP

NVIDIA AI Enterprise

Refer to Standard GPU Instances

N/A

Supported

CPU-Only Server Support#

NVIDIA AI Enterprise supports the following CPU-enabled frameworks:

  • TensorFlow

  • PyTorch

  • Triton Inference Server with FIL backend

  • NVIDIA RAPIDS with XGBoost and Dask

The CPU-enabled frameworks are supported on CPU-only servers that are part of the NVIDIA-Certified Systems list.

Footnotes