Infrastructure Support Matrix#
Supported NVIDIA Infrastructure Software#
Product |
Version |
x86 |
ARM |
---|---|---|---|
NVIDIA GPU Data Center Driver |
Supported |
Supported |
|
NVIDIA DOCA Driver for Networking |
Supported |
Supported |
|
NVIDIA vGPU (C-Series Drivers Host and Guest) |
Supported |
Not Supported |
|
NVIDIA Container Toolkit |
Supported |
Supported |
|
NVIDIA GPU Operator |
Supported |
Supported |
|
NVIDIA Network Operator |
Supported |
Supported |
|
NVIDIA Base Command Manager Essentials (BCME) |
Supported |
Supported |
|
NVIDIA NIM Operator |
Supported |
Not Supported |
Supported NVIDIA GPUs and Networking#
NVIDIA AI Enterprise is supported on the following NVIDIA GPUs with compatible third-party servers listed on the NVIDIA-certified systems page.
Specific NVIDIA AI Enterprise-supported products may not support all OS or GPU; refer to the individual product release notes for any discrepancies.
NVIDIA H800
NVIDIA H800 NVL
NVIDIA H100
NVIDIA H100 NVL [1]
NVIDIA H20
NVIDIA GH200
NVIDIA A800
NVIDIA AX800
NVIDIA A100X
NVIDIA A100
NVIDIA A40
NVIDIA A30X
NVIDIA A30
NVIDIA A16
NVIDIA A10
NVIDIA A10G
NVIDIA A10M
NVIDIA A2
NVIDIA RTX A6000
NVIDIA RTX A5000
NVIDIA RTX A4000
NVIDIA L40S
NVIDIA L40
NVIDIA L20
NVIDIA L4
NVIDIA L2
NVIDIA RTX 6000 Ada Generation
NVIDIA RTX 4000 SFF Ada Generation
NVIDIA T4
NVIDIA T4G
NVIDIA Quadro RTX 8000
NVIDIA Quadro RTX 6000
NVIDIA Quadro RTX 4000
NNVIDIA V100
Multi-node requires an Ethernet NIC that supports RoCE. NVIDIA recommends using an NVIDIA Mellanox ConnectX and an NVIDIA GPU for best performance.
Product Family |
Architecture |
---|---|
NVIDIA ConnectX-6 NIC |
NVIDIA ConnectX-6 |
NVIDIA ConnectX-6 Dx NIC |
NVIDIA ConnectX-6 Dx |
NVIDIA ConnectX-7 NIC |
NVIDIA ConnectX-7 |
NVIDIA BlueField-3 SuperNIC |
NVIDIA BlueField-3 |
Supported Platforms#
NVIDIA AI Enterprise is supported on NVIDIA DGX servers in bare-metal deployments with the NVIDIA data center driver for Linux, which is included in the DGX OS software.
Accelerated Platform |
Architecture |
---|---|
NVIDIA DGX H100 |
NVIDIA Hopper |
NVIDIA DGX A100 |
NVIDIA Ampere |
NVIDIA HGX H800 |
NVIDIA Hopper |
NVIDIA HGX H200 [11] |
NVIDIA Hopper |
NVIDIA HGX H100 |
NVIDIA Hopper |
NVIDIA HGX H20 |
NVIDIA Hopper |
NVIDIA HGX A800 |
NVIDIA Ampere |
NVIDIA HGX A100 |
NVIDIA Ampere |
NVIDIA IGX Orin [2] |
NVIDIA Ada Lovelace |
Note
DGX platforms, HGX platforms with KVM hypervisors, and IGX Orin are not supported with NVIDIA vGPU (C-Series).
For NVIDIA IGX, refer to the NVIDIA AI Enterprise - IGX Packaging, Pricing, and Licensing Guide.
Bare Metal#
Refer to the following platform support matrix for NVIDIA AI Enterprise if you have a dedicated physical server on-premises.
Orchestration Platform |
Operating System |
NVIDIA AI Enterprise Infrastructure Support |
|||||
---|---|---|---|---|---|---|---|
Name |
Versions |
Engine |
Name |
Versions |
GPU Operator |
Network Operator |
|
Charmed Kubernetes |
|
Containerd |
Ubuntu |
|
Supported |
Supported |
vGPU Guest/Data center |
HPE Ezmeral Runtime Enterprise |
5.6 |
Containerd |
Red Hat Enterprise Linux |
|
Supported |
Not Supported |
vGPU Guest/Data center |
Red Hat OpenShift [4] |
|
CRI-O |
Red Hat CoreOS |
|
Supported |
Supported |
vGPU Guest/Data center |
Nutanix NKP |
|
Containerd |
Ubuntu |
|
Supported |
Not Supported |
vGPU Guest/Data center |
Upstream Kubernetes |
|
Containerd |
Red Hat Enterprise Linux |
|
Supported |
Supported [5] |
vGPU Guest/Data center |
Upstream Kubernetes |
|
Containerd |
Ubuntu |
|
Supported |
Supported [5] |
vGPU Guest/Data center |
Upstream Kubernetes |
|
CRI-O |
Red Hat Enterprise Linux |
|
Supported |
Supported |
vGPU Guest/Data center |
Upstream Kubernetes |
|
CRI-O |
Ubuntu |
|
Supported |
Not Supported |
vGPU Guest/Data center |
Container |
Operating System |
NVIDIA AI Enterprise Infrastructure Support |
|||||
---|---|---|---|---|---|---|---|
Name |
Versions |
Engine |
Name |
Versions |
GPU Operator |
Network Operator |
|
Non-Kubernetes (standalone containers) |
Docker/Podman |
Red Hat Enterprise Linux |
|
N/A |
N/A |
vGPU Guest/Data center |
|
Non-Kubernetes (standalone containers) |
Docker/Podman |
SUSE Linux Enterprise Server |
15 SP2 and later |
N/A |
N/A |
vGPU Guest/Data center |
|
Non-Kubernetes (standalone containers) |
Docker/Podman |
Ubuntu |
|
N/A |
N/A |
vGPU Guest/Data center |
Virtualized#
If you have a physical server separated into multiple virtual servers on-premises, refer to the following platform support matrix for NVIDIA AI Enterprise.
Orchestration Platform |
Guest Operating System |
Hypervisor |
NVIDIA AI Enterprise Infrastructure Support |
|||||||
---|---|---|---|---|---|---|---|---|---|---|
Name |
Versions |
Engine |
Name |
Versions |
Name |
Versions |
GPU Operator |
Network Operator |
GPU Driver Support (inside the virtual machine) |
|
vGPU |
Passthrough [6] |
|||||||||
Charmed Kubernetes |
|
Containerd |
Ubuntu |
|
|
Supported |
Supported |
vGPU Guest |
vGPU Guest/Data center |
|
Charmed Kubernetes |
|
Containerd |
Ubuntu |
|
VMware vSphere |
|
Supported |
Supported |
vGPU Guest |
vGPU Guest/Data center |
Red Hat OpenShift [8] |
|
CRI-O |
Red Hat CoreOS |
|
|
Supported |
Supported |
vGPU Guest |
vGPU Guest/Data center |
|
Red Hat OpenShift [8] |
|
CRI-O |
Red Hat CoreOS |
|
VMware vSphere |
|
Supported |
Supported |
vGPU Guest |
vGPU Guest/Data center |
VMware vSphere with Tanzu |
TKR 1.23 - TKR 1.30 |
Containerd |
Ubuntu |
|
VMware vSphere |
|
Supported |
Not Supported |
vGPU Guest |
vGPU Guest/Data center |
Nutanix NKP |
|
Containerd |
Ubuntu |
|
|
Supported |
Not Supported |
vGPU Guest |
vGPU Guest/Data center |
|
Upstream Kubernetes |
|
Containerd |
Red Hat Enterprise Linux |
|
|
Supported |
Supported [5] |
vGPU Guest |
vGPU Guest/Data center |
|
Upstream Kubernetes |
|
Containerd |
Red Hat Enterprise Linux |
|
VMware vSphere |
|
Supported |
Supported [5] |
vGPU Guest |
vGPU Guest/Data center |
Upstream Kubernetes |
|
Containerd |
Red Hat Enterprise Linux |
|
|
Supported |
Supported [5] |
vGPU Guest |
vGPU Guest/Data center |
|
Upstream Kubernetes |
|
Containerd |
Ubuntu |
|
|
Supported |
Supported [5] |
vGPU Guest |
vGPU Guest/Data center |
|
Upstream Kubernetes |
|
Containerd |
Ubuntu |
|
VMware vSphere |
|
Supported |
Supported [5] |
vGPU Guest |
vGPU Guest/Data center |
Upstream Kubernetes |
|
Containerd |
Ubuntu |
|
|
Supported |
Supported [5] |
vGPU Guest |
vGPU Guest/Data center |
|
Upstream Kubernetes |
|
CRI-O |
Red Hat Enterprise Linux |
|
|
Supported |
Supported [5] |
vGPU Guest |
vGPU Guest/Data center |
|
Upstream Kubernetes |
|
CRI-O |
Red Hat Enterprise Linux |
|
VMware vSphere |
|
Supported |
Supported [5] |
vGPU Guest |
vGPU Guest/Data center |
Upstream Kubernetes |
|
CRI-O |
Red Hat Enterprise Linux |
|
|
Supported |
Supported [5] |
vGPU Guest |
vGPU Guest/Data center |
|
Upstream Kubernetes |
|
CRI-O |
Ubuntu |
|
|
Supported |
Not Supported [5] |
vGPU Guest |
vGPU Guest/Data center |
|
Upstream Kubernetes |
|
CRI-O |
Ubuntu |
|
VMware vSphere |
|
Supported |
Not Supported [5] |
vGPU Guest |
vGPU Guest/Data center |
Upstream Kubernetes |
|
CRI-O |
Ubuntu |
|
|
Supported |
Not Supported [5] |
vGPU Guest |
vGPU Guest/Data center |
Note
If the NVIDIA AI Enterprise release you need is unavailable from the My Nutanix portal, contact Nutanix. Then, follow the instructions on the My Nutanix portal to obtain the correct NVIDIA AI Enterprise graphics drivers from the NVIDIA Licensing Portal.
Container |
Guest Operating System |
Hypervisor |
NVIDIA AI Enterprise Infrastructure Support |
|||||||
---|---|---|---|---|---|---|---|---|---|---|
Name |
Versions |
Engine |
Name |
Versions |
Name |
Versions |
GPU Operator |
Network Operator |
GPU Driver Support (inside the virtual machine) |
|
vGPU |
Passthrough [6] |
|||||||||
Non-Kubernetes (standalone containers) |
Docker/Podman |
Red Hat Enterprise Linux |
|
Red Hat Enterprise Linux [7] |
|
N/A |
N/A |
vGPU Guest |
vGPU Guest/Data center |
|
Non-Kubernetes (standalone containers) |
Docker/Podman |
Red Hat Enterprise Linux |
|
VMware vSphere |
|
N/A |
N/A |
vGPU Guest |
vGPU Guest/Data center |
|
Non-Kubernetes (standalone containers) |
Docker/Podman |
SUSE Linux Enterprise Server |
15 SP2 and later |
VMWare vSphere |
|
N/A |
N/A |
vGPU Guest |
vGPU Guest/Data center |
|
Non-Kubernetes (standalone containers) |
Docker/Podman |
Ubuntu |
|
|
N/A |
N/A |
vGPU Guest |
vGPU Guest/Data center |
||
Non-Kubernetes (standalone containers) |
Docker/Podman |
Ubuntu |
|
VMware vSphere |
|
N/A |
N/A |
vGPU Guest |
vGPU Guest/Data center |
|
Non-Kubernetes (standalone containers) |
Docker/Podman |
Ubuntu |
|
|
N/A |
N/A |
vGPU Guest |
vGPU Guest/Data center |
Note
If the NVIDIA AI Enterprise release you need is unavailable from the My Nutanix portal, contact Nutanix. Then, follow the instructions on the My Nutanix portal to obtain the correct NVIDIA AI Enterprise graphics drivers from the NVIDIA Licensing Portal.
Hypervisor |
Guest Operating System |
NVIDIA AI Enterprise Infrastructure Support |
||
---|---|---|---|---|
Name |
Version |
Name |
Version |
vGPU |
VMware ESX |
ESXi 8.0 |
Debian |
12 |
vGPU Guest |
VMware ESX |
ESXi 8.0 |
Red Hat Enterprise Linux |
|
vGPU Guest |
VMware ESX |
ESXi 8.0 |
Ubuntu |
|
vGPU Guest |
VMware ESX |
ESXi 8.0 |
SUSE Linux Enterprise Server |
|
vGPU Guest |
VMware ESX |
ESXi 8.0 |
Microsoft Windows |
|
vGPU Guest |
VMware ESX |
ESXi 7.0 Update 2 |
Red Hat Enterprise Linux |
|
vGPU Guest |
VMware ESX |
ESXi 7.0 Update 2 |
Ubuntu |
|
vGPU Guest |
VMware ESX |
ESXi 7.0 Update 2 |
SUSE Linux Enterprise Server |
|
vGPU Guest |
VMware ESX |
ESXi 7.0 Update 2 |
Microsoft Windows |
|
vGPU Guest |
|
Ubuntu |
|
vGPU Guest |
|
RHEL 8.8 |
Red Hat Enterprise Linux |
|
vGPU Guest |
|
RHEL 8.8 |
Microsoft Windows |
Server 2022 |
vGPU Guest |
|
RHEL 8.10 |
Red Hat Enterprise Linux |
|
vGPU Guest |
|
RHEL 8.10 |
Microsoft Windows |
Server 2022 |
vGPU Guest |
|
RHEL 9.2 |
Red Hat Enterprise Linux |
|
vGPU Guest |
|
RHEL 9.2 |
Microsoft Windows |
Server 2022 |
vGPU Guest |
|
RHEL 9.4 |
Red Hat Enterprise Linux |
|
vGPU Guest |
|
RHEL 9.4 |
Microsoft Windows |
Server 2022 |
vGPU Guest |
|
|
vGPU Guest |
|||
|
Ubuntu |
|
vGPU Guest |
|
|
Debian |
12 |
vGPU Guest |
|
|
Red Hat Enterprise Linux |
|
vGPU Guest |
|
|
SUSE Linux Enterprise Server |
|
vGPU Guest |
Note
If the NVIDIA AI Enterprise release you need is unavailable from the My Nutanix portal, contact Nutanix. Then, follow the instructions on the My Nutanix portal to obtain the correct NVIDIA AI Enterprise graphics drivers from the NVIDIA Licensing Portal.
Base Command Manager Essentials#
Orchestration Platform |
Operating System |
NVIDIA AI Enterprise Infrastructure Support |
|||||
---|---|---|---|---|---|---|---|
Name |
Versions |
Engine |
Name |
Versions |
GPU Operator |
Network Operator |
|
Upstream Kubernetes |
|
Containerd |
Ubuntu |
|
Supported |
Supported |
Data center |
Upstream Kubernetes |
|
Containerd |
Red Hat Enterprise Linux |
|
Supported |
Supported |
Data center |
Slurm (non-Kubernetes) |
|
N/A |
Ubuntu |
|
N/A |
N/A |
Data center |
Slurm (non-Kubernetes) |
|
N/A |
Red Hat Enterprise Linux |
|
N/A |
N/A |
Data center |
PBS Pro |
|
N/A |
Ubuntu |
|
N/A |
N/A |
Data center |
PBS Pro |
|
N/A |
Red Hat Enterprise Linux |
|
N/A |
N/A |
Data center |
Public Cloud#
Managed Kubernetes#
If you have a virtual server that runs in a cloud computing environment and is accessible remotely, refer to the following platform support matrix for NVIDIA AI Enterprise.
Cloud Service Provider |
Orchestration Platform |
Operating System |
NVIDIA AI Enterprise Infrastructure Support |
|||||
---|---|---|---|---|---|---|---|---|
Name |
K8s Versions |
Engine |
Name |
Versions |
GPU Operator |
Network Operator |
||
AWS |
Amazon Elastic Kubernetes Service (EKS) |
|
Containerd |
Ubuntu |
|
Supported |
Not Supported |
vGPU Guest/Data center |
Google Kubernetes Engine (GKE) |
|
Containerd |
Ubuntu |
22.04 LTS |
Supported |
Not Supported |
vGPU Guest/Data center |
|
Microsoft |
Azure Kubernetes Service (AKS) |
|
Containerd |
Ubuntu |
22.04 LTS |
Supported |
Not Supported |
vGPU Guest/Data center |
N/A |
Red Hat OpenShift (Managed Service) |
|
CRI-O |
Red Hat CoreOS |
|
Supported |
Not Supported |
vGPU Guest/Data center |
Standard GPU Instances#
Cloud Service Provider |
Virtual Machine (VM) Instance with GPU |
Product Family |
---|---|---|
Alibaba |
gn7e |
NVIDIA A10 |
Alibaba |
gn7i |
NVIDIA A10 |
Alibaba |
gn7s |
NVIDIA A30 |
Alibaba |
gn6i |
NVIDIA T4 |
Alibaba |
gn6e |
NVIDIA V100 |
Alibaba |
gn6v |
NVIDIA V100 |
Alibaba |
ecs.ebmgn8v |
NVIDIA H20 |
Alibaba |
ecs.gn8v |
NVIDIA H20 |
Alibaba |
ecs.ebmgn8is |
NVIDIA L20 |
Alibaba |
ecs.gn8is |
NVIDIA L20 |
Amazon Web Services (AWS) |
EC2 P3 |
NVIDIA V100 |
Amazon Web Services (AWS) |
EC2 P4 |
NVIDIA A100 |
Amazon Web Services (AWS) |
EC2 P5 |
NVIDIA H100 |
Amazon Web Services (AWS) |
EC2 G4 |
NVIDIA T4 |
Amazon Web Services (AWS) |
EC2 G5 |
NVIDIA A10G |
Amazon Web Services (AWS) |
EC2 G6 |
NVIDIA L4 |
Amazon Web Services (AWS) |
EC2 G6e |
NVIDIA L40S |
Azure |
NCads_H100_v5-series |
NVIDIA H100 |
Azure |
NCCads_H100_v5-series |
NVIDIA H100 |
Azure |
NCv3-series |
NVIDIA V100 |
Azure |
NCasT4_v3-series |
NVIDIA T4 |
Azure |
NC_A100_v4-series |
NVIDIA A100 |
Google Cloud Platform (GCP) |
A3 VM |
NVIDIA H100 |
Google Cloud Platform (GCP) |
A2 VM |
NVIDIA A100 |
Google Cloud Platform (GCP) |
G2 VM |
NVIDIA L4 |
Google Cloud Platform (GCP) |
N1 VM |
|
Oracle Cloud Infrastructure (OCI) |
BM.GPU3 |
NVIDIA V100 |
Oracle Cloud Infrastructure (OCI) |
|
NVIDIA A100 |
Oracle Cloud Infrastructure (OCI) |
BM.GPU.A10 |
NVIDIA A10 |
Oracle Cloud Infrastructure (OCI) |
BM.GPU.H100.8 |
NVIDIA H100 |
Oracle Cloud Infrastructure (OCI) |
VM.GPU3 |
NVIDIA V100 |
Oracle Cloud Infrastructure (OCI) |
VM.GPU.A10 |
NVIDIA A10 |
Tencent Cloud |
PNV4 |
NVIDIA A10 |
Tencent Cloud |
GT4 |
NVIDIA A100 |
Tencent Cloud |
|
NVIDIA V100 |
Tencent Cloud |
|
NVIDIA T4 |
Volcano Engine |
ecs.gni2 |
NVIDIA A10 |
NVIDIA GPU Optimized VMI on CSP Marketplace#
For ease of use in the cloud, NVIDIA provides compute-optimized and validated base Virtual Machine Instances (VMI) to run standalone NVIDIA AI containers through CSP marketplaces. Each VMI includes key technologies and software from NVIDIA for rapid deployment, management, and scaling of AI workloads in the modern hybrid cloud.
Cloud Service Provider |
VMI Name |
GPUs |
K8s Support |
Standalone Container |
---|---|---|---|---|
AWS |
NVIDIA AI Enterprise |
Listed in Standard GPU Instances |
Not Supported |
Supported |
Azure |
NVIDIA AI Enterprise |
Listed in Standard GPU Instances |
Not Supported |
Supported |
GCP |
NVIDIA AI Enterprise |
Listed in Standard GPU Instances |
Not Supported |
Supported |
CPU-Only Server Support#
NVIDIA AI Enterprise will support the following CPU-enabled frameworks:
TensorFlow
PyTorch
Triton Inference Server with FIL backend
NVIDIA RAPIDS with XGBoost and Dask
The CPU-enabled frameworks are supported on CPU-only servers that are part of the NVIDIA Certified Systems list.
Footnotes