Infrastructure Support Matrix#

Supported NVIDIA Infrastructure Software#

Supported Infrastructure Software#

Product

Version

x86

ARM

NVIDIA GPU Data Center Driver

550.144.03

Supported

Supported

NVIDIA DOCA Driver for Networking

v24.10 (DOCA 2.9.1)

Supported

Supported

NVIDIA vGPU (C-Series Drivers Host and Guest)

17.5

Supported

Not Supported

NVIDIA Container Toolkit

v1.17.4

Supported

Supported

NVIDIA GPU Operator

v24.9.2

Supported

Supported

NVIDIA Network Operator

v24.10.1

Supported

Supported

NVIDIA Base Command Manager Essentials (BCME)

10.24.11

Supported

Supported

NVIDIA NIM Operator

v1.0.1

Supported

Not Supported

Supported NVIDIA GPUs and Networking#

NVIDIA AI Enterprise is supported on the following NVIDIA GPUs with compatible third-party servers listed on the NVIDIA-certified systems page.

Specific NVIDIA AI Enterprise-supported products may not support all OS or GPU; refer to the individual product release notes for any discrepancies.

  • NVIDIA H800

  • NVIDIA H800 NVL

  • NVIDIA H100

  • NVIDIA H100 NVL [1]

  • NVIDIA H20

  • NVIDIA GH200

  • NVIDIA A800

  • NVIDIA AX800

  • NVIDIA A100X

  • NVIDIA A100

  • NVIDIA A40

  • NVIDIA A30X

  • NVIDIA A30

  • NVIDIA A16

  • NVIDIA A10

  • NVIDIA A10G

  • NVIDIA A10M

  • NVIDIA A2

  • NVIDIA RTX A6000

  • NVIDIA RTX A5000

  • NVIDIA RTX A4000

  • NVIDIA L40S

  • NVIDIA L40

  • NVIDIA L20

  • NVIDIA L4

  • NVIDIA L2

  • NVIDIA RTX 6000 Ada Generation

  • NVIDIA RTX 4000 SFF Ada Generation

  • NVIDIA T4

  • NVIDIA T4G

  • NVIDIA Quadro RTX 8000

  • NVIDIA Quadro RTX 6000

  • NVIDIA Quadro RTX 4000

  • NNVIDIA V100

Multi-node requires an Ethernet NIC that supports RoCE. NVIDIA recommends using an NVIDIA Mellanox ConnectX and an NVIDIA GPU for best performance.

Supported Ethernet NICs and SuperNICs#

Product Family

Architecture

NVIDIA ConnectX-6 NIC

NVIDIA ConnectX-6

NVIDIA ConnectX-6 Dx NIC

NVIDIA ConnectX-6 Dx

NVIDIA ConnectX-7 NIC

NVIDIA ConnectX-7

NVIDIA BlueField-3 SuperNIC

NVIDIA BlueField-3

Supported Platforms#

NVIDIA AI Enterprise is supported on NVIDIA DGX servers in bare-metal deployments with the NVIDIA data center driver for Linux, which is included in the DGX OS software.

Supported Platforms#

Accelerated Platform

Architecture

NVIDIA DGX H100

NVIDIA Hopper

NVIDIA DGX A100

NVIDIA Ampere

NVIDIA HGX H800

NVIDIA Hopper

NVIDIA HGX H200 [11]

NVIDIA Hopper

NVIDIA HGX H100

NVIDIA Hopper

NVIDIA HGX H20

NVIDIA Hopper

NVIDIA HGX A800

NVIDIA Ampere

NVIDIA HGX A100

NVIDIA Ampere

NVIDIA IGX Orin [2]

NVIDIA Ada Lovelace

Note

DGX platforms, HGX platforms with KVM hypervisors, and IGX Orin are not supported with NVIDIA vGPU (C-Series).

For NVIDIA IGX, refer to the NVIDIA AI Enterprise - IGX Packaging, Pricing, and Licensing Guide.

Bare Metal#

Refer to the following platform support matrix for NVIDIA AI Enterprise if you have a dedicated physical server on-premises.

Containers Orchestrated with Kubernetes on Bare Metal#

Orchestration Platform

Operating System

NVIDIA AI Enterprise Infrastructure Support

Name

Versions

Engine

Name

Versions

GPU Operator

Network Operator

GPU Driver Support [3]

Charmed Kubernetes

  • 1.28

  • 1.29

  • 1.30

Containerd

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

Supported

Supported

vGPU Guest/Data center

HPE Ezmeral Runtime Enterprise

5.6

Containerd

Red Hat Enterprise Linux

  • 8.6

  • 8.8

  • 8.10

Supported

Not Supported

vGPU Guest/Data center

Red Hat OpenShift [4]

  • 4.13

  • 4.14

  • 4.15

  • 4.16

CRI-O

Red Hat CoreOS

  • 4.13

  • 4.14

  • 4.15

  • 4.16

Supported

Supported

vGPU Guest/Data center

Nutanix NKP

  • 2.12

  • 2.13

Containerd

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

Supported

Not Supported

vGPU Guest/Data center

Upstream Kubernetes

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

Containerd

Red Hat Enterprise Linux

  • 8.6

  • 8.8

  • 8.10

Supported

Supported [5]

vGPU Guest/Data center

Upstream Kubernetes

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

Containerd

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

Supported

Supported [5]

vGPU Guest/Data center

Upstream Kubernetes

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

CRI-O

Red Hat Enterprise Linux

  • 8.6

  • 8.8

  • 8.10

Supported

Supported

vGPU Guest/Data center

Upstream Kubernetes

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

CRI-O

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

Supported

Not Supported

vGPU Guest/Data center

Standalone Containers on Bare Metal#

Container

Operating System

NVIDIA AI Enterprise Infrastructure Support

Name

Versions

Engine

Name

Versions

GPU Operator

Network Operator

GPU Driver Support

Non-Kubernetes (standalone containers)

Docker/Podman

Red Hat Enterprise Linux

  • 7.9

  • 8.6

  • 8.8

  • 8.10

  • 9.2

  • 9.4

N/A

N/A

vGPU Guest/Data center

Non-Kubernetes (standalone containers)

Docker/Podman

SUSE Linux Enterprise Server

15 SP2 and later

N/A

N/A

vGPU Guest/Data center

Non-Kubernetes (standalone containers)

Docker/Podman

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

N/A

N/A

vGPU Guest/Data center

Virtualized#

If you have a physical server separated into multiple virtual servers on-premises, refer to the following platform support matrix for NVIDIA AI Enterprise.

Containers Orchestrated with Kubernetes on Virtualized Environments#

Orchestration Platform

Guest Operating System

Hypervisor

NVIDIA AI Enterprise Infrastructure Support

Name

Versions

Engine

Name

Versions

Name

Versions

GPU Operator

Network Operator

GPU Driver Support (inside the virtual machine)

vGPU

Passthrough [6]

Charmed Kubernetes

  • 1.28

  • 1.29

  • 1.30

Containerd

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

Ubuntu [7] [10]

  • 20.04 LTS

  • 22.04 LTS

Supported

Supported

vGPU Guest

vGPU Guest/Data center

Charmed Kubernetes

  • 1.28

  • 1.29

  • 1.30

Containerd

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

VMware vSphere

  • 7.0 update 2 and later

  • 8.0 and later

Supported

Supported

vGPU Guest

vGPU Guest/Data center

Red Hat OpenShift [8]

  • 4.13

  • 4.14

  • 4.15

  • 4.16

CRI-O

Red Hat CoreOS

  • 4.13

  • 4.14

  • 4.15

  • 4.16

Red Hat Enterprise Linux [7] [10]

  • 7.9

  • 8.6

  • 8.8

  • 8.10

  • 9.2

  • 9.4

Supported

Supported

vGPU Guest

vGPU Guest/Data center

Red Hat OpenShift [8]

  • 4.13

  • 4.14

  • 4.15

  • 4.16

CRI-O

Red Hat CoreOS

  • 4.13

  • 4.14

  • 4.15

  • 4.16

VMware vSphere

  • 7.0 update 2 and later

  • 8.0 and later

Supported

Supported

vGPU Guest

vGPU Guest/Data center

VMware vSphere with Tanzu

TKR 1.23 - TKR 1.30

Containerd

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

VMware vSphere

  • 7.0 update 2 and later

  • 8.0 and later

Supported

Not Supported

vGPU Guest

vGPU Guest/Data center

Nutanix NKP

  • 2.12

  • 2.13

Containerd

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

Nutanix AOS/AHV [7] [10]

  • 6.5

  • 6.6

  • 6.7

  • 6.8

  • 6.9

  • 6.10

Supported

Not Supported

vGPU Guest

vGPU Guest/Data center

Upstream Kubernetes

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

Containerd

Red Hat Enterprise Linux

  • 8.6

  • 8.8

  • 8.10

Red Hat Enterprise Linux [7] [10]

  • 7.9

  • 8.6

  • 8.8

  • 8.10

  • 9.2

  • 9.4

Supported

Supported [5]

vGPU Guest

vGPU Guest/Data center

Upstream Kubernetes

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

Containerd

Red Hat Enterprise Linux

  • 8.6

  • 8.8

  • 8.10

VMware vSphere

  • 7.0 update 2 and later

  • 8.0 and later

Supported

Supported [5]

vGPU Guest

vGPU Guest/Data center

Upstream Kubernetes

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

Containerd

Red Hat Enterprise Linux

  • 8.6

  • 8.8

  • 8.10

Nutanix AOS/AHV [7] [10]

  • 6.5

  • 6.6

  • 6.7

  • 6.8

  • 6.9

  • 6.10

Supported

Supported [5]

vGPU Guest

vGPU Guest/Data center

Upstream Kubernetes

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

Containerd

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

Ubuntu [7] [10]

  • 20.04 LTS

  • 22.04 LTS

Supported

Supported [5]

vGPU Guest

vGPU Guest/Data center

Upstream Kubernetes

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

Containerd

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

VMware vSphere

  • 7.0 update 2 and later

  • 8.0

Supported

Supported [5]

vGPU Guest

vGPU Guest/Data center

Upstream Kubernetes

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

Containerd

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

Nutanix AOS/AHV [7] [10]

  • 6.5

  • 6.6

  • 6.7

  • 6.8

  • 6.9

  • 6.10

Supported

Supported [5]

vGPU Guest

vGPU Guest/Data center

Upstream Kubernetes

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

CRI-O

Red Hat Enterprise Linux

  • 8.6

  • 8.8

  • 8.10

Red Hat Enterprise Linux [7] [10]

  • 7.9

  • 8.6

  • 8.8

  • 8.10

  • 9.2

  • 9.4

Supported

Supported [5]

vGPU Guest

vGPU Guest/Data center

Upstream Kubernetes

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

CRI-O

Red Hat Enterprise Linux

  • 8.6

  • 8.8

  • 8.10

VMware vSphere

  • 7.0 update 2 and later

  • 8.0 and later

Supported

Supported [5]

vGPU Guest

vGPU Guest/Data center

Upstream Kubernetes

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

CRI-O

Red Hat Enterprise Linux

  • 8.6

  • 8.8

  • 8.10

Nutanix AOS/AHV [7] [10]

  • 6.5

  • 6.6

  • 6.7

  • 6.8

  • 6.9

  • 6.10

Supported

Supported [5]

vGPU Guest

vGPU Guest/Data center

Upstream Kubernetes

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

CRI-O

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

Ubuntu [7] [10]

  • 20.04 LTS

  • 22.04 LTS

Supported

Not Supported [5]

vGPU Guest

vGPU Guest/Data center

Upstream Kubernetes

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

CRI-O

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

VMware vSphere

  • 7.0 update 2 and later

  • 8.0 and later

Supported

Not Supported [5]

vGPU Guest

vGPU Guest/Data center

Upstream Kubernetes

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

CRI-O

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

Nutanix AOS/AHV [7] [10]

  • 6.5

  • 6.6

  • 6.7

  • 6.8

  • 6.9

  • 6.10

Supported

Not Supported [5]

vGPU Guest

vGPU Guest/Data center

Note

If the NVIDIA AI Enterprise release you need is unavailable from the My Nutanix portal, contact Nutanix. Then, follow the instructions on the My Nutanix portal to obtain the correct NVIDIA AI Enterprise graphics drivers from the NVIDIA Licensing Portal.

Standalone Containers on Virtualized Environments#

Container

Guest Operating System

Hypervisor

NVIDIA AI Enterprise Infrastructure Support

Name

Versions

Engine

Name

Versions

Name

Versions

GPU Operator

Network Operator

GPU Driver Support (inside the virtual machine)

vGPU

Passthrough [6]

Non-Kubernetes (standalone containers)

Docker/Podman

Red Hat Enterprise Linux

  • 7.9

  • 8.6

  • 8.8

  • 8.10

  • 9.2

  • 9.4

Red Hat Enterprise Linux [7]

  • 7.9

  • 8.6

  • 8.8

  • 8.9

  • 9.2

  • 9.4

N/A

N/A

vGPU Guest

vGPU Guest/Data center

Non-Kubernetes (standalone containers)

Docker/Podman

Red Hat Enterprise Linux

  • 7.9

  • 8.6

  • 8.8

  • 8.10

  • 9.2

  • 9.4

VMware vSphere

  • 7.0 update 2 and later

  • 8.0 and later

N/A

N/A

vGPU Guest

vGPU Guest/Data center

Non-Kubernetes (standalone containers)

Docker/Podman

SUSE Linux Enterprise Server

15 SP2 and later

VMWare vSphere

  • 7.0 update 2 and later

  • 8.0 and later

N/A

N/A

vGPU Guest

vGPU Guest/Data center

Non-Kubernetes (standalone containers)

Docker/Podman

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

  • 24.04 LTS

Ubuntu [7] [10]

  • 20.04 LTS

  • 22.04 LTS

N/A

N/A

vGPU Guest

vGPU Guest/Data center

Non-Kubernetes (standalone containers)

Docker/Podman

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

  • 24.04 LTS

VMware vSphere

  • 7.0 update 2 and later

  • 8.0 and later

N/A

N/A

vGPU Guest

vGPU Guest/Data center

Non-Kubernetes (standalone containers)

Docker/Podman

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

  • 24.04 LTS

Nutanix AOS/AHV [7] [9] [10]

  • 6.5

  • 6.6

  • 6.7

  • 6.8

  • 6.9

  • 6.10

N/A

N/A

vGPU Guest

vGPU Guest/Data center

Note

If the NVIDIA AI Enterprise release you need is unavailable from the My Nutanix portal, contact Nutanix. Then, follow the instructions on the My Nutanix portal to obtain the correct NVIDIA AI Enterprise graphics drivers from the NVIDIA Licensing Portal.

Non-containerized Applications on Hypervisors and Guest Operating Systems Supported with vGPU#

Hypervisor

Guest Operating System

NVIDIA AI Enterprise Infrastructure Support

Name

Version

Name

Version

vGPU

VMware ESX

ESXi 8.0

Debian

12

vGPU Guest

VMware ESX

ESXi 8.0

Red Hat Enterprise Linux

  • 8.8

  • 8.10

  • 9.2

  • 9.4

vGPU Guest

VMware ESX

ESXi 8.0

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

  • 24.04 LTS

vGPU Guest

VMware ESX

ESXi 8.0

SUSE Linux Enterprise Server

  • 12 SP3+

  • 12 SP5

  • 15 SP2

vGPU Guest

VMware ESX

ESXi 8.0

Microsoft Windows

  • Server 2022

  • Windows 11, 10

vGPU Guest

VMware ESX

ESXi 7.0 Update 2

Red Hat Enterprise Linux

  • 8.8

  • 8.10

  • 9.2

  • 9.4

vGPU Guest

VMware ESX

ESXi 7.0 Update 2

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

  • 24.04 LTS

vGPU Guest

VMware ESX

ESXi 7.0 Update 2

SUSE Linux Enterprise Server

  • 12 SP3+

  • 12 SP5

  • 15 SP2

vGPU Guest

VMware ESX

ESXi 7.0 Update 2

Microsoft Windows

  • Server 2022

  • Windows 11, 10

vGPU Guest

Ubuntu [7] [10]

  • 20.04 LTS

  • 22.04 LTS

  • 24.04 LTS

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

  • 24.04 LTS

vGPU Guest

Red Hat Enterprise Linux (RHEL) with KVM [7] [10]

RHEL 8.8

Red Hat Enterprise Linux

  • 8.8

  • 8.10

vGPU Guest

Red Hat Enterprise Linux (RHEL) with KVM [7] [10]

RHEL 8.8

Microsoft Windows

Server 2022

vGPU Guest

Red Hat Enterprise Linux (RHEL) with KVM [7] [10]

RHEL 8.10

Red Hat Enterprise Linux

  • 8.8

  • 8.10

vGPU Guest

Red Hat Enterprise Linux (RHEL) with KVM [7] [10]

RHEL 8.10

Microsoft Windows

Server 2022

vGPU Guest

Red Hat Enterprise Linux (RHEL) with KVM [7] [10]

RHEL 9.2

Red Hat Enterprise Linux

  • 8.8

  • 8.10

  • 9.2

  • 9.4

vGPU Guest

Red Hat Enterprise Linux (RHEL) with KVM [7] [10]

RHEL 9.2

Microsoft Windows

Server 2022

vGPU Guest

Red Hat Enterprise Linux (RHEL) with KVM [7] [10]

RHEL 9.4

Red Hat Enterprise Linux

  • 8.8

  • 8.10

  • 9.2

  • 9.4

vGPU Guest

Red Hat Enterprise Linux (RHEL) with KVM [7] [10]

RHEL 9.4

Microsoft Windows

Server 2022

vGPU Guest

Red Hat Enterprise Linux (RHEL) with KVM [7] [10]

  • Red Hat OpenStack Platform

  • Red Hat OpenStack Services on OpenShift

Product Documentation for Red Hat OpenStack

Product Documentation for Red Hat OpenStack

vGPU Guest

Nutanix AOS/AHV [7] [10]

  • AOS/AHV 6.5

  • AOS/AHV 6.6

  • AOS/AHV 6.7

  • AOS/AHV 6.8

  • AOS/AHV 6.9

  • AOS/AHV 6.10

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

  • 24.04 LTS

vGPU Guest

Nutanix AOS/AHV [7] [10]

  • AOS/AHV 6.5

  • AOS/AHV 6.6

  • AOS/AHV 6.7

  • AOS/AHV 6.8

  • AOS/AHV 6.9

  • AOS/AHV 6.10

Debian

12

vGPU Guest

Nutanix AOS/AHV [7] [10]

  • AOS/AHV 6.5

  • AOS/AHV 6.6

  • AOS/AHV 6.7

  • AOS/AHV 6.8

  • AOS/AHV 6.9

  • AOS/AHV 6.10

Red Hat Enterprise Linux

  • 8.8

  • 8.10

  • 9.2

  • 9.4

vGPU Guest

Nutanix AOS/AHV [7] [10]

  • AOS/AHV 6.5

  • AOS/AHV 6.6

  • AOS/AHV 6.7

  • AOS/AHV 6.8

  • AOS/AHV 6.9

  • AOS/AHV 6.10

SUSE Linux Enterprise Server

  • 12

  • 15

vGPU Guest

Note

If the NVIDIA AI Enterprise release you need is unavailable from the My Nutanix portal, contact Nutanix. Then, follow the instructions on the My Nutanix portal to obtain the correct NVIDIA AI Enterprise graphics drivers from the NVIDIA Licensing Portal.

Base Command Manager Essentials#

Base Command Manager#

Orchestration Platform

Operating System

NVIDIA AI Enterprise Infrastructure Support

Name

Versions

Engine

Name

Versions

GPU Operator

Network Operator

GPU Driver Support [2]

Upstream Kubernetes

  • 1.27

  • 1.28

  • 1.29

  • 1.30

Containerd

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

Supported

Supported

Data center

Upstream Kubernetes

  • 1.27

  • 1.28

  • 1.29

  • 1.30

Containerd

Red Hat Enterprise Linux

  • 8

  • 9

Supported

Supported

Data center

Slurm (non-Kubernetes)

  • 23.02

  • 23.11

  • 24.05

N/A

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

N/A

N/A

Data center

Slurm (non-Kubernetes)

  • 23.02

  • 23.11

  • 24.05

N/A

Red Hat Enterprise Linux

  • 8

  • 9

N/A

N/A

Data center

PBS Pro

  • 2024.1.1

  • 2022.1.6

N/A

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

N/A

N/A

Data center

PBS Pro

  • 2024.1.1

  • 2022.1.6

N/A

Red Hat Enterprise Linux

  • 8

  • 9

N/A

N/A

Data center

Public Cloud#

Managed Kubernetes#

If you have a virtual server that runs in a cloud computing environment and is accessible remotely, refer to the following platform support matrix for NVIDIA AI Enterprise.

Managed Kubernetes#

Cloud Service Provider

Orchestration Platform

Operating System

NVIDIA AI Enterprise Infrastructure Support

Name

K8s Versions

Engine

Name

Versions

GPU Operator

Network Operator

GPU Driver Support

AWS

Amazon Elastic Kubernetes Service (EKS)

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

Containerd

Ubuntu

  • 20.04 LTS

  • 22.04 LTS

Supported

Not Supported

vGPU Guest/Data center

Google

Google Kubernetes Engine (GKE)

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

Containerd

Ubuntu

22.04 LTS

Supported

Not Supported

vGPU Guest/Data center

Microsoft

Azure Kubernetes Service (AKS)

  • 1.24

  • 1.25

  • 1.26

  • 1.27

  • 1.28

  • 1.29

  • 1.30

Containerd

Ubuntu

22.04 LTS

Supported

Not Supported

vGPU Guest/Data center

N/A

Red Hat OpenShift (Managed Service)

  • 4.13

  • 4.14

  • 4.15

  • 4.16

CRI-O

Red Hat CoreOS

  • 4.13

  • 4.14

  • 4.15

  • 4.16

Supported

Not Supported

vGPU Guest/Data center

Standard GPU Instances#

Standard Instances for Kubernetes and Standalone Containers#

Cloud Service Provider

Virtual Machine (VM) Instance with GPU

Product Family

Alibaba

gn7e

NVIDIA A10

Alibaba

gn7i

NVIDIA A10

Alibaba

gn7s

NVIDIA A30

Alibaba

gn6i

NVIDIA T4

Alibaba

gn6e

NVIDIA V100

Alibaba

gn6v

NVIDIA V100

Alibaba

ecs.ebmgn8v

NVIDIA H20

Alibaba

ecs.gn8v

NVIDIA H20

Alibaba

ecs.ebmgn8is

NVIDIA L20

Alibaba

ecs.gn8is

NVIDIA L20

Amazon Web Services (AWS)

EC2 P3

NVIDIA V100

Amazon Web Services (AWS)

EC2 P4

NVIDIA A100

Amazon Web Services (AWS)

EC2 P5

NVIDIA H100

Amazon Web Services (AWS)

EC2 G4

NVIDIA T4

Amazon Web Services (AWS)

EC2 G5

NVIDIA A10G

Amazon Web Services (AWS)

EC2 G6

NVIDIA L4

Amazon Web Services (AWS)

EC2 G6e

NVIDIA L40S

Azure

NCads_H100_v5-series

NVIDIA H100

Azure

NCCads_H100_v5-series

NVIDIA H100

Azure

NCv3-series

NVIDIA V100

Azure

NCasT4_v3-series

NVIDIA T4

Azure

NC_A100_v4-series

NVIDIA A100

Google Cloud Platform (GCP)

A3 VM

NVIDIA H100

Google Cloud Platform (GCP)

A2 VM

NVIDIA A100

Google Cloud Platform (GCP)

G2 VM

NVIDIA L4

Google Cloud Platform (GCP)

N1 VM

  • NVIDIA T4

  • NVIDIA V100

Oracle Cloud Infrastructure (OCI)

BM.GPU3

NVIDIA V100

Oracle Cloud Infrastructure (OCI)

  • BM.GPU4

  • BM.GPU.A100

NVIDIA A100

Oracle Cloud Infrastructure (OCI)

BM.GPU.A10

NVIDIA A10

Oracle Cloud Infrastructure (OCI)

BM.GPU.H100.8

NVIDIA H100

Oracle Cloud Infrastructure (OCI)

VM.GPU3

NVIDIA V100

Oracle Cloud Infrastructure (OCI)

VM.GPU.A10

NVIDIA A10

Tencent Cloud

PNV4

NVIDIA A10

Tencent Cloud

GT4

NVIDIA A100

Tencent Cloud

  • GN10Xp

  • GN10X

NVIDIA V100

Tencent Cloud

  • GN7

  • GN7vi

  • GI3X

NVIDIA T4

Volcano Engine

ecs.gni2

NVIDIA A10

NVIDIA GPU Optimized VMI on CSP Marketplace#

For ease of use in the cloud, NVIDIA provides compute-optimized and validated base Virtual Machine Instances (VMI) to run standalone NVIDIA AI containers through CSP marketplaces. Each VMI includes key technologies and software from NVIDIA for rapid deployment, management, and scaling of AI workloads in the modern hybrid cloud.

NVIDIA GPU Optimized VMI on CSP Marketplace#

Cloud Service Provider

VMI Name

GPUs

K8s Support

Standalone Container

AWS

NVIDIA AI Enterprise

Listed in Standard GPU Instances

Not Supported

Supported

Azure

NVIDIA AI Enterprise

Listed in Standard GPU Instances

Not Supported

Supported

GCP

NVIDIA AI Enterprise

Listed in Standard GPU Instances

Not Supported

Supported

CPU-Only Server Support#

NVIDIA AI Enterprise will support the following CPU-enabled frameworks:

  • TensorFlow

  • PyTorch

  • Triton Inference Server with FIL backend

  • NVIDIA RAPIDS with XGBoost and Dask

The CPU-enabled frameworks are supported on CPU-only servers that are part of the NVIDIA Certified Systems list.

Footnotes