Multi-vGPU and P2P#
Multi-vGPU and Peer-to-Peer (P2P) CUDA transfers are related capabilities for multi-GPU VM workloads. Use this hub for the shared hypervisor matrix, then open the concept or support page you need.
Page |
Use when you need |
|---|---|
Concepts and compatibility rules for attaching several vGPUs to one VM |
|
Architecture-specific board and vGPU combinations for Multi-vGPU |
|
NVLink P2P between vGPUs in the same VM, profile tables, and the A100 / UVM caveat |
Hypervisor Platform Support for Multi-vGPU and P2P#
The hypervisor support below applies to both Multi-vGPU and P2P features.
Hypervisor Platform |
NVIDIA AI Enterprise Infra Release |
Supported vGPU Types |
Documentation |
|---|---|---|---|
Red Hat Enterprise Linux with KVM |
All active NVIDIA AI Enterprise Infra Releases |
All NVIDIA vGPU for Compute with PCIe GPUs; on supported GPUs, both time-sliced and MIG-backed vGPUs are supported. |
|
Ubuntu with KVM |
All active NVIDIA AI Enterprise Infra Releases |
All NVIDIA vGPU for Compute with PCIe GPUs; on supported GPUs, both time-sliced and MIG-backed vGPUs are supported. |
|
VMware vSphere |
All active NVIDIA AI Enterprise Infra Releases |
Time-sliced multi-vGPU on supported GPUs. MIG-backed multi-vGPU requires VMware Cloud Foundation (VCF) 9.1 or later (NVIDIA AI Enterprise Infra 8.2 / vGPU 20.2 and later). |
Note
P2P CUDA transfers are not supported on Windows. Only Linux OS distros as outlined in NVIDIA AI Enterprise Infrastructure Support Matrix are supported.
Note
MIG-backed multi-vGPU on VMware vSphere requires VMware VCF 9.1 or later. It is not supported on VCF 9.0P01 or on standalone ESXi without VCF 9.1. Linux KVM hypervisors continue to support MIG-backed multi-vGPU on supported GPUs.