Features#
NVIDIA vGPU (Virtual GPU) for Compute virtualizes NVIDIA GPUs for AI, machine learning, and high-performance computing. The subsections below describe MIG (Multi-Instance GPU) partitioning, provisioning, data paths, migration, multi-GPU guests, interconnects, scheduling, power state, and unified memory.
Feature |
What it covers |
Page |
|---|---|---|
MIG-Backed vGPU |
Hardware-level GPU partitioning with spatial isolation |
|
Device Groups |
Topology-aware detection and provisioning of connected devices |
|
GPUDirect |
RDMA and storage paths that reduce CPU overhead |
|
Heterogeneous vGPU |
Mixed vGPU profiles on one physical GPU |
|
Live Migration |
VM migration with short stun time on supported hypervisors |
|
Multi-vGPU and P2P |
Multi-GPU guests, board support, and NVLink P2P (hub) |
|
NVIDIA NVSwitch |
High-bandwidth NVLink fabric between GPUs (includes multicast) |
|
NVLink Multicast |
One-to-many data distribution (requires UVM; see NVSwitch page) |
|
Scheduling Policies |
Best Effort, Equal Share, and Fixed Share time-slicing |
|
Suspend-Resume |
VM state preservation for resource management |
|
Unified Virtual Memory |
Single address space across CPU and GPU (includes board support) |
|
Inference mode decision |
Time-sliced vs MIG-backed vs time-sliced MIG-backed for inference |