NVIDIA AI Enterprise and NVIDIA vGPU for Compute

NVIDIA vGPU for Compute lets multiple virtual machines share one physical GPU for AI training, fine-tuning, and inference. Use Quick Start below for the recommended reading order.

About NVIDIA vGPU for Compute

NVIDIA AI Enterprise is NVIDIA’s supported software stack for production AI (tools, libraries, and frameworks) in cloud and data center environments. It spans the application layer and the infrastructure layer.

NVIDIA vGPU for Compute is licensed only through NVIDIA AI Enterprise. It partitions GPU capacity across VMs so several workloads can run on fewer physical GPUs. For cloud service providers (CSPs) and IT teams, supported operations include Suspend/Resume, Live Migration, and Warm Updates in addition to GPU compute in guests.

Documentation Structure

The following sections move from concepts and features to install, license, configure, and reference:

NVIDIA vGPU for Compute Documentation

• NVIDIA vGPU for Compute Overview
  • Key Terms
  • NVIDIA vGPU Architecture Overview
  • NVIDIA vGPU for Compute Configurations
  • NVIDIA vGPU for Compute Key Features
  • Product Limitations and Known Issues
  • Related Topics
• NVIDIA vGPU for Compute Features
• NVIDIA vGPU for Compute Installation
  • Prerequisites
  • Installing NVIDIA Virtual GPU Manager
  • NVIDIA Fabric Manager on HGX Servers
  • Installing NVIDIA vGPU Guest Driver
  • Installing the NVIDIA GPU Operator Using a Bash Shell Script
  • Installing NVIDIA AI Enterprise Applications Software
  • Next Steps
• NVIDIA vGPU for Compute Licensing
  • Verifying the License Status of a Licensed NVIDIA vGPU for Compute Guest VM
• NVIDIA vGPU for Compute Configuration
  • Configuring MIG-Backed vGPU
• NVIDIA vGPU Types Reference
  • Frequently Asked Questions

Quick Start

New to NVIDIA vGPU for Compute? Follow this recommended path:

1. Understand the Basics - Overview for concepts, architecture, and vGPU configuration modes; Features for capability detail.

2. Install Components - Installation for NGC CLI, Virtual GPU Manager, and guest drivers.

3. Configure Licensing - Licensing to connect VMs to NVIDIA License System.

4. Configure vGPU - Configuration for MIG-backed vGPU and profile selection.

5. Reference vGPU Types - Reference for vGPU type tables by GPU.

Common Tasks

Installation and Setup

• Prerequisites - Hardware and BIOS checks.

• Installing NGC CLI - Download vGPU software from NVIDIA NGC.

• Installing Virtual GPU Manager - Deploy on the hypervisor.

• Installing vGPU Guest Driver - Deploy in VMs.

Licensing

• Licensing vGPU VMs - NVIDIA License System integration.

• Verifying License Configuration - Confirm licensing.

Configuration

• Configuring MIG-Backed vGPU - MIG mode and GPU instances.

• Virtual GPU Types - Choose vGPU profiles for your workload.

Additional Resources

• NVIDIA AI Enterprise Product Support Matrix - Supported platforms and versions

• NVIDIA vGPU Software Documentation - Complete vGPU software documentation

• NVIDIA Fabric Manager User Guide - Multi-GPU configuration on HGX platforms

• NVIDIA NGC Catalog - Download vGPU software and drivers