NVIDIA AI Enterprise and NVIDIA vGPU for Compute

NVIDIA vGPU for Compute enables multiple virtual machines to share a single physical GPU while providing compute capabilities for AI model training, fine-tuning, and inference workloads.

About NVIDIA vGPU for Compute

NVIDIA AI Enterprise is a cloud-native suite of software tools, libraries, and frameworks for production AI deployments. It delivers optimized performance, security, and stability with enterprise-grade support. NVIDIA AI Enterprise consists of two primary layers: the application layer and the infrastructure layer.

NVIDIA vGPU for Compute is licensed exclusively through NVIDIA AI Enterprise. NVIDIA vGPU for Compute distributes GPU resources efficiently across multiple VMs, optimizes utilization, and lowers overall hardware costs. It offers advanced monitoring and management capabilities including Suspend/Resume, Live Migration, and Warm Updates. These capabilities serve Cloud Service Providers (CSPs) and organizations that require scalable, cost-effective GPU acceleration.

Documentation Structure

This documentation is organized into the following sections:

• NVIDIA vGPU for Compute Overview
• NVIDIA vGPU for Compute Features
• NVIDIA vGPU for Compute Installation
• NVIDIA vGPU for Compute Licensing
• NVIDIA vGPU for Compute Configuration
• NVIDIA vGPU Types Reference

Quick Start

New to NVIDIA vGPU for Compute? Follow this recommended path:

1. Understand the Basics: Overview for concepts, architecture, and vGPU configuration modes; Features for capability detail.

2. Install Components: Installation for NGC CLI, Virtual GPU Manager, and guest drivers.

3. Configure Licensing: Licensing to connect VMs to NVIDIA License System.

4. Configure vGPU: Configuration for MIG-backed vGPU and profile selection.

5. Reference vGPU Types: Reference for vGPU type tables by GPU.

Common Tasks

Installation and Setup

• Prerequisites: Hardware and BIOS checks.

• Installing NGC CLI: Download vGPU software from NVIDIA NGC.

• Installing Virtual GPU Manager: Deploy on the hypervisor.

• Installing vGPU Guest Driver: Deploy in VMs.

Licensing

• Licensing vGPU VMs: NVIDIA License System integration.

• Verifying License Configuration: Confirm licensing.

Configuration

• Configuring MIG-Backed vGPU: MIG mode and GPU instances.

• Virtual GPU Types: Choose vGPU profiles for your workload.

Additional Resources

• NVIDIA AI Enterprise Product Support Matrix: Supported platforms and versions

• NVIDIA vGPU Software Documentation: Complete vGPU software documentation

• NVIDIA Fabric Manager User Guide: Multi-GPU configuration on HGX platforms

• NVIDIA NGC Catalog: Download vGPU software and drivers