NVIDIA AI Enterprise Documentation#
This documentation covers the NVIDIA AI Enterprise Infrastructure Layer software — GPU and network drivers, Kubernetes operators, and NVIDIA vGPU for Compute.
For application-layer software, refer to Application Software. For enterprise support services, refer to Support.
Getting Started
- Release Notes
- Quick Start Guide
- Activating the Accounts for Getting NVIDIA AI Enterprise
- Installing Your NVIDIA AI Enterprise License Server and License Files
- Installing and Licensing NVIDIA AI Enterprise Software Components
- The NVIDIA NGC Catalog
- Installing the NVIDIA AI Enterprise Graphics Driver on Ubuntu from a Debian Package
- Configuring a Licensed Client
- Configuring a Licensed Client on Linux with Default Settings
- Verifying the NVIDIA AI Enterprise License Status of a Licensed Client
- Installing the NVIDIA Container Toolkit
- Verifying the Installation of NVIDIA Container Toolkit
- Installing Software Distributed as Container Images
- Running ResNet-50 with TensorRT
- Running an NVIDIA Production Branch PyTorch Container
- Obtaining NVIDIA Base Command Manager
- Support Matrix
- Deployment Guide
Appendix
- NVIDIA vGPU (C-Series) Documentation
- Release Notes
- Supported Hardware
- Requirements for Using NVIDIA vGPU (C-Series)
- Requirements for Using NVIDIA vGPU (C-Series) on GPUs Requiring 64 GB or More of MMIO Space with Large-Memory VMs
- NVIDIA CUDA Toolkit Version Support
- NVIDIA vGPU (C-Series) Migration Support
- GPUDirect Technology Support
- NVIDIA NVSwitch On-Chip Memory Fabric Support
- Hardware Platforms that Support NVIDIA NVSwitch On-Chip Memory Fabric
- vGPUs that Support NVIDIA NVSwitch On-Chip Memory Fabric
- Hypervisor Releases that Support NVIDIA NVSwitch On-Chip Memory Fabric
- Guest OS Releases that Support NVIDIA NVSwitch On-Chip Memory Fabric
- Limitations on Support for NVIDIA NVSwitch On-Chip Memory Fabric
- vGPUs that Support Unified Memory
nvidia-smicannot report GPU utilization for MIG instances- Total frame buffer for vGPUs is less than the total frame buffer on the physical GPU
- Single vGPU benchmark scores are lower than passthrough GPU
- User Guide
- MIG-Backed NVIDIA vGPU Internal Architecture
- Valid MIG-Backed Virtual GPU Configurations on a Single GPU
- Installing and Configuring the NVIDIA Virtual GPU Manager for Red Hat Enterprise Linux KVM
- Installing and Configuring the NVIDIA Virtual GPU Manager for Ubuntu
- Installing and Configuring the NVIDIA Virtual GPU Manager for VMware vSphere
- Configuring a GPU for MIG-Backed vGPUs
- Disabling MIG Mode for One or More GPUs
- Installing NVIDIA AI Enterprise Software Components by Using Kubernetes
- Installing NVIDIA AI Enterprise Software, Applications, and Deep Learning Framework Components by Using Docker
- Installing NVIDIA GPU Operator by Using a Bash Shell Script
- Modifying a MIG-Backed vGPU’s Configuration
- Monitoring MIG-backed vGPU Activity
- Virtual GPU Types for Supported GPUs
- NVIDIA A800 PCIe 80GB, NVIDIA A800 PCIe 80GB Liquid Cooled, and NVIDIA AX800 Virtual GPU Types
- NVIDIA A800 PCIe 40GB Virtual GPU Types
- NVIDIA A800 HGX Virtual GPU Types
- NVIDIA A100 PCIe 40GB Virtual GPU Types
- NVIDIA A100 HGX 40GB Virtual GPU Types
- NVIDIA A100 PCIe 80GB, NVIDIA A100 PCIe 80GB Liquid-Cooled and NVIDIA A100X Virtual GPU Types
- NVIDIA A100 HGX 80GB Virtual GPU Types
- NVIDIA A40 Virtual GPU Types
- NVIDIA A30, NVIDIA A30X, and NVIDIA A30 Liquid-Cooled Virtual GPU Types
- NVIDIA A16 Virtual GPU Types
- NVIDIA A10 Virtual GPU Types
- NVIDIA H100 PCIe 94GB (H100 NVL) Virtual GPU Types
- NVIDIA H100 SXM5 94GB Virtual GPU Types
- NVIDIA H100 PCIe 80GB Virtual GPU Types
- NVIDIA H100 SXM5 80GB Virtual GPU Types
- NVIDIA H100 SXM5 64GB Virtual GPU Types
- NVIDIA H800 PCIe 94GB (H800 NVL) Virtual GPU Types
- NVIDIA H800 PCIe 80GB Virtual GPU Types
- NVIDIA H800 SXM5 80GB Virtual GPU Types
- NVIDIA H20 SXM5 96GB Virtual GPU Types
- NVIDIA L40 Virtual GPU Types
- NVIDIA L40S Virtual GPU Types
- NVIDIA L20 and NVIDIA L20 Liquid-Cooled Virtual GPU Types
- NVIDIA L4 Virtual GPU Types
- NVIDIA L2 Virtual GPU Types
- NVIDIA RTX 6000 Ada Virtual GPU Types
- NVIDIA RTX 5880 Ada Virtual GPU Types
- NVIDIA RTX 5000 Ada Virtual GPU Types
- NVIDIA RTX A6000 Virtual GPU Types
- NVIDIA RTX A5500 Virtual GPU Types
- NVIDIA RTX A5000 Virtual GPU Types
- Tesla T4 Virtual GPU Types
- Tesla V100 SXM2 Virtual GPU Types
- Tesla V100 SXM2 32GB Virtual GPU Types
- Tesla V100 PCIe Virtual GPU Types
- Tesla V100 PCIe 32GB Virtual GPU Types
- Tesla V100S PCIe 32GB Virtual GPU Types
- Tesla V100 FHHL Virtual GPU Types
- Quadro RTX 8000 Passive Virtual GPU Types
- Quadro RTX 6000 Passive Virtual GPU Types
- Release Notes