What’s Included#

The NVIDIA compute software “stack” consists of various software products in the system software or infrastructure that are required to bootstrap a system with NVIDIA GPUs and be able to run accelerated AI or HPC workloads.

Infrastructure and Workload Management Components#

All software for managing and optimizing the infrastructure and workloads is packaged into the NVIDIA AI Enterprise Infrastructure Branch. For more information, refer to the NVIDIA AI Enterprise Release Branches.

Infrastructure and Workload Management Components#
Component	Description	NGC Link	Documentation
NVIDIA vGPU (C-Series) Host Driver	NVIDIA driver to be deployed in the hypervisor for virtualized environments.	NVIDIA vGPU (C-Series) Host Driver on NGC	NVIDIA vGPU Host Driver Documentation
NVIDIA vGPU (C-Series) Guest Driver	NVIDIA virtual GPU software driver to be deployed in the VM or on a bare metal Operating System to enable multiple virtual machines (VMs) to have simultaneous, direct access to a single physical GPU.	NVIDIA vGPU (C-Series) Guest Driver on NGC	NVIDIA vGPU Guest Driver Documentation
NVIDIA Data Center Driver	Enable GPU acceleration for AI and Deep Learning in data centers.	GPU Driver on NGC	NVIDIA Data Center Driver Documentation
GPU Operator	NVIDIA GPU Operator simplifies the deployment of NVIDIA AI Enterprise by automating the management of all NVIDIA software components needed to provision GPUs in Kubernetes.	GPU Operator on NGC	NVIDIA GPU Operator Documentation
Network Operator	NVIDIA Network Operator simplifies the provisioning and management of NVIDIA networking resources in a Kubernetes cluster.	Network Operator on NGC	NVIDIA Network Operator Documentation
NVIDIA NIM Operator	NVIDIA NIM Operator enables cluster administrators to operate the software components and services required to run LLM, embedding, and other models using NVIDIA NIM microservices in Kubernetes.	NIM Operator on NGC	NVIDIA NIM Operator Documentation
Base Command Manager Essentials	NVIDIA Base Command Manager essentials streamlines cluster provisioning, workload management, and infrastructure monitoring across data centers and edge locations. It provides all the tools you need to deploy and manage an AI data center. NVIDIA Base Command Manager Essentials comprises the features of NVIDIA Base Command Manager that are certified for use with NVIDIA AI Enterprise.	Base Command Manager Essentials on NGC	NVIDIA Base Command Manager Documentation
NVIDIA License System	The NVIDIA License System is used to serve a pool of floating licenses to NVIDIA-licensed products. The NVIDIA License System is configured with licenses obtained from the NVIDIA Licensing Portal.	N/A	NVIDIA License System Documentation