NVIDIA AI Enterprise Software#

NVIDIA vGPU Architecture#

The high-level architecture of an NVIDIA virtual GPU enabled environment is illustrated in the figure below. Here, we have GPUs in the server, and the NVIDIA AI Enterprise Host Software (VIB) is installed on the host server. This software enables multiple VMs to share a single GPU, or if there are multiple GPUs in the server, they can be aggregated so that a single VM can access multiple GPUs. Physical NVIDIA GPUs can support multiple virtual GPUs (vGPUs) and be assigned directly to guest VMs under the control of NVIDIA’s AI Enterprise Host Software running in a hypervisor. Guest VMs use the NVIDIA vGPUs in the same manner as a physical GPU that has been passed through by the hypervisor. In the VM itself, vGPU drivers are installed which support the different license levels that are available.

_images/components-03.png

NVIDIA AI Enterprise Host Software (VIB)#

The NVIDIA AI Enterprise Host Software host driver is the software driver that is installed on the hypervisor host that is responsible for communicating with the NVIDIA vGPU guest driver which is installed on the guest VM.

NVIDIA vGPU Guest Driver#

The NVIDIA vGPU guest driver is the software driver that is installed on the OS of the guest VM and is responsible for communicating with the NVIDIA vGPU host driver which is installed on the hypervisor.

Important

NVIDIA AI Enterprise Host and Guest drivers are available by either downloading them from the NVIDIA Enterprise Licensing Portal or by pulling them from NGC Catalog. Please review to the NVIDIA AI Enterprise Quick Start guide for more details regarding licensing entitlement certificates.

Installing NGC Catalog CLI#

To access the NVIDIA AI Enterprise Host Software (VIB) and NVIDIA vGPU Guest Driver, you must first download and install NGC Catalog CLI. After the NGC Catalog CLI is installed, you will need to launch a command window and running the following commands to download software.

To install NGC Catalog CLI:

  1. Enter the NVIDIA NGC website as a guest user.

  2. In the top right corner, click Welcome Guest and then select Setup from the menu.

  3. Click Downloads under Install NGC CLI from the Setup page.

  4. From the CLI Install page, click the Windows, Linux, or MacOS tab, according to the platform from which you will be running NGC Catalog CLI.

  5. Follow the instructions to install the CLI.

  6. Open Command Prompt from the Run Box.

  7. Verify the installation by entering ngc --version. The output should be NGC Catalog CLI x.y.z where x.y.z indicates the version.

  8. Enter the following command ngc config set. You will be prompted to enter your NGC API Key.

After the NGC Catalog CLI is installed, you will need to launch a command window and running the following commands to download software.

NVIDIA AI Enterprise Host Software (VIB)#

  • VMware ESXi

ngc registry resource download-version "nvaie/vgpu_host_driver_4_0:vGPU Host Driver"

NVIDIA vGPU Guest Driver#

  • Ubuntu

ngc registry resource download-version "nvaie/vgpu_guest_driver_4_0:vGPU Guest Driver"

NVIDIA AI Enterprise 1.1 or later

  • Red Hat Enterprise Linux 8.4 vGPU Guest Driver

ngc registry resource download-version "nvaie/vgpu_guest_driver_4_0:vGPU Guest Driver"

Note

Further information on NGC Catalog and Registry CLIs can be found here.

On this page