NVIDIA AI Enterprise VMI#

Added in version 4.1.

NVIDIA AI Enterprise On-Demand VMIs are offered through CSP marketplaces which provide easy access to NVIDIA AI Enterprise containers, models, resources, and support without the need to bring a separate license. These Enterprise VMIs include all of the software required to run NVIDIA AI Enterprise containers.

Note

In order to run NVIDIA AI Workflows, The NVIDIA Cloud Native Stack must be installed on the Enterprise VMI. Instructions for installing the Cloud Native Stack on the Enterprise VMI via an ansible playbook can be found in the NVIDIA AI Workflows Deployment Guides. Further details around installing CNS can be found in the CNS Playbook. To avoid these additional steps, the Cloud Native Stack VMI can also be used but is not currently supported under NVIDIA AI Enterprise. Further information on NVIDIA AI Workflows can be found in the general NVIDIA AI Enterprise Documentation.

The NVIDIA AI Enterprise On-Demand VMI is a virtual machine image for accelerating your Machine Learning, Deep Learning, Data Science and HPC workloads. Using this VMI, you can spin up a GPU-accelerated Compute Engine VM instance in minutes with a pre-installed Ubuntu OS, GPU driver, Docker and NVIDIA container toolkit.

This VMI provides easy access to NVIDIA’s NGC Catalog, a hub for GPU-optimized software, for pulling & running performance-tuned, tested, and NVIDIA certified docker containers. The NGC catalog provides free access to containerized AI, Data Science, and HPC applications, pre-trained models, AI SDKs and other resources to enable data scientists, developers, and researchers to focus on building and deploying solutions. The On-Demand VMI is preconfigured with the following software:

  • Ubuntu Operating System Certified for NVIDIA AI Enterprise

  • NVIDIA Driver

  • Docker-ce

  • NVIDIA Container Toolkit

  • CSP CLI, NGC CLI

  • Miniconda, JupyterLab, Git

Note

When the NVIDIA vGPU driver is preinstalled it is configured for compute workloads.

A complete list of supported instance types can be found in the NVIDIA AI Enterprise Product Support Matrix.

Accessing The NGC Catalog on NGC#

Prior to getting started with NVIDIA AI Enterprise in your Enterprise (On-Demand) VMI cloud instance, you must authorize the instance with NVIDIA NGC using an NGC API key or an NGC Personal Key with NVAIE access privileges. The Enterprise VMI provides access to the NVIDIA AI Catalog, but the user must first obtain the appropriate API key and place it on the VMI.

Note

Additional information for setting up VMI’s in the public cloud can be found in the NGC Certified Public Cloud documentation.

Here are the high level steps for this process.

  1. Generate an NGC API key or Personal key (with NVAIE access privilege) for accessing the catalog.

  2. Put the API key on the VMI.

  1. Generate an API key for accessing the catalog

    Next you must generate an NGC API key or Personal key that will give you access to the NGC Catalog.

    For a description on the various API keys, refer to NGC API Keys.

    Note

    You only need to generate an API Key once. NGC does not save your key, so store it securely. You can generate a new one from the NGC website if you lose your API Key. Generating a new API Key invalidates the previously generated key.

  2. Put the API key on the VMI

    The API Key allows you to pull resources from the NVIDIA Catalog, but you must make it available to the different tools, e.g. Docker and the NGC CLI.

    Add the API Key to the NGC CLI

    ngc config set

    Input the API key

    Next, add the API Key to the Docker CLI

    docker login -u "\$oauthtoken" -p <NGC API key or NGC personal key> nvcr.io

    The VMI is now ready to pull and run NVIDIA AI Enterprise Containers.

Pulling and Running NVIDIA AI Enterprise Containers#

Please refer to the Appendix for pulling and running NGC container images through the NVIDIA NGC Catalog.

Maintaining Access to the NVIDIA AI NGC Catalog#

You can generate a new API key from the NGC website if needed. Generating a new API Key invalidates the previously generated key.

Warning

There is a one to one relationship with the VMI instance ID and the associated NGC organization. This means that if you delete the VMI, the NGC Org can no longer be renewed.

Note

An entitlement to the typical private container registry on NGC that comes with NVIDIA AI Enterprise is not included with the Enterprise On-Demand VMI.

Note

Enterprise On-Demand VMI licensing does not allow admins to add other users to their NGC Org associated with the VMI.

NVIDIA Technical Support Resources#

The following technical support resources are available for NVIDIA AI Enterprise:

Developer Forum:

Common questions and information about the AI application frameworks and SDKs provided as part of NVIDIA AI Enterprise can be found at the NVIDIA Developer Forum.

Phone Support for the NVIDIA AI Enterprise VMI when used on-demand:

Customers using the NVIDIA AI Enterprise VMI on the OCI marketplace on-demand can submit up to 3 technical support requests to NVIDIA at no cost. To get in touch with an NVIDIA support specialist, call one of the phone numbers listed here and provide the code OCI-NVAIE when requesting assistance.

NVIDIA Business Standard Support for the NVIDIA AI Enterprise VMI when ordered as a Private Offer:

Customers who have made a term commitment for NVIDIA AI Enterprise via a Private Offer are entitled to NVIDIA Business Standard Support. NVIDIA Business Standard Support includes:

  • 24x7 online support portal with access to tracking tool for bug reporting and issue resolution, knowledge base materials and troubleshooting information.

  • 8 AM - 5 PM business days at local time zone telephone technical assistance.

Find additional details around Private Offers here.

On this page