Software Overview#
NVIDIA AI Enterprise#
NVIDIA AI Enterprise is an end-to-end, cloud-native software suite that accelerates the data science pipeline and streamlines the development and deployment of production AI. This platform is optimized and certified for a wide range of industry-standard infrastructure, including Red Hat AI Factory, ensuring performance, stability, and security for enterprise-grade AI workloads.
The suite includes essential building blocks for modern AI such as NVIDIA NIM for pre-optimized inference microservices and NVIDIA NeMo for building or customizing generative AI models. It also features management tools like the GPU and Network Operators that automate driver deployment and health monitoring within OpenShift. For detailed technical specifications, visit the NVIDIA AI Enterprise Documentation.
The software included in the NVIDIA AI Enterprise suite can be found and accessed through the NVIDIA NGC Catalog and the Red Hat Ecosystem Catalog.
To access container images for NVIDIA AI Enterprise, including NIM, you must first generate an NVIDIA NGC API Key.
Red Hat AI Enterprise#
Red Hat AI Enterprise is a flexible, scalable MLOps platform built on top of Red Hat OpenShift that provides a standardized environment for developing, training, and deploying artificial intelligence models. It integrates a set of open-source and NVIDIA technologies into a single, managed lifecycle. OpenShift AI acts as the orchestration layer that organizes these services into functional data science projects.
Red Hat OpenShift#
Red Hat OpenShift supports a wide range of deployment architectures, including bare metal, virtualized environments (such as VMware vSphere and Red Hat Virtualization), and various public and private cloud environments (such as AWS, Azure, Google Cloud, and OpenStack). This flexibility allows organizations to deploy and manage their AI workloads using NVIDIA AI Enterprise on the infrastructure that best meets their specific performance, cost, and security requirements.
Refer to the official Red Hat OpenShift documentation for detailed planning and deployment procedures.
Note
For an example step-by-step deployment, see: Installing Red Hat OpenShift on NVIDIA DGX.
The OpenShift CLI is utilized throughout the referenced guides for performing various tasks. The OpenShift command-line interface (CLI), or oc command, allows you to manage OpenShift Container Platform projects and create applications from a terminal. For detailed information on using the OpenShift CLI, refer to the documentation.
Red Hat OpenShift AI#
Red Hat OpenShift AI is installed as an Operator on an existing Red Hat OpenShift Container Platform cluster. Once installed, OpenShift AI provides the unified control plane, dashboards, and tools necessary for data scientists and platform engineers to manage the full AI/ML lifecycle, from initial experimentation in Jupyter notebooks to production deployment and monitoring of models, including NVIDIA NIMs.
Refer to the Red Hat OpenShift AI documentation for detailed planning and deploying procedures.