Platform-specific Prerequisites

This page covers any platform-specific prerequisites for installing the NVIDIA NIM Operator.

Google Kubernetes Engine (GKE)

If you are installing on GKE, you must also set resource quotas for the NIM Operator namespace.

Red Hat OpenShift

• The NIM Operator requires the NVIDIA GPU Operator to be installed on your cluster.

  To install the NVIDIA GPU Operator on Red Hat OpenShift:

  1. Install the Node Feature Discovery Operator.

     • Refer to Node Feature Discovery Operator in the OpenShift Container Platform documentation for installation information.

     • Refer to Installing the Node Feature Discovery Operator on OpenShift for information about creating a node feature discovery instance.

  2. Install the GPU Operator.

     Refer to Installing the NVIDIA GPU Operator on OpenShift for information about installing the Operator and creating a cluster policy instance.

If you are planning to install using the Open Shift CLI, you must also have the following prerequisites:

• A Red Hat OpenShift Container Platform cluster and the cluster-admin role. Refer to Platform Support for information about supported operating systems and Kubernetes platforms.

• An installation of the Operator SDK and the operator-sdk command in your path. Refer to Installation in the Operator SDK documentation for more information.

• OpenShift CLI. Refer to Installing the OpenShift CLI in the OpenShift documentation for more information.

• An NGC CLI API key. Pods use the API key as an image pull secret to download container images and models from NVIDIA NGC. Refer to Generating Your NGC API Key in the NVIDIA NGC User Guide for more information.

VMware Tanzu

Installing on VMware Tanzu requires the following prerequisites:

• A TKG cluster and the cluster-admin role. Refer to Platform Support for information about supported operating systems and Kubernetes platforms.

• A persistent volume provisioner that supports network access, such as vSAN.

• Kubernetes CLI tools for VMware vSphere. Refer to Download and Install the Kubernetes CLI Tools for vSphere

• The NIM Operator requires the NVIDIA GPU Operator be installed on your cluster. When installing NVIDIA GPU Operator, create and label the GPU Operator namespace first to prevent the admission controller from enforcing the pod security policy for pods that are created with a service account:

  $ kubectl create namespace gpu-operator
  $ kubectl label --overwrite ns gpu-operator pod-security.kubernetes.io/warn=privileged pod-security.kubernetes.io/enforce=privileged
  

Next Steps

• Installing NVIDIA NIM Operator