Prerequisites#

Before installing the NeMo Platform Helm Chart, review requirements and create necessary secrets using your NGC API key.

Review Requirements#

To check the hardware and software specifications required for installing the NeMo Platform Helm Chart, review Hardware and Software Requirements for NeMo Platform.

For storage and persistent volume configuration (including ReadWriteMany and StorageClass configuration), see Persistent Volumes.

Create NGC API Key and Secrets#

You need an NGC account with access to the NeMo Platform early access org (0857255566152269), an NGC API key, and Kubernetes secrets created from that key so the chart can download platform assets and Docker images.

To learn more about using Helm charts in the NGC Catalog console in general, refer to the Helm Charts section in the NGC Catalog User Guide.

  1. Make sure your NGC account is invited to the NeMoMS organization as an external user. If you have not received an invitation, contact your NVIDIA point of contact.

  2. Create a personal NGC API key at https://org.ngc.nvidia.com/account/api-keys. Select NVIDIA Private Registry in Services Included at minimum.

    For more information about the service permissions you can include, refer to Supported NGC Applications and API Key Types in the NVIDIA NGC Catalog documentation.

  3. Store the key into your shell environment.

    export NGC_API_KEY=<your-ngc-api-key>

    The rest of the installation guide assumes that you have set up the environment variable NGC_API_KEY.

  4. Set up the following secrets in a namespace where you want to install the charts.

    • Docker registry image pull secret: This secret allows pods to pull container images from the NGC private registry.

      kubectl create secret \
   docker-registry nvcrimagepullsecret \
   --docker-server=nvcr.io \
   --docker-username='$oauthtoken' \
   --docker-password=$NGC_API_KEY \
   --namespace <namespace-to-install-nemo-microservices>

    • Generic secret: This secret is for authenticating to download models from the NGC Catalog.

      kubectl create secret generic ngc-api \
   --from-literal=NGC_API_KEY=$NGC_API_KEY \
   --namespace <namespace-to-install-nemo-microservices>

For more information about various secrets you might need to create and set up through the NeMo Platform Helm Chart depending on your use case, refer to Manage Secrets.