Prerequisites#

Before installing the NeMo Microservices Helm Chart, review requirements and create necessary secrets using your NGC API key.

Review Requirements#

To check the hardware and software specifications required for installing the NeMo Microservices Helm Chart, review Hardware and Software Requirements for NeMo Microservices.

Create NGC API Key and Secrets#

You need to have an NGC account, create an NGC API key, and create secrets using the key to access and download the NeMo Microservices Helm Chart and Docker images.

To learn more about using Helm charts in the NGC Catalog console in general, refer to the Helm Charts section in the NGC Catalog User Guide.

  1. Create an NGC API key following the instructions at Generating NGC API Keys.

    Tip

    While creating the key, make sure that you include the following permissions at a minimum:

    • NGC Catalog

    • Public API Endpoints

    For more information about the service permissions you can include, refer to Supported NGC Applications and API Key Types in the NVIDIA NGC Catalog documentation.

  2. Store the key into your shell environment.

    export NGC_API_KEY=<your-ngc-api-key>

    The rest of the installation guide assumes that you have set up the environment variable NGC_API_KEY.

  3. Set up the following secrets in a namespace where you want to install the charts.

    • Docker registry image pull secret: This secret allows pods to pull container images from the NGC Catalog.

      kubectl create secret \
   docker-registry nvcrimagepullsecret \
   --docker-server=nvcr.io \
   --docker-username='$oauthtoken' \
   --docker-password=$NGC_API_KEY \
   --namespace <namespace-to-install-nemo-microservices>

    • Generic secret: This secret is for authenticating to download models from the NGC Catalog.

      kubectl create secret generic ngc-api \
   --from-literal=NGC_API_KEY=$NGC_API_KEY \
   --namespace <namespace-to-install-nemo-microservices>

For more information about various secrets you might need to create and set up through the NeMo Microservices Helm Chart depending on your use case, refer to Manage Secrets.