Install NeMo Microservices Individually#

The NeMo microservices support component-based deployment, which is useful if you require them to be in separate namespaces or clusters. Individual component Helm charts are available for you to fetch from the NGC Catalog. You can install the microservices you need instead of installing the entire NeMo platform using the NeMo Microservices Helm Chart.

The basic steps to install the NeMo microservices follow the same procedure as Helm Installation Overview. It’s recommended to use the charts in the same release version to avoid compatibility issues.


Component Helm Chart Installation Guides#

Use the following guides to install the NeMo Microservices and integrate them into your AI workflow.

NeMo Data Store

Deploy the NeMo Data Store microservice.

NeMo Data Store Microservice Deployment and Setup Guide
NeMo Entity Store

Deploy the NeMo Entity Store microservice.

NeMo Entity Store Values Setup
NeMo Customizer

Deploy the NeMo Customizer microservice.

NeMo Customizer Microservice Deployment Guide
NeMo Evaluator

Deploy the NeMo Evaluator microservice.

NeMo Evaluator Deployment Guide
NeMo Operator

Deploy the NeMo Operator microservice.

NeMo Operator Installation
DGX Cloud Admission Controller

Deploy the DGX Cloud Admission Controller for deployment to cloud.

Cloud Deployment with DGX Cloud Admission Controller
Deployment Management

Deploy the Deployment Management microservice.

NeMo Deployment Management Setup Guide
NIM Proxy

Deploy the NIM Proxy microservice.

NeMo NIM Proxy Helm Chart Values Setup
NeMo Guardrails

Deploy the NeMo Guardrails microservice.

NeMo Guardrails Microservice Deployment Guide