Tag-Based Helm Installation#
The NeMo Microservices Helm Chart enables flexible installation through the tags key in the values.yaml file. You can choose which functional microservices to install in a namespace.
The following commands show how to install the microservices using the tags key.
Installing NeMo Auditor#
To install only NeMo Auditor functionality, use the following command.
helm install nemo-auditor nmp/nemo-microservices-helm-chart \
--set tags.platform=false \
--set tags.auditor=true \
--timeout 10m
For more installation details and advanced configurations, refer to Deploy NeMo Auditor Using Helm Chart.
Installing NeMo Customizer#
To install only NeMo Customizer functionality, use the following command.
helm install nemo-customizer nmp/nemo-microservices-helm-chart \
--set tags.platform=false \
--set tags.customizer=true \
--timeout 10m
For more installation details and advanced configurations, refer to NeMo Customizer Microservice Deployment Guide.
Installing NeMo Data Designer#
To install only NeMo Data Designer functionality, use the following command.
helm install nemo-data-designer nmp/nemo-microservices-helm-chart \
--set tags.platform=false \
--set tags.data-designer=true \
--timeout 10m
For more installation details and advanced configurations, refer to NeMo Data Designer Deployment Guide.
Installing NeMo Evaluator#
To install only NeMo Evaluator functionality, use the following command.
helm install nemo-evaluator nmp/nemo-microservices-helm-chart \
--set tags.platform=false \
--set tags.evaluator=true \
--timeout 10m
For more installation details and advanced configurations, refer to Deploy NeMo Evaluator Using Helm Chart.
Installing NeMo Guardrails#
To install only NeMo Guardrails functionality, use the following command.
helm install nemo-guardrails nmp/nemo-microservices-helm-chart \
--set tags.platform=false \
--set tags.guardrails=true \
--timeout 10m
For more installation details and advanced configurations, refer to NeMo Guardrails Deployment Guide.
Installing NeMo Safe Synthesizer#
To install only NeMo Safe Synthesizer functionality, use the following command.
helm install nemo-safe-synthesizer nmp/nemo-microservices-helm-chart \
--set tags.platform=false \
--set tags.safe-synthesizer=true \
--timeout 10m
For more installation details and advanced configurations, refer to NeMo Safe Synthesizer Deployment Guide.
Installing NeMo Studio#
To install NeMo Studio along with the NeMo microservices platform, use the following command.
helm install nemo-studio nmp/nemo-microservices-helm-chart \
--set tags.studio=true \
--timeout 10m
For more installation details and advanced configurations, refer to Deploy NeMo Studio Using Parent Helm Chart.
Installed Components per Tag#
The following table summarizes the installation tags available in the NeMo Microservices Helm Chart and the microservices that are installed when each tag is used.
Tag |
Microservices Installed |
Description |
|---|---|---|
|
All NeMo microservices |
Installs the complete NeMo microservices platform including all generally available (GA) components. This is the default installation. |
|
NeMo Auditor |
Model and system risk assessment service. |
NeMo Core Microservice |
Core microservice for scheduling jobs. |
|
NeMo Data Store |
Data storage for job results. |
|
|
NeMo Customizer |
Core fine-tuning service. |
NeMo Entity Store |
Entity management for customizer. |
|
NeMo Data Store |
Data storage for customizer. |
|
NeMo Operator |
Kubernetes operator for customizer. |
|
|
NeMo Data Designer |
Data Designer service for generating synthetic data from scratch or seeds. |
NeMo Core Microservice |
Core microservice for scheduling jobs. |
|
NeMo Data Store |
Data storage for job results. |
|
|
NeMo Evaluator |
Core evaluation service. |
NeMo Entity Store |
Entity management for evaluator. |
|
NeMo Core Microservice |
Core microservice for scheduling jobs. |
|
NeMo Data Store |
Data storage for evaluator and job results. |
|
|
NeMo Guardrails |
Core guardrails service. |
NeMo Deployment Management |
Deployment management service for managing NIM microservice deployments. |
|
NIM Proxy |
NIM Proxy service for routing inference requests to the guardrails service. |
|
NIM Operator |
Kubernetes operator for NIM microservice. |
|
|
NeMo Safe Synthesizer |
Safe Synthesizer service for generating safe synthetic data. |
NeMo Core Microservice |
Core microservice for scheduling jobs. |
|
NeMo Data Store |
Data storage for job results. |
|
|
NeMo Studio |
NeMo Studio service for managing the NeMo Studio platform. To enable Customizations and Evaluations, you need to install with the |
NeMo Entity Store |
Entity management for studio. |
|
NeMo Data Store |
Data storage for studio. |
|
NeMo Deployment Management |
Deployment management service for managing LLM NIM microservice deployments. |
|
NIM Proxy |
NIM Proxy service for routing inference requests to LLM NIM microservices. |
|
NIM Operator |
Kubernetes operator for NIM microservice. |