Tag-Based Helm Installation#
The NeMo Microservices Helm Chart enables flexible installation through the tags
key in the values.yaml
file. You can choose which functional microservices to install in a namespace.
The following commands show how to install the microservices using the tags
key.
Installing NeMo Auditor#
To install only NeMo Auditor functionality, use the following command.
helm install nemo-auditor nmp/nemo-microservices-helm-chart \
--set tags.platform=false \
--set tags.auditor=true \
--timeout 10m
For more installation details and advanced configurations, refer to Deploy NeMo Auditor Using Helm Chart.
Installing NeMo Customizer#
To install only NeMo Customizer functionality, use the following command.
helm install nemo-customizer nmp/nemo-microservices-helm-chart \
--set tags.platform=false \
--set tags.customizer=true \
--timeout 10m
For more installation details and advanced configurations, refer to NeMo Customizer Microservice Deployment Guide.
Installing NeMo Data Designer#
To install only NeMo Data Designer functionality, use the following command.
helm install nemo-data-designer nmp/nemo-microservices-helm-chart \
--set tags.platform=false \
--set tags.data-designer=true \
--timeout 10m
For more installation details and advanced configurations, refer to NeMo Data Designer Deployment Guide.
Installing NeMo Evaluator#
To install only NeMo Evaluator functionality, use the following command.
helm install nemo-evaluator nmp/nemo-microservices-helm-chart \
--set tags.platform=false \
--set tags.evaluator=true \
--timeout 10m
For more installation details and advanced configurations, refer to Deploy NeMo Evaluator Using Helm Chart.
Installing NeMo Guardrails#
To install only NeMo Guardrails functionality, use the following command.
helm install nemo-guardrails nmp/nemo-microservices-helm-chart \
--set tags.platform=false \
--set tags.guardrails=true \
--timeout 10m
For more installation details and advanced configurations, refer to NeMo Guardrails Deployment Guide.
Installing NeMo Safe Synthesizer#
To install only NeMo Safe Synthesizer functionality, use the following command.
helm install nemo-safe-synthesizer nmp/nemo-microservices-helm-chart \
--set tags.platform=false \
--set tags.safe-synthesizer=true \
--timeout 10m
For more installation details and advanced configurations, refer to NeMo Safe Synthesizer Deployment Guide.
You can also install the microservices by overriding the tags
values in the default values.yaml
file of the chart.
Installed Components per Tag#
The following table summarizes the installation tags available in the NeMo Microservices Helm Chart and the microservices that are installed when each tag is used.
Tag |
Microservices Installed |
Description |
---|---|---|
|
All NeMo microservices |
Installs the complete NeMo microservices platform including all generally available (GA) components. This is the default installation. |
|
NeMo Auditor |
Model and system risk assessment service. |
NeMo Core Microservice |
Core microservice for scheduling jobs. |
|
NeMo Data Store |
Data storage for job results. |
|
|
NeMo Customizer |
Core fine-tuning service. |
NeMo Entity Store |
Entity management for customizer. |
|
NeMo Data Store |
Data storage for customizer. |
|
NeMo Operator |
Kubernetes operator for customizer. |
|
|
NeMo Data Designer |
Data Designer service for generating synthetic data from scratch or seeds. |
NeMo Core Microservice |
Core microservice for scheduling jobs. |
|
NeMo Data Store |
Data storage for job results. |
|
|
NeMo Evaluator |
Core evaluation service. |
NeMo Entity Store |
Entity management for evaluator. |
|
NeMo Core Microservice |
Core microservice for scheduling jobs. |
|
NeMo Data Store |
Data storage for evaluator and job results. |
|
|
NeMo Guardrails |
Core guardrails service. |
NeMo Deployment Management |
Deployment management service for managing NIM microservice deployments. |
|
NIM Proxy |
NIM Proxy service for routing inference requests to the guardrails service. |
|
NIM Operator |
Kubernetes operator for NIM microservice. |
|
|
NeMo Safe Synthesizer |
Safe Synthesizer service for generating safe synthetic data. |
NeMo Core Microservice |
Core microservice for scheduling jobs. |
|
NeMo Data Store |
Data storage for job results. |