Install NeMo Guardrails Microservice Using Helm

Find more information on prerequisites and configuring the key parts of the values.yaml file in the NeMo Microservices Helm Chart.

Installation Options

Choose the installation method that best fits your requirements:

• NeMo Guardrails Basic Installation Using Helm: Default configuration with NeMo platform microservices such as NIM Proxy and NeMo Deployment Management. Choose this option if you want to manage NIM microservices in the NeMo platform.

• Integrate NeMo Guardrails with LLM NIM Outside of NeMo Platform: Configure NeMo Guardrails to use NIM microservices you have deployed in your cluster separately outside of the NeMo platform.

• Integrate NeMo Guardrails with NIM from build.nvidia.com: Configure NeMo Guardrails to use NIM endpoints from build.nvidia.com.

Advanced Configurations

• High Availability Configuration: Deploy NeMo Guardrails with high availability by adding configurations for multiple replicas and affinity rules.

• Install Custom Dependencies in NeMo Guardrails: Extend the NeMo Guardrails microservice image with additional dependencies and use it in the Helm installation.

• Guardrails Configuration Store: Use an external database for NeMo Guardrails configuration store.