About Guardrails Configuration Store

In a guardrail configuration, you can configure models and policies (prompts) to apply to user inputs and LLM outputs. After you create guardrail configurations, you can specify the ID of the configuration you want to apply in each guardrail inference request to the NeMo Guardrails microservice inference endpoint. You can manage multiple guardrail configurations in the NeMo Guardrails microservice, as the microservice stores configurations in the default PostgreSQL or a database you provide.

The guardrail configuration store needs to be configured at the time of installing the NeMo Guardrails microservice. You can choose from the following storage backends for the guardrail configuration store:

• Bitnami PostgreSQL Database: This is the default option.

• External PostgreSQL Database: This is a recommeneded option for production deployments if you have an existing database.

• NFS Storage: This is an option for file-based storage requirements.

To learn more about setting up a database for the guardrail configuration store, refer to Guardrails Configuration Store in the NeMo Guardrails microservice Helm installation guide.