Integrating with NeMo Guardrails

NeMo Guardrails uses the LangChain ChatNVIDIA connector to connect to a locally running NIM microservice like Llama 3.1 Nemotron Safety Guard Multilingual 8B V1 NIM. The content safety microservice exposes the standard OpenAI interface on the v1/chat/completions endpoint.

NeMo Guardrails simplifies the complexity of building the prompt template, parsing the multilingual content safety model responses, and provides a programmable method to build a chatbot with multilingual content safety rails.

Refer to Nemotron Content Safety Multilingual Deployment in the NeMo Guardrails documentation for step-by-step instructions.