Skip to main content

Ctrl+K

NVIDIA NeMo Guardrails

NVIDIA NeMo Guardrails

Table of Contents

NVIDIA NeMo Guardrails

About NeMo Guardrails
Installation Guide
Getting Started
Release Notes

Common Tasks

Configuration Guide
Guardrails Library
Guardrails Process
Colang Guide
LLM Support
Multimodal Data
Python API
CLI
Server Guide
LangChain
Detailed Logging
- Output Variables
Tracing
Jailbreak Detection Heuristics
- Using Jailbreak Detection Heuristics
LLMs
- NVIDIA AI Endpoints
  - Using LLMs hosted on NVIDIA API Catalog
- Vertex AI
  - Using LLMs hosted on Vertex AI
Multi Config API
- Multi-config API
Migrating from Colang 1 to Colang 2

Advanced Uses

Generation Options
Prompt Customization
Embedding Search Providers
NeMo Guardrails with Docker
Streaming
AlignScore Deployment
Extract User-provided Values
Bot Message Instructions
Event-based API
Self-hosting Llama Guard using vLLM
Nested AsyncIO Loop
Vertex AI Setup
Llama 3.1 NemoGuard 8B ContentSafety Deployment
Nemotron Content Safety Multilingual Deployment
Llama 3.1 NemoGuard 8B Topic Control Deployment
NemoGuard JailbreakDetect Deployment
KV Cache Reuse for NemoGuard NIM
Blueprint with NemoGuard NIMs
Tools Integration with NeMo Guardrails

Security

Security Guidelines

Evaluation

Guardrails Evaluation
LLM Vulnerability Scanning

Guardrails with Colang

Hello World
Core Colang Concepts
Demo Use Case
Input Rails
Output Rails
Topical Rails
Retrieval-Augmented Generation

Colang 2.0

Overview
What’s Changed
Getting Started
Language Reference

Reference

Architecture
- Architecture Guide
Glossary
Frequently Asked Questions (FAQ)

module nemoguardrails.context

`module` `nemoguardrails.context`#

Global Variables#

streaming_handler_var
explain_info_var
llm_call_info_var

On this page

Global Variables

Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2023-2025, NVIDIA Corporation.