Advanced

• AlignScore Deployment
• Bot Message Instructions
• Embedding Search Providers
  • Batch Implementation
  • Custom Embedding Search Providers
• Event-based API
  • Event Types
  • Custom Events
  • Typical Usage
• Extract User-provided Values
  • Overview
  • Single Values or Lists
  • Multiple Values
  • Contextual Queries
• Generation Options
  • Output Variables
  • Additional LLM Parameters
  • Additional LLM Output
  • Detailed Logging Information
  • Disabling Rails
  • Limitations
• Jailbreak Detection Deployment
  • Running on GPU
• Self-hosting Llama Guard using vLLM
• Nested AsyncIO Loop
• Prompt Customization
  • Task-oriented Prompting
  • Prompt Configuration
  • Predefined Prompts
  • Custom Tasks and Prompts
• Streaming
  • Configuration
  • Usage
  • Token Usage Tracking
• NeMo Guardrails with Docker
  • Introduction
  • Prerequisites
  • Build the Docker Images
  • Running using Docker
  • AlignScore Fact-checking
• Vertex AI Setup
• Nemotron Safety Guard Deployment
  • Adding Multilingual Content Safety Guardrails
  • Prerequisites
  • Starting the Content Safety Container
  • Configuring Guardrails and Running Inference
  • Next Steps
• Llama 3.1 NemoGuard 8B Topic Control Deployment
  • NIM Deployment
  • More details on TopicControl model
• Blueprint with NemoGuard NIMs
  • Prerequisites and Setup