Use the Guardrails API Server
The NeMo Guardrails library includes the Guardrails API server that exposes guardrails through an HTTP API. This section covers how to run the server and interact with it.
Overview
The Guardrails API server is a tool for running guardrails in a secure, isolated environment.
ConceptRun the Server
Start the Guardrails API server, configure CORS, and enable auto-reload.
TutorialChat Completions
Send chat requests, use streaming, and manage conversation threads.
TutorialList Configurations
Retrieve available guardrails configurations from the server.
ReferenceList Models
Query the available LLM models from the configured provider.
ReferenceActions Server
Run guardrail actions in a secure, isolated environment.
Tutorial