The NeMo Guardrails library includes the Guardrails API server that exposes guardrails through an HTTP API. This section covers how to run the server and interact with it.
Run guardrails through an HTTP API and connect applications to configured models.
ConceptStart the Guardrails API server, configure CORS, and enable auto-reload.
TutorialSend chat requests, use streaming, and manage conversation threads.
TutorialCheck messages, tool calls, and tool results against rails without generating a response.
ReferenceRetrieve available guardrails configurations from the server.
ReferenceQuery the available LLM models from the configured provider.
ReferenceRun guardrail actions in a separate server process.
Tutorial