> This page is for version v0.25.0.
> For other versions, use one of these documentation indexes:
> - Latest (default): https://docs.nvidia.com/nemo/guardrails/latest/llms.txt
> - v0.25.0: https://docs.nvidia.com/nemo/guardrails/v0.25.0/llms.txt
> - v0.24.1: https://docs.nvidia.com/nemo/guardrails/v0.24.1/llms.txt
> - v0.24.0: https://docs.nvidia.com/nemo/guardrails/v0.24.0/llms.txt
> - v0.23.0: https://docs.nvidia.com/nemo/guardrails/v0.23.0/llms.txt
> - v0.22.0: https://docs.nvidia.com/nemo/guardrails/v0.22.0/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/guardrails/llms.txt.

# Use the Guardrails API Server

> Expose guardrails through an HTTP API using the Guardrails API server.

The NeMo Guardrails library includes the Guardrails API server that exposes guardrails through an HTTP API.
This section covers how to run the server and interact with it.

#### [Overview](/nemo/guardrails/v0.25.0/run-guardrailed-inference/using-fastapi-server/overview)

Run guardrails through an HTTP API and connect applications to configured models.

Concept

#### [Run the Server](/nemo/guardrails/v0.25.0/run-guardrailed-inference/using-fastapi-server/run-guardrails-server)

Start the Guardrails API server, configure CORS, and enable auto-reload.

Tutorial

#### [Chat Completions](/nemo/guardrails/v0.25.0/run-guardrailed-inference/using-fastapi-server/chat-with-guardrailed-model)

Send chat requests, use streaming, and manage conversation threads.

Tutorial

#### [Check Messages](/nemo/guardrails/v0.25.0/run-guardrailed-inference/using-python-apis/check-messages#guardrails-server)

Check messages, tool calls, and tool results against rails without generating a response.

Reference

#### [List Configurations](/nemo/guardrails/v0.25.0/run-guardrailed-inference/using-fastapi-server/list-guardrail-configs)

Retrieve available guardrails configurations from the server.

Reference

#### [List Models](/nemo/guardrails/v0.25.0/run-guardrailed-inference/using-fastapi-server/list-models)

Query the available LLM models from the configured provider.

Reference

#### [Actions Server](/nemo/guardrails/v0.25.0/run-guardrailed-inference/using-fastapi-server/actions-server)

Run guardrail actions in a separate server process.

Tutorial