> For clean Markdown of any page, append .md to the page URL. > For a complete documentation index, see https://docs.nvidia.com/nemo/guardrails/v0.25.0/run-guardrailed-inference/using-fastapi-server/llms.txt. # Use the Guardrails API Server > Expose guardrails through an HTTP API using the Guardrails API server. The NeMo Guardrails library includes the Guardrails API server that exposes guardrails through an HTTP API. This section covers how to run the server and interact with it. #### [Overview](/run-guardrailed-inference/using-fastapi-server/overview) Run guardrails through an HTTP API and connect applications to configured models. Concept #### [Run the Server](/run-guardrailed-inference/using-fastapi-server/run-guardrails-server) Start the Guardrails API server, configure CORS, and enable auto-reload. Tutorial #### [Chat Completions](/run-guardrailed-inference/using-fastapi-server/chat-with-guardrailed-model) Send chat requests, use streaming, and manage conversation threads. Tutorial #### [Check Messages](/run-guardrailed-inference/using-python-apis/check-messages#guardrails-server) Check messages, tool calls, and tool results against rails without generating a response. Reference #### [List Configurations](/run-guardrailed-inference/using-fastapi-server/list-guardrail-configs) Retrieve available guardrails configurations from the server. Reference #### [List Models](/run-guardrailed-inference/using-fastapi-server/list-models) Query the available LLM models from the configured provider. Reference #### [Actions Server](/run-guardrailed-inference/using-fastapi-server/actions-server) Run guardrail actions in a separate server process. Tutorial ## Docs - [Overview of the NVIDIA NeMo Guardrails Library API Server](https://docs.nvidia.com/nemo/guardrails/v0.25.0/run-guardrailed-inference/using-fastapi-server/overview.md): Expose configured guardrails and models through the NVIDIA NeMo Guardrails library HTTP API. - [Run the Guardrails Server](https://docs.nvidia.com/nemo/guardrails/v0.25.0/run-guardrailed-inference/using-fastapi-server/run-guardrails-server.md): Start the Guardrails API server, configure CORS, and enable auto-reload. - [Chat with Guardrailed Model](https://docs.nvidia.com/nemo/guardrails/v0.25.0/run-guardrailed-inference/using-fastapi-server/chat-with-guardrailed-model.md): Send chat requests, use streaming, and manage conversation threads. - [List Guardrail Configurations](https://docs.nvidia.com/nemo/guardrails/v0.25.0/run-guardrailed-inference/using-fastapi-server/list-guardrail-configs.md): Retrieve available guardrails configurations from the server. - [List Available Models](https://docs.nvidia.com/nemo/guardrails/v0.25.0/run-guardrailed-inference/using-fastapi-server/list-models.md): Query the available LLM models from the configured provider. - [Use the Actions Server](https://docs.nvidia.com/nemo/guardrails/v0.25.0/run-guardrailed-inference/using-fastapi-server/actions-server.md): Run guardrail actions in a separate server process.