> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/guardrails/v0.24.0/run-guardrailed-inference/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/guardrails/_mcp/server.

# Run Guardrailed Inference

## Docs

- [About Running Guardrailed Inference](https://docs.nvidia.com/nemo/guardrails/v0.24.0/run-guardrailed-inference/run-rails.md): Run guardrailed inference using the Python API or Guardrails API server.
- [Use the NeMo Guardrails Python APIs](https://docs.nvidia.com/nemo/guardrails/v0.24.0/run-guardrailed-inference/using-python-apis.md): Run guardrailed inference using the NeMo Guardrails Python API.
- [Overview of the NeMo Guardrails Python APIs](https://docs.nvidia.com/nemo/guardrails/v0.24.0/run-guardrailed-inference/using-python-apis/overview.md): RailsConfig and LLMRails core classes for generating guarded responses.
- [Core Classes Reference](https://docs.nvidia.com/nemo/guardrails/v0.24.0/run-guardrailed-inference/using-python-apis/core-classes.md): RailsConfig and LLMRails class reference for loading and running guardrails.
- [Generation Options Reference](https://docs.nvidia.com/nemo/guardrails/v0.24.0/run-guardrailed-inference/using-python-apis/generation-options.md): Configure logging, LLM parameters, and rail selection for generation.
- [Streaming Responses](https://docs.nvidia.com/nemo/guardrails/v0.24.0/run-guardrailed-inference/using-python-apis/streaming.md): Stream LLM responses in real-time with the stream_async method.
- [Checking Messages Against Rails](https://docs.nvidia.com/nemo/guardrails/v0.24.0/run-guardrailed-inference/using-python-apis/check-messages.md): Validate messages against input and output rails using check_async and check methods on the LLMRails and IORails engines.
- [Event-Based API](https://docs.nvidia.com/nemo/guardrails/v0.24.0/run-guardrailed-inference/using-python-apis/event-based-api.md): Use generate_events for low-level control over guardrails execution.
- [Use the Guardrails API Server](https://docs.nvidia.com/nemo/guardrails/v0.24.0/run-guardrailed-inference/using-fastapi-server.md): Expose guardrails through an HTTP API using the Guardrails API server.
- [Overview of the NVIDIA NeMo Guardrails Library API Server](https://docs.nvidia.com/nemo/guardrails/v0.24.0/run-guardrailed-inference/using-fastapi-server/overview.md): The NVIDIA NeMo Guardrails library API server runs guardrails in a secure, isolated environment.
- [Run the Guardrails Server](https://docs.nvidia.com/nemo/guardrails/v0.24.0/run-guardrailed-inference/using-fastapi-server/run-guardrails-server.md): Start the Guardrails API server, configure CORS, and enable auto-reload.
- [Chat with Guardrailed Model](https://docs.nvidia.com/nemo/guardrails/v0.24.0/run-guardrailed-inference/using-fastapi-server/chat-with-guardrailed-model.md): Send chat requests, use streaming, and manage conversation threads.
- [List Guardrail Configurations](https://docs.nvidia.com/nemo/guardrails/v0.24.0/run-guardrailed-inference/using-fastapi-server/list-guardrail-configs.md): Retrieve available guardrails configurations from the server.
- [List Available Models](https://docs.nvidia.com/nemo/guardrails/v0.24.0/run-guardrailed-inference/using-fastapi-server/list-models.md): Query the available LLM models from the configured provider.
- [Use the Actions Server](https://docs.nvidia.com/nemo/guardrails/v0.24.0/run-guardrailed-inference/using-fastapi-server/actions-server.md): Run guardrail actions in a secure, isolated environment.