> This page is for NeMo Relay, version v0.6.0.
> For other versions, use one of these documentation indexes:
> - Latest (v0.9.4) (default): https://docs.nvidia.com/nemo/relay/latest/llms.txt
> - dev: https://docs.nvidia.com/nemo/relay/dev/llms.txt
> - v0.10.0: https://docs.nvidia.com/nemo/relay/v0.10.0/llms.txt
> - v0.9.4: https://docs.nvidia.com/nemo/relay/v0.9.4/llms.txt
> - v0.8.4: https://docs.nvidia.com/nemo/relay/v0.8.4/llms.txt
> - v0.7.3: https://docs.nvidia.com/nemo/relay/v0.7.3/llms.txt
> - v0.6.0: https://docs.nvidia.com/nemo/relay/v0.6.0/llms.txt
> - v0.5.0: https://docs.nvidia.com/nemo/relay/v0.5.0/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/relay/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/relay/_mcp/server.

# Module llm

> LLM DTOs and attributes. Shared LLM data types.

Generated from `cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker`.

LLM DTOs and attributes. Shared LLM data types.

## Structs

* [LlmAttributes](/reference/api/rust-library-reference/nemo-relay-types/api/llm/struct-llmattributes): Bitflags that modify LLM-call behavior and observability.
* [LlmRequest](/reference/api/rust-library-reference/nemo-relay-types/api/llm/struct-llmrequest): JSON-shaped LLM request payload passed through the runtime.
* [LlmRequestInterceptOutcome](/reference/api/rust-library-reference/nemo-relay-types/api/llm/struct-llmrequestinterceptoutcome): Result of an LLM request intercept that can schedule lifecycle marks.

## Constants

* [LLM\_REQUEST\_INTERCEPT\_OUTCOME\_SCHEMA](/reference/api/rust-library-reference/nemo-relay-types/api/llm/constant-llm-request-intercept-outcome-schema): Versioned JSON envelope schema for [`LlmRequestInterceptOutcome`](/reference/api/rust-library-reference/nemo-relay-types/api/llm/struct-llmrequestinterceptoutcome).