> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/relay/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/relay/_mcp/server.

# Module llm

> LLM DTOs and attributes. Shared LLM data types.

Generated from `cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker`.

LLM DTOs and attributes. Shared LLM data types.

## Structs

* [LlmAttributes](/reference/api/rust-library-reference/nemo-relay-types/api/llm/struct-llmattributes): Bitflags that modify LLM-call behavior and observability.
* [LlmRequest](/reference/api/rust-library-reference/nemo-relay-types/api/llm/struct-llmrequest): JSON-shaped LLM request payload passed through the runtime.
* [LlmRequestInterceptOutcome](/reference/api/rust-library-reference/nemo-relay-types/api/llm/struct-llmrequestinterceptoutcome): Result of an LLM request intercept that can schedule lifecycle marks.

## Constants

* [LLM\_REQUEST\_INTERCEPT\_OUTCOME\_SCHEMA](/reference/api/rust-library-reference/nemo-relay-types/api/llm/constant-llm-request-intercept-outcome-schema): Versioned JSON envelope schema for [`LlmRequestInterceptOutcome`](/reference/api/rust-library-reference/nemo-relay-types/api/llm/struct-llmrequestinterceptoutcome).