> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/relay/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/relay/_mcp/server.

# Module llm

> LLM lifecycle helpers and managed execution entry points.

Generated from `cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi`.

LLM lifecycle helpers and managed execution entry points.

## Structs

* [CreateLlmHandleParams](/reference/api/rust-library-reference/nemo-relay/api/llm/struct-createllmhandleparams): Builder parameters for [`NemoRelayContextState::create_llm_handle`](/reference/api/rust-library-reference/nemo-relay/api/runtime/state/struct-nemorelaycontextstate).
* [EndLlmHandleParams](/reference/api/rust-library-reference/nemo-relay/api/llm/struct-endllmhandleparams): Builder parameters for [`NemoRelayContextState::build_llm_end_event`](/reference/api/rust-library-reference/nemo-relay/api/runtime/state/struct-nemorelaycontextstate).
* [LlmAttributes](/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmattributes): Bitflags that modify LLM-call behavior and observability.
* [LlmCallEndParams](/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmcallendparams): Builder parameters for [`llm_call_end`](/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-call-end).
* [LlmCallExecuteParams](/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmcallexecuteparams): Builder parameters for [`llm_call_execute`](/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-call-execute).
* [LlmCallParams](/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmcallparams): Builder parameters for [`llm_call`](/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-call).
* [LlmHandle](/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmhandle): Runtime-owned handle identifying an active or completed LLM call.
* [LlmRequest](/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmrequest): JSON-shaped LLM request payload passed through the runtime.
* [LlmStreamCallExecuteParams](/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmstreamcallexecuteparams): Builder parameters for [`llm_stream_call_execute`](/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-stream-call-execute).

## Functions

* [llm\_call](/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-call): Start a manual LLM lifecycle span.
* [llm\_call\_end](/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-call-end): Finish a manual LLM lifecycle span.
* [llm\_call\_execute](/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-call-execute): Execute an LLM call through the managed middleware pipeline.
* [llm\_conditional\_execution](/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-conditional-execution): Run only the LLM conditional-execution guardrail chain.
* [llm\_request\_intercepts](/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-request-intercepts): Run only the LLM request-intercept chain.
* [llm\_stream\_call\_execute](/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-stream-call-execute): Execute a streaming LLM call through the managed middleware pipeline.