Module llm

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

LLM lifecycle helpers and managed execution entry points.

Structs

• CreateLlmHandleParams: Builder parameters for NemoRelayContextState::create_llm_handle.
• EndLlmHandleParams: Builder parameters for NemoRelayContextState::build_llm_end_event.
• LlmAttributes: Bitflags that modify LLM-call behavior and observability.
• LlmCallEndParams: Builder parameters for llm_call_end.
• LlmCallExecuteParams: Builder parameters for llm_call_execute.
• LlmCallParams: Builder parameters for llm_call.
• LlmHandle: Runtime-owned handle identifying an active or completed LLM call.
• LlmRequest: JSON-shaped LLM request payload passed through the runtime.
• LlmRequestInterceptOutcome: Result of an LLM request intercept that can schedule lifecycle marks.
• LlmStreamCallExecuteParams: Builder parameters for llm_stream_call_execute.

Functions

• llm_call: Start a manual LLM lifecycle span.
• llm_call_end: Finish a manual LLM lifecycle span.
• llm_call_execute: Execute an LLM call through the managed middleware pipeline.
• llm_conditional_execution: Run only the LLM conditional-execution guardrail chain.
• llm_request_intercepts: Run only the LLM request-intercept chain.
• llm_stream_call_execute: Execute a streaming LLM call through the managed middleware pipeline.