Module llm
Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.
LLM DTOs and attributes. Shared LLM data types.
Structs
- LlmAttributes: Bitflags that modify LLM-call behavior and observability.
- LlmRequest: JSON-shaped LLM request payload passed through the runtime.
- LlmRequestInterceptOutcome: Result of an LLM request intercept that can schedule lifecycle marks.