Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.
Process-global runtime state backing middleware and event emission.
The public API layer stores one shared instance of this type for the process. It contains global middleware registries, lifecycle subscribers, and arbitrary extension slots used by bindings or integrations.
impl NemoRelayContextStateimpl NemoRelayContextStatenewpub fn new() -> SelfCreate an empty runtime state with no registered middleware.
A NemoRelayContextState with empty registries, no subscribers, and no extensions.
set_extensionpub fn set_extension<T: Any + Send + Sync>(
&mut self,
key: impl Into<String>,
value: T,
)Store an arbitrary runtime extension under key.
Extensions let bindings or integrations attach shared state to the process-global runtime without adding new first-class fields.
key: Stable identifier for the extension slot.value: Typed extension value to store.get_extensionpub fn get_extension<T: Any + Send + Sync>(&self, key: &str) -> Option<&T>Borrow a typed runtime extension by key.
key: Extension slot name.Some(&T) when an extension exists under key with the requested type and None otherwise.
get_extension_mutpub fn get_extension_mut<T: Any + Send + Sync>(
&mut self,
key: &str,
) -> Option<&mut T>Mutably borrow a typed runtime extension by key.
key: Extension slot name.Some(&mut T) when an extension exists under key with the requested type and None otherwise.
remove_extensionpub fn remove_extension(&mut self, key: &str) -> boolRemove a runtime extension by key.
key: Extension slot name.true when an extension was removed and false when no extension was stored under key.
create_eventpub fn create_event(&self, params: MarkEvent) -> EventBuild a standalone mark event.
A mark Event containing the provided MarkEvent.
create_scope_handlepub fn create_scope_handle(
&self,
params: CreateScopeHandleParams<'_>,
) -> ScopeHandleCreate a new scope handle.
name: Human-readable scope name.parent_uuid: Optional parent scope UUID.scope_type: Semantic category of the scope.attributes: Scope attribute bitflags.data: Optional application payload stored on the handle.metadata: Optional metadata stored on the handle.timestamp: Optional handle start time. When omitted, the current UTC time is used.A new ScopeHandle with a fresh UUID.
build_scope_start_eventpub fn build_scope_start_event(
&self,
handle: &ScopeHandle,
data: Option<Json>,
) -> EventBuild a scope-start event from a handle.
handle: Scope handle to serialize into an event.data: Optional semantic input payload exported on the start event.A scope-start Event derived from the provided handle.
end_scope_handlepub fn end_scope_handle(
&self,
handle: &ScopeHandle,
data: Option<Json>,
) -> EventBuild a scope-end event from a handle.
handle: Scope handle to serialize into an event.data: Optional data payload returned from the scope.A scope-end Event derived from the provided handle.
build_scope_end_eventpub fn build_scope_end_event(&self, params: EndScopeHandleParams<'_>) -> EventBuild a scope-end event from builder parameters.
params: Scope end-event builder parameters.A scope-end Event derived from the provided parameters.
create_tool_handlepub fn create_tool_handle(
&self,
params: CreateToolHandleParams<'_>,
) -> ToolHandleCreate a new tool handle.
name: Tool name recorded on emitted events.parent_uuid: Optional parent scope UUID.attributes: Tool attribute bitflags.data: Optional application payload stored on the handle.metadata: Optional metadata stored on the handle.tool_call_id: Optional provider-specific correlation identifier.timestamp: Optional handle start time. When omitted, the current UTC time is used.A new ToolHandle with a fresh UUID.
build_tool_start_eventpub fn build_tool_start_event(
&self,
handle: &ToolHandle,
data: Option<Json>,
) -> EventBuild a tool-start event from a handle.
handle: Tool handle to serialize into an event.data: Optional tool input payload.A tool-start Event derived from the provided handle.
end_tool_handlepub fn end_tool_handle(
&self,
handle: &ToolHandle,
data: Option<Json>,
metadata: Option<Json>,
) -> EventBuild a tool-end event from a handle and optional overrides.
handle: Tool handle to serialize into an event.data: Optional end-event data payload.metadata: Optional metadata payload merged over handle.metadata.A tool-end Event derived from the provided handle.
build_tool_end_eventpub fn build_tool_end_event(&self, params: EndToolHandleParams<'_>) -> EventBuild a tool-end event from builder parameters.
The metadata payload is merged over the metadata already stored on the handle.
params: Tool end-event builder parameters.A tool-end Event derived from the provided parameters.
create_llm_handlepub fn create_llm_handle(&self, params: CreateLlmHandleParams<'_>) -> LlmHandleCreate a new LLM handle.
name: Logical provider or model family name.parent_uuid: Optional parent scope UUID.attributes: LLM attribute bitflags.data: Optional application payload stored on the handle.metadata: Optional metadata stored on the handle.model_name: Optional normalized model name stored on the handle.timestamp: Optional handle start time. When omitted, the current UTC time is used.A new LlmHandle with a fresh UUID.
build_llm_start_eventpub fn build_llm_start_event(
&self,
handle: &LlmHandle,
data: Option<Json>,
annotated_request: Option<Arc<AnnotatedLlmRequest>>,
) -> EventBuild an LLM-start event from a handle.
handle: LLM handle to serialize into an event.data: Sanitized LLM request payload.annotated_request: Optional normalized request annotation.An LLM-start Event derived from the provided handle.
end_llm_handlepub fn end_llm_handle(
&self,
handle: &LlmHandle,
data: Option<Json>,
metadata: Option<Json>,
annotated_response: Option<Arc<AnnotatedLlmResponse>>,
) -> EventBuild an LLM-end event from a handle and optional overrides.
handle: LLM handle to serialize into an event.data: Sanitized LLM response payload.metadata: Optional metadata payload merged over handle.metadata.annotated_response: Optional normalized response annotation.An LLM-end Event derived from the provided handle.
build_llm_end_eventpub fn build_llm_end_event(&self, params: EndLlmHandleParams<'_>) -> EventBuild an LLM-end event from builder parameters.
The metadata payload is merged over the metadata already stored on the handle.
params: LLM end-event builder parameters.An LLM-end Event derived from the provided parameters.
impl Default for NemoRelayContextStateimpl Default for NemoRelayContextStatedefaultfn default() -> Self