ReferenceAPIsRust Library Referencenemo-relayapiregistry

Function register_llm_request_intercept

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub fn register_llm_request_intercept(
    name: &str,
    priority: i32,
    break_chain: bool,
    callable: LlmRequestInterceptFn,
) -> Result<()>

Register a global LLM request intercept. Request intercepts can rewrite or annotate the outgoing LLM request and schedule lifecycle marks for the resulting LLM scope.

Parameters

  • name: Unique middleware name in the global registry.
  • priority: Lower values run earlier in the chain.
  • break_chain: Whether the intercept should stop later request intercepts after it returns.
  • callable: Intercept callback stored under name.

Returns

A Result that is Ok(()) when the intercept was registered.

Errors

Returns FlowError::AlreadyExists when the name is already in use or an internal error if the runtime state cannot be updated.