ReferenceAPIsRust Library Referencenemo-relayapiregistry

Function register_llm_request_intercept

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

pub fn register_llm_request_intercept(
    name: &str,
    priority: i32,
    break_chain: bool,
    callable: LlmRequestInterceptFn,
) -> Result<()>

Register a global LLM request intercept. Request intercepts can rewrite or annotate the outgoing LLM request.

Parameters

  • name: Unique middleware name in the global registry.
  • priority: Lower values run earlier in the chain.
  • break_chain: Whether the intercept should stop later request intercepts after it returns.
  • callable: Intercept callback stored under name.

Returns

A Result that is Ok(()) when the intercept was registered.

Errors

Returns FlowError::AlreadyExists when the name is already in use or an internal error if the runtime state cannot be updated.