ReferenceAPIsRust Library Referencenemo-relayapiregistry

Function register_llm_execution_intercept

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

pub fn register_llm_execution_intercept(
    name: &str,
    priority: i32,
    callable: LlmExecutionFn,
) -> Result<()>

Register a global LLM execution intercept. Execution intercepts can wrap or replace the non-streaming provider callback.

Parameters

  • name: Unique middleware name in the global registry.
  • priority: Lower values run earlier in the chain.
  • callable: Execution intercept callback stored under name.

Returns

A Result that is Ok(()) when the intercept was registered.

Errors

Returns FlowError::AlreadyExists when the name is already in use or an internal error if the runtime state cannot be updated.