Struct LlmNext

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

1
pub struct LlmNext { /* private fields */ }

Continuation handle for LLM execution intercepts.

Implementations

impl LlmNext

impl LlmNext

call

pub async fn call(&self, request: LlmRequest) -> Result<Json>

Calls the remaining LLM execution chain.

Calls may be repeated or concurrent while the owning interceptor is active. Each call receives an isolated snapshot of the scope stack visible here. Calls still unfinished when the interceptor settles fail.

Trait Implementations

impl Clone for LlmNext

impl Clone for LlmNext

clone

fn clone(&self) -> LlmNext

clone_from

fn clone_from(&mut self, source: &Self)