ReferenceAPIsRust Library Referencenemo-relay-worker

Struct LlmStream Next

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

1pub struct LlmStreamNext { /* private fields */ }

Continuation handle for LLM stream execution intercepts.

Implementations

impl LlmStreamNext

impl LlmStreamNext

call

pub async fn call(&self, request: LlmRequest) -> Result<JsonStream>

Calls the remaining LLM streaming execution chain.

Calls may be repeated or concurrent while the owning interceptor stream is active. Each call receives an isolated snapshot of the scope stack visible here. A returned downstream stream has its ordinary lifetime, but unfinished calls are cancelled when the interceptor stream closes.

Trait Implementations

impl Clone for LlmStreamNext

impl Clone for LlmStreamNext

clone

fn clone(&self) -> LlmStreamNext

clone_from

fn clone_from(&mut self, source: &Self)