Struct LlmStream Next

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

1pub struct LlmStreamNext(/* private fields */);

Cloneable asynchronous LLM stream continuation.

Implementations

impl LlmStreamNext

impl LlmStreamNext

call

pub async fn call(&self, request: LlmRequest) -> Result<LlmJsonAsyncStream>

Opens an independent pull-based downstream stream.

Trait Implementations

impl Clone for LlmStreamNext

impl Clone for LlmStreamNext

clone

fn clone(&self) -> LlmStreamNext

clone_from

fn clone_from(&mut self, source: &Self)