Struct LlmStream Next

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

1
pub struct LlmStreamNext<'a> { /* private fields */ }

Typed continuation passed to LLM stream execution intercepts.

Implementations

impl LlmStreamNext<'_>

impl LlmStreamNext<'_>

call

pub fn call(&self, request: LlmRequest) -> Result<LlmStream>

Continues the LLM stream execution chain with a replacement request.