Struct LlmStream Next
Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.
Continuation handle for LLM stream execution intercepts.
Implementations
impl LlmStreamNext
impl LlmStreamNext
call
pub async fn call(&self, request: LlmRequest) -> Result<JsonStream>
Calls the remaining LLM streaming execution chain.
Trait Implementations
impl Clone for LlmStreamNext
impl Clone for LlmStreamNext
clone
fn clone(&self) -> LlmStreamNext
clone_from
fn clone_from(&mut self, source: &Self)