Function llm_stream_call_execute
Function llm_stream_call_execute
Function llm_stream_call_execute
Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.
pub async fn llm_stream_call_execute(
params: LlmStreamCallExecuteParams,
) -> Result<LlmJsonStream>Execute a streaming LLM call through the managed middleware pipeline.
This runs the same pre-execution middleware as llm_call_execute, emits the LLM-start event, and then wraps the provider stream so chunk callbacks and finalization can emit a single LLM-end event when streaming completes.
name: Logical provider or model family name recorded on emitted events.request: Raw LlmRequest passed into the managed pipeline.func: Streaming provider callback or execution continuation.collector: Per-chunk collector callback used to accumulate stream state.finalizer: Finalizer callback used to construct the completed response.parent: Optional explicit parent scope for the emitted LLM span.attributes: LLM attribute bitflags applied to the managed span.data: Optional application payload stored on the managed LLM handle. It may be used on failure end events that have no output payload.metadata: Optional JSON metadata recorded on emitted events.model_name: Optional normalized model name for observability output.codec: Optional request codec used to produce annotated request data for intercepts and events.response_codec: Optional response codec used to attach annotated response data to the end event.A Result containing a boxed stream of JSON chunks.
Returns FlowError::GuardrailRejected when conditional-execution guardrails block the call, or any error raised by request intercepts, execution intercepts, stream callbacks, codecs, or the provider callback.
The LLM-start event is emitted before stream execution intercepts run.
The returned stream emits chunk-level results while the runtime defers the LLM-end event until the collector and finalizer complete.