Struct LlmStream Call Execute Params

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

pub struct LlmStreamCallExecuteParams {
    pub name: String,
    pub request: LlmRequest,
    pub func: LlmStreamExecutionNextFn,
    pub collector: LlmCollectorFn,
    pub finalizer: LlmFinalizerFn,
    pub parent: Option<ScopeHandle>,
    pub attributes: LlmAttributes,
    pub data: Option<Json>,
    pub metadata: Option<Json>,
    pub model_name: Option<String>,
    pub codec: Option<Arc<dyn LlmCodec>>,
    pub response_codec: Option<Arc<dyn LlmResponseCodec>>,
}

Builder parameters for llm_stream_call_execute.

Fields

name: String

Logical provider or model family name recorded on emitted events.

request: LlmRequest

Raw request passed into the managed pipeline.

func: LlmStreamExecutionNextFn

Streaming provider callback or execution continuation.

collector: LlmCollectorFn

Per-chunk collector callback used to accumulate stream state.

finalizer: LlmFinalizerFn

Finalizer callback used to construct the completed response.

parent: Option<ScopeHandle>

Optional explicit parent scope for the emitted LLM span.

attributes: LlmAttributes

LLM attribute bitflags applied to the managed span.

data: Option<Json>

Optional application payload stored on the handle but not emitted as Agent Trajectory Observability Format (ATOF) data.

metadata: Option<Json>

Optional JSON metadata recorded on emitted events.

model_name: Option<String>

Optional normalized model name for observability output.

codec: Option<Arc<dyn LlmCodec>>

Optional request codec used to produce annotated request data.

response_codec: Option<Arc<dyn LlmResponseCodec>>

Optional response codec used to attach annotated response data.

Implementations

impl LlmStreamCallExecuteParams

impl LlmStreamCallExecuteParams

builder

pub fn builder() -> LlmStreamCallExecuteParamsBuilder<((), (), (), (), (), (), (), (), (), (), (), ())>

Create a builder for building LlmStreamCallExecuteParams. On the builder, call .name(...), .request(...), .func(...), .collector(...), .finalizer(...), .parent(...)(optional), .attributes(...)(optional), .data(...)(optional), .metadata(...)(optional), .model_name(...)(optional), .codec(...)(optional), .response_codec(...)(optional) to set the values of the fields. Finally, call .build() to create the instance of LlmStreamCallExecuteParams.