Struct LlmStream Call Execute Params
Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.
pub struct LlmStreamCallExecuteParams {
pub name: String,
pub request: LlmRequest,
pub func: LlmStreamExecutionNextFn,
pub collector: LlmCollectorFn,
pub finalizer: LlmFinalizerFn,
pub parent: Option<ScopeHandle>,
pub attributes: LlmAttributes,
pub data: Option<Json>,
pub metadata: Option<Json>,
pub model_name: Option<String>,
pub codec: Option<Arc<dyn LlmCodec>>,
pub response_codec: Option<Arc<dyn LlmResponseCodec>>,
}
Builder parameters for llm_stream_call_execute.
Fields
name: String
Logical provider or model family name recorded on emitted events.
request: LlmRequest
Raw request passed into the managed pipeline.
func: LlmStreamExecutionNextFn
Streaming provider callback or execution continuation.
collector: LlmCollectorFn
Per-chunk collector callback used to accumulate stream state.
finalizer: LlmFinalizerFn
Finalizer callback used to construct the completed response.
parent: Option<ScopeHandle>
Optional explicit parent scope for the emitted LLM span.
attributes: LlmAttributes
LLM attribute bitflags applied to the managed span.
data: Option<Json>
Optional application payload stored on the handle but not emitted as Agent Trajectory Observability Format (ATOF) data.
metadata: Option<Json>
Optional JSON metadata recorded on emitted events.
model_name: Option<String>
Optional normalized model name for observability output.
codec: Option<Arc<dyn LlmCodec>>
Optional request codec used to produce annotated request data.
response_codec: Option<Arc<dyn LlmResponseCodec>>
Optional response codec used to attach annotated response data.
Implementations
impl LlmStreamCallExecuteParams
impl LlmStreamCallExecuteParams
builder
pub fn builder() -> LlmStreamCallExecuteParamsBuilder<((), (), (), (), (), (), (), (), (), (), (), ())>
Create a builder for building LlmStreamCallExecuteParams. On the builder, call .name(...), .request(...), .func(...), .collector(...), .finalizer(...), .parent(...)(optional), .attributes(...)(optional), .data(...)(optional), .metadata(...)(optional), .model_name(...)(optional), .codec(...)(optional), .response_codec(...)(optional) to set the values of the fields. Finally, call .build() to create the instance of LlmStreamCallExecuteParams.