Struct LlmOptimization Recorder

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

1pub struct LlmOptimizationRecorder { /* private fields */ }

Cloneable capability for adding evidence to the current managed LLM call.

A streaming execution intercept may capture this value before returning its stream and use it when the route is committed by the first upstream item.

Implementations

impl LlmOptimizationRecorder

impl LlmOptimizationRecorder

record

pub fn record(&self, contribution: LlmOptimizationContribution) -> bool

Record one contribution without blocking on I/O or exporter delivery.

Returns false when the contribution is rejected by a payload/schema invariant, a per-call bound, or because accounting has already closed. Rejection never affects LLM execution and does not consume a sequence.

Trait Implementations

impl Clone for LlmOptimizationRecorder

impl Clone for LlmOptimizationRecorder

clone

fn clone(&self) -> LlmOptimizationRecorder

clone_from

fn clone_from(&mut self, source: &Self)

impl Debug for LlmOptimizationRecorder

impl Debug for LlmOptimizationRecorder

fmt

fn fmt(&self, f: &mut Formatter<'_>) -> Result

impl Default for LlmOptimizationRecorder

impl Default for LlmOptimizationRecorder

default

fn default() -> LlmOptimizationRecorder