OutputRails

class nemo_microservices.types.shared_params.OutputRails

Bases: TypedDict

apply_to_reasoning_traces: bool

If True, output rails will apply guardrails to both reasoning traces and output response. If False, output rails will only apply guardrails to the output response excluding the reasoning traces, thus keeping reasoning traces unaltered.

flows: List[str]

The names of all the flows that implement output rails.

streaming: OutputRailsStreamingConfig

Configuration for managing streaming output of LLM tokens.