nat.eval.red_teaming_evaluator.register

Classes

RedTeamingEvaluatorConfig

Configuration for red teaming evaluator

Functions

register_red_teaming_evaluator(config, builder)

Register red teaming evaluator

Module Contents

class RedTeamingEvaluatorConfig(/, **data: Any)

Bases: nat.data_models.evaluator.EvaluatorBaseConfig

Configuration for red teaming evaluator

Create a new model by parsing and validating input data from keyword arguments.

Raises [ValidationError][pydantic_core.ValidationError] if the input data cannot be validated to form a valid model.

self is explicitly positional-only to allow self as a field name.

llm_name: nat.data_models.component_ref.LLMRef = None

llm_retry_control_params: dict | None = None

judge_llm_prompt: str = None

filter_conditions: list[nat.eval.red_teaming_evaluator.filter_conditions.IntermediateStepsFilterCondition] = None

reduction_strategy: str = None

scenario_specific_instructions: str | None = None

async register_red_teaming_evaluator(

config: RedTeamingEvaluatorConfig,

builder: nat.builder.builder.EvalBuilder,

)

Register red teaming evaluator