nat.plugins.eval.red_teaming_evaluator.register

Classes

RedTeamingEvaluatorConfig

Configuration for red teaming evaluator

Functions

register_red_teaming_evaluator(config, builder)

Register red teaming evaluator

Module Contents

class RedTeamingEvaluatorConfig

Bases: nat.data_models.evaluator.EvaluatorBaseConfig

Configuration for red teaming evaluator

llm_name: nat.data_models.component_ref.LLMRef = None

llm_retry_control_params: dict | None = None

judge_llm_prompt: str = None

intermediate_step_filters: list[nat.plugins.eval.red_teaming_evaluator.filter_conditions.IntermediateStepsFilterCondition] = None

reduction_strategy: str = None

scenario_specific_instructions: str | None = None

async register_red_teaming_evaluator(

config: RedTeamingEvaluatorConfig,

builder: nat.builder.builder.EvalBuilder,

)

Register red teaming evaluator