nat.cli.commands.red_teaming.red_teaming

Red teaming CLI command.

Attributes

logger

Functions

red_team_command(→ None)	Run red teaming evaluation with multiple scenarios.
process_red_team_eval(processors, *, red_team_config, ...)	Process the red team eval command and execute the evaluation.

Module Contents

logger

red_team_command(ctx, \*\*kwargs) → None

Run red teaming evaluation with multiple scenarios.

process_red_team_eval(

processors,

*,

red_team_config: pathlib.Path | None,

config_file: pathlib.Path | None,

dataset: pathlib.Path | None,

result_json_path: str,

endpoint: str | None,

endpoint_timeout: int,

reps: int,

override: tuple[tuple[str, str], Ellipsis],

)

Process the red team eval command and execute the evaluation.