aiq.eval.trajectory_evaluator.register

Classes

TrajectoryEvaluatorConfig

Agent Trajectory Evaluation.

Functions

register_trajectory_evaluator(config, builder)

Module Contents

class TrajectoryEvaluatorConfig(/, **data: Any)

Bases: aiq.data_models.evaluator.EvaluatorBaseConfig

Agent Trajectory Evaluation.

Create a new model by parsing and validating input data from keyword arguments.

Raises [ValidationError][pydantic_core.ValidationError] if the input data cannot be validated to form a valid model.

self is explicitly positional-only to allow self as a field name.

llm_name: str = None

async register_trajectory_evaluator(

config: TrajectoryEvaluatorConfig,

builder: aiq.builder.builder.EvalBuilder,

)