aiq.eval.trajectory_evaluator.evaluate#
Attributes#
Classes#
Module Contents#
- logger#
- class TrajectoryEvaluator(
- llm: langchain_core.language_models.BaseChatModel,
- tools: list[langchain_core.tools.BaseTool] | None = None,
- max_concurrency: int = 8,
- llm#
- tools = None#
- max_concurrency = 8#
- semaphore#
- traj_eval_chain#
- async evaluate(
- eval_input: aiq.eval.evaluator.evaluator_model.EvalInput,
Evaluates the agent trajectories using trajectory evaluation chain.