aiq.eval.tunable_rag_evaluator.register

Classes

TunableRagEvaluatorConfig

Configuration for tunable RAG evaluator

Functions

register_tunable_rag_evaluator(config, builder)

Register tunable RAG evaluator

Module Contents

class TunableRagEvaluatorConfig(/, **data: Any)

Bases: aiq.data_models.evaluator.EvaluatorBaseConfig

Configuration for tunable RAG evaluator

Create a new model by parsing and validating input data from keyword arguments.

Raises [ValidationError][pydantic_core.ValidationError] if the input data cannot be validated to form a valid model.

self is explicitly positional-only to allow self as a field name.

llm_name: aiq.data_models.component_ref.LLMRef = None

judge_llm_prompt: str = None

default_scoring: bool = None

default_score_weights: dict = None

async register_tunable_rag_evaluator(

config: TunableRagEvaluatorConfig,

builder: aiq.builder.builder.EvalBuilder,

)

Register tunable RAG evaluator