nat.plugins.eval.tunable_rag_evaluator.register

Classes

TunableRagEvaluatorConfig

Configuration for tunable RAG evaluator

Functions

register_tunable_rag_evaluator(config, builder)

Register tunable RAG evaluator

Module Contents

class TunableRagEvaluatorConfig

Bases: nat.data_models.evaluator.EvaluatorBaseConfig

Configuration for tunable RAG evaluator

llm_name: nat.data_models.component_ref.LLMRef = None

llm_retry_control_params: dict | None = None

judge_llm_prompt: str = None

default_scoring: bool = None

default_score_weights: dict = None

async register_tunable_rag_evaluator(

config: TunableRagEvaluatorConfig,

builder: nat.builder.builder.EvalBuilder,

)

Register tunable RAG evaluator