nemo_microservices.types.v2.evaluation.evaluation_target_v2_param

Module Contents

Classes

EvaluationTargetV2Param

Data

Dataset
Model

API

nemo_microservices.types.v2.evaluation.evaluation_target_v2_param.Dataset: typing_extensions.TypeAlias

None

class nemo_microservices.types.v2.evaluation.evaluation_target_v2_param.EvaluationTargetV2Param

Bases: typing_extensions.TypedDict

cached_outputs: nemo_microservices.types.cached_outputs_data_param.CachedOutputsDataParam

None

An evaluation target which contains cached outputs.

dataset: nemo_microservices.types.v2.evaluation.evaluation_target_v2_param.Dataset

None

Dataset to be evaluated.

model: nemo_microservices.types.v2.evaluation.evaluation_target_v2_param.Model

None

The model to be evaluated.

rag: nemo_microservices.types.rag_target_param.RagTargetParam

None

RAG to be evaluated.

retriever: nemo_microservices.types.retriever_target_param.RetrieverTargetParam

None

Retriever to be evaluated.

rows: Iterable[Dict[str, object]]

None

Rows to be evaluated.

type: typing_extensions.Required[nemo_microservices.types.target_type.TargetType]

None

The type of the evaluation target, e.g., ‘model’, ‘retriever’, ‘rag’.

nemo_microservices.types.v2.evaluation.evaluation_target_v2_param.Model: typing_extensions.TypeAlias

None