nemo_rl.data.datasets.eval_datasets

Submodules

• nemo_rl.data.datasets.eval_datasets.mmlu_pro
• nemo_rl.data.datasets.eval_datasets.mmlu
• nemo_rl.data.datasets.eval_datasets.local_math_dataset
• nemo_rl.data.datasets.eval_datasets.aime
• nemo_rl.data.datasets.eval_datasets.mmau
• nemo_rl.data.datasets.eval_datasets.math
• nemo_rl.data.datasets.eval_datasets.gpqa

Package Contents

Functions

_is_multimodal_dataset	Check if the dataset requires multimodal processing.
load_eval_dataset	Loads evaluation dataset.

Data

MULTIMODAL_DATASETS
__all__

API

nemo_rl.data.datasets.eval_datasets.MULTIMODAL_DATASETS

None

nemo_rl.data.datasets.eval_datasets._is_multimodal_dataset(dataset_name)

Check if the dataset requires multimodal processing.

nemo_rl.data.datasets.eval_datasets.load_eval_dataset(data_config)

Loads evaluation dataset.

nemo_rl.data.datasets.eval_datasets.__all__

[‘AIMEDataset’, ‘GPQADataset’, ‘LocalMathDataset’, ‘MathDataset’, ‘MMAUDataset’, ‘MMLUDataset’, ‘MML…