nemo_rl.data.eval_datasets.gpqa#

GPQA dataset and its variants.

Module Contents#

Classes#

GPQADataset

API#

class nemo_rl.data.eval_datasets.gpqa.GPQADataset(
variant: Literal[diamond, main] = 'diamond',
prompt_file: Optional[str] = None,
system_prompt_file: Optional[str] = None,
)[source]#

Initialization

_rekey(data: dict[str, Any])[source]#