nemo_rl.data.hf_datasets.tulu3

Module Contents

Classes

Tulu3PreferenceDataset

Tulu3 preference dataset for DPO training.

Functions

format_tulu3_preference

API

nemo_rl.data.hf_datasets.tulu3.format_tulu3_preference(

data: dict[str, Any],

) → dict[str, str | dict[str, str]]

class nemo_rl.data.hf_datasets.tulu3.Tulu3PreferenceDataset

Tulu3 preference dataset for DPO training.

Initialization