Important

NeMo 2.0 is an experimental feature and currently released in the dev container only: nvcr.io/nvidia/nemo:dev. Please refer to the Migration Guide for information on getting started.

Data Preparation for SFT

For details on data preparation with Mamba, refer to the documentation on Data Preparation for SFT and PEFT.