Important

You are viewing the NeMo 2.0 documentation. This release introduces significant changes to the API and a new library, NeMo Run. We are currently porting all features from NeMo 1.0 to 2.0. For documentation on previous versions or features not yet available in 2.0, please refer to the NeMo 24.07 documentation.

SFT and PEFT Examples

We offer many examples that show how to run Supervised Fine-Tuning (SFT) and Parameter-Efficient Fine-Tuning (PEFT) methods across a variety of models presented in the form of playbooks or NeMo Framework Launcher commands.

Most of the PEFT examples use LoRA since it is the most common PEFT method. However, you can easily switch to other PEFT methods by modifying model.peft.peft_scheme to ptuning, ia3, or adapter. You can also switch to SFT by setting model.peft.peft_scheme to null (along with other changes such as learning rate, if applicable).

For QLoRA, please refer to the NeMo QLoRA Guide.

Nemotron

• PEFT Playbook

• PEFT Launcher Command

• SFT Playbook

Gemma and CodeGemma

• PEFT Playbook and Launcher Comamnd

• SFT Playbook and Launcher Comamnd

Starcoder2

• PEFT Playbook and Launcher Comamnd

• SFT Playbook and Launcher Comamnd

Mistral

• PEFT Playbook

• PEFT Launcher Command

• SFT Playbook

Mixtral

• PEFT Playbook

• PEFT Launcher Command

• SFT Playbook

Llama

• PEFT Playbook

• PEFT Launcher Command

• SFT Playbook

Falcon

• PEFT Launcher Command

Baichuan2

• PEFT Launcher Command

T5

• PEFT Launcher Command

• SFT Launcher Command