PEFT Examples

We have many examples to demonstrate how to run PEFT with a variety of models in the forms of playbooks or Nemo launcher commands.

Most of the examples use LoRA since it is the most common PEFT method. However, you can easily switch to other PEFT methods by modifying model.peft.peft_scheme to ptuning, ia3, or adapter.

Previous Supported PEFT methods
Next Large Language Models
© Copyright 2023-2024, NVIDIA. Last updated on Apr 22, 2024.