Overview
Why NeMo Framework?
Software Component Versions
Getting Started
Playbooks
Cloud Service Providers
SFT and PEFT
RAG
Large Language Models
All Models
Llama and CodeLlama
Gemma and CodeGemma
Griffin (Recurrent Gemma)
Data Preparation for SFT and PEFT
Checkpoint Conversion
Supervised Fine-tuning (SFT)
Parameter Efficient Fine-Tuning (PEFT)
Baichuan 2
Falcon
Mistral
Mixtral
Nemotron
StarCoder2
T5
mT5
GPT
BERT
ChatGLM
RETRO
Embedding Models
Multimodal Models
Speech AI Models
Deploy NeMo Framework Models
Library Documentation
Example Scripts for Pretraining and Fine-tuning
Changelog
Known Issues
NVIDIA NeMo Framework User Guide
»
Large Language Models
»
Griffin (Recurrent Gemma)
»
Data Preparation for SFT and PEFT
Data Preparation for SFT and PEFT
Please refer to Gemma’s data preparation tab.