Checkpoint Conversion

User Guide (Latest Version)

NVIDIA provides scripts to convert the external Griffin checkpoints HuggingFace format to .nemo format. The .nemo checkpoint will be used for SFT, PEFT.

Run the NeMo container.

Convert the HuggingFace Gemma model to .nemo model:

Copy
Copied!
            

python3 /opt/NeMo/scripts/checkpoint_converters/convert_griffin_hf_to_nemo.py \ --input_name_or_path /path/to/griffin/checkpoints/hf/2b \ --output_path /path/to/griffin-2b.nemo

Previous Data Preparation for SFT and PEFT
Next Supervised Fine-tuning (SFT)
© | | | | | | |. Last updated on Jun 19, 2024.