Checkpoint Conversion
NVIDIA provides scripts to convert the external Griffin checkpoints HuggingFace format to .nemo
format. The .nemo
checkpoint will be used for SFT, PEFT.
Run the NeMo container.
Convert the HuggingFace Gemma model to .nemo model:
python3 /opt/NeMo/scripts/checkpoint_converters/convert_griffin_hf_to_nemo.py \
--input_name_or_path /path/to/griffin/checkpoints/hf/2b \
--output_path /path/to/griffin-2b.nemo