Important

NeMo 2.0 is an experimental feature and currently released in the dev container only: nvcr.io/nvidia/nemo:dev. Please refer to NeMo 2.0 overview for information on getting started.

Checkpoint Conversion

NVIDIA provides scripts to convert the external Griffin checkpoints Hugging Face format to .nemo format. The .nemo checkpoint will be used for SFT, PEFT.

1. Run the NeMo container.

2. Convert the Hugging Face Gemma model to .nemo model:

python3 /opt/NeMo/scripts/checkpoint_converters/convert_griffin_hf_to_nemo.py \
--input_name_or_path /path/to/griffin/checkpoints/hf/2b \
--output_path /path/to/griffin-2b.nemo