Important

NeMo 2.0 is an experimental feature and currently released in the dev container only: nvcr.io/nvidia/nemo:dev. Please refer to NeMo 2.0 overview for information on getting started.

Feature Guide

Compared to NeMo 1.0, NeMo 2.0 provides a more modular and Pythonic approach to configuring experiments. The following guide provides an overview of some of the noteworthy features provided in NeMo 2.0.

• The Bridge Between Lightning and Megatron Core
• Logging and Checkpointing
• Serialization
• Parameter Efficient Fine-Tuning (PEFT)
• Hugging Face Integration