Important

NeMo 2.0 is an experimental feature and currently released in the dev container only: nvcr.io/nvidia/nemo:dev. Please refer to the Migration Guide for information on getting started.

Design Guide

Compared to NeMo 1.0, NeMo 2.0 provides a more modular and Pythonic approach to configuring experiments. The following guide provides an overview of some of the noteworthy features provided in NeMo 2.0.

• The Bridge Between Lightning and Megatron Core
• Logging and Checkpointing
• Serialization
• Parameter Efficient Fine-Tuning (PEFT)
• Hugging Face Integration