Important

NeMo 2.0 is an experimental feature and currently released in the dev container only: nvcr.io/nvidia/nemo:dev. Please refer to NeMo 2.0 overview for information on getting started.

Common

The NVIDIA NeMo Framework provides a suite of model-agnostic tools to assist with the following tasks:

• Preparing your environment to get started with the NVIDIA NeMo™ Framework

• Preparing your data

• Logging

• Using the Auto Configurator

• Resuming training

• Deploy NeMo Large Language Models

The following sections provide detailed information for each of the tasks:

• Prepare Environment
• Data Preparation
• Monitoring and Logging
• Auto Configurator
• Resuming Training with a Different Number of Nodes
• Continual Learning with Pretrained Checkpoints
• Deploy NeMo Large Language Models