Important

NeMo 2.0 is an experimental feature and currently released in the dev container only: nvcr.io/nvidia/nemo:dev. Please refer to NeMo 2.0 overview for information on getting started.

NeMo Launcher Tutorial

• NeMo Launcher Tutorial
• Understand the Configurations
  • Overall Hierarchy:
  • Pipeline Configurations
  • Cluster Configurations
  • Environment Variables Configurations
  • NUMA Mapping Configurations
• Launch Experiment with NeMo Launcher
  • Configure and Run a Launcher Pipeline
  • Example: Pre-train Stable Diffusion 860M Model for 10 Epochs with Resolution 256
• Logs and Results
• Launcher Multirun
• Debugging