Important

NeMo 2.0 is an experimental feature and currently released in the dev container only: nvcr.io/nvidia/nemo:dev. Please refer to the Migration Guide for information on getting started.

NeMo Common Collection API

The common collection contains things that could be used across all collections.

• Callbacks
  • Exponential Moving Average (EMA)
• Losses
• Metrics
• Tokenizers
• Data
• S3 Checkpointing
  • S3CheckpointIO
  • S3Utils and Dependencies
  • s3_dirpath_utils
  • S3 Demands and ExpManager Details When Running at Scale