Important

NeMo 2.0 is an experimental feature and currently released in the dev container only: nvcr.io/nvidia/nemo:dev. Please refer to NeMo 2.0 overview for information on getting started.

NeMo Common Collection API

The common collection contains things that could be used across all collections.

• Callbacks
  • Exponential Moving Average (EMA)
• Losses
  • AggregatorLoss
    • __init__()
  • CrossEntropyLoss
    • __init__()
  • MSELoss
    • __init__()
  • SmoothedCrossEntropyLoss
    • __init__()
  • SpanningLoss
    • __init__()
• Metrics
  • Perplexity
    • compute()
    • full_state_update
    • update()
• Tokenizers
  • AutoTokenizer
    • __init__()
  • SentencePieceTokenizer
    • __init__()
  • TokenizerSpec
    • __init__()
• Data
  • ConcatDataset
    • get_iterable()
    • random_generator()
    • round_robin_generator()
    • temperature_generator()
  • ConcatMapDataset
• S3 Checkpointing
  • S3CheckpointIO
  • S3Utils and Dependencies
  • s3_dirpath_utils
  • S3 Demands and ExpManager Details When Running at Scale