NeMo Common Collection API# The common collection contains things that could be used across all collections. Callbacks Exponential Moving Average (EMA) Losses AggregatorLoss __init__() CrossEntropyLoss __init__() MSELoss __init__() SmoothedCrossEntropyLoss __init__() SpanningLoss __init__() Metrics Perplexity compute() full_state_update update() Tokenizers AutoTokenizer __init__() SentencePieceTokenizer __init__() TokenizerSpec __init__() Data ConcatDataset get_iterable() random_generator() round_robin_generator() temperature_generator() ConcatMapDataset S3 Checkpointing S3CheckpointIO S3Utils and Dependencies s3_dirpath_utils S3 Demands and ExpManager Details When Running at Scale
