Common Collection ================= The common collection contains things that could be used across all collections. Tokenizers ---------- .. automodule:: nemo.collections.common.tokenizers.AutoTokenizer :special-members: __init__ .. automodule:: nemo.collections.common.tokenizers.SentencePieceTokenizer :special-members: __init__ .. automodule:: nemo.collections.common.tokenizers.TokenizerSpec :special-members: __init__ Losses ------ .. automodule:: nemo.collections.common.losses.AggregatorLoss :special-members: __init__ .. automodule:: nemo.collections.common.losses.CrossEntropyLoss :special-members: __init__ .. automodule:: nemo.collections.common.losses.MSELoss :special-members: __init__ .. automodule:: nemo.collections.common.losses.SmoothedCrossEntropyLoss :special-members: __init__ .. automodule:: nemo.collections.common.losses.SpanningLoss :special-members: __init__ Metrics ------- .. autoclass:: nemo.collections.common.metrics.Perplexity :show-inheritance: :members: :undoc-members: