NeMo Common Collection API#
The common collection contains things that could be used across all collections.
- Callbacks
- Losses
- Metrics
- Tokenizers
AutoTokenizer__init__()add_special_tokens()additional_special_tokens_idsapply_chat_template()bos_idcls_ideodeos_idids_to_text()ids_to_tokens()inv_vocabmask_idnamepad_idsave_pretrained()save_vocabulary()sep_idtext_to_ids()text_to_tokens()token_to_id()tokens_to_ids()tokens_to_text()unk_idvocabvocab_size
SentencePieceTokenizerTokenizerSpec
- Data
- S3 Checkpointing