Important
NeMo 2.0 is an experimental feature and currently released in the dev container only: nvcr.io/nvidia/nemo:dev. Please refer to NeMo 2.0 overview for information on getting started.
SentencePiece Tokenizer#
NeMo Framework supports SentencePiece tokenizer usage for training LLMs. For more information about SentencePiece, please visit this page.