Important

NeMo 2.0 is an experimental feature and currently released in the dev container only: nvcr.io/nvidia/nemo:dev. Please refer to NeMo 2.0 overview for information on getting started.

SentencePiece Tokenizer

NeMo Framework supports SentencePiece tokenizer usage for training LLMs. For more information about SentencePiece, please visit this page.

• Installation
• Training
• NeMo Usage