Text Curation Tutorials

Hands-on tutorials for text curation workflows are available in the tutorials/text directory of the NeMo Curator GitHub repository.

Key Concepts for Tutorial Success

Before diving into the tutorials, familiarize yourself with these essential NeMo Curator concepts:

Core processing stages and pipeline concepts for text curation workflows data-structures distributed

Scoring and filtering techniques used in tutorials heuristics classifiers

Loading data from various sources common-crawl custom-data

GPU-accelerated classification concepts gpu scalable