> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/curator/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/curator/_mcp/server.

# Text Curation Concepts

> Essential concepts for text data curation including loading and processing.

This document covers the essential concepts for text data curation in NVIDIA NeMo Curator. These concepts assume basic familiarity with data science and machine learning principles.

## Core Concept Areas

Text curation in NeMo Curator focuses on these key areas:

#### [Text Curation Pipeline](/about/concepts/text/data/data-curation-pipeline)

Comprehensive overview of the end-to-end text curation architecture and workflow

#### [Data Loading](/about/concepts/text/data/loading)

Core concepts for loading and managing text datasets from local files

#### [Data Acquisition](/about/concepts/text/data/acquisition)

Components for downloading and extracting data from remote sources

#### [Data Processing](/about/concepts/text/data/processing)

Concepts for filtering, deduplication, and classification

## Infrastructure Components

The text curation concepts build on NVIDIA NeMo Curator's core infrastructure components, which are shared across all modalities. These components include:

#### [Memory Management](/reference/infra/memory-management)

Optimize memory usage when processing large datasets

#### [GPU Acceleration](/reference/infra/gpu-processing)

Leverage NVIDIA GPUs for faster data processing

#### [Resumable Processing](/reference/infra/resumable-processing)

Continue interrupted operations across large datasets