API Reference | NeMo Curator

This section provides API reference documentation for NeMo Curator’s core classes and interfaces.

Core Classes

The main orchestrator for executing sequences of processing stages.

Base class for all data processing stages in NeMo Curator.

High-level stages that decompose into multiple execution stages.

Task type for text document processing.

Task type for image processing.

Task type for video processing.

Task type for audio processing.

Production executor using Cosmos-Xenna for distributed execution.

Ray Data and Ray Actor Pool executors, and how to choose between them.

CPU and GPU resource configuration for stages.

For complete implementation details, see the NeMo Curator source code on GitHub.