Audio Curation Concepts#

This guide covers the essential concepts for audio data curation in NVIDIA NeMo Curator. These concepts assume basic familiarity with speech processing and machine learning principles.

Core Concept Areas#

Audio curation in NVIDIA NeMo Curator focuses on these key areas:

Audio Curation Pipeline

Modality-level overview of ingest, validation, optional ASR, metrics, filtering, and export

Audio Curation Pipeline (Overview)
ASR Pipeline

Comprehensive overview of the automatic speech recognition pipeline and workflow

ASR Pipeline Architecture
Quality Metrics

Core concepts for evaluating speech transcription quality and audio characteristics

Audio Quality Metrics
AudioBatch Structure

Understanding the AudioBatch data structure and audio file management

AudioBatch Data Structure
Dataset Manifests and Ingest

Concepts for constructing manifests and ingesting audio datasets

Dataset Manifests and Ingest
Text Integration

Concepts for integrating audio processing with text curation workflows

Audio-Text Integration Concepts

Infrastructure Components#

The audio curation concepts build on NVIDIA NeMo Curator’s core infrastructure components, which are shared across all modalities. These components include:

Memory Management

Optimize memory usage when processing large audio datasets

Memory Management Guide
GPU Acceleration

Leverage NVIDIA GPUs for faster ASR inference and audio processing

GPU Processing Guide
Resumable Processing

Continue interrupted operations across large audio datasets

Resumable Processing