> For clean Markdown of any page, append .md to the page URL. > For a complete documentation index, see https://docs.nvidia.com/nemo/curator/v26.04/curate-video/llms.txt. > For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/curator/_mcp/server. # Curate Video ## Docs - [Overview](https://docs.nvidia.com/nemo/curator/v26.04/curate-video/tutorials.md): Collection of tutorials for video curation workflows including beginner guides and advanced pipeline customization techniques - [Beginner Tutorial](https://docs.nvidia.com/nemo/curator/v26.04/curate-video/tutorials/beginner.md): Beginner-friendly tutorial for running your first Ray-based video splitting pipeline using the Python example - [Split and Dedup](https://docs.nvidia.com/nemo/curator/v26.04/curate-video/tutorials/split-dedup.md): End-to-end workflow tutorial covering the video curation process from splitting through semantic deduplication (Ray/Python) - [Overview](https://docs.nvidia.com/nemo/curator/v26.04/curate-video/tutorials/pipeline-customization.md): Advanced tutorials for customizing NeMo Curator video pipelines including adding custom code, models, stages, and environments - [Add Custom Environment](https://docs.nvidia.com/nemo/curator/v26.04/curate-video/tutorials/pipeline-customization/add-cust-env.md): Guide to creating and managing custom Docker environments for specialized video curation pipeline requirements - [Add Custom Code](https://docs.nvidia.com/nemo/curator/v26.04/curate-video/tutorials/pipeline-customization/add-cust-code.md): Tutorial for adding custom code to video curation pipelines for specialized processing requirements - [Add Custom Model](https://docs.nvidia.com/nemo/curator/v26.04/curate-video/tutorials/pipeline-customization/add-cust-model.md): Tutorial for integrating custom models into video curation pipelines for specialized captioning, embedding, or filtering tasks - [Add Custom Stage](https://docs.nvidia.com/nemo/curator/v26.04/curate-video/tutorials/pipeline-customization/add-cust-stage.md): Advanced tutorial for adding custom processing stages to video curation pipelines for specialized workflow requirements - [Load Data](https://docs.nvidia.com/nemo/curator/v26.04/curate-video/load-data.md): Load video data into NeMo Curator from local paths or fsspec-supported storage, including explicit file list support - [Overview](https://docs.nvidia.com/nemo/curator/v26.04/curate-video/process-data.md): Process video data by splitting into clips, encoding, generating embeddings and captions, and removing duplicates - [Clipping](https://docs.nvidia.com/nemo/curator/v26.04/curate-video/process-data/clipping.md): Split videos into clips using fixed stride or TransNetV2 scene-change detection - [Transcoding](https://docs.nvidia.com/nemo/curator/v26.04/curate-video/process-data/transcoding.md): Transcode clips with CPU or GPU encoders and tune for quality and performance - [Filtering](https://docs.nvidia.com/nemo/curator/v26.04/curate-video/process-data/filtering.md): Filter clips by motion or aesthetics to improve dataset quality - [Embeddings](https://docs.nvidia.com/nemo/curator/v26.04/curate-video/process-data/embeddings.md): Generate clip-level embeddings using Cosmos-Embed1 - [Deduplication](https://docs.nvidia.com/nemo/curator/v26.04/curate-video/process-data/dedup.md): Remove near-duplicate clips using semantic clustering and pairwise similarity - [Frame Extraction](https://docs.nvidia.com/nemo/curator/v26.04/curate-video/process-data/frame-extraction.md): Extract frames from clips or full videos for embeddings, filtering, and analysis - [Captions Preview](https://docs.nvidia.com/nemo/curator/v26.04/curate-video/process-data/captions-preview.md): Generate clip captions with Qwen-VL or Nemotron VLMs and optional preview images - [Save and Export](https://docs.nvidia.com/nemo/curator/v26.04/curate-video/save-export.md): Understand output directories, parquet embeddings, and packaging curated video data for training > **Note:** This page contains both a page directory (above) and the landing page content (below). The page directory is generated for agent use and does not appear on the landing page. > For clean Markdown of any page, append .md to the page URL. > For a complete documentation index, see https://docs.nvidia.com/nemo/curator/v26.04/curate-video/llms.txt. > For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/curator/_mcp/server. > Comprehensive guide to Ray-based video curation with NeMo Curator including splitting and deduplication pipelines for large-scale processing # About Video Curation Learn what video curation is and how you use NeMo Curator to turn long videos into high‑quality, searchable clips. Depending on the use case, this can involve processing 100+ PB of videos. To efficiently process this quantity of videos, NeMo Curator provides highly optimized curation pipelines. ## Use Cases Identify when to use NeMo Curator by matching your goals to common video curation scenarios. * Generating clips for video world model training * Generating clips for generative video model fine-tuning * Creating a rich video database for video retrieval applications ## Architecture Understand how components work together so you can plan, scale, and troubleshoot video pipelines. The following diagram outlines NeMo Curator's video curation architecture: ![High-level outline of NeMo Curator's video curation architecture](/nemo/curator/_fern-img/67388f28b69b406148bf172d2269e71cd23dfbfd40c5ebb2bb0f312d9e7766ab.webp) > **Note** > > Video pipelines use the `XennaExecutor` backend by default, which provides optimized support for GPU-accelerated video processing including hardware decoders and encoders. You do not need to import or configure the executor unless you want to use an alternative backend. For more information about customizing backends, refer to [Pipeline Execution Backends](/reference/infra/execution-backends). --- ## Introduction Get oriented and prepare your environment so you can start curating videos with confidence. #### [Concepts](/about/concepts/video) Learn about the architecture, stages, pipelines, and data flow for video curation stages pipelines ray #### [Get Started](/get-started/video) Install NeMo Curator, configure storage, prepare data, and run your first video pipeline. --- ## Curation Tasks Follow task-based guides to load, process, and write curated video data end to end. ### Load Data Bring videos into your pipeline from local paths or remote sources you control. #### [Local & Cloud](/curate-video/load-data#local-and-cloud) Load videos from local paths or S3-compatible and HTTP(S) URLs. local s3 file-list #### [Remote (JSON)](/curate-video/load-data#explicit-file-list-json) Provide an explicit JSON file list for remote datasets under a root prefix. file-list s3 ### Process Data Transform raw videos into curated clips, frames, embeddings, and metadata you can use. #### [Clip Videos](/curate-video/process-data/clipping) Split long videos into shorter clips using fixed stride or scene-change detection. clips fixed-stride transnetv2 #### [Encode Clips](/curate-video/process-data/transcoding) Encode clips to H.264 using CPU or GPU encoders and tune performance. clips h264\_nvenc #### [Filter Clips and Frames](/curate-video/process-data/filtering) Apply motion-based filtering and aesthetic filtering to improve dataset quality. clips frames motion aesthetic #### [Extract Frames](/curate-video/process-data/frame-extraction) Extract frames from clips or full videos for embeddings, filtering, and analysis. frames nvdec ffmpeg fps #### [Create Embeddings](/curate-video/process-data/embeddings) Generate clip-level embeddings with Cosmos-Embed1 for search and duplicate removal. clips cosmos-embed1 #### [Create Captions & Preview](/curate-video/process-data/captions-preview) Generate Qwen‑VL captions and optional WebP previews; optionally enhance with Qwen‑LM. captions previews qwen webp #### [Remove Duplicate Embeddings](/curate-video/process-data/dedup) Remove near-duplicates using semantic clustering and similarity with generated embeddings. clips semantic pairwise kmeans ### Write Data Save outputs in formats your training or retrieval systems can consume at scale. #### [Save & Export](/curate-video/save-export) Understand output directories, parquet embeddings, and packaging for training. parquet webdataset metadata --- ## Tutorials Practice with guided, hands-on examples to build, customize, and run video pipelines. #### [Beginner Tutorial](/curate-video/tutorials/beginner) Create and run your first video pipeline: read, split, encode, embed, write. splitting encoding embeddings #### [Pipeline Customization Tutorials](/curate-video/tutorials/pipeline-customization) Customize environments, code, models, and stages for video pipelines. environments code models stages