NVIDIA NeMo Curator on DGX Cloud

Overview

• Introduction
  • Curation Pipeline Overview
• Release Notes
  • 1.0

Getting Started

• Creating a Dataset
  • Dataset Guidelines
  • Adding a Dataset
  • Managing Datasets

Reference

• Curation Parameters
• Curated Dataset Structure
• API Reference
  • Prerequisites
  • Example Workflows
    • Uploading a ZIP File
    • Linking S3 Input/Output Buckets
  • API Endpoints
    • Create a Dataset
    • Get a Dataset
    • Get All Datasets by Organization
    • Initialize Dataset Upload
    • Get Presigned URLs
    • Finalize Dataset Upload
    • Get Dataset Download URL
    • Process Dataset
    • Delete Dataset
    • Process S3 Input/Output
    • Get Dataset Captions
    • Update Dataset Captions
    • Terminate All Jobs