Data Designer CLI

The NeMo Data Designer plugin adds the nemo data-designer command group. Use it to execute Data Designer workloads on NeMo Platform.

Configuration Sources

The preview and create commands accept a configuration source path. The most flexible form is a Python file that defines load_config_builder() and returns a configured DataDesignerConfigBuilder instance. This file can have any name; the examples below use product_reviews.py.

import data_designer.config as dd
def load_config_builder() -> dd.DataDesignerConfigBuilder:
    model_configs = [
        dd.ModelConfig(
            provider="default/nvidia-build",
            model="nvidia/nemotron-3-nano-30b-a3b",
            alias="text",
        )
    ]
    config_builder = dd.DataDesignerConfigBuilder(model_configs)
    # Add columns, constraints, seed datasets, processors, and profilers here.
    return config_builder

nemo data-designer preview product_reviews.py --workspace default
nemo data-designer create product_reviews.py --workspace default

Retrieval SDG

Nemotron retrieval Stage 0/1 use dedicated jobs, not create. See Retrieval SDG.

nemo data-designer retrieval generate \
  --corpus default/my-docs \
  --provider default/nvidia-build \
  --chat-model nvidia/nemotron-3-nano-30b-a3b \
  --embed-model nvidia/nemotron-3-embed-1b
nemo data-designer retrieval-prepare --spec '{"sdg_input":"default/stage0-out"}'

Personas

The plugin provides commands for Nemotron Personas datasets.

Create a Files API Fileset for a persona locale so workloads can use it:

nemo data-designer personas make-fileset \
  --locale en_US \
  --api-key-secret system/ngc-api-key

If you need to create the secret during the same command, set an environment variable with the NGC API key and pass --api-key-env-var:

nemo data-designer personas make-fileset \
  --locale en_US \
  --api-key-secret system/ngc-api-key \
  --api-key-env-var NGC_API_KEY