Data Designer CLI

The NeMo Data Designer plugin adds the nemo data-designer command group. Use it to execute Data Designer workloads on NeMo Platform.

Configuration Sources

The preview and create commands accept a configuration source path. The most flexible form is a Python file that defines load_config_builder() and returns a configured DataDesignerConfigBuilder instance. This file can have any name; the examples below use product_reviews.py.

1
import data_designer.config as dd
2
3
def load_config_builder() -> dd.DataDesignerConfigBuilder:
4
    model_configs = [
5
        dd.ModelConfig(
6
            provider="default/nvidia-build",
7
            model="nvidia/nemotron-3-nano-30b-a3b",
8
            alias="text",
9
        )
10
    ]
11
12
    config_builder = dd.DataDesignerConfigBuilder(model_configs)
13
    # Add columns, constraints, seed datasets, processors, and profilers here.
14
    return config_builder

$
nemo data-designer preview product_reviews.py --workspace default
$
nemo data-designer create product_reviews.py --workspace default

Retrieval SDG

Nemotron retrieval Stage 0/1 use dedicated jobs, not create. See Retrieval SDG.

$
nemo data-designer retrieval generate \
>
  --corpus default/my-docs \
>
  --provider default/nvidia-build \
>
  --chat-model nvidia/nemotron-3-nano-30b-a3b \
>
  --embed-model nvidia/nemotron-3-embed-1b
$
nemo data-designer retrieval-prepare --spec '{"sdg_input":"default/stage0-out"}'

Personas

The plugin provides commands for Nemotron Personas datasets.

Create a Files API Fileset for a persona locale so workloads can use it:

$
nemo data-designer personas make-fileset \
>
  --locale en_US \
>
  --api-key-secret system/ngc-api-key

If you need to create the secret during the same command, set an environment variable with the NGC API key and pass --api-key-env-var:

$
nemo data-designer personas make-fileset \
>
  --locale en_US \
>
  --api-key-secret system/ngc-api-key \
>
  --api-key-env-var NGC_API_KEY