Catalog

View as Markdown

The catalog is the registry of all supported certification categories. It maps {domain, variant} pairs to workload definitions — the concrete specs that run during certification.

Structure

Each catalog entry is a YAML file at pkg/catalog/entries/<domain>/<variant>.yaml. The file defines the base workload spec (dependencies, job template, orchestration) plus platform- and GPU-specific overrides. The catalog loader discovers entries by scanning that directory tree at startup.

Domains and variants

DomainVariantWhat it tests
communicationnccl-all-reduceAll-reduce collective bandwidth
communicationnccl-all-gatherAll-gather collective bandwidth
communicationnccl-alltoallAll-to-all collective bandwidth
communicationnccl-loopbackLoopback bandwidth (single-node NVLink/NVSwitch)
communicationnccl-loopback-nvswitchLoopback bandwidth via NVSwitch fabric
diagnosticsdcgm-level4DCGM level-4 diagnostics
trainingnemotron5-8bEnd-to-end training throughput (NeMo, Nemotron 5 8B)
trainingnemotron5-56bEnd-to-end training throughput (NeMo, Nemotron 5 56B)

Selecting categories

In a Certification spec, list any combination of domain/variant pairs under categories:

1spec:
2 categories:
3 - domain: communication
4 variant: nccl-all-reduce
5 - domain: training
6 variant: nemotron5-8b

To see all available categories from the CLI:

$nvcrectl certification list-categories

Per-node category options

nccl-loopback, nccl-loopback-nvswitch, and dcgm-level4 run one Job per node. They support two additional options:

OptionDescription
maxConcurrentMaximum number of per-node Jobs to run simultaneously (default: unbounded)
timeoutPerJobTimeout for each individual per-node Job
1categories:
2 - domain: diagnostics
3 variant: dcgm-level4
4 options:
5 maxConcurrent: 4
6 timeoutPerJob: 30m

Overrides

Catalog entries define a base workload spec. Platform-specific and GPU-specific overrides within the same YAML are applied at render time based on the detected environment. Supported GPU architectures include GB200, GB300, H100, H200, and B200. See Platform Detection & Overrides for override semantics.

Adding a custom entry

See How-to: Custom Catalog Entries.