Tutorials
Available tutorials
Step-by-step guides for common workflows.
| Tutorial | Description |
|---|---|
| Interactive Walkthrough | Guided tour of all main features through real config examples — start here. |
| Write Your Own Benchmark | Define a complete benchmark with @benchmark + @scorer in under 10 lines. |
| Gym Integration | Serve benchmarks for NeMo Gym training and consume remote Gym environments. |
| NeMo Skills Integration | Use NeMo Skills benchmarks with full per-request observability. |
| Legacy Evaluator Containers | Run any existing NeMo Evaluator harness container through NEL’s unified interface. |
| Distributed Evaluation | Scale to thousands of problems with SLURM, Kubernetes, Ray, or manual sharding. |
| Compare Runs | Diagnose what changed between two runs of the same benchmark with nel compare. |
| Config Composition | Reuse config fragments with Hydra-style inheritance and interpolation. |
| Quality Gates | Turn benchmark thresholds into a suite-level GO / NO-GO / INCONCLUSIVE decision with nel gate. |
| External Environments | Connect Gym, NeMo Skills, and lm-eval environments through the unified registry. |