Overview
Learn how to run, build, and integrate benchmarks into NeMo Gym.
Looking for benchmark design tutorials? See the environment-tutorials-index.
Run a benchmark or benchmark suite
Tutorial to run a benchmark or benchmark suite using NeMo Gym.
benchmarkAdd a benchmark to NeMo Gym
Best practices for benchmark integration into NeMo Gym.
benchmarkDesign a customer evaluation
Best practices for design and iteration on a customer evaluation benchmark.
benchmarkAdd aggregate metrics for your benchmark
Implementation tutorial for aggregate metrics.
benchmark
