Overview
This page is for version 0.2.1.
For other versions, use one of these documentation indexes:
- Main (default): https://docs.nvidia.com/nemo/gym/main/llms.txt
- 0.7.0: https://docs.nvidia.com/nemo/gym/v0.7.0/llms.txt
- 0.6.0: https://docs.nvidia.com/nemo/gym/v0.6.0/llms.txt
- 0.5.1: https://docs.nvidia.com/nemo/gym/v0.5.1/llms.txt
- 0.5.0: https://docs.nvidia.com/nemo/gym/v0.5.0/llms.txt
- 0.4.0: https://docs.nvidia.com/nemo/gym/v0.4.0/llms.txt
- 0.3.0: https://docs.nvidia.com/nemo/gym/v0.3.0/llms.txt
- 0.2.1: https://docs.nvidia.com/nemo/gym/v0.2.1/llms.txt
Learn how to run, build, and integrate benchmarks into NeMo Gym.
Looking for benchmark design tutorials? See the environment-tutorials-index.
Run a benchmark or benchmark suite
Tutorial to run a benchmark or benchmark suite using NeMo Gym.
benchmarkAdd a benchmark to NeMo Gym
Best practices for benchmark integration into NeMo Gym.
benchmarkDesign a customer evaluation
Best practices for design and iteration on a customer evaluation benchmark.
benchmarkAdd aggregate metrics for your benchmark
Implementation tutorial for aggregate metrics.
benchmark