> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/gym/_mcp/server.

# nemo_gym.eval

Evaluation on top of collected rollouts: eval plans, reverifying saved rollouts, and comparing runs.

## Subpackages

* **[`nemo_gym.eval.comparison`](/nemo/gym/nemo-gym/nemo_gym/eval/comparison)**
* **[`nemo_gym.eval.rollout_compare`](/nemo/gym/nemo-gym/nemo_gym/eval/rollout_compare)**

## Submodules

* **[`nemo_gym.eval.eval_plan`](/nemo/gym/nemo-gym/nemo_gym/eval/eval_plan)**
* **[`nemo_gym.eval.rollout_reverification`](/nemo/gym/nemo-gym/nemo_gym/eval/rollout_reverification)**

## Docs

- [nemo_gym.eval.comparison](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/comparison.md)
- [nemo_gym.eval.comparison.diff](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/comparison/diff.md)
- [nemo_gym.eval.comparison.loading](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/comparison/loading.md)
- [nemo_gym.eval.comparison.pooling](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/comparison/pooling.md)
- [nemo_gym.eval.comparison.report](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/comparison/report.md)
- [nemo_gym.eval.comparison.runner](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/comparison/runner.md)
- [nemo_gym.eval.comparison.schema](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/comparison/schema.md)
- [nemo_gym.eval.comparison.statistics](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/comparison/statistics.md)
- [nemo_gym.eval.comparison.statistics.unpaired_welch_fixed_suite](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/comparison/statistics/unpaired_welch_fixed_suite.md)
- [nemo_gym.eval.comparison.suite](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/comparison/suite.md)
- [nemo_gym.eval.comparison.suite.coverage](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/comparison/suite/coverage.md)
- [nemo_gym.eval.comparison.suite.failures](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/comparison/suite/failures.md)
- [nemo_gym.eval.comparison.suite.loading](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/comparison/suite/loading.md)
- [nemo_gym.eval.comparison.suite.pooling](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/comparison/suite/pooling.md)
- [nemo_gym.eval.comparison.suite.processing](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/comparison/suite/processing.md)
- [nemo_gym.eval.comparison.suite.report](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/comparison/suite/report.md)
- [nemo_gym.eval.comparison.suite.runner](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/comparison/suite/runner.md)
- [nemo_gym.eval.comparison.suite.schema](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/comparison/suite/schema.md)
- [nemo_gym.eval.eval_plan](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/eval_plan.md)
- [nemo_gym.eval.rollout_compare](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/rollout_compare.md)
- [nemo_gym.eval.rollout_compare.command](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/rollout_compare/command.md)
- [nemo_gym.eval.rollout_compare.compare](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/rollout_compare/compare.md)
- [nemo_gym.eval.rollout_compare.join](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/rollout_compare/join.md)
- [nemo_gym.eval.rollout_compare.report](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/rollout_compare/report.md)
- [nemo_gym.eval.rollout_compare.rows](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/rollout_compare/rows.md)
- [nemo_gym.eval.rollout_compare.schema](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/rollout_compare/schema.md)
- [nemo_gym.eval.rollout_reverification](https://docs.nvidia.com/nemo/gym/main/nemo-gym/nemo_gym/eval/rollout_reverification.md)