> This page is for version 0.6.0.
> For other versions, use one of these documentation indexes:
> - Main (default): https://docs.nvidia.com/nemo/gym/main/llms.txt
> - 0.7.0: https://docs.nvidia.com/nemo/gym/v0.7.0/llms.txt
> - 0.6.0: https://docs.nvidia.com/nemo/gym/v0.6.0/llms.txt
> - 0.5.1: https://docs.nvidia.com/nemo/gym/v0.5.1/llms.txt
> - 0.5.0: https://docs.nvidia.com/nemo/gym/v0.5.0/llms.txt
> - 0.4.0: https://docs.nvidia.com/nemo/gym/v0.4.0/llms.txt
> - 0.3.0: https://docs.nvidia.com/nemo/gym/v0.3.0/llms.txt
> - 0.2.1: https://docs.nvidia.com/nemo/gym/v0.2.1/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/gym/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/gym/_mcp/server.

# nemo_gym.eval.comparison.suite.runner

Orchestrate suite artifact loading, processing, and result provenance.

## Module Contents

### Functions

| Name                                                                                      | Description                                                                                    |
| ----------------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------- |
| [`build_suite_comparison`](#nemo_gym-eval-comparison-suite-runner-build_suite_comparison) | Build typed results, optionally resolving catalog reward scales through the supplied callback. |
| [`invoked_command`](#nemo_gym-eval-comparison-suite-runner-invoked_command)               | Record the suite command with its Hydra overrides, masking secret values.                      |

### API

```python
nemo_gym.eval.comparison.suite.runner.build_suite_comparison(
    config: nemo_gym.eval.comparison.suite.schema.SuiteComparisonConfig,
    command: str,
    reward_metric_resolver: collections.abc.Callable[[str], nemo_gym.eval.comparison.suite.schema.SuiteMetricResult] | None = None
) -> nemo_gym.eval.comparison.suite.schema.SuiteComparisonResult
```

Build typed results, optionally resolving catalog reward scales through the supplied callback.

```python
nemo_gym.eval.comparison.suite.runner.invoked_command() -> str
```

Record the suite command with its Hydra overrides, masking secret values.