> This page is for version 0.5.1.
> For other versions, use one of these documentation indexes:
> - Main (default): https://docs.nvidia.com/nemo/gym/main/llms.txt
> - 0.7.0: https://docs.nvidia.com/nemo/gym/v0.7.0/llms.txt
> - 0.6.0: https://docs.nvidia.com/nemo/gym/v0.6.0/llms.txt
> - 0.5.1: https://docs.nvidia.com/nemo/gym/v0.5.1/llms.txt
> - 0.5.0: https://docs.nvidia.com/nemo/gym/v0.5.0/llms.txt
> - 0.4.0: https://docs.nvidia.com/nemo/gym/v0.4.0/llms.txt
> - 0.3.0: https://docs.nvidia.com/nemo/gym/v0.3.0/llms.txt
> - 0.2.1: https://docs.nvidia.com/nemo/gym/v0.2.1/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/gym/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/gym/_mcp/server.

# nemo_gym.eval.comparison.suite.coverage

Validate recorded and planned task coverage for suite comparisons.

## Module Contents

### Functions

| Name                                                                                              | Description                                                                        |
| ------------------------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------- |
| [`_check_paired_coverage`](#nemo_gym-eval-comparison-suite-coverage-_check_paired_coverage)       | -                                                                                  |
| [`_task_indices`](#nemo_gym-eval-comparison-suite-coverage-_task_indices)                         | Keep task indices useful for locating missing inputs without overwhelming reports. |
| [`check_collection_coverage`](#nemo_gym-eval-comparison-suite-coverage-check_collection_coverage) | Return collection inconsistencies separately from each source's own evidence.      |
| [`recorded_task_sets`](#nemo_gym-eval-comparison-suite-coverage-recorded_task_sets)               | Read identities already recorded by aggregation; never derive repeat scores.       |
| [`run_coverage`](#nemo_gym-eval-comparison-suite-coverage-run_coverage)                           | Describe a source's own recorded and planned evidence independently of other runs. |

### API

```python
nemo_gym.eval.comparison.suite.coverage._check_paired_coverage(
    baseline: nemo_gym.eval.comparison.suite.loading.LoadedSuiteRun,
    candidate: nemo_gym.eval.comparison.suite.loading.LoadedSuiteRun,
    baseline_coverage: nemo_gym.eval.comparison.suite.schema.SuiteCoverage,
    candidate_coverage: nemo_gym.eval.comparison.suite.schema.SuiteCoverage
) -> None
```

```python
nemo_gym.eval.comparison.suite.coverage._task_indices(
    tasks: set[int]
) -> str
```

Keep task indices useful for locating missing inputs without overwhelming reports.

```python
nemo_gym.eval.comparison.suite.coverage.check_collection_coverage(
    baseline: tuple[nemo_gym.eval.comparison.suite.loading.LoadedSuiteRun, ...],
    candidate: tuple[nemo_gym.eval.comparison.suite.loading.LoadedSuiteRun, ...],
    baseline_coverage: list[nemo_gym.eval.comparison.suite.schema.SuiteCoverage],
    candidate_coverage: list[nemo_gym.eval.comparison.suite.schema.SuiteCoverage]
) -> list[str]
```

Return collection inconsistencies separately from each source's own evidence.

```python
nemo_gym.eval.comparison.suite.coverage.recorded_task_sets(
    run: nemo_gym.eval.comparison.suite.loading.LoadedSuiteRun
) -> tuple[dict[int, frozenset[int]], list[str], bool]
```

Read identities already recorded by aggregation; never derive repeat scores.

```python
nemo_gym.eval.comparison.suite.coverage.run_coverage(
    run: nemo_gym.eval.comparison.suite.loading.LoadedSuiteRun
) -> nemo_gym.eval.comparison.suite.schema.SuiteCoverage
```

Describe a source's own recorded and planned evidence independently of other runs.