nemo_gym.eval.comparison.suite.report

Presentation of completed suite results; no loading or statistical calculations.

Module Contents

Functions

Name	Description
`_interval`	-
`_number`	-
`_source_lines`	-
`_text`	-
`render_suite_markdown`	Render suite statistics, effective membership, metric scales, and source evidence.
`render_suite_summary`	Render per-model and overall results for the terminal.
`write_suite_reports`	Write separate suite artifacts without overwriting single-run comparison reports.

API

nemo_gym.eval.comparison.suite.report._interval(
    statistics: nemo_gym.eval.comparison.suite.schema.SuiteStatistics | None
) -> str

nemo_gym.eval.comparison.suite.report._number(
    value: float | None
) -> str

nemo_gym.eval.comparison.suite.report._source_lines(
    label: str,
    run: nemo_gym.eval.comparison.suite.schema.SuiteRunSummary
) -> list[str]

nemo_gym.eval.comparison.suite.report._text(
    value: object
) -> str

nemo_gym.eval.comparison.suite.report.render_suite_markdown(
    result: nemo_gym.eval.comparison.suite.schema.SuiteComparisonResult
) -> str

Render suite statistics, effective membership, metric scales, and source evidence.

nemo_gym.eval.comparison.suite.report.render_suite_summary(
    result: nemo_gym.eval.comparison.suite.schema.SuiteComparisonResult
) -> str

Render per-model and overall results for the terminal.

nemo_gym.eval.comparison.suite.report.write_suite_reports(
    result: nemo_gym.eval.comparison.suite.schema.SuiteComparisonResult,
    output_dir: pathlib.Path,
    report_format: nemo_gym.eval.comparison.schema.ReportFormat
) -> list[pathlib.Path]

Write separate suite artifacts without overwriting single-run comparison reports.