nemo_gym.web.judge_evidence

Compact, replayable WebVoyager judge evidence stored in rollout responses.

Module Contents

Functions

Name	Description
`_mapping`	-
`compact_webvoyager_judge_evidence`	Reference trajectory images by index and inline only missing edge images.
`expand_webvoyager_judge_screenshots`	Expand compact screenshot references from a persisted rollout response.
`response_image_urls`	Return input-image URLs already retained in a response trajectory.

Data

WEBVOYAGER_JUDGE_EVIDENCE_SCHEMA_VERSION

API

nemo_gym.web.judge_evidence._mapping(
    value: typing.Any
) -> collections.abc.Mapping[str, typing.Any] | None

nemo_gym.web.judge_evidence.compact_webvoyager_judge_evidence(
    response: typing.Any,
    final_answer: str,
    screenshots: collections.abc.Sequence[str],
    page_urls: collections.abc.Sequence[str]
) -> dict[str, typing.Any]

Reference trajectory images by index and inline only missing edge images.

nemo_gym.web.judge_evidence.expand_webvoyager_judge_screenshots(
    evidence: collections.abc.Mapping[str, typing.Any],
    response: typing.Any
) -> list[str]

Expand compact screenshot references from a persisted rollout response.

nemo_gym.web.judge_evidence.response_image_urls(
    response: typing.Any
) -> list[str]

Return input-image URLs already retained in a response trajectory.

nemo_gym.web.judge_evidence.WEBVOYAGER_JUDGE_EVIDENCE_SCHEMA_VERSION = 1