nemo_gym.web.evaluation_collision
nemo_gym.web.evaluation_collision
Pure collision planning shared by WebArena preparation and scoring.
Module Contents
Functions
Data
API
Derive snapshot adapters from a task’s evaluator config.
Build collision plans using the selected benchmark tasks as context.
Fixed-URL program_html snapshots are only enabled when more than one task in the selected set checks the same mutable target. Most targets use the URL as their collision key; GitLab raw/blob file targets share a key by repo and branch because commits to different files on the same branch can conflict. This avoids snapshot overhead and false negatives for unique mutation tasks while keeping protection for genuinely shared mutable surfaces.
Return helper calls from a func: expression without evaluating it.