nemo_gym.environment.validation
nemo_gym.environment.validation
Static manifest validation for manifest-backed workloads.
Module Contents
Classes
Functions
Data
SINGLE_AGENT_TURN_ENVIRONMENT_SERVERS
API
Bases: ConfigError
A manifest-backed workload failed static manifest validation.
Bases: BaseModel
Any task input object: the input of an environment server whose own input model owns its fields.
The servers a workload config wires around its dataset-bearing agent.
Bases: _StaticWiringParser
Reject partially valid server configs before the parser prints its almost-server banner.
Catalog lookup remains strict even with error_on_almost_servers: false: its caller falls back to raw names
rather than selecting from only the valid blocks. Other parser warnings and metadata fallback are unaffected.
Bases: GlobalConfigDictParser
Inspect wiring without deployment credentials or images; runtime parsing stays strict.
The resources binding selected by all dataset routes, or unknown when they do not identify one instance.
Resolve which servers a workload config wires, without probing or materializing runtime services.
The agent rollout dispatch routes owner_instance_name’s datasets to (validation-time check).
Resolve manifest wiring, with datasets in manifest form, without probing or materializing runtime services.
Each routed taskset’s environment server implementation, such as single_agent_turn.
A route to an instance that is not an environment server is left out, so its tasks count as unknown.
A Harbor target must name a committed entry, an existing task folder or a harbor: reference.
Nothing is fetched: a reference is checked by its shape, and its tasks are validated by gym dataset validate.
Check a materialized task row (task_id and task_input) as rollout collection dispatches it.
Rollout collection sends only the row’s task_id and task_input to the environment server its taskset
routes to (environment_server_routes). A single-agent-turn server validates them as
MaterializedTask[SingleAgentTurnTaskInput]. For any other server, or a taskset with no route, only the
envelope is checked here, a valid TaskId and a task_input object, because that server owns its input.
The resources server and agent selected by a workload config’s runtime routes.
Wiring resolution still needs an unambiguous dataset owner and agent, but skips manifest-only dataset checks
such as requiring a benchmark preparation script. Returns None when the config does not resolve on its own:
for example, it needs runtime-only values or contains invalid server blocks, even with
error_on_almost_servers: false. Parser compatibility warnings can still go to stderr, and the caller’s
metadata fallback may emit its own diagnostics. A resolved config with ambiguous or differing resources routes
returns (None, agent) so the catalog does not guess from raw names.
Validate a manifest without probing services or runtime output paths.
Component CI may disable dataset checks to exercise committed verifier fixtures without downloading a workload’s full benchmark or training dataset.