Nemo Run
This workload (test_template_name is NemoRun) executes NeMo training and fine-tuning tasks using the NeMo Run framework.
Usage Examples
Test TOML example:
Test Scenario example:
Test-in-Scenario example:
API Documentation
Command Arguments
class cloudai.workloads.nemo_run.nemo_run.NeMoRunCmdArgs(
*,
docker_image_url: str,
task: str,
recipe_name: str,
num_layers: int | None = None,
trainer: ~cloudai.workloads.nemo_run.nemo_run.Trainer = <factory>,
log: ~cloudai.workloads.nemo_run.nemo_run.Log = <factory>,
data: ~cloudai.workloads.nemo_run.nemo_run.Data = <factory>,
optim: ~cloudai.workloads.nemo_run.nemo_run.Optim = <factory>,
**extra_data: ~typing.Any,
)
Bases: CmdArgs
NeMoRun test command arguments.
Test Definition
class cloudai.workloads.nemo_run.nemo_run.NeMoRunTestDefinition(
*,
name: str,
description: str,
test_template_name: str,
cmd_args: NeMoRunCmdArgs,
extra_env_vars: dict[str, str | List[str]] = {},
extra_cmd_args: dict[str, str] = {},
extra_container_mounts: list[str] = [],
git_repos: list[GitRepo] = [],
nsys: NsysConfiguration | None = None,
predictor: PredictorConfig | None = None,
agent: str = ‘grid_search’,
agent_steps: int = 1,
agent_metrics: list[str] = [‘default’],
agent_reward_function: str = ‘inverse’,
agent_config: dict[str, Any] | None = None,
script: File = File(src=PosixPath(‘src/cloudai/workloads/nemo_run/cloudai_nemorun.py’)),
)
Bases: TestDefinition
NeMoRun test definition.
property installables: list[Installable]**
Get list of installable objects.
constraint_check(
tr: TestRun,
system: System | None,
) → bool
Check constraints for NeMoRun.
property update_num_train_samples: int | None**
Calculate num_train_samples based on global_batch_size and max_steps.