> This page is for version 1.7.1.
> For other versions, use one of these documentation indexes:
> - 1.8.1 (default): https://docs.nvidia.com/networking/cloudai/1.8.1/llms.txt
> - 1.7.1: https://docs.nvidia.com/networking/cloudai/1.7.1/llms.txt
> - 1.6.1: https://docs.nvidia.com/networking/cloudai/1.6.1/llms.txt
> - dev: https://docs.nvidia.com/networking/cloudai/dev/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/networking/cloudai/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/networking/cloudai/_mcp/server.

AIConfigurator workload (test_template_name is `Aiconfigurator`) runs the AIConfigurator predictor using the installed `aiconfigurator` Python package. It is a **Standalone** workload (no Slurm/Kubernetes/RunAI required).

## Outputs

Each test run produces:

* `report.json`: Predictor output (JSON dict of metrics and metadata)

* `stdout.txt` / `stderr.txt`: Predictor logs

* `run_simple_predictor.sh`: Repro script containing the exact executed command (useful for debugging)

## Usage Example

Test TOML example (Disaggregated mode):

```toml
name = "aiconfigurator_disagg_demo"
description = "Example AIConfigurator disaggregated predictor"
test_template_name = "Aiconfigurator"

[cmd_args]
model_name = "LLAMA3.1_70B"
system = "h200_sxm"
backend = "trtllm"
version = "0.20.0"
isl = 4000
osl = 500

  [cmd_args.disagg]
  p_tp = 1
  p_pp = 1
  p_dp = 1
  p_bs = 1
  p_workers = 1

  d_tp = 1
  d_pp = 1
  d_dp = 1
  d_bs = 8
  d_workers = 2

  prefill_correction_scale = 1.0
  decode_correction_scale = 1.0
```

Test TOML example (Aggregated/IFB mode):

```toml
name = "aiconfigurator_agg_demo"
description = "Example AIConfigurator aggregated predictor"
test_template_name = "Aiconfigurator"

[cmd_args]
model_name = "LLAMA3.1_70B"
system = "h200_sxm"
backend = "trtllm"
version = "0.20.0"
isl = 4000
osl = 500

  [cmd_args.agg]
  batch_size = 8
  ctx_tokens = 16
  tp = 1
  pp = 1
  dp = 1
```

## Running

```bash
uv run cloudai run --system-config conf/common/system/standalone_system.toml \
   --tests-dir conf/experimental/aiconfigurator/test \
   --test-scenario conf/experimental/aiconfigurator/test_scenario/aiconfigurator_disagg.toml
```

## API Documentation

### Command Arguments

*class* cloudai.workloads.aiconfig.aiconfigurator.AiconfiguratorCmdArgs(

*\**,

*model_name: str*,

*system: str*,

*backend: str = 'trtllm'*,

*version: str = '0.20.0'*,

*isl: int | List\[int]*,

*osl: int | List\[int]*,

*agg: Agg | None = None*,

*disagg: Disagg | None = None*,

*\*\*extra_data: Any*,

)

Bases: `CmdArgs`

Command arguments for Aiconfigurator workload with nested agg/disagg configs.

### Test Definition

*class* cloudai.workloads.aiconfig.aiconfigurator.AiconfiguratorTestDefinition(*\*, name: str, description: str, test_template_name: str, cmd_args: \~cloudai.workloads.aiconfig.aiconfigurator.AiconfiguratorCmdArgs, dse_excluded_args: list\[str] = \<factory>, extra_env_vars: dict\[str, str | \~typing.List\[str]] = \{}, extra_cmd_args: dict\[str, str] = \{}, extra_container_mounts: list\[str] = \[], git_repos: list\[\~cloudai.\_core.installables.git_repo.GitRepo] = \[], nsys: \~cloudai.models.workload.NsysConfiguration | None = None, predictor: \~cloudai.models.workload.PredictorConfig | None = None, training_report: \~cloudai.models.workload.TrainingReportConfig | None = None, agent: str = 'grid_search', agent_steps: int = 1, agent_metrics: list\[str] = \['default'], agent_reward_function: str = 'inverse', agent_config: dict\[str, \~typing.Any] | None = None, env_params: dict\[str, \~cloudai.configurator.env_params.EnvParamSpec] = \<factory>*)

Bases: `TestDefinition`

Test object for running Aiconfigurator predictor as a workload.

**&#x20;*property* is_domain_randomization_enabled*: bool*\*\*

at least one `env_params` annotation.

**Type:**

Whether the config declares domain randomization

**&#x20;is_dse_excluded_arg(*path: str*) → bool**

Return whether a dot-separated cmd_args path should be ignored by DSE.

is_env_sampled(

*cmd_args_path: str*,

) → bool

Whether a cmd_args field is env-sampled (env draws it per trial, not the agent).

**&#x20;*validator* validate_env_params*  » \* *all fields**\*

Validate env_params annotations against cmd_args.

`env_params` is an annotation: each key names a `cmd_args` field whose value is the candidate set (the single source of truth), and the entry carries only *how* to sample. So each key must name a real `cmd_args` field whose value is a candidate list; a scalar is already fixed, so annotating it is a meaningless label and is rejected here. When `weights` are declared, the list needs >= 2 values and the weights must align 1:1 with it. Sampling, persistence, the per-trial cmd_args overlay, and the cache key all live in `CloudAIGymEnv`; keeping this shape check in core lets the overlay stay agent- and workload-agnostic rather than re-implemented per workload.

### Command Generation Strategy (Standalone)

*class* cloudai.workloads.aiconfig.standalone_command_gen_strategy.AiconfiguratorStandaloneCommandGenStrategy(

*system: System*,

*test_run: TestRun*,

)

Bases: `CommandGenStrategy`

Generate a standalone command that invokes the Aiconfigurator predictor and writes JSON output.

**&#x20;store_test_run() → None**

Store the test run information in output folder.

Only at command generation time, CloudAI has all the information to store the test run.

**&#x20;gen_exec_command() → str**

Generate the execution command for a test based on the given parameters.

**Returns:**

The generated execution command.

**Return type:**

str

\_\_init\_\_(

*system: System*,

*test_run: TestRun*,

) → None

**&#x20;cleanup_job_artifacts() → None**

Best-effort cleanup hook run after the job has fully completed.

### Report Generation Strategy

*class* cloudai.workloads.aiconfig.report_generation_strategy.AiconfiguratorReportGenerationStrategy(

*system: System*,

*tr: TestRun*,

)

Bases: `ReportGenerationStrategy`

Generate metrics from Aiconfigurator predictor outputs.

\_\_init\_\_(

*system: System*,

*tr: TestRun*,

) → None