> This page is for version dev.
> For other versions, use one of these documentation indexes:
> - 1.8.1 (default): https://docs.nvidia.com/networking/cloudai/1.8.1/llms.txt
> - 1.7.1: https://docs.nvidia.com/networking/cloudai/1.7.1/llms.txt
> - 1.6.1: https://docs.nvidia.com/networking/cloudai/1.6.1/llms.txt
> - dev: https://docs.nvidia.com/networking/cloudai/dev/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/networking/cloudai/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/networking/cloudai/_mcp/server.

AIConfigurator workload (`test_template_name` is `Aiconfigurator`) runs the AIConfigurator predictor using the installed `aiconfigurator` Python package. It is a **Standalone** workload (no Slurm/Kubernetes/RunAI required).

## Outputs

Each test run produces:

* `report.json`: Predictor output (JSON dict of metrics and metadata)
* `stdout.txt` / `stderr.txt`: Predictor logs
* `run_simple_predictor.sh`: Repro script containing the exact executed command (useful for debugging)

## Usage Example

Test TOML example (Disaggregated mode):

```toml
name = "aiconfigurator_disagg_demo"
description = "Example AIConfigurator disaggregated predictor"
test_template_name = "Aiconfigurator"

[cmd_args]
model_name = "LLAMA3.1_70B"
system = "h200_sxm"
backend = "trtllm"
version = "0.20.0"
isl = 4000
osl = 500

  [cmd_args.disagg]
  p_tp = 1
  p_pp = 1
  p_dp = 1
  p_bs = 1
  p_workers = 1

  d_tp = 1
  d_pp = 1
  d_dp = 1
  d_bs = 8
  d_workers = 2

  prefill_correction_scale = 1.0
  decode_correction_scale = 1.0
```

Test TOML example (Aggregated/IFB mode):

```toml
name = "aiconfigurator_agg_demo"
description = "Example AIConfigurator aggregated predictor"
test_template_name = "Aiconfigurator"

[cmd_args]
model_name = "LLAMA3.1_70B"
system = "h200_sxm"
backend = "trtllm"
version = "0.20.0"
isl = 4000
osl = 500

  [cmd_args.agg]
  batch_size = 8
  ctx_tokens = 16
  tp = 1
  pp = 1
  dp = 1
```

## Running

```bash
uv run cloudai run --system-config conf/common/system/standalone_system.toml \
   --tests-dir conf/experimental/aiconfigurator/test \
   --test-scenario conf/experimental/aiconfigurator/test_scenario/aiconfigurator_disagg.toml
```

## API Documentation

### Command Arguments

### `AiconfiguratorCmdArgs`

Command arguments for Aiconfigurator workload with nested agg/disagg configs.

| Field          | Type                                                       | Default                   | Description                                                                        |
| -------------- | ---------------------------------------------------------- | ------------------------- | ---------------------------------------------------------------------------------- |
| `requirements` | `str`                                                      | `'aiconfigurator~=0.5.0'` | Space-separated Python requirements installed into the Aiconfigurator environment. |
| `model_name`   | `str`                                                      | Required                  |                                                                                    |
| `system`       | `str`                                                      | Required                  |                                                                                    |
| `backend`      | `str`                                                      | `'trtllm'`                |                                                                                    |
| `version`      | `str`                                                      | `'0.20.0'`                |                                                                                    |
| `isl`          | `int \| List[int]`                                         | Required                  |                                                                                    |
| `osl`          | `int \| List[int]`                                         | Required                  |                                                                                    |
| `agg`          | `cloudai.workloads.aiconfig.aiconfigurator.Agg \| None`    | `None`                    |                                                                                    |
| `disagg`       | `cloudai.workloads.aiconfig.aiconfigurator.Disagg \| None` | `None`                    |                                                                                    |

### Test Definition

### `AiconfiguratorTestDefinition`

Test object for running Aiconfigurator predictor as a workload.

| Field                    | Type                                                              | Default         | Description                                                                                                                                                                                                                   |
| ------------------------ | ----------------------------------------------------------------- | --------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| `name`                   | `str`                                                             | Required        |                                                                                                                                                                                                                               |
| `description`            | `str`                                                             | Required        |                                                                                                                                                                                                                               |
| `test_template_name`     | `str`                                                             | Required        |                                                                                                                                                                                                                               |
| `cmd_args`               | `cloudai.workloads.aiconfig.aiconfigurator.AiconfiguratorCmdArgs` | Required        |                                                                                                                                                                                                                               |
| `dse_excluded_args`      | `list[str]`                                                       | Factory: `list` |                                                                                                                                                                                                                               |
| `extra_env_vars`         | `dict[str, str \| typing.List[str]]`                              | `{}`            |                                                                                                                                                                                                                               |
| `extra_cmd_args`         | `dict[str, str]`                                                  | `{}`            |                                                                                                                                                                                                                               |
| `extra_container_mounts` | `list[str]`                                                       | `[]`            |                                                                                                                                                                                                                               |
| `git_repos`              | `list[cloudai._core.installables.git_repo.GitRepo]`               | `[]`            |                                                                                                                                                                                                                               |
| `nsys`                   | `cloudai.models.workload.NsysConfiguration \| None`               | `None`          |                                                                                                                                                                                                                               |
| `predictor`              | `cloudai.models.workload.PredictorConfig \| None`                 | `None`          |                                                                                                                                                                                                                               |
| `training_report`        | `cloudai.models.workload.TrainingReportConfig \| None`            | `None`          |                                                                                                                                                                                                                               |
| `agent`                  | `str`                                                             | `'grid_search'` |                                                                                                                                                                                                                               |
| `agent_steps`            | `int`                                                             | `1`             |                                                                                                                                                                                                                               |
| `agent_metrics`          | `list[str]`                                                       | `['default']`   |                                                                                                                                                                                                                               |
| `agent_reward_function`  | `str`                                                             | `'inverse'`     |                                                                                                                                                                                                                               |
| `agent_config`           | `dict[str, Any] \| None`                                          | `None`          | Agent configuration.                                                                                                                                                                                                          |
| `env_params`             | `dict[str, cloudai.configurator.env_params.EnvParamSpec]`         | Factory: `dict` | Environment parameters sampled by the env per trial. Sibling to cmd_args; not part of the agent's action space. CloudAIGymEnv samples, persists them in the trajectory output, and includes them in the trajectory cache key. |

### Command Generation Strategy (Standalone)

### `cloudai.workloads.aiconfig.standalone_command_gen_strategy.AiconfiguratorStandaloneCommandGenStrategy`

Generate a standalone command that invokes the Aiconfigurator predictor and writes JSON output.

#### `cleanup_job_artifacts`

```python
cleanup_job_artifacts(self) -> None
```

Best-effort cleanup hook run after the job has fully completed.

### Report Generation Strategy

### `cloudai.workloads.aiconfig.report_generation_strategy.AiconfiguratorReportGenerationStrategy`

Generate metrics from Aiconfigurator predictor outputs.