AIConfigurator
AIConfigurator workload (test_template_name is Aiconfigurator) runs the AIConfigurator predictor using the installed aiconfigurator Python package. It is a Standalone workload (no Slurm/Kubernetes/RunAI required).
Outputs
Each test run produces:
-
report.json: Predictor output (JSON dict of metrics and metadata) -
stdout.txt/stderr.txt: Predictor logs -
run_simple_predictor.sh: Repro script containing the exact executed command (useful for debugging)
Usage Example
Test TOML example (Disaggregated mode):
Test TOML example (Aggregated/IFB mode):
Running
API Documentation
Command Arguments
class cloudai.workloads.aiconfig.aiconfigurator.AiconfiguratorCmdArgs(
*,
python_executable: str = ‘python’,
model_name: str,
system: str,
backend: str = ‘trtllm’,
version: str = ‘0.20.0’,
isl: int | List[int],
osl: int | List[int],
agg: Agg | None = None,
disagg: Disagg | None = None,
**extra_data: Any,
)
Bases: CmdArgs
Command arguments for Aiconfigurator workload with nested agg/disagg configs.
Test Definition
class cloudai.workloads.aiconfig.aiconfigurator.AiconfiguratorTestDefinition(
*,
name: str,
description: str,
test_template_name: str,
cmd_args: AiconfiguratorCmdArgs,
extra_env_vars: dict[str, str | List[str]] = {},
extra_cmd_args: dict[str, str] = {},
extra_container_mounts: list[str] = [],
git_repos: list[GitRepo] = [],
nsys: NsysConfiguration | None = None,
predictor: PredictorConfig | None = None,
agent: str = ‘grid_search’,
agent_steps: int = 1,
agent_metrics: list[str] = [‘default’],
agent_reward_function: str = ‘inverse’,
agent_config: dict[str, Any] | None = None,
)
Bases: TestDefinition
Test object for running Aiconfigurator predictor as a workload.
Command Generation Strategy (Standalone)
class cloudai.workloads.aiconfig.standalone_command_gen_strategy.AiconfiguratorStandaloneCommandGenStrategy(
system: System,
test_run: TestRun,
)
Bases: CommandGenStrategy
Generate a standalone command that invokes the Aiconfigurator predictor and writes JSON output.
store_test_run() → None
Store the test run information in output folder.
Only at command generation time, CloudAI has all the information to store the test run.
gen_exec_command() → str
Generate the execution command for a test based on the given parameters.
Returns:
The generated execution command.
Return type:
str
__init__(
system: System,
test_run: TestRun,
) → None
cleanup_job_artifacts() → None
Best-effort cleanup hook run after the job has fully completed.
Report Generation Strategy
class cloudai.workloads.aiconfig.report_generation_strategy.AiconfiguratorReportGenerationStrategy(
system: System,
tr: TestRun,
)
Bases: ReportGenerationStrategy
Generate metrics from Aiconfigurator predictor outputs.
__init__(
system: System,
tr: TestRun,
) → None