Skip to navigation

DDLB

View as Markdown

DDLB workload (test_template_name is DDLB) allows users to execute DDLB (Distributed Deep Learning Benchmarks) within the CloudAI framework. Please find the DDLB README at https://github.com/samnordmann/ddlb.

Usage Examples

Test TOML example:

name = "my_ddlb_test"
description = "Example DDLB test"
test_template_name = "DDLB"
[cmd_args]
docker_image_url = "<docker container url here>"
primitive = "tp_columnwise"
dtype = "float16"

Test Scenario example:

name = "ddlb-test"
[[Tests]]
id = "ddlb.1"
num_nodes = 1
time_limit = "00:10:00"
test_name = "my_ddlb_test"

Test-in-Scenario example:

name = "ddlb-test"
[[Tests]]
id = "ddlb.1"
num_nodes = 1
time_limit = "00:10:00"
name = "my_ddlb_test"
description = "Example DDLB test"
test_template_name = "DDLB"
[Tests.cmd_args]
docker_image_url = "<docker container url here>"
primitive = "tp_columnwise"
m = 1024
n = 128
k = 1024
dtype = "float16"
num_iterations = 50
num_warmups = 5
impl = "pytorch;backend=nccl;order=AG_before"

API Documentation

Command Arguments

DDLBCmdArgs

DDLB test command arguments.

FieldTypeDefaultDescription
docker_image_urlstrRequired
primitivestrRequired
mint | list[int]1024
nint | list[int]128
kint | list[int]1024
dtypestrRequired
num_iterationsint50
num_warmupsint5
implstr | list[str]'pytorch;backend=nccl;order=AG_before'

Test Definition

DDLBTestDefinition

Test object for DDLB.

FieldTypeDefaultDescription
namestrRequired
descriptionstrRequired
test_template_namestrRequired
cmd_argscloudai.workloads.ddlb.ddlb.DDLBCmdArgsRequired
dse_excluded_argslist[str]Factory: list
extra_env_varsdict[str, str | typing.List[str]]{}
extra_cmd_argsdict[str, str]{}
extra_container_mountslist[str][]
git_reposlist[cloudai._core.installables.git_repo.GitRepo][]
nsyscloudai.models.workload.NsysConfiguration | NoneNone
predictorcloudai.models.workload.PredictorConfig | NoneNone
training_reportcloudai.models.workload.TrainingReportConfig | NoneNone
agentstr'grid_search'
agent_stepsint1
agent_metricslist[str]['default']
agent_reward_functionstr'inverse'
agent_configdict[str, Any] | NoneNoneAgent configuration.
env_paramsdict[str, cloudai.configurator.env_params.EnvParamSpec]Factory: dictEnvironment parameters sampled by the env per trial. Sibling to cmd_args; not part of the agent’s action space. CloudAIGymEnv samples, persists them in the trajectory output, and includes them in the trajectory cache key.