bridge.recipes.qwen.gb200.qwen35#

GB200 text-only pretraining recipes for Qwen3.5 dense and MoE models.

Module Contents#

Functions#

qwen35_text_9b_pretrain_8gpu_gb200_bf16_config

Return a text-only Qwen3.5-9B pretraining config for eight GB200 GPUs.

qwen35_text_35b_a3b_pretrain_8gpu_gb200_bf16_config

Return a text-only Qwen3.5-35B-A3B pretraining config for eight GB200 GPUs.

Data#

API#

bridge.recipes.qwen.gb200.qwen35._QWEN35_9B_BASE#

‘Qwen/Qwen3.5-9B-Base’

bridge.recipes.qwen.gb200.qwen35._QWEN35_35B_A3B_BASE#

‘Qwen/Qwen3.5-35B-A3B-Base’

bridge.recipes.qwen.gb200.qwen35.qwen35_text_9b_pretrain_8gpu_gb200_bf16_config() megatron.bridge.training.config.ConfigContainer#

Return a text-only Qwen3.5-9B pretraining config for eight GB200 GPUs.

bridge.recipes.qwen.gb200.qwen35.qwen35_text_35b_a3b_pretrain_8gpu_gb200_bf16_config() megatron.bridge.training.config.ConfigContainer#

Return a text-only Qwen3.5-35B-A3B pretraining config for eight GB200 GPUs.