bridge.recipes.qwen.gb200.qwen35#
GB200 text-only pretraining recipes for Qwen3.5 dense and MoE models.
Module Contents#
Functions#
Return a text-only Qwen3.5-9B pretraining config for eight GB200 GPUs. |
|
Return a text-only Qwen3.5-35B-A3B pretraining config for eight GB200 GPUs. |
Data#
API#
- bridge.recipes.qwen.gb200.qwen35._QWEN35_9B_BASE#
‘Qwen/Qwen3.5-9B-Base’
- bridge.recipes.qwen.gb200.qwen35._QWEN35_35B_A3B_BASE#
‘Qwen/Qwen3.5-35B-A3B-Base’
- bridge.recipes.qwen.gb200.qwen35.qwen35_text_9b_pretrain_8gpu_gb200_bf16_config() megatron.bridge.training.config.ConfigContainer#
Return a text-only Qwen3.5-9B pretraining config for eight GB200 GPUs.
- bridge.recipes.qwen.gb200.qwen35.qwen35_text_35b_a3b_pretrain_8gpu_gb200_bf16_config() megatron.bridge.training.config.ConfigContainer#
Return a text-only Qwen3.5-35B-A3B pretraining config for eight GB200 GPUs.