bridge.recipes.glm.glm45#
Module Contents#
Functions#
Return a pre-training config for GLM 4.5 355B-A32B variant. |
|
Return a pre-training config for GLM 4.5 Air 106B-A12B variant. |
|
Return a full SFT config for GLM-4.5 355B-A32B. |
|
Return a full SFT config for GLM-4.5 Air 106B-A12B. |
|
Return a PEFT config for GLM-4.5 355B-A32B. |
|
Return a PEFT config for GLM-4.5 Air 106B-A12B. |
API#
- bridge.recipes.glm.glm45.glm45_355b_pretrain_config() megatron.bridge.training.config.ConfigContainer#
Return a pre-training config for GLM 4.5 355B-A32B variant.
Recommended parallelism: TP=2, PP=8, EP=16
- bridge.recipes.glm.glm45.glm45_air_106b_pretrain_config() megatron.bridge.training.config.ConfigContainer#
Return a pre-training config for GLM 4.5 Air 106B-A12B variant.
Recommended parallelism: TP=1, PP=4, EP=8
- bridge.recipes.glm.glm45.glm45_355b_sft_config() megatron.bridge.training.config.ConfigContainer#
Return a full SFT config for GLM-4.5 355B-A32B.
Default parallelism: TP=2, PP=8, EP=16
Note: Packed sequence is NOT supported for GLM-4.5.
- Returns:
ConfigContainer with all settings pre-configured for GLM-4.5 355B SFT.
- bridge.recipes.glm.glm45.glm45_air_106b_sft_config() megatron.bridge.training.config.ConfigContainer#
Return a full SFT config for GLM-4.5 Air 106B-A12B.
Default parallelism: TP=1, PP=4, EP=8
Note: Packed sequence is NOT supported for GLM-4.5.
- Returns:
ConfigContainer with all settings pre-configured for GLM-4.5 Air 106B SFT.
- bridge.recipes.glm.glm45.glm45_355b_peft_config(
- peft_scheme: str | megatron.bridge.peft.base.PEFT = 'lora',
Return a PEFT config for GLM-4.5 355B-A32B.
Default parallelism: TP=2, PP=4, EP=4
Note: Packed sequence is NOT supported for GLM-4.5.
- Parameters:
peft_scheme – PEFT scheme - “lora”, “dora”, or a custom PEFT instance.
- Returns:
ConfigContainer with all settings pre-configured for GLM-4.5 355B PEFT.
- bridge.recipes.glm.glm45.glm45_air_106b_peft_config(
- peft_scheme: str | megatron.bridge.peft.base.PEFT = 'lora',
Return a PEFT config for GLM-4.5 Air 106B-A12B.
Default parallelism: TP=1, PP=2, EP=4
Note: Packed sequence is NOT supported for GLM-4.5.
- Parameters:
peft_scheme – PEFT scheme - “lora”, “dora”, or a custom PEFT instance.
- Returns:
ConfigContainer with all settings pre-configured for GLM-4.5 Air 106B PEFT.