bridge.recipes.glm.glm45#

Module Contents#

Functions#

glm45_355b_pretrain_config

Return a pre-training config for GLM 4.5 355B-A32B variant.

glm45_air_106b_pretrain_config

Return a pre-training config for GLM 4.5 Air 106B-A12B variant.

glm45_355b_sft_config

Return a full SFT config for GLM-4.5 355B-A32B.

glm45_air_106b_sft_config

Return a full SFT config for GLM-4.5 Air 106B-A12B.

glm45_355b_peft_config

Return a PEFT config for GLM-4.5 355B-A32B.

glm45_air_106b_peft_config

Return a PEFT config for GLM-4.5 Air 106B-A12B.

API#

bridge.recipes.glm.glm45.glm45_355b_pretrain_config() megatron.bridge.training.config.ConfigContainer#

Return a pre-training config for GLM 4.5 355B-A32B variant.

Recommended parallelism: TP=2, PP=8, EP=16

bridge.recipes.glm.glm45.glm45_air_106b_pretrain_config() megatron.bridge.training.config.ConfigContainer#

Return a pre-training config for GLM 4.5 Air 106B-A12B variant.

Recommended parallelism: TP=1, PP=4, EP=8

bridge.recipes.glm.glm45.glm45_355b_sft_config() megatron.bridge.training.config.ConfigContainer#

Return a full SFT config for GLM-4.5 355B-A32B.

Default parallelism: TP=2, PP=8, EP=16

Note: Packed sequence is NOT supported for GLM-4.5.

Returns:

ConfigContainer with all settings pre-configured for GLM-4.5 355B SFT.

bridge.recipes.glm.glm45.glm45_air_106b_sft_config() megatron.bridge.training.config.ConfigContainer#

Return a full SFT config for GLM-4.5 Air 106B-A12B.

Default parallelism: TP=1, PP=4, EP=8

Note: Packed sequence is NOT supported for GLM-4.5.

Returns:

ConfigContainer with all settings pre-configured for GLM-4.5 Air 106B SFT.

bridge.recipes.glm.glm45.glm45_355b_peft_config(
peft_scheme: str | megatron.bridge.peft.base.PEFT = 'lora',
) megatron.bridge.training.config.ConfigContainer#

Return a PEFT config for GLM-4.5 355B-A32B.

Default parallelism: TP=2, PP=4, EP=4

Note: Packed sequence is NOT supported for GLM-4.5.

Parameters:

peft_scheme – PEFT scheme - “lora”, “dora”, or a custom PEFT instance.

Returns:

ConfigContainer with all settings pre-configured for GLM-4.5 355B PEFT.

bridge.recipes.glm.glm45.glm45_air_106b_peft_config(
peft_scheme: str | megatron.bridge.peft.base.PEFT = 'lora',
) megatron.bridge.training.config.ConfigContainer#

Return a PEFT config for GLM-4.5 Air 106B-A12B.

Default parallelism: TP=1, PP=2, EP=4

Note: Packed sequence is NOT supported for GLM-4.5.

Parameters:

peft_scheme – PEFT scheme - “lora”, “dora”, or a custom PEFT instance.

Returns:

ConfigContainer with all settings pre-configured for GLM-4.5 Air 106B PEFT.