bridge.recipes.exaone.h100.exaone_moe

K-EXAONE MoE H100 training recipes.

Module Contents

Functions

_set_optimizer_precision
_apply_exaone_moe_common
exaone_moe_236b_a23b_pretrain_64gpu_h100_bf16_config	Return a pre-training config for K-EXAONE 236B-A23B MoE.
exaone_moe_236b_a23b_sft_64gpu_h100_bf16_config	Return a full SFT config for K-EXAONE 236B-A23B MoE.
exaone_moe_236b_a23b_peft_16gpu_h100_bf16_config	Return a PEFT config for K-EXAONE 236B-A23B MoE.

Data

_HF_PATH
__all__

API

bridge.recipes.exaone.h100.exaone_moe._HF_PATH

‘LGAI-EXAONE/K-EXAONE-236B-A23B’

bridge.recipes.exaone.h100.exaone_moe._set_optimizer_precision(

cfg: megatron.bridge.training.config.ConfigContainer,

) → None

bridge.recipes.exaone.h100.exaone_moe._apply_exaone_moe_common(

cfg: megatron.bridge.training.config.ConfigContainer,

) → None

bridge.recipes.exaone.h100.exaone_moe.exaone_moe_236b_a23b_pretrain_64gpu_h100_bf16_config() → megatron.bridge.training.config.ConfigContainer

Return a pre-training config for K-EXAONE 236B-A23B MoE.

bridge.recipes.exaone.h100.exaone_moe.exaone_moe_236b_a23b_sft_64gpu_h100_bf16_config() → megatron.bridge.training.config.ConfigContainer

Return a full SFT config for K-EXAONE 236B-A23B MoE.

bridge.recipes.exaone.h100.exaone_moe.exaone_moe_236b_a23b_peft_16gpu_h100_bf16_config(

peft_scheme: str | megatron.bridge.peft.base.PEFT = 'lora',

) → megatron.bridge.training.config.ConfigContainer

Return a PEFT config for K-EXAONE 236B-A23B MoE.

bridge.recipes.exaone.h100.exaone_moe.__all__

[‘exaone_moe_236b_a23b_peft_16gpu_h100_bf16_config’, ‘exaone_moe_236b_a23b_pretrain_64gpu_h100_bf16_…