bridge.recipes.deepseek.h100.deepseek_v2

Module Contents

Functions

deepseek_v2_lite_pretrain_8gpu_h100_bf16_config	Return a pre-training config for DeepSeek-V2-Lite.
deepseek_v2_pretrain_128gpu_h100_bf16_config	Return a pre-training config for DeepSeek-V2.

Data

__all__

API

bridge.recipes.deepseek.h100.deepseek_v2.deepseek_v2_lite_pretrain_8gpu_h100_bf16_config() → megatron.bridge.training.config.ConfigContainer

Return a pre-training config for DeepSeek-V2-Lite.

Recommended parallelism: TP=1, PP=1, EP=8.

bridge.recipes.deepseek.h100.deepseek_v2.deepseek_v2_pretrain_128gpu_h100_bf16_config() → megatron.bridge.training.config.ConfigContainer

Return a pre-training config for DeepSeek-V2.

Recommended parallelism: TP=1, PP=4, EP=32.

bridge.recipes.deepseek.h100.deepseek_v2.__all__

[‘deepseek_v2_lite_pretrain_8gpu_h100_bf16_config’, ‘deepseek_v2_pretrain_128gpu_h100_bf16_config’]