bridge.recipes.deepseek.deepseek_v4

Compatibility aliases for legacy recipe names.

Module Contents

Functions

deepseek_v4_flash_sft_openmath_thinking_packed_config

DSv4 Flash SFT on OpenMathInstruct-2 with thinking channel and offline-packed sequences.

Data

__all__

API

bridge.recipes.deepseek.deepseek_v4.__all__

[‘deepseek_v4_flash_no_mtp_sft_config’, ‘deepseek_v4_flash_pretrain_config’, ‘deepseek_v4_flash_pret…

bridge.recipes.deepseek.deepseek_v4.deepseek_v4_flash_sft_openmath_thinking_packed_config() → megatron.bridge.training.config.ConfigContainer

DSv4 Flash SFT on OpenMathInstruct-2 with thinking channel and offline-packed sequences.

CoT reasoning goes into the assistant thinking field and the final answer into the content field. Uses packed sequences for efficient training. Pre-pack data with prepare_gpt_sft_packed_data.py before running SFT. When using CP>1, pass model.cp_partition_mode=contiguous (required for DSv4 CSA attention) and pad_seq_to_mult=4 to ensure divisibility by cp_size.