DFlash

View as Markdown

Qwen3-4B-DFlash-b16 is a diffusion draft model trained against a frozen Qwen3 target for speculative decoding.

TaskDiffusion Draft-Model Training
ArchitectureDFlashDraftModel with Hugging Face trust_remote_code
TargetQwen/Qwen3-4B
HF Orgz-lab

Example Model and Recipe

$uv run torchrun --nproc-per-node=8 nemo_automodel/recipes/dllm/train_ft.py \
> -c examples/dllm_sft/dflash_sft.yaml

See the dLLM Fine-Tuning Guide.