LLaDA 2.1

View as Markdown

LLaDA 2.1 is a mixture-of-experts diffusion language model supported through its Hugging Face remote-code implementation.

TaskDiffusion Language Modeling (MoE)
ArchitectureLLaDA2MoeModelLM with Hugging Face trust_remote_code
HF OrginclusionAI

Example Model and Recipes

$uv run automodel --nproc-per-node=8 examples/dllm_sft/llada2_sft.yaml

See the dLLM Fine-Tuning Guide.