LLaDA

LLaDA is a diffusion language model that generates text through iterative masked-token denoising.

Example Model and Recipes

$
uv run automodel --nproc-per-node=8 examples/dllm_sft/llada_sft.yaml

See the dLLM Fine-Tuning Guide.