LLaDA-8B-Base

LLaDA is a diffusion language model that generates text through iterative masked-token denoising.

Fine-Tune LLaDA-8B-Base

From the repository root, run:

uv run automodel --nproc-per-node=8 examples/dllm_sft/llada_sft.yaml

Model Reference

Model Architecture

Example Model and Recipes

See the dLLM Fine-Tuning Guide.