For AI agents: a documentation index is available at the root level at /llms.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
This page is for version Latest.
For other versions, use one of these documentation indexes:
- Nightly (default): https://docs.nvidia.com/nemo/automodel/nightly/llms.txt
- Latest: https://docs.nvidia.com/nemo/automodel/latest/llms.txt
- 0.7.0 · 26.10: https://docs.nvidia.com/nemo/automodel/v0.7/llms.txt
- 0.5.0 · 26.06: https://docs.nvidia.com/nemo/automodel/v0.5/llms.txt
- 0.4.0 · 26.04: https://docs.nvidia.com/nemo/automodel/v0.4/llms.txt
The I-DLM recipe converts the autoregressive Qwen/Qwen3-8B checkpoint into a diffusion language model using an all-masked block-diffusion objective.
Fine-Tune Qwen3-8B
From the repository root, run:
uv run torchrun --nproc-per-node=8 nemo_automodel/recipes/dllm/train_ft.py \