Devstral-2-123B-Instruct-2512 | NVIDIA NeMo AutoModel

Devstral-2-123B-Instruct-2512 is a text-only, code-focused checkpoint from Mistral AI. NeMo AutoModel includes a LoRA fine-tuning recipe for the checkpoint.

Set up NeMo AutoModel with the latest container or follow the installation instructions.

Fine-Tune Devstral-2-123B-Instruct-2512

Run the checked-in recipe on one node with eight GPUs:

uv run automodel examples/llm_finetune/devstral/devstral2_123b_2512_squad_peft.yaml \
  --nproc-per-node 8

Choose a Workflow

Goal	Start Here
LoRA fine-tuning on SQuAD	Use devstral2_123b_2512_squad_peft.yaml.

Model Reference

Model Architecture

Property	Value
Task	Text Generation
Architecture	`Ministral3ForCausalLM`
Strategy	FSDP2 with tensor parallelism 8 and LoRA
Hugging Face Organization	mistralai

Available Models

mistralai/Devstral-2-123B-Instruct-2512

LLM Fine-Tuning Guide

Fine-Tune Devstral-2-123B-Instruct-2512

Choose a Workflow

Model Reference

Model Architecture

Available Models

Related Resources