> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/automodel/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/automodel/_mcp/server.

# Mistral-Small-4-119B-2603

> Use Mistral-Small-4-119B-2603 with NeMo AutoModel for vision-language fine-tuning, with documented checkpoints, runnable recipes, setup, and model reference details.

[Mistral-Small-4-119B](https://huggingface.co/mistralai/Mistral-Small-4-119B-2603) is Mistral AI's multimodal MoE model supporting both text and image inputs at scale.

Set up NeMo AutoModel with the [latest container](https://catalog.ngc.nvidia.com/orgs/nvidia/containers/nemo-automodel) or follow the [installation instructions](/get-started/installation).

## Fine-Tune Mistral-Small-4-119B-2603

> **Note**
>
> This recipe was validated on **4 nodes x 8 GPUs (32 H100s)**. See the [Launcher Guide](/job-launchers/slurm-cluster) for multi-node setup.

From the repository root, run:

```bash
uv run automodel --nproc-per-node=8 examples/vlm_finetune/mistral4/mistral4_medpix.yaml
```

## Choose a Workflow

| Goal                                                     | Start Here                                                                                                                                                |
| -------------------------------------------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------- |
| Supervised fine-tuning (SFT) - Mistral-Small-4 on MedPix | Use [mistral4\_medpix.yaml](https://github.com/NVIDIA-NeMo/Automodel/blob/main/examples/vlm_finetune/mistral4/mistral4_medpix.yaml). Dataset: MedPix-VQA. |

## Model Reference

### Model Architecture

| Property                  | Value                                         |
| ------------------------- | --------------------------------------------- |
| Task                      | Image-Text-to-Text                            |
| Architecture              | `MistralForConditionalGeneration`             |
| Parameters                | 119B (MoE)                                    |
| Hugging Face Organization | [mistralai](https://huggingface.co/mistralai) |

### Available Models

| Model                | HF ID                                                                                               |
| -------------------- | --------------------------------------------------------------------------------------------------- |
| Mistral-Small-4 119B | [`mistralai/Mistral-Small-4-119B-2603`](https://huggingface.co/mistralai/Mistral-Small-4-119B-2603) |

## Related Resources

* [VLM Fine-Tuning Guide](/recipes-e2e-examples/gemma-3-3n)