Qwen3-30B-A3B | NVIDIA NeMo AutoModel

Qwen3 MoE is the Mixture-of-Experts variant of the Qwen3 series from Alibaba Cloud, activating a small fraction of parameters per token for efficient large-scale training.

Set up NeMo AutoModel with the latest container or follow the installation instructions.

Fine-Tune Qwen3-30B-A3B

From the repository root, run:

uv run automodel --nproc-per-node=8 examples/llm_finetune/qwen/qwen3_moe_30b_te_deepep.yaml

Choose a Workflow

Goal	Start Here
Supervised fine-tuning (SFT) - Qwen3 MoE 30B with TE + DeepEP	Use qwen3_moe_30b_te_deepep.yaml.
Low-rank adaptation (LoRA) - Qwen3 MoE 30B	Use qwen3_moe_30b_lora.yaml.

Model Reference

Model Architecture

Property	Value
Task	Text Generation (MoE)
Architecture	`Qwen3MoeForCausalLM`
Parameters	30B total / 3B active
Hugging Face Organization	Qwen

Available Models

Model	HF ID
Qwen3 30B A3B	`Qwen/Qwen3-30B-A3B`

LLM Fine-Tuning Guide
Large MoE Fine-Tuning Guide

Fine-Tune Qwen3-30B-A3B

Choose a Workflow

Model Reference

Model Architecture

Available Models

Related Resources