Model CoverageLarge Language ModelsQwenQwen3-0.6B

Qwen3-0.6B

View as Markdown

Qwen3 is Alibaba Cloud’s third-generation dense language model series, featuring improved reasoning, instruction following, and multilingual capabilities over Qwen2.

Set up NeMo AutoModel with the latest container or follow the installation instructions.

Fine-Tune Qwen3-0.6B

From the repository root, run:

uv run automodel --nproc-per-node=8 examples/llm_finetune/qwen/qwen3_0p6b_hellaswag.yaml

Choose a Workflow

GoalStart Here
Supervised fine-tuning (SFT) - Qwen3 0.6B on HellaSwagUse qwen3_0p6b_hellaswag.yaml.

Model Reference

Model Architecture

PropertyValue
TaskText Generation
ArchitectureQwen3ForCausalLM
Parameters0.6B
Hugging Face OrganizationQwen

Available Models

ModelHF ID
Qwen3 0.6BQwen/Qwen3-0.6B