Model CoverageLarge Language ModelsQwenQwen2.5-7B-Instruct

Qwen2.5-7B-Instruct

View as Markdown

Qwen2.5 is Qwen’s latest series of large language models for text generation. The Qwen2.5-7B-Instruct checkpoint uses the Qwen2ForCausalLM architecture and supports long-context extension through YaRN.

Set up NeMo AutoModel with the latest container or follow the installation instructions.

Fine-Tune Qwen2.5-7B-Instruct

From the repository root, run:

uv run automodel --nproc-per-node=8 examples/llm_finetune/qwen/qwen2_5_7b_squad.yaml

Choose a Workflow

GoalStart Here
Supervised fine-tuning (SFT) - Qwen2.5 7B on SQuADUse qwen2_5_7b_squad.yaml.

Model Reference

Model Architecture

PropertyValue
TaskText Generation
ArchitectureQwen2ForCausalLM
Parameters7B
Hugging Face OrganizationQwen

Available Models

ModelHF ID
Qwen2.5 7B InstructQwen/Qwen2.5-7B-Instruct
Qwen2.5 7B BaseQwen/Qwen2.5-7B