gemma-7b

View as Markdown

Gemma 1 is the first generation of Google’s open-weight Gemma language models.

Fine-Tune gemma-7b

From the repository root, run:

uv run automodel --nproc-per-node=8 examples/llm_finetune/gemma/gemma_7b_squad.yaml

Model Reference

Model Architecture

PropertyValue
TaskText Generation
ArchitectureGemmaForCausalLM
Parameters2B, 7B
HF Orggoogle

Example Models and Recipes

See the Installation Guide and LLM Fine-Tuning Guide.