> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/automodel/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/automodel/_mcp/server.

# MiniCPM5-1B

> Use MiniCPM5-1B with NeMo AutoModel for language model fine-tuning, with documented checkpoints, a runnable starting command, setup guidance, and model reference details.

[MiniCPM](https://github.com/OpenBMB/MiniCPM) is a compact language model series from OpenBMB and Tsinghua University, designed to deliver strong performance at small parameter counts using model merging and continuous training techniques.

Set up NeMo AutoModel with the [latest container](https://catalog.ngc.nvidia.com/orgs/nvidia/containers/nemo-automodel) or follow the [installation instructions](/get-started/installation).

## Fine-Tune MiniCPM5-1B

From the repository root, run:

```bash
# Full fine-tuning
uv run automodel examples/llm_finetune/minicpm/minicpm5_1b_squad.yaml --nproc-per-node 8

# LoRA fine-tuning
uv run automodel examples/llm_finetune/minicpm/minicpm5_1b_squad_peft.yaml --nproc-per-node 8
```

## Model Reference

### Model Architecture

| Property                  | Value                                                                |
| ------------------------- | -------------------------------------------------------------------- |
| Task                      | Text Generation                                                      |
| Architecture              | `MiniCPMForCausalLM` / `MiniCPM3ForCausalLM` / `MiniCPM5ForCausalLM` |
| Parameters                | 1B                                                                   |
| Hugging Face Organization | [openbmb](https://huggingface.co/openbmb)                            |

* `MiniCPMForCausalLM` - MiniCPM v1/v2
* `MiniCPM3ForCausalLM` - MiniCPM3
* `MiniCPM5ForCausalLM` - MiniCPM5

### Available Models

| Model       | HF ID                                                               |
| ----------- | ------------------------------------------------------------------- |
| MiniCPM5 1B | [`openbmb/MiniCPM5-1B`](https://huggingface.co/openbmb/MiniCPM5-1B) |

## Related Resources

* [LLM Fine-Tuning Guide](/recipes-e2e-examples/sft-peft)