> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/automodel/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/automodel/_mcp/server.

# Nemotron-Flash-1B

> Use Nemotron-Flash-1B with NeMo AutoModel for language model fine-tuning, with documented checkpoints, runnable recipes, setup guidance, and model reference details.

[NVIDIA Nemotron-Flash](https://huggingface.co/nvidia/Nemotron-Flash-1B) is a compact, fast language model designed for low-latency inference workloads.

> **Note**
>
> This model requires `trust_remote_code: true` in your recipe YAML.

Set up NeMo AutoModel with the [latest container](https://catalog.ngc.nvidia.com/orgs/nvidia/containers/nemo-automodel) or follow the [installation instructions](/get-started/installation).

## Fine-Tune Nemotron-Flash-1B

From the repository root, run:

```bash
uv run automodel --nproc-per-node=8 examples/llm_finetune/nemotron_flash/nemotron_flash_1b_squad.yaml
```

## Choose a Workflow

| Goal                                                      | Start Here                                                                                                                                                              |
| --------------------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| Supervised fine-tuning (SFT) - Nemotron-Flash 1B on SQuAD | Use [nemotron\_flash\_1b\_squad.yaml](https://github.com/NVIDIA-NeMo/Automodel/blob/main/examples/llm_finetune/nemotron_flash/nemotron_flash_1b_squad.yaml).            |
| Low-rank adaptation (LoRA) - Nemotron-Flash 1B on SQuAD   | Use [nemotron\_flash\_1b\_squad\_peft.yaml](https://github.com/NVIDIA-NeMo/Automodel/blob/main/examples/llm_finetune/nemotron_flash/nemotron_flash_1b_squad_peft.yaml). |

## Model Reference

### Model Architecture

| Property                  | Value                                   |
| ------------------------- | --------------------------------------- |
| Task                      | Text Generation                         |
| Architecture              | `NemotronFlashForCausalLM`              |
| Parameters                | 1B                                      |
| Hugging Face Organization | [nvidia](https://huggingface.co/nvidia) |

### Available Models

| Model             | HF ID                                                                         |
| ----------------- | ----------------------------------------------------------------------------- |
| Nemotron-Flash 1B | [`nvidia/Nemotron-Flash-1B`](https://huggingface.co/nvidia/Nemotron-Flash-1B) |

## Related Resources

* [LLM Fine-Tuning Guide](/recipes-e2e-examples/sft-peft)