> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/automodel/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/automodel/_mcp/server.

# granite-3.0-1b-a400m-base

> Reference granite-3.0-1b-a400m-base checkpoint and architecture details for NeMo AutoModel, with model-family information, setup guidance, and upstream resources.

IBM Granite MoE models extend the Granite architecture with Mixture-of-Experts layers for more efficient scaling. PowerMoE (IBM Research) also uses this architecture.

Use this page as a checkpoint and architecture reference. Set up NeMo AutoModel with the
[latest container](https://catalog.ngc.nvidia.com/orgs/nvidia/containers/nemo-automodel) or follow the
[installation instructions](/get-started/installation).

## Model Reference

### Model Architecture

| Property                  | Value                                             |
| ------------------------- | ------------------------------------------------- |
| Task                      | Text Generation (MoE)                             |
| Architecture              | `GraniteMoeForCausalLM`                           |
| Parameters                | 1B total / 400M active                            |
| Hugging Face Organization | [ibm-granite](https://huggingface.co/ibm-granite) |

* `GraniteMoeForCausalLM`
* `GraniteMoeSharedForCausalLM` - variant with shared experts

### Available Models

| Model                     | HF ID                                                                                                   |
| ------------------------- | ------------------------------------------------------------------------------------------------------- |
| Granite 3.0 1B A400M Base | [`ibm-granite/granite-3.0-1b-a400m-base`](https://huggingface.co/ibm-granite/granite-3.0-1b-a400m-base) |

## Related Resources

* [LLM Fine-Tuning Guide](/recipes-e2e-examples/sft-peft)