> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/automodel/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/automodel/_mcp/server.

# nemo_automodel.components.quantization.qlora

## Module Contents

### Functions

| Name                                                                                                   | Description                                        |
| ------------------------------------------------------------------------------------------------------ | -------------------------------------------------- |
| [`create_bnb_config`](#nemo_automodel-components-quantization-qlora-create_bnb_config)                 | Create BitsAndBytes config for quantization.       |
| [`verify_qlora_quantization`](#nemo_automodel-components-quantization-qlora-verify_qlora_quantization) | Verify that the model has been properly quantized. |

### API

```python
nemo_automodel.components.quantization.qlora.create_bnb_config(
    config: dict
)
```

Create BitsAndBytes config for quantization.

```python
nemo_automodel.components.quantization.qlora.verify_qlora_quantization(
    model
) -> bool
```

Verify that the model has been properly quantized.