`nemo_export.trt_llm.qnemo.utils`#

Module Contents#

Functions#

is_qnemo_checkpoint

Detect if a given path is a TensorRT-LLM a.k.a. “qnemo” checkpoint based on config & tensor data presence.

Data#

`CONFIG_NAME`
`WEIGHTS_NAME`

API#

nemo_export.trt_llm.qnemo.utils.CONFIG_NAME = 'config.json'#

nemo_export.trt_llm.qnemo.utils.WEIGHTS_NAME = 'rank{}.safetensors'#

nemo_export.trt_llm.qnemo.utils.is_qnemo_checkpoint(path: str) → bool[source]#: Detect if a given path is a TensorRT-LLM a.k.a. “qnemo” checkpoint based on config & tensor data presence.