NIM Model Profile Table

Each NIM_MODEL_PROFILE downloads a specific Model Type on the supported GPU.

Note

If NIM_MODEL_PROFILE is not set, the NIM selects the lexicographically first profile from the manifest as the default profile. In the packaged model_manifest.yaml, the default profile corresponds to the V100 GPU and 48k-LL model.

Model Type

Model Type

Description

48k-HQ

High Quality Model that supports input audio of sample rate 48KHz

16k-HQ

High Quality Model that supports input audio of sample rate 16KHz

48k-LL

Streaming-compatible Model that supports input audio of sample rate 48KHz

Note

Maxine Studio Voice NIM supports the 48k-LL model in transactional mode only, for quality evaluation purposes.

NIM Model Profile Table

GPU

SM

Model Type

NIM_MODEL_PROFILE

V100

7.0

48k-HQ

bcbe1ffab71681633b40f5a2e196081a5e0a88f3cee3222066de22bd4d6170c9

V100

7.0

16k-HQ

709f4e223efcdaa9e08c6ad86d1a74310a6522e6e22040cc3be34b8ff8513be5

V100

7.0

48k-LL

0059b177f5101759673f25671ee9658fbb5fa15f5daa243f0a9d30ea950f2302

T4

7.5

48k-HQ

a90825aeddbbd7120796baf2a44ffbae23eead15d6ce8bfb8432c02a90a0415b

T4

7.5

16k-HQ

8177768613329d67d17075e5a95cebbbf75441639adf8276cfe85f4543234bc5

T4

7.5

48k-LL

adb3d4fc80027f38b424728df95e9d4f4f00232d099e35d909e771b2788f7708

A30, A100

8.0

48k-HQ

b2b66398e0de8776b66429ca4ad1e93c9f4f6646a6c04b2efa1c39baee539cd5

A30, A100

8.0

16k-HQ

9c58b34c224dc9817c8c1e9e50222dbab2b8dcf5ed4875bbde57421adede9017

A30, A100

8.0

48k-LL

0a18facd4d20878b1da9824fdaddef674551c0aaeaa1f661d42772f15bf110bf

A2, A10, A16, A40

8.6

48k-HQ

d108d683f66c30a0c0b3036840d7c81f9191deec5265a95e16f6d8f2bd71b7d8

A2, A10, A16, A40

8.6

16k-HQ

797baefa4e4047fa46fd2db475dbd4fab5c6489a1e743f37fc934b0a2abc44a2

A2, A10, A16, A40

8.6

48k-LL

aa3743bca805f3345b643d3373776fff9fb147d39b9a89c551b4d0e24687a52e

L4, L40/S/G

8.9

48k-HQ

f14baca66186936413d065bf02829e1a702b0bbf2fb69eb28e26432f6095a229

L4, L40/S/G

8.9

16k-HQ

0964f6e9a4c591ba9649c49f678d49d8e17469670b5e2fa53c60e4e95405a16c

L4, L40/S/G

8.9

48k-LL

5e2f26f075c35fa73876eb40dfa6ff646a4a7de0971192c4f08091c113721e64

H100

9.0

48k-HQ

145350ad39d905713fff192b52d89b553dd536cc1eb0bc74d48b82c33aa10b4d

H100

9.0

16k-HQ

e24037d48b23129d7df5601b77efcf730dec79b6ea92d1c176c7e6912c4e8105

H100

9.0

48k-LL

0c28de0077cb66e6ed53a700bebe7be9d378658a3a090ba1c7966eda0c79111d