NIM Model Profile Table#
Each NIM_MODEL_PROFILE downloads a specific Model Type on the supported GPU.
Note
If NIM_MODEL_PROFILE is not set, the NIM automatically selects a matching NIM_MODEL_PROFILE based on the target GPU architecture; that is, SM (Streaming Multiprocessor) values.
Model Type#
Model Type |
Description |
|---|---|
48k-HQ |
High Quality Model that supports input audio of sample rate 48KHz |
16k-HQ |
High Quality Model that supports input audio of sample rate 16KHz |
48k-LL |
Streaming-compatible Model that supports input audio of sample rate 48KHz |
NIM Model Profile Table#
GPU |
SM |
Model Type |
NIM_MODEL_PROFILE |
|---|---|---|---|
V100 |
7.0 |
16k-HQ |
bcb8f1044ef0442c3a32803a8243689bf0655285ac104093cbed4b9678d569f5 |
V100 |
7.0 |
48k-HQ |
3439d26178388d0b446db063de000bc9f69281bdc39a29b634ffd9bb60b153a6 |
V100 |
7.0 |
48k-LL |
594f83cafb93f42248b98fa21dbe7ad8903c25bb12f2bd75fd444dec567c7781 |
T4 |
7.5 |
16k-HQ |
08a8fb42c18f688edd772089f82aede3dd85f15f22eeec49cc861f69076c347b |
T4 |
7.5 |
48k-HQ |
eb0bfe75ea1dac2a6ec455f8c84e7ebefe846ddea27047f799ed315bda5b8872 |
T4 |
7.5 |
48k-LL |
385614918597e8bf85cef5989b8d356eb23d51ae1e5943597eccac266166b470 |
A30, A100 |
8.0 |
16k-HQ |
8e78a4f3b961c0d2fd7bf136cc640c21ac5f04a4584cabc6b8fc8bb4ad5c8028 |
A30, A100 |
8.0 |
48k-HQ |
1f272e3f334ba89406f408888789e7a9b9133328b2ddcee8d6da6890beb76779 |
A30, A100 |
8.0 |
48k-LL |
4c301f4b8458c7ee7ed7f832450080c623bbed9eb3fa7ee0d308fa388ebb36ae |
A2, A10, A16, A40 |
8.6 |
16k-HQ |
aa2a68f978cf894875763e3b95ca24d7928432b92dbbe6095270fc8fbd311f5a |
A2, A10, A16, A40 |
8.6 |
48k-HQ |
11b24f59b33a1ca3f54c78761862bf739fdbab4965b718a48e9dfefcec494517 |
A2, A10, A16, A40 |
8.6 |
48k-LL |
c86e86a11386e44d6bb211080f5634a48b61b5616c8dfb2c200777108cc2c194 |
L4, L40/S/G, RTX 4080, RTX 4090, RTX 6000 Ada |
8.9 |
16k-HQ |
69b6141a2e7db01206fe47bee4b58cf75df64363a84ca52cf126137f1514f6df |
L4, L40/S/G, RTX 4080, RTX 4090, RTX 6000 Ada |
8.9 |
48k-HQ |
cc5593fc2b52bd814110cf1f241e182ff08334690a9373daacbd89b8bb7f4318 |
L4, L40/S/G, RTX 4080, RTX 4090, RTX 6000 Ada |
8.9 |
48k-LL |
f58c87109ca66e3f31617c3734402efb50277c5931de7527185dea0593bbb128 |
H100 |
9.0 |
16k-HQ |
6009a6e116dee78ffcaed2cdd77b6079f8b75dc80123edfe8a17ad7a9d040c0e |
H100 |
9.0 |
48k-HQ |
f9085cdc3fb4fd0324fd393085ab77e248e05f361ae20fe79b13f39a926f26d8 |
H100 |
9.0 |
48k-LL |
800680db9ee1a4e4c9413ae962e3579e8c1f55fc3c53501169a909c3ce8c34d5 |
RTX 5090, 5080, 5070 |
12.0 |
16k-HQ |
1f2d6833e9919940374784f04bb791ce332de00952558a86e1e837c951fae0f0 |
RTX 5090, 5080, 5070 |
12.0 |
48k-HQ |
09578326cb86ae3bad8920046996f3b49747843123ac5580b38dde2db288c133 |
RTX 5090, 5080, 5070 |
12.0 |
48k-LL |
9ace3619e8d6db08c6bbcceb9c29fafde944eca5c3acf82adf961450fcb80a99 |