NIM Model Profile Table#
Each NIM_MODEL_PROFILE downloads a specific Model Type on the supported GPU.
Note
If NIM_MODEL_PROFILE is not set, the NIM automatically selects a matching NIM_MODEL_PROFILE based on the target GPU architecture; that is, SM (Streaming Multiprocessor) values.
Model Type#
Model Type |
Description |
|---|---|
48k-HQ |
High Quality Model that supports input audio of sample rate 48KHz |
16k-HQ |
High Quality Model that supports input audio of sample rate 16KHz |
48k-LL |
Streaming-compatible Model that supports input audio of sample rate 48KHz |
NIM Model Profile Table#
GPU |
SM |
Model Type |
NIM_MODEL_PROFILE |
|---|---|---|---|
T4 |
7.5 |
16k-HQ |
a6cfbbfa20970a5c0cc014c826c4c557272d54f396d8557f6e0bb54621d097b8 |
T4 |
7.5 |
48k-HQ |
85ad4b65868a94b4f2eb209f318c9223e627857b9bcc60fa79c762c597132457 |
T4 |
7.5 |
48k-LL |
2abc25ab9e3f9af93fdcdb841a70df3304bbdaeeb8ffcb093f695c1d8bf7786c |
A30, A100 |
8.0 |
16k-HQ |
bc9ad330fae98975d8b9dab17f1ce997731b24a909d6a8aabee227aa92bd9662 |
A30, A100 |
8.0 |
48k-HQ |
086a81bc6a86d999bd1178a98f6f52d54854d07a6bf56b17ca9951f161816821 |
A30, A100 |
8.0 |
48k-LL |
3c18815498e29ccc7354147304f9fe357528b604a3f0f1408ca5c7a31169375a |
A2, A10, A16, A40 |
8.6 |
16k-HQ |
ea79e39e048174a8a1a3594587478f349b9883314e8fc1364a001dc61c19e0c8 |
A2, A10, A16, A40 |
8.6 |
48k-HQ |
73770c9a8cfcb7137e112be314446a408bd0bc6ecbbf46f04e4ac5ac2236f720 |
A2, A10, A16, A40 |
8.6 |
48k-LL |
8333225ad9afe3c756a8e885304c3643b9c7eb6ad5cb5b394f60d9a68dd8fdf2 |
L4, L40, RTX 4090 |
8.9 |
16k-HQ |
db4dd58beca3c1aa896f370c0be12c31847adee32ec3753a42b65ef92ef1406c |
L4, L40, RTX 4090 |
8.9 |
48k-HQ |
5e8adc3a96952760d614e72885ae84b9ccc7a8a2f3b280a180e7e82e08b87bc6 |
L4, L40, RTX 4090 |
8.9 |
48k-LL |
a43c8e61ba45a9fc9d045ebade971480fbc204e791e7499394ab052dc668ffb1 |
H100 |
9.0 |
16k-HQ |
89972993b8e80e5cdde60fd4f9c29c52770820b37524adfa4eb5e13442ca95ed |
H100 |
9.0 |
48k-HQ |
3183e192b882d331fe777df91d4c4608456fa316880c01a46b93c8c801450186 |
H100 |
9.0 |
48k-LL |
d88656445941d1d89c89553f8a64701cb9322a208650d828ac5a3b3c864525e4 |
B100, B200 |
10.0 |
16k-HQ |
aabe653128cea6de02a3872e055a81dc10c3aef125d1f7034dc1fe57fbc9b35f |
B100, B200 |
10.0 |
48k-HQ |
5fe5fb20134e51d4c99fc4f445e55528f968d12a6703334ed021dda41589861a |
B100, B200 |
10.0 |
48k-LL |
73425c7f49c1bbc8b88c7cc4817e9cb8a56fcd0da1b7c31d4c5c7713f2995433 |
B40, RTX 5090, RTX 5080, RTX PRO 6000 Blackwell Server Edition |
12.0 |
16k-HQ |
d691328d467beae5107d9295792661f8915b9d4f20c6dc58912b0ccadbbdff26 |
B40, RTX 5090, RTX 5080, RTX PRO 6000 Blackwell Server Edition |
12.0 |
48k-HQ |
0e88773e67c60b7b372d8a6b12035246e26b5ed56c099b456edf41f98d2445e1 |
B40, RTX 5090, RTX 5080, RTX PRO 6000 Blackwell Server Edition |
12.0 |
48k-LL |
679219b680fc9592f8b0e0a00ee422fc4ea1f42c668a95d83aeeaed964212a97 |