Skip to navigation

NIM Model Profile Table

View as MarkdownOpen in Claude

Each NIM_MODEL_PROFILE downloads a specific Model Type on the supported GPU.

If NIM_MODEL_PROFILE is not set, the NIM automatically selects a matching NIM_MODEL_PROFILE based on the target GPU architecture; that is, SM (Streaming Multiprocessor) values.

Model Type

Model TypeDescription
48k-HQHigh Quality Model that supports input audio of sample rate 48KHz
16k-HQHigh Quality Model that supports input audio of sample rate 16KHz
48k-LLStreaming-compatible Model that supports input audio of sample rate 48KHz

NIM Model Profile Table

GPUSMModel TypeNIM_MODEL_PROFILE
T47.516k-HQa6cfbbfa20970a5c0cc014c826c4c557272d54f396d8557f6e0bb54621d097b8
T47.548k-HQ85ad4b65868a94b4f2eb209f318c9223e627857b9bcc60fa79c762c597132457
T47.548k-LL2abc25ab9e3f9af93fdcdb841a70df3304bbdaeeb8ffcb093f695c1d8bf7786c
A30, A1008.016k-HQbc9ad330fae98975d8b9dab17f1ce997731b24a909d6a8aabee227aa92bd9662
A30, A1008.048k-HQ086a81bc6a86d999bd1178a98f6f52d54854d07a6bf56b17ca9951f161816821
A30, A1008.048k-LL3c18815498e29ccc7354147304f9fe357528b604a3f0f1408ca5c7a31169375a
A2, A10, A16, A408.616k-HQea79e39e048174a8a1a3594587478f349b9883314e8fc1364a001dc61c19e0c8
A2, A10, A16, A408.648k-HQ73770c9a8cfcb7137e112be314446a408bd0bc6ecbbf46f04e4ac5ac2236f720
A2, A10, A16, A408.648k-LL8333225ad9afe3c756a8e885304c3643b9c7eb6ad5cb5b394f60d9a68dd8fdf2
L4, L40, RTX 40908.916k-HQdb4dd58beca3c1aa896f370c0be12c31847adee32ec3753a42b65ef92ef1406c
L4, L40, RTX 40908.948k-HQ5e8adc3a96952760d614e72885ae84b9ccc7a8a2f3b280a180e7e82e08b87bc6
L4, L40, RTX 40908.948k-LLa43c8e61ba45a9fc9d045ebade971480fbc204e791e7499394ab052dc668ffb1
H1009.016k-HQ89972993b8e80e5cdde60fd4f9c29c52770820b37524adfa4eb5e13442ca95ed
H1009.048k-HQ3183e192b882d331fe777df91d4c4608456fa316880c01a46b93c8c801450186
H1009.048k-LLd88656445941d1d89c89553f8a64701cb9322a208650d828ac5a3b3c864525e4
B100, B20010.016k-HQaabe653128cea6de02a3872e055a81dc10c3aef125d1f7034dc1fe57fbc9b35f
B100, B20010.048k-HQ5fe5fb20134e51d4c99fc4f445e55528f968d12a6703334ed021dda41589861a
B100, B20010.048k-LL73425c7f49c1bbc8b88c7cc4817e9cb8a56fcd0da1b7c31d4c5c7713f2995433
B40, RTX 5090, RTX 5080, RTX PRO 6000 Blackwell Server Edition12.016k-HQd691328d467beae5107d9295792661f8915b9d4f20c6dc58912b0ccadbbdff26
B40, RTX 5090, RTX 5080, RTX PRO 6000 Blackwell Server Edition12.048k-HQ0e88773e67c60b7b372d8a6b12035246e26b5ed56c099b456edf41f98d2445e1
B40, RTX 5090, RTX 5080, RTX PRO 6000 Blackwell Server Edition12.048k-LL679219b680fc9592f8b0e0a00ee422fc4ea1f42c668a95d83aeeaed964212a97