Skip to navigation

NIM Model Profile Table

View as MarkdownOpen in Claude

Each NIM_MODEL_PROFILE downloads a specific Model Type on the supported GPU.

If NIM_MODEL_PROFILE is not set, the NIM automatically selects a matching NIM_MODEL_PROFILE based on the target GPU architecture; that is, SM (Streaming Multiprocessor) values.

Model Type

Model TypeDescription
48k-HQHigh Quality Model that supports input audio of sample rate 48KHz
16k-HQHigh Quality Model that supports input audio of sample rate 16KHz
48k-LLStreaming-compatible Model that supports input audio of sample rate 48KHz

NIM Model Profile Table

GPUSMModel TypeNIM_MODEL_PROFILE
V1007.016k-HQbcb8f1044ef0442c3a32803a8243689bf0655285ac104093cbed4b9678d569f5
V1007.048k-HQ3439d26178388d0b446db063de000bc9f69281bdc39a29b634ffd9bb60b153a6
V1007.048k-LL594f83cafb93f42248b98fa21dbe7ad8903c25bb12f2bd75fd444dec567c7781
T47.516k-HQ08a8fb42c18f688edd772089f82aede3dd85f15f22eeec49cc861f69076c347b
T47.548k-HQeb0bfe75ea1dac2a6ec455f8c84e7ebefe846ddea27047f799ed315bda5b8872
T47.548k-LL385614918597e8bf85cef5989b8d356eb23d51ae1e5943597eccac266166b470
A30, A1008.016k-HQ8e78a4f3b961c0d2fd7bf136cc640c21ac5f04a4584cabc6b8fc8bb4ad5c8028
A30, A1008.048k-HQ1f272e3f334ba89406f408888789e7a9b9133328b2ddcee8d6da6890beb76779
A30, A1008.048k-LL4c301f4b8458c7ee7ed7f832450080c623bbed9eb3fa7ee0d308fa388ebb36ae
A2, A10, A16, A408.616k-HQaa2a68f978cf894875763e3b95ca24d7928432b92dbbe6095270fc8fbd311f5a
A2, A10, A16, A408.648k-HQ11b24f59b33a1ca3f54c78761862bf739fdbab4965b718a48e9dfefcec494517
A2, A10, A16, A408.648k-LLc86e86a11386e44d6bb211080f5634a48b61b5616c8dfb2c200777108cc2c194
L4, L40/S/G, RTX 4080, RTX 4090, RTX 6000 Ada8.916k-HQ69b6141a2e7db01206fe47bee4b58cf75df64363a84ca52cf126137f1514f6df
L4, L40/S/G, RTX 4080, RTX 4090, RTX 6000 Ada8.948k-HQcc5593fc2b52bd814110cf1f241e182ff08334690a9373daacbd89b8bb7f4318
L4, L40/S/G, RTX 4080, RTX 4090, RTX 6000 Ada8.948k-LLf58c87109ca66e3f31617c3734402efb50277c5931de7527185dea0593bbb128
H1009.016k-HQ6009a6e116dee78ffcaed2cdd77b6079f8b75dc80123edfe8a17ad7a9d040c0e
H1009.048k-HQf9085cdc3fb4fd0324fd393085ab77e248e05f361ae20fe79b13f39a926f26d8
H1009.048k-LL800680db9ee1a4e4c9413ae962e3579e8c1f55fc3c53501169a909c3ce8c34d5
RTX 5090, 5080, 507012.016k-HQ1f2d6833e9919940374784f04bb791ce332de00952558a86e1e837c951fae0f0
RTX 5090, 5080, 507012.048k-HQ09578326cb86ae3bad8920046996f3b49747843123ac5580b38dde2db288c133
RTX 5090, 5080, 507012.048k-LL9ace3619e8d6db08c6bbcceb9c29fafde944eca5c3acf82adf961450fcb80a99