Skip to navigation

NIM Model Profile Table

View as MarkdownOpen in Claude

Each NIM_MODEL_PROFILE downloads a specific Model Type on the supported GPU.

If NIM_MODEL_PROFILE is not set, the NIM automatically selects a matching NIM_MODEL_PROFILE based on the target GPU architecture; that is, SM (Streaming Multiprocessor) values.

Model Type

Model TypeDescription
48k-HQHigh Quality Model that supports input audio of sample rate 48KHz
16k-HQHigh Quality Model that supports input audio of sample rate 16KHz
48k-LLStreaming-compatible Model that supports input audio of sample rate 48KHz

NIM Model Profile Table

GPUSMModel TypeNIM_MODEL_PROFILE
T47.516k-HQ669026efdaf09bc9fb3bcfc63761ae981f588bafc2e17c201f3747484f405ff2
T47.548k-HQa81adf7c20f5c53ad6622afd38768a980bc62f536dba16cdff32e03505fd3044
T47.548k-LLd4a05fd85322c89b2593de7bb90dff8f51c6e065476c127abdd3de7bc94a29cc
A30, A1008.016k-HQ333b238d3b4e5393b7c3ef5da4321027a6c89a24f22cda08eefb6b02aae31a12
A30, A1008.048k-HQa0ef5f245313252c7c48f5ba2660b7457e388a6ac6b51c24c87845a1ec3498b3
A30, A1008.048k-LL49ed404d6a0ce29e83ed33cc3cfb9a4c0dbb3ca200c53743efc9f57a45c95b92
A2, A10, A16, A408.616k-HQ26fa7ba0f7f609439db66983da76e5863958a5367096e111ec33ada2a3f62b4d
A2, A10, A16, A408.648k-HQ0cd76f5d9cbfc7054ed4c7164dcfb9fa2427963f4df80ec3d5ccb80db2311b9b
A2, A10, A16, A408.648k-LL0cc07261902d91a87f12dff8c5b028b49b98afafc95130d61b069141ac021be6
L4, L40, RTX 40908.916k-HQfc6090cd82ff3e918cba9e6b82b1bb72932ce4ec45979584f2a2bd248429302d
L4, L40, RTX 40908.948k-HQb4f601e14bb68d8f11f2f6ad38ed84e150fb197653f3125362aab9a9e1c7fc20
L4, L40, RTX 40908.948k-LL32ad9bfbc222aa6f74c62898be9269c81523a7bc877fab7cb21268f47ef1fbfb
H1009.016k-HQacc77362f0a2b0570a618caf97bcb9d45d8d64e18b2c79098a940ea88afc932c
H1009.048k-HQa0fb1bacd8fb1b15a22aee2809cae8c8cac83ddf43681ab7f49720363d7f9606
H1009.048k-LLda9c18295abb1cf2b273a6fc48ed9633d45872fc1ba5a344d9aaf15c1c83a893
B100, B20010.016k-HQ1ce3a6a13c0eeffab093af91d26c36bdf1dd01c6bab85001514f9fc930c8c6a6
B100, B20010.048k-HQ937b741a8b77ae95ba009b63839991c1f3ab4007bab67398adde9ace57d0edaf
B100, B20010.048k-LLe9ae7b9757846cb5f76d23b345d5d2a4691876d32e13ce661e51735e4a4583e1
B40, RTX 5090, RTX 5080, RTX PRO 6000 Blackwell Server Edition12.016k-HQ074ef77e62d3b29ae4042d7dfeb59c5ccbbe780516fc3f3a018724354f1df6d0
B40, RTX 5090, RTX 5080, RTX PRO 6000 Blackwell Server Edition12.048k-HQ6b3aaa8aa06da73326c853b4e9c5bf4f9634f63c594f84a943eaf330967a32b1
B40, RTX 5090, RTX 5080, RTX PRO 6000 Blackwell Server Edition12.048k-LL25321fe0e1b6fb55ba1413cef670bed81ec90e19817788de039fb30f26b0e054