NVIDIA TTS NIM Support Matrix#
This page describes the software and hardware that the NVIDIA TTS NIM supports.
Hardware#
The NVIDIA TTS NIM requires an NVIDIA GPU with a Compute Capability of 8.0 or higher and at least 16 GB of VRAM. Ensure that the models you deploy do not exceed the available GPU memory.
GPU |
Precision |
|---|---|
A30, A100 |
FP16 |
H100 |
FP16 |
A2, A10, A16, A40 |
FP16 |
L4, L40, GeForce RTX 40xx |
FP16 |
GeForce RTX 50xx |
FP16 |
Blackwell RTX 60xx |
FP16 |
DGX Spark |
FP16 |
Note
Magpie TTS Multilingual, Magpie TTS Zeroshot, and Chatterbox TTS Multilingual support the DGX Spark platform (Multilingual support extended in the Riva TTS NIM Release 1.10.0). On DGX Spark, Chatterbox TTS Multilingual provides only the batch_size=8 profile; refer to Chatterbox TTS Multilingual model profiles.
Software#
Linux operating systems (Ubuntu 22.04 or later recommended)
NVIDIA Driver >= 535
NVIDIA Docker >= 23.0.1
Supported Models#
The NVIDIA TTS NIM microservice supports the following Nemotron TTS models.
The microservice requires an NVIDIA GPU with Compute Capability >= 8.0. It automatically downloads a pre-built model when available for the target GPU or generates an optimized model on-the-fly using the RMIR model.
Model |
Languages Supported |
Inference Mode |
Publisher |
WSL Support |
Model Format |
|---|---|---|---|---|---|
English (en-US), Spanish (es-US), French (fr-FR), German (de-DE), Mandarin (zh-CN), Vietnamese (vi-VN), Italian (it-IT), Hindi (hi-IN), Japanese (ja-JP), Korean (ko-KR), Arabic (ar-XA), Portuguese (pt-BR) |
Streaming & Offline |
NVIDIA |
No |
Prebuilt, RMIR |
|
English (en-US), Spanish (es-US), French (fr-FR), German (de-DE), Mandarin (zh-CN), Vietnamese (vi-VN), Italian (it-IT), Hindi (hi-IN), Japanese (ja-JP), Arabic (ar-XA), Portuguese (pt-BR), Korean (ko-KR) |
Streaming & Offline |
NVIDIA |
No |
Prebuilt, RMIR |
|
Arabic (ar-SA), Danish (da-DK), German (de-DE), Greek (el-GR), English (en-US), Spanish (es-ES), Finnish (fi-FI), French (fr-FR), Hebrew (he-IL), Hindi (hi-IN), Italian (it-IT), Japanese (ja-JP), Korean (ko-KR), Malay (ms-MY), Dutch (nl-NL), Norwegian (nb-NO), Polish (pl-PL), Portuguese (pt-BR), Russian (ru-RU), Swedish (sv-SE), Swahili (sw-KE), Turkish (tr-TR), Mandarin (zh-CN) |
Streaming & Offline |
Resemble AI (community) |
No |
Prebuilt, RMIR |
Note
All models use FP16 precision.
Note
No TTS model currently supports Windows Subsystem for Linux (WSL2). For WSL2 deployments, refer to the ASR support matrix for the models that do.
Magpie TTS Multilingual#
This model supports text to speech in English (en-US), Spanish (es-US), French (fr-FR), German (de-DE), Mandarin (zh-CN), Vietnamese (vi-VN), Italian (it-IT), Hindi (hi-IN), Japanese (ja-JP), Korean (ko-KR), Arabic (ar-XA), and Portuguese (pt-BR).
To use this model, set CONTAINER_ID to magpie-tts-multilingual. Then, set NIM_TAGS_SELECTOR to one of the values from the following table as required. For more information, refer to Launching the TTS NIM.
Model Profiles#
Model Profile |
Inference Mode |
Host Memory (GiB) |
GPU Memory (GiB) |
|---|---|---|---|
|
offline and streaming |
5.182 |
12.58 |
|
offline and streaming |
5.208 |
41.46 |
|
offline and streaming |
5.258 |
74.74 |
Note
If NIM_TAGS_SELECTOR is not specified, the default model profile is batch_size=8.
Available Voices#
Magpie-Multilingual.EN-US.Mia
Magpie-Multilingual.EN-US.Mia.Neutral
Magpie-Multilingual.EN-US.Mia.Calm
Magpie-Multilingual.EN-US.Mia.Angry
Magpie-Multilingual.EN-US.Mia.Sad
Magpie-Multilingual.EN-US.Jason
Magpie-Multilingual.EN-US.Jason.Neutral
Magpie-Multilingual.EN-US.Jason.Calm
Magpie-Multilingual.EN-US.Jason.Angry
Magpie-Multilingual.EN-US.Jason.Happy
Magpie-Multilingual.EN-US.Aria
Magpie-Multilingual.EN-US.Aria.Neutral
Magpie-Multilingual.EN-US.Aria.Calm
Magpie-Multilingual.EN-US.Aria.Angry
Magpie-Multilingual.EN-US.Aria.Sad
Magpie-Multilingual.EN-US.Leo
Magpie-Multilingual.EN-US.Leo.Neutral
Magpie-Multilingual.EN-US.Leo.Calm
Magpie-Multilingual.EN-US.Leo.Angry
Magpie-Multilingual.EN-US.Leo.Sad
Magpie-Multilingual.EN-US.Sofia
Magpie-Multilingual.EN-US.Sofia.Neutral
Magpie-Multilingual.EN-US.Sofia.Calm
Magpie-Multilingual.EN-US.Sofia.Angry
Magpie-Multilingual.EN-US.Sofia.Fearful
Magpie-Multilingual.EN-US.Ray
Magpie-Multilingual.EN-US.Ray.Neutral
Magpie-Multilingual.EN-US.Ray.Calm
Magpie-Multilingual.EN-US.Ray.Angry
Magpie-Multilingual.EN-US.Ray.Fearful
Magpie-Multilingual.EN-US.Diego
Magpie-Multilingual.EN-US.Pascal
Magpie-Multilingual.EN-US.Isabela
Magpie-Multilingual.EN-US.Louise
Magpie-Multilingual.ES-US.Isabela
Magpie-Multilingual.ES-US.Isabela.Neutral
Magpie-Multilingual.ES-US.Isabela.Calm
Magpie-Multilingual.ES-US.Isabela.Sad
Magpie-Multilingual.ES-US.Isabela.Angry
Magpie-Multilingual.ES-US.Isabela.Happy
Magpie-Multilingual.ES-US.Diego
Magpie-Multilingual.ES-US.Diego.Neutral
Magpie-Multilingual.ES-US.Diego.Calm
Magpie-Multilingual.ES-US.Diego.Angry
Magpie-Multilingual.ES-US.Diego.Happy
Magpie-Multilingual.ES-US.Diego.PleasantSurprised
Magpie-Multilingual.ES-US.Ray
Magpie-Multilingual.ES-US.Jason
Magpie-Multilingual.ES-US.Leo
Magpie-Multilingual.ES-US.Pascal
Magpie-Multilingual.ES-US.Mia
Magpie-Multilingual.ES-US.Sofia
Magpie-Multilingual.ES-US.Aria
Magpie-Multilingual.ES-US.Louise
Magpie-Multilingual.FR-FR.Louise
Magpie-Multilingual.FR-FR.Pascal
Magpie-Multilingual.FR-FR.Pascal.Neutral
Magpie-Multilingual.FR-FR.Pascal.Calm
Magpie-Multilingual.FR-FR.Pascal.Happy
Magpie-Multilingual.FR-FR.Pascal.Sad
Magpie-Multilingual.FR-FR.Ray
Magpie-Multilingual.FR-FR.Jason
Magpie-Multilingual.FR-FR.Leo
Magpie-Multilingual.FR-FR.Diego
Magpie-Multilingual.FR-FR.Mia
Magpie-Multilingual.FR-FR.Sofia
Magpie-Multilingual.FR-FR.Aria
Magpie-Multilingual.FR-FR.Isabela
Magpie-Multilingual.DE-DE.Pascal
Magpie-Multilingual.DE-DE.Mia
Magpie-Multilingual.DE-DE.Diego
Magpie-Multilingual.DE-DE.Jason
Magpie-Multilingual.DE-DE.Ray
Magpie-Multilingual.DE-DE.Leo
Magpie-Multilingual.DE-DE.Sofia
Magpie-Multilingual.DE-DE.Isabela
Magpie-Multilingual.DE-DE.Aria
Magpie-Multilingual.DE-DE.Louise
Magpie-Multilingual.ZH-CN.HouZhen
Magpie-Multilingual.ZH-CN.Siwei
Magpie-Multilingual.ZH-CN.Diego
Magpie-Multilingual.ZH-CN.Pascal
Magpie-Multilingual.ZH-CN.Long
Magpie-Multilingual.ZH-CN.Jason
Magpie-Multilingual.ZH-CN.Isabela
Magpie-Multilingual.ZH-CN.Louise
Magpie-Multilingual.VI-VN.Long
Magpie-Multilingual.VI-VN.Long.Neutral
Magpie-Multilingual.VI-VN.Long.Calm
Magpie-Multilingual.VI-VN.Long.Sad
Magpie-Multilingual.VI-VN.Jason
Magpie-Multilingual.VI-VN.Louise
Magpie-Multilingual.VI-VN.Pascal
Magpie-Multilingual.VI-VN.Isabela
Magpie-Multilingual.VI-VN.Siwei
Magpie-Multilingual.VI-VN.Ray
Magpie-Multilingual.VI-VN.Sofia
Magpie-Multilingual.VI-VN.Mia
Magpie-Multilingual.VI-VN.Phung
Magpie-Multilingual.IT-IT.Isabela
Magpie-Multilingual.IT-IT.Pascal
Magpie-Multilingual.IT-IT.Diego
Magpie-Multilingual.IT-IT.Jason
Magpie-Multilingual.IT-IT.Ray
Magpie-Multilingual.IT-IT.Leo
Magpie-Multilingual.IT-IT.Mia
Magpie-Multilingual.IT-IT.Sofia
Magpie-Multilingual.IT-IT.Louise
Magpie-Multilingual.HI-IN.Siwei
Magpie-Multilingual.HI-IN.Leo
Magpie-Multilingual.HI-IN.Sofia
Magpie-Multilingual.HI-IN.Pascal
Magpie-Multilingual.HI-IN.Isabela
Magpie-Multilingual.HI-IN.Aria
Magpie-Multilingual.HI-IN.Louise
Magpie-Multilingual.HI-IN.Diego
Magpie-Multilingual.HI-IN.Long
Magpie-Multilingual.HI-IN.HouZhen
Magpie-Multilingual.HI-IN.Jason
Magpie-Multilingual.JA-JP.HouZhen
Magpie-Multilingual.JA-JP.Louise
Magpie-Multilingual.JA-JP.Isabela
Magpie-Multilingual.JA-JP.Ray
Magpie-Multilingual.JA-JP.Pascal
Magpie-Multilingual.JA-JP.Long
Magpie-Multilingual.JA-JP.Jason
Magpie-Multilingual.JA-JP.Siwei
Magpie-Multilingual.KO-KR.Louise
Magpie-Multilingual.KO-KR.Aria
Magpie-Multilingual.KO-KR.Pascal
Magpie-Multilingual.KO-KR.Diego
Magpie-Multilingual.KO-KR.Ray
Magpie-Multilingual.KO-KR.HouZhen
Magpie-Multilingual.KO-KR.Phung
Magpie-Multilingual.AR-XA.Sofia
Magpie-Multilingual.AR-XA.Ray
Magpie-Multilingual.AR-XA.Jason
Magpie-Multilingual.PT-BR.Diego
Magpie-Multilingual.PT-BR.Louise
Magpie-Multilingual.PT-BR.Isabela
Magpie TTS Zeroshot#
This model supports text to speech in English (en-US), Spanish (es-US), French (fr-FR), German (de-DE), Mandarin (zh-CN), Vietnamese (vi-VN), Italian (it-IT), Hindi (hi-IN), Japanese (ja-JP), Arabic (ar-XA), Portuguese (pt-BR), and Korean (ko-KR) languages. It synthesizes speech from input text using either a built-in voice or an audio prompt of three to ten seconds for zero-shot voice cloning.
To use this model, set CONTAINER_ID to magpie-tts-zeroshot. Then, set NIM_TAGS_SELECTOR to one of the values from the following table, based on your requirements. For more information, refer to Launching the TTS NIM.
Note
Access to Magpie TTS Zeroshot model is restricted. Apply for access
Model Profiles#
Model Profile |
Inference Mode |
CPU Memory (GB) |
GPU Memory (GB) |
|---|---|---|---|
|
offline and streaming |
4.00 |
13.06 |
|
offline and streaming |
7.08 |
41.30 |
Note
If NIM_TAGS_SELECTOR is not specified, the default model profile is batch_size=8.
Available Voices#
Magpie TTS Zeroshot provides built-in default voices and also supports zero-shot voice cloning from an audio prompt. The same voices are available across all supported languages.
Magpie-ZeroShot-Multilingual.Female (Default female speaker)
Magpie-ZeroShot-Multilingual.Male (Default male speaker)
Magpie-ZeroShot-Multilingual
Chatterbox TTS Multilingual#
Chatterbox TTS Multilingual is an end-to-end multilingual text-to-speech model that generates expressive and natural speech. The model uses a T3 architecture (text-to-speech token generation) paired with an S3Gen diffusion-based decoder using flow matching for high-fidelity audio generation. At 500M parameters, it supports Arabic, Danish, German, Greek, English, Spanish, Finnish, French, Hebrew, Hindi, Italian, Japanese, Korean, Malay, Dutch, Norwegian, Polish, Portuguese, Russian, Swedish, Swahili, Turkish, and Chinese.
Features include emotion exaggeration control for adjusting expressiveness intensity.
Note
Chatterbox TTS Multilingual is a community model hosted on NVIDIA NIM for accelerated inference. It is not owned or developed by NVIDIA. The model is licensed under the MIT License; use of this API is governed by the NVIDIA API Trial Service Terms of Use.
To use this model, set CONTAINER_ID to chatterbox-tts-multilingual. Then, set NIM_TAGS_SELECTOR to the value from the following table. For more information, refer to Launching the TTS NIM.
Model Profiles#
Model Profile |
Inference Mode |
Supported GPUs |
Host Memory (GiB) |
GPU Memory (GiB) |
|---|---|---|---|---|
|
offline and streaming |
A100, H100, L40S, DGX Spark |
4.86 |
44.61 |
|
offline and streaming |
A100, H100, L40S |
5.40 |
46.84 |
|
offline and streaming |
A100, H100, L40S |
5.54 |
49.72 |
Note
If NIM_TAGS_SELECTOR is not specified, the default model profile is batch_size=8.
Note
On DGX Spark, only the batch_size=8 profile is available. Setting NIM_TAGS_SELECTOR to batch_size=32 or batch_size=64 on DGX Spark causes deployment to fail because no matching profile exists. To list the profiles that are compatible with your system, run the container with the nim_list_model_profiles entrypoint.
Available Voices#
Chatterbox TTS Multilingual ships with a single built-in default speaker per locale.
Chatterbox-Multilingual.ar-SA.Male
Chatterbox-Multilingual.da-DK.Male
Chatterbox-Multilingual.de-DE.Male
Chatterbox-Multilingual.el-GR.Male
Chatterbox-Multilingual.en-US.Male
Chatterbox-Multilingual.es-ES.Male
Chatterbox-Multilingual.fi-FI.Male
Chatterbox-Multilingual.fr-FR.Male
Chatterbox-Multilingual.he-IL.Male
Chatterbox-Multilingual.hi-IN.Male
Chatterbox-Multilingual.it-IT.Male
Chatterbox-Multilingual.ja-JP.Male
Chatterbox-Multilingual.ko-KR.Male
Chatterbox-Multilingual.ms-MY.Male
Chatterbox-Multilingual.nl-NL.Male
Chatterbox-Multilingual.nb-NO.Male
Chatterbox-Multilingual.pl-PL.Male
Chatterbox-Multilingual.pt-BR.Male
Chatterbox-Multilingual.ru-RU.Male
Chatterbox-Multilingual.sv-SE.Male
Chatterbox-Multilingual.sw-KE.Male
Chatterbox-Multilingual.tr-TR.Male
Chatterbox-Multilingual.zh-CN.Male
Supported Locales#
Locale |
Language |
|---|---|
|
Arabic |
|
Danish |
|
German |
|
Greek |
|
English |
|
Spanish |
|
Finnish |
|
French |
|
Hebrew |
|
Hindi |
|
Italian |
|
Japanese |
|
Korean |
|
Malay |
|
Dutch |
|
Norwegian |
|
Polish |
|
Portuguese |
|
Russian |
|
Swedish |
|
Swahili |
|
Turkish |
|
Mandarin |