NVIDIA TTS NIM Support Matrix#

This page describes the software and hardware that the NVIDIA TTS NIM supports.

Hardware#

The NVIDIA TTS NIM requires an NVIDIA GPU with a Compute Capability of 8.0 or higher and at least 16 GB of VRAM. Ensure that the models you deploy do not exceed the available GPU memory.

GPU

Precision

A30, A100

FP16

H100

FP16

A2, A10, A16, A40

FP16

L4, L40, GeForce RTX 40xx

FP16

GeForce RTX 50xx

FP16

Blackwell RTX 60xx

FP16

DGX Spark

FP16

Note

Magpie TTS Multilingual, Magpie TTS Zeroshot, and Chatterbox TTS Multilingual support the DGX Spark platform (Multilingual support extended in the Riva TTS NIM Release 1.10.0). On DGX Spark, Chatterbox TTS Multilingual provides only the batch_size=8 profile; refer to Chatterbox TTS Multilingual model profiles.

Software#

  • Linux operating systems (Ubuntu 22.04 or later recommended)

  • NVIDIA Driver >= 535

  • NVIDIA Docker >= 23.0.1

Supported Models#

The NVIDIA TTS NIM microservice supports the following Nemotron TTS models.

The microservice requires an NVIDIA GPU with Compute Capability >= 8.0. It automatically downloads a pre-built model when available for the target GPU or generates an optimized model on-the-fly using the RMIR model.

Model

Languages Supported

Inference Mode

Publisher

WSL Support

Model Format

Magpie TTS Multilingual

English (en-US), Spanish (es-US), French (fr-FR), German (de-DE), Mandarin (zh-CN), Vietnamese (vi-VN), Italian (it-IT), Hindi (hi-IN), Japanese (ja-JP), Korean (ko-KR), Arabic (ar-XA), Portuguese (pt-BR)

Streaming & Offline

NVIDIA

No

Prebuilt, RMIR

Magpie TTS Zeroshot

English (en-US), Spanish (es-US), French (fr-FR), German (de-DE), Mandarin (zh-CN), Vietnamese (vi-VN), Italian (it-IT), Hindi (hi-IN), Japanese (ja-JP), Arabic (ar-XA), Portuguese (pt-BR), Korean (ko-KR)

Streaming & Offline

NVIDIA

No

Prebuilt, RMIR

Chatterbox TTS Multilingual

Arabic (ar-SA), Danish (da-DK), German (de-DE), Greek (el-GR), English (en-US), Spanish (es-ES), Finnish (fi-FI), French (fr-FR), Hebrew (he-IL), Hindi (hi-IN), Italian (it-IT), Japanese (ja-JP), Korean (ko-KR), Malay (ms-MY), Dutch (nl-NL), Norwegian (nb-NO), Polish (pl-PL), Portuguese (pt-BR), Russian (ru-RU), Swedish (sv-SE), Swahili (sw-KE), Turkish (tr-TR), Mandarin (zh-CN)

Streaming & Offline

Resemble AI (community)

No

Prebuilt, RMIR

Note

All models use FP16 precision.

Note

No TTS model currently supports Windows Subsystem for Linux (WSL2). For WSL2 deployments, refer to the ASR support matrix for the models that do.

Magpie TTS Multilingual#

This model supports text to speech in English (en-US), Spanish (es-US), French (fr-FR), German (de-DE), Mandarin (zh-CN), Vietnamese (vi-VN), Italian (it-IT), Hindi (hi-IN), Japanese (ja-JP), Korean (ko-KR), Arabic (ar-XA), and Portuguese (pt-BR).

To use this model, set CONTAINER_ID to magpie-tts-multilingual. Then, set NIM_TAGS_SELECTOR to one of the values from the following table as required. For more information, refer to Launching the TTS NIM.

Model Profiles#

Model Profile
(Selected using NIM_TAGS_SELECTOR)

Inference Mode

Host Memory (GiB)

GPU Memory (GiB)

batch_size=8

offline and streaming

5.182

12.58

batch_size=32

offline and streaming

5.208

41.46

batch_size=64

offline and streaming

5.258

74.74

Note

If NIM_TAGS_SELECTOR is not specified, the default model profile is batch_size=8.

Available Voices#

Magpie-Multilingual.EN-US.Mia
Magpie-Multilingual.EN-US.Mia.Neutral
Magpie-Multilingual.EN-US.Mia.Calm
Magpie-Multilingual.EN-US.Mia.Angry
Magpie-Multilingual.EN-US.Mia.Sad
Magpie-Multilingual.EN-US.Jason
Magpie-Multilingual.EN-US.Jason.Neutral
Magpie-Multilingual.EN-US.Jason.Calm
Magpie-Multilingual.EN-US.Jason.Angry
Magpie-Multilingual.EN-US.Jason.Happy
Magpie-Multilingual.EN-US.Aria
Magpie-Multilingual.EN-US.Aria.Neutral
Magpie-Multilingual.EN-US.Aria.Calm
Magpie-Multilingual.EN-US.Aria.Angry
Magpie-Multilingual.EN-US.Aria.Sad
Magpie-Multilingual.EN-US.Leo
Magpie-Multilingual.EN-US.Leo.Neutral
Magpie-Multilingual.EN-US.Leo.Calm
Magpie-Multilingual.EN-US.Leo.Angry
Magpie-Multilingual.EN-US.Leo.Sad
Magpie-Multilingual.EN-US.Sofia
Magpie-Multilingual.EN-US.Sofia.Neutral
Magpie-Multilingual.EN-US.Sofia.Calm
Magpie-Multilingual.EN-US.Sofia.Angry
Magpie-Multilingual.EN-US.Sofia.Fearful
Magpie-Multilingual.EN-US.Ray
Magpie-Multilingual.EN-US.Ray.Neutral
Magpie-Multilingual.EN-US.Ray.Calm
Magpie-Multilingual.EN-US.Ray.Angry
Magpie-Multilingual.EN-US.Ray.Fearful
Magpie-Multilingual.EN-US.Diego
Magpie-Multilingual.EN-US.Pascal
Magpie-Multilingual.EN-US.Isabela
Magpie-Multilingual.EN-US.Louise
Magpie-Multilingual.ES-US.Isabela
Magpie-Multilingual.ES-US.Isabela.Neutral
Magpie-Multilingual.ES-US.Isabela.Calm
Magpie-Multilingual.ES-US.Isabela.Sad
Magpie-Multilingual.ES-US.Isabela.Angry
Magpie-Multilingual.ES-US.Isabela.Happy
Magpie-Multilingual.ES-US.Diego
Magpie-Multilingual.ES-US.Diego.Neutral
Magpie-Multilingual.ES-US.Diego.Calm
Magpie-Multilingual.ES-US.Diego.Angry
Magpie-Multilingual.ES-US.Diego.Happy
Magpie-Multilingual.ES-US.Diego.PleasantSurprised
Magpie-Multilingual.ES-US.Ray
Magpie-Multilingual.ES-US.Jason
Magpie-Multilingual.ES-US.Leo
Magpie-Multilingual.ES-US.Pascal
Magpie-Multilingual.ES-US.Mia
Magpie-Multilingual.ES-US.Sofia
Magpie-Multilingual.ES-US.Aria
Magpie-Multilingual.ES-US.Louise
Magpie-Multilingual.FR-FR.Louise
Magpie-Multilingual.FR-FR.Pascal
Magpie-Multilingual.FR-FR.Pascal.Neutral
Magpie-Multilingual.FR-FR.Pascal.Calm
Magpie-Multilingual.FR-FR.Pascal.Happy
Magpie-Multilingual.FR-FR.Pascal.Sad
Magpie-Multilingual.FR-FR.Ray
Magpie-Multilingual.FR-FR.Jason
Magpie-Multilingual.FR-FR.Leo
Magpie-Multilingual.FR-FR.Diego
Magpie-Multilingual.FR-FR.Mia
Magpie-Multilingual.FR-FR.Sofia
Magpie-Multilingual.FR-FR.Aria
Magpie-Multilingual.FR-FR.Isabela
Magpie-Multilingual.DE-DE.Pascal
Magpie-Multilingual.DE-DE.Mia
Magpie-Multilingual.DE-DE.Diego
Magpie-Multilingual.DE-DE.Jason
Magpie-Multilingual.DE-DE.Ray
Magpie-Multilingual.DE-DE.Leo
Magpie-Multilingual.DE-DE.Sofia
Magpie-Multilingual.DE-DE.Isabela
Magpie-Multilingual.DE-DE.Aria
Magpie-Multilingual.DE-DE.Louise
Magpie-Multilingual.ZH-CN.HouZhen
Magpie-Multilingual.ZH-CN.Siwei
Magpie-Multilingual.ZH-CN.Diego
Magpie-Multilingual.ZH-CN.Pascal
Magpie-Multilingual.ZH-CN.Long
Magpie-Multilingual.ZH-CN.Jason
Magpie-Multilingual.ZH-CN.Isabela
Magpie-Multilingual.ZH-CN.Louise
Magpie-Multilingual.VI-VN.Long
Magpie-Multilingual.VI-VN.Long.Neutral
Magpie-Multilingual.VI-VN.Long.Calm
Magpie-Multilingual.VI-VN.Long.Sad
Magpie-Multilingual.VI-VN.Jason
Magpie-Multilingual.VI-VN.Louise
Magpie-Multilingual.VI-VN.Pascal
Magpie-Multilingual.VI-VN.Isabela
Magpie-Multilingual.VI-VN.Siwei
Magpie-Multilingual.VI-VN.Ray
Magpie-Multilingual.VI-VN.Sofia
Magpie-Multilingual.VI-VN.Mia
Magpie-Multilingual.VI-VN.Phung
Magpie-Multilingual.IT-IT.Isabela
Magpie-Multilingual.IT-IT.Pascal
Magpie-Multilingual.IT-IT.Diego
Magpie-Multilingual.IT-IT.Jason
Magpie-Multilingual.IT-IT.Ray
Magpie-Multilingual.IT-IT.Leo
Magpie-Multilingual.IT-IT.Mia
Magpie-Multilingual.IT-IT.Sofia
Magpie-Multilingual.IT-IT.Louise
Magpie-Multilingual.HI-IN.Siwei
Magpie-Multilingual.HI-IN.Leo
Magpie-Multilingual.HI-IN.Sofia
Magpie-Multilingual.HI-IN.Pascal
Magpie-Multilingual.HI-IN.Isabela
Magpie-Multilingual.HI-IN.Aria
Magpie-Multilingual.HI-IN.Louise
Magpie-Multilingual.HI-IN.Diego
Magpie-Multilingual.HI-IN.Long
Magpie-Multilingual.HI-IN.HouZhen
Magpie-Multilingual.HI-IN.Jason
Magpie-Multilingual.JA-JP.HouZhen
Magpie-Multilingual.JA-JP.Louise
Magpie-Multilingual.JA-JP.Isabela
Magpie-Multilingual.JA-JP.Ray
Magpie-Multilingual.JA-JP.Pascal
Magpie-Multilingual.JA-JP.Long
Magpie-Multilingual.JA-JP.Jason
Magpie-Multilingual.JA-JP.Siwei
Magpie-Multilingual.KO-KR.Louise
Magpie-Multilingual.KO-KR.Aria
Magpie-Multilingual.KO-KR.Pascal
Magpie-Multilingual.KO-KR.Diego
Magpie-Multilingual.KO-KR.Ray
Magpie-Multilingual.KO-KR.HouZhen
Magpie-Multilingual.KO-KR.Phung
Magpie-Multilingual.AR-XA.Sofia
Magpie-Multilingual.AR-XA.Ray
Magpie-Multilingual.AR-XA.Jason
Magpie-Multilingual.PT-BR.Diego
Magpie-Multilingual.PT-BR.Louise
Magpie-Multilingual.PT-BR.Isabela

Magpie TTS Zeroshot#

This model supports text to speech in English (en-US), Spanish (es-US), French (fr-FR), German (de-DE), Mandarin (zh-CN), Vietnamese (vi-VN), Italian (it-IT), Hindi (hi-IN), Japanese (ja-JP), Arabic (ar-XA), Portuguese (pt-BR), and Korean (ko-KR) languages. It synthesizes speech from input text using either a built-in voice or an audio prompt of three to ten seconds for zero-shot voice cloning.

To use this model, set CONTAINER_ID to magpie-tts-zeroshot. Then, set NIM_TAGS_SELECTOR to one of the values from the following table, based on your requirements. For more information, refer to Launching the TTS NIM.

Note

Access to Magpie TTS Zeroshot model is restricted. Apply for access

Model Profiles#

Model Profile
(Selected using NIM_TAGS_SELECTOR)

Inference Mode

CPU Memory (GB)

GPU Memory (GB)

batch_size=8

offline and streaming

4.00

13.06

batch_size=32

offline and streaming

7.08

41.30

Note

If NIM_TAGS_SELECTOR is not specified, the default model profile is batch_size=8.

Available Voices#

Magpie TTS Zeroshot provides built-in default voices and also supports zero-shot voice cloning from an audio prompt. The same voices are available across all supported languages.

Magpie-ZeroShot-Multilingual.Female  (Default female speaker)
Magpie-ZeroShot-Multilingual.Male    (Default male speaker)
Magpie-ZeroShot-Multilingual

Chatterbox TTS Multilingual#

Chatterbox TTS Multilingual is an end-to-end multilingual text-to-speech model that generates expressive and natural speech. The model uses a T3 architecture (text-to-speech token generation) paired with an S3Gen diffusion-based decoder using flow matching for high-fidelity audio generation. At 500M parameters, it supports Arabic, Danish, German, Greek, English, Spanish, Finnish, French, Hebrew, Hindi, Italian, Japanese, Korean, Malay, Dutch, Norwegian, Polish, Portuguese, Russian, Swedish, Swahili, Turkish, and Chinese.

Features include emotion exaggeration control for adjusting expressiveness intensity.

Note

Chatterbox TTS Multilingual is a community model hosted on NVIDIA NIM for accelerated inference. It is not owned or developed by NVIDIA. The model is licensed under the MIT License; use of this API is governed by the NVIDIA API Trial Service Terms of Use.

To use this model, set CONTAINER_ID to chatterbox-tts-multilingual. Then, set NIM_TAGS_SELECTOR to the value from the following table. For more information, refer to Launching the TTS NIM.

Model Profiles#

Model Profile
(Selected using NIM_TAGS_SELECTOR)

Inference Mode

Supported GPUs

Host Memory (GiB)

GPU Memory (GiB)

batch_size=8

offline and streaming

A100, H100, L40S, DGX Spark

4.86

44.61

batch_size=32

offline and streaming

A100, H100, L40S

5.40

46.84

batch_size=64

offline and streaming

A100, H100, L40S

5.54

49.72

Note

If NIM_TAGS_SELECTOR is not specified, the default model profile is batch_size=8.

Note

On DGX Spark, only the batch_size=8 profile is available. Setting NIM_TAGS_SELECTOR to batch_size=32 or batch_size=64 on DGX Spark causes deployment to fail because no matching profile exists. To list the profiles that are compatible with your system, run the container with the nim_list_model_profiles entrypoint.

Available Voices#

Chatterbox TTS Multilingual ships with a single built-in default speaker per locale.

Chatterbox-Multilingual.ar-SA.Male
Chatterbox-Multilingual.da-DK.Male
Chatterbox-Multilingual.de-DE.Male
Chatterbox-Multilingual.el-GR.Male
Chatterbox-Multilingual.en-US.Male
Chatterbox-Multilingual.es-ES.Male
Chatterbox-Multilingual.fi-FI.Male
Chatterbox-Multilingual.fr-FR.Male
Chatterbox-Multilingual.he-IL.Male
Chatterbox-Multilingual.hi-IN.Male
Chatterbox-Multilingual.it-IT.Male
Chatterbox-Multilingual.ja-JP.Male
Chatterbox-Multilingual.ko-KR.Male
Chatterbox-Multilingual.ms-MY.Male
Chatterbox-Multilingual.nl-NL.Male
Chatterbox-Multilingual.nb-NO.Male
Chatterbox-Multilingual.pl-PL.Male
Chatterbox-Multilingual.pt-BR.Male
Chatterbox-Multilingual.ru-RU.Male
Chatterbox-Multilingual.sv-SE.Male
Chatterbox-Multilingual.sw-KE.Male
Chatterbox-Multilingual.tr-TR.Male
Chatterbox-Multilingual.zh-CN.Male

Supported Locales#

Locale

Language

ar-SA

Arabic

da-DK

Danish

de-DE

German

el-GR

Greek

en-US

English

es-ES

Spanish

fi-FI

Finnish

fr-FR

French

he-IL

Hebrew

hi-IN

Hindi

it-IT

Italian

ja-JP

Japanese

ko-KR

Korean

ms-MY

Malay

nl-NL

Dutch

nb-NO

Norwegian

pl-PL

Polish

pt-BR

Portuguese

ru-RU

Russian

sv-SE

Swedish

sw-KE

Swahili

tr-TR

Turkish

zh-CN

Mandarin

Known Limitations#

  • English quality is strongest. Non-English languages have reported issues with pronunciation, mixed-language output, hallucinated words, and speed-up artifacts. See upstream issues #268, #254, #271, #327.