Text-To-Speech (Latest)
Text-To-Speech (Latest)

nim/riva/tts/latest/tts-performance-table.html

# of streams

Latency to first audio (ms)

Latency between audio chunks (ms)

Throughput (RTFX)

avg

p90

p95

p99

avg

p90

p95

p99

1

22

24.2

25

25.3

2.84

3.1

3.15

4.02

150.8

4

40

50

60

70

5

8

9

12

340

8

63

84

90

100

8

12

14

18

420

16

120

143

154

200

14.3

17.8

19.4

23

460

32

323

340

355

390

14.5

17.9

19.9

23.9

440

© Copyright © 2024, NVIDIA Corporation. Last updated on Aug 6, 2024.