Neural Machine Translation (Latest)
Neural Machine Translation (Latest)

nim/riva/nmt/latest/translation-performance-table.html

batch size

translations/second

p90

p95

p99

1

2.5204

0.699321

0.909914

1.29494

2

3.30693

1.08113

1.35028

1.89888

4

4.22761

1.74112

1.97779

3.14655

8

4.6737

2.98084

3.74519

6.52791

© Copyright © 2024, NVIDIA Corporation. Last updated on Aug 6, 2024.