Performance
The performance of NV-CLIP NIM is calculated by measuring the end to end latency of the API call. It is the average over 100 iterations.
Latency values are in seconds; throughput values are inputs per second.
GPU |
Precision |
Input Type |
Resolution |
Batch Size |
Latency |
Throughput |
|---|---|---|---|---|---|---|
| H100 SXM | FP16 | Image | 350x197 | 64 | 0.2568 | 249.22 |
| H100 PCIe | FP16 | Image | 350x197 | 64 | 0.2568 | 249.22 |
| A100 SXM | FP16 | Image | 350x197 | 64 | 0.3968 | 160.57 |
| A100 PCIe | FP16 | Image | 350x197 | 64 | 0.3968 | 160.57 |
| L40S | FP16 | Image | 350x197 | 64 | 0.3562 | 179.67 |
| A10G | FP16 | Image | 350x197 | 64 | 0.615 | 104.07 |
| A6000 Ada | FP16 | Image | 350x197 | 64 | 0.3701 | 172.93 |
| RTX 4090 | FP16 | Image | 350x197 | 64 | 0.339 | 188.78 |