Skip to navigation

Performance Results

View as MarkdownOpen in Claude

Performance data

The following table shows the performance data for the LipSync NIM for concurrent streams on a single GPU with the provided sample input files and the Python client. The LipSync NIM supports concurrent streams per GPU. The number of concurrent streams can be configured using the NIM_MAX_CONCURRENCY_PER_GPU environment variable (default: 1). Higher concurrency values consume more GPU memory and can cause out-of-memory errors.

GPUInput Video ResolutionConcurrencyAverage FPS
RTX PRO 6000 Blackwell Server Edition720p150
720p235
720p427
1080p142
1080p227
1080p417
4K133
4K221
RTX L40S720p150
720p235
720p424
1080p142
1080p227
1080p417
4K132
4K221
RTX L4720p122
720p213
720p47
1080p120
1080p213
1080p46
4K117
4K213
RTX A10G720p122
720p212
720p46
1080p120
1080p213
1080p46
4K117
4K212
RTX 5090720p162
720p237
720p420
1080p147
1080p232
1080p420
4K133
4K221
RTX 5080720p152
720p229
720p415
1080p137
1080p228
1080p415
4K129
4K218
RTX 4090720p157
720p235
720p419
1080p145
1080p230
1080p418
4K132
4K220

The inference FPS is calculated by dividing the total number of frames in input video file by the total inference time in seconds (measured from the time the request is sent until complete output file is received by the client).

Note: Video extension operations significantly increase processing time and memory usage due to frame buffering.

For more information, refer to the NIM clients Github repository: NVIDIA-Maxine/nim-clients.