Performance Results
The NVIDIA Eye Contact NIM supports multiple concurrent inputs per GPU. The following table shows the performance data for various concurrency levels on various GPUs with the provided sample input files and the Python client.
The average FPS is calculated by dividing the sum of number of frames in the input video files by the total inference time in seconds (measured from the time the concurrent requests are sent until complete output files are received by the client). This metric helps determine the effective performance scaling when running multiple inputs simultaneously.
For more information, refer to the Maxine NIM clients Github repository: NVIDIA-Maxine/nim-clients.