Skip to navigation

Alert Verification Performance

View as Markdown

Overview

The VSS Alert Bridge verification pipeline processes live RTSP streams through CV detection and analytics (RTVI-CV and video-analytics microservices) and a VLM stage to classify and confirm security alerts. Benchmarks measure end-to-end (E2E) latency, VLM and VST stage latency, and verified alert throughput across the NVIDIA RTX PRO 4500, RTX PRO 6000, DGX H100 SXM, DGX Spark, and AGX Thor platforms using RT-DETR and Grounding DINO (GDINO) with Cosmos3 Nano Reasoner (CR3) precision variants.

Test Configuration

ParameterValue
VSS Release3.3
Platforms testedNVIDIA RTX PRO 4500, RTX PRO 6000, DGX H100 SXM, DGX Spark, AGX Thor
CV modelsRT-DETR, Grounding DINO (GDINO)
VLMCosmos3 Nano Reasoner (CR3)
VLM precisionBF16, FP8, NVFP4 (platform- and model-dependent)
Stream concurrency1–50 concurrent RTSP streams (platform-dependent)
Configured stream FPS10
Video resolution1920x1080 (1080p)
OSL1
Test dateJuly 2026

Performance by Platform

RT-DETR with Cosmos3 Nano Reasoner (CR3).

StreamsPrecisionE2E Avg (s)E2E P90 (s)E2E P99 (s)VLM P90 (s)VST P90 (s)Verified/min/stream
1BF160.730.900.990.910.254.68
40BF1612.3525.0736.389.190.092.92
40FP87.9713.4622.274.730.094.58
40NVFP47.2812.3314.744.710.094.60

All benchmarks use input streams at 1080p, H.264 input.

For dGPU platform tests (NVIDIA RTX PRO 4500, RTX PRO 6000, and DGX H100 SXM), two GPUs were used: one GPU dedicated to RTVI-CV and one GPU dedicated to RTVI-VLM.