> This page is for NVIDIA Active Speaker Detection on Holoscan for Media, version 1.0.0 (Latest) (default).
> For other versions, use one of these documentation indexes:
> - 1.0.0 (Latest) (default): https://docs.nvidia.com/nim/maxine/active-speaker-detection-h4m/1.0.0/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nim/maxine/llms.txt.

# Limitations and Known Behaviors

## Audio Stream Requirements

Individual input audio streams must contain only a single speaker's audio. During silence, audio samples must be zero. If background noise is present, enable audio thresholding via `useAudioThresholdToDetectActiveAudioStream` and `audioThresholdDb`. For details, refer to [Configuration Reference](/nim/maxine/active-speaker-detection-h4m/configuration/pipeline#active-speaker-detection-pipeline-tuning).

## Latency

The Active Speaker Detection model requires an initial 3-second processing window to produce its first result. A look-ahead queue then buffers output frames—default 30 frames at 30 fps ≈ 1 second—to ensure smooth downstream transmission. This gives a fixed end-to-end latency of approximately 4 seconds at 30 fps with default settings.

The look-ahead queue depth is configurable via `outputFrameBufferSize`. For parameter details, refer to [Configuration reference](/nim/maxine/active-speaker-detection-h4m/configuration/pipeline#active-speaker-detection-pipeline-tuning).

## Throughput

The Active Speaker Detection NIM is optimized to adhere to SMPTE ST 2110 real-time processing standards. Performance scales with the number of tracked faces, diarized audio streams, and the GPU SKU used. Higher-end GPUs and lighter workloads achieve greater throughput, while more demanding combinations (more faces and more audio streams) require more compute.