Skip to navigation

This page covers NIM service chart Helm values and environment variables specific to the Active Speaker Detection pipeline, including tuning parameters, media format, and SMPTE ST 2110 session wiring.


Active Speaker Detection Pipeline Tuning

ConfigurationHelm Key (pipeline.*)Environment VariableComment
Sync tolerance (minimum score to treat a face as speaking)syncToleranceAI4M_ACTIVESPEAKERDETECTION_SYNC_TOLERANCEDefault: 0.5986; valid range: (0, 1); invalid values fall back to default at process start.
Bounding box overlay on output videotestFrameOverlayModeAI4M_ACTIVESPEAKERDETECTION_TEST_FRAME_OVERLAY_MODEtrue or false; when enabled, draws active-speaker bounding boxes on output video.
Output frame buffer sizeoutputFrameBufferSizeAI4M_ACTIVESPEAKERDETECTION_OUTPUT_FRAME_BUFFER_SIZEDefault: 30 frames; adds ~size / fps seconds of latency to the ~3 sec model latency.
Audio silence detectionuseAudioThresholdToDetectActiveAudioStreamAI4M_ACTIVESPEAKERDETECTION_USE_AUDIO_THRESHOLD_TO_DETECT_ACTIVE_AUDIO_STREAMDefault: false; allowed: true or false.
Audio silence thresholdaudioThresholdDbAI4M_ACTIVESPEAKERDETECTION_AUDIO_THRESHOLD_DBDefault: -40.0 dB; used when audio silence detection is enabled.

Video Raster

The video raster defines the fixed picture format of the incoming SMPTE ST 2110-20 stream. These Helm keys tell the NIM the raster of the incoming video so that decoding, audio sync, and inference stay consistent.

ConfigurationHelm KeyComment
Width and heightvideo.width, video.heightSupported: 720p, 1080p (default), 4K UHD; refer to Support Matrix.
Frame ratevideo.framerateNum, video.framerateDenMust match the upstream sender and downstream receiver.

Audio Format

ConfigurationHelm KeyComment
PCM formataudio.pcmFormatExample: S24BE
Sample rateaudio.samplingRateExample: 48000 Hz
Channelsaudio.numChannelsPer logical stream

SMPTE ST 2110 Input Sessions

ConfigurationHelm KeyComment
Video sessioninput.video.sessionName, input.video.localInterfaceName, input.video.hostIp, input.video.hostPort, input.video.hostNumSubnetBits, input.video.flushFrameCountThresholdMulticast IP address and port must match the upstream sender pipeline; site-specific. flushFrameCountThreshold: consecutive stale frames allowed before flush and resync (default: 3).
Audio sessioninput.audio.sessionName, input.audio.localInterfaceName, input.audio.hostIp, input.audio.hostPort, input.audio.hostNumSubnetBits, input.audio.numStreamsMulticast IP address and port must match the upstream sender pipeline. numStreams must match the number of diarized audio streams.

SMPTE ST 2110 Output Sessions

For video and ancillary outputs, multicast hostIp and hostPort must match the multicast host IP address and host port configured on the downstream receiver pipeline. (Receivers must subscribe to the same groups and ports this NIM transmits on.)

ConfigurationHelm KeyComment
Ancillary (SMPTE ST 2110-40)output.ancillaryData.sessionName, output.ancillaryData.localInterfaceName, output.ancillaryData.hostIp, output.ancillaryData.hostPort, output.ancillaryData.hostNumSubnetBitsActive-speaker detection results as ancillary data. For application payload layout, refer to Ancillary Data Payload.
Video outoutput.video.sessionName, output.video.localInterfaceName, output.video.hostIp, output.video.hostPort, output.video.hostNumSubnetBitsSMPTE ST 2110-20 program video; site-specific session name, interface, and subnet mask length.

NIM Pod Resources

ResourceRequestsLimits
cpu1212
hugepages-2Mi8Gi8Gi
memory8Gi8Gi
nvidia.com/gpu11

The cpu value is set to 12 cores by default, tuned for real-time ST 2110 performance. You can reduce it, but the value must be consistent with env.CPU_AFFINITY.

env.CPU_AFFINITY (default "0-7") pins the NIM process to a contiguous range of CPU cores. The chart validates at deploy time that the values of resources.requests.cpu and resources.limits.cpu are each equal to or greater than the number of cores in the affinity range.

SettingHelm KeyDefault
CPU affinity rangeenv.CPU_AFFINITY"0-7" (8 cores)

The default cpu (12) is intentionally greater than CPU_AFFINITY ("0-7", 8 cores)—the pinned range covers the NIM workload minimum, and the remaining cores are available to Kubernetes. To configure the cores, keep resources.requests.cpu, resources.limits.cpu, and env.CPU_AFFINITY consistent. If cpu falls below the affinity range, the chart fails during installation with a descriptive error.


Logging

ConfigurationHelm KeyComment
Log levellogging.level0 FATAL, 1 ERROR, 2 WARN, 3 INFO (default), 4 DEBUG, 5 VERBOSE.

See Also