Overview
NVIDIA Background Noise Removal (BNR) NIM removes unwanted background noise from speech and improves intelligibility in noisy live-production environments. The NIM ingests a single PCM audio stream over SMPTE ST 2110-30, applies real-time denoising, and publishes enhanced audio over SMPTE ST 2110-30 for downstream broadcast equipment.
This NIM is designed for live broadcast and production workflows that ingest and egress uncompressed audio over SMPTE ST 2110 using NVIDIA Rivermax. It is deployed with Helm charts on a Holoscan for Media cluster and can optionally be managed through a Kubernetes operator.
Architecture
The BNR NIM is built on NVIDIA’s software platform:
- Holoscan for Media: Media platform for SMPTE ST 2110-oriented live pipelines and Kubernetes-native orchestration.
- NVIDIA Rivermax: GPU-accelerated SMPTE ST 2110 and RTP ingest and egress.
- CUDA: GPU-accelerated processing.
- TensorRT: Optimized neural network inference.
- Triton Inference Server: Local model execution and metrics.
Processing Flow
The NIM performs the following actions in sequence:
- Receives uncompressed mono audio via SMPTE ST 2110-30 over the high-speed network interface.
- Selects the BNR denoiser variant from
model.type(v2-48korv2-16k). - Runs inference through Triton Inference Server inside the pod.
- Applies the configured
intensityRatio(from0.0to1.0). - Emits enhanced audio via SMPTE ST 2110-30.
Logical Pipeline
Operator variant: Reconciles only the BNR NIM deployment and SDP ConfigMap from an NvidiaBnrMediaFunction custom resource.
Inputs and Outputs
BNR expects a single mono speech stream per input session. For multi-channel mixes, downmix to mono on the sender or instantiate one NIM per speaker channel.
Deployment
BNR NIM supports three deployment patterns:
For installation instructions, refer to Installation.
Supported Operating Modes
ST 2110 Static Mode
Media streams use fixed multicast IP addresses, ports, and session names. Configure the sender output, BNR input/output, and receiver input so the IP and port chain is consistent.
NMOS Mode
Devices and streams are registered and connected using AMWA NMOS IS-04 and IS-05. This mode simplifies setup by moving transport negotiation into the NMOS Connection Manager UI.
See Also
- Holoscan for Media documentation.
- System Requirements for Holoscan for Media.
- Rivermax and ST 2110 for Holoscan for Media.
- Known Limitations.