Is this page helpful?

About the Noise Removal/Background Noise Suppression Effect#

Recordings of speech made outside of a recording studio contain a lot of background noise. The Audio Denoiser Effect removes a variety of background noises from audio recordings. (For the types of noise that this effect removes, see Types of Background Noise Removed.)

This effect retains emotive tones in speech, such as happy, sad, excited, and angry tones, which were removed as noise in previous versions of the SDK. Extreme emotive cases, such as loud laughing, shrieking, screaming, and crying might not be retained. Extremely loud noises in input (SNR < 5 dB) might result in distorted output.

Note

In this guide, the term Background Noise Suppression is used interchangeably with Denoising and Noise Removal (referred to as denoiser in the API).

Acquire the Windows feature files once from the SDK features directory:

powershell -ExecutionPolicy Bypass -File .\download_features.ps1 -Effects denoiser-16k,denoiser-48k -Version 3.0.0 -Output_Directory .

Run from an existing package without network access. The x64 helper directory is shown; on NVIDIA N1X, use samples\build-arm64\Release\scripts:

Set-Location $env:AFX_SDK_ROOT\samples\build\Release\scripts
.\run_effects_demo.bat -e denoiser -isr 16k -osr 16k
.\run_effects_demo.bat -e denoiser -isr 48k -osr 48k

Note

For more information, see Use the Helper Script to Run the Sample Application.

Acquire the Linux models once from the SDK models directory:

./download_models.sh --gpu <gpu> --effects denoiser-16k,denoiser-48k

Run locally from the built Linux effects_demo sample directory:

./run_effect.sh -g t4 -s 16 -e denoiser
./run_effect.sh -g t4 -s 48 -e denoiser

Note

For more information, see Use the Helper Script to Run the Sample Application.

This effect has the following characteristics:

  • Supported input/output audio format is 32-bit float audio with a sampling rate of 16 kHz or 48 kHz.

  • In the Linux SDK, this effect has the following maximum throughput (the number of batches supported in real time):

    Architecture

    Maximum Throughput for the 16K Effect

    Maximum Throughput for the 48K Effect

    T4

    3240

    1520

    A100

    15760

    6750

    A10

    6410

    2960

    L40

    14440

    5400

    H100

    18500

    8030

    B100

    25030

    12160

    RTX PRO 6000

    23640

    10640

Note

This effect might miss some noises in the first 1–2 seconds of input audio. Low-volume noises during speech might also be missed.

BNR 2.0 Experimental Model#

BNR 2.0 is a newer version of the Noise Removal effect that improves the speech recognition accuracies of ASR systems and integrates seamlessly in pipelines where audio cleaning is required before being used in other subsystems. It supports all the noise profiles supported by the stable denoiser effect.

The BNR 2.0 preview is currently supported using the effect_version parameter. For details on how this mode is enabled, see Set the Parameters of an Audio Effect.

The same acquired feature set contains the Denoiser v2 model. Run it locally with -ev 2; do not edit the helper script:

Set-Location $env:AFX_SDK_ROOT\samples\build\Release\scripts
.\run_effects_demo.bat -e denoiser -isr 16k -osr 16k -ev 2
.\run_effects_demo.bat -e denoiser -isr 48k -osr 48k -ev 2

Note

For more information, see Use the Helper Script to Run the Sample Application. This effect cannot be chained with other effects using the Chaining API.

Note

With this release, Voice Activity Detection is enabled by default for this effect.

Run the already-acquired Linux v2 model locally:

./run_effect.sh -g t4 -s 16 -e denoiser -m 2
./run_effect.sh -g t4 -s 48 -e denoiser -m 2

Note

For more information, see Use the Helper Script to Run the Sample Application.

This effect has the following characteristics:

  • Supported input/output audio format is 32-bit float audio with a sampling rate of 16 kHz or 48 kHz.

  • In the Linux SDK, this effect has the following maximum throughput (the number of batches supported in real time):

    Architecture

    Maximum Throughput for the 16K Effect

    Maximum Throughput for the 48K Effect

    T4

    1350

    430

    A100

    7880

    3960

    A10

    3160

    1840

    L40

    7220

    4860

    H100

    9670

    6940

    B100

    12160

    4160

    RTX Pro 6000

    12160

    5610