DriveWorks SDK Reference
3.5.78 Release
For Test and Development only

ClearSightNet

About This Module

This module provides the APIs to initialize, query, and release NVIDIA proprietary camera blindness detection neural network: ClearSightNet. The relevant member data structures are:

In order to run ClearSightNet, users must use the ClearSightNet Interface and Camera Blindness Detection Interface APIs. The ClearSightNet Interface API helps load and prepare the network for inference. The Camera Blindness Detection Interface API, using the loaded network, runs inference on input images and returns processed output.

The default model should work on all i.e. surround cameras.

Inputs

ClearSightNet consumes RCCB frames with a resolution of 480x240 pixels from AR0231 cameras (revision >= 4).

Outputs

ClearSightNet outputs intermediate signals to feed Camera Blindness Detection Interface pipeline which returns the following:

  1. dwBlindnessDetectionOutput.blindnessRatio: a value between 0 and 1 indicating fraction of overall input image that is blinded or compromised.
  2. dwBlindnessDetectionOutput.fullBlindRatio: a value between 0 and 1 indicating fraction of overall input image that is fully blinded or blocked.
  3. dwBlindnessDetectionOutput.partBlindRatio: a value between 0 and 1 indicating fraction of overall input image that is partially blinded or blurred.
  4. dwBlindnessDetectionOutput.mask: an RGBA mask that can be overlayed on input image to visualize blocked (R channel), blurred (G channel) and sky (B channel) regions.
  5. dwBlindnessDetectionOutput.numRegionsX: number of sub-regions in X direction
  6. dwBlindnessDetectionOutput.numRegionsY: number of sub-regions in Y direction
  7. dwBlindnessDetectionOutput.regionDividersX: sub-region dividers (in input image coordinates) in X direction
  8. dwBlindnessDetectionOutput.regionDividersY: sub-region dividers (in input image coordinates) in Y direction
  9. dwBlindnessDetectionOutput.regionBlindnessRatio: values between 0 and 1 indicating fraction of each sub-region that is blinded or compromised
  10. dwBlindnessDetectionOutput.regionFullBlindRatio: values between 0 and 1 indicating fraction of each sub-region that is fully blinded or blocked
  11. dwBlindnessDetectionOutput.regionPartBlindRatio: values between 0 and 1 indicating fraction of each sub-region that is partially blinded

Relevant Tutorials

APIs