DriveWorks SDK Reference
3.0.4260 Release
For Test and Development only

DNN-based Night-time and low-light Active Light Source Perception Module

About This Module

This module provides the APIs to initialize, query, and release NVIDIA proprietary camera-based LightSourcePerception visual perception module, which is based on neural network: LightSourceNet in addition to intermediate signals post processing.

The LightSourcePerception is the key perception module in supporting Adaptive Driving Beam standard which had been adopted since 2016 in Europe. It is a superset of the binary high beam ON/OFF signaling, which is being used in U.S.

Please notice, the high beam control is a system-level problem that should consider input from other function modules', such as ego speed, environment illumination, GPS signal etc., besides OEM-specific requirements. The LightSourcePerception perception module makes decision from only camera input, without considering those system-level inputs. Customers who use this module should do their own system-level integration as the figure shows.

lightsourceperception_system.png

The first release of LightSourcePerception outputs binary ON/OFF signal only. Adaptive Driving Beam features, such as regional dimmable control are not available.

The LightSourcePerception sample streams frames from a live camera or recorded video. It runs LightSourceNet DNN inference on each frame to generate perception intermediate outputs. These outputs are noisy before going through post-processing. Finally, a binary high beam ON/OFF signal is generated per the perception module.

The relevant member data structures are:

  • dwLightSourceDetectorParams: allows users to specify ROI of incoming frame (Not in current release. By default, ROI is set to full input frame).

Relevant Tutorials

APIs

See LightSourceNet for information on DNN used in this perception module (LightSourceNet).