1 # Copyright (c) 2017-2020, NVIDIA CORPORATION. All rights reserved.
3 @page lightsourceperception_mainsection DNN-based Night-time and low-light Active Light Source Perception Module
6 This module provides the APIs to initialize, query, and release NVIDIA proprietary camera-based **LightSourcePerception** visual perception module, which is based on neural network: **LightSourceNet** in addition to intermediate signals post processing.
8 The LightSourcePerception is the key perception module in supporting Adaptive Driving Beam standard which had been adopted since 2016 in Europe. It is a superset of the binary high beam ON/OFF signaling, which is being used in U.S.
10 Please notice, the high beam control is a system-level problem that should consider input from other function modules', such as ego speed, environment illumination, GPS signal etc., besides OEM-specific requirements. The LightSourcePerception perception module makes decision from only camera input, without considering those system-level inputs. Customers who use this module should do their own system-level integration as the figure shows.
12 
14 The first release of LightSourcePerception outputs binary ON/OFF signal only. Adaptive Driving Beam features, such as regional dimmable control are not available.
16 The LightSourcePerception sample streams frames from a live camera or recorded video. It runs LightSourceNet DNN inference on each frame to generate perception intermediate outputs. These outputs are noisy before going through post-processing. Finally, a binary high beam ON/OFF signal is generated per the perception module.
18 The relevant member data structures are:
20 - `dwLightSourceDetectorParams`: allows users to specify ROI of incoming frame (Not in current release. By default, ROI is set to full input frame).
24 - See @ref lightsourceperception_usecase1 for loading and preparing the input images, running inference and returning the processed output.
28 - @ref lightsourcenet_group
29 - @ref lightsource_detector_group
31 See @ref lightsourcenet_mainsection for information on DNN used in this perception module (LightSourceNet).