LightNet
- Note
- SW Release Applicability: This module is available in NVIDIA DRIVE Software releases.
About This Module
This module provides the APIs to initialize, query, and release the NVIDIA proprietary traffic light classification deep neural network: LightNet.
The data structures include:
dwTrafficLightClass: defines the traffic light states that LightNet is trained to classify.dwLightNetModel: allows user to choose among LightNet models.dwLightNetParams: in addition todwLightNetModel, defines the LightNet model variant with specific precision and processor optimization to be loaded.
DriveWorks comes with the LightNet model:
- Front camera model: DW_LIGHTNET_MODEL_FRONT_V5: Supported on GPU, DLA
- Front camera model: DW_LIGHTNET_MODEL_FRONT_V6: Supported on GPU
- Front camera model: DW_LIGHTNET_MODEL_FRONT_V7: Supported on GPU
Inputs
LightNet consumes FP16 planar frames with a resolution of 960x604 pixels from AR0231 cameras (revision >= 4).
Outputs
LightNet currently supports 21 traffic light classes:
| # | TRAFFIC LIGHT STATE NAME | LIGHT ICON | DESCRIPTION |
|---|---|---|---|
| 1 | TLGreenArrowDown | 
| Green down arrow. |
| 2 | TLGreenArrowLeft | 
| Green left arrow. |
| 3 | TLGreenArrowRight | 
| Green right arrow. |
| 4 | TLGreenArrowStraight | 
| Green straight arrow. |
| 5 | TLGreenLightGreenArrowLeft | 
| Green solid along with a green left arrow. |
| 6 | TLGreenLightGreenArrowRight | 
| Green solid along with a green right arrow. |
| 7 | TLGreenLightRedArrowLeft | 
| Green solid along with a red left arrow. |
| 8 | TLGreenLightRedArrowRight | 
| Green solid along with a red right arrow. |
| 9 | TLRedArrowLeft | 
| Red left arrow. |
| 10 | TLRedArrowRight | 
| Red left arrow. |
| 11 | TLRedLight | 
| Red solid. |
| 12 | TLRedLightGreenArrowLeft | 
| Red solid along with a green left arrow. |
| 13 | TLRedLightGreenArrowRight | 
| Red solid along with a green right arrow. |
| 14 | TLRedLightRedArrowLeft | 
| Red solid along with a red left arrow. |
| 15 | TLRedLightRedArrowRight | 
| Red solid along with a red right arrow. |
| 16 | TLYellowArrowLeft | 
| Yellow left arrow. |
| 17 | TLYellowArrowRight | 
| Yellow right arrow. |
| 18 | TLYellowLight | 
| Yellow solid. |
| 19 | TrafficLightGreen | 
| Green solid. |
| 20 | TLStatelessOrSide | 
| The traffic light shows no light, is seen from the side, or not activated. |
| 21 | TLLaneClosed | 
| Red cross signal. |
| 22 | Invalid | 
| Not a traffic light object. |
Additional Information
- Warning
- The LightNet model currently deployed is mostly trained with United States traffic lights. It might experience reduced accuracy in other regions, particularly for light patterns not present in the US.