choosing the optimum mix of sensors for driver assistance ... · • radar and lidar are not...

Copyright © 2017 NXP Semiconductors 1

Ali Osman OrsMay 2, 2017

Choosing the Optimum Mix of Sensors for Driver Assistance and Autonomous

Vehicles


AutonomousRequirement

Sensing Technology Comparison

Camera Radar LiDAR

Object Detection M H H H

Classification H M L H

Close-Proximity Detection M H L H

Speed Detection L H M H

Lane Detection H L L H

Traffic Sign Recognition H L L H

Range H (200m) H (250m) M (120m) Full range

Work in Rain, Fog, Snow L H M H

Work in Low Light L H H H

Work in Bright Light M H H H

Size Small Small Medium Mix

Cost $ $$ $$$$ Mix

Rating: H = High, M=Medium, L = Low



• Radar and Lidar are not affected by obscurant conditions as much as camera systems.

• Cameras also affected by light variation and shadows.


Camera Radar LiDAR

Object Detection M H H H





Camera Radar LiDAR

Classification H M L H


• Level of detail available for template matching much higher in camera systems.

• The range and height of detection area affects performance




Camera Radar LiDAR

Speed Detection L H M H


• Radar and Lidar are active emitters that can make measurements on returning signals

• Object-level motion detection is difficult due to the dual motion introduced by the camera motion and the object motion


Evolution of the Self Driving Car


Limitations

* www.volvo.com


?


RADAR

*Hella*NXP


MEDIUM RANGE RADAR

Blind Spot Detection

SHORT RANGE/ MEDIUM RANGE

RADARPark Assist

Cross-Traffic AlertJunction Assist

RADAR TODAY

LONG RANGE RADAR

Adaptive Cruise Control Automatic Emergency Braking

Forward Collision Warning


SHORT RANGE/ MEDIUM RANGE

RADARPark Assist


LONG RANGE RADAR


Forward Collision WarningRear Collision Warning

RADAR TOMORROW

MEDIUM RANGE RADAR

Blind Spot DetectionPark Assist


LIDAR

*Velodyne *Quanergy *Leddartech


360o LIDARPark Assist


Close NavigationReverse Assist

LIDAR TODAY

LIDARAutomatic Emergency Braking



2D Flash LIDARBlind Spot Detection

Park AssistCross-Traffic Alert

Junction AssistClose NavigationReverse Assist

3D Flash LIDARPark Assist


Close Navigation

LIDAR TOMORROW

In CabinGesture RecognitionOccupancy DetectionTouchless Controls

Long Range 3D LIDAR




CAMERA


In-Cabin IR Camera

Driver Monitoring

VISION TODAY

Surround CameraParking Assist


Forward CameraSingle & Stereo Adaptive Cruise Control

Automatic Emergency Braking Forward Collision Warning

Lane Keep AssistAutomatic High Beam Control

Traffic Sign Recognition

Rear CameraPark Assist



In-Cabin IR & 3D Camera

Driver MonitoringPresence detectionGesture recognition

VISION TOMORROW

Surround CameraParking Assist


Forward CameraSingle & Stereo Adaptive Cruise Control

Automatic Emergency Braking Forward Collision Warning

Lane Keep AssistAdaptive Front Light Control

Traffic Sign Recognition

Rear and Side CameraPark Assist


Mirror Replacement


Nighttime Scenes


Autonomy


3 OEMs, 3 Approaches

3x LRR Radar (160-250m)4x MRR (80m) 2x SRR (40m)5x Camera

3x LRR Radar (150-250m)2x MRR (70m) 4x SRR (40m)6-9x Camera

1x LRR Radar (250m)4x MRR (80m) 1x LIDAR5x Camera


• All the sensor technologies used in ADAS and Autonomous Vehicles are evolving.

• To guarantee safety we need to have redundancy.• The needs are not only outside the vehicle.• True autonomous vehicles need more than distance and speed, they will

need texture data and communication.

Take Aways


As the leader in Automotive Semiconductors, Advanced Driver Assistance Systems (ADAS), NXP offers a broad portfolio of Radar sensing and processing, Vision processing, Secure V2X and Sensor Fusion technologies that drive innovation in autonomous cars.

http://bit.ly/2ponsM6

Please visit our table in the exhibit hall to view some of our Neural Network based vision processing demos.

About NXP


Thank You

choosing the optimum mix of sensors for driver assistance ... · • radar and lidar are not...

Documents