what’s new in automated driving with matlab and simulink · sensor fusion and tracking toolboxtm...
TRANSCRIPT
![Page 1: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/1.jpg)
1© 2019 The MathWorks, Inc.
What’s New in Automated Driving
with MATLAB and Simulink
Mark Corless
Industry Marketing
Automated Driving Segment Manager
![Page 2: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/2.jpg)
2
Some common questions from automated driving engineers
How can I
synthesize scenarios
to test my designs?
How can I
discover and design
in multiple domains?
How can I
integrate
with other environments?
Control
Planning
Perception Simulation Integration
ROS
C/C++ Python
Cross
Release
Third
Party
CAN
![Page 3: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/3.jpg)
3
Some common questions from automated driving engineers
How can I
synthesize scenarios
to test my designs?
How can I
discover and design
in multiple domains?
How can I
integrate
with other environments?
Control
Planning
Perception Simulation Integration
ROS
C/C++ Python
Cross
Release
Third
Party
CAN
![Page 4: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/4.jpg)
4
Synthesize scenarios to test sensor fusion algorithms
Sensor Fusion Using Synthetic
Radar and Vision Data
▪ Synthesize road and vehicles
▪ Add probabilistic vision and radar detection sensors
▪ Fuse and track detections
▪ Visualize sensor coverage areas, detections, and tracks
Automated Driving ToolboxTM
![Page 5: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/5.jpg)
5
Graphically author driving scenarios
Driving Scenario Designer
▪ Create roads and lane markings
▪ Add actors and trajectories
▪ Specify actor size and radar
cross-section (RCS)
▪ Explore pre-built scenarios
▪ Import OpenDRIVE roads
Automated Driving ToolboxTM
![Page 6: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/6.jpg)
6
Integrate driving scenarios into Simulink simulations
Test Open-Loop ADAS
Algorithm Using Driving
Scenario
▪ Edit driving scenario
▪ Integrate into Simulink
▪ Add sensor models
▪ Visualize results
▪ Pace simulation
Automated Driving ToolboxTM
.MAT
![Page 7: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/7.jpg)
7
Integrate driving scenario into closed loop simulation
Lane Following Control with
Sensor Fusion
▪ Integrate scenario into system
▪ Design lateral (lane keeping) and longitudinal (lane spacing)
model predictive controllers
▪ Visualize sensors and tracks
▪ Generate C/C++ code
▪ Test with software in the loop
(SIL) simulation
Model Predictive Control ToolboxTM
Automated Driving ToolboxTM
Embedded Coder®
![Page 8: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/8.jpg)
8
Design lateral and longitudinal controls
Lane Following Control with
Sensor Fusion
▪ Integrate scenario into system
▪ Design lateral (lane keeping) and longitudinal (lane spacing)
model predictive controllers
▪ Visualize sensors and tracks
▪ Generate C/C++ code
▪ Test with software in the loop
(SIL) simulation
Model Predictive Control ToolboxTM
Automated Driving ToolboxTM
Embedded Coder®
![Page 9: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/9.jpg)
9
Visualize sensor detections and tracks
Lane Following Control with
Sensor Fusion
▪ Integrate scenario into system
▪ Design lateral (lane keeping) and longitudinal (lane spacing)
model predictive controllers
▪ Visualize sensors and tracks
▪ Generate C/C++ code
▪ Test with software in the loop
(SIL) simulation
Model Predictive Control ToolboxTM
Automated Driving ToolboxTM
Embedded Coder®
![Page 10: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/10.jpg)
10
Automate testing against driving scenarios
Testing a Lane Following
Controller with Simulink Test
▪ Author high level requirements
▪ Synthesize driving scenarios
▪ Specify assessment criteria
▪ Run interactive simulation
▪ Automate regression testing
▪ Review verification status
Simulink TestTM
Automated Driving ToolboxTM
Model Predictive Control ToolboxTM
Requirements link
Scenarios
Simulink Model
Define scenario ID
and data initialization
Plot the results
![Page 11: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/11.jpg)
11
Synthesize driving scenarios from recorded data
Scenario Generation from
Recorded Vehicle Data
▪ Visualize video
▪ Import OpenDRIVE roads
▪ Import GPS
▪ Import object lists
Automated Driving ToolboxTM
![Page 12: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/12.jpg)
12
How can I design with virtual scenarios?
Scenes Driving Scenarios (cuboid)
Testing Controls
Controls + sensor fusion
Authoring Driving Scenario Designer App
drivingScenario programmatic API
Sensing Probabilistic radar detections
Probabilistic vision detections
Probabilistic lane detections
![Page 13: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/13.jpg)
13
How can I design with virtual scenarios?
Scenes Driving Scenarios (cuboid) 3D Simulation (Unreal Engine)
Testing Controls
Controls + sensor fusion
Controls
Controls + vision
Authoring Driving Scenario Designer App
drivingScenario programmatic API
Unreal Editor
Sensing Probabilistic radar detections
Probabilistic vision detections
Probabilistic lane detections
Ideal camera (viewer)
![Page 14: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/14.jpg)
14
Simulate controls and perception systems
Lane Following Control with
Sensor Fusion
Model Predictive Control ToolboxTM
Automated Driving ToolboxTM
Embedded Coder®
Visual Perception Using
Monocular Camera
Automated Driving ToolboxTM
Lane-Following Control with
Monocular Camera Perception
Model Predictive Control ToolboxTM
Automated Driving ToolboxTM
Vehicle Dynamics BlocksetTM
![Page 15: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/15.jpg)
15
Simulate lane controls with vision based perception
Lane-Following Control with
Monocular Camera Perception
▪ Integrate Simulink controller
– Lane follower
– Spacing control
▪ Integrate MATLAB perception
– Lane boundary detector
– Vehicle detector
▪ Synthesize ideal camera image
from Unreal Engine
Model Predictive Control ToolboxTM
Automated Driving ToolboxTM
Vehicle Dynamics BlocksetTM
![Page 16: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/16.jpg)
16
Some common questions from automated driving engineers
How can I
synthesize scenarios
to test my designs?
How can I
discover and design
in multiple domains?
How can I
integrate
with other environments?
Control
Planning
Perception Simulation Integration
ROS
C/C++ Python
Cross
Release
Third
Party
CAN
![Page 17: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/17.jpg)
17
Design trackers
Automated Driving ToolboxTM
Detections Tracks
Multi-Object Tracker
Tracking
Filter
Association &
Track
Management
From various sensors at various update rates
▪ Multi-object tracker ▪ Linear, extended, and
unscented Kalman filters
![Page 18: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/18.jpg)
18
Design trackers
Automated Driving ToolboxTM
Sensor Fusion and Tracking ToolboxTM
Detections Tracks
Multi-Object Tracker
Tracking
Filter
Association &
Track
Management
From various sensors at various update rates
▪ Multi-object tracker
▪ Global Nearest Neighbor (GNN) tracker
▪ Joint Probabilistic Data Association (JPDA) tracker
▪ Track-Oriented Multi-Hypothesis Tracker (TOMHT)
▪ Probability Hypothesis Density (PHD) tracker
▪ Linear, extended, and
unscented Kalman filters
▪ Particle, Gaussian-sum,
and Interacting Multiple
Model (IMM) filters
![Page 19: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/19.jpg)
19
Design multi-object trackers
Multi-Object Tracker
Extended Object Tracking
▪ Design multi-object tracker
▪ Design extended object trackers
▪ Evaluate tracking metrics
▪ Evaluate error metrics
▪ Evaluate desktop execution time
Sensor Fusion and
Tracking ToolboxTM
Automated Driving ToolboxTM
Updated
![Page 20: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/20.jpg)
20
Design extended object trackers
Extended-Object Tracker
Extended Object Tracking
▪ Design multi-object tracker
▪ Design extended object trackers
▪ Evaluate tracking metrics
▪ Evaluate error metrics
▪ Evaluate desktop execution time
Sensor Fusion and
Tracking ToolboxTM
Automated Driving ToolboxTM
Updated
![Page 21: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/21.jpg)
21
Evaluate tracking performance
Extended Object Tracking
▪ Design multi-object tracker
▪ Design extended object trackers
▪ Evaluate tracking metrics
▪ Evaluate error metrics
▪ Evaluate desktop execution time
Sensor Fusion and
Tracking ToolboxTM
Automated Driving ToolboxTM
Updated
Multi-object tracker
Probability Hypothesis Density tracker
Extended object (size and orientation) tracker
![Page 22: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/22.jpg)
22
Evaluate error metrics
Extended Object Tracking
▪ Design multi-object tracker
▪ Design extended object trackers
▪ Evaluate tracking metrics
▪ Evaluate error metrics
▪ Evaluate desktop execution time
Sensor Fusion and
Tracking ToolboxTM
Automated Driving ToolboxTM
Updated
Multi-object tracker
Probability Hypothesis Density tracker
Extended object (size and orientation) tracker
![Page 23: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/23.jpg)
23
Compare relative execution times of object trackers
Extended Object Tracking
▪ Design multi-object tracker
▪ Design extended object trackers
▪ Evaluate tracking performance
▪ Evaluate error metrics
▪ Evaluate desktop execution time
Sensor Fusion and
Tracking ToolboxTM
Automated Driving ToolboxTM
Updated
Multi-object tracker
Probability Hypothesis Density tracker
Extended object (size and orientation) tracker
![Page 24: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/24.jpg)
24
Design detector for lidar point cloud data
Track Vehicles Using Lidar:
From Point Cloud to Track List
▪ Design 3-D bounding box
detector
▪ Design tracker (target state and
measurement models)
▪ Generate C/C++ code for
detector and tracker
Sensor Fusion and Tracking
ToolboxTM
Computer Vision ToolboxTM
![Page 25: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/25.jpg)
25
Design tracker for lidar point cloud data
Track Vehicles Using Lidar:
From Point Cloud to Track List
▪ Design 3-D bounding box
detector
▪ Design tracker (target state and
measurement models)
▪ Generate C/C++ code for
detector and tracker
Sensor Fusion and Tracking
ToolboxTM
Computer Vision ToolboxTM
![Page 26: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/26.jpg)
26
Generate C/C++ code for lidar detector and tracker
Track Vehicles Using Lidar:
From Point Cloud to Track List
▪ Design 3-D bounding box
detector
▪ Design tracker (target state and
measurement models)
▪ Generate C/C++ code for
detector and tracker
Sensor Fusion and Tracking
ToolboxTM
Computer Vision ToolboxTM
![Page 27: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/27.jpg)
27
Create region of interest labels and groups
Get Started with the Ground
Truth Labeler
▪ Label rectangles
▪ Label lane markings
▪ Label pixels
▪ Label scenes
▪ Create label groups
▪ Create sublabels
▪ Add label attributes
Automated Driving ToolboxTM
Updated
![Page 28: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/28.jpg)
28
Create sublabels and add attributes
Get Started with the Ground
Truth Labeler
▪ Label rectangles
▪ Label lane markings
▪ Label pixels
▪ Label scenes
▪ Create label groups
▪ Create sublabels
▪ Add label attributes
Automated Driving ToolboxTM
Updated
![Page 29: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/29.jpg)
29
Create polyline labels and add attributes
Get Started with the Ground
Truth Labeler
▪ Label rectangles
▪ Label lane markings
▪ Label pixels
▪ Label scenes
▪ Create label groups
▪ Create sublabels
▪ Add label attributes
Automated Driving ToolboxTM
Updated
![Page 30: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/30.jpg)
30
Create pixel labels
Get Started with the Ground
Truth Labeler
▪ Label rectangles
▪ Label lane markings
▪ Label pixels
▪ Label scenes
▪ Create label groups
▪ Create sublabels
▪ Add label attributes
Automated Driving ToolboxTM
Updated
![Page 31: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/31.jpg)
31
Create scene labels and groups
Get Started with the Ground
Truth Labeler
▪ Label rectangles
▪ Label lane markings
▪ Label pixels
▪ Label scenes
▪ Create label groups
▪ Create sublabels
▪ Add label attributes
Automated Driving ToolboxTM
Updated
![Page 32: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/32.jpg)
32
Import custom automation algorithms
Automate Attributes of Labeled
Objects
▪ Import automation algorithm into
Ground Truth Labeling app
▪ Detect vehicles from monocular
camera
▪ Estimate distance to detected
vehicles
▪ Run automation algorithm and
interactively validate labels
Automated Driving ToolboxTM
![Page 33: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/33.jpg)
33
Add custom visualizations for multi-sensor data
Connect Lidar Display to
Ground Truth Labeler
▪ Sync external tool to each frame
change
▪ Control external tool through
playback controls
Automated Driving ToolboxTM
![Page 34: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/34.jpg)
34
Interoperate with neural network frameworks
PyTorch
Caffe2
MXNet
Core ML
CNTK
Keras-
Tensorflow
Caffe
MATLABONNX
Open Neural Network Exchange
(…)
![Page 35: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/35.jpg)
35
Design camera, lidar, and radar perception algorithms
Object Detection Using
YOLO v2 Deep Learning
Computer Vision ToolboxTM
Deep Learning ToolboxTM
Segment Ground Points
from Organized Lidar Data
Computer Vision ToolboxTM
Introduction to Micro-Doppler
Effects
Phased Array System ToolboxTM
Detect vehicle with
camera
Detect ground with
lidar
Detect pedestrian with
radar
![Page 36: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/36.jpg)
36
Some common questions from automated driving engineers
How can I
synthesize scenarios
to test my designs?
How can I
discover and design
in multiple domains?
How can I
integrate
with other environments?
Control
Planning
Perception Simulation Integration
ROS
C/C++ Python
Cross
Release
Third
Party
CAN
![Page 37: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/37.jpg)
38
Read road and speed attributes from HERE HD Live Map data
Use HERE HD Live Map Data
to Verify Lane Configurations
▪ Load camera and GPS data
▪ Retrieve speed limit
▪ Retrieve lane configurations
▪ Visualize composite data
Automated Driving ToolboxTM
![Page 38: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/38.jpg)
40
Visualize HERE HD Live Map recorded data
Use HERE HD Live Map Data
to Verify Lane Configurations
▪ Load camera and GPS data
▪ Retrieve speed limit
▪ Retrieve lane configurations
▪ Visualize composite data
Automated Driving ToolboxTM
![Page 39: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/39.jpg)
41
Design path planner
Automated Parking Valet
▪ Create cost map of environment
▪ Inflate cost map for collision checking
▪ Specify goal poses
▪ Plan path using rapidly exploring random tree (RRT*)
Automated Driving ToolboxTM
![Page 40: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/40.jpg)
42
Design path planner and controller
Automated Parking Valet with
Simulink
▪ Integrate path planner
▪ Design lateral controller (based on vehicle kinematics)
▪ Design longitudinal controller
(PID)
▪ Simulate closed loop with
vehicle dynamics
Automated Driving ToolboxTM
![Page 41: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/41.jpg)
43
Generate C/C++ code for path planner and controller
Code Generation for Path
Planning and Vehicle Control
▪ Simulate system
▪ Configure for code generation
▪ Generate C/C++ code
▪ Test using Software-In-the-Loop
▪ Measure execution time of
generated code
Automated Driving ToolboxTM
Embedded Coder
![Page 42: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/42.jpg)
44
Some common questions from automated driving engineers
How can I
synthesize scenarios
to test my designs?
How can I
discover and design
in multiple domains?
How can I
integrate
with other environments?
Control
Planning
Perception Simulation Integration
ROS
C/C++ Python
Cross
Release
Third
Party
CAN
![Page 43: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/43.jpg)
45
Design lateral and longitudinal Model Predictive Controllers
Adaptive Cruise Control
with Sensor Fusion
Automated Driving ToolboxTM
Model Predictive Control
ToolboxTM
Embedded Coder®
Lane Keeping Assist with
Lane Detection
Automated Driving ToolboxTM
Model Predictive Control
ToolboxTM
Embedded Coder®
Lane Following Control with
Sensor Fusion and Lane
Detection
Automated Driving ToolboxTM
Model Predictive Control ToolboxTM
Embedded Coder®
Longitudinal Control Lateral Control Longitudinal + Lateral
![Page 44: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/44.jpg)
46
Develop automatic emergency braking application
Automatic Emergency Braking
(AEB) with Sensor Fusion
▪ Specify driving scenario
▪ Design AEB logic
▪ Integrate sensor fusion
▪ Visualize sensors and tracks
▪ Generate C/C++ code
▪ Test with software in the loop
(SIL) simulation
Automated Driving ToolboxTM
Stateflow®
Embedded Coder®
![Page 45: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/45.jpg)
47
Train reinforcement learning networks for ADAS controllers
Train Deep Deterministic Policy
Gradient (DDPG) Agent for
Adaptive Cruise Control
▪ Create environment interface
▪ Create agent
▪ Train agent
▪ Simulate trained agent
Reinforcement Learning ToolboxTM
![Page 46: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/46.jpg)
48
Some common questions from automated driving engineers
How can I
synthesize scenarios
to test my designs?
How can I
discover and design
in new domains?
How can I
integrate
with other environments?
Control
Planning
Perception Simulation Integration
ROS
C/C++ Python
Cross
Release
Third
Party
CAN
![Page 47: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/47.jpg)
49
Integrate with ROS
Exchange Data with ROS
Publishers and Subscribers
Robotic System ToolboxTM
Work with rosbag Logfiles
Robotic System ToolboxTM
Generate a Standalone ROS
Node from Simulink
Robotic System ToolboxTM
Simulink CoderTM
Replay logged
ROS data
Connect to live
ROS data
Generate standalone
ROS node
Updated R2018a R2016b R2016b
![Page 48: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/48.jpg)
50
Install and Use Computer Vision
Toolbox OpenCV Interface
Computer Vision System ToolboxTM
OpenCV Interface Support Package
Call C++, Python, and OpenCV from MATLAB
Import C++ Library
Functionality into MATLAB
MATLAB®
Call Python from MATLAB
MATLAB®
.mex
cv::Rect
cv::KeyPoint
cv::Size
cv::Mat
cv::Ptr
...
Updated
.mlx.hpp
tw = ...
py.textwrap.TextWrapper(...
pyargs(...
'initial_indent', '% ',...
'subsequent_indent','% ',...
'width', int32(30)))
Call C++ Call PythonCall OpenCV &
OpenCV GPU
R2014a
![Page 49: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/49.jpg)
51
Call C code from Simulink
Import Structure and
Enumerated Types
Simulink®
Bring Custom Image Filter
Algorithms as Reusable
Blocks in Simulink
Simulink®
Custom C Code Verification
with Simulink Test
Simulink TestTM
Simulink CoverageTM
Call C codeCreate buses from C
structsTest and verify C code
![Page 50: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/50.jpg)
52
Connect to third party tools
152 Interfaces to 3rd Party
Modeling and Simulation Tools (as of March 2019)
![Page 51: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/51.jpg)
53
Cross-release simulation through code generation
Integrate Generated Code by
Using Cross-Release Workflow
▪ Generate code from previous
release (R2010a or later)
▪ Import generated code as a
block in current release
▪ Tune parameters
▪ Access internal signals
Embedded Coder
R2016a
Previous Release
Current Release
C
crossReleaseImport
![Page 52: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/52.jpg)
54
Some common questions from automated driving engineers
Synthesize scenarios
to test my designs
Discover and design
in multiple domains
Integrate
with other environments
Control
Planning
Perception Simulation Integration
ROS
C/C++ Python
Cross
Release
Third
Party
CAN
![Page 53: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/53.jpg)
56
Get started on your own with documented examples
▪ Automated Driving Toolbox
– Labeling, perception, sensor fusion, path
planning, synthetic sensor data
▪ Model Predictive Control Toolbox (Section: Automated Driving Applications)
– Adaptive cruise control, lane keeping, lane
following with spacing control
▪ Simulink Test (Section: Systematic Testing and Reporting)
– Test lane following controller with sensor
fusion
Simulation Integration
Control
Planning
Perception
![Page 54: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/54.jpg)
57
Gain tool experience with Training Services
▪ Automated Driving with MATLAB
▪ Deep Learning with MATLAB
▪ Computer Vision with MATLAB
▪ Simulink for System and Algorithm Modeling
▪ Integrating Code with Simulink
▪ Code Generation for AUTOSAR Software
▪ Verification and Validation of Simulink Models
▪ Polyspace Bug Finder for C/C++ Code
Analysis
▪ Ask about customizing training courses for
your needs (contact training)
Simulation Integration
Control
Planning
Perception
![Page 55: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/55.jpg)
58
Partner on your projects with Consulting Services
▪ Image Processing and Computer Vision
▪ MATLAB with Hadoop and Spark
▪ Tools Integration
▪ ISO 26262 Process Deployment Advisory
Service
▪ Model-Based Design Process Establishment
▪ Model-Based Design Process Assessment
and Maturity Framework
▪ Ask about extending tools for labeling or
synthesizing sensor data (contact consulting)
Simulation Integration
Control
Planning
Perception
![Page 56: What’s New in Automated Driving with MATLAB and Simulink · Sensor Fusion and Tracking ToolboxTM Detections Tracks Multi-Object Tracker Tracking Filter Association & Track Management](https://reader036.vdocument.in/reader036/viewer/2022081406/5f1061907e708231d448d42c/html5/thumbnails/56.jpg)
59
Get started developing automated driving systems
with MATLAB and Simulink
Discuss your application with me
([email protected]) or a
MathWorks field engineer to help you
structure an evaluation
▪ Understand your goals
▪ Recommend tasks
▪ Answer questions
Simulation Integration
Control
Planning
Perception