design your autonomous vehicle applications with nvidia...
TRANSCRIPT
![Page 1: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/1.jpg)
Design your autonomous vehicle applications withNVIDIA DriveWorks components on RTMaps
Nicolas du LacCEO, Intempora
SAN JOSE MAY 8-11, 2017
![Page 2: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/2.jpg)
Brief introduction about Intempora
![Page 3: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/3.jpg)
Intempora
• Software editor company
• Created in 2000 - Over 15 years experience in ADAS/A.D. and embedded computing
• Over 15 years of experience
• Strong partnership with
Intempora© 2017 – 03
![Page 4: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/4.jpg)
Over 15 years of experience in providing advanced solutionsHistory
Multisensor Technologysince 1998!
Video speed: 1x. Over 100 kmh | 65 mph
• Darpa Challenge 2007 (Dotmobil Team)
• NAVYA ARMA
Intempora© 2017 - 04
![Page 5: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/5.jpg)
ADAS & AD Challenges
![Page 6: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/6.jpg)
Challenges ADAS and AD
Intempora© 2017 – 06
3
Offline development
5
Development costs / Time to market
2
Execution performance / Number crunching
1
Time coherency in distributed/multi-core multisensor applications
6
Test & validation
Ease of use / Ease for deployment
4
![Page 7: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/7.jpg)
RTMapsmiddleware
![Page 8: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/8.jpg)
Intempora© 2017 - 08
OutputInput
ActuatorsMotor, Wheel, Brake,Database, V2X
SensorsVision, RADAR, LiDAR, GPS, Maps, IMU, V2X
DATA PROCESSING
RTMaps - Real-Time Multisensor applications
![Page 9: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/9.jpg)
FeaturesGraphical interface
Large library of off-the-shelf components
Record / Playback
Optimized (multithread, pre-allocatedbuffers, copyless)
Preserves time coherency
Intempora© 2017 - 09
![Page 10: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/10.jpg)
Applications
Intempora© 2017 - 10
Positioning & Navigation
SLAM
HMIs
Computer VisionBig Data / Cloud
Perception
2D/3D
Machine Learning
Data Fusion
![Page 11: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/11.jpg)
ADAS toolchain(VEOS, ControlDESK, MicroAutoBox)
Interoperability
Digital maps
Signal processing & Control Actuators(Simulink, MathWorks)
Image processing(OpenCV, others libraries…)
Communication(DDS, TCP, UDP, LCM, …)
Advanced HMIs(Qt, QML)
Simulators(MotionDesk, ASM, PreScan, Pro-SiVIC..)
Robotics(ROS bridge)
RTMapsSensors / Actuators
Intempora© 2017 - 11
![Page 12: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/12.jpg)
Intempora© 2017 - 12
SDK / Develop your own RTMaps components
A cross platform / multi-language API
C++PythonSimulinkQML
![Page 13: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/13.jpg)
Intempora© 2017 - 13
…
Model-based controller design
Model-based perception
High performance sensor data processing
⋮
…⋮
ActuatorsSensors Perception Applications
Data processing, Data fusion,
tracking
↓
SceneInterpretation
↓
EnvironmentModel
fcn 1(ECU a)
fcn 2(ECU b)
fcn 3(ECU b)
GigEMATLAB/Simulink
Model based perception
![Page 14: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/14.jpg)
RTMaps workflow
![Page 15: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/15.jpg)
4 Embedded in prototype(PC+ dSPACE)
2In-vehicleData Recording
3 Offline DataPlayback
5 PrototypingRTMaps appsto embeddedtargets
From R&D to production
From COTS solutionsto custom developments
1 OfflineSimulation
6 RTMaps applications to embedded ECU
Intempora© 2017 - 15
![Page 16: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/16.jpg)
RTMaps Embedded & NVIDIA
![Page 17: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/17.jpg)
Nvidia JetsonTegra K1
Nvidia Drive PX
RTMaps on Nvidia boards since 2013
Nvidia JetsonTegra X1
Nvidia Drive PX2
• ELA Project 2013Automotive Electronics and Software
RTMaps Embedded on ARM architecture
2014 2015 2015 Today Q3 2017
SPU
?
Intempora© 2017 - 17
![Page 18: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/18.jpg)
ARM
GPU
OS
• RTMaps Runtime engine runs on the ARM CPU
Intensive computing taking advantage of hardware acceleration
Intempora© 2017 - 18
• Components (image processing for instance) canwrap intensive computing algorithms takingadvantage of GPU
• Supported OS: Windows, Linux, Embedded Linux (Yocto/Poky)
• Supported OS: Windows, Linux, Embedded Linux (Yocto/Poky)
![Page 19: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/19.jpg)
RTMaps Embedded
Intempora© 2017 - 19
• RTMaps Runtime Engine and components compiled on chosentarget
• RTMaps SDK for cross-compilation on a Linux PC, or available directlyon the target
• RTMaps Studio operating on separate laptop with direct SSL connection with the runtime engine on the target. Used for diagrams edition (design and configuration).
SSL
Work & Edityour algorithms
from PC
Easily deployon board
![Page 20: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/20.jpg)
RTMaps & NVIDIA DriveWorks
![Page 21: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/21.jpg)
Nvidia_DriveWorks
Intempora© 2017 - 21
*Easily deploy on target with RTMaps Remote Studio (SSL)
RTMaps & NVIDIA DriveWorks
DriveWorks Components (C++ / CUDA) DRIVE PX 2
etc…
*
DriveNet
LaneNet
Feature Tracker
RTMaps
![Page 22: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/22.jpg)
Conlusion: Video Live DemonstrationReduce and enhance your development cycles
![Page 23: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/23.jpg)
Intempora© 2017 - 22
RTMaps & NVIDIA DriveWorks
![Page 24: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/24.jpg)
Intempora© 2017 - 22
RTMaps & KITTI
![Page 25: Design your autonomous vehicle applications with NVIDIA ...on-demand.gputechconf.com/gtc/2017/presentation/s... · SAN JOSE MAY 8-11, 2017. Brief introduction about Intempora. Intempora](https://reader035.vdocument.in/reader035/viewer/2022071009/5fc7364415712c58cf6087c1/html5/thumbnails/25.jpg)
Thanks for your attention
https://intempora.com@INTEMPORA #GTC17 #RTMaps
Nicolas du LacCEO, Intempora
To see live demonstrations, meet us on booth #1105 with dSPACE Inc
Evaluate RTMaps!1- Download RTMaps from intempora.com2- Send an activation request at
[email protected] | Tel. +1 248 295-4700