design your autonomous vehicle applications with nvidia … · 2017. 5. 19. · rtmaps embedded...

Design your autonomous vehicle applications withNVIDIA DriveWorks components on RTMaps

Nicolas du LacCEO, Intempora

SAN JOSE MAY 8-11, 2017

Brief introduction about Intempora

Intempora

• Software editor company

• Created in 2000 - Over 15 years experience in ADAS/A.D. and embedded computing

• Over 15 years of experience

• Strong partnership with

Intempora© 2017 – 03

Over 15 years of experience in providing advanced solutionsHistory

Multisensor Technologysince 1998!

Video speed: 1x. Over 100 kmh | 65 mph

• Darpa Challenge 2007 (Dotmobil Team)

• NAVYA ARMA

Intempora© 2017 - 04

ADAS & AD Challenges

Challenges ADAS and AD

Intempora© 2017 – 06

3

Offline development

5

Development costs / Time to market

2

Execution performance / Number crunching

1

Time coherency in distributed/multi-core multisensor applications

6

Test & validation

Ease of use / Ease for deployment

4

RTMapsmiddleware


OutputInput

ActuatorsMotor, Wheel, Brake,Database, V2X

SensorsVision, RADAR, LiDAR, GPS, Maps, IMU, V2X

DATA PROCESSING

RTMaps - Real-Time Multisensor applications

FeaturesGraphical interface

Large library of off-the-shelf components

Record / Playback

Optimized (multithread, pre-allocatedbuffers, copyless)

Preserves time coherency


Applications


Positioning & Navigation

SLAM

HMIs

Computer VisionBig Data / Cloud

Perception

2D/3D

Machine Learning

Data Fusion

ADAS toolchain(VEOS, ControlDESK, MicroAutoBox)

Interoperability

Digital maps

Signal processing & Control Actuators(Simulink, MathWorks)

Image processing(OpenCV, others libraries…)

Communication(DDS, TCP, UDP, LCM, …)

Advanced HMIs(Qt, QML)

Simulators(MotionDesk, ASM, PreScan, Pro-SiVIC..)

Robotics(ROS bridge)

RTMapsSensors / Actuators



SDK / Develop your own RTMaps components

A cross platform / multi-language API

C++PythonSimulinkQML


…

Model-based controller design

Model-based perception

High performance sensor data processing

⋮

…⋮

ActuatorsSensors Perception Applications

Data processing, Data fusion,

tracking

↓

SceneInterpretation

↓

EnvironmentModel

fcn 1(ECU a)

fcn 2(ECU b)

fcn 3(ECU b)

GigEMATLAB/Simulink

Model based perception

RTMaps workflow

4 Embedded in prototype(PC+ dSPACE)

2In-vehicleData Recording

3 Offline DataPlayback

5 PrototypingRTMaps appsto embeddedtargets

From R&D to production

From COTS solutionsto custom developments

1 OfflineSimulation

6 RTMaps applications to embedded ECU


RTMaps Embedded & NVIDIA

Nvidia JetsonTegra K1

Nvidia Drive PX

RTMaps on Nvidia boards since 2013

Nvidia JetsonTegra X1

Nvidia Drive PX2

• ELA Project 2013Automotive Electronics and Software

RTMaps Embedded on ARM architecture

2014 2015 2015 Today Q3 2017

SPU

?


ARM

GPU

OS

• RTMaps Runtime engine runs on the ARM CPU

Intensive computing taking advantage of hardware acceleration


• Components (image processing for instance) canwrap intensive computing algorithms takingadvantage of GPU

• Supported OS: Windows, Linux, Embedded Linux (Yocto/Poky)

• Supported OS: Windows, Linux, Embedded Linux (Yocto/Poky)

RTMaps Embedded


• RTMaps Runtime Engine and components compiled on chosentarget

• RTMaps SDK for cross-compilation on a Linux PC, or available directlyon the target

• RTMaps Studio operating on separate laptop with direct SSL connection with the runtime engine on the target. Used for diagrams edition (design and configuration).

SSL

Work & Edityour algorithms

from PC

Easily deployon board

RTMaps & NVIDIA DriveWorks

Nvidia_DriveWorks


*Easily deploy on target with RTMaps Remote Studio (SSL)


DriveWorks Components (C++ / CUDA) DRIVE PX 2

etc…

*

DriveNet

LaneNet

Feature Tracker

RTMaps

Conlusion: Video Live DemonstrationReduce and enhance your development cycles


RTMaps & KITTI

Thanks for your attention

https://intempora.com@INTEMPORA #GTC17 #RTMaps

Nicolas du LacCEO, Intempora

To see live demonstrations, meet us on booth #1105 with dSPACE Inc

Evaluate RTMaps!1- Download RTMaps from intempora.com2- Send an activation request at

[email protected]

[email protected] | Tel. +1 248 295-4700

mailto:[email protected]

mailto:[email protected]

design your autonomous vehicle applications with nvidia … · 2017. 5. 19. · rtmaps embedded...

Documents