![Page 1: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/1.jpg)
Redefining how the driver and vehicle interact
Webinar
June 27, 2016
![Page 2: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/2.jpg)
The HMI revolution
“ The human interface revolution is about perfecting the user experience and will encompass four phases. We call these phases Interaction, Personalization, Contextual Awareness, and Omnipresence.”
– Rick Bergman, CEO, Synaptics
FANCI Webinar | June 27, 2016 | Slide 2
![Page 3: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/3.jpg)
The HMI revolution
FANCI Webinar | June 27, 2016 | Slide 3
Interaction
Personalization
Contextual Awareness
Omnipresence
paving the way towards autonomous driving
![Page 4: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/4.jpg)
Rinspeed XchangE (2014)
How will we interact with cars in the future?
![Page 5: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/5.jpg)
Productivity? Entertainment?
Rinspeed Budii (2015)
![Page 6: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/6.jpg)
Concepts Today – Immersive
Rinspeed Etos (2016)
![Page 7: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/7.jpg)
What’s Changing?
VW Market Cap
$67.1B
BMW Market Cap
$47.7B
FANCI Webinar | June 27, 2016 | Slide 7
![Page 8: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/8.jpg)
Major shift in delivering information Human interactions by A.I. systems
FANCI Webinar | June 27, 2016 | Slide 8
HUMAN INPUT
70 Billion Opportunity by 20201
MACHINE RECOGNITION
Before
- Explicit
- Slow and Error Prone
- Labor Intensive
Today
- Explicit (+) Implicit
- Real-time and Objective
- Automated
1. Bank of America Merrill Lynch (as covered in FT.com)
Key Drivers
Artificial Intelligence
New Input Mechanisms (Face, Gesture, Voice, …)
Adaptive Learning Software
Applications
Key Players
Company Users
Facebook 1.65bn
Google 1.2bn
Baidu 629mn
Microsoft 800mn
Apple 150mn
![Page 9: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/9.jpg)
Machines surpass human performance
0
5
10
15
20
25
30
2010 2011 2012 2013 2014 Human ArXiv 2015
ILSVRX top-5 Error on ImageNet
Blue is Traditional Computer Vision : Purple is Deep Learning : Red is Human
Since 2015 Deep Learning has achieved a super human
(better than human) quality on simple perceptual tasks.
A milestone has been reached and new territories will open
to A.I. performance in the coming years at an ever
increasing rate.
FANCI Webinar | June 27, 2016 | Slide 9
Deep Learning and Big Data
2015: milestone in A.I. “Super
Human” performance
Google Deep Mind programmed Alpha Go to be capable of teaching itself
2016 Google AI beats
Go world champion
![Page 10: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/10.jpg)
A.I. being embedded by new market entrants
Consumer Devices
Home Automation
Ride Sharing
Media & Entertainment
Automotive
Market Benefit New Entrants
Virtual Assistant
Voice Control
Dynamic Pricing Engine
Personalised Preferences
Automated Driving
FANCI Webinar | June 27, 2016 | Slide 10
Indispensable to B2C
Asian tech leaders predict
artificial intelligence & cognitive computing will be the most disruptive technology impacting the
global business-to-consumer (B2C) marketplace.
Next generation products will surpass human performance
Companies rapidly
leveraging A.I. to enter into new markets & taking leadership positions
![Page 11: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/11.jpg)
Daily Life
PC 2000
Smartphone
More natural computer interfaces needed
FANCI Webinar | June 27, 2016 | Slide 11
![Page 12: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/12.jpg)
The vision Language
Face
Speech
Head
Gesture
Touch
Body Pose
IMP
LIC
IT &
EM
OT
ION
User
Behavior
System Reaction
User State
Context
FANCI Webinar | June 27, 2016 | Slide 12
![Page 13: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/13.jpg)
The objective: needs of interaction
FANCI Webinar | June 27, 2016 | Slide 13
![Page 14: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/14.jpg)
FANCI automotive demonstrator
Face authentication
Mood detection
Gesture recognition
Gaze tracking
KeyLemon webcam
nViso webcam
SoftKinetic sensor
Tobii sensor
Se
nso
rs
So
ftwa
re
HA
RM
AN
Info
tain
me
nt
So
ftwa
re
JSON
over TCP
HARMAN
Infotainment
Hardware
USB
USB
USB
USB
FANCI Webinar | June 27, 2016 | Slide 14
![Page 15: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/15.jpg)
FANCI demonstrator
FANCI Webinar | June 27, 2016 | Slide 15
![Page 16: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/16.jpg)
FANCI demonstrator HMI
KeyLemon ID/
nViso mood cam
Tobii
eye gaze cam
SoftKinetic
gesture cam
Instrument
Cluster Display
1440*540
Central display
1280*800 & touch
HARMAN
Infotainment
Demonstrator
FANCI Webinar | June 27, 2016 | Slide 16
![Page 17: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/17.jpg)
FANCI demonstration video
FANCI Webinar | June 27, 2016 | Slide 17
![Page 18: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/18.jpg)
The consortium
FANCI Webinar | June 27, 2016 | Slide 18
![Page 19: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/19.jpg)
The contributions – CEVA
• A leading semiconductor IP company
FANCI-related technologies: Computer Vision DSP IP
Platform Application Development Kit
(ADK) Commercial tools suite & dev.
boards
FANCI Webinar | June 27, 2016 | Slide 19
![Page 20: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/20.jpg)
The contributions – HARMAN
• The leading automotive infotainment and audio supplier
FANCI-related technologies:
Infotainment systems Driver assistance systems
(vision based) Driver workload management
FANCI Webinar | June 27, 2016 | Slide 20
![Page 21: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/21.jpg)
The contributions – KeyLemon
• The face authentication software specialist
FANCI-related technologies:
Face detection Face verification Face identification Speaker recognition
(biometry) verification
FANCI Webinar | June 27, 2016 | Slide 21
![Page 22: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/22.jpg)
The contributions – nViso
• Developer of emotion detection software
FANCI-related technologies:
Emotion recognition Sentiment analysis Facial tracking - 170 points Facial gestures
FANCI Webinar | June 27, 2016 | Slide 22
![Page 23: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/23.jpg)
The contributions – SoftKinetic
• The leader in 3D vision and gesture recognition technologies
FANCI-related technologies:
SKS (SoftKinetic Sensors) SKSW (SoftKinetic Software) + Embedded design expertise
FANCI Webinar | June 27, 2016 | Slide 23
![Page 24: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/24.jpg)
The contributions – Tobii
• Specialist in eye tracking technology
FANCI-related technologies:
HW and algorithms for eye
and gaze tracking Natural User Interaction and
HMI design, development
and validation
FANCI Webinar | June 27, 2016 | Slide 24
![Page 25: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/25.jpg)
The contributions – Uni of Siena
• Validator of end-user and developer experience
FANCI-related technologies:
VISLab Multimodal Distributed
Systems for Safety, Monitoring and Ambient Intelligence
Validation and usability
FANCI Webinar | June 27, 2016 | Slide 25
![Page 26: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/26.jpg)
Where we stand
Jan 2015 Jan 2017
CES
Project Start Project End
Public Presentation:
Automotive application
demonstration
running on prototype platform
CES
Public Presentation:
Automotive demonstration
platform with an automotive
application-suite
Jan 2016 June 2016
Webinar
FANCI Webinar | June 27, 2016 | Slide 26
![Page 27: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/27.jpg)
FANCI universal developer reference platform
Face authentication
Mood detection
Gesture recognition
Gaze tracking
KeyLemon webcam
nViso webcam
SoftKinetic sensor
Tobii sensor
Se
nso
rs
So
ftwa
re
Info
tain
me
nt
So
ftwa
re
High
Level
API
CEVA
DSP USB
USB
USB
USB
FANCI Webinar | June 27, 2016 | Slide 27
HARMAN
Automotive
Demonstration
Platform
![Page 28: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/28.jpg)
CES 2017
• Launch of next-generation demonstrator running on CEVA DSP platform
• Usecases to be implemented:
1. Face authentication: leveraging face biometrics and eye gaze tracking information, for more secure and efficient recognition of the driver and loading of profiles
2. Smart media player: showcasing a better UX and improved safety by leveraging eye gaze information, emotions recognition, gesture sensing and contextual information, allowing the driver to focus more on the road
FANCI Webinar | June 27, 2016 | Slide 28
![Page 29: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/29.jpg)
Exploitation
• Huge interest by OEMs for application potential in automotive industry towards SOP 2018-2020
• OEM interested in FANCI innovative NCI for infotainment platforms
• Active use of FANCI demonstrator for automotive OEM presentations (ongoing)
• Public demonstrations
FANCI Webinar | June 27, 2016 | Slide 29
![Page 30: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/30.jpg)
What’s next?
• Broadening the scope of NCI beyond Automotive applications to e.g. Healthcare, Security, Gaming, and ICT industries
Interaction
Personalization
Contextual Awareness
Omnipresence
FANCI Webinar | June 27, 2016 | Slide 30
![Page 31: Webinar June 27, 2016 - FANCI Projectfanci-project.eu/wp-content/uploads/2016/07/FANCI-Webinar_2016-0… · SoftKinetic sensor Tobii sensor rs e otainment e High Level API CEVA USB](https://reader034.vdocument.in/reader034/viewer/2022050217/5f638778284c0060890b3526/html5/thumbnails/31.jpg)
Thank you! Any questions?
Q&A
Visit fanci-project.eu
FANCI Webinar | June 27, 2016 | Slide 31