webinar june 27, 2016 - fanci...

Redefining how the driver and vehicle interact

Webinar

June 27, 2016

The HMI revolution

“ The human interface revolution is about perfecting the user experience and will encompass four phases. We call these phases Interaction, Personalization, Contextual Awareness, and Omnipresence.”

– Rick Bergman, CEO, Synaptics

FANCI Webinar | June 27, 2016 | Slide 2

The HMI revolution


Interaction

Personalization

Contextual Awareness

Omnipresence

paving the way towards autonomous driving

Rinspeed XchangE (2014)

How will we interact with cars in the future?

Productivity? Entertainment?

Rinspeed Budii (2015)

Concepts Today – Immersive

Rinspeed Etos (2016)

What’s Changing?

VW Market Cap

$67.1B

BMW Market Cap

$47.7B


Major shift in delivering information Human interactions by A.I. systems


HUMAN INPUT

70 Billion Opportunity by 20201

MACHINE RECOGNITION

Before

- Explicit

- Slow and Error Prone

- Labor Intensive

Today

- Explicit (+) Implicit

- Real-time and Objective

- Automated

1. Bank of America Merrill Lynch (as covered in FT.com)

Key Drivers

Artificial Intelligence

New Input Mechanisms (Face, Gesture, Voice, …)

Adaptive Learning Software

Applications

Key Players

Company Users

Facebook 1.65bn

Google 1.2bn

Baidu 629mn

Microsoft 800mn

Apple 150mn

Machines surpass human performance

0

5

10

15

20

25

30

2010 2011 2012 2013 2014 Human ArXiv 2015

ILSVRX top-5 Error on ImageNet

Blue is Traditional Computer Vision : Purple is Deep Learning : Red is Human

Since 2015 Deep Learning has achieved a super human

(better than human) quality on simple perceptual tasks.

A milestone has been reached and new territories will open

to A.I. performance in the coming years at an ever

increasing rate.


Deep Learning and Big Data

2015: milestone in A.I. “Super

Human” performance

Google Deep Mind programmed Alpha Go to be capable of teaching itself

2016 Google AI beats

Go world champion

A.I. being embedded by new market entrants

Consumer Devices

Home Automation

Ride Sharing

Media & Entertainment

Automotive

Market Benefit New Entrants

Virtual Assistant

Voice Control

Dynamic Pricing Engine

Personalised Preferences

Automated Driving


Indispensable to B2C

Asian tech leaders predict

artificial intelligence & cognitive computing will be the most disruptive technology impacting the

global business-to-consumer (B2C) marketplace.

Next generation products will surpass human performance

Companies rapidly

leveraging A.I. to enter into new markets & taking leadership positions

Daily Life

PC 2000

Smartphone

More natural computer interfaces needed


The vision Language

Face

Speech

Head

Gesture

Touch

Body Pose

IMP

LIC

IT &

EM

OT

ION

User

Behavior

System Reaction

User State

Context


The objective: needs of interaction


FANCI automotive demonstrator

Face authentication

Mood detection

Gesture recognition

Gaze tracking

KeyLemon webcam

nViso webcam

SoftKinetic sensor

Tobii sensor

Se

nso

rs

So

ftwa

re

HA

RM

AN

Info

tain

me

nt

So

ftwa

re

JSON

over TCP

HARMAN

Infotainment

Hardware

USB

USB

USB

USB


FANCI demonstrator


FANCI demonstrator HMI

KeyLemon ID/

nViso mood cam

Tobii

eye gaze cam

SoftKinetic

gesture cam

Instrument

Cluster Display

1440*540

Central display

1280*800 & touch

HARMAN

Infotainment

Demonstrator


FANCI demonstration video


The consortium


The contributions – CEVA

• A leading semiconductor IP company

FANCI-related technologies: Computer Vision DSP IP

Platform Application Development Kit

(ADK) Commercial tools suite & dev.

boards


The contributions – HARMAN

• The leading automotive infotainment and audio supplier

FANCI-related technologies:

Infotainment systems Driver assistance systems

(vision based) Driver workload management


The contributions – KeyLemon

• The face authentication software specialist


Face detection Face verification Face identification Speaker recognition

(biometry) verification


The contributions – nViso

• Developer of emotion detection software


Emotion recognition Sentiment analysis Facial tracking - 170 points Facial gestures


The contributions – SoftKinetic

• The leader in 3D vision and gesture recognition technologies


SKS (SoftKinetic Sensors) SKSW (SoftKinetic Software) + Embedded design expertise


The contributions – Tobii

• Specialist in eye tracking technology


HW and algorithms for eye

and gaze tracking Natural User Interaction and

HMI design, development

and validation


The contributions – Uni of Siena

• Validator of end-user and developer experience


VISLab Multimodal Distributed

Systems for Safety, Monitoring and Ambient Intelligence

Validation and usability


Where we stand

Jan 2015 Jan 2017

CES

Project Start Project End

Public Presentation:

Automotive application

demonstration

running on prototype platform

CES

Public Presentation:

Automotive demonstration

platform with an automotive

application-suite

Jan 2016 June 2016

Webinar


FANCI universal developer reference platform

Face authentication

Mood detection

Gesture recognition

Gaze tracking

KeyLemon webcam

nViso webcam

SoftKinetic sensor

Tobii sensor

Se

nso

rs

So

ftwa

re

Info

tain

me

nt

So

ftwa

re

High

Level

API

CEVA

DSP USB

USB

USB

USB


HARMAN

Automotive

Demonstration

Platform

CES 2017

• Launch of next-generation demonstrator running on CEVA DSP platform

• Usecases to be implemented:

1. Face authentication: leveraging face biometrics and eye gaze tracking information, for more secure and efficient recognition of the driver and loading of profiles

2. Smart media player: showcasing a better UX and improved safety by leveraging eye gaze information, emotions recognition, gesture sensing and contextual information, allowing the driver to focus more on the road


Exploitation

• Huge interest by OEMs for application potential in automotive industry towards SOP 2018-2020

• OEM interested in FANCI innovative NCI for infotainment platforms

• Active use of FANCI demonstrator for automotive OEM presentations (ongoing)

• Public demonstrations


What’s next?

• Broadening the scope of NCI beyond Automotive applications to e.g. Healthcare, Security, Gaming, and ICT industries

Interaction

Personalization

Contextual Awareness

Omnipresence


Thank you! Any questions?

Q&A

Visit fanci-project.eu


http://fanci-project.eu/



webinar june 27, 2016 - fanci...

Documents