interfacing with humans in the iot era · industry innovator in human interface solutions •first...

Interfacing with Humans in the IoT Era

Huibert Verhoeven

SVP & GM IoT

© 2018 Synaptics Incorporated 2

SYNAPTICS LEADS THE HUMAN INTERFACE REVOLUTION

PIONEERING THE RELATIONSHIP BETWEENPEOPLE AND INTELLIGENT DEVICES


Synaptics – Pioneers in Neural Network Processing

NEURALNETWORKS

1986 - Synaptics was founded to commercialize analog neural

network chips for ultra-low power pattern matching

Action potential

Pre-synaptic(“sending”) cell

SYNAPSE

Post-synaptic(“receiving”) cell


Experience is Everything – Over 30 Years in Human Interface

20 Locations WorldwideFounded in 1986

NASDAQ: SYNA

+70% in Engineering

2300+ Employees

FY17 Revenue: $1.72B


Industry Innovator in Human Interface Solutions

• First with touchpads for notebook PCs (TouchPad™)

• First with capacitive touch on mobile phones (ClearPad®)

• First with capacitive touchscreen technology for mobile phones (ClearPad®)

• First with pressure sensitive touchscreen solution (ForcePad®)

• First with touch & display driver integration (TDDI) for smartphones & auto

• First with Match-in-Sensor™ fingerprint authentication (Natural ID™)

• First with optical-based fingerprint sensors for smartphones (Clear ID™)

• First to meet Amazon’s far-field qualification with only 2 microphones (AudioSmart®)

• First multimedia processor to power Android TV on service provider STB (VideoSmart™)

1st


Advanced Underlying Technologies

Far-field Voice and

Speech Capture

Acoustics and Audio

Output Processing

Video and Image

Processing

Optical Imaging

Display Driver and

Integrated Sensing

Capacitive Sensing


Boundless Opportunities in a New Growth Era

2000 2010 2020

Notebook PC SmartphoneConsumer IoT

Automotive


Revolutionary Jump in Device Intelligence

User learns fixed device Ambient AI adapts to user

DE

VIC

E I

NT

EL

LIG

EN

CE

User struggles with

multiple devices

PAST PRESENT FUTURE


Voice will be Everywhere


Do you want me to take

care of dinner? I found a

2 for 1 offer from Chronic Tacos

I think you would like

Ordering dinner for two.

Expected to arrive in 30 min

Sure that

sounds good.

Devices will become Context and Conversation Aware


Ambient Computing will be Omnipresent

“Hi John, would you like me

to set the temperature to 80°?”

“I’ll turn off lights in the living room.”

“Here are your favorite movies on Netflix.”

“Should I make some popcorn?”

It’s too cold

outside. I think I’ll

stay in and watch

a movie.

AI identifies users, location and context

PRIVACY RESPONSE AVAILABILITY


Data Deluge of Ambient Computing

Vast amounts of cameras & sensors

gathering massive volumes of data

Ambient computing requires Intelligence at the Edge

CONCERNS

• Security & Privacy

• Performance & Latency

• Availability


Smart Home Processing Capability

2013Single Core Processor

at 2000 DMIPS

2018Quad Core Processor

at 43,000 DMIPS


IP Needed for Future Successful Voice IoT Products

SoC

RF

Speaker

Amp

FFV

Processing

Cloud Services

ADC

Trigger

BiometricsSmart Amp

Local

ASR/NLU

Context

Awareness

NLUVoice

Calling

Speech

Recognition

Media

Content

ShoppingHome

Control

Security NPU


SyNAP* on Android - Software Architecture

Linux

Android NN Runtime

Synaptics /

IP Providers

Google

Android Applications with ML (apk)

App

Developers

GPU

Drivers

OpenCL

GPU HAL

NPU LLD

NPU HALExtension

HAL

Scheduling NN Operations on the best possible core

CPU

Fallback

VS-6xx and later

TensorFlow Lite

*SyNAP: Synaptics Neural Network Accelerator and Processor


Semiconductor Process Implications

Our HMI vision requires low active power, ultra-low standby power,

significant computation, and dedicated neural network hardware


IoT Process Sweet Spot Different from Mobile

0

0.5

1

1.5

2

2.5

3

3.5

28nm IoT focus FinFet

Active Power Unit Cost Investment


Key Aspects of Consumer IoT Solutions

Small form-factor and highly integrated solutions for

ubiquitous use in homes

Extremely low power during idle periods but high-

performance during active periods

Fast time-to-market through near turn key systems


Boundless Opportunities

TOMORROWTODAY


Local Intelligence – Smarter Edge

SMART CLOUDSMART DEVICES

PRIVACY RESPONSE AVAILABILITY

PRIVACY RESPONSE AVAILABILITYTODAYCommands mostly processed in cloud

TOMORROWCommands mostly processed locally

INTELLIGENCE

INTELLIGENCE

interfacing with humans in the iot era · industry innovator in human interface solutions •first...

Documents