Wearable Sensors and UX Development

Mark Melnykowycz

Frontend Conference 2014 August 29th 2014 Zurich, Switzerland

mark@idezo.ch / @idezo_ch / @americanpeyote

#fec14 @idezo_ch

Idea Flow

Evolution of Materials

IC Design / Production Material Library Influence on wearables

Sensors

Flexible sensors Future applications

Evolution of Computing

Sensor use Wearables landscape

Trends

Prototyping

Science to Society

#fec14 @idezo_ch

Products and Innovation Pipeline

Characterize and communicate how the world/universe work

Putting science into something we can build things with

Translating technology into something which people interact with

#fec14 @idezo_ch

Ubiquitous Computer

Internet of Things (IoT)

Web of Things (WoT)

Wearable Computing

#fec14 @idezo_ch

Connected Device Evolution

50 Billion By 2020*

Quantified User

Quantified Self

IoT

*http://share.cisco.com/internet-of-things.html

#fec14 @idezo_ch

Computing Evolution Trends

UX Patterns Increase with Devices

Defined UX Space

Distributed UX

#fec14 @idezo_ch

Separate Devices: Closed UX design spaces

Dev

ices

In

tera

ctiv

ity

User patterns are learned and establish “easy to use” psychology

#fec14 @idezo_ch

Technology and User Experience

*http://www.macworld.com/article/2090829/apple-executives-on-the-mac-at-30-the-mac-keeps-going-forever.html

“The reason OS X has a different interface than iOS isn’t because one came after the other or because this one’s old and this one’s new,” Federighi said. Instead, it’s because using a mouse and keyboard just isn’t the same as tapping with your finger. “This device,” Federighi said, pointing at a MacBook Air screen, “has been honed over 30 years to be optimal” for keyboards and mice.*

-Apple senior vice president of software engineering Craig Federighi

iOS

O

SX

Win

dow

s 8.

1

#fec14 @idezo_ch

Device vs Ecosystem UX

Designing for one device UX is easier

Designing for an ecosystem offers more opportunity

#fec14 @idezo_ch

Wearables / IoT: Open UX Design Ecosystem

Many Devices

Multiple Interaction Patterns

Some Devices Talk

Openness of ecosystem defines UX

design space

#fec14 @idezo_ch

Quantified User

Quantified Self

Device Tracking and Data Interpretation

Self-Tracking and Data Analysis

Data Trends Low/Medium Accuracy Data Ingestion Data Interpretation

Continuous Tracking Sensor Fusion User Data Profile Low/Medium/High Accuracy Smart Apps

User is the Data Scientist

App is the Data Scientist

#fec14 @idezo_ch

Quantified User

User Tracking and Data Interpretation

Total Data Profile

The user is a person and an ecosystem of data

Design UX based on data context

#fec14 @idezo_ch

User State Determination / Context

Location

Time

Heart Rate

Sensor Inputs/Fusion

User State Position

Application User Experience

…? Sensor Hub

#fec14 @idezo_ch

Data

User Experience

Wearable Computing

Sensors / Actuators

Product Development

Application Development

Does Wearable make the difference?

#fec14 @idezo_ch

Personal Tracking

2nd/3rd Screen

Current Single Device UX Design Trends

Notifications Minimal Interactions

Data Profile Creation

#fec14 @idezo_ch

Wrist-band Form Factor

#fec14 @idezo_ch

Wearable Sensors

Wearable Activity Tracking Quantified Self

http://amiigo.co/

ION Glasses

Angel

Heart rate Skin temp. Blood oxygen Physical activity

Acoustical Optical Acceleration Temperature

Fitbit

#fec14 @idezo_ch

Sensors Basics

Translates physical interaction into electrical signal

Time Acceleration GPS Compass …

Direction/Amplitude Global Position Orientation Speed …

Sensors Output

#fec14 @idezo_ch

Sensor Materials Evolution

Integrated Circuits Layered designs

Vapor deposition / etching

Hard materials Silicon

PVD / Metals

Oxides Doped Ceramics PZT

Quartz

Pressure Sensor Acceleration Sensor

Surface micromachining

#fec14 @idezo_ch

Smart Phone Sensor Anatomy E

nviro

nmen

t Sen

sing

Connectivity

Imaging

Depth Sensing

Thermal Imaging Motion

Coprocessor Acceleration

GPS

Compass

Motion Profile

#fec14 @idezo_ch

Near Future: Thermal Imaging Uses

Metaio Thermal Touch Emotion Recognition?

Nummenmaa L et al. PNAS 2014;111:646-651

Separate UI from device Visualize emotions

#fec14 @idezo_ch

Focus on Solving One User Problem

Value for the User?

Often good UX means solving one (or a few) problems really, really well in one product

Don’t get lost in the ecosystem

#fec14 @idezo_ch 11th Wearable Technologies Conference 2014 I Europe

#fec14 @idezo_ch

Business Modeling for Wearable Tech / IoT

User Experience

Application / Experience

Development

Data

Sensors / Actuators

Who What How

#fec14 @idezo_ch

Moticon (moticon.com)

User Dat

a Pr

ofile

Rem

ote

Res

earc

h

Separation of UX, data profile and user value

The ideal wearables UX is invisible

#fec14 @idezo_ch

Samsung Gear S Smart Watch

Accelerometer Gyroscope UV Heart Rate

Ambient Light Compass Barometer 3G

Wide range of sensors and connectivity

#fec14 @idezo_ch

User – Data Pipeline

API

Sensors / Actuators

Data

Data Digestion / Algorithms

Interpretation

#fec14 @idezo_ch

Wearables and IoT Development

IoT / Hardware Tools

Trends: Society vs. Technology

Solution Idea

#fec14 @idezo_ch

Wearables Development Example: eHealth

Patient Empowerment

Self-Diagnosis

Remote Monitoring

Rehabilitation

Sensor Technology Use Cases

Acceleration Temperature

Light / Radiation Orientation

Electrical Impulse …

#fec14 @idezo_ch

Learn / Understand

Act

Quantify

Learning about their medical situation and understanding which actions can influence it

Gathering specific information on their condition, which can be used to influence it

Taking steps and enacting change in their lives to affect their medical situation

Patient

Patient Empowerment UX

#fec14 @idezo_ch

Quantify

Gathering specific information on their condition, which can be used to influence it

Based on asking questions

Depends on observations of a patient on how they feel

Effective in building historical profiles of user states, emotions, etc.

Quantified Measured data from an instrument (reproducible)

Passively with wearable sensors or IoT devices

Actively with specific tools

Data Types

#fec14 @idezo_ch

Hardware Prototyping for eHealth

Easy testing of medical parameters with Arduino / Raspberry Pi

Flexible toolkit of basic sensors

Open hardware platform

Convert physical elements into digital signals

#fec14 @idezo_ch

Multiple Sensor Connections

#fec14 @idezo_ch

Flexible Data Delivery iOS / Android App

API

#fec14 @idezo_ch

Wearables and User Experience

Value for the User?

Solve a user problem

Look at the device ecosystem

Be aware of sensor function

UI and device may be separate

The best solution might be invisible

#fec14 @idezo_ch

Contact / Questions

mark@idezo.ch @idezo_ch / @americanpeyote