1 © 2016 IBM Corporation

Cognitive Interaction using WearablesEyal Herman, Sep 2016

2 2 Phot

o C

redi

t:: C

redi

t Sui

sse

3 3

4

Let’s focus

4

Displaying

Sensing

Let’s focus here

5

Trend• Sensor à Multi-sensor• Acceleration à Galvanic Skin Response• Closed, proprietary à Open• Single, specialized à Flexible• Expensive à Cheap

5

6

Wearables enable new business opportunities

Engaging Customers

Field worker safety

Emergency response

Payments

Pay as you live insurance

Customer service

Customer loyalty

Smart law enforcement

Smart care team

Amusement parks

Smart conference

Banking

HealthcareField worker effectiveness

Shopping Home caring

Wellness

Transforming Professions

7 IBM Confidential

Thinking

Emotion

Activity

Location

Identity

New levels of Cognitive Situation AwarenessStressed

Tired

Excited

Busy

Active

Walking

Commuting

Confused

8

99

Retail

…Why i get those ads when i’m already so nervous?

…She needs to use more sunscreen

I had to walk all the way to the register to grab this basket

1010

Healthcare

…Does she take her medications on time?

Who’s trying to get off their bed?

Is my dad doing well?

1111

Workplace Safety

Who must take a break?

Is everybody OK?

What leads to overexertion?

12

Data Interpretation

12

(tons of) Raw Data

Data Interpretation

Knowing people’s currentsituation, context, activity, mood,…

13

Data Interpretation

13

Data Interpretation on Cloud

Short range connectivity

(tons of) Raw Data

Knowing people’s currentsituation, context, activity, mood,…

14

Data Interpretation

14

Data Interpretation on Cloud

Mobile as a Data Bus

(tons of) Raw Data

(tons of) Raw Data

• Bandwidth• Cost• Latency• Reliability• Privacy• Battery

Knowing people’s currentsituation, context, activity, mood,…

15

Data Interpretation

Mobile Data Interpretation

(tons of) Raw Data

Analytics &Interoperability

Knowing people’s currentsituation, context, activity, mood,…

1616

We have a Quick Start Kit for you• Device Connectivity• Data Interpretation• Gesture Recognition

And it’s free!(we just ask for your feedback and impression)

1717

Demo:Let’s get moving.

Gesture Recognition

18 18

Connectivity SDK

TI Sensor Tag

Connector

MS Band Connector

GemSense Connector

Custom Connector…

Interpretation SDK

Fall Detection Algorithm

Excessive Temperature

Algorithm

Gesture Recognition Algorithm

Custom Algorithm

Data Abstraction

Demo app

Code Samples& Best Practices

Gesture Recognition Algorithms Generator

Gesture Recording & Testing app

…

1919

Examples

Safety Water Intake Gym

2020

How to get it?• Visit our Website: http://wearables.mybluemix.net/• Or scan the QR:

2121

Videos:General introhttps://youtu.be/2ox8Qfz8sJo

Intro to Wearable Gesture Recognitionhttps://youtu.be/LMQi5syT7bU

How to use IBM's Gesture Recording App for Wearables https://youtu.be/rR6rM7A8ouo

Gym Apphttps://youtu.be/7_IDRQnBTnE

Blog Posts:Generalhttp://mobilebusinessinsights.com/2016/03/how-enterprises-can-use-mobile-wearables-to-improve-workflows/

Gymhttps://developer.ibm.com/bluemix/2016/06/26/exercise-bluemix-gesture-recognition-will-counting