communicate by your hands

222
COMMUNICATE BY YOUR HANDS Trương Công Thái - SE61209 - Leader Nguyễn Nhất Nguyên - SE61172 Phạm Hồng Quý - SE61130 Supervisor: Mr. Kiều Trọng Khánh

Upload: tcthai1994

Post on 08-Jan-2017

65 views

Category:

Technology


0 download

TRANSCRIPT

COMMUNICATE BY YOUR HANDS

COMMUNICATE BY YOUR HANDSTrng Cng Thi - SE61209 - LeaderNguyn Nht Nguyn - SE61172Phm Hng Qu - SE61130Supervisor:Mr. Kiu Trng Khnh

Overview

1. Scenario Problems2. Current solution3. Teams solution 4. Feature explanation, algorithm and demoa. Translate (Online)b. Train (Online)c. Translate (Offline)e. Train (Offline)5. Future plan

Communication by Your Hands

Scenario Problems

Communication by Your Hands

1.Scenario Problem

Communication by Your Hands

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

1.Scenario Problem

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

1.Scenario Problem

Communication by Your Hands

WritingTexting1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

1.Scenario Problem

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

1.Scenario Problem

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

Sign language

1.Scenario Problem

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

1.Scenario Problem

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

Current solution

Communication by Your Hands

2.Current solution

Communication by Your Hands

Kinect sign language translator1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

2.Current solution

Communication by Your Hands

Kinect sign language translator1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

2.Current solutionAdvantage:*High accuracyDisadvantage:*Low mobility*Low natural

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

Teams solution

Communication by Your Hands

3.Teams solution

Communication by Your Hands

https://www.myo.com/1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

3.Teams solution

Communication by Your Hands

Medical Grade Stainless Steel EMG sensorsARM Cortex M4 ProcessorGyroscopeAccelerometerMagnetometerhttps://www.myo.com/1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

3.Teams solution

Communication by Your Hands

EMG - Electromyographyhttps://www.myo.com/1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planMedical Grade Stainless Steel EMG sensors

3.Teams solution

Communication by Your HandsEMG: a set of eight numbers 1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan5.045.52.013.345.07.06.334.0EX: ( , , , , , , , )

19

3.Teams solution

Communication by Your Hands

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

3.Teams solution

Communication by Your Hands

CBYH System

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

3.Teams solution

Communication by Your Hands

CBYH System

2 MYO armbands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

3.Teams solution

Communication by Your Hands

CBYH System

2 MYO armbands

Android mobile device1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

3.Teams solution

Communication by Your Hands

CBYH System

2 MYO armbands

Android mobile device

Web services1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

3.Teams solution

Communication by Your Hands

CBYH System

2 MYO armbands

Android mobile device

Web services

Web services1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

Feature explanation

Communication by Your Hands

4. Feature explanation

Communication by Your Hands

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planTiWord

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planTiWord

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planTiWord

Left hand activityRight hand activity

4. Feature explanation

Communication by Your Hands

Left hand activityRight hand activityTiWord

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands

Left handRight hand

Left hand activityRight hand activityTiWord

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsAction

Left handRight hand

Left hand activityRight hand activityTiWord

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0emgCode

1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0emgCode

4. Feature explanation

Communication by Your HandsLeft hand activityRight hand activityTiWord

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands

Left hand activityRight hand activityTiWord

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0emgCode1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0emgCodeleftSignalrightSignal

4. Feature explanation

Communication by Your Hands

Left hand activityRight hand activityTiWord

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

emgCodeemgCodeleftSignalrightSignal1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.01.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0

Timeaning

4. Feature explanation

Communication by Your Hands

Left hand activityRight hand activityTiWord

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

emgCodeemgCodeleftSignalrightSignal12meaningCode

Timeaning

4. Feature explanation

Communication by Your Hands

Left hand activityRight hand activityTiWord

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

emgCodeemgCodeleftSignalrightSignal12meaningCodedataContent

meaning

4. Feature explanation

Communication by Your Hands

Left hand activityRight hand activityTiWord

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

emgCodeemgCodeleftSignalrightSignal12meaningCodedataContentTi

meaning

4. Feature explanation

Communication by Your Hands

Left hand activityRight hand activityTiWord

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

emgCodeemgCodeleftSignalrightSignaldataContent12meaningCode

meaning

4. Feature explanation

Communication by Your Hands

Left hand activityRight hand activityTiWord

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

emgCodeemgCodeleftSignalrightSignaldataContentmeaningCode12

4. Feature explanation

Communication by Your HandsemgCodeleftSignalemgCoderightSignalmeaningCodemeaningdataContent1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsemgCodeleftSignalemgCoderightSignalmeaningRightmeaningRightmeaningCodemeaningdataContentmeaningLeftmeaningLeft1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsemgCodemeaningLeftleftSignalemgCodemeaningRightrightSignalmeaningRightmeaningRight111..*1..*meaningCodemeaningdataContentmeaningLeftmeaningLeft1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsemgCodemeaningLeftleftSignalemgCodemeaningRightrightSignalmeaningRightmeaningRight111..*1..*meaningCodemeaningdataContentmeaningLeftmeaningLeft1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planmeaningLeftmeaningRightmeaningCodewordSignal11..*11..*1..*1

4. Feature explanation

Communication by Your Hands

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands

Connect1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands

ConnectStandardize1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands

ConnectStandardizeDetect rest action1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands

ConnectStandardizeDetect rest actionOptimize1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands

StandardizeDetect rest actionMatchingOptimizeConnect1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands

StandardizeDetect rest actionMatchingOptimizeConnectDetect1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsTranslateConnect1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsTranslateConnectStandardize1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsTranslateConnectStandardizeDetect rest action1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsTranslateConnectStandardizeDetect rest actionMatching1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsTranslateConnectStandardizeDetect rest actionMatching1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsTranslateConnectStandardizeDetect rest actionMatchingDetect1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsTranslateConnectStandardizeDetect rest actionMatchingDetect1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsTrainConnectStandardizeDetect rest action1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsTrainConnectStandardizeDetect rest actionOptimize1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

Translate

Communication by Your HandsConnect and get EMG data from MYO armband4. Feature explanation

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands

Paired1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planPaired

4. Feature explanation

Communication by Your Hands

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

Paired

SDK

Translate

Communication by Your HandsStandardize EMG(Mobile)4. Feature explanation

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands250 EMG pulses / second

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEmg120.015.03.023.01.05.014.06.0

Emg220.015.03.023.01.05.014.06.0

Emg35.03.06.015.025.045.04.09.0

Emg430.032.046.034.02.04.05.01.0

Emg530.032.046.034.02.04.05.01.0

Emg630.032.046.034.02.04.05.01.0

Emg730.032.046.034.02.04.05.01.0

Emg84.015.029.03.02.024.025.056.0

Emg945.032.036.015.025.045.04.019.0

Emg1045.032.036.015.025.045.04.019.0

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEmg120.015.03.023.01.05.014.06.0

Emg220.015.03.023.01.05.014.06.0

Emg35.03.06.015.025.045.04.09.0

Emg430.032.046.034.02.04.05.01.0

Emg530.032.046.034.02.04.05.01.0

Emg630.032.046.034.02.04.05.01.0

Emg730.032.046.034.02.04.05.01.0

Emg84.015.029.03.02.024.025.056.0

Emg945.032.036.015.025.045.04.019.0

Emg1045.032.036.015.025.045.04.019.0

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEmg120.015.03.023.01.05.014.06.0

Emg220.015.03.023.01.05.014.06.0

Emg35.03.06.015.025.045.04.09.0

Emg430.032.046.034.02.04.05.01.0

Emg530.032.046.034.02.04.05.01.0

Emg630.032.046.034.02.04.05.01.0

Emg730.032.046.034.02.04.05.01.0

Emg84.015.029.03.02.024.025.056.0

Emg945.032.036.015.025.045.04.019.0

Emg1045.032.036.015.025.045.04.019.0

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEmg120.015.03.023.01.05.014.06.0

Emg220.015.03.023.01.05.014.06.0

Emg35.03.06.015.025.045.04.09.0

Emg430.032.046.034.02.04.05.01.0

Emg530.032.046.034.02.04.05.01.0

Emg630.032.046.034.02.04.05.01.0

Emg730.032.046.034.02.04.05.01.0

Emg84.015.029.03.02.024.025.056.0

Emg945.032.036.015.025.045.04.019.0

Emg1045.032.036.015.025.045.04.019.0

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEmg120.015.03.023.01.05.014.06.0

Emg220.015.03.023.01.05.014.06.0

Emg35.03.06.015.025.045.04.09.0

Emg430.032.046.034.02.04.05.01.0

Emg530.032.046.034.02.04.05.01.0

Emg630.032.046.034.02.04.05.01.0

Emg730.032.046.034.02.04.05.01.0

Emg84.015.029.03.02.024.025.056.0

Emg945.032.036.015.025.045.04.019.0

Emg1045.032.036.015.025.045.04.019.0

4. Feature explanation

Communication by Your Hands250 EMG pulses / second

2 EMG pulses take 11. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanationExample:

Communication by Your HandsEMG1-4.05.07.0-6.06.07.02.0-10.0EMG21.0-4.010.04.05.07.08.09.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanationExample:

Communication by Your HandsEMG14.05.07.06.06.07.02.010.0EMG21.0-4.010.04.05.07.08.09.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanationExample:

Communication by Your HandsEMG14.05.07.06.06.07.02.010.0EMG21.04.010.04.05.07.08.09.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanationExample:

Communication by Your HandsEMG14.05.07.06.06.07.02.010.0EMG21.04.010.04.05.07.08.09.0Result EMG

4.0 > 1.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanationExample:

Communication by Your Hands

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.05.07.06.06.07.02.010.0EMG21.04.010.04.05.07.08.09.0Result EMG4.0

4. Feature explanationExample:

Communication by Your Hands5.0 > 4.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.05.07.06.06.07.02.010.0EMG21.04.010.04.05.07.08.09.0Result EMG4.0

4. Feature explanationExample:

Communication by Your Hands

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.05.07.06.06.07.02.010.0EMG21.04.010.04.05.07.08.09.0Result EMG4.05.0

4. Feature explanationExample:

Communication by Your Hands10.0 > 7.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.05.07.06.06.07.02.010.0EMG21.04.010.04.05.07.08.09.0Result EMG4.05.0

4. Feature explanationExample:

Communication by Your Hands

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.05.07.06.06.07.02.010.0EMG21.04.010.04.05.07.08.09.0Result EMG4.05.010.0

4. Feature explanationExample:

Communication by Your Hands6.0 > 4.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.05.07.06.06.07.02.010.0EMG21.04.010.04.05.07.08.09.0Result EMG4.05.010.0

4. Feature explanationExample:

Communication by Your Hands

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.05.07.06.06.07.02.010.0EMG21.04.010.04.05.07.08.09.0Result EMG4.05.010.06.0

4. Feature explanationExample:

Communication by Your Hands6.0 > 5.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.05.07.06.06.07.02.010.0EMG21.04.010.04.05.07.08.09.0Result EMG4.05.010.06.0

4. Feature explanationExample:

Communication by Your Hands

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.05.07.06.06.07.02.010.0EMG21.04.010.04.05.07.08.09.0Result EMG4.05.010.06.06.0

4. Feature explanationExample:

Communication by Your Hands7.0 = 7.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.05.07.06.06.07.02.010.0EMG21.04.010.04.05.07.08.09.0Result EMG4.05.010.06.06.0

4. Feature explanationExample:

Communication by Your Hands

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.05.07.06.06.07.02.010.0EMG21.04.010.04.05.07.08.09.0Result EMG4.05.010.06.06.07.0

4. Feature explanationExample:

Communication by Your Hands8.0 > 2.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.05.07.06.06.07.02.010.0EMG21.04.010.04.05.07.08.09.0Result EMG4.05.010.06.06.07.0

4. Feature explanationExample:

Communication by Your Hands

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.05.07.06.06.07.02.010.0EMG21.04.010.04.05.07.08.09.0Result EMG4.05.010.06.06.07.08.0

4. Feature explanationExample:

Communication by Your Hands10.0 > 9.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.05.07.06.06.07.02.010.0EMG21.04.010.04.05.07.08.09.0Result EMG4.05.010.06.06.07.08.0

4. Feature explanationExample:

Communication by Your Hands

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.05.07.06.06.07.02.010.0EMG21.04.010.04.05.07.08.09.0Result EMG4.05.010.06.06.07.08.010.0

Translate

Communication by Your HandsDetect rest action4. Feature explanation

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands

When will I send these EMG data???1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsEMG (a, b, c, d, e, f, g, h)

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsEMG (a, b, c, d, e, f, g, h)

a + b + c + d + e + f + g + h Sum of EMG elements < 40 continue 30 times: rest action

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

Translate

Communication by Your HandsMatching4. Feature explanation

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsEMG1: (14.0, 34.0, 45.0, 1.0, 24.0, 3.0, 12.0, 34.0)1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plana, b, c, d, e, f, g, h8 dimensions space

4. Feature explanationA: (14.0, 34.0, 45.0, 1.0, 24.0, 3.0, 12.0, 34.0)B: (2.0, 4.0, 15.0, 45.0, 30.0, 4.0, 10.0, 2.0)O: (0, 0, 0, 0, 0, 0, 0, 0)

Communication by Your Hands8 dimensions spaceEMG1: (14.0, 34.0, 45.0, 1.0, 24.0, 3.0, 12.0, 34.0)bEMG1: (2.0, 4.0, 15.0, 45.0, 30.0, 4.0, 10.0, 2.0)

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands8 dimensions spaceA: compare EMG data

B: base EMG data

O: The Origin

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsEMG14.012.043.04.020.03.05.09.0

bEMG14.010.043.03.019.03.06.09.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsEMG14.012.043.04.020.03.05.09.0

bEMG14.010.043.03.019.03.06.09.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsEMG14.012.043.04.020.03.05.09.0

bEMG14.010.043.03.019.03.06.09.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planA(4.0, 12.0, 43.0, 4.0, 20.0, 3.0, 5.0, 9.0)B(4.0, 10.0, 43.0, 3.0, 19.0, 3.0, 6.0, 9.0)

4. Feature explanation

Communication by Your HandsEMG14.012.043.04.020.03.05.09.0

bEMG14.010.043.03.019.03.06.09.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planA(4.0, 12.0, 43.0, 4.0, 20.0, 3.0, 5.0, 9.0)B(4.0, 10.0, 43.0, 3.0, 19.0, 3.0, 6.0, 9.0)

4. Feature explanation

Communication by Your HandsEMG14.012.043.04.020.03.05.09.0

bEMG14.010.043.03.019.03.06.09.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planA(4.0, 12.0, 43.0, 4.0, 20.0, 3.0, 5.0, 9.0)B(4.0, 10.0, 43.0, 3.0, 19.0, 3.0, 6.0, 9.0)

4. Feature explanation

Communication by Your HandsEMG14.012.043.04.020.03.05.09.0

bEMG14.010.043.03.019.03.06.09.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsEMG14.012.043.04.020.03.05.09.0

bEMG14.010.043.03.019.03.06.09.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your HandsEMG14.012.043.04.020.03.05.09.0

bEMG14.010.043.03.019.03.06.09.0

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG1bEMG1R0.001

Threshold0.01

Matched list

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG1bEMG1R0.001

Threshold0.001

Matched list

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG1bEMG1R0.001

Threshold0.001

MatchedMatched list

Matched list

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG1bEMG1R0.001

Threshold0.001

EMG1bEMG1Matched

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG1Threshold0.001

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

bEMG2EMG1Threshold0.001

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG1bEMG2R0.05

Threshold0.001

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG1bEMG2R0.05

Threshold0.001

Matched listEMG1bEMG1

No match

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG1Threshold0.001

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

bEMG3EMG1Threshold0.001

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG1bEMG3R0.02

Threshold0.001

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG1bEMG3R0.02

Threshold0.001

Matched listEMG1bEMG1

No match

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG1Threshold0.001

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

bEMG4EMG1Threshold0.001

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG1bEMG4R0.017

Threshold0.001

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG1bEMG4R0.017

Threshold0.001

Matched listEMG1bEMG1

No match

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG1bEMG4R0.017

Threshold0.001

Matched listEMG1bEMG1

No match

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

Threshold0.01

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

bEMG1EMG2Threshold0.01

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG2bEMG1R0.05

Threshold0.01

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG2bEMG1R0.05

Threshold0.01

Matched listEMG1bEMG1

No match

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG2Threshold0.01

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG2bEMG2Threshold0.01

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG2bEMG2R0.016

Threshold0.01

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG2bEMG2R0.016

Threshold0.01

Matched listEMG1bEMG1

No match

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG2Threshold0.01

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG2bEMG3Threshold0.01

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG2bEMG3R0.043

Threshold0.01

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG2bEMG3R0.043

Threshold0.01

Matched listEMG1bEMG1

No match

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG2Threshold0.01

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG2bEMG4Threshold0.01

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG2bEMG4R0.05

Threshold0.01

Matched listEMG1bEMG1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0bEMG23.04.05.03.05.06.07.08.0bEMG32.03.05.07.020.04.023.09.0bEMG410.040.014.023.015.024.03.02.0

EMG2bEMG4R0.05

Threshold0.01

Matched listEMG1bEMG1

No match

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG14.012.043.04.020.03.05.09.0EMG25.05.05.05.06.06.06.06.0EMG315.05.03.07.027.010.04.06.0EMG423.04.02.03.06.03.05.07.0

bEMG14.010.043.03.019.03.06.09.0

Translate

Communication by Your HandsDetect4. Feature explanation

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planResult of matching

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planResult of matchingFind meaning left

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planFind meaning leftResult of matching:bEMG1 (4.0, 10.0, 43.0, 3.0, 19.0, 3.0, 6.0, 9.0)leftSignal4.0, 10.0, 43.0, 3.0, 19.0, 3.0, 6.0, 9.0123.0, 4.0, 5.0, 3.0, 5.0, 6.0, 7.0, 8.0232.0, 3.0, 5.0, 7.0, 20.0, 4.0, 23.0, 9.0542.0, 3.0, 5.0, 7.0, 20.0, 4.0, 23.0, 9.05610.0 40.0, 12.0, 23.0, 15.0, 24.0, 3.0, 2.042

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planFind meaning leftResult of matching:bEMG1 (4.0, 10.0, 43.0, 3.0, 19.0, 3.0, 6.0, 9.0)leftSignalemgCodemeaningLeft4.0, 10.0, 43.0, 3.0, 19.0, 3.0, 6.0, 9.0123.0, 4.0, 5.0, 3.0, 5.0, 6.0, 7.0, 8.0232.0, 3.0, 5.0, 7.0, 20.0, 4.0, 23.0, 9.0542.0, 3.0, 5.0, 7.0, 20.0, 4.0, 23.0, 9.05610.0 40.0, 12.0, 23.0, 15.0, 24.0, 3.0, 2.042

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planResult of matchingFind meaning leftFind meaning right

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planResult of matchingFind meaning leftFind meaning rightNoise meaning filter

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planNoise meaning filterMeaningLeft:12, 12, ... 12, 43, 43, 45, 51, , 51

50 times

70 times

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planNoise meaning filterMeaningLeft:12, 12, ... 12, 43, 43, 45, 51, , 51

50 times

70 times

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planNoise meaning filterMeaningLeft:12, 12, ... 12, 43, 43, 45, 51, , 51

50 times

70 times

12, 51

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planResult of matchingFind meaning leftFind meaning rightFind meaning code of each hand Noise meaning filter

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planFind meaning code of each hand meaningLeft: 12meaningRight: 51 wordSignalmeaningLeftmeaningRightmeaningCode1251123542545435634442125

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planFind meaning code of each hand meaningLeft: 12meaningRight: 51 wordSignalmeaningLeftmeaningRightmeaningCode1251123542545435634442125

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planResult of matchingFind meaning leftFind meaning rightFind meaning code of each hand Find meaning Noise meaning filter

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planFind meaning meaningCode: 1dataContentmeaningCodemeaningLeft1Ti2Bn3n4Cho5Yu

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planFind meaning meaningCode: 1dataContentmeaningCodemeaningLeft1Ti2Bn3n4Cho5Yu

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planResult of matchingFind meaning leftFind meaning rightFind meaning code of each hand Find meaning Duplicate result filter Noise meaning filter

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planDuplicate result filter rawResult:Ti Ti Ti Cho Cho Bn Bn

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planDuplicate result filter rawResult:Ti Ti Ti Cho Cho Bn Bn

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planDuplicate result filter rawResult:Ti Ti Ti Cho Cho Bn Bn

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planResult of matchingFind meaning leftFind meaning rightFind meaning code of each hand Find meaning Duplicate result filter Noise meaning filterResult of matching

Translate

Communication by Your HandsDemo4. Feature explanation

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

Demo -1Demo 1: Translate sign language online

Scenario: User Nguyn Vn A - a mute person, uses 2 MYO armband and translate function of CBYH application to communicate with his classmates : ti thch kt bn mi ngi.

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

Train

Communication by Your HandsOptimize4. Feature explanation

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planOptimized area

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planOptimized area

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planAAA: input EMGA: optimized EMGB: input EMGB: optimized EMG

BB

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG5.06.07.08.04.05.06.07.0

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMG5.06.07.08.04.05.06.07.0

K

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMGnew EMG5.0K*5.06.07.08.04.05.06.07.0

K

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMGnew EMG5.0K*5.06.0K*6.07.08.04.05.06.07.0

K

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMGnew EMG5.0K*5.06.0K*6.07.0K*7.08.04.05.06.07.0

K

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMGnew EMG5.0K*5.06.0K*6.07.0K*7.08.0K*8.04.05.06.07.0

K

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMGnew EMG5.0K*5.06.0K*6.07.0K*7.08.0K*8.04.0K*4.05.06.07.0

K

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMGnew EMG5.0K*5.06.0K*6.07.0K*7.08.0K*8.04.0K*4.05.0K*5.06.07.0

K

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMGnew EMG5.0K*5.06.0K*6.07.0K*7.08.0K*8.04.0K*4.05.0K*5.06.0K*6.07.0

K

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMGnew EMG5.0K*5.06.0K*6.07.0K*7.08.0K*8.04.0K*4.05.0K*5.06.0K*6.07.0K*7.0

K

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planEMGnew EMG5.014.43375672974056.017.32050807568867.020.20725942163678.023.09401076758484.011.54700538379245.014.43375672974056.017.32050807568867.020.2072594216367

K

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planmeaningCodemeaningdataContent

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planmeaningRightmeaningRightmeaningCodemeaningdataContentmeaningLeftmeaningLeft

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planemgCodemeaningLeftleftSignalmeaningRightmeaningRight111..*1..*meaningCodemeaningdataContentNew EMG

emgCodemeaningRightrightSignalmeaningLeftmeaningLeft

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planemgCodemeaningLeftleftSignalmeaningRightmeaningRight111..*1..*meaningCodemeaningdataContentNew EMG

emgCodemeaningRightrightSignalmeaningLeftmeaningLeftmeaningLeftmeaningRightmeaningCodewordSignal11..*11..*1..*1

Train

Communication by Your HandsDemo4. Feature explanation

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Demo - 2Demo 2: Train sign language online

Scenario: Staff Nguyn Vn B with the help of Staff Nguyn Vn C train new word n to the standard library of the system.

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

Offline

Communication by Your Hands4. Feature explanation

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

MatchingOptimizeDetect

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

Offline

Communication by Your HandsTranslate4. Feature explanation

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

Offline

Communication by Your HandsDemo - Translate4. Feature explanation

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Demo - 3Demo 3: Translate sign language (offline)

Scenario: User Nguyn Vn A travels and gets lost in the countryside where no Wi-Fi connection is available and his phone is out of credit. He decides to use the translate (offline) function of CBYH application to ask the local people: Ti u

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

Offline

Communication by Your HandsTrain4. Feature explanation

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

I have to do too many action

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planemgCodemeaningLeftleftSignalemgCodemeaningRightrightSignalmeaningLeftmeaningLeftmeaningRightmeaningRight111..*1..*meaningCodemeaningdataContentmeaningLeftmeaningRightmeaningCodewordSignal11..*11..*1..*1

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planmeaningCodemeaningcustomContentemgCodemeaningLeftleftSignalemgCodemeaningRightrightSignalmeaningLeftmeaningLeft111..*1..*meaningCodemeaningdataContentmeaningLeftmeaningRightmeaningCodewordSignal11..*11..*1..*1meaningRightmeaningRight

4. Feature explanation

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future planmeaningCodemeaningcustomContentemgCodemeaningLeftleftSignalemgCodemeaningRightrightSignalmeaningLeftmeaningLeft111..*1..*meaningCodemeaningdataContentmeaningLeftmeaningRightmeaningCodewordSignal11..*11..*1..*1meaningRightmeaningRight1..*1..*1..*111customLeftcustomRightmeaningCodecustomSignal

Offline

Communication by Your HandsDemo - Train4. Feature explanation

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanationDemo 4: Train sign language (offline)

Scenario: User Nguyn Vn A wants to train new custom sign Ti xin cho mi ngi

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

Outcome

Communication by Your Hands4. Feature explanation

1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

4. Feature explanationCBYH system performance:*Word translation accuracy: 80%*Sentence translation accuracy: 60%(best muscle condition)

Disadvantage:*1 side translation: side language -> text/ speech*Not support multi platform

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

Future plan

Communication by Your Hands

5. Future plan

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

5. Future plan

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

5. Future plan

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

5. Future plan

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

5. Future plan

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

5. Future plan

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

5. Future plan

Communication by Your Hands1. Scenario problem2. Current solution3. Teams solution4. Feature explanation5. Future plan

Thank you for your listening

Q/A

Communication by Your Hands