applications of emotions recognition
TRANSCRIPT
Applications ofEmotions Recognition
Francesco [email protected]
30 January 2015Computer-Supported Interaction
Emotion Recognition
EEG + Brain Computer Interfaces
upload.wikimedia.org/wikipedia/commons/b/bf/EEG_cap.jpg
2
Emotion Recognition
EEG + Brain Computer Interfaces
ECG + Cardiovascular signals
atrialfibrillation.org.ukupload.wikimedia.org/wikipedia/commons/b/bf/EEG_cap.jpg
2
Emotion Recognition
EEG + Brain Computer Interfaces
ECG + Cardiovascular signals
Electrodermal activity
ycanaustralia.comatrialfibrillation.org.ukupload.wikimedia.org/wikipedia/commons/b/bf/EEG_cap.jpg
2
Emotion Recognition
Speech + Voice intonation
www-03.ibm.com
3
Emotion Recognition
Speech + Voice intonation
Facial expressions
chilloutpoint.comwww-03.ibm.com
3
Emotion Recognition
Speech + Voice intonation
Facial expressions
Body language
chilloutpoint.comwww-03.ibm.comwinwithvictory.com
3
Human vs. Human
arabianindustry.com
4
Human vs. Machine
orbitmedia.com
5
Human vs. Machine
orbitmedia.com
EMOTIONS?
5
davenussbaum.com
6
Applications of Emotion Recognition
Medicine E-learning Monitoring
Entertainment Law Marketing
7
1. Medicine
baysidecarecenter.com
Rehabilitation →help monitoring
8
1. Medicine
baysidecarecenter.com iavrpt.org
Companion →enhance realism
8
1. Medicine
baysidecarecenter.com iavrpt.org degreequery.com
Counseling → client’s emotional state
8
1. Medicine
baysidecarecenter.com iavrpt.org degreequery.com masainternational.com
Health care → patients’ feelings about treatment
8
Autism
- struggling to interpret expressions
mychildwithoutlimits.org
9
Autism
- struggling to interpret expressions
- game with this same purpose
mychildwithoutlimits.org
9
Autism
- struggling to interpret expressions
- game with this same purpose
- develop a system → therapy
mychildwithoutlimits.org
9
http://youtu.be/Suc5B79qjfE?t=40s
10
Music Therapy
- help patients deal with stress, anxiety and depression
musictherapy.orggaryradler.com
11
Music Therapy
- help patients deal with stress, anxiety and depression
- positive effects on Alzheimer
musictherapy.orggaryradler.com
11
Music Therapy
- help patients deal with stress, anxiety and depression
- positive effects on Alzheimer
- EEG = real-timemusictherapy.orggaryradler.com
11
2. E-learning
- adjust the presentation style of an online tutor
educed.org
12
2. E-learning
- adjust the presentation style of an online tutor
- detect the state of the learner
educed.org
12
Tutoring system
- positive attitude to maximize learning
skypeteachingjobs.com
13
Tutoring system
- positive attitude to maximize learning
- more interactive and effective
skypeteachingjobs.com
13
Tutoring system
- positive attitude to maximize learning
- more interactive and effective
- provide feedback and guide towards a solution
skypeteachingjobs.com
13
3. Monitoring
sbtjapan.com
Car driver →detect state and alert other cars
14
3. Monitoring
sbtjapan.com manage.grabweb.net
Agent →warning before angry email + invite to calm down
14
3. Monitoring
sbtjapan.com manage.grabweb.net s3.amazonaws.com
ATM not dispensing money when scared
14
Call-center system
- recognize voices
lovemoneylaw.com
15
Call-center system
- recognize voices
- detect anger in speech
lovemoneylaw.com
15
Call-center system
- recognize voices
- detect anger in speech
- prioritize angry calls
lovemoneylaw.com
15
Remote Love
- globalization →mobility
weknowmemes.com
16
Remote Love
- globalization →mobility
- long distance relations
weknowmemes.com
16
Remote Love
- globalization →mobility
- long distance relations
- recognize partner’s trueemotional state
weknowmemes.com
16
Remote Love
- globalization →mobility
- long distance relations
- recognize partner’s trueemotional state
- heartbeat pulsing rings
weknowmemes.com
16
Remote Love
- globalization →mobility
- long distance relations
- recognize partner’s trueemotional state
- heartbeat pulsing rings
- phone detecting affectionweknowmemes.com
16
4. Entertainment
i.ytimg.com
17
jonlieffmd.com
- Recognize mood and emotions of the users
Music Player18
jonlieffmd.com
- Recognize mood and emotions of the users
- satisfy needs
Music Player18
5. Lawdeeper discovery of depositions
cdn2.hubspot.net
19
6. Marketing
- impact of ads
redorbit.com
20
6. Marketing
- impact of ads
- attention and engagement
redorbit.com
20
6. Marketing
- impact of ads
- attention and engagement
- emotion vital in purchasing decisions
redorbit.com
20
6. Marketing
- impact of ads
- attention and engagement
- emotion vital in purchasing decisions→ improve sales
redorbit.com
20
References1. Yoon W.-J. , Park K.-S., A Study of Emotion Recognition and Its Applications, 4th International Conference,
MDAI, Springer, 2007
2. Yoon W.-J. , Park K.-S., A study of speech emotion recognition and its application to mobile services, 4th
International Conference, UIC, Springer, 2007
3. Rached T.S., Perkusich A., Emotion Recognition Based on Brain-Computer Interface Systems, Brain-Computer
Interface Systems, 2013
4. Ntombikayise B., Robinson P., Multimodal Affect Recognition in Intelligent Tutoring Systems, Proceedings of
the 4th international conference on Affective computing and intelligent interaction, 2011
5. Petrushin V., Emotion recognition in speech signal: experimental study, development, and application, ICSLP,
2000
6. Liu Y., Sourina O., Nguyen M.K., Real-time EEG-based Emotion Recognition and its Applications, Special Issue
on Cyberworlds, 2011
7. ExtremeTech:extremetech.com/extreme/189259-real-time-emotion-detection-with-google-glass-an-
awesome-creepy-taste-of-the-future-of-wearable-computers
8. Speech emotion recognition: emospeech.net
9. Emotient, leading authority on emotion detection and sentiment analysis technologies: emotient.com
10. Wikipedia: en.wikipedia.org/wiki/Affective_computing
21
22