the coming age of empathic computing

of 26 /26
THE COMING AGE OF EMPATHIC COMPUTING Mark Billinghurst [email protected] June 2 nd 2016 AWE 2016 Conference Santa Clara, USA

Upload: mark-billinghurst

Post on 23-Jan-2018

991 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: The Coming Age of Empathic Computing

THE COMING AGE OF EMPATHIC COMPUTING

Mark Billinghurst [email protected]

June 2nd 2016

AWE 2016 Conference Santa Clara, USA

Page 2: The Coming Age of Empathic Computing
Page 3: The Coming Age of Empathic Computing

Current AR/VR/Wearable Technology

Page 4: The Coming Age of Empathic Computing

Applications Enabled

• Gaming • Education • Health • Medicine • Training • Tourism • Etc

Page 5: The Coming Age of Empathic Computing

Looking to the Future

Page 6: The Coming Age of Empathic Computing

Empathy

“Seeing with the Eyes of another,

Listening with the Ears of another,

and Feeling with the Heart of another..”

Alfred Adler

Page 7: The Coming Age of Empathic Computing
Page 8: The Coming Age of Empathic Computing

Empathic Computing

1. Understanding: Systems that can understand your feelings and emotions

2. Experiencing: Systems that help you better experience the world of others

3. Sharing: Systems that help you better share the experience of others

Sensors

VR

AR

Page 9: The Coming Age of Empathic Computing

1. Understanding: Affective Computing

• Ros Picard – MIT Media Lab • Systems that recognize emotion

Page 10: The Coming Age of Empathic Computing

Example: Affectiva

https://www.youtube.com/watch?v=6QDMNPhMJI4

Page 11: The Coming Age of Empathic Computing

2. Experiencing: Virtual Reality

"Virtual reality offers a whole different medium to tell stories that really connect people and create an empathic connection."

Nonny de la Peña http://www.emblematicgroup.com/

Page 12: The Coming Age of Empathic Computing

Using VR for Empathy

• USC Project Syria (2014) • Experience of Terrorism • Project Homeless (2015)

• Experience of Homelessness

Page 13: The Coming Age of Empathic Computing

Project Homeless

https://www.youtube.com/watch?time_continue=1&v=SSLG8auUZKc

Page 14: The Coming Age of Empathic Computing

CHILDHOOD (Siggraph 2015)

• Kenji Suzuki, University of Tsukuba • What does it feel like to be a child? • VR display + moved cameras + hand restrictors

Page 15: The Coming Age of Empathic Computing

CHILDHOOD Demo

https://www.youtube.com/watch?v=V3OghiKZxz4

Page 16: The Coming Age of Empathic Computing

Sharing: Augmented Reality

Can we develop systems that allow us to share what we are seeing, hearing and feeling with others?

Page 17: The Coming Age of Empathic Computing

Empathy Glasses (CHI 2016)

• Combine together eye-tracking, display, face expression •  Impicit cues – eye gaze, face expression

+ +

Pupil Labs Epson BT-200 AffectiveWear

Masai, K., Sugimoto, M., Kunze, K., & Billinghurst, M. (2016, May). Empathy Glasses. In Proceedings of the 34th Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. ACM.

Page 18: The Coming Age of Empathic Computing

AffectiveWear – Emotion Glasses

• Photo sensors to recognize expression • User calibration • Machine learning • Recognizing 8 face expressions

Page 19: The Coming Age of Empathic Computing

Empathy Glasses in Use

• Eye gaze pointer and remote pointing •  Face expression display •  In future integrated eye-tracking/display

Page 20: The Coming Age of Empathic Computing

Empathy Glasses Demo

Page 21: The Coming Age of Empathic Computing

Lessons Learned • Pointing really helps in remote collaboration

• Makes remote user feel more connected

• Gaze looks promising • Shows context of what person talking about • Establish shared understanding/awareness

• Face expression • Used as an implicit cue to show comprehension

• Limitations •  Limited implicit cues •  Task was a poor emotional trigger • AffectiveWear needs improvement

Page 22: The Coming Age of Empathic Computing

Empathic VR Environments

• Player and Viewer •  Viewer slaved to player

• Share emotional signals •  Heart rate, GSR

• Remote affect measuring

Page 23: The Coming Age of Empathic Computing

Demo: Empathic VR

Page 24: The Coming Age of Empathic Computing

AR and VR for Empathic Computing • VR systems are ideal for trying experiences:

• Strong story telling medium • Provide total immersion/3D experience • Easy to change virtual body scale and representation

• AR systems are idea for live sharing: • Allow overlay on real world view/can share viewpoints • Support remote annotation/communication • Enhance real world task

Page 25: The Coming Age of Empathic Computing

Conclusions • Trend towards Empathic Computing

• Understanding, Experiencing, Sharing

• AR/VR Enables Empathic Experiences • Changes perspective • Sharing space/experience • Supports annotation/communication

• Many directions for future research

Page 26: The Coming Age of Empathic Computing

www.empathiccomputing.org

@marknb00

[email protected]