ux & measures of engagement
TRANSCRIPT
![Page 1: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/1.jpg)
mesures d’engagement
Dr. Alan PopeNASA
UX&
![Page 2: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/2.jpg)
UX & Measures of Engagement
World Usability Day @ HEC: User Engagement and Usability
Montreal, Canada November 2015
AlanPope
NASALangleyResearchCenter
1
![Page 3: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/3.jpg)
2
• Background of Crew State Monitoring Research at NASA Langley
• Development of a Method for Evaluating Task Engagement Indices
• In Progress Crew State Monitoring Research at NASA Langley
![Page 4: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/4.jpg)
3
Real-Time State Estimation in a Flight Simulator Using fNIRS Gateau T, Durantin G, Lancelot F, Scannella S, Dehais F (2015)
PLoS ONE 10(3): e0121279
![Page 5: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/5.jpg)
4
Initial Research Agenda
![Page 6: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/6.jpg)
5
• Background of Crew State Monitoring Research at NASA Langley
• Development of a Method for Evaluating Task Engagement Indices
• In Progress Crew State Monitoring Research at NASA Langley
![Page 7: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/7.jpg)
• ~70% of incidents and accidents are attributed to human error
Human Error in Aviation Incidents and Accidents
• A primary goal of NASA’s Aeronautics research focus is to improve the National Airspace System which already has an exceptionally high level of safety.
6
![Page 8: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/8.jpg)
Use of Automation in Aviation and Hazardous States of Awareness (HSAs)
• Automation plays a significant role in the cockpit – enables humans to perform beyond normal
abilities (longer shifts, improved control, etc.) • But can lead to suboptimal psychological
states [Aviation Safety Reporting System (ASRS) database] – complacency – boredom – diminished alertness – compromised vigilance – lapsing attention – preoccupation – absorption 7
![Page 9: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/9.jpg)
8
![Page 10: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/10.jpg)
9
![Page 11: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/11.jpg)
Brainwave Correlates of Hazardous States In
Advanced Concepts Flight Simulator 10
![Page 12: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/12.jpg)
11
• Background of Crew State Monitoring Research at NASA Langley
• Development of a Method for Evaluating Task Engagement Indices
• In Progress Crew State Monitoring Research at NASA Langley
![Page 13: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/13.jpg)
12
Task engagement has been defined in various ways. • A subjective state defined by questionnaire factor analytic
loadings on energetic arousal (affect), task motivation, and concentration (cognition). Matthews et al. (2012)
• A cognitive measure that increases “as a function of increasing task demands.” Task demand in the Berka et al. study was manipulated with a set of tasks that elicited the targeted cognitive states. Berka et al. (2007)
• “a substantial amount of the variance” associated with task engagement could be explained using psychophysiological measures. Fairclough and Venables (2006)
![Page 14: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/14.jpg)
13
The closed-loop evaluation method implies a particularly dynamic definition of task engagement • how closely brain response slews with changes
in task demand when brain response is fed back to adjust task demand (automation/manual mix) in real time.
• represents an “operationalization” of the task
engagement construct (Lilienfeld et al., 2015).
![Page 15: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/15.jpg)
14
![Page 16: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/16.jpg)
15
Biological Psychology
![Page 17: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/17.jpg)
16
Biological Psychology
![Page 18: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/18.jpg)
17
EEG data could be used to determine player experience across entire level designs. Nacke et.al (2010)
Engagement index (Beta / (Alpha + Theta)) was capable of differentiating high intensity game events (Player Death) from general game play. McMahan, Parberry and Parsons (2015)
Engagement Index (EI) did not show systematic vigilance decrement but discriminated cued and uncued conditions near task end. Kamzanova, Kustubayeva and Matthews (2014)
Three EEG band ratios, beta/(alpha+theta), beta/alpha, and beta/theta were able to discriminate daydreaming from attentive driving beta/alpha band ratio outperformed the other two indices. Zhao, G., Wu, C. and Ou, B (2013).
![Page 19: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/19.jpg)
18
Adapting Automation based upon EEG Measures of Task Engagement
![Page 20: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/20.jpg)
19
Spin-Offs from Attention and Engagement Research
![Page 21: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/21.jpg)
20
Eastern Virginia Medical School Videogame Neurofeedback Research
![Page 22: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/22.jpg)
21
• HowdoesthisworkfitwithintheNASAmission?– “CongressdeclaresthatthegeneralwelfareoftheUSrequiresthattheuniquecompetenceofNASAinscienceandengineeringsystemsbedirectedtoassisFnginbioengineeringresearch,development,anddemonstra4onprogramsdesignedtoalleviateandminimizetheeffectsofdisability.”TheNa'onalAeronau'csandSpaceAct,Sec.20102.(f)
![Page 23: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/23.jpg)
22
ZONE An embodiment of U.S. patent number 8628333
Biofeedback Training
for Optimal Athletic
Performance
![Page 24: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/24.jpg)
23
EEG-based MindShift FPS
Trade names and trademarks are used in this presentation for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.
![Page 25: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/25.jpg)
24
• Background of Crew State Monitoring Research at NASA Langley
• Development of a Method for Evaluating Task Engagement Indices
• In Progress Crew State Monitoring Research at NASA Langley
![Page 26: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/26.jpg)
25
![Page 27: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/27.jpg)
26
Fixed-Base Simulator Lab
![Page 28: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/28.jpg)
27
Attention-related Human Performance Limiting States (AHPLS)
• AHPLS may reduce pilot aircraft state awareness, and can be indicated by covert or physiological markers of limited performance.
• Current NASA Crew State Monitoring (CSM) studies assess the efficacy of using CSM technology as a means of detecting adverse human performance states.
![Page 29: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/29.jpg)
28
• CAST research for safety enhancements to improve commercial pilot Training for Attention Management to address attention-related human performance limitations observed in flight incidents
• Develop methods to detect and measure attention-related human performance limiting states (AHPLS):
o Channelized Attention o Diverted Attention o Startle / Surprise o Confirmation Bias
![Page 30: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/30.jpg)
29
Results are to be presented: Harrivel, Liles, Stephens, Ellis, Prinzel, Pope.
Psychophysiological sensing and state classification for attention management in commercial aviation.
AIAA Sci Tech 2016, San Diego, 4 - 8 January 2016.
![Page 31: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/31.jpg)
30
LaRC Cockpit Motion Facility
![Page 32: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/32.jpg)
31
Next CSM Research Objective Is Analogous to the Biofeedback Spin-Offs – “Spin-Back”
• Commercial Aviation Safety Team (CAST) recommendation to study Training for Attention Management
• “Training-based mitigations - self-diagnosis methods for flight crew members to recognize and recover from channelized attention, confirmation bias, startle/surprise, and diverted attention”
• Analogous to training to recognize symptoms of hypoxia
![Page 33: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/33.jpg)
32
For coverage of our core research: Stephens, C. L., Scerbo, M. W., and Pope, A.T. Adaptive Automation for Mitigation of Hazardous States of Awareness Chapter 26 in The Handbook of Operator Fatigue edited by Matthews, Desmond, Neubauer, and Hancock, Ashgate 2012. For coverage of our biofeedback work: Pope, A.T., Stephens, C.L., and Gilleade, K. M. Biocybernetic Adaptation as Biofeedback Training Method Chapter 5 in Advances in Physiological Computing edited by Fairclough and Gilleade, Springer 2014.
![Page 34: UX & Measures of Engagement](https://reader033.vdocument.in/reader033/viewer/2022042723/587b99431a28ab4e4f8b709d/html5/thumbnails/34.jpg)
33