neuroergonomics: the brain at work and in everyday life · pierre besson, vincent cabibel, mark...

21
a publisher's https://oatao.univ-toulouse.fr/21820 http://doi.org/10.1016/C2016-0-02196-4 Ayaz, Hasan and Dehais, Frédéric Neuroergonomics: the brain at work and in everyday life. (2019) Elsevier. ISBN 9780128119266

Upload: others

Post on 19-Oct-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

�������������������������� �������������������������������������������������������

�������������������������������������

���������������������������������������������

������ �� ��� ���� ����� ��������� ����� �������� ���� ��� � ��� ���� ��������

���������������� �������������������������������������������������

�������������������������������������������������

����������������� ��

������������ ���

a publisher's https://oatao.univ-toulouse.fr/21820

http://doi.org/10.1016/C2016-0-02196-4

Ayaz, Hasan and Dehais, Frédéric Neuroergonomics: the brain at work and in everyday life. (2019) Elsevier. ISBN

9780128119266

Page 2: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging
Page 3: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

Neuroergonomics

Page 4: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

         

This page intentionally left blank

Page 5: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

NeuroergonomicsThe Brain at Work and in Everyday Life

Edited by

Hasan AyazDrexel University, Philadelphia, PA, United States

Frédéric DehaisISAE-SUPAERO, Université de Toulouse, Toulouse, France

Page 6: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

Academic Press is an imprint of Elsevier125 London Wall, London EC2Y 5AS, United Kingdom525 B Street, Suite 1650, San Diego, CA 92101, United States50 Hampshire Street, 5th Floor, Cambridge, MA 02139, United StatesThe Boulevard, Langford Lane, Kidlington, Oxford OX5 1GB, United Kingdom

Copyright © 2019 Elsevier Inc. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording, or any information storage and retrieval system, without permission in writing from the publisher. Details on how to seek permission, further information about the Publisher’s permissions policies and our arrangements with organizations such as the Copyright Clearance Center and the Copyright Licensing Agency, can be found at our website: www.elsevier.com/permissions.

This book and the individual contributions contained in it are protected under copyright by the Publisher (other than as may be noted herein).

NoticesKnowledge and best practice in this field are constantly changing. As new research and experience broaden our understanding, changes in research methods, professional practices, or medical treatment may become necessary.

Practitioners and researchers must always rely on their own experience and knowledge in evaluating and using any information, methods, compounds, or experiments described herein. In using such information or methods they should be mindful of their own safety and the safety of others, including parties for whom they have a professional responsibility.

To the fullest extent of the law, neither the Publisher nor the authors, contributors, or editors, assume any liability for any injury and/or damage to persons or property as a matter of products liability, negligence or otherwise, or from any use or operation of any methods, products, instructions, or ideas contained in the material herein.

Library of Congress Cataloging-in-Publication DataA catalog record for this book is available from the Library of Congress

British Library Cataloguing-in-Publication DataA catalogue record for this book is available from the British Library

ISBN: 978-0-12-811926-6

For information on all Academic Press publications visit our website at https://www.elsevier.com/books-and-journals

Publisher: Nikki LevyAcquisition Editor: Natalie FarraEditorial Project Manager: Kathy PadillaProduction Project Manager: Poulouse JosephDesigner: Mark Rogers

Typeset by TNQ Technologies

Page 7: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

Dedication

This book is dedicated to Professor Raja Parasuraman who unexpectedly passed on March 22, 2015. Raja Parasuraman’s pioneering work led to the emergence of Neuroergonomics as a new scientific field. He made significant contributions

to a number of disciplines from human factors to cognitive neuroscience. His early work included important contributions to topics such as vigilance and

human interaction with automated systems. He later consolidated his interests in human factors and cognitive neuroscience to develop a new discipline called Neuroergonomics, which he defined as the study of the brain and behavior at

work.His advice to young researchers was to be passionate in order to develop

theory and knowledge that can guide the design of technologies and environments for people. His legacy, the field of Neuroergonomics, will live

on in countless faculties and students whom he advised and inspired with unmatched humility throughout the span of his distinguished career. Raja Parasuraman was an impressive human being, a very kind person, and an

absolutely inspiring individual who will be remembered by everyone who had the chance to meet him.

Page 8: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

This page intentionally left blank

Page 9: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

vii

Contents

List of Contributors xxi

Section IIntroduction

1. Progress and Direction in Neuroergonomics

Frédéric Dehais and Hasan Ayaz

Introduction 3Understanding the Brain in Everyday Activities 3

Adapting Interaction 4Augmenting Cognition 5

Conclusion and Future Challenges 5Book Organization 5References 6

Section IIMethods

2. The Use of Electroencephalography in Neuroergonomics

Klaus Gramann and Markus Plank

Introduction 11Physiological Foundation of the EEG 11

EEG Amplifiers 12EEG Sensors 12

Signal Processing 13Data Analysis in the Time Domain—Event-

Related Potentials 13Data Analysis in the Frequency Domain—

Spectral Variations 13Applications 14Summary 14References 15

3. The Use of Functional Near-Infrared Spectroscopy in Neuroergonomics

Hasan Ayaz, Meltem Izzetoglu, Kurtulus Izzetoglu and Banu Onaral

Introduction 17Measure 17

Physiological and Physical Principles 17Processing 18

Motion Artifacts 18Superficial Layers 19Physiological Signals 19

Analyze 19Applications 20

Aerospace: Cognitive Workload Assessment of Air Traffic Controllers 20

Aerospace: Expertise Development With Piloting Tasks 21

Healthcare: Cognitive Aging 21Conclusion 22References 22

4. Why is Eye Tracking an Essential Part of Neuroergonomics?

Vsevolod Peysakhovich, Frédéric Dehais and Andrew T. Duchowski

Eye Movements 27Pupil Diameter 28Eye–Computer Interface 28References 29

5. The Use of tDCS and rTMS Methods in Neuroergonomics

Daniel Callan and Stephane Perrey

Introduction 31TMS Principles 31tDCS Principles 32Conclusion 33References 33

Page 10: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

viii Contents

6. Transcranial Doppler Sonography in Neuroergonomics

Tyler H. Shaw, Amanda E. Harwood, Kelly Satterfield and Victor S. Finomore

TCD Instrumentation and Application 35TCD and Task Characteristics 36

TCD and Supervisory Control 36TCD and Operator Characteristics 37

TCD and the Effects of Operator Experience 38TCD and the Effects of Cognitive Aging 38

Conclusion 39References 40Further Reading 41

7. Brain–Computer Interface Contributions to Neuroergonomics

Fabien Lotte and Raphaëlle N. Roy

Introduction 43Signal Processing 44

Preprocessing 44Feature Extraction 44Classification 45Adaptation 45

Contributions to Neuroergonomics 45Mental States 45Offline Use: Evaluation 46Online Use: Adaptation 46

Perspectives 46References 46

8. Neuroergonomics of Simulators and Behavioral Research Methods

Carryl L. Baldwin

Overview 49Simulations and Neuroergonomics 49

Advantages 49Challenges 49

Important Issues 50Transfer of Training 50Fidelity 50Validity 50Generalizability 50Part Task 51Whole Task 51Simulator Sickness 51Adaptation Period 52

Behavioral Research Methods 52Baseline Performance 52Control Conditions 52

Conclusion 52References 53

9. Neuroergonomics for Aviation

Daniel E. Callan and Frédéric Dehais

Introduction 55Challenges 55Electro-Encephalography 56Functional Near Infra Red Spectroscopy 56

Brain Computer Interface and Neuro-Adaptive Technology 57

Neurostimulation 57Conclusion 57References 57

10. MoBI—Mobile Brain/Body Imaging

Evelyn Jungnickel, Lukas Gehrke, Marius Klug and Klaus Gramann

Introduction 59Physiological Principles 59Instrumentation 60

Signal Processing and Analysis Approaches 60Applications 61References 62

11. Experiments With Participants: Some Ethical Considerations

Catherine Tessier and Vincent Bonnemains

Introduction 65Who Is Involved in the Experiment? 65

The Investigator 65The Participants 65

Information Given to the Participants 66Can the Criteria Really Be Satisfied? 66To What Extent Is the Participant Informed? 66Potential Benefits and Risks 66Incidental Findings 67

Data 67Which Data Is Really Necessary? 67Personal Data 67Anonymization and Pseudonymization 67Data Storage and Access 68

Toward Experiment Results Publication 68Approval by an Ethics Committee 68Conflicts of Interest 68More Scientific Integrity Issues 69

Conclusion 69Acknowledgments 69References 69

Page 11: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

Contents ix

Section IIINeuroadaptive Interfaces and Operator Assessment

12. Neural Efficiency and Mental Workload: Locating the Red Line

Stephen Fairclough, Kate Ewing, Christopher Burns and Ute Kreplin

Introduction 73Neural Efficiency 73Study One 74Study Two 75Summary 76References 76

13. Drowsiness Detection During a Driving Task Using fNIRS

Rayyan A. Khan, Noman Naseer and Muhammad J. Khan

Introduction 79Literature Review 80Methods 80

Support Vector Machine 81Linear Discriminant Analysis 82

Results 82Discussion 82Conclusion 84References 84Further Reading 85

14. Neural Oscillation Dynamics of Emerging Interest in Neuroergonomics

Robert J. Gougelet

Neuroergonomists Should Know About Neural Oscillations 87

Neural Oscillation Dynamics of Emerging Interest 87Amplitude, Frequency, and Phase

Modulation of Neural Oscillations 87Amplitude, Frequency, and Phase

Coupling of Neural Oscillations 89Waveform Shape and Neural Noise 89

Leveraging Neural Oscillations in Neuroergonomics 89

References 90

15. Is Mindfulness Helping the Brain to Drive? Insights From Behavioral Data and Future Directions for Research

Emanuelle Reynaud and Jordan Navarro

Introduction 93MMP and Driving 93

Method 93Results 94Discussion 95

MMP and the Driving Brain 95Rationale 95Method 96Results 96Discussion 96

General Discussion and Conclusion 97References 97

16. Tracking Mental Workload by Multimodal Measurements in the Operating Room

Ahmet Omurtag, Raphaëlle N. Roy, Frédéric Dehais, Luc Chatty and Marc Garbey

Introduction 99Methods 100Results 101Discussion 102Conclusion 102References 102

17. Toward Brain-Based Interaction Between Humans and Technology: Does Age Matter?

Mathias Vukelić, Kathrin Pollmann and Matthias Peissner

Introduction 105Methods 105

Participants 105Experimental Procedure and Data Recording 105EEG Data Analysis 106

Results 106Subjective Ratings 106Event-Related Potentials 106

Discussion 107Acknowledgments 108References 108

Page 12: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

x Contents

18. Mobile Neuroergonomics: Action, Interfaces, Cognitive Load, and Selective Attention

Ryan McKendrick

Action, Environment, and the Brain 111Action, Technology, and the Brain 113Neuroergonomics and Selective Attention 115Conclusion 115References 116

19. Computational Models for Near-Real-Time Performance Predictions Based on Physiological Measures of Workload

Matthias D. Ziegler, Bartlett A. Russell, Amanda E. Kraft, Michael Krein, Jon Russo and William D. Casebeer

Introduction 117Methods 118

Participants 118Task Design 118

Results 119Discussion 120Acknowledgments 120References 120

20. EEG-Based Mental Workload Assessment During Real Driving: A Taxonomic Tool for Neuroergonomics in Highly Automated Environments

Gianluca Di Flumeri, Gianluca Borghini, Pietro Aricò, Nicolina Sciaraffa, Paola Lanzi, Simone Pozzi, Valeria Vignali, Claudio Lantieri, Arianna Bichicchi, Andrea Simone and Fabio Babiloni

Introduction 121Material and Methods 122

Experimental Protocol 122EEG Recording and Processing 123Eye Tracking Recording and Processing 123Performed Data Analysis 123

Results 124Discussion 125Conclusions 125Acknowledgments 125References 125

21. Preliminary Validation of an Adaptive Tactical Training Model: Cognitive Alignment With Performance-Targeted Training Intervention Model

Quinn Kennedy, Travis Carlson and Lee Sciarini

Introduction 127Methods 128CAPTTIM Classification 129Results 129Discussion 130Acknowledgments 131References 131Further Reading 131

22. Neural Efficiency Metrics in Neuroergonomics: Theory and Applications

Adrian Curtin and Hasan Ayaz

Introduction 133Measuring Neural Correlates of Cognitive

Load: Electroencephalography 134Measuring Neural Correlates of Cognitive

Load: Functional Near-Infrared Spectroscopy 135

Calculating and Employing Measures of Neural Efficiency 136

Discussion: Application, Challenges, and Limitations 137

Conclusion 138References 138

Section IVNeurostimulation Applications

23. Neuromodulatory Effects of Transcranial Direct Current Stimulation Revealed by Functional Magnetic Resonance Imaging

Brian Falcone and Daniel E. Callan

References 145

Page 13: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

Contents xi

24. Neurophysiological Correlates of tDCS-Induced Modulation of Cortical Sensorimotor Networks: A Simultaneous fNIRS–EEG Study

Makii Muthalib, Pierre Besson, Anirban Dutta, Mitsuhiro Hayashibe and Stephane Perrey

Introduction 147Methods 148

Design and Protocol 148tDCS 148fNIRS 149EEG 149fNIRS and EEG Analysis 149

Results 149Discussion 149Conclusion 150Acknowledgments 150References 150

25. Opinion: The Use of Online/Offline Terminology for Transcranial Direct Current Stimulation Can Bring Confusion

Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey

Acknowledgments 154References 154

Section VEmerging Applications in Decision-Making, Usability, Trust & Emotions

26. Neural Signatures of Advice Utilization During Human–Machine Agent Interactions: Functional Magnetic Resonance Imaging and Effective Connectivity Evidence

Kimberly Goodyear and Frank Krueger

Introduction 159Background 159Empirical Evidence 160Summary 162Acknowledgments 163References 163

27. Psychophysical Equivalence of Static Versus Dynamic Stimuli in a Two-Alternative Forced-Choice Detection Task

Gabriella M. Hancock

Introduction 165Methods 165Results 166Discussion 166References 168

28. Functional Near-Infrared Spectroscopy: Proof of Concept for Its Application in Social Neuroscience

Stefano I. Di Domenico, Achala H. Rodrigo, Mengxi Dong, Marc A. Fournier, Hasan Ayaz, Richard M. Ryan and Anthony C. Ruocco

A Brief Introduction to fNIRS and Its Potential for Social Neuroscience 169

The Current Study 170Method 170

Participants 170Personality Judgment Task 170fNIRS Procedures and Signal Processing 170

Results 172Discussion 172References 172

29. Quantifying Brain Hemodynamics During Neuromuscular Fatigue

Joohyun Rhee and Ranjana K. Mehta

Introduction 175Methods 175

Participants 175Procedures 175Measurements 176

NIRS Analyses 176Data Presentation 178Results and Discussion 179References 180

30. Web Usability Testing With Concurrent fNIRS and Eye Tracking

Siddharth Bhatt, Atahan Agrali, Kevin McCarthy, Rajneesh Suri and Hasan Ayaz

Introduction 181Methods 182Results 182

Page 14: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

xii Contents

Survey Measures 182Behavioral Measures 182Eye-Tracking Measures 182Neural Measures 184

Conclusion 184References 185Further Reading 186

31. Hybrid Collaborative Brain–Computer Interfaces to Augment Group Decision-Making

Davide Valeriani, Caterina Cinel and Riccardo Poli

Introduction 187Methods 187

Participants 187Experiments 188Data Recording and Group Decisions 188

Results 189Individual Performance 189Group Performance 189

Conclusions 189Acknowledgments 190References 190

32. How to Recognize Emotions Without Signal Processing: An Application of Convolutional Neural Network to Physiological Signals

Nicolas Martin, Jean-Marc Diverrez, Sonia Em, Nico Pallamin and Martin Ragot

Introduction 191Emotion Recognition 191Deep Learning Algorithms 191Deep Learning Applied to Physiological

Signals 192Current Study 192Method 192Results 193Discussion and Conclusion 193

Futures Work 193Acknowledgments 193References 193

Section VIEntries From the Inaugural International Neuroergonomics Conference

33. Technical Manifestations of the Everted Brain: The Impact and Legacy of Raja Parasuraman

Peter A. Hancock

34. Can We Trust Autonomous Systems?

Peter A. Hancock, Kimberly L. Stowers and Theresa T. Kessler

Aim 199Methods 199Results 199Conclusions 199

35. Learning and Modulating Spatial Probabilities in Virtual Environments

Amy L. Holloway, Peter Chapman and Alastair D. Smith

Background 201Aims 201Methods 201Results and Conclusions 201

Study 1 201Study 2 201Study 3 202

36. Physiological Markers for UAV Operator Monitoring

Raphaëlle N. Roy, Thibault Gateau, Angela Bovo, Frédéric Dehais and Caroline P.C. Chanel

Aims of This Chapter 203Methods 203Results 203Conclusions 204References 204

37. Estimating Cognitive Workload Levels While Driving Using Functional Near-Infrared Spectroscopy (fNIRS)

Anirudh Unni, Klas Ihme, Meike Jipp and Jochem W. Rieger

Introduction and Aim 205Methods 205Results 205

Page 15: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

Contents xiii

Discussion and Conclusion 205Acknowledgments 206References 206

38. Auditory Neglect in the Cockpit: Using ERPs to Disentangle Early From Late Processes in the Inattentional Deafness Phenomenon

Sébastien Scannella, Raphaëlle N. Roy, Amine Laouar and Frédéric Dehais

Introduction and Aims 207Methods 207Results 207Discussion and Conclusion 207References 208

39. Immediate Effects of Ankle Foot Orthosis During Gait Initiation: Impaired Balance Control and Change in Ankle Electromyographic Activity

Arnaud Delafontaine, Jean-Louis Honeine, Manh-Cuong Do and Olivier Gagey

Aims 209Methods 209Results 209Conclusions 209References 209

40. Toward a Better Understanding of Human Prioritization. A Dual-Task Study

Benoît Valéry, Nadine Matton, Sébastien Scannella and Frédéric Dehais

Objective 211Background 211Methods 211Results 211Conclusions 211Fundings 211References 212

41. Assessing Working Memory Load in Real Flight Condition With Wireless fNIRS

Frédéric Dehais, Hasan Ayaz and Thibault Gateau

Introduction and Aims 213Methods 213Results 213

Conclusion 213References 214

42. Assessing Driver Frustration Using Functional Near-Infrared Spectroscopy (fNIRS)

Klas Ihme, Anirudh Unni, Jochem W. Rieger and Meike Jipp

Introduction and Aim 215Methods 215Results 215Discussion and Conclusion 215Acknowledgments 216Reference 216

43. The Spatial Release of Cognitive Load in Multi-Talker Situation

Guillaume Andéol, Clara Suied, Sébastien Scannella and Frédéric Dehais

Acknowledgments 217References 217

44. Decreased Intra-Hemispheric Prefrontal Connectivity and Impaired Performance After Induction of Cognitive Fatigue During a State of Sleep Deprivation. An Optical Imaging Study

Guillermo Borragán, Céline Guillaume, Hichem Slama, Carlos Guerrero-Mosquera and Philippe Peigneux

References 219

45. Bright Light Exposure Does Not Prevent the Deterioration of Alertness Induced by Sustained High Cognitive Load Demands

Guillermo Borragán, Gaétane Deliens, Philippe Peigneux and Rachel Leproult

Theoretical Framework and Study Goal 221Methods 221Results 221Discussion and Conclusion 221

Page 16: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

xiv Contents

46. A Psychophysiology-Based Driver Model for the Design of Driving Assistance Systems

Franck Mars and Philippe Chevrel

Aims 223Methods 223Results 223Conclusions 223

47. Effect of Postural Chain Mobility on Body Balance and Motor Performance

Alain Hamaoui

Aims 225Methods 225Results 225Conclusions 225References 225

48. Effect of Seat and Backrest Sloping on the Biomechanical Strain Sustained by the Body

Nadège Tebbache and Alain Hamaoui

Aims 227Methods 227Results 227Conclusions 227References 227

49. Effect of Human Exposure to Whole-Body Vibration in Transport

Hiba Souissi and Alain Hamaoui

Aims 229Methods 229Results 229Conclusion 229References 229

50. Electroencephalography (EEG) Activity Associated With Manual Lifting Tasks: A Neuroergonomics Study

Awad Aljuaid, Waldemar Karwowski, Petros Xanthopoulos and Peter A. Hancock

51. Anticipatory Postural Control of Stability During Gait Initiation Over Obstacles of Different Height and Distance Under Reaction-Time and Self-Initiated Instructions

Eric Yiou, Romain Artico, Claudine Teyssedre, Ombeline Labaune and Paul Fourcade

Aims 233Methods 233Results 233Conclusions 234References 234

52. Effect of Age on Behavioral Performance and Metabolic Brain Activity During Dual-Task

Nounagnon F. Agbangla, Michel Audiffren, Jean Pylouster and Cédric T. Albinet

Aim and Methods 235Results 235

Single Task 235Dual-Task 235

Discussion and Conclusion 235References 236

53. Using Machine Learning Algorithms to Develop Adaptive Man–Machine Interfaces

Dargent Lauren, Branthomme Arnaud, Kou Paul, Girod Hervé and Morellec Olivier

Context 237Aim 237Method 237Expected Results 237Conclusion 238References 238

54. Link Between Out-of-the-Loop Performance Problem and Mind Wandering: How to Keep the Operator in the Loop

Jonas Gouraud, Bruno Berberian and Arnaud Delorme

References 239

Page 17: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

Contents xv

55. Applied Neuroergonomic: Recent Updates From Automotive Industry Case Studies

Ivan Macuzic, Evanthia Giagloglou, Ivana Živanovic-Macuzic and Branislav Jeremic

Aims 241Methods 241Results and Conclusions 241Acknowledgments 241Further Reading 241

56. Multi-Brain Computing: BCI Monitoring and Real-Time Decision Making

Anton Nijholt

References 243

57. Toward Mental Workload Measurement Using Multimodal EEG–fNIRS Monitoring

Hubert Banville, Mark Parent, Sébastien Tremblay and Tiago H. Falk

Aims 245Methods 245Results 245Conclusion 245Acknowledgments 245References 246

58. The Effects of Transcranial Direct Current Stimulation (tDCS) on Adapting to Temporal Lag in Virtual Environments

Hayley Thair and Roger Newport

Aims 247Methods 247Results 247Conclusions 247References 247

59. Why Do Auditory Warnings During Steering Allow for Faster Visual Target Recognition?

Christiane Glatz, Heinrich H. Bülthoff and Lewis L. Chuang

Introduction and Aim 249Methods 249

Results 250Discussion and Conclusion 250Reference 250

60. Attending to the Auditory Scene Improves Situational Awareness

Menja Scheer, Heinrich H. Bülthoff and Lewis L. Chuang

Aim 251Methods 251Results 251Conclusion 251References 252

61. Individual Differences and Detection Response Task Reaction Times

Antonia S. Conti, Moritz Späth and Klaus Bengler

Aims 253Methods 253Results 253Conclusions 254References 254

62. Cognitive Components of Path Integration: Implications for Simulator Studies of Human Navigation

Alastair D. Smith and Lydia Dyer

Aims 255Method 255Results 255Conclusions 255

63. Vector-Based Phase Analysis Approach for Initial Dip Detection Using HbO and HbR

Amad Zafar, Keum-Shik Hong and Muhammad J. Khan

Introduction 257Aims 257Methods 257Results 257Conclusions 258Acknowledgments 258References 258

Page 18: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

xvi Contents

64. Subjective and Objective Methods to Continuously Monitor Workload

Horia A Maior, Sarah Sharples and Max L. Wilson

References 260Further Reading 260

65. Decision Making and Executive Functioning in Aortic Valve Resection: About the Design of an Ergonomic Aortic Valve Resection Tool

René Patesson and Eric Brangier

Reference 262Further Reading 262

66. Short-Duration Affective States Induced by Emotional Words Improve Response Inhibition: An Event-Related Potential Study

Magdalena Senderecka, Michal Ociepka, Magdalena Matyjek and Bartlomiej Kroczek

Aim 263Method 263Results 263Conclusions 263Acknowledgments 264References 264

67. Predicting Audience Preferences for Television Advertisements Using Functional Brain Imaging

Atahan Agrali, Siddharth Bhatt, Rajnesh Suri, Kurtulus Izzetoglu, Banu Onaral and Hasan Ayaz

References 266

68. When Does the Brain Respond to Information During Visual Scanning?

Nina Flad, Heinrich H. Bülthoff and Lewis L. Chuang

Aims 267Methods 267Results 267Conclusion 268References 268

69. Brain–Computer Interface: Analysis of Different Virtual Keyboards for Improving Usability

Liliana Garcia, Véronique Lespinet-Najib, Mathilde Menoret, Bernard Claverie, Jean M. André and Ricardo Ron-Angevin

Acknowledgments 269References 270

70. A Method for Prediction of Behavioral Errors From Single-Trial Electrophysiological Data

Hiroki Ora and Yoshihiro Miyake

Aims 271Methods 271Results 271Conclusion 271Reference 271

71. Neuro-Functional Correlates of the Out-of-the-Loop Performance Problem: Impact on Performance Monitoring

Bertille Somon, Aurélie Campagne, Arnaud Delorme and Bruno Berberian

Acknowledgments 273References 273

72. Recent Advances in EEG-Based Neuroergonomics for Human–Computer Interaction

Jérémy Frey, Martin Hachet and Fabien Lotte

References 275

73. Attention and Driving Performance Modulations Due to Anger State: Contribution of Electroencephalographical Data

Franck Techer, Christophe Jallais, Yves Corson and Alexandra Fort

References 277Further Reading 277

Page 19: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

Contents xvii

74. Development of Intelligent Early Warning System for Hypoglycemia Attacks

Ali Berkol, Emre O. Tartan and Gozde Kara

Acknowledgments 279References 279

75. Out-of-the-loop (OOL) Performance Problem: Characterization and Compensation

Bruno Berberian

Acknowledgments 281

76. The Impact of Visual Scan Strategies on Active Surveillance Performance: An Eye-Tracking Study

Jean-Denis Thériault, Benoit Roberge-Vallières, Daniel Lafond, Sébastien Tremblay and François Vachon

Aims 283Methods 283Results 283Conclusions 284Reference 284

77. Using Neural Correlates for Enhancing Customer Experience Through Effective Visual Price Placement

Rajneesh Suri, Nancy M. Puccinelli, Dhruv Grewal, Anne L. Roggeveen, Atahan Agrali, Hasan Ayaz, Kurtulus Izzetoglu and Banu Onaral

References 286

78. Human Decision-Making During Crowd Evacuations: The Role of Stress, Conflicting Information, and Social Interactions

Nikolai W.F. Bode

References 287

79. Toward an Online Index of the Attentional Response to Auditory Alarms in the Cockpit: Is Pupillary Response Robust Enough?

Alexandre Marois, Johnathan Crépeau, Sébastien Tremblay and François Vachon

Aims 289Methods 289Results 289Conclusions 289References 290

80. Functional Neuroimaging of Prefrontal Cortex Activity During a Problem Solving Versus Motor Task in Children With and Without Autism

Nancy Getchell and Ling-Yin Liang

Aims 291Method 291Results 291Conclusions 292

81. Differential Within and Between Effects on Prefrontal Hemodynamics of fNIRS Guided HD-tDCS

Ryan McKendrick, Melissa Scheldrup, Raja Parasuraman and Hasan Ayaz

82. Neuroergonomics In Situ: Differentiation Between Naviation Displays

Ryan McKendrick, Raja Parasuraman, Rabia Murtza, Alice Formwalt, Wendy Baccus, Martin Paczynski and Hasan Ayaz

83. Embodied and Situated Cognitive Neuroscience

Ryan McKendrick, Ranjana Mehta, Hasan Ayaz, Melissa Scheldrup and Raja Parasuraman

Page 20: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

xviii Contents

84. Workload Transition, Cognitive Load States, and Adaptive Autonomous Transportation

Ryan McKendrick

85. Towards Neuroadaptive Technology: Implicitly Controlling a Cursor Though a Passive Brain–Computer Interface

Thorsten O. Zander, Lauens R. Krol and Klaus Gramann

86. A Random Practice Schedule Provides Better Retention and Transfer Than Blocked When Learning Computer Mazes: Preliminary Results

Nancy Getchell, Alex Schilder, Emily Wusch and Amy Trask

Aims 303Method 303Results 303Conclusions 303

87. Detection of Mind-Wandering in Driving: Contributions of Cardiac Measurement and Eye Movements

G. Pepin, S. Malin, J. Navarro, Alexandra Fort, Christophe Jallais and C. Gabaude

Acknowledgments 305References 305

88. Electroencephalography and Eye Tracking Signatures of Target Encoding During Guided Search

Anne-Marie Brouwer, Maarten A.J. Hogervorst, Bob Oudejans, Anthony J. Ries and Jonathan Touryan

Aims 307Methods 307Results 307Conclusions 308Acknowledgments 308References 308

89. Effects of an Acute Social Stressor on Trustworthiness Judgements, Physiological and Subjective Measures– Differences Between Civilians and Military Personnel

Martijn Bijlsma, Alexander Toet, Helma van den Berg and Anne-Marie Brouwer

Aims 309Methods 309Results 309Conclusions 310References 310

90. Meta-Cognitive Skills Modeling: Communication and Reasoning Among Agents

Laurent Chaudron, Hélio Kadogami, Nicolas Maille and Guillaume Roumy

Further Reading 311

91. Assessing Differences in Emotional Expressivity Between Expert and Non Expert Video Game Players Using Facial Electromyography

Marc-André Bouchard, Jérémy Bergeron-Boucher, Cindy Chamberland, Sébastien Tremblay and Philip L. Jackson

Aim 313Method 313Results 313Conclusion 314References 314

92. Mental Fatigue Assessment in Prolonged BCI Use Through EEG and fNIRS

Amanda Sargent, Terry Heiman-Patterson, Sara Feldman, Patricia A. Shewokis and Hasan Ayaz

References 316

93. Neuroergonomic Multimodal Neuroimaging During a Simulated Aviation Pursuit Task

Robert J. Gougelet, Cengiz Terzibas and Daniel E. Callan

Aims 317Methods 317Results and Conclusions 317References 318

Page 21: Neuroergonomics: The Brain at Work and in Everyday Life · Pierre Besson, Vincent Cabibel, Mark Muthalib and Stephane Perrey Acknowledgments 154 References 154 Section V Emerging

Contents xix

94. The Use of Neurometric and Biometric Research Methods in Understanding the User Experience of First-Time Buyers in E-Commerce

Tuna E. Çakar, Kerem Rızvanoğlu, Özgürol Öztürk and Deniz Zengin Çelik

Aim 319Method 319Results 319Conclusion 320References 320

95. An Applied Driving Evaluation of Electrodermal Potential as a Measurement of Attentional State

Bruce Mehler, Ben D. Sawyer, Tom McWilliams and Bryan Reimer

References 321

96. Applied Potential: Neuroergonomic Error Detection in Single Electrode Electroencephalography

Ben D. Sawyer, Waldemar Karwowski, Petros Xanthopoulos and Peter A. Hancock

References 324

97. Negative Mood States in Neuroergonomics

Ahmad Fadzil M. Hani, Ying Xing Feng and Tong Boon Tang

Supplementary (Research Framework) 326References 326

98. EEG and FNIRS Connectivity Features for Mental Workload Assessment: A Preliminary Study

Raphaëlle N. Roy, Alexandre Moly, Frédéric Dehais and Sébastien Scannella

Introduction 327Aims 327Methods 327Results 327Discussion 328Reference 328

99. Using Cognitive Models to Understand In-Car Distraction

Christian P. Janssen

Acknowledgments 329References 329

100. Concurrent fNIRS and TMS for Neurocognitive Enhancement on a Speed-of-Processing Task

Adrian Curtin, Shanbao Tong, Yingying Tang, Junfeng Sun, Jijun Wang and Hasan Ayaz

References 332

Index 333

View publication statsView publication stats