neuroergonomics for flight safety - gob.mx · nec septembre, 8-11 munich, germany. 38. institut...
TRANSCRIPT
Neuroergonomicsfor flight safety
Dr. Vsevolod PeysakhovichISAE-SUPAERO, Toulouse, France
[email protected]@peysakhovich
What can go wrong?
2
A difficult landing…
3
…and limited attentional resources
4
48 sec
Human causes of accidents
5
1900 Today
Human causes of accidents
6
1900 Today
Cockpit without pilots?
7
Aircraft evolution…
8
Aircraft evolution improved safety
9
Air
bu
s, 2
01
9 1950 1960 1980 1990
Average human cognitive capacity
but…
“Errors” are inevitable! Let’s adapt to them
“I was thinking. I was telling myselfthat what was particularly missingfor the good system performance, itwas the human error, and that it hasto urgently get involved.”
10
“Errors” are inevitable! Let’s adapt to them
11
Adaptive systems: closing the loop
12
System state
Control
Operator state
Feedback
What is neuroergonomics?
13
Neuroscience Ergonomics
Why measure something at all?
14
What we can measure?
15
Ph
oto
: O
. K
on
on
enk
o/
Ro
sco
smo
s
What we can measure?
16
Ph
oto
: O
. K
on
on
enk
o/
Ro
sco
smo
s
Eye tracking:• Eye movements• Pupil diameter
EEG:• Brain waves (Δ, Θ, A, B, Γ, M)• Event-related potentials (ERP)
fNIRSHaemodynamic response
Face temperature
System state
Respiratory rate
ECG:• Heart rate• Heart rate variability
How can we measure?
17
EEG fNIRS Eye Tracking
P
O
R
T
A
B
I
L
I
T
Y
A
C
C
U
R
A
C
Y
Aerospace: different operational constraints
18
Studying phenomena from lab to real life
19
Ecologic validityExperimental control
How to study inattentional deafness?
20
Oddball paradigm
Ecologic validityExperimental control
How to study inattentional deafness?
21Giraudet, L., St-Louis, M. E., Scannella, S., & Causse, M. (2015). P300 event-related potential as an indicator of inattentional deafness?. PLoS one, 10(2)
To land or not to land?400 times
Ecologic validityExperimental control
How to study inattentional deafness?
22
To hear or not to hear?240 times
Dehais, F., Roy, R. N., & Scannella, S. (2019). Inattentional deafness to auditory alarms. Behavioural brain research, 360, 51-59.
Ecologic validityExperimental control
How to study inattentional deafness?
23Dehais, F., Rida, I., Roy, R. N., Iversen, J., Mullen, T., & Callan, D. (2019). A pBCI to Predict Attentional Error Before it Happens in Real Flight Conditions. IEEE SMC
To hear or not to hear?1000 times
Ecologic validityExperimental control
How to study inattentional deafness?
24
• Real alert with context
• Once or twice
• More pilots
• 100% accuracy
Ecologic validityExperimental control
From science (fiction) to real life
What can we implement today?
Hint: Monitoring matters!
26
Pilot Not Flying Pilot Monitoring
Eye tracking systems ancestors
27
Fitts, Jones & Milton (1950)
Modern eye tracking systems
28
Wearable Remote
Eye tracking in an aircraft
29
Eye tracking in full flight simulator
30
Eye-tracking integration
31
Gaze-BasedFlight Deck Adaptation
Gaze-BasedAircraft
Adaptation
In flight
Pilot Training &
Performance Analysis
On ground
Visual BehaviorDatabase
On-boardGaze
Recordings
Visual BehaviorChecking
System
Peysakhovich, V., Lefrançois, O., Dehais, F., & Causse, M. (2018). The neuroergonomics of aircraft cockpits: the four stages of eye-tracking integration to enhance flight safety. Safety, 4(1), 8.
Eye-tracking integration
32
Gaze-BasedFlight Deck Adaptation
Gaze-BasedAircraft
Adaptation
In flight
Pilot Training &
Performance Analysis
On ground
Visual BehaviorDatabase
On-boardGaze
Recordings
Visual BehaviorChecking
System
Peysakhovich, V., Lefrançois, O., Dehais, F., & Causse, M. (2018). The neuroergonomics of aircraft cockpits: the four stages of eye-tracking integration to enhance flight safety. Safety, 4(1), 8.
Eye-tracking integration
33
Gaze-BasedFlight Deck Adaptation
Gaze-BasedAircraft
Adaptation
In flight
Pilot Training &
Performance Analysis
On ground
Visual BehaviorDatabase
On-boardGaze
Recordings
Visual BehaviorChecking
System
Peysakhovich, V., Lefrançois, O., Dehais, F., & Causse, M. (2018). The neuroergonomics of aircraft cockpits: the four stages of eye-tracking integration to enhance flight safety. Safety, 4(1), 8.
Human state integration
34
Human State-Based
Flight Deck Adaptation
Human State-Based
Aircraft Adaptation
In flight
Pilot Training &
Performance Analysis
On ground
Human StateDatabase
On-boardHuman State Recordings
Human StateChecking
System
Peysakhovich, V., Lefrançois, O., Dehais, F., & Causse, M. (2018). The neuroergonomics of aircraft cockpits: the four stages of eye-tracking integration to enhance flight safety. Safety, 4(1), 8.
What is yet to be solved?
1. Summarize big (human) data
2. Certification(Explainable AI)
3. Ethics and privacy
4. 100% accuracy35
Human State-BasedFlight Deck Adaptation
Human State-BasedAircraft Adaptation
In flight
Pilot Training & Performance
Analysis
On ground
HumanState
Database
On-boardHuman State Recordings
Human StateChecking
System1
23 41 4
Technology! But also safety regulations…
36
Venues to talk more about neuroergonomics
37
▪ ETAVIMarch, 17
Toulouse, France
▪ ICCASMarch, 18-19
Toulouse, France
▪ NECSeptembre, 8-11Munich, Germany
38
Institut Supérieur de l’Aéronautique et de l’Espace
10, avenue Edouard Belin – BP 54032
31055 Toulouse Cedex 4 – France
T +33 5 61 33 80 80
www.isae-supaero.fr
39
¡Muchas gracias por su atención!
Institut Supérieur de l’Aéronautique et de l’Espace
10, avenue Edouard Belin – BP 54032
31055 Toulouse Cedex 4 – France
T +33 5 61 33 80 80
www.isae-supaero.fr
40
¡Muchas gracias por su atención!
Institut Supérieur de l’Aéronautique et de l’Espace
10, avenue Edouard Belin – BP 54032
31055 Toulouse Cedex 4 – France
T +33 5 61 33 80 80
www.isae-supaero.fr
Aviation – the safest transportation mode
42
Air
bu
s, 2
01
9
Are we too reliant on automation?
43
Decreasing manual flying skills Necessity to master (and to monitor)the latest changes in cockpit technology
It’s all started with an idea…
44
Eye tracking systems ancestors
45
Shackel (1960)Dodge & Cline (1901)
Modern eye tracking systems
46
SR
Res
earc
h,
Ey
eL
ink
100
0 P
lus
Pu
pil
La
bs,
Pu
pil
Inv
isib
le