Human Social InteractionResearch proposal

Dr Roger NewportRoom B47

Drop-in times Tuesdays 12-2

wwwpsychologynottinghamacukstaffrwn

Understanding Emotion visual recognition

1

Introduction to facial emotionsThe neuroscience of Fear and Disgust(the simple story)

Other emotions (the complicated story)Current research

2

What are facial expressions of emotion and what are they for

Are there specific centres in the brain dedicated to emotion perception

Are different emotions processed in different ways

3

Understanding Emotions

Lecture Overview

Why are we interested in emotion perception

Evolutionary survival Social survival

4

Motivational Self-conscioussocial

ThirstHungerPainMood

ShameEmbarrassment

PrideGuilt

Regulate social behaviour

BasicHappiness

FearAnger

SurpriseDisgustSadness

Feature prominentlyin social

communication

Do not feature prominentlyin social communication

5facial expressions of emotion - what are the emotions

Faces are special

Face perception may be the most developed visual perceptual skill in humans

Infants prefer to look at faces from shortly after birth (Morton and Johnson 1991)

Most people spend more time looking at faces than at any other type of object

We seem to have the capacity to perceive the unique identity of a virtually unlimited number of different faces

6

We laugh more if in a group show distress more if in a group

Babies (10 months) almost only smile in presence of caregiver

Babies look to caregiver and behave according to caregiver response when encountering novel object Eg a barking dog or a snake

This is known as social referencing and is also seen in chimpanzee societies

A similar process observational fear is seen in other monkeys Infant monkeys show fearful unconditioned response to motherrsquos expression of fear when the mother could see a snake but the infants could not That is infants showed a fear response to the motherrsquos fear response

Facial expressions as a communicative tool

7Understanding Emotion from facial expressions

Percentage of facial responses to unpleasant odour classified as unpleasant neutral or pleasant in a spontaneous condition a posed to real person condition and a posed to imaginary audience condition

InErickson and Schulkin 2003

8facial expressions as communication

Facial expressions allow for rapid communication

They are produced when there is an emotional stimulus and an audience present

Our interpretation of anotherrsquos emotion modulates our behaviour and vice versa

The ability to recognise emotion expressions appears very early

first few days (neonates)

can distinguish between expressions of happiness sadness and surprise

Four- to six-month show preferences for facial expressions of happiness over neutral and angry expressions

seven months can distinguish among expressions of fear anger surprise happiness and sadness

9facial expressions as communication

Angry faces are detected much more rapidly than faces depicting non-threatening expressions

Ohman et al 2001

Attention is driven by fear

10Recognition as an automatic processes - fear and threat

Evidence from animal neuropsychological and imaging studies suggest that the amygdala is of primary importance in the recognition of fear

11Automatic processes = dedicated network

Fear and the amygdala

Bilateral amygdala removal

reduces levels of aggression and fear in rats and monkeys

facial expressions and vocalisations become less expressive

impairs fear conditioning

12Fear and the amygdala - evidence from animal studies

Bilateral amygdala damagereduces recognition of fear-inducing stimulireduces recognition of fear in othersreduces ability to express fear

Does NOT affect ability to recognise faces or to know what fear is

See patients SM DR and SE (Adolphs et al and Calder et al)

Alzheimerrsquos disease impairs fear conditioning

13

Fear and the amygdala - evidence from human neuropsychology

non-conscious processing of fear expressions

Fear and the amygdala - evidence from human imaging

Increased amydala activity for facial expressions of fear vs happiness disgust anger neutral

Fear face recog

Fear cond

Results from several studies

14

Neuromodulatory role of left amygdala less fear = less activity

Subliminal activation of amygdala to fear

Amygdala Response to Facial Expressions in Children and AdultsThomas et al 2001

Blocks of fixation of fear neutral faces No task just watch

Left amygdala activation for fear vs fixation in male children and adults

Overall adults showed greater amygdala activation for fear v neutral whereas children did not (neutral faces may be ambiguous)

LeftRight

15A typical study

Methods and Materials Subjects Six male adults (mean 1113093 24 years SD 1113093 66 years) and 12 children (mean 1113093 11 years SD 1113093 24 years) recruited in the Pittsburgh area were scanned in a 15-T scanner during passive viewing of fearful and neutral faces The children sixfemale and six male ranged in pubertal development from Tanner stages1 II to VIV Male and female subjects did not differ in mean age or Tanner stage Data from an additional three adults (three female) and four children (two female) were not included due to excessive motion artifact (111309305 voxels n 1113093 5) or claustrophobia (n 1113093 1) or because the subject fell asleep during the task (n 1113093 1) Subjects were screened for any personal or family history of psychiatric or medical illness and for any contraindications for an MRI Written child assent and parental consent were acquired before the study

Behavioral Paradigm The task consisted of the rapid and successive presentation of faces in blocks of neutral and emotional expressions The face stimuli consisted of digitized fearful and neutral faces taken from the Ekman and Friesen (1976) study (Figure 1) A total of eight different actors (four male and four female) demonstrating both fearful and neutral expressions were used The hair was stripped from the images to remove any nonfacial features and both fear and exaggerated fear poses were used for each actor (Calder et al 1997) resulting in a total of 16 fear stimuli and eight neutral stimuli Stimuli were presented for 200 msec with an interstimulus interval of 800 msec (flashing fixation point) Each block of trials consisted of the presentation of a flashing fixation point for 45 sec followed by alternating 42-sec blocks of either neutral or fearful expressions and a final 45-sec epoch of fixation (Figure 1) This procedure was repeated in three runs of trials with the presentation order counterbalanced across runs and across subjects (ie F-N-F-N-F or N-F-N-F-N) Following Breiter and colleaguesrsquo (Breiter et al 1996) design no overt response was required Instead subjects were instructed to fixate centrally to try to get an overall sense of the faces2

Image Acquisition Processing and Analysis Scans were acquired on a 15-T GE Signa scanner (General Electric Systems Milwaukee) modified for echo planar imaging (Advanced NMR Wilmington MA) using a quadrature head coil A T1-weighted sagittal localizer image was used to prescribe the functional slice locations T1-weighted structural images were acquired in 4-mm contiguous coronal slices through the whole brain (echo time [TE] min repetition time [TR] 500 matrix 256 1113093 256 field of view [FOV] 20) for purposes of localizing the functional activity and aligning images in Talairach space (Talairach and Tournoux 1988) Functional images (T2) were acquired at 12 of these slice locations spanning the entire amygdala (1113093A20 to P24 in Talairach coordinates) using an EPI BOLD sequence (TE 40 TR 3000 flip angle 90deg matrix 128 1113093 64 FOV 20 4-mm skip 0 voxel size 3125 1113093 3125 1113093 40 mm) There were three runs of 100 images totaling 300 images per slice Images were motion corrected and normalized All 18 subjects had less than 05 voxels of in-plane motion All images were registered to a representative reference brain using Automated Image Registration software (Woods et al 1992) and voxelwise analyses of variance (ANOVAs) were conducted on these pooled data using normalized signal intensity as the dependent variable (Braver et al 1997 Casey et al 2000) Separate analyses were conducted comparing male adults and male children and comparing male and female children to examine interactions of stimulus type (fearful faces neutral faces fixation) with age or gender respectively Significant activations were defined by at least three contiguous voxels and alpha = 05 (Forman et al 1995) Amygdala activation was defined on the reference brain using Talairach coordinates and consensus among three raters (BJC KMT PJW) Significant regions that extended outside of the brain or had large SDs were excluded

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Introduction to facial emotionsThe neuroscience of Fear and Disgust(the simple story)

Other emotions (the complicated story)Current research

2

What are facial expressions of emotion and what are they for

Are there specific centres in the brain dedicated to emotion perception

Are different emotions processed in different ways

3

Understanding Emotions

Lecture Overview

Why are we interested in emotion perception

Evolutionary survival Social survival

4

Motivational Self-conscioussocial

ThirstHungerPainMood

ShameEmbarrassment

PrideGuilt

Regulate social behaviour

BasicHappiness

FearAnger

SurpriseDisgustSadness

Feature prominentlyin social

communication

Do not feature prominentlyin social communication

5facial expressions of emotion - what are the emotions

Faces are special

Face perception may be the most developed visual perceptual skill in humans

Infants prefer to look at faces from shortly after birth (Morton and Johnson 1991)

Most people spend more time looking at faces than at any other type of object

We seem to have the capacity to perceive the unique identity of a virtually unlimited number of different faces

6

We laugh more if in a group show distress more if in a group

Babies (10 months) almost only smile in presence of caregiver

Babies look to caregiver and behave according to caregiver response when encountering novel object Eg a barking dog or a snake

This is known as social referencing and is also seen in chimpanzee societies

A similar process observational fear is seen in other monkeys Infant monkeys show fearful unconditioned response to motherrsquos expression of fear when the mother could see a snake but the infants could not That is infants showed a fear response to the motherrsquos fear response

Facial expressions as a communicative tool

7Understanding Emotion from facial expressions

Percentage of facial responses to unpleasant odour classified as unpleasant neutral or pleasant in a spontaneous condition a posed to real person condition and a posed to imaginary audience condition

InErickson and Schulkin 2003

8facial expressions as communication

Facial expressions allow for rapid communication

They are produced when there is an emotional stimulus and an audience present

Our interpretation of anotherrsquos emotion modulates our behaviour and vice versa

The ability to recognise emotion expressions appears very early

first few days (neonates)

can distinguish between expressions of happiness sadness and surprise

Four- to six-month show preferences for facial expressions of happiness over neutral and angry expressions

seven months can distinguish among expressions of fear anger surprise happiness and sadness

9facial expressions as communication

Angry faces are detected much more rapidly than faces depicting non-threatening expressions

Ohman et al 2001

Attention is driven by fear

10Recognition as an automatic processes - fear and threat

Evidence from animal neuropsychological and imaging studies suggest that the amygdala is of primary importance in the recognition of fear

11Automatic processes = dedicated network

Fear and the amygdala

Bilateral amygdala removal

reduces levels of aggression and fear in rats and monkeys

facial expressions and vocalisations become less expressive

impairs fear conditioning

12Fear and the amygdala - evidence from animal studies

Bilateral amygdala damagereduces recognition of fear-inducing stimulireduces recognition of fear in othersreduces ability to express fear

Does NOT affect ability to recognise faces or to know what fear is

See patients SM DR and SE (Adolphs et al and Calder et al)

Alzheimerrsquos disease impairs fear conditioning

13

Fear and the amygdala - evidence from human neuropsychology

non-conscious processing of fear expressions

Fear and the amygdala - evidence from human imaging

Increased amydala activity for facial expressions of fear vs happiness disgust anger neutral

Fear face recog

Fear cond

Results from several studies

14

Neuromodulatory role of left amygdala less fear = less activity

Subliminal activation of amygdala to fear

Amygdala Response to Facial Expressions in Children and AdultsThomas et al 2001

Blocks of fixation of fear neutral faces No task just watch

Left amygdala activation for fear vs fixation in male children and adults

Overall adults showed greater amygdala activation for fear v neutral whereas children did not (neutral faces may be ambiguous)

LeftRight

15A typical study

Methods and Materials Subjects Six male adults (mean 1113093 24 years SD 1113093 66 years) and 12 children (mean 1113093 11 years SD 1113093 24 years) recruited in the Pittsburgh area were scanned in a 15-T scanner during passive viewing of fearful and neutral faces The children sixfemale and six male ranged in pubertal development from Tanner stages1 II to VIV Male and female subjects did not differ in mean age or Tanner stage Data from an additional three adults (three female) and four children (two female) were not included due to excessive motion artifact (111309305 voxels n 1113093 5) or claustrophobia (n 1113093 1) or because the subject fell asleep during the task (n 1113093 1) Subjects were screened for any personal or family history of psychiatric or medical illness and for any contraindications for an MRI Written child assent and parental consent were acquired before the study

Behavioral Paradigm The task consisted of the rapid and successive presentation of faces in blocks of neutral and emotional expressions The face stimuli consisted of digitized fearful and neutral faces taken from the Ekman and Friesen (1976) study (Figure 1) A total of eight different actors (four male and four female) demonstrating both fearful and neutral expressions were used The hair was stripped from the images to remove any nonfacial features and both fear and exaggerated fear poses were used for each actor (Calder et al 1997) resulting in a total of 16 fear stimuli and eight neutral stimuli Stimuli were presented for 200 msec with an interstimulus interval of 800 msec (flashing fixation point) Each block of trials consisted of the presentation of a flashing fixation point for 45 sec followed by alternating 42-sec blocks of either neutral or fearful expressions and a final 45-sec epoch of fixation (Figure 1) This procedure was repeated in three runs of trials with the presentation order counterbalanced across runs and across subjects (ie F-N-F-N-F or N-F-N-F-N) Following Breiter and colleaguesrsquo (Breiter et al 1996) design no overt response was required Instead subjects were instructed to fixate centrally to try to get an overall sense of the faces2

Image Acquisition Processing and Analysis Scans were acquired on a 15-T GE Signa scanner (General Electric Systems Milwaukee) modified for echo planar imaging (Advanced NMR Wilmington MA) using a quadrature head coil A T1-weighted sagittal localizer image was used to prescribe the functional slice locations T1-weighted structural images were acquired in 4-mm contiguous coronal slices through the whole brain (echo time [TE] min repetition time [TR] 500 matrix 256 1113093 256 field of view [FOV] 20) for purposes of localizing the functional activity and aligning images in Talairach space (Talairach and Tournoux 1988) Functional images (T2) were acquired at 12 of these slice locations spanning the entire amygdala (1113093A20 to P24 in Talairach coordinates) using an EPI BOLD sequence (TE 40 TR 3000 flip angle 90deg matrix 128 1113093 64 FOV 20 4-mm skip 0 voxel size 3125 1113093 3125 1113093 40 mm) There were three runs of 100 images totaling 300 images per slice Images were motion corrected and normalized All 18 subjects had less than 05 voxels of in-plane motion All images were registered to a representative reference brain using Automated Image Registration software (Woods et al 1992) and voxelwise analyses of variance (ANOVAs) were conducted on these pooled data using normalized signal intensity as the dependent variable (Braver et al 1997 Casey et al 2000) Separate analyses were conducted comparing male adults and male children and comparing male and female children to examine interactions of stimulus type (fearful faces neutral faces fixation) with age or gender respectively Significant activations were defined by at least three contiguous voxels and alpha = 05 (Forman et al 1995) Amygdala activation was defined on the reference brain using Talairach coordinates and consensus among three raters (BJC KMT PJW) Significant regions that extended outside of the brain or had large SDs were excluded

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

What are facial expressions of emotion and what are they for

Are there specific centres in the brain dedicated to emotion perception

Are different emotions processed in different ways

3

Understanding Emotions

Lecture Overview

Why are we interested in emotion perception

Evolutionary survival Social survival

4

Motivational Self-conscioussocial

ThirstHungerPainMood

ShameEmbarrassment

PrideGuilt

Regulate social behaviour

BasicHappiness

FearAnger

SurpriseDisgustSadness

Feature prominentlyin social

communication

Do not feature prominentlyin social communication

5facial expressions of emotion - what are the emotions

Faces are special

Face perception may be the most developed visual perceptual skill in humans

Infants prefer to look at faces from shortly after birth (Morton and Johnson 1991)

Most people spend more time looking at faces than at any other type of object

We seem to have the capacity to perceive the unique identity of a virtually unlimited number of different faces

6

We laugh more if in a group show distress more if in a group

Babies (10 months) almost only smile in presence of caregiver

Babies look to caregiver and behave according to caregiver response when encountering novel object Eg a barking dog or a snake

This is known as social referencing and is also seen in chimpanzee societies

A similar process observational fear is seen in other monkeys Infant monkeys show fearful unconditioned response to motherrsquos expression of fear when the mother could see a snake but the infants could not That is infants showed a fear response to the motherrsquos fear response

Facial expressions as a communicative tool

7Understanding Emotion from facial expressions

Percentage of facial responses to unpleasant odour classified as unpleasant neutral or pleasant in a spontaneous condition a posed to real person condition and a posed to imaginary audience condition

InErickson and Schulkin 2003

8facial expressions as communication

Facial expressions allow for rapid communication

They are produced when there is an emotional stimulus and an audience present

Our interpretation of anotherrsquos emotion modulates our behaviour and vice versa

The ability to recognise emotion expressions appears very early

first few days (neonates)

can distinguish between expressions of happiness sadness and surprise

Four- to six-month show preferences for facial expressions of happiness over neutral and angry expressions

seven months can distinguish among expressions of fear anger surprise happiness and sadness

9facial expressions as communication

Angry faces are detected much more rapidly than faces depicting non-threatening expressions

Ohman et al 2001

Attention is driven by fear

10Recognition as an automatic processes - fear and threat

Evidence from animal neuropsychological and imaging studies suggest that the amygdala is of primary importance in the recognition of fear

11Automatic processes = dedicated network

Fear and the amygdala

Bilateral amygdala removal

reduces levels of aggression and fear in rats and monkeys

facial expressions and vocalisations become less expressive

impairs fear conditioning

12Fear and the amygdala - evidence from animal studies

Bilateral amygdala damagereduces recognition of fear-inducing stimulireduces recognition of fear in othersreduces ability to express fear

Does NOT affect ability to recognise faces or to know what fear is

See patients SM DR and SE (Adolphs et al and Calder et al)

Alzheimerrsquos disease impairs fear conditioning

13

Fear and the amygdala - evidence from human neuropsychology

non-conscious processing of fear expressions

Fear and the amygdala - evidence from human imaging

Increased amydala activity for facial expressions of fear vs happiness disgust anger neutral

Fear face recog

Fear cond

Results from several studies

14

Neuromodulatory role of left amygdala less fear = less activity

Subliminal activation of amygdala to fear

Amygdala Response to Facial Expressions in Children and AdultsThomas et al 2001

Blocks of fixation of fear neutral faces No task just watch

Left amygdala activation for fear vs fixation in male children and adults

Overall adults showed greater amygdala activation for fear v neutral whereas children did not (neutral faces may be ambiguous)

LeftRight

15A typical study

Methods and Materials Subjects Six male adults (mean 1113093 24 years SD 1113093 66 years) and 12 children (mean 1113093 11 years SD 1113093 24 years) recruited in the Pittsburgh area were scanned in a 15-T scanner during passive viewing of fearful and neutral faces The children sixfemale and six male ranged in pubertal development from Tanner stages1 II to VIV Male and female subjects did not differ in mean age or Tanner stage Data from an additional three adults (three female) and four children (two female) were not included due to excessive motion artifact (111309305 voxels n 1113093 5) or claustrophobia (n 1113093 1) or because the subject fell asleep during the task (n 1113093 1) Subjects were screened for any personal or family history of psychiatric or medical illness and for any contraindications for an MRI Written child assent and parental consent were acquired before the study

Behavioral Paradigm The task consisted of the rapid and successive presentation of faces in blocks of neutral and emotional expressions The face stimuli consisted of digitized fearful and neutral faces taken from the Ekman and Friesen (1976) study (Figure 1) A total of eight different actors (four male and four female) demonstrating both fearful and neutral expressions were used The hair was stripped from the images to remove any nonfacial features and both fear and exaggerated fear poses were used for each actor (Calder et al 1997) resulting in a total of 16 fear stimuli and eight neutral stimuli Stimuli were presented for 200 msec with an interstimulus interval of 800 msec (flashing fixation point) Each block of trials consisted of the presentation of a flashing fixation point for 45 sec followed by alternating 42-sec blocks of either neutral or fearful expressions and a final 45-sec epoch of fixation (Figure 1) This procedure was repeated in three runs of trials with the presentation order counterbalanced across runs and across subjects (ie F-N-F-N-F or N-F-N-F-N) Following Breiter and colleaguesrsquo (Breiter et al 1996) design no overt response was required Instead subjects were instructed to fixate centrally to try to get an overall sense of the faces2

Image Acquisition Processing and Analysis Scans were acquired on a 15-T GE Signa scanner (General Electric Systems Milwaukee) modified for echo planar imaging (Advanced NMR Wilmington MA) using a quadrature head coil A T1-weighted sagittal localizer image was used to prescribe the functional slice locations T1-weighted structural images were acquired in 4-mm contiguous coronal slices through the whole brain (echo time [TE] min repetition time [TR] 500 matrix 256 1113093 256 field of view [FOV] 20) for purposes of localizing the functional activity and aligning images in Talairach space (Talairach and Tournoux 1988) Functional images (T2) were acquired at 12 of these slice locations spanning the entire amygdala (1113093A20 to P24 in Talairach coordinates) using an EPI BOLD sequence (TE 40 TR 3000 flip angle 90deg matrix 128 1113093 64 FOV 20 4-mm skip 0 voxel size 3125 1113093 3125 1113093 40 mm) There were three runs of 100 images totaling 300 images per slice Images were motion corrected and normalized All 18 subjects had less than 05 voxels of in-plane motion All images were registered to a representative reference brain using Automated Image Registration software (Woods et al 1992) and voxelwise analyses of variance (ANOVAs) were conducted on these pooled data using normalized signal intensity as the dependent variable (Braver et al 1997 Casey et al 2000) Separate analyses were conducted comparing male adults and male children and comparing male and female children to examine interactions of stimulus type (fearful faces neutral faces fixation) with age or gender respectively Significant activations were defined by at least three contiguous voxels and alpha = 05 (Forman et al 1995) Amygdala activation was defined on the reference brain using Talairach coordinates and consensus among three raters (BJC KMT PJW) Significant regions that extended outside of the brain or had large SDs were excluded

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Why are we interested in emotion perception

Evolutionary survival Social survival

4

Motivational Self-conscioussocial

ThirstHungerPainMood

ShameEmbarrassment

PrideGuilt

Regulate social behaviour

BasicHappiness

FearAnger

SurpriseDisgustSadness

Feature prominentlyin social

communication

Do not feature prominentlyin social communication

5facial expressions of emotion - what are the emotions

Faces are special

Face perception may be the most developed visual perceptual skill in humans

Infants prefer to look at faces from shortly after birth (Morton and Johnson 1991)

Most people spend more time looking at faces than at any other type of object

We seem to have the capacity to perceive the unique identity of a virtually unlimited number of different faces

6

We laugh more if in a group show distress more if in a group

Babies (10 months) almost only smile in presence of caregiver

Babies look to caregiver and behave according to caregiver response when encountering novel object Eg a barking dog or a snake

This is known as social referencing and is also seen in chimpanzee societies

A similar process observational fear is seen in other monkeys Infant monkeys show fearful unconditioned response to motherrsquos expression of fear when the mother could see a snake but the infants could not That is infants showed a fear response to the motherrsquos fear response

Facial expressions as a communicative tool

7Understanding Emotion from facial expressions

Percentage of facial responses to unpleasant odour classified as unpleasant neutral or pleasant in a spontaneous condition a posed to real person condition and a posed to imaginary audience condition

InErickson and Schulkin 2003

8facial expressions as communication

Facial expressions allow for rapid communication

They are produced when there is an emotional stimulus and an audience present

Our interpretation of anotherrsquos emotion modulates our behaviour and vice versa

The ability to recognise emotion expressions appears very early

first few days (neonates)

can distinguish between expressions of happiness sadness and surprise

Four- to six-month show preferences for facial expressions of happiness over neutral and angry expressions

seven months can distinguish among expressions of fear anger surprise happiness and sadness

9facial expressions as communication

Angry faces are detected much more rapidly than faces depicting non-threatening expressions

Ohman et al 2001

Attention is driven by fear

10Recognition as an automatic processes - fear and threat

Evidence from animal neuropsychological and imaging studies suggest that the amygdala is of primary importance in the recognition of fear

11Automatic processes = dedicated network

Fear and the amygdala

Bilateral amygdala removal

reduces levels of aggression and fear in rats and monkeys

facial expressions and vocalisations become less expressive

impairs fear conditioning

12Fear and the amygdala - evidence from animal studies

Bilateral amygdala damagereduces recognition of fear-inducing stimulireduces recognition of fear in othersreduces ability to express fear

Does NOT affect ability to recognise faces or to know what fear is

See patients SM DR and SE (Adolphs et al and Calder et al)

Alzheimerrsquos disease impairs fear conditioning

13

Fear and the amygdala - evidence from human neuropsychology

non-conscious processing of fear expressions

Fear and the amygdala - evidence from human imaging

Increased amydala activity for facial expressions of fear vs happiness disgust anger neutral

Fear face recog

Fear cond

Results from several studies

14

Neuromodulatory role of left amygdala less fear = less activity

Subliminal activation of amygdala to fear

Amygdala Response to Facial Expressions in Children and AdultsThomas et al 2001

Blocks of fixation of fear neutral faces No task just watch

Left amygdala activation for fear vs fixation in male children and adults

Overall adults showed greater amygdala activation for fear v neutral whereas children did not (neutral faces may be ambiguous)

LeftRight

15A typical study

Methods and Materials Subjects Six male adults (mean 1113093 24 years SD 1113093 66 years) and 12 children (mean 1113093 11 years SD 1113093 24 years) recruited in the Pittsburgh area were scanned in a 15-T scanner during passive viewing of fearful and neutral faces The children sixfemale and six male ranged in pubertal development from Tanner stages1 II to VIV Male and female subjects did not differ in mean age or Tanner stage Data from an additional three adults (three female) and four children (two female) were not included due to excessive motion artifact (111309305 voxels n 1113093 5) or claustrophobia (n 1113093 1) or because the subject fell asleep during the task (n 1113093 1) Subjects were screened for any personal or family history of psychiatric or medical illness and for any contraindications for an MRI Written child assent and parental consent were acquired before the study

Behavioral Paradigm The task consisted of the rapid and successive presentation of faces in blocks of neutral and emotional expressions The face stimuli consisted of digitized fearful and neutral faces taken from the Ekman and Friesen (1976) study (Figure 1) A total of eight different actors (four male and four female) demonstrating both fearful and neutral expressions were used The hair was stripped from the images to remove any nonfacial features and both fear and exaggerated fear poses were used for each actor (Calder et al 1997) resulting in a total of 16 fear stimuli and eight neutral stimuli Stimuli were presented for 200 msec with an interstimulus interval of 800 msec (flashing fixation point) Each block of trials consisted of the presentation of a flashing fixation point for 45 sec followed by alternating 42-sec blocks of either neutral or fearful expressions and a final 45-sec epoch of fixation (Figure 1) This procedure was repeated in three runs of trials with the presentation order counterbalanced across runs and across subjects (ie F-N-F-N-F or N-F-N-F-N) Following Breiter and colleaguesrsquo (Breiter et al 1996) design no overt response was required Instead subjects were instructed to fixate centrally to try to get an overall sense of the faces2

Image Acquisition Processing and Analysis Scans were acquired on a 15-T GE Signa scanner (General Electric Systems Milwaukee) modified for echo planar imaging (Advanced NMR Wilmington MA) using a quadrature head coil A T1-weighted sagittal localizer image was used to prescribe the functional slice locations T1-weighted structural images were acquired in 4-mm contiguous coronal slices through the whole brain (echo time [TE] min repetition time [TR] 500 matrix 256 1113093 256 field of view [FOV] 20) for purposes of localizing the functional activity and aligning images in Talairach space (Talairach and Tournoux 1988) Functional images (T2) were acquired at 12 of these slice locations spanning the entire amygdala (1113093A20 to P24 in Talairach coordinates) using an EPI BOLD sequence (TE 40 TR 3000 flip angle 90deg matrix 128 1113093 64 FOV 20 4-mm skip 0 voxel size 3125 1113093 3125 1113093 40 mm) There were three runs of 100 images totaling 300 images per slice Images were motion corrected and normalized All 18 subjects had less than 05 voxels of in-plane motion All images were registered to a representative reference brain using Automated Image Registration software (Woods et al 1992) and voxelwise analyses of variance (ANOVAs) were conducted on these pooled data using normalized signal intensity as the dependent variable (Braver et al 1997 Casey et al 2000) Separate analyses were conducted comparing male adults and male children and comparing male and female children to examine interactions of stimulus type (fearful faces neutral faces fixation) with age or gender respectively Significant activations were defined by at least three contiguous voxels and alpha = 05 (Forman et al 1995) Amygdala activation was defined on the reference brain using Talairach coordinates and consensus among three raters (BJC KMT PJW) Significant regions that extended outside of the brain or had large SDs were excluded

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Motivational Self-conscioussocial

ThirstHungerPainMood

ShameEmbarrassment

PrideGuilt

Regulate social behaviour

BasicHappiness

FearAnger

SurpriseDisgustSadness

Feature prominentlyin social

communication

Do not feature prominentlyin social communication

5facial expressions of emotion - what are the emotions

Faces are special

Face perception may be the most developed visual perceptual skill in humans

Infants prefer to look at faces from shortly after birth (Morton and Johnson 1991)

Most people spend more time looking at faces than at any other type of object

We seem to have the capacity to perceive the unique identity of a virtually unlimited number of different faces

6

We laugh more if in a group show distress more if in a group

Babies (10 months) almost only smile in presence of caregiver

Babies look to caregiver and behave according to caregiver response when encountering novel object Eg a barking dog or a snake

This is known as social referencing and is also seen in chimpanzee societies

A similar process observational fear is seen in other monkeys Infant monkeys show fearful unconditioned response to motherrsquos expression of fear when the mother could see a snake but the infants could not That is infants showed a fear response to the motherrsquos fear response

Facial expressions as a communicative tool

7Understanding Emotion from facial expressions

Percentage of facial responses to unpleasant odour classified as unpleasant neutral or pleasant in a spontaneous condition a posed to real person condition and a posed to imaginary audience condition

InErickson and Schulkin 2003

8facial expressions as communication

Facial expressions allow for rapid communication

They are produced when there is an emotional stimulus and an audience present

Our interpretation of anotherrsquos emotion modulates our behaviour and vice versa

The ability to recognise emotion expressions appears very early

first few days (neonates)

can distinguish between expressions of happiness sadness and surprise

Four- to six-month show preferences for facial expressions of happiness over neutral and angry expressions

seven months can distinguish among expressions of fear anger surprise happiness and sadness

9facial expressions as communication

Angry faces are detected much more rapidly than faces depicting non-threatening expressions

Ohman et al 2001

Attention is driven by fear

10Recognition as an automatic processes - fear and threat

Evidence from animal neuropsychological and imaging studies suggest that the amygdala is of primary importance in the recognition of fear

11Automatic processes = dedicated network

Fear and the amygdala

Bilateral amygdala removal

reduces levels of aggression and fear in rats and monkeys

facial expressions and vocalisations become less expressive

impairs fear conditioning

12Fear and the amygdala - evidence from animal studies

Bilateral amygdala damagereduces recognition of fear-inducing stimulireduces recognition of fear in othersreduces ability to express fear

Does NOT affect ability to recognise faces or to know what fear is

See patients SM DR and SE (Adolphs et al and Calder et al)

Alzheimerrsquos disease impairs fear conditioning

13

Fear and the amygdala - evidence from human neuropsychology

non-conscious processing of fear expressions

Fear and the amygdala - evidence from human imaging

Increased amydala activity for facial expressions of fear vs happiness disgust anger neutral

Fear face recog

Fear cond

Results from several studies

14

Neuromodulatory role of left amygdala less fear = less activity

Subliminal activation of amygdala to fear

Amygdala Response to Facial Expressions in Children and AdultsThomas et al 2001

Blocks of fixation of fear neutral faces No task just watch

Left amygdala activation for fear vs fixation in male children and adults

Overall adults showed greater amygdala activation for fear v neutral whereas children did not (neutral faces may be ambiguous)

LeftRight

15A typical study

Methods and Materials Subjects Six male adults (mean 1113093 24 years SD 1113093 66 years) and 12 children (mean 1113093 11 years SD 1113093 24 years) recruited in the Pittsburgh area were scanned in a 15-T scanner during passive viewing of fearful and neutral faces The children sixfemale and six male ranged in pubertal development from Tanner stages1 II to VIV Male and female subjects did not differ in mean age or Tanner stage Data from an additional three adults (three female) and four children (two female) were not included due to excessive motion artifact (111309305 voxels n 1113093 5) or claustrophobia (n 1113093 1) or because the subject fell asleep during the task (n 1113093 1) Subjects were screened for any personal or family history of psychiatric or medical illness and for any contraindications for an MRI Written child assent and parental consent were acquired before the study

Behavioral Paradigm The task consisted of the rapid and successive presentation of faces in blocks of neutral and emotional expressions The face stimuli consisted of digitized fearful and neutral faces taken from the Ekman and Friesen (1976) study (Figure 1) A total of eight different actors (four male and four female) demonstrating both fearful and neutral expressions were used The hair was stripped from the images to remove any nonfacial features and both fear and exaggerated fear poses were used for each actor (Calder et al 1997) resulting in a total of 16 fear stimuli and eight neutral stimuli Stimuli were presented for 200 msec with an interstimulus interval of 800 msec (flashing fixation point) Each block of trials consisted of the presentation of a flashing fixation point for 45 sec followed by alternating 42-sec blocks of either neutral or fearful expressions and a final 45-sec epoch of fixation (Figure 1) This procedure was repeated in three runs of trials with the presentation order counterbalanced across runs and across subjects (ie F-N-F-N-F or N-F-N-F-N) Following Breiter and colleaguesrsquo (Breiter et al 1996) design no overt response was required Instead subjects were instructed to fixate centrally to try to get an overall sense of the faces2

Image Acquisition Processing and Analysis Scans were acquired on a 15-T GE Signa scanner (General Electric Systems Milwaukee) modified for echo planar imaging (Advanced NMR Wilmington MA) using a quadrature head coil A T1-weighted sagittal localizer image was used to prescribe the functional slice locations T1-weighted structural images were acquired in 4-mm contiguous coronal slices through the whole brain (echo time [TE] min repetition time [TR] 500 matrix 256 1113093 256 field of view [FOV] 20) for purposes of localizing the functional activity and aligning images in Talairach space (Talairach and Tournoux 1988) Functional images (T2) were acquired at 12 of these slice locations spanning the entire amygdala (1113093A20 to P24 in Talairach coordinates) using an EPI BOLD sequence (TE 40 TR 3000 flip angle 90deg matrix 128 1113093 64 FOV 20 4-mm skip 0 voxel size 3125 1113093 3125 1113093 40 mm) There were three runs of 100 images totaling 300 images per slice Images were motion corrected and normalized All 18 subjects had less than 05 voxels of in-plane motion All images were registered to a representative reference brain using Automated Image Registration software (Woods et al 1992) and voxelwise analyses of variance (ANOVAs) were conducted on these pooled data using normalized signal intensity as the dependent variable (Braver et al 1997 Casey et al 2000) Separate analyses were conducted comparing male adults and male children and comparing male and female children to examine interactions of stimulus type (fearful faces neutral faces fixation) with age or gender respectively Significant activations were defined by at least three contiguous voxels and alpha = 05 (Forman et al 1995) Amygdala activation was defined on the reference brain using Talairach coordinates and consensus among three raters (BJC KMT PJW) Significant regions that extended outside of the brain or had large SDs were excluded

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Faces are special

Face perception may be the most developed visual perceptual skill in humans

Infants prefer to look at faces from shortly after birth (Morton and Johnson 1991)

Most people spend more time looking at faces than at any other type of object

We seem to have the capacity to perceive the unique identity of a virtually unlimited number of different faces

6

We laugh more if in a group show distress more if in a group

Babies (10 months) almost only smile in presence of caregiver

Babies look to caregiver and behave according to caregiver response when encountering novel object Eg a barking dog or a snake

This is known as social referencing and is also seen in chimpanzee societies

A similar process observational fear is seen in other monkeys Infant monkeys show fearful unconditioned response to motherrsquos expression of fear when the mother could see a snake but the infants could not That is infants showed a fear response to the motherrsquos fear response

Facial expressions as a communicative tool

7Understanding Emotion from facial expressions

Percentage of facial responses to unpleasant odour classified as unpleasant neutral or pleasant in a spontaneous condition a posed to real person condition and a posed to imaginary audience condition

InErickson and Schulkin 2003

8facial expressions as communication

Facial expressions allow for rapid communication

They are produced when there is an emotional stimulus and an audience present

Our interpretation of anotherrsquos emotion modulates our behaviour and vice versa

The ability to recognise emotion expressions appears very early

first few days (neonates)

can distinguish between expressions of happiness sadness and surprise

Four- to six-month show preferences for facial expressions of happiness over neutral and angry expressions

seven months can distinguish among expressions of fear anger surprise happiness and sadness

9facial expressions as communication

Angry faces are detected much more rapidly than faces depicting non-threatening expressions

Ohman et al 2001

Attention is driven by fear

10Recognition as an automatic processes - fear and threat

Evidence from animal neuropsychological and imaging studies suggest that the amygdala is of primary importance in the recognition of fear

11Automatic processes = dedicated network

Fear and the amygdala

Bilateral amygdala removal

reduces levels of aggression and fear in rats and monkeys

facial expressions and vocalisations become less expressive

impairs fear conditioning

12Fear and the amygdala - evidence from animal studies

Bilateral amygdala damagereduces recognition of fear-inducing stimulireduces recognition of fear in othersreduces ability to express fear

Does NOT affect ability to recognise faces or to know what fear is

See patients SM DR and SE (Adolphs et al and Calder et al)

Alzheimerrsquos disease impairs fear conditioning

13

Fear and the amygdala - evidence from human neuropsychology

non-conscious processing of fear expressions

Fear and the amygdala - evidence from human imaging

Increased amydala activity for facial expressions of fear vs happiness disgust anger neutral

Fear face recog

Fear cond

Results from several studies

14

Neuromodulatory role of left amygdala less fear = less activity

Subliminal activation of amygdala to fear

Amygdala Response to Facial Expressions in Children and AdultsThomas et al 2001

Blocks of fixation of fear neutral faces No task just watch

Left amygdala activation for fear vs fixation in male children and adults

Overall adults showed greater amygdala activation for fear v neutral whereas children did not (neutral faces may be ambiguous)

LeftRight

15A typical study

Methods and Materials Subjects Six male adults (mean 1113093 24 years SD 1113093 66 years) and 12 children (mean 1113093 11 years SD 1113093 24 years) recruited in the Pittsburgh area were scanned in a 15-T scanner during passive viewing of fearful and neutral faces The children sixfemale and six male ranged in pubertal development from Tanner stages1 II to VIV Male and female subjects did not differ in mean age or Tanner stage Data from an additional three adults (three female) and four children (two female) were not included due to excessive motion artifact (111309305 voxels n 1113093 5) or claustrophobia (n 1113093 1) or because the subject fell asleep during the task (n 1113093 1) Subjects were screened for any personal or family history of psychiatric or medical illness and for any contraindications for an MRI Written child assent and parental consent were acquired before the study

Behavioral Paradigm The task consisted of the rapid and successive presentation of faces in blocks of neutral and emotional expressions The face stimuli consisted of digitized fearful and neutral faces taken from the Ekman and Friesen (1976) study (Figure 1) A total of eight different actors (four male and four female) demonstrating both fearful and neutral expressions were used The hair was stripped from the images to remove any nonfacial features and both fear and exaggerated fear poses were used for each actor (Calder et al 1997) resulting in a total of 16 fear stimuli and eight neutral stimuli Stimuli were presented for 200 msec with an interstimulus interval of 800 msec (flashing fixation point) Each block of trials consisted of the presentation of a flashing fixation point for 45 sec followed by alternating 42-sec blocks of either neutral or fearful expressions and a final 45-sec epoch of fixation (Figure 1) This procedure was repeated in three runs of trials with the presentation order counterbalanced across runs and across subjects (ie F-N-F-N-F or N-F-N-F-N) Following Breiter and colleaguesrsquo (Breiter et al 1996) design no overt response was required Instead subjects were instructed to fixate centrally to try to get an overall sense of the faces2

Image Acquisition Processing and Analysis Scans were acquired on a 15-T GE Signa scanner (General Electric Systems Milwaukee) modified for echo planar imaging (Advanced NMR Wilmington MA) using a quadrature head coil A T1-weighted sagittal localizer image was used to prescribe the functional slice locations T1-weighted structural images were acquired in 4-mm contiguous coronal slices through the whole brain (echo time [TE] min repetition time [TR] 500 matrix 256 1113093 256 field of view [FOV] 20) for purposes of localizing the functional activity and aligning images in Talairach space (Talairach and Tournoux 1988) Functional images (T2) were acquired at 12 of these slice locations spanning the entire amygdala (1113093A20 to P24 in Talairach coordinates) using an EPI BOLD sequence (TE 40 TR 3000 flip angle 90deg matrix 128 1113093 64 FOV 20 4-mm skip 0 voxel size 3125 1113093 3125 1113093 40 mm) There were three runs of 100 images totaling 300 images per slice Images were motion corrected and normalized All 18 subjects had less than 05 voxels of in-plane motion All images were registered to a representative reference brain using Automated Image Registration software (Woods et al 1992) and voxelwise analyses of variance (ANOVAs) were conducted on these pooled data using normalized signal intensity as the dependent variable (Braver et al 1997 Casey et al 2000) Separate analyses were conducted comparing male adults and male children and comparing male and female children to examine interactions of stimulus type (fearful faces neutral faces fixation) with age or gender respectively Significant activations were defined by at least three contiguous voxels and alpha = 05 (Forman et al 1995) Amygdala activation was defined on the reference brain using Talairach coordinates and consensus among three raters (BJC KMT PJW) Significant regions that extended outside of the brain or had large SDs were excluded

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

We laugh more if in a group show distress more if in a group

Babies (10 months) almost only smile in presence of caregiver

Babies look to caregiver and behave according to caregiver response when encountering novel object Eg a barking dog or a snake

This is known as social referencing and is also seen in chimpanzee societies

A similar process observational fear is seen in other monkeys Infant monkeys show fearful unconditioned response to motherrsquos expression of fear when the mother could see a snake but the infants could not That is infants showed a fear response to the motherrsquos fear response

Facial expressions as a communicative tool

7Understanding Emotion from facial expressions

Percentage of facial responses to unpleasant odour classified as unpleasant neutral or pleasant in a spontaneous condition a posed to real person condition and a posed to imaginary audience condition

InErickson and Schulkin 2003

8facial expressions as communication

Facial expressions allow for rapid communication

They are produced when there is an emotional stimulus and an audience present

Our interpretation of anotherrsquos emotion modulates our behaviour and vice versa

The ability to recognise emotion expressions appears very early

first few days (neonates)

can distinguish between expressions of happiness sadness and surprise

Four- to six-month show preferences for facial expressions of happiness over neutral and angry expressions

seven months can distinguish among expressions of fear anger surprise happiness and sadness

9facial expressions as communication

Angry faces are detected much more rapidly than faces depicting non-threatening expressions

Ohman et al 2001

Attention is driven by fear

10Recognition as an automatic processes - fear and threat

Evidence from animal neuropsychological and imaging studies suggest that the amygdala is of primary importance in the recognition of fear

11Automatic processes = dedicated network

Fear and the amygdala

Bilateral amygdala removal

reduces levels of aggression and fear in rats and monkeys

facial expressions and vocalisations become less expressive

impairs fear conditioning

12Fear and the amygdala - evidence from animal studies

Bilateral amygdala damagereduces recognition of fear-inducing stimulireduces recognition of fear in othersreduces ability to express fear

Does NOT affect ability to recognise faces or to know what fear is

See patients SM DR and SE (Adolphs et al and Calder et al)

Alzheimerrsquos disease impairs fear conditioning

13

Fear and the amygdala - evidence from human neuropsychology

non-conscious processing of fear expressions

Fear and the amygdala - evidence from human imaging

Increased amydala activity for facial expressions of fear vs happiness disgust anger neutral

Fear face recog

Fear cond

Results from several studies

14

Neuromodulatory role of left amygdala less fear = less activity

Subliminal activation of amygdala to fear

Amygdala Response to Facial Expressions in Children and AdultsThomas et al 2001

Blocks of fixation of fear neutral faces No task just watch

Left amygdala activation for fear vs fixation in male children and adults

Overall adults showed greater amygdala activation for fear v neutral whereas children did not (neutral faces may be ambiguous)

LeftRight

15A typical study

Methods and Materials Subjects Six male adults (mean 1113093 24 years SD 1113093 66 years) and 12 children (mean 1113093 11 years SD 1113093 24 years) recruited in the Pittsburgh area were scanned in a 15-T scanner during passive viewing of fearful and neutral faces The children sixfemale and six male ranged in pubertal development from Tanner stages1 II to VIV Male and female subjects did not differ in mean age or Tanner stage Data from an additional three adults (three female) and four children (two female) were not included due to excessive motion artifact (111309305 voxels n 1113093 5) or claustrophobia (n 1113093 1) or because the subject fell asleep during the task (n 1113093 1) Subjects were screened for any personal or family history of psychiatric or medical illness and for any contraindications for an MRI Written child assent and parental consent were acquired before the study

Behavioral Paradigm The task consisted of the rapid and successive presentation of faces in blocks of neutral and emotional expressions The face stimuli consisted of digitized fearful and neutral faces taken from the Ekman and Friesen (1976) study (Figure 1) A total of eight different actors (four male and four female) demonstrating both fearful and neutral expressions were used The hair was stripped from the images to remove any nonfacial features and both fear and exaggerated fear poses were used for each actor (Calder et al 1997) resulting in a total of 16 fear stimuli and eight neutral stimuli Stimuli were presented for 200 msec with an interstimulus interval of 800 msec (flashing fixation point) Each block of trials consisted of the presentation of a flashing fixation point for 45 sec followed by alternating 42-sec blocks of either neutral or fearful expressions and a final 45-sec epoch of fixation (Figure 1) This procedure was repeated in three runs of trials with the presentation order counterbalanced across runs and across subjects (ie F-N-F-N-F or N-F-N-F-N) Following Breiter and colleaguesrsquo (Breiter et al 1996) design no overt response was required Instead subjects were instructed to fixate centrally to try to get an overall sense of the faces2

Image Acquisition Processing and Analysis Scans were acquired on a 15-T GE Signa scanner (General Electric Systems Milwaukee) modified for echo planar imaging (Advanced NMR Wilmington MA) using a quadrature head coil A T1-weighted sagittal localizer image was used to prescribe the functional slice locations T1-weighted structural images were acquired in 4-mm contiguous coronal slices through the whole brain (echo time [TE] min repetition time [TR] 500 matrix 256 1113093 256 field of view [FOV] 20) for purposes of localizing the functional activity and aligning images in Talairach space (Talairach and Tournoux 1988) Functional images (T2) were acquired at 12 of these slice locations spanning the entire amygdala (1113093A20 to P24 in Talairach coordinates) using an EPI BOLD sequence (TE 40 TR 3000 flip angle 90deg matrix 128 1113093 64 FOV 20 4-mm skip 0 voxel size 3125 1113093 3125 1113093 40 mm) There were three runs of 100 images totaling 300 images per slice Images were motion corrected and normalized All 18 subjects had less than 05 voxels of in-plane motion All images were registered to a representative reference brain using Automated Image Registration software (Woods et al 1992) and voxelwise analyses of variance (ANOVAs) were conducted on these pooled data using normalized signal intensity as the dependent variable (Braver et al 1997 Casey et al 2000) Separate analyses were conducted comparing male adults and male children and comparing male and female children to examine interactions of stimulus type (fearful faces neutral faces fixation) with age or gender respectively Significant activations were defined by at least three contiguous voxels and alpha = 05 (Forman et al 1995) Amygdala activation was defined on the reference brain using Talairach coordinates and consensus among three raters (BJC KMT PJW) Significant regions that extended outside of the brain or had large SDs were excluded

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Percentage of facial responses to unpleasant odour classified as unpleasant neutral or pleasant in a spontaneous condition a posed to real person condition and a posed to imaginary audience condition

InErickson and Schulkin 2003

8facial expressions as communication

Facial expressions allow for rapid communication

They are produced when there is an emotional stimulus and an audience present

Our interpretation of anotherrsquos emotion modulates our behaviour and vice versa

The ability to recognise emotion expressions appears very early

first few days (neonates)

can distinguish between expressions of happiness sadness and surprise

Four- to six-month show preferences for facial expressions of happiness over neutral and angry expressions

seven months can distinguish among expressions of fear anger surprise happiness and sadness

9facial expressions as communication

Angry faces are detected much more rapidly than faces depicting non-threatening expressions

Ohman et al 2001

Attention is driven by fear

10Recognition as an automatic processes - fear and threat

Evidence from animal neuropsychological and imaging studies suggest that the amygdala is of primary importance in the recognition of fear

11Automatic processes = dedicated network

Fear and the amygdala

Bilateral amygdala removal

reduces levels of aggression and fear in rats and monkeys

facial expressions and vocalisations become less expressive

impairs fear conditioning

12Fear and the amygdala - evidence from animal studies

Bilateral amygdala damagereduces recognition of fear-inducing stimulireduces recognition of fear in othersreduces ability to express fear

Does NOT affect ability to recognise faces or to know what fear is

See patients SM DR and SE (Adolphs et al and Calder et al)

Alzheimerrsquos disease impairs fear conditioning

13

Fear and the amygdala - evidence from human neuropsychology

non-conscious processing of fear expressions

Fear and the amygdala - evidence from human imaging

Increased amydala activity for facial expressions of fear vs happiness disgust anger neutral

Fear face recog

Fear cond

Results from several studies

14

Neuromodulatory role of left amygdala less fear = less activity

Subliminal activation of amygdala to fear

Amygdala Response to Facial Expressions in Children and AdultsThomas et al 2001

Blocks of fixation of fear neutral faces No task just watch

Left amygdala activation for fear vs fixation in male children and adults

Overall adults showed greater amygdala activation for fear v neutral whereas children did not (neutral faces may be ambiguous)

LeftRight

15A typical study

Methods and Materials Subjects Six male adults (mean 1113093 24 years SD 1113093 66 years) and 12 children (mean 1113093 11 years SD 1113093 24 years) recruited in the Pittsburgh area were scanned in a 15-T scanner during passive viewing of fearful and neutral faces The children sixfemale and six male ranged in pubertal development from Tanner stages1 II to VIV Male and female subjects did not differ in mean age or Tanner stage Data from an additional three adults (three female) and four children (two female) were not included due to excessive motion artifact (111309305 voxels n 1113093 5) or claustrophobia (n 1113093 1) or because the subject fell asleep during the task (n 1113093 1) Subjects were screened for any personal or family history of psychiatric or medical illness and for any contraindications for an MRI Written child assent and parental consent were acquired before the study

Behavioral Paradigm The task consisted of the rapid and successive presentation of faces in blocks of neutral and emotional expressions The face stimuli consisted of digitized fearful and neutral faces taken from the Ekman and Friesen (1976) study (Figure 1) A total of eight different actors (four male and four female) demonstrating both fearful and neutral expressions were used The hair was stripped from the images to remove any nonfacial features and both fear and exaggerated fear poses were used for each actor (Calder et al 1997) resulting in a total of 16 fear stimuli and eight neutral stimuli Stimuli were presented for 200 msec with an interstimulus interval of 800 msec (flashing fixation point) Each block of trials consisted of the presentation of a flashing fixation point for 45 sec followed by alternating 42-sec blocks of either neutral or fearful expressions and a final 45-sec epoch of fixation (Figure 1) This procedure was repeated in three runs of trials with the presentation order counterbalanced across runs and across subjects (ie F-N-F-N-F or N-F-N-F-N) Following Breiter and colleaguesrsquo (Breiter et al 1996) design no overt response was required Instead subjects were instructed to fixate centrally to try to get an overall sense of the faces2

Image Acquisition Processing and Analysis Scans were acquired on a 15-T GE Signa scanner (General Electric Systems Milwaukee) modified for echo planar imaging (Advanced NMR Wilmington MA) using a quadrature head coil A T1-weighted sagittal localizer image was used to prescribe the functional slice locations T1-weighted structural images were acquired in 4-mm contiguous coronal slices through the whole brain (echo time [TE] min repetition time [TR] 500 matrix 256 1113093 256 field of view [FOV] 20) for purposes of localizing the functional activity and aligning images in Talairach space (Talairach and Tournoux 1988) Functional images (T2) were acquired at 12 of these slice locations spanning the entire amygdala (1113093A20 to P24 in Talairach coordinates) using an EPI BOLD sequence (TE 40 TR 3000 flip angle 90deg matrix 128 1113093 64 FOV 20 4-mm skip 0 voxel size 3125 1113093 3125 1113093 40 mm) There were three runs of 100 images totaling 300 images per slice Images were motion corrected and normalized All 18 subjects had less than 05 voxels of in-plane motion All images were registered to a representative reference brain using Automated Image Registration software (Woods et al 1992) and voxelwise analyses of variance (ANOVAs) were conducted on these pooled data using normalized signal intensity as the dependent variable (Braver et al 1997 Casey et al 2000) Separate analyses were conducted comparing male adults and male children and comparing male and female children to examine interactions of stimulus type (fearful faces neutral faces fixation) with age or gender respectively Significant activations were defined by at least three contiguous voxels and alpha = 05 (Forman et al 1995) Amygdala activation was defined on the reference brain using Talairach coordinates and consensus among three raters (BJC KMT PJW) Significant regions that extended outside of the brain or had large SDs were excluded

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Facial expressions allow for rapid communication

They are produced when there is an emotional stimulus and an audience present

Our interpretation of anotherrsquos emotion modulates our behaviour and vice versa

The ability to recognise emotion expressions appears very early

first few days (neonates)

can distinguish between expressions of happiness sadness and surprise

Four- to six-month show preferences for facial expressions of happiness over neutral and angry expressions

seven months can distinguish among expressions of fear anger surprise happiness and sadness

9facial expressions as communication

Angry faces are detected much more rapidly than faces depicting non-threatening expressions

Ohman et al 2001

Attention is driven by fear

10Recognition as an automatic processes - fear and threat

Evidence from animal neuropsychological and imaging studies suggest that the amygdala is of primary importance in the recognition of fear

11Automatic processes = dedicated network

Fear and the amygdala

Bilateral amygdala removal

reduces levels of aggression and fear in rats and monkeys

facial expressions and vocalisations become less expressive

impairs fear conditioning

12Fear and the amygdala - evidence from animal studies

Bilateral amygdala damagereduces recognition of fear-inducing stimulireduces recognition of fear in othersreduces ability to express fear

Does NOT affect ability to recognise faces or to know what fear is

See patients SM DR and SE (Adolphs et al and Calder et al)

Alzheimerrsquos disease impairs fear conditioning

13

Fear and the amygdala - evidence from human neuropsychology

non-conscious processing of fear expressions

Fear and the amygdala - evidence from human imaging

Increased amydala activity for facial expressions of fear vs happiness disgust anger neutral

Fear face recog

Fear cond

Results from several studies

14

Neuromodulatory role of left amygdala less fear = less activity

Subliminal activation of amygdala to fear

Amygdala Response to Facial Expressions in Children and AdultsThomas et al 2001

Blocks of fixation of fear neutral faces No task just watch

Left amygdala activation for fear vs fixation in male children and adults

Overall adults showed greater amygdala activation for fear v neutral whereas children did not (neutral faces may be ambiguous)

LeftRight

15A typical study

Methods and Materials Subjects Six male adults (mean 1113093 24 years SD 1113093 66 years) and 12 children (mean 1113093 11 years SD 1113093 24 years) recruited in the Pittsburgh area were scanned in a 15-T scanner during passive viewing of fearful and neutral faces The children sixfemale and six male ranged in pubertal development from Tanner stages1 II to VIV Male and female subjects did not differ in mean age or Tanner stage Data from an additional three adults (three female) and four children (two female) were not included due to excessive motion artifact (111309305 voxels n 1113093 5) or claustrophobia (n 1113093 1) or because the subject fell asleep during the task (n 1113093 1) Subjects were screened for any personal or family history of psychiatric or medical illness and for any contraindications for an MRI Written child assent and parental consent were acquired before the study

Behavioral Paradigm The task consisted of the rapid and successive presentation of faces in blocks of neutral and emotional expressions The face stimuli consisted of digitized fearful and neutral faces taken from the Ekman and Friesen (1976) study (Figure 1) A total of eight different actors (four male and four female) demonstrating both fearful and neutral expressions were used The hair was stripped from the images to remove any nonfacial features and both fear and exaggerated fear poses were used for each actor (Calder et al 1997) resulting in a total of 16 fear stimuli and eight neutral stimuli Stimuli were presented for 200 msec with an interstimulus interval of 800 msec (flashing fixation point) Each block of trials consisted of the presentation of a flashing fixation point for 45 sec followed by alternating 42-sec blocks of either neutral or fearful expressions and a final 45-sec epoch of fixation (Figure 1) This procedure was repeated in three runs of trials with the presentation order counterbalanced across runs and across subjects (ie F-N-F-N-F or N-F-N-F-N) Following Breiter and colleaguesrsquo (Breiter et al 1996) design no overt response was required Instead subjects were instructed to fixate centrally to try to get an overall sense of the faces2

Image Acquisition Processing and Analysis Scans were acquired on a 15-T GE Signa scanner (General Electric Systems Milwaukee) modified for echo planar imaging (Advanced NMR Wilmington MA) using a quadrature head coil A T1-weighted sagittal localizer image was used to prescribe the functional slice locations T1-weighted structural images were acquired in 4-mm contiguous coronal slices through the whole brain (echo time [TE] min repetition time [TR] 500 matrix 256 1113093 256 field of view [FOV] 20) for purposes of localizing the functional activity and aligning images in Talairach space (Talairach and Tournoux 1988) Functional images (T2) were acquired at 12 of these slice locations spanning the entire amygdala (1113093A20 to P24 in Talairach coordinates) using an EPI BOLD sequence (TE 40 TR 3000 flip angle 90deg matrix 128 1113093 64 FOV 20 4-mm skip 0 voxel size 3125 1113093 3125 1113093 40 mm) There were three runs of 100 images totaling 300 images per slice Images were motion corrected and normalized All 18 subjects had less than 05 voxels of in-plane motion All images were registered to a representative reference brain using Automated Image Registration software (Woods et al 1992) and voxelwise analyses of variance (ANOVAs) were conducted on these pooled data using normalized signal intensity as the dependent variable (Braver et al 1997 Casey et al 2000) Separate analyses were conducted comparing male adults and male children and comparing male and female children to examine interactions of stimulus type (fearful faces neutral faces fixation) with age or gender respectively Significant activations were defined by at least three contiguous voxels and alpha = 05 (Forman et al 1995) Amygdala activation was defined on the reference brain using Talairach coordinates and consensus among three raters (BJC KMT PJW) Significant regions that extended outside of the brain or had large SDs were excluded

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Angry faces are detected much more rapidly than faces depicting non-threatening expressions

Ohman et al 2001

Attention is driven by fear

10Recognition as an automatic processes - fear and threat

Evidence from animal neuropsychological and imaging studies suggest that the amygdala is of primary importance in the recognition of fear

11Automatic processes = dedicated network

Fear and the amygdala

Bilateral amygdala removal

reduces levels of aggression and fear in rats and monkeys

facial expressions and vocalisations become less expressive

impairs fear conditioning

12Fear and the amygdala - evidence from animal studies

Bilateral amygdala damagereduces recognition of fear-inducing stimulireduces recognition of fear in othersreduces ability to express fear

Does NOT affect ability to recognise faces or to know what fear is

See patients SM DR and SE (Adolphs et al and Calder et al)

Alzheimerrsquos disease impairs fear conditioning

13

Fear and the amygdala - evidence from human neuropsychology

non-conscious processing of fear expressions

Fear and the amygdala - evidence from human imaging

Increased amydala activity for facial expressions of fear vs happiness disgust anger neutral

Fear face recog

Fear cond

Results from several studies

14

Neuromodulatory role of left amygdala less fear = less activity

Subliminal activation of amygdala to fear

Amygdala Response to Facial Expressions in Children and AdultsThomas et al 2001

Blocks of fixation of fear neutral faces No task just watch

Left amygdala activation for fear vs fixation in male children and adults

Overall adults showed greater amygdala activation for fear v neutral whereas children did not (neutral faces may be ambiguous)

LeftRight

15A typical study

Methods and Materials Subjects Six male adults (mean 1113093 24 years SD 1113093 66 years) and 12 children (mean 1113093 11 years SD 1113093 24 years) recruited in the Pittsburgh area were scanned in a 15-T scanner during passive viewing of fearful and neutral faces The children sixfemale and six male ranged in pubertal development from Tanner stages1 II to VIV Male and female subjects did not differ in mean age or Tanner stage Data from an additional three adults (three female) and four children (two female) were not included due to excessive motion artifact (111309305 voxels n 1113093 5) or claustrophobia (n 1113093 1) or because the subject fell asleep during the task (n 1113093 1) Subjects were screened for any personal or family history of psychiatric or medical illness and for any contraindications for an MRI Written child assent and parental consent were acquired before the study

Behavioral Paradigm The task consisted of the rapid and successive presentation of faces in blocks of neutral and emotional expressions The face stimuli consisted of digitized fearful and neutral faces taken from the Ekman and Friesen (1976) study (Figure 1) A total of eight different actors (four male and four female) demonstrating both fearful and neutral expressions were used The hair was stripped from the images to remove any nonfacial features and both fear and exaggerated fear poses were used for each actor (Calder et al 1997) resulting in a total of 16 fear stimuli and eight neutral stimuli Stimuli were presented for 200 msec with an interstimulus interval of 800 msec (flashing fixation point) Each block of trials consisted of the presentation of a flashing fixation point for 45 sec followed by alternating 42-sec blocks of either neutral or fearful expressions and a final 45-sec epoch of fixation (Figure 1) This procedure was repeated in three runs of trials with the presentation order counterbalanced across runs and across subjects (ie F-N-F-N-F or N-F-N-F-N) Following Breiter and colleaguesrsquo (Breiter et al 1996) design no overt response was required Instead subjects were instructed to fixate centrally to try to get an overall sense of the faces2

Image Acquisition Processing and Analysis Scans were acquired on a 15-T GE Signa scanner (General Electric Systems Milwaukee) modified for echo planar imaging (Advanced NMR Wilmington MA) using a quadrature head coil A T1-weighted sagittal localizer image was used to prescribe the functional slice locations T1-weighted structural images were acquired in 4-mm contiguous coronal slices through the whole brain (echo time [TE] min repetition time [TR] 500 matrix 256 1113093 256 field of view [FOV] 20) for purposes of localizing the functional activity and aligning images in Talairach space (Talairach and Tournoux 1988) Functional images (T2) were acquired at 12 of these slice locations spanning the entire amygdala (1113093A20 to P24 in Talairach coordinates) using an EPI BOLD sequence (TE 40 TR 3000 flip angle 90deg matrix 128 1113093 64 FOV 20 4-mm skip 0 voxel size 3125 1113093 3125 1113093 40 mm) There were three runs of 100 images totaling 300 images per slice Images were motion corrected and normalized All 18 subjects had less than 05 voxels of in-plane motion All images were registered to a representative reference brain using Automated Image Registration software (Woods et al 1992) and voxelwise analyses of variance (ANOVAs) were conducted on these pooled data using normalized signal intensity as the dependent variable (Braver et al 1997 Casey et al 2000) Separate analyses were conducted comparing male adults and male children and comparing male and female children to examine interactions of stimulus type (fearful faces neutral faces fixation) with age or gender respectively Significant activations were defined by at least three contiguous voxels and alpha = 05 (Forman et al 1995) Amygdala activation was defined on the reference brain using Talairach coordinates and consensus among three raters (BJC KMT PJW) Significant regions that extended outside of the brain or had large SDs were excluded

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Evidence from animal neuropsychological and imaging studies suggest that the amygdala is of primary importance in the recognition of fear

11Automatic processes = dedicated network

Fear and the amygdala

Bilateral amygdala removal

reduces levels of aggression and fear in rats and monkeys

facial expressions and vocalisations become less expressive

impairs fear conditioning

12Fear and the amygdala - evidence from animal studies

Bilateral amygdala damagereduces recognition of fear-inducing stimulireduces recognition of fear in othersreduces ability to express fear

Does NOT affect ability to recognise faces or to know what fear is

See patients SM DR and SE (Adolphs et al and Calder et al)

Alzheimerrsquos disease impairs fear conditioning

13

Fear and the amygdala - evidence from human neuropsychology

non-conscious processing of fear expressions

Fear and the amygdala - evidence from human imaging

Increased amydala activity for facial expressions of fear vs happiness disgust anger neutral

Fear face recog

Fear cond

Results from several studies

14

Neuromodulatory role of left amygdala less fear = less activity

Subliminal activation of amygdala to fear

Amygdala Response to Facial Expressions in Children and AdultsThomas et al 2001

Blocks of fixation of fear neutral faces No task just watch

Left amygdala activation for fear vs fixation in male children and adults

Overall adults showed greater amygdala activation for fear v neutral whereas children did not (neutral faces may be ambiguous)

LeftRight

15A typical study

Methods and Materials Subjects Six male adults (mean 1113093 24 years SD 1113093 66 years) and 12 children (mean 1113093 11 years SD 1113093 24 years) recruited in the Pittsburgh area were scanned in a 15-T scanner during passive viewing of fearful and neutral faces The children sixfemale and six male ranged in pubertal development from Tanner stages1 II to VIV Male and female subjects did not differ in mean age or Tanner stage Data from an additional three adults (three female) and four children (two female) were not included due to excessive motion artifact (111309305 voxels n 1113093 5) or claustrophobia (n 1113093 1) or because the subject fell asleep during the task (n 1113093 1) Subjects were screened for any personal or family history of psychiatric or medical illness and for any contraindications for an MRI Written child assent and parental consent were acquired before the study

Behavioral Paradigm The task consisted of the rapid and successive presentation of faces in blocks of neutral and emotional expressions The face stimuli consisted of digitized fearful and neutral faces taken from the Ekman and Friesen (1976) study (Figure 1) A total of eight different actors (four male and four female) demonstrating both fearful and neutral expressions were used The hair was stripped from the images to remove any nonfacial features and both fear and exaggerated fear poses were used for each actor (Calder et al 1997) resulting in a total of 16 fear stimuli and eight neutral stimuli Stimuli were presented for 200 msec with an interstimulus interval of 800 msec (flashing fixation point) Each block of trials consisted of the presentation of a flashing fixation point for 45 sec followed by alternating 42-sec blocks of either neutral or fearful expressions and a final 45-sec epoch of fixation (Figure 1) This procedure was repeated in three runs of trials with the presentation order counterbalanced across runs and across subjects (ie F-N-F-N-F or N-F-N-F-N) Following Breiter and colleaguesrsquo (Breiter et al 1996) design no overt response was required Instead subjects were instructed to fixate centrally to try to get an overall sense of the faces2

Image Acquisition Processing and Analysis Scans were acquired on a 15-T GE Signa scanner (General Electric Systems Milwaukee) modified for echo planar imaging (Advanced NMR Wilmington MA) using a quadrature head coil A T1-weighted sagittal localizer image was used to prescribe the functional slice locations T1-weighted structural images were acquired in 4-mm contiguous coronal slices through the whole brain (echo time [TE] min repetition time [TR] 500 matrix 256 1113093 256 field of view [FOV] 20) for purposes of localizing the functional activity and aligning images in Talairach space (Talairach and Tournoux 1988) Functional images (T2) were acquired at 12 of these slice locations spanning the entire amygdala (1113093A20 to P24 in Talairach coordinates) using an EPI BOLD sequence (TE 40 TR 3000 flip angle 90deg matrix 128 1113093 64 FOV 20 4-mm skip 0 voxel size 3125 1113093 3125 1113093 40 mm) There were three runs of 100 images totaling 300 images per slice Images were motion corrected and normalized All 18 subjects had less than 05 voxels of in-plane motion All images were registered to a representative reference brain using Automated Image Registration software (Woods et al 1992) and voxelwise analyses of variance (ANOVAs) were conducted on these pooled data using normalized signal intensity as the dependent variable (Braver et al 1997 Casey et al 2000) Separate analyses were conducted comparing male adults and male children and comparing male and female children to examine interactions of stimulus type (fearful faces neutral faces fixation) with age or gender respectively Significant activations were defined by at least three contiguous voxels and alpha = 05 (Forman et al 1995) Amygdala activation was defined on the reference brain using Talairach coordinates and consensus among three raters (BJC KMT PJW) Significant regions that extended outside of the brain or had large SDs were excluded

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Bilateral amygdala removal

reduces levels of aggression and fear in rats and monkeys

facial expressions and vocalisations become less expressive

impairs fear conditioning

12Fear and the amygdala - evidence from animal studies

Bilateral amygdala damagereduces recognition of fear-inducing stimulireduces recognition of fear in othersreduces ability to express fear

Does NOT affect ability to recognise faces or to know what fear is

See patients SM DR and SE (Adolphs et al and Calder et al)

Alzheimerrsquos disease impairs fear conditioning

13

Fear and the amygdala - evidence from human neuropsychology

non-conscious processing of fear expressions

Fear and the amygdala - evidence from human imaging

Increased amydala activity for facial expressions of fear vs happiness disgust anger neutral

Fear face recog

Fear cond

Results from several studies

14

Neuromodulatory role of left amygdala less fear = less activity

Subliminal activation of amygdala to fear

Amygdala Response to Facial Expressions in Children and AdultsThomas et al 2001

Blocks of fixation of fear neutral faces No task just watch

Left amygdala activation for fear vs fixation in male children and adults

Overall adults showed greater amygdala activation for fear v neutral whereas children did not (neutral faces may be ambiguous)

LeftRight

15A typical study

Methods and Materials Subjects Six male adults (mean 1113093 24 years SD 1113093 66 years) and 12 children (mean 1113093 11 years SD 1113093 24 years) recruited in the Pittsburgh area were scanned in a 15-T scanner during passive viewing of fearful and neutral faces The children sixfemale and six male ranged in pubertal development from Tanner stages1 II to VIV Male and female subjects did not differ in mean age or Tanner stage Data from an additional three adults (three female) and four children (two female) were not included due to excessive motion artifact (111309305 voxels n 1113093 5) or claustrophobia (n 1113093 1) or because the subject fell asleep during the task (n 1113093 1) Subjects were screened for any personal or family history of psychiatric or medical illness and for any contraindications for an MRI Written child assent and parental consent were acquired before the study

Behavioral Paradigm The task consisted of the rapid and successive presentation of faces in blocks of neutral and emotional expressions The face stimuli consisted of digitized fearful and neutral faces taken from the Ekman and Friesen (1976) study (Figure 1) A total of eight different actors (four male and four female) demonstrating both fearful and neutral expressions were used The hair was stripped from the images to remove any nonfacial features and both fear and exaggerated fear poses were used for each actor (Calder et al 1997) resulting in a total of 16 fear stimuli and eight neutral stimuli Stimuli were presented for 200 msec with an interstimulus interval of 800 msec (flashing fixation point) Each block of trials consisted of the presentation of a flashing fixation point for 45 sec followed by alternating 42-sec blocks of either neutral or fearful expressions and a final 45-sec epoch of fixation (Figure 1) This procedure was repeated in three runs of trials with the presentation order counterbalanced across runs and across subjects (ie F-N-F-N-F or N-F-N-F-N) Following Breiter and colleaguesrsquo (Breiter et al 1996) design no overt response was required Instead subjects were instructed to fixate centrally to try to get an overall sense of the faces2

Image Acquisition Processing and Analysis Scans were acquired on a 15-T GE Signa scanner (General Electric Systems Milwaukee) modified for echo planar imaging (Advanced NMR Wilmington MA) using a quadrature head coil A T1-weighted sagittal localizer image was used to prescribe the functional slice locations T1-weighted structural images were acquired in 4-mm contiguous coronal slices through the whole brain (echo time [TE] min repetition time [TR] 500 matrix 256 1113093 256 field of view [FOV] 20) for purposes of localizing the functional activity and aligning images in Talairach space (Talairach and Tournoux 1988) Functional images (T2) were acquired at 12 of these slice locations spanning the entire amygdala (1113093A20 to P24 in Talairach coordinates) using an EPI BOLD sequence (TE 40 TR 3000 flip angle 90deg matrix 128 1113093 64 FOV 20 4-mm skip 0 voxel size 3125 1113093 3125 1113093 40 mm) There were three runs of 100 images totaling 300 images per slice Images were motion corrected and normalized All 18 subjects had less than 05 voxels of in-plane motion All images were registered to a representative reference brain using Automated Image Registration software (Woods et al 1992) and voxelwise analyses of variance (ANOVAs) were conducted on these pooled data using normalized signal intensity as the dependent variable (Braver et al 1997 Casey et al 2000) Separate analyses were conducted comparing male adults and male children and comparing male and female children to examine interactions of stimulus type (fearful faces neutral faces fixation) with age or gender respectively Significant activations were defined by at least three contiguous voxels and alpha = 05 (Forman et al 1995) Amygdala activation was defined on the reference brain using Talairach coordinates and consensus among three raters (BJC KMT PJW) Significant regions that extended outside of the brain or had large SDs were excluded

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Bilateral amygdala damagereduces recognition of fear-inducing stimulireduces recognition of fear in othersreduces ability to express fear

Does NOT affect ability to recognise faces or to know what fear is

See patients SM DR and SE (Adolphs et al and Calder et al)

Alzheimerrsquos disease impairs fear conditioning

13

Fear and the amygdala - evidence from human neuropsychology

non-conscious processing of fear expressions

Fear and the amygdala - evidence from human imaging

Increased amydala activity for facial expressions of fear vs happiness disgust anger neutral

Fear face recog

Fear cond

Results from several studies

14

Neuromodulatory role of left amygdala less fear = less activity

Subliminal activation of amygdala to fear

Amygdala Response to Facial Expressions in Children and AdultsThomas et al 2001

Blocks of fixation of fear neutral faces No task just watch

Left amygdala activation for fear vs fixation in male children and adults

Overall adults showed greater amygdala activation for fear v neutral whereas children did not (neutral faces may be ambiguous)

LeftRight

15A typical study

Methods and Materials Subjects Six male adults (mean 1113093 24 years SD 1113093 66 years) and 12 children (mean 1113093 11 years SD 1113093 24 years) recruited in the Pittsburgh area were scanned in a 15-T scanner during passive viewing of fearful and neutral faces The children sixfemale and six male ranged in pubertal development from Tanner stages1 II to VIV Male and female subjects did not differ in mean age or Tanner stage Data from an additional three adults (three female) and four children (two female) were not included due to excessive motion artifact (111309305 voxels n 1113093 5) or claustrophobia (n 1113093 1) or because the subject fell asleep during the task (n 1113093 1) Subjects were screened for any personal or family history of psychiatric or medical illness and for any contraindications for an MRI Written child assent and parental consent were acquired before the study

Behavioral Paradigm The task consisted of the rapid and successive presentation of faces in blocks of neutral and emotional expressions The face stimuli consisted of digitized fearful and neutral faces taken from the Ekman and Friesen (1976) study (Figure 1) A total of eight different actors (four male and four female) demonstrating both fearful and neutral expressions were used The hair was stripped from the images to remove any nonfacial features and both fear and exaggerated fear poses were used for each actor (Calder et al 1997) resulting in a total of 16 fear stimuli and eight neutral stimuli Stimuli were presented for 200 msec with an interstimulus interval of 800 msec (flashing fixation point) Each block of trials consisted of the presentation of a flashing fixation point for 45 sec followed by alternating 42-sec blocks of either neutral or fearful expressions and a final 45-sec epoch of fixation (Figure 1) This procedure was repeated in three runs of trials with the presentation order counterbalanced across runs and across subjects (ie F-N-F-N-F or N-F-N-F-N) Following Breiter and colleaguesrsquo (Breiter et al 1996) design no overt response was required Instead subjects were instructed to fixate centrally to try to get an overall sense of the faces2

Image Acquisition Processing and Analysis Scans were acquired on a 15-T GE Signa scanner (General Electric Systems Milwaukee) modified for echo planar imaging (Advanced NMR Wilmington MA) using a quadrature head coil A T1-weighted sagittal localizer image was used to prescribe the functional slice locations T1-weighted structural images were acquired in 4-mm contiguous coronal slices through the whole brain (echo time [TE] min repetition time [TR] 500 matrix 256 1113093 256 field of view [FOV] 20) for purposes of localizing the functional activity and aligning images in Talairach space (Talairach and Tournoux 1988) Functional images (T2) were acquired at 12 of these slice locations spanning the entire amygdala (1113093A20 to P24 in Talairach coordinates) using an EPI BOLD sequence (TE 40 TR 3000 flip angle 90deg matrix 128 1113093 64 FOV 20 4-mm skip 0 voxel size 3125 1113093 3125 1113093 40 mm) There were three runs of 100 images totaling 300 images per slice Images were motion corrected and normalized All 18 subjects had less than 05 voxels of in-plane motion All images were registered to a representative reference brain using Automated Image Registration software (Woods et al 1992) and voxelwise analyses of variance (ANOVAs) were conducted on these pooled data using normalized signal intensity as the dependent variable (Braver et al 1997 Casey et al 2000) Separate analyses were conducted comparing male adults and male children and comparing male and female children to examine interactions of stimulus type (fearful faces neutral faces fixation) with age or gender respectively Significant activations were defined by at least three contiguous voxels and alpha = 05 (Forman et al 1995) Amygdala activation was defined on the reference brain using Talairach coordinates and consensus among three raters (BJC KMT PJW) Significant regions that extended outside of the brain or had large SDs were excluded

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

non-conscious processing of fear expressions

Fear and the amygdala - evidence from human imaging

Increased amydala activity for facial expressions of fear vs happiness disgust anger neutral

Fear face recog

Fear cond

Results from several studies

14

Neuromodulatory role of left amygdala less fear = less activity

Subliminal activation of amygdala to fear

Amygdala Response to Facial Expressions in Children and AdultsThomas et al 2001

Blocks of fixation of fear neutral faces No task just watch

Left amygdala activation for fear vs fixation in male children and adults

Overall adults showed greater amygdala activation for fear v neutral whereas children did not (neutral faces may be ambiguous)

LeftRight

15A typical study

Methods and Materials Subjects Six male adults (mean 1113093 24 years SD 1113093 66 years) and 12 children (mean 1113093 11 years SD 1113093 24 years) recruited in the Pittsburgh area were scanned in a 15-T scanner during passive viewing of fearful and neutral faces The children sixfemale and six male ranged in pubertal development from Tanner stages1 II to VIV Male and female subjects did not differ in mean age or Tanner stage Data from an additional three adults (three female) and four children (two female) were not included due to excessive motion artifact (111309305 voxels n 1113093 5) or claustrophobia (n 1113093 1) or because the subject fell asleep during the task (n 1113093 1) Subjects were screened for any personal or family history of psychiatric or medical illness and for any contraindications for an MRI Written child assent and parental consent were acquired before the study

Behavioral Paradigm The task consisted of the rapid and successive presentation of faces in blocks of neutral and emotional expressions The face stimuli consisted of digitized fearful and neutral faces taken from the Ekman and Friesen (1976) study (Figure 1) A total of eight different actors (four male and four female) demonstrating both fearful and neutral expressions were used The hair was stripped from the images to remove any nonfacial features and both fear and exaggerated fear poses were used for each actor (Calder et al 1997) resulting in a total of 16 fear stimuli and eight neutral stimuli Stimuli were presented for 200 msec with an interstimulus interval of 800 msec (flashing fixation point) Each block of trials consisted of the presentation of a flashing fixation point for 45 sec followed by alternating 42-sec blocks of either neutral or fearful expressions and a final 45-sec epoch of fixation (Figure 1) This procedure was repeated in three runs of trials with the presentation order counterbalanced across runs and across subjects (ie F-N-F-N-F or N-F-N-F-N) Following Breiter and colleaguesrsquo (Breiter et al 1996) design no overt response was required Instead subjects were instructed to fixate centrally to try to get an overall sense of the faces2

Image Acquisition Processing and Analysis Scans were acquired on a 15-T GE Signa scanner (General Electric Systems Milwaukee) modified for echo planar imaging (Advanced NMR Wilmington MA) using a quadrature head coil A T1-weighted sagittal localizer image was used to prescribe the functional slice locations T1-weighted structural images were acquired in 4-mm contiguous coronal slices through the whole brain (echo time [TE] min repetition time [TR] 500 matrix 256 1113093 256 field of view [FOV] 20) for purposes of localizing the functional activity and aligning images in Talairach space (Talairach and Tournoux 1988) Functional images (T2) were acquired at 12 of these slice locations spanning the entire amygdala (1113093A20 to P24 in Talairach coordinates) using an EPI BOLD sequence (TE 40 TR 3000 flip angle 90deg matrix 128 1113093 64 FOV 20 4-mm skip 0 voxel size 3125 1113093 3125 1113093 40 mm) There were three runs of 100 images totaling 300 images per slice Images were motion corrected and normalized All 18 subjects had less than 05 voxels of in-plane motion All images were registered to a representative reference brain using Automated Image Registration software (Woods et al 1992) and voxelwise analyses of variance (ANOVAs) were conducted on these pooled data using normalized signal intensity as the dependent variable (Braver et al 1997 Casey et al 2000) Separate analyses were conducted comparing male adults and male children and comparing male and female children to examine interactions of stimulus type (fearful faces neutral faces fixation) with age or gender respectively Significant activations were defined by at least three contiguous voxels and alpha = 05 (Forman et al 1995) Amygdala activation was defined on the reference brain using Talairach coordinates and consensus among three raters (BJC KMT PJW) Significant regions that extended outside of the brain or had large SDs were excluded

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Amygdala Response to Facial Expressions in Children and AdultsThomas et al 2001

Blocks of fixation of fear neutral faces No task just watch

Left amygdala activation for fear vs fixation in male children and adults

Overall adults showed greater amygdala activation for fear v neutral whereas children did not (neutral faces may be ambiguous)

LeftRight

15A typical study

Methods and Materials Subjects Six male adults (mean 1113093 24 years SD 1113093 66 years) and 12 children (mean 1113093 11 years SD 1113093 24 years) recruited in the Pittsburgh area were scanned in a 15-T scanner during passive viewing of fearful and neutral faces The children sixfemale and six male ranged in pubertal development from Tanner stages1 II to VIV Male and female subjects did not differ in mean age or Tanner stage Data from an additional three adults (three female) and four children (two female) were not included due to excessive motion artifact (111309305 voxels n 1113093 5) or claustrophobia (n 1113093 1) or because the subject fell asleep during the task (n 1113093 1) Subjects were screened for any personal or family history of psychiatric or medical illness and for any contraindications for an MRI Written child assent and parental consent were acquired before the study

Behavioral Paradigm The task consisted of the rapid and successive presentation of faces in blocks of neutral and emotional expressions The face stimuli consisted of digitized fearful and neutral faces taken from the Ekman and Friesen (1976) study (Figure 1) A total of eight different actors (four male and four female) demonstrating both fearful and neutral expressions were used The hair was stripped from the images to remove any nonfacial features and both fear and exaggerated fear poses were used for each actor (Calder et al 1997) resulting in a total of 16 fear stimuli and eight neutral stimuli Stimuli were presented for 200 msec with an interstimulus interval of 800 msec (flashing fixation point) Each block of trials consisted of the presentation of a flashing fixation point for 45 sec followed by alternating 42-sec blocks of either neutral or fearful expressions and a final 45-sec epoch of fixation (Figure 1) This procedure was repeated in three runs of trials with the presentation order counterbalanced across runs and across subjects (ie F-N-F-N-F or N-F-N-F-N) Following Breiter and colleaguesrsquo (Breiter et al 1996) design no overt response was required Instead subjects were instructed to fixate centrally to try to get an overall sense of the faces2

Image Acquisition Processing and Analysis Scans were acquired on a 15-T GE Signa scanner (General Electric Systems Milwaukee) modified for echo planar imaging (Advanced NMR Wilmington MA) using a quadrature head coil A T1-weighted sagittal localizer image was used to prescribe the functional slice locations T1-weighted structural images were acquired in 4-mm contiguous coronal slices through the whole brain (echo time [TE] min repetition time [TR] 500 matrix 256 1113093 256 field of view [FOV] 20) for purposes of localizing the functional activity and aligning images in Talairach space (Talairach and Tournoux 1988) Functional images (T2) were acquired at 12 of these slice locations spanning the entire amygdala (1113093A20 to P24 in Talairach coordinates) using an EPI BOLD sequence (TE 40 TR 3000 flip angle 90deg matrix 128 1113093 64 FOV 20 4-mm skip 0 voxel size 3125 1113093 3125 1113093 40 mm) There were three runs of 100 images totaling 300 images per slice Images were motion corrected and normalized All 18 subjects had less than 05 voxels of in-plane motion All images were registered to a representative reference brain using Automated Image Registration software (Woods et al 1992) and voxelwise analyses of variance (ANOVAs) were conducted on these pooled data using normalized signal intensity as the dependent variable (Braver et al 1997 Casey et al 2000) Separate analyses were conducted comparing male adults and male children and comparing male and female children to examine interactions of stimulus type (fearful faces neutral faces fixation) with age or gender respectively Significant activations were defined by at least three contiguous voxels and alpha = 05 (Forman et al 1995) Amygdala activation was defined on the reference brain using Talairach coordinates and consensus among three raters (BJC KMT PJW) Significant regions that extended outside of the brain or had large SDs were excluded

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Methods and Materials Subjects Six male adults (mean 1113093 24 years SD 1113093 66 years) and 12 children (mean 1113093 11 years SD 1113093 24 years) recruited in the Pittsburgh area were scanned in a 15-T scanner during passive viewing of fearful and neutral faces The children sixfemale and six male ranged in pubertal development from Tanner stages1 II to VIV Male and female subjects did not differ in mean age or Tanner stage Data from an additional three adults (three female) and four children (two female) were not included due to excessive motion artifact (111309305 voxels n 1113093 5) or claustrophobia (n 1113093 1) or because the subject fell asleep during the task (n 1113093 1) Subjects were screened for any personal or family history of psychiatric or medical illness and for any contraindications for an MRI Written child assent and parental consent were acquired before the study

Behavioral Paradigm The task consisted of the rapid and successive presentation of faces in blocks of neutral and emotional expressions The face stimuli consisted of digitized fearful and neutral faces taken from the Ekman and Friesen (1976) study (Figure 1) A total of eight different actors (four male and four female) demonstrating both fearful and neutral expressions were used The hair was stripped from the images to remove any nonfacial features and both fear and exaggerated fear poses were used for each actor (Calder et al 1997) resulting in a total of 16 fear stimuli and eight neutral stimuli Stimuli were presented for 200 msec with an interstimulus interval of 800 msec (flashing fixation point) Each block of trials consisted of the presentation of a flashing fixation point for 45 sec followed by alternating 42-sec blocks of either neutral or fearful expressions and a final 45-sec epoch of fixation (Figure 1) This procedure was repeated in three runs of trials with the presentation order counterbalanced across runs and across subjects (ie F-N-F-N-F or N-F-N-F-N) Following Breiter and colleaguesrsquo (Breiter et al 1996) design no overt response was required Instead subjects were instructed to fixate centrally to try to get an overall sense of the faces2

Image Acquisition Processing and Analysis Scans were acquired on a 15-T GE Signa scanner (General Electric Systems Milwaukee) modified for echo planar imaging (Advanced NMR Wilmington MA) using a quadrature head coil A T1-weighted sagittal localizer image was used to prescribe the functional slice locations T1-weighted structural images were acquired in 4-mm contiguous coronal slices through the whole brain (echo time [TE] min repetition time [TR] 500 matrix 256 1113093 256 field of view [FOV] 20) for purposes of localizing the functional activity and aligning images in Talairach space (Talairach and Tournoux 1988) Functional images (T2) were acquired at 12 of these slice locations spanning the entire amygdala (1113093A20 to P24 in Talairach coordinates) using an EPI BOLD sequence (TE 40 TR 3000 flip angle 90deg matrix 128 1113093 64 FOV 20 4-mm skip 0 voxel size 3125 1113093 3125 1113093 40 mm) There were three runs of 100 images totaling 300 images per slice Images were motion corrected and normalized All 18 subjects had less than 05 voxels of in-plane motion All images were registered to a representative reference brain using Automated Image Registration software (Woods et al 1992) and voxelwise analyses of variance (ANOVAs) were conducted on these pooled data using normalized signal intensity as the dependent variable (Braver et al 1997 Casey et al 2000) Separate analyses were conducted comparing male adults and male children and comparing male and female children to examine interactions of stimulus type (fearful faces neutral faces fixation) with age or gender respectively Significant activations were defined by at least three contiguous voxels and alpha = 05 (Forman et al 1995) Amygdala activation was defined on the reference brain using Talairach coordinates and consensus among three raters (BJC KMT PJW) Significant regions that extended outside of the brain or had large SDs were excluded

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Behavioral Paradigm The task consisted of the rapid and successive presentation of faces in blocks of neutral and emotional expressions The face stimuli consisted of digitized fearful and neutral faces taken from the Ekman and Friesen (1976) study (Figure 1) A total of eight different actors (four male and four female) demonstrating both fearful and neutral expressions were used The hair was stripped from the images to remove any nonfacial features and both fear and exaggerated fear poses were used for each actor (Calder et al 1997) resulting in a total of 16 fear stimuli and eight neutral stimuli Stimuli were presented for 200 msec with an interstimulus interval of 800 msec (flashing fixation point) Each block of trials consisted of the presentation of a flashing fixation point for 45 sec followed by alternating 42-sec blocks of either neutral or fearful expressions and a final 45-sec epoch of fixation (Figure 1) This procedure was repeated in three runs of trials with the presentation order counterbalanced across runs and across subjects (ie F-N-F-N-F or N-F-N-F-N) Following Breiter and colleaguesrsquo (Breiter et al 1996) design no overt response was required Instead subjects were instructed to fixate centrally to try to get an overall sense of the faces2

Image Acquisition Processing and Analysis Scans were acquired on a 15-T GE Signa scanner (General Electric Systems Milwaukee) modified for echo planar imaging (Advanced NMR Wilmington MA) using a quadrature head coil A T1-weighted sagittal localizer image was used to prescribe the functional slice locations T1-weighted structural images were acquired in 4-mm contiguous coronal slices through the whole brain (echo time [TE] min repetition time [TR] 500 matrix 256 1113093 256 field of view [FOV] 20) for purposes of localizing the functional activity and aligning images in Talairach space (Talairach and Tournoux 1988) Functional images (T2) were acquired at 12 of these slice locations spanning the entire amygdala (1113093A20 to P24 in Talairach coordinates) using an EPI BOLD sequence (TE 40 TR 3000 flip angle 90deg matrix 128 1113093 64 FOV 20 4-mm skip 0 voxel size 3125 1113093 3125 1113093 40 mm) There were three runs of 100 images totaling 300 images per slice Images were motion corrected and normalized All 18 subjects had less than 05 voxels of in-plane motion All images were registered to a representative reference brain using Automated Image Registration software (Woods et al 1992) and voxelwise analyses of variance (ANOVAs) were conducted on these pooled data using normalized signal intensity as the dependent variable (Braver et al 1997 Casey et al 2000) Separate analyses were conducted comparing male adults and male children and comparing male and female children to examine interactions of stimulus type (fearful faces neutral faces fixation) with age or gender respectively Significant activations were defined by at least three contiguous voxels and alpha = 05 (Forman et al 1995) Amygdala activation was defined on the reference brain using Talairach coordinates and consensus among three raters (BJC KMT PJW) Significant regions that extended outside of the brain or had large SDs were excluded

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Image Acquisition Processing and Analysis Scans were acquired on a 15-T GE Signa scanner (General Electric Systems Milwaukee) modified for echo planar imaging (Advanced NMR Wilmington MA) using a quadrature head coil A T1-weighted sagittal localizer image was used to prescribe the functional slice locations T1-weighted structural images were acquired in 4-mm contiguous coronal slices through the whole brain (echo time [TE] min repetition time [TR] 500 matrix 256 1113093 256 field of view [FOV] 20) for purposes of localizing the functional activity and aligning images in Talairach space (Talairach and Tournoux 1988) Functional images (T2) were acquired at 12 of these slice locations spanning the entire amygdala (1113093A20 to P24 in Talairach coordinates) using an EPI BOLD sequence (TE 40 TR 3000 flip angle 90deg matrix 128 1113093 64 FOV 20 4-mm skip 0 voxel size 3125 1113093 3125 1113093 40 mm) There were three runs of 100 images totaling 300 images per slice Images were motion corrected and normalized All 18 subjects had less than 05 voxels of in-plane motion All images were registered to a representative reference brain using Automated Image Registration software (Woods et al 1992) and voxelwise analyses of variance (ANOVAs) were conducted on these pooled data using normalized signal intensity as the dependent variable (Braver et al 1997 Casey et al 2000) Separate analyses were conducted comparing male adults and male children and comparing male and female children to examine interactions of stimulus type (fearful faces neutral faces fixation) with age or gender respectively Significant activations were defined by at least three contiguous voxels and alpha = 05 (Forman et al 1995) Amygdala activation was defined on the reference brain using Talairach coordinates and consensus among three raters (BJC KMT PJW) Significant regions that extended outside of the brain or had large SDs were excluded

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Results Adults and Children A 2 1113093 2 (Group 1113093 Condition)3 ANOVA comparing male adults (n 1113093 6) and male children (n 1113093 6) revealed significant activity in the left amygdala and substantia innominata for fearful faces relative to fixation (Figure 2) and a decrease in signal with repeated presentations of the fearful faces4 (Table 1) Neutral faces showed a similar pattern of activation relative to fixation trials (F 1113093 2371 p 1113093 001) A significant interaction was observed in the left amygdala between stimulus type and age for the comparison of fearful and neutral expressions (Table 1) (Group 1113093 Condition Fear vs Neutral) Post hoc t tests indicate that adults demonstrated significantly greater activity for fearful faces relative to neutral faces (p 1113093 001) However the children demonstrated greater amygdala activity for neutral faces than for fearful expressions (p 1113093 0001) (Figure 3) Neither age nor Tanner stage predicted the magnitude of the percent change in signal in this sample

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

A variety of brain regions are involved in the processing of facial expressions of emotion

They are active at different times and some structures are active at more than one time

The amygdala is particularly implicated in the processing of fear stimuli receiving early (lt120 ms) subcortical as well as late (~170 ms) cortical input from the temporal lobes

Warning about other brain regions

16

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

The Amygdala Response to Emotional Stimuli A Comparison of Faces and ScenesHariri et al 2002

Blocked design

Matching task

Preferential right amygdala response to faces (faces gt IAPS)

Amygdala response to fear - special for faces

Getting rid of unwanted activations

17

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Adolphs and Tranel 2003Hadjihhani and de Gelder 2003

18Emotions - not just an ugly face

Cs better when faces presentBilat AMs worse when faces presentoften better at negative stimuli without faces

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

19

Emotions - the importance of the eyes

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

20

break

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

21

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

What emotion do these eyes depict

22The contribution of the eyes to facial expressions of fear

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Whalen et al 2004

Amygdala activation above fixation baseline for non-inverted (eye white) fearful eyes

23

The amygdala is responsive to large eye whites in fear (and surprise) expressions

Emotions - the importance of the eyes

signal change from fix

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

The amygdala fear and the eyesAdolphs et al 2005SM bubble analysis

24Emotions - the importance of the eyes

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

25

Emotions - the importance of the eyes

SMrsquos eye fixation (or lack of it)

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

When told to look at the eyes specifically SM improves but only while given this instruction

26Emotions - the importance of the eyes

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Hybrid Faces from Vuilleumier 2005

We need more than just the eyes to determine emotional and social relevance

27

Some easy to tell from eyes

Others from mouths

The amydalae are not just eye detectors - may direct attention to relevant stimuli - a biological relevance detector

Emotions - amygdalae are not simply eye detectors

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Animal studiesinsula = gustatory corteximpaired taste aversion in rats

Human Neuropsychologypatient NKHuntingdonrsquos DiseaseTourettersquos and OCDElectrical stimulation = nauseaRepeated exposure leads to habituation

Human imagingPhilips et alWicker et al

29Yuck Disgust and the Insula (and basal ganglia)

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling DisgustWicker et al 2003

1 Observed actors smelling and reacting to bad nice and neutral odours

2 Smelt bad and nice odours (+ rest)Separate visual and olfactory runs

Overlay analysis

Disgust - evidence from imaging 30

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Fear

Amygdala

Activated by fear-inducing stimuli

Habituates to fear

Removal or damage disproportionately impairs fear recognition and feelings of fear

Disgust

Insula and Basal Ganglia

Activated by facial expressions of disgust

Insula Habituates to disgust

Removal damage or degeneration of either structure disproportionately impairs disgust recognition and feelings of disgust

A double dissociation conclude that the neural mechanisms for fear and disgust are anatomically and functionally distinct

31Disgust vs Fear summary

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Green = neutralRed = angerPurple = fearYellow - happyBlue = sad

32

Duvernoy 1991 but see KesslerWest et al 2001

Other basic emotions - implicated brain regions

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

50 patients with neurodegenerative dementiaNegative emotions (red rlITGrMTG) and in particular sadness (green rSTG) correlated with tissue loss in right lateral inferior temporal and right middle temporal regions

Reflects this arearsquos role in visual processing of negative emotions

Tissue loss associated with specific emotion recognition impairment

Rosen et al 2006

33Other basic emotions - implicated brain regions

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

How does knowledge about brain activation help social psychologists

34

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Recent Research June 2006

Age is related to decreasing cognitive function - esp in frontal functions

Is emotion processing affected by advancing ageAn event-related brain potential study

Emotional intensity is a frontal function

Are old folk impaired at emotion intensity recognition

Investigated using ERP (EEG) and analysed by ANOVA

Rationale

Methods

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

young

old

Delay in early discrimination processing but no difference in emotion discrimination

Results

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Perceiving fear in dynamic body expressions

Emotional body language is important when the face cannot be seen

Important for survival so should be fast automatic and employ dedicated brain network

We know which parts of the brain are active for static emotion

We know that other parts of the brain are active for body motion

How do these interact for emotive whole body dynamic stimuli

Recent Research January 2007

Rationale

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Used event-related fMRI and video clips

Fear and neutral body movements with scrambled static and dynamic video images as controls

Task to press button when inverted image seen (therefore incidental processing being measured)

Methods

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

1 Main effects of bodies vs scrambled stimuli (Fs+Fd+Ns+Nd) minus 2(Sd+Ss)2 Main effects of fear vs neutral bodies [(Fs+Fd)minus(Ns+Nd)]3 Main effects of dynamic vs static bodies [(Fd+Nd)minus(Fs+Ns)]

Analyses

Results

Amygdala active for social stimuli

Not bothered whether static or dynamic

More bothered when it is fearful

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Other brain regions are bothered that it is dynamic (and fearful)These regions will be covered in later lectures

Results

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Attention to the person or the emotion Underlying activations in MEG

Facial emotion processing is fast (100ms) and automatic and occurs regardless of whether you attend to the face or not

Facial identity is also fast (but slower) and occurs in parallel according to most models

But there is some evidence from schizophrenia suggesting that the parallel (and therefore separate) brain regions interact

What happens to this interaction when you attend to either emotion or identity

Recent Research June 2007

Rational

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Used MEG and happyfearneutral faces

Identity task - press button when 2 identities the sameEmotion task - press button when 2 emotions the same

90ms orbito-frontal response to emotion regardless of attention

170ms right insula response when attending to emotion

Also 220ms activation increase for areas associated with identity processing

Methods and Results

ConclusionsSo there you go

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Impaired facial emotion recognition and reduced amygdalar volume in schizophrenia

Amygdala volume known to be reduced in Schizophrenics

Emotion recognition known to be impaired in Schizophrenia

Direct link between the two not studied (properly) before

Used 20 Sz + 20 Cs 3T MRIAnd facial emotion intensity recognition task

Recent Research Oct 2007

Rationale

Methods

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

(1) The schizophrenia patients had smaller amygdalar volumes than the healthy controls

(2) the patients showed impairment in recognizing facial emotions specifically anger surprise disgust and sadness

(3) the left amygdala volume reduction in these patients was associated with impaired recognition of sadness in facial expressions

Results

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Summary

distinct neural pathways underlie the processing of signals of fear (amygdala) and disgust (insulabasal ganglia) in humans

this dissociation can be related to the adaptive significance of these emotions as responses to critical forms of threat that are associated with external (fear) and internal (disgust) defence systems

According to LeDoux social neuroscience has been able to make progress in the field of emotion by

focusing on a psychologically well-defined aspect of emotion

using an experimental approach to emotion that simplifies the problem in such a way as to make it tractable

circumventing vague and poorly defined aspects of emotion

removing subjective experience as a roadblock to experimentation

37

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50

Next weekEmotion recognition from auditory cues and theories of emotion

• Slide 1
• Slide 2
• Slide 3
• Slide 4
• Slide 5
• Slide 6
• Slide 7
• Slide 8
• Slide 9
• Slide 10
• Slide 11
• Slide 12
• Slide 13
• Slide 14
• Slide 15
• Slide 16
• Slide 17
• Slide 18
• Slide 19
• Slide 20
• Slide 21
• Slide 22
• Slide 23
• Slide 24
• Slide 25
• Slide 26
• Slide 27
• Slide 28
• Slide 29
• Slide 30
• Slide 31
• Slide 32
• Slide 33
• Slide 34
• Slide 35
• Slide 36
• Slide 37
• Slide 38
• Slide 39
• Slide 40
• Slide 41
• Slide 42
• Slide 43
• Slide 44
• Slide 45
• Slide 46
• Slide 47
• Slide 48
• Slide 49
• Slide 50