language and the human brain - university of california ... · language and the human brain jeff...
TRANSCRIPT
![Page 1: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/1.jpg)
Language and the human brain
Jeff Elman
Department of Cognitive Science University of California, San Diego
![Page 2: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/2.jpg)
Animal language?
![Page 3: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/3.jpg)
Protective coloration
![Page 4: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/4.jpg)
![Page 5: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/5.jpg)
Vervet alarm calls
• Eagle alarm call
• Snake alarm call
![Page 6: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/6.jpg)
Kanzi
![Page 7: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/7.jpg)
Kanzi
![Page 8: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/8.jpg)
![Page 9: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/9.jpg)
Is this language?
![Page 10: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/10.jpg)
4 quick examples
![Page 11: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/11.jpg)
1.
Where are the words, anyway?
![Page 12: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/12.jpg)
Whereareth es il ens es b et w eew or d s Whereareth es il enc es b et w eenw or d s
![Page 13: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/13.jpg)
Baby statisticians?
Saffran, Aslin, Newport, 1996
![Page 14: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/14.jpg)
pabikulatidorepabikutalikulatidopabikulilitalatidotupabiku
![Page 15: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/15.jpg)
2.
What a big vocabulary you have!
![Page 16: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/16.jpg)
milk
bottle
bed
chair
kitty
doggie
cookie
candy horse
bird mommy
daddy Jane
go
run
see
man
drink
Do you want to eat a VIOLET CRUMBLE?
![Page 17: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/17.jpg)
3.
Syntax, syntax, syntax
![Page 18: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/18.jpg)
The dog barked. mouse sees The the dog.
that the
![Page 19: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/19.jpg)
Noun Phrase Verb Phrase
The dog barked
that the mouse sees
NP VP
Sentence
NP VP
that the cat chases
The dog the mouse sees barked. The dog the mouse the cat chases sees barked.
![Page 20: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/20.jpg)
4.
Saying one thing, meaning another
![Page 21: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/21.jpg)
This car is a lemon.
If you do that, you’ll be sorry.
If I were you, I’d hate myself.
![Page 22: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/22.jpg)
The Voringian Binx glorphed the Knappaboor.
![Page 23: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/23.jpg)
Language really is different
![Page 24: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/24.jpg)
A language organ in the brain?
![Page 25: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/25.jpg)
Brain of Leborgne - Left Hemisphere
![Page 26: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/26.jpg)
![Page 27: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/27.jpg)
![Page 28: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/28.jpg)
Moses, 1999
![Page 29: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/29.jpg)
Nichelli et al. (1994).
Brain regions that are active in expert chess players during the end game of chess
![Page 30: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/30.jpg)
MENTAL ROTATION: Imagining the Movement of an Object
010002000300040005000
40 80 120 160Angle of Rotation from Vertical (degrees)
Res
pons
e Ti
me
(ms)
SAME
MIRROR
SAME
The mental rotation task
![Page 31: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/31.jpg)
Mental Rotation FMRI Data Ark, Haist, & Stiles (in prep)
R R L L
Parietal Lobe • Visual attention • Visual memory • Image generation • Spatial
manipulation
Fusiform Gyrus - Object Recognition
Area MT • Perception of motion
![Page 32: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/32.jpg)
Brain areas that process environmental sounds
Dick, Saygin, Galati, Pitzalis, Bentrovato, D’Amico, Wilson, Bates, Pizzamiglio (in revision)
![Page 33: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/33.jpg)
Brain areas that process language
Dick, Saygin, Galati, Pitzalis, Bentrovato, D’Amico, Wilson, Bates, Pizzamiglio (in revision)
![Page 34: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/34.jpg)
Hauk, Johnsrude, Pulvermuller (2004)
![Page 35: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/35.jpg)
Our brains are opportunistic
![Page 36: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/36.jpg)
Our brains are integrative
![Page 37: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/37.jpg)
Hearing (speech) alone Seeing (lips) alone
Hearing (speech) & Seeing (lips) together
![Page 38: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/38.jpg)
• The left hemisphere • Many more regions
involved
![Page 39: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/39.jpg)
A gene for language?
![Page 40: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/40.jpg)
![Page 41: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/41.jpg)
![Page 42: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/42.jpg)
![Page 43: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/43.jpg)
pyramidal cells
mossy cells
muscle cells
sperm cells Purkinje cell
![Page 44: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/44.jpg)
![Page 45: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/45.jpg)
![Page 46: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/46.jpg)
![Page 47: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/47.jpg)
A gene for language?
![Page 48: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/48.jpg)
3 generations 30 family members 15 afflicted members
The KE family
![Page 49: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/49.jpg)
![Page 50: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/50.jpg)
FOXp2
![Page 51: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/51.jpg)
Human FOXp2
Mouse FOXp2
nearly identical!!
![Page 52: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/52.jpg)
BASAL GANGLIA
![Page 53: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/53.jpg)
Language depends on rapid and complex vocal movements
Chimpanzees cannot voluntarily control vocalizations
A very small change in FOXp2 makes this possible
![Page 54: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/54.jpg)
Small changes can lead to big differences
![Page 55: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/55.jpg)
A new machine built out of old parts
![Page 56: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/56.jpg)
Brain areas that process environmental sounds
Dick, Saygin, Galati, Pitzalis, Bentrovato, D’Amico, Wilson, Bates, Pizzamiglio (in revision)
![Page 57: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/57.jpg)
Brain areas that process language
Dick, Saygin, Galati, Pitzalis, Bentrovato, D’Amico, Wilson, Bates, Pizzamiglio (in revision)
![Page 58: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/58.jpg)
The connections really matter
![Page 59: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/59.jpg)
Coronal section of brain (looking forward)
![Page 60: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/60.jpg)
Scanning the brain of Leborgne – Nina Dronkers
![Page 61: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/61.jpg)
Superior longitudinal fasciculus
![Page 62: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/62.jpg)
Superior longitudinal fasciculus of Leborgne
Right Hemisphere Left Hemisphere
![Page 63: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/63.jpg)
Other things matter, too
![Page 64: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/64.jpg)
![Page 65: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/65.jpg)
![Page 66: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/66.jpg)
![Page 67: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/67.jpg)
Anterior
Redcay, Haist, & Courchesne (submitted)
Posterior
Right Left
![Page 68: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/68.jpg)
Development:
The importance of starting small
![Page 69: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/69.jpg)
Putting it all together. . .
![Page 70: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/70.jpg)
bonobo macaque human song bird termite
Control over respiration
Control over articulators
Sequencing
Memory
Sociability
Auditory processing
Imitation
Predictive learning
Lang
uage
is p
ossi
ble
![Page 71: Language and the human brain - University of California ... · Language and the human brain Jeff Elman Department of Cognitive Science University of California, San Diego. ... articulators](https://reader034.vdocument.in/reader034/viewer/2022042308/5ed557b0cfcb033b55255e2b/html5/thumbnails/71.jpg)
Thank you