modeling in psychology: what’s the point? robert m. french l.e.a.d. – cnrs u. de bourgogne
TRANSCRIPT
![Page 1: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/1.jpg)
Modeling in psychology:What’s the point?
Robert M. French
L.E.A.D. – CNRS
U. de Bourgogne
![Page 2: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/2.jpg)
What do we mean by a “model”
The reduction of a phenomenon to its essential elements as a means of explaining it.
![Page 3: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/3.jpg)
A good model must:
• Reproduce, at least qualitatively, the existing empirical data.
• Be falsifiable.
• Explain this data.
• Make predictions that go beyond the existing data.
• Clearly indicate its context of application (i.e., its level of explanation).
• Be able to be probed in order to how its mechanisms produce the phenomena being modeled and to understand the limits of the model.
![Page 4: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/4.jpg)
A probabilistic model/theory of the world
Theory of the WorldAssume that past experience shows that an event A is as frequent as an event B. But suppose that for a period of time, we have only seen event A. We conclude that event B should become more likely until event B “catches up” to event A.
For example, suppose we get the following sequence of heads and tails:
Despite our naive theory: p(H) = ½, p(T) = ½
H T T T T H H H H T H H H T T T T T T ?
![Page 5: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/5.jpg)
A little more complicated…
goat goat car
![Page 6: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/6.jpg)
The host of a TV game show puts a goat behind two of the doors and the new car behind the other.
1 2 3
He picks a volunteer from the audience and explains that there are goats behind two of the doors and a new car behind the other door. He invites the volunteer to pick a door.
![Page 7: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/7.jpg)
3
The volunteer picks Door No. 3.
1 2
![Page 8: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/8.jpg)
31
The television host then opens Door No. 2, behind which is a goat.
2
![Page 9: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/9.jpg)
31
He asks the volunteer if he wants to change his choice to Door 1 or keep Door 3. He may keep whatever is behind the door of his final choice.
2
?
![Page 10: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/10.jpg)
31 2
?
He asks the volunteer if he wants to change his choice to Door 1 or keep Door 3. He may keep whatever is behind the door of his final choice.
![Page 11: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/11.jpg)
Our experience (probabilistic model of the world) tells us that when there are two options and we
don’t know the outcome of either, we choose at random.
In this case, this theory leads us to the wrong conclusion, because...
....WE MUST CHANGE DOORS !
![Page 12: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/12.jpg)
A probabilistic model of basketball: an explanation of the « hot hand ».
Thomas Gilovich, Robert Vallone, and Amos Tversky recorded every basket shot by players for the Philadelphia 76er’s during the 1980-81 season.
*Gilovich et al. (1985). The Hot Hand in Basketball. On the Misinterpretation of Random Sequences. Cognitive Psychology, 17, 295-314.
![Page 13: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/13.jpg)
Their model of success at scoring in basketball
Statistically, if each shot is modeled as an INDEPENDENT EVENT, the performance of a player can be modeled with a coined biased so that it reflects the seasonal shooting average of the player. Heads = basket made; tails = basket not made. According to this model, there is no such thing as a « hot hand ».
![Page 14: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/14.jpg)
0 1 1 0 1 1 1 0 1 1 0 1 0 0 0 0 0 1 1 0 0 0 1 1 1 1 0 0 1 1 1 1 0 0 1 0 0 0 1 0 0 1 0 0 1 1 0 0 0 0 1 0 0 0 1 1 1 1 1 1 0 1 1 1 1 1 1 1 0 0 1 0 0 0 1 0 0 0 1 0 1 1 0 0
1 1 1 1 1 0 0 0…
Pass me the ball, I’m HOT!
Warm up… Not great, not bad
Percentages of shots made: 55%
Simulated by a 55/45 biased coin and the voice of a basketball player….
1 = basket made; 0 = basket missed
![Page 15: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/15.jpg)
Some reactions
– There are so many variables involved in making a shot, that this study makes no sense. -- Bobby Knight, Indiana U.
– “Who is this guy? He does a study, so what? I don’t give a damn what he found. -- owner of the Boston Celtics
– “We once did a lot of sport. You tell ME what’s wrong here. It’s for you to explain, not for me to believe. -- my brother.
![Page 16: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/16.jpg)
Consider our criteria
• Reproduces, at least qualitatively, the empircal data
• Explains the data.
• Makes predictions
• Clearly indicates its context of application.
• Can be probed to discover its limits and to understand how its underlying mechanisms produce the effects being modeled.
• Is falsifiable.
NON
Conclusion: It’s a pretty good model of scoring in basketball.
![Page 17: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/17.jpg)
Models and Prediction
The Delphi Oracle predicts:An earthquake will level Athens in 8 days.
Migratory birds will fly to Africa a month early this year.
Sun spots will begin at the end of 2007 this year.
![Page 18: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/18.jpg)
Models and Prediction
The Black Box predicts:An earthquake will level Athens in 8 days.
Migratory birds will fly to Africa a month early this year.
Sun spots will begin at the end of 2007 this year.
The Black Box has no explanatory power and is, therefore, not a model
![Page 19: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/19.jpg)
A model of how the cock crows
• Reproduces, at least qualitatively, the empircal data
• Explains the data.
• Makes predictions
• Clearly indicates its context of application.
• Can be probed to discover its limits and to understand how its underlying mechanisms produce the effects being modeled.
• Is falsifiable.
![Page 20: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/20.jpg)
Let’s examine a little more closely the following three criteria
• Clearly indicates its context of application.
• Can be probed to discover its limits and to understand how its underlying mechanisms produce the effects being modeled.
• Is falsifiable.
![Page 21: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/21.jpg)
• Clearly indicates its context of application.
Without this, every model becomes false, simply by saying, « Well, it doesn’t explain this lower level. » Neuroscientists do this all the time: « Where are the GABA receptors in your model? » etc.
For this reason, you must specify the level at which your model is designed to explain things.
![Page 22: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/22.jpg)
• Can be probed to discover its limits and to understand how its underlying mechanisms produce the effects being modeled.
Without this, we cannot have the permanent and necessary interaction between the model and empirical data.
![Page 23: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/23.jpg)
• Is falsifiable
Astrology
Freudian psychoanalysis
Greek/Hindu/Western mythology.
All unfalsifiable!
Evolutionary psychology??
![Page 24: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/24.jpg)
Unfalsifiability
An interaction between a model and empirical data is necessary
BUT
It can lead – and too often does lead – to an unfalsifiable model.
![Page 25: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/25.jpg)
Boxology: The disease of cognitive modelers
![Page 26: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/26.jpg)
Originalmodel
New Data to explain
Phonological module
![Page 27: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/27.jpg)
OriginalModel
Phonological module
Pre-linguisticModule
New data to be explained
New data explained
![Page 28: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/28.jpg)
Visual-gusatorymodule
OriginalModel
Phonological module
Pre-linguisticModule
![Page 29: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/29.jpg)
But this can, and frequently does, lead to “rampant boxological cancer”….
![Page 30: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/30.jpg)
Originalmodel
![Page 31: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/31.jpg)
….and, once again, the system loses its explicative power and, along the way, also becomes unfalsifiable.
![Page 32: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/32.jpg)
Consider our criteria
• Reproduces, at least qualitatively, the empircal data
• Explains the data.
• Makes predictions
• Clearly indicates its context of application.
• Can be probed to discover its limits and to understand how its underlying mechanisms produce the effects being modeled.
• Is falsifiable.
???
MAYBE
NO
NO
NO
![Page 33: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/33.jpg)
Evolutionary Psychology
Falsifiable or not??
In its currently practiced form, the answer is (mostly) NO….
![Page 34: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/34.jpg)
Connectionist models
![Page 35: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/35.jpg)
What do cows drink?
Connectionism provides a “bottom-up” answer: MILK
COW MILK DRINK
These neurons are active even the network has never heard the word
MILK
![Page 36: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/36.jpg)
What do cows drink?
Symbolic AI gives a “top-down” answer
ISA(cow, mammal)
ISA(mammal, animal)
Rule 1: IF animal(X) AND thirst(X) THEN lacks_water(X)
IF lacks_water(X) THEN drink_water(X)
Conclusion: Cows drink WATER.
Rule 2:
![Page 37: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/37.jpg)
A good model of human cognition must be able to give both answers, according to the context in which it is asked
the question.
![Page 38: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/38.jpg)
We will be looking closely at a connectionist model of categorization in young infants.
![Page 39: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/39.jpg)
Connectionist model of Bilingual language learning(French, 1998; French & Jacquet, 2004)
BOY LIFTS TOY MAN SEES PEN GIRL PUSHES BALL BOY PUSHES BOOK FEMME SOULEVE STYLO FILLE PREND STYLO GARÇON TOUCHE LIVRE FEMME POUSSE BALLON FILLE SOULEVE JOUET WOMAN PUSHES TOY.... (Note: absence of markers between sentences and between languages.)
Input to the SRN: - Two “micro” languages, Alpha & Beta, 12 words each- An SVO grammar for each language- Unpredictable language switching
The network tries each time to predict the next element.
We do a cluster analysis of its internal (hidden-unit) representations after having seen 20,000 sentences.
Attempted Prediction
![Page 40: Modeling in psychology: What’s the point? Robert M. French L.E.A.D. – CNRS U. de Bourgogne](https://reader036.vdocument.in/reader036/viewer/2022062308/56649e885503460f94b8ceb6/html5/thumbnails/40.jpg)
A model is the reduction of a phenomenon (or set of phenomena) to its essential elements as a means of explaining it. It must:
Summary
• Reproduce, at least qualitatively, the existing empirical data.
• Be falsifiable.
• Explain this data.
• Make predictions that go beyond the existing data.
• Clearly indicate its context of application (i.e., its level of explanation).
• Be able to be probed in order to how its mechanisms produce the phenomena being modeled and to understand the limits of the model.