the reward factor in the control of action: a neurophysiological theory johan lauwereyns victoria...
TRANSCRIPT
![Page 1: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/1.jpg)
The Reward Factor in the Control of Action:
A Neurophysiological Theory
Johan LauwereynsVictoria University of Wellington,
New Zealand
![Page 2: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/2.jpg)
• How does the brain incorporate reward value in the control of action?
![Page 3: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/3.jpg)
• How does the brain incorporate reward value in the control of action?
• Studied in monkeys using saccadic eye movement tasks
with asymmetrical reward schedule
![Page 4: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/4.jpg)
Biased Saccade Task (BST)
![Page 5: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/5.jpg)
Biased Saccade Task (BST)
![Page 6: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/6.jpg)
Biased Saccade Task (BST)
![Page 7: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/7.jpg)
Biased Saccade Task (BST)
![Page 8: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/8.jpg)
Biased Saccade Task (BST)
![Page 9: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/9.jpg)
Biased Saccade Task (BST)
![Page 10: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/10.jpg)
Biased Saccade Task (BST)
Target position =
unpredictable
![Page 11: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/11.jpg)
Biased Saccade Task (BST)
Reward association = known
![Page 12: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/12.jpg)
Biased Saccade Task (BST)
![Page 13: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/13.jpg)
Biased Saccade Task (BST)
![Page 14: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/14.jpg)
Biased Saccade Task (BST)
![Page 15: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/15.jpg)
Biased Saccade Task (BST)
No escape!
![Page 16: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/16.jpg)
Biased Saccade Task (BST)
![Page 17: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/17.jpg)
Biased Saccade Task (BST)
![Page 18: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/18.jpg)
Biased Saccade Task (BST)
![Page 19: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/19.jpg)
![Page 20: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/20.jpg)
Saccade-related brain areas (macaque monkey)
FEF: frontal eye fieldSEF: supplementary eye fieldLIP: area LIP of parietal cortexCD: caudate nucleusSNr: substantia nigra pars reticulataSC: superior colliculusClbm: cerebellumSG: brainstem saccade generators
![Page 21: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/21.jpg)
DA neuron responds to Reward & Reward Predictor
![Page 22: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/22.jpg)
SignalNoise
Neuronal activity
Noise
Noise
Signal +
Signal +
![Page 23: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/23.jpg)
Improved discrimination
![Page 24: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/24.jpg)
Improved discrimination:Synergistic, multiplicative
• Sensory properties
• Non-linearly enhanced by reward
Response = Input * Reward Gain
Prefrontal cortex, parietal cortex
Superior colliculus
![Page 25: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/25.jpg)
General increase
![Page 26: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/26.jpg)
General increase:Prospective, additive
• Bias in anticipatory activity
• Linearly enhances sensory activity
Response = Input + Reward Bias
Prefrontal cortex, basal ganglia
Superior colliculus
![Page 27: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/27.jpg)
Improved discrimination & General increase
![Page 28: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/28.jpg)
Combination of both mechanisms
• Seen in all areas• Loops between FC, BG and SC• But most common in Superior Colliculus
Response = (Input * Reward Gain) + Reward Bias
On toward the oculomotor plant
![Page 29: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/29.jpg)
Dopamine
![Page 30: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/30.jpg)
DopamineExcitation
![Page 31: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/31.jpg)
DopamineExcitation
Disinhibition
![Page 32: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/32.jpg)
Synergistic,multiplicative
DopamineExcitation
Disinhibition
![Page 33: The Reward Factor in the Control of Action: A Neurophysiological Theory Johan Lauwereyns Victoria University of Wellington, New Zealand](https://reader036.vdocument.in/reader036/viewer/2022062408/56649f2b5503460f94c45dc7/html5/thumbnails/33.jpg)
Prospective, additive
Synergistic,multiplicative
DopamineExcitation
Disinhibition