models in neuroscience

34
Models in neuroscience

Upload: others

Post on 01-Oct-2021

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Models in neuroscience

Models in neuroscience

Page 2: Models in neuroscience

Lee, Rohrer & Sparks 1988:

population coding of saccades in SC

Gunnar

July 30, 2018CoSMo 2018 - G. Blohm2

Page 3: Models in neuroscience

population coding of saccades in SC

July 30, 2018CoSMo 2018 - G. Blohm3

Lidocaine

inactivation

Page 4: Models in neuroscience

Andy Ruina’s passive walkers

(e.g. Collins & Ruina, 2005)

Konrad

July 30, 2018CoSMo 2018 - G. Blohm4

Page 5: Models in neuroscience

https://www.youtube.com/watch?v=-

nh4EPmGlEE&feature=youtu.be

July 30, 2018CoSMo 2018 - G. Blohm5

Page 6: Models in neuroscience

Zipser & Andersen 1988: Gain

fields

Gunnar

July 30, 2018CoSMo 2018 - G. Blohm6

Page 7: Models in neuroscience

Gain modulation

July 30, 2018CoSMo 2018 - G. Blohm7

= change of receptive field strength with secondary input

E.g. eye position gain modulation of visual receptive fields in

posterior parietal cortex

Blohm, Khan, Crawford, 2009 (adapted from Andersen, et al., 1985)

Page 8: Models in neuroscience

Gain modulation

July 30, 2018CoSMo 2018 - G. Blohm8

Reference frame transformations

Zipser & Andersen, Nature 1988Eye position gain modulation

of hidden layer units

Page 9: Models in neuroscience

Gain modulation

July 30, 2018CoSMo 2018 - G. Blohm9

Powerful computational means for

Cue combination

Reference frame transformations

Multi-sensory integration...

Blohm & Crawford, 2009

Page 10: Models in neuroscience

Mnih et al., 2013: Deep learning

for playing games

Konrad

July 30, 2018CoSMo 2018 - G. Blohm10

Page 11: Models in neuroscience

Deep reinforcement learning for games

July 30, 2018CoSMo 2018 - G. Blohm11

https://arxiv.org/pdf/1312.5602.pdf

Page 12: Models in neuroscience

Standage & Pare 2011: biophysical

model of decisions and WM

Gunnar

July 30, 2018CoSMo 2018 - G. Blohm12

Page 13: Models in neuroscience

Biophysical model of decisions and WM

July 30, 2018CoSMo 2018 - G. Blohm13

Page 14: Models in neuroscience

Biophysical model of decisions and WM

July 30, 2018CoSMo 2018 - G. Blohm14

Page 15: Models in neuroscience

Vilares & Kording 2017:

dopamine represents uncertainty

Konrad

July 30, 2018CoSMo 2018 - G. Blohm15

Page 16: Models in neuroscience

Dopamine represents uncertainty

July 30, 2018CoSMo 2018 - G. Blohm16

Page 17: Models in neuroscience

Dopamine represents uncertainty

July 30, 2018CoSMo 2018 - G. Blohm17

Page 18: Models in neuroscience

Todorov & Jordan 2002: Optimal

feedback movement control

Gunnar

July 30, 2018CoSMo 2018 - G. Blohm18

Page 19: Models in neuroscience

Motor planning & control

July 30, 2018CoSMo 2018 - G. Blohm19

Motor planning is the result of all previous steps…

Sensory processing

Transformations & multi-sensory integration

Target selection & decision making

Motor control

Execution of the motor plan…

Task Selection (Reaching)

Target Position

Initial Arm Position

Nominal Speed

Scott, 2004

Page 20: Models in neuroscience

Optimal feedback control

July 30, 2018CoSMo 2018 - G. Blohm20

( 1) ( ) ( ) ( )

( ) ( ) ( )

1( ) ( ) ( ) ( 1) ( 1) ( 1)

0

( ) ( ) ( )

( 1) ( ) ( ) ( ) ( ) ( )

ˆ

ˆ ˆ ˆˆ ˆ ˆ

k k k ku

k k ky

pk T k k k T k k

k

k k k

k k k k k k

A C

B

J L T

G

A AK C

x x u ε

y x ε

u u y y

u x

x x y y u

motor noise

sensory noise

Sensory state of our body and the world we interact with

What we can observe about the state

Cost to minimize

Feedback control policy

Belief about state

motor command

Predicted sensory consequences

Measured sensory consequences

Page 21: Models in neuroscience

Optimal feedback control

July 30, 2018CoSMo 2018 - G. Blohm21

Example: tennis

Optimal control reproduces backward swing

Torodov & Jordan, 2002

Page 22: Models in neuroscience

Nichols & Houk 1976: stretch

reflex simplifies feedback control

Konrad

July 30, 2018CoSMo 2018 - G. Blohm22

Page 23: Models in neuroscience

Stretch reflex simplifies feedback control

July 30, 2018CoSMo 2018 - G. Blohm23

Page 24: Models in neuroscience

More models…

July 30, 2018CoSMo 2018 - G. Blohm24

Page 25: Models in neuroscience

Daye et al. 2014: hierarchical

control of eye-head saccades

July 30, 2018CoSMo 2018 - G. Blohm25

Page 26: Models in neuroscience

Hierarchical control

July 30, 2018CoSMo 2018 - G. Blohm26

Eye-head Saccades

Endpoint control

Vs. trajectory control

Head motion =

perturbation to gaze goal

Daye, Optican, Blohm, Lefèvre (2014)

Page 27: Models in neuroscience

Izhiekevich & Edelman 2008:

rhythms in thalamocortical model

July 30, 2018CoSMo 2018 - G. Blohm27

Page 28: Models in neuroscience

Emergent rhythms in thalamocortical model

July 30, 2018CoSMo 2018 - G. Blohm28

Izhikevich & Edelman PNAS (2008)

Page 29: Models in neuroscience

Mazurek etal. 2003: drift

diffusion modelling

July 30, 2018CoSMo 2018 - G. Blohm29

Page 30: Models in neuroscience

Diffusion models for decision making

July 30, 2018CoSMo 2018 - G. Blohm30

Example: left-right decisions

Integrated decision model (Mazurek, et al. 2003)

Page 31: Models in neuroscience

Ma et al. 2006: Multi-sensory

integration in PPC

July 30, 2018CoSMo 2018 - G. Blohm31

Page 32: Models in neuroscience

Bayesian multi-sensory integration

July 30, 2018CoSMo 2018 - G. Blohm32

Cue combination

Optimal Bayesian observer

Independent observations A, V

If uniform priors, then

The brain always uses all available useful information.

Information from different sources is combined in a statistically optimal fashion

likelih

ood )|( XVp

)|( XAp

)|,( XVAp

),(

)()|,(),|(

VAp

XpXVApVAXp

)|()|()|,( XApXVpXVAp

)|()|(

),|(

XApXVp

VAXp

Page 33: Models in neuroscience

Bayesian computations in population codes

July 30, 2018CoSMo 2018 - G. Blohm33

Representing uncertainty with population codes

Probabilistic population codes

Poisson-like neural noise

Variance inversely

related to gains of

population code

Ma et al. (2006)

Page 34: Models in neuroscience

That’s all folks!

July 30, 2018CoSMo 2018 - G. Blohm34