‘any neural or behavioural phenomenon implying storage e n ...cvrl.ioo.ucl.ac.uk/neur3001/lecture...

25
Long-term Memory Semantic: - multiple experience - association of features Episodic: - single experience - association with time/place Conscious / ‘Declarative’ Unconscious / ‘Procedural’ Systems of categorisation: Facial identity Facial expression Visual ‘events’ - ‘snapshots’ of scenes; - groupings of recognised items /people & place. Animal Mammal Dog Terrier ‘Scottie’ Colour - e.g. Jeremy Corbyn - e.g. Miley Cyrus - e.g. The Crimea - e.g. World Trade Centre Individual exemplars: Familiarity Recollection Visual Memory ‘Any neural or behavioural phenomenon implying storage of a past visual experience’. RECOGNITION Categories recall time/place imagery imagery non- visual cue no associations no context Encoding Retrieval Working Memory Short-term Memory Iconic Memory red ‘deja vu’ = episodic false familiarity photographic’ memory

Upload: others

Post on 13-Mar-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

Long-term Memory

Semantic: - multiple experience - association of features

Episodic: -  single experience -  association with time/place

Conscious / ‘Declarative’ Unconscious / ‘Procedural’

Systems of categorisation:

Facial identity

Facial expression

Visual ‘events’

- ‘snapshots’ of scenes;

-  groupings of recognised items /people & place.

Animal Mammal Dog Terrier ‘Scottie’

Colour

- e.g. Jeremy Corbyn

- e.g. Miley Cyrus

-  e.g. The Crimea

-  e.g. World Trade Centre

Individual exemplars:

Familiarity

Recollection

Visual Memory ‘Any neural or behavioural

phenomenon implying storage of a past visual experience’.

RECOGNITION

Categories

recall time/place imagery imagery non- visual cue

no associations no context

Encoding

RetrievalWorking Memory

Short-term Memory

Iconic Memory

red

‘deja vu’ = episodic false familiarity

‘photographic’ memory

Page 2: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

ML/MFpatches:Viewselec)veSubjectinspecificlatency=88msec

ALpatch:Viewsymmetricallatency=104msec

AMpatch:ViewinvariantSubjectspecificlatency=124msec

e.g.Friewald&Tsao(2010)Hierarchicalmodel[Ref3]

eyeheight eyesepara.on

mouthheightnoselength

e.g.Sigala&LogotheDs(2002)[Ref2]AreaTEneuronslearning‘facial’features

Parametric ‘face-space’: - eye height - eye separation - nose length - mouth height

Eyeheight

Eyesepara.o

n

MeanresponseofrecordedpopulaDon:besttypeofeachfeature:worsttypeofeachfeature:

The categorisation depends on two features only

SEMANTIC EPISODIC

X familiarity

recollec)on

e.g.Seman.cfamiliarity;learningindividualfaces

Page 3: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

Large stimulus set = 125

NOVEL V. FAMILIAR STIMULUS SETS

SEMANTIC EPISODIC

X familiarity

recollec)on

Areas TEO & TE - known together as ‘IT cortex’ (inferior temporal)

broad spike = excitatory neuron narrow spike = inhibitory neuron

Large stimulus set = 125

Woloszyn & Sheinberg (2012) [Ref4] Neural encoding of familiarity v novelty

Page 4: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

SEMANTIC EPISODIC

X familiarity

recollec)onbroad spike = excitatory neuron

narrow spike = inhibitory neuron

Familiar

Novel

Woloszyn & Sheinberg (2012) [Ref4] Neural encoding of familiarity v novelty

Page 5: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

SEMANTIC EPISODIC

X familiarity

recollec)onbroad spike = excitatory neurons

Familiar

Novel

narrow spike = inhibitory neurons

Neural population:

Average response to best stimulus

Average response to all stimuli

Neural population:

Average response to best stimulus

Average response to all stimuli

Woloszyn & Sheinberg (2012) [Ref4] Neural encoding of familiarity v novelty

Page 6: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

Naya, Miyashita et al. (2003-2010)Paired-associatetask–forma.onofvisual‘seman.c’memoryinmedialtemporallobe[refs 5-7]

Paired-associatetask:1.  Learnthespecificpairingsfor12pairsofunfamiliarcomplexpaHerns;2.  Observeasinglecues.mulus(anyoneofthe24items)e.g.item5’;3.  Recallassociateditem(item5);4.  Selectcorrectitemfromachoiceoftwo(e.g.5&8’).

Page 7: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

Area TE Inferotemporal cortex Area 36 Area 35 ECECEC Entorhinal cortex

}Perirhinal cortex

area 36 area TE

best cue stimulus

Paired associate of best cue stimulus

30

0

Firin

g ra

te

0 320 2320 cue delay

30

0

40

0

30

0

area 35 area 36

Pair coding

representation of cue-target pair

representation of cue-target pair

‘MEANING’

LATERAL

DORSALhc.

SEMANTIC EPISODIC

familiarity

X recollec)on

Naya, Miyashita et al. (2003-10)‘Paired-associatetask’–learningarbitraryassocia.ons[5-7]

0 2320 320

Pair recall

transient representation of cue object

… sustained recall of target object

‘MEANING’

longer latency; sustained activity

Page 8: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

bestcolourpairedassoc.colour

bestshape

pairedassoc.shape

colourpair}shapepair}

PAIRCODING

PAIRRECALL

Kasahara et al. (2011)[Ref 8] Colourorshapepairassociatestask

colour shape

n = 375 stimulus selective

pair coding

pair recall

colour 19% 11%

shape 30% 7.7%

colour shape Area 36

LATERAL MEDIAL

Page 9: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

‘remote learning’ = 8 weeks before scan ‘recent learning’ = 30 minutes before scan

Remote > Recent

Recent > Remote

Hippocampus

Anterior IT cortex

Average activation for group, n = 30

Yamashita, Miyashita et al. (2009) Memoryconsolida.oninITcortex(humanfMRI) [ref 9]

Subjects required to learn 2 sets of pairings:

Page 10: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

A B

TE A36 A35 Hippocampus

Pair associate recall – hypothetical neural mechanism

RECENTLEARNING

REMOTELEARNING(asobservedinhighlytrainedmacaques)

cue

visual representation

visual imagery

associate

cue

visual representation

visual imagery

associate

learntpair

Neuraltuning

itemA

itemB

A&B

Page 11: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

TE A36 A35 Hippocampus

ACHIEVESSELECTION

cue

choice

visual representation

visual imagery

A B Pair associate recall – hypothetical neural mechanism (including display)

learntpair

Page 12: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

Delay period activation:

FFA

PPA

cue probe

‘pair associate’ task

Ranganath et al. (2004) PairAssociaterecall(humanfMRI)[ref 10]

Task:

1. Pre scan: learn face-house pairs; 2. In scan: recall pair associate,

OR Perform match to sample task.

Delay period activation:

PPA

FFA

cue probe

‘match-to-sample’ task

FFA PPA PPA

PARAHIPPOCAMPALPLACEAREA

FUSIFORMFACEAREA

Pair associates task v. Match-to-sample task

Anterior Prefrontal Cortex

Hippocampus

Caudate Nucleus

10-4

p

10-3

Page 13: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

- left posterior hippocampus: ‘Jennifer Aniston’ cell

SEMANTIC EPISODIC

familiarity

X recollec)on

Quiroga et al. (2009) Single unit recordings from human: [ref 11]

Page 14: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

SEMANTIC EPISODIC

familiarity

X recollec)on

Quiroga et al. (2009) Single unit recordings from human entorhinal cortex: ‘Saddam Hussein’ cell [ref 11]

40 spike/sec 1 sec

Page 15: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

SEMANTIC EPISODIC

familiarity

X recollec)on

- left anterior hippocampus: ‘Oprah Winfrey’ cellQuiroga et al. (2009) Single unit recordings from human: [ref 11]

Page 16: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

- left amygdala: ‘Arne’ (one of the research team)

SEMANTIC EPISODIC

familiarity

X (X) recollec)on

Quiroga et al. (2009) Single unit recordings from human [ref 11]

40 spike/sec 1 sec

Page 17: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

Visual: (one picture only)

Visual: invariant (several pictures)

Auditory: vocal name

Visual: text name

Quiroga et al. (2009) Single unit recordings from human entorhinal cortex [ref 11]

Page 18: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

Thehippocampusformsthecurled-up,lateralrimofthecor.calsheet

Hippocampus

Amygdala

Hippocampallearning:-Arbitraryassocia.ons;-Mul.modal;-Oneshot;Allepisodicincharacter.

HippocampusisLa.nfor‘sea-horse’.

Page 19: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

Coronalbrainsec.oninnonhumanprimate(Macaquemonkey)

Hippocampus

Page 20: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

TheHippocampalLoop

Entorhinalcortex

Subiculum CA1

CA3

DentateGyrus

Page 21: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

Neocortex

Parahippocampal cortex

Perirhinal cortex

The hippocampal loop: circuitry

ERC=EntorhinalCortexDG=DentateGyrusCA=CornuAmmonisSub=Subiculum

Page 22: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

RamonyCajal(1911)‘Histologiedusystèmenerveuxdel'hommeetdesvertébrés’

The hippocampal loop: circuitry

RecurrentcollateralsofCA3pyramids

Page 23: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

An auto-association (or attractor) neural network theory of memory.

ENCODING

Hebb’sLaw:‘Cellsthatfiretogether,wiretogether’

CA3

SEMANTIC EPISODIC

familiarity

X recollec)on

Page 24: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

CA3

An auto-association (or attractor) neural network theory of memory.

RETRIEVAL

SEMANTIC EPISODIC

familiarity

X recollec)on

Page 25: ‘Any neural or behavioural phenomenon implying storage E n ...cvrl.ioo.ucl.ac.uk/neur3001/Lecture Notes/Shipp/Shipp Visual memory.pdf · Subject specific latency = 124 msec e.g

Memory

Semantic: - multiple experience - association of features

Episodic: -  single experience -  association with time/place

Conscious / ‘Declarative’ Unconscious / ‘Procedural’

Visual ‘events’

- ‘snapshots’ of scenes;

-  groupings of recognised items /people & place.

- e.g. Jeremy Corbyn

- e.g. Miley Cyrus

-  e.g. The Crimea

-  e.g. World Trade Centre

Individual exemplars:

Familiarity

Recollection

VISUAL MEMORY: Any neural or behavioural phenomenon implying storage of a past visual experience.

Visual Memory

RECOGNITION

no associations no context

‘photographic’ memory imagery imagery

Unconscious / ‘Procedural’

BasalGanglia

Semantic: - multiple experience - association of features

imagery

no associations

Inferotemporal&perirhinalcortex(&hippocampus) Episodic:

-  single experience -  association with time/place

recall time/place imagery

no context

Hippocampus(&MTL)

Systems of categorisation:

Facial identity

Facial expression

Animal Mammal Dog Terrier ‘Scottie’

Colour

Categories

red

Retrieval

non- visual cue

Working Memory

Short-term Memory

Iconic Memory

Encoding

‘deja vu’ = episodic false familiarity

‘photographic’ memory