learning, development and plasticity josh tenenbaum mit department of brain and cognitive sciences
DESCRIPTION
Learning, development and plasticity Josh Tenenbaum MIT Department of Brain and Cognitive Sciences Computer Science and AI Lab (CSAIL). Can we develop an integrated theory of learning, in computational, behavioral and neural terms?. The “standard model”. Supervised. Unsupervised. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Learning, development and plasticity Josh Tenenbaum MIT Department of Brain and Cognitive Sciences](https://reader035.vdocument.in/reader035/viewer/2022062816/568155f4550346895dc3b8c2/html5/thumbnails/1.jpg)
Learning, development and plasticity
Josh TenenbaumMIT
Department of Brain and Cognitive SciencesComputer Science and AI Lab (CSAIL)
![Page 2: Learning, development and plasticity Josh Tenenbaum MIT Department of Brain and Cognitive Sciences](https://reader035.vdocument.in/reader035/viewer/2022062816/568155f4550346895dc3b8c2/html5/thumbnails/2.jpg)
Can we develop an integrated theory of learning, in computational, behavioral and neural terms?
• The “standard model”
t
n
ttt
n
ttt
xxwywEw
xwyE
1
1
2
)(
)(21
t
n
tt
n
t
n
ttt
xywEw
xwyE
1
1 1
22 )(21
21
Sup
ervi
sed
Uns
uper
vise
d
![Page 3: Learning, development and plasticity Josh Tenenbaum MIT Department of Brain and Cognitive Sciences](https://reader035.vdocument.in/reader035/viewer/2022062816/568155f4550346895dc3b8c2/html5/thumbnails/3.jpg)
amF
The really hard problems
![Page 4: Learning, development and plasticity Josh Tenenbaum MIT Department of Brain and Cognitive Sciences](https://reader035.vdocument.in/reader035/viewer/2022062816/568155f4550346895dc3b8c2/html5/thumbnails/4.jpg)
The two cultures
“Nurture”Statistical learning, plasticityGrounded in the brain
“Nature”Innate structured representationsGrounded in cognition
versus
![Page 5: Learning, development and plasticity Josh Tenenbaum MIT Department of Brain and Cognitive Sciences](https://reader035.vdocument.in/reader035/viewer/2022062816/568155f4550346895dc3b8c2/html5/thumbnails/5.jpg)
Recent causes for optimism• New models from machine learning, AI
– Structured statistical modelsProbabilities defined over structured representations: graphs,
causal networks, grammars, predicate logic.
– Multilevel (hierarchical) statistical modelsInference at multiple levels of abstraction and multiple
timescales.
– Flexible statistical modelsHypothesis spaces grow as new data are encountered.
• New technologies – “Supercomputers” on the desktop, grid computing– Life-size datasets for modeling cognitive development– Mainstream functional MRI
![Page 6: Learning, development and plasticity Josh Tenenbaum MIT Department of Brain and Cognitive Sciences](https://reader035.vdocument.in/reader035/viewer/2022062816/568155f4550346895dc3b8c2/html5/thumbnails/6.jpg)
Phrase structure
Utterance
Speech signal
Grammar
“Universal Grammar” Hierarchical phrase structure grammars (e.g., CFG, HPSG, TAG)
P(phrase structure | grammar)
P(utterance | phrase structure)
P(speech | utterance)
P(grammar | UG)
Left IFG
VerbVPNPVPVP
VNPRelRelClauseRelClauseNounAdjDetNP
VPNPS
][][][
![Page 7: Learning, development and plasticity Josh Tenenbaum MIT Department of Brain and Cognitive Sciences](https://reader035.vdocument.in/reader035/viewer/2022062816/568155f4550346895dc3b8c2/html5/thumbnails/7.jpg)
Probabilistic scene parsing
1 2
1 2
t=0
t=1
t=2
Dest=1
Dest=1
Dest=2
Dest=2
BLOG(Bayesian Logic)
![Page 8: Learning, development and plasticity Josh Tenenbaum MIT Department of Brain and Cognitive Sciences](https://reader035.vdocument.in/reader035/viewer/2022062816/568155f4550346895dc3b8c2/html5/thumbnails/8.jpg)
Probabilistic scene parsing
![Page 9: Learning, development and plasticity Josh Tenenbaum MIT Department of Brain and Cognitive Sciences](https://reader035.vdocument.in/reader035/viewer/2022062816/568155f4550346895dc3b8c2/html5/thumbnails/9.jpg)
Learning domain structures
F: form
S: structure
D: data
tree
mammal
Tree with objects at leaf nodes
plant
animal
living thing
P(structure | form)
P(data | structure)
mouse
gorilla
pine
palm
![Page 10: Learning, development and plasticity Josh Tenenbaum MIT Department of Brain and Cognitive Sciences](https://reader035.vdocument.in/reader035/viewer/2022062816/568155f4550346895dc3b8c2/html5/thumbnails/10.jpg)
Learning domain structures
![Page 11: Learning, development and plasticity Josh Tenenbaum MIT Department of Brain and Cognitive Sciences](https://reader035.vdocument.in/reader035/viewer/2022062816/568155f4550346895dc3b8c2/html5/thumbnails/11.jpg)
AbstractPrinciples
Structure
Data
Learning causal theories
![Page 12: Learning, development and plasticity Josh Tenenbaum MIT Department of Brain and Cognitive Sciences](https://reader035.vdocument.in/reader035/viewer/2022062816/568155f4550346895dc3b8c2/html5/thumbnails/12.jpg)
Learning regulatorymodules in genetics
Learning the lawsof magnetism
Causal learning with complementary “cortical” and
“hippocampal” networks
![Page 13: Learning, development and plasticity Josh Tenenbaum MIT Department of Brain and Cognitive Sciences](https://reader035.vdocument.in/reader035/viewer/2022062816/568155f4550346895dc3b8c2/html5/thumbnails/13.jpg)
Learning to act
Concepts learned:Clear, InhandTopstackAboveHeight…
Exploration vs. Exploitation
![Page 14: Learning, development and plasticity Josh Tenenbaum MIT Department of Brain and Cognitive Sciences](https://reader035.vdocument.in/reader035/viewer/2022062816/568155f4550346895dc3b8c2/html5/thumbnails/14.jpg)
Constraints Goals
Actions
Rational planning(PO)MDP
Understanding actions:goal inference
Model Predictions
Hum
an
judg
men
ts
![Page 15: Learning, development and plasticity Josh Tenenbaum MIT Department of Brain and Cognitive Sciences](https://reader035.vdocument.in/reader035/viewer/2022062816/568155f4550346895dc3b8c2/html5/thumbnails/15.jpg)
The grand challenge
Cognitive science of human learning
Design of artificial learning systems
Brain structures and mechanisms that support learning