colin mcdonnell learning · 2016-03-02 · learning the papers ... (for temporal learning?) neurons...
TRANSCRIPT
![Page 1: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/1.jpg)
LEARNINGCOLIN MCDONNELL
![Page 2: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/2.jpg)
LEARNING
THE PAPERS
▸ Innate attentional biases and associated effects
▸ Thalamocortical loops for prediction learning
▸ Method of comparing human classification capability to neural networks
how the brain learns
and vice versaand how it informs machine learning
with no pretensions of completeness
![Page 3: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/3.jpg)
LEARNING
▸ What is learning
▸ Neuroscience inspires machine learning
▸ Machine learning guides neuroscience
STRUCTURE OF TALK
![Page 4: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/4.jpg)
SOME DEFINITIONSwhat do I mean neuroscience? what do I mean ML?
LEARNING
Affective neuroscience Behavioral neuroscience
Cellular neuroscience Clinical neuroscience
Cognitive neuroscience Computational neuroscience
Cultural neuroscience Developmental neuroscience
Evolutionary neuroscience Molecular neuroscience
Neuroengineering Neuroethology Neuroheuristics Neuroimaging
Neuroinformatics Neurolinguistics
Neurophysics Neurophysiology Neuropsychology Paleoneurology
Social neuroscience Systems neuroscience
NEURAL NETWORKS
![Page 5: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/5.jpg)
WHAT IS LEARNING
▸ pattern recognition
▸ finding an efficient encoding
▸ discovering beneficial behavior based on past observations
▸ abstraction
▸ Australian or European?
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
![Page 6: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/6.jpg)
NEUROSCIENCE INSPIRES MACHINE LEARNING
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
![Page 7: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/7.jpg)
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
Hebbian learning
![Page 8: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/8.jpg)
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
spike timing dependent plasticity
404
![Page 9: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/9.jpg)
synaptic re-wiring
sort of a 404, but…
sparsity
winner-take-all learning
ReLU?
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
![Page 10: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/10.jpg)
many excitatory synapses (for temporal learning?)
neurons that remember window of past inputs/firings
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
![Page 11: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/11.jpg)
dendritic computation layers collapse to neurons mathematically equivalent
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
![Page 12: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/12.jpg)
reflection of action potential into input
dendrites
gradient learning
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
![Page 13: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/13.jpg)
molecular diffusion
neuromodulators neuropeptides nitrous oxide
message-passing networks
going smaller…WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
![Page 14: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/14.jpg)
retrograde chemical signaling reverse connections
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
![Page 15: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/15.jpg)
attractor circuitsshould arise organically…
(later: LeabraTI)
going bigger…WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
![Page 16: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/16.jpg)
communicating brain regions
top-down feedback [Ullman 2015]
basal ganglia for decisions
multi-sensory learning
404 eventually, interacting
networks:
deep reinforcement learning
variable binding
information routing
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
![Page 17: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/17.jpg)
innate biasesattention mechanisms
“feature weights”
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
![Page 18: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/18.jpg)
‣ bias network towards “mover events” ‣ first pass: ‣ high precision, low recall
‣ second pass: ‣ tracking/continuity ‣ body context
‣ third pass: ‣ gaze
‣ fourth pass ‣ mirroring ‣ own-hands
‣ comparison ‣ but was it necessary?
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
HANDS
POSEGAZE
![Page 19: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/19.jpg)
implicit labeling/ proto-concepts [Ullman 2012]
semi-supervised labeling
basins of attraction as reward signal generator
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
![Page 20: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/20.jpg)
MACHINE LEARNING GUIDES NEUROSCIENCE
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
supervised learningunsupervised learning
![Page 21: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/21.jpg)
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
supervised learning
![Page 22: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/22.jpg)
error-driven backpropagation
404?
problems ‣ requires transmission of exact
derivatives over distance ‣ neurons communicate through
(stochastic?) spikes ‣ temporal synchronicity ‣ what are the targets?
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
supervised learning
![Page 23: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/23.jpg)
derivative backpropagation
hyper polarization of dendrites
+ reverse action potential
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
supervised learningsupervised learning
![Page 24: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/24.jpg)
training epochs hippocampus-mediated replay
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
supervised learningsupervised learning
![Page 25: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/25.jpg)
momentum gradient descent plasticity modulation
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
supervised learningsupervised learning
![Page 26: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/26.jpg)
dropout stochastic models of neural spiking
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
supervised learningsupervised learning
![Page 27: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/27.jpg)
layer-by-layer training developmental drop-off in cortical plasticity
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
supervised learningsupervised learning
![Page 28: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/28.jpg)
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
unsupervised learning
![Page 29: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/29.jpg)
auto-encoders
404
layer-size bottleneck
lateral inhibition
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
unsupervised learning
![Page 30: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/30.jpg)
predictive learning
babies understand spatiotemporal coherence
thalamocortical loops! [O’Reilly 2014]
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
unsupervised learning
![Page 31: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/31.jpg)
prediction learning
babies understand spatiotemporal coherence
thalamocortical loops! [O’Reilly 2014]
WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO
unsupervised learning
![Page 32: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/32.jpg)
LEARNING
INTER-DISCIPLINE COMPARISONS
![Page 33: COLIN MCDONNELL LEARNING · 2016-03-02 · LEARNING THE PAPERS ... (for temporal learning?) neurons that remember window of past inputs/firings WHAT IS LEARNING > NEURO INSPIRES](https://reader034.vdocument.in/reader034/viewer/2022042211/5eb32ac6852e44321845e415/html5/thumbnails/33.jpg)
QUESTIONS