![Page 1: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/1.jpg)
Vector Symbolic Architectures: Constructions in the Brain
Simon D. LevyWashington & Lee University
Lexington, Virginia, USA
Ross GaylerBaycorp Advantage Value Solutions /
LaTrobe UniversityMelbourne, Australia
![Page 2: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/2.jpg)
The Appeal of Connectionism(Rumelhart &
McClelland 1986)
![Page 3: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/3.jpg)
WALK
WALKED
![Page 4: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/4.jpg)
ROAR
ROARED
![Page 5: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/5.jpg)
SPEAK
SPOKE
![Page 6: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/6.jpg)
GO
WENT
![Page 7: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/7.jpg)
ignores(mary, john)
Mary won’t give John the time of day.
![Page 8: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/8.jpg)
Language Isn’t (Just)
Association: Jackendoff’s
Four Challenges for
Cognitive Neuroscience
![Page 9: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/9.jpg)
Challenge I: The Binding Problem
+
? ? ? ?
![Page 10: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/10.jpg)
Solution? Local Representations
![Page 11: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/11.jpg)
Local Representations
![Page 12: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/12.jpg)
Challenge II: The Problem of Two
?
![Page 13: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/13.jpg)
Challenge III: The Problem of Variables
Challenge IV: Working Memory vs. Long-Term Memory
ignores(X, Y)
X won’t give Y the time of day.
![Page 14: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/14.jpg)
Vector Symbolic Architectures
(Plate 1991; Kanerva 1994; Gayler 1998)
![Page 15: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/15.jpg)
Binding
![Page 16: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/16.jpg)
Binding
![Page 17: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/17.jpg)
Bundling
+ =
![Page 18: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/18.jpg)
Unbinding (query)
![Page 19: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/19.jpg)
Reduction
![Page 20: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/20.jpg)
Composition / Recursion
![Page 21: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/21.jpg)
Variables
X
john
![Page 22: Vector Symbolic Architectures: Constructions in the Brain Simon D. Levy Washington Lee University Lexington, Virginia, USA Ross Gayler Baycorp Advantage](https://reader035.vdocument.in/reader035/viewer/2022062401/5a4d1b687f8b9ab0599b1ef7/html5/thumbnails/22.jpg)
Conclusions / Future Work
•VSAs address Jackendoff’s first three challenges
•Can be implemented as spiking neurons (Eliasmith 2004)
•Remaining challenge: constructions (long-term memory) to map from conceptual structure (working memory) to symbol sequences