neural information in the visual system
DESCRIPTION
Neural Information in the Visual System. By Paul Ruvolo Bryn Mawr College Fall 2012. Questions to Explore for Today. How is visual information encoded and transmitted in the brain? What are the potential engineering applications of this understanding? - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/1.jpg)
Neural Information in the Visual System
ByPaul Ruvolo
Bryn Mawr CollegeFall 2012
![Page 2: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/2.jpg)
Questions to Explore for Today
• How is visual information encoded and transmitted in the brain?
• What are the potential engineering applications of this understanding?
• Are there underlying principles that explain this organization?
• What is the role of experience and learning in this organization?
![Page 3: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/3.jpg)
![Page 4: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/4.jpg)
![Page 5: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/5.jpg)
![Page 6: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/6.jpg)
The Human Eye
Blindspot: http://www.tedmontgomery.com/the_eye/optcnrve.html
![Page 7: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/7.jpg)
The Beginning of Visual Processing
![Page 8: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/8.jpg)
Retinal Ganglion Cells and Receptive Fields
+ ++
+
+
++
+
+
+-
--
-
-
-
-
Axon
To the brain
Receives input from photo receptors via Bipolar and Amacrine cells
![Page 9: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/9.jpg)
Retinal Ganglion Cells
Retina
Retinal Ganglion Cells are localized in the visual field
![Page 10: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/10.jpg)
Retinal Ganglion Cells
Add pixel brightness in the outer ring, subtract those in the inner ring.
The higher this number is the more spikes the cell will produce (rate coding).
Also involved in detecting color contrasts.
![Page 11: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/11.jpg)
Visual Perception
• From last time: “Perception of the world is constructed out of the raw data sent to the brain by sensory nerves.”
• In order to accurately perceive our visual world we need many retinal ganglion cells working together.
• Matlab demo: /Users/paul/tmp/doReconstruction.m
![Page 12: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/12.jpg)
Pathway to the Cortex
Information is relayed from the eye through the LGN (Lateral Geniculate Nucleus) located in the Thalamus.
The LGN can is in part a relay station from the eyes to the visual cortex..
Largely leaves the input from the Retinal Ganglion Cells unchanged.
![Page 13: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/13.jpg)
Optical Illusions (possibly based on Retinal Ganglion Cells)
![Page 14: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/14.jpg)
Potential Applications
![Page 15: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/15.jpg)
Primary Visual Cortex
• Receives input from LGN and begins the cortical processing of visual information in the brain
• Exhibits retinotopic mapping
![Page 16: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/16.jpg)
Hubel and Wiesel 1959
![Page 17: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/17.jpg)
Simple Cells
• Respond to oriented bars of light• Diffuse lighting does not produce a response• Question for the class: how might we form these
from inputs from the LGN?
+-
+-
-
![Page 18: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/18.jpg)
Hubel and Wiesel Experiment 2
![Page 19: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/19.jpg)
Complex Cell
• Respond to bars of a particular orientation regardless of position within the visual field
• Question for the class: how might we form a complex cell from individual simple cells?
![Page 20: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/20.jpg)
Higher Level Visual Areas
• V1 feeds to V2• V2 to V3 and so on• Each layer becomes a more abstract
representation of the original input• Somewhat controversial: grandmother cells
![Page 21: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/21.jpg)
Neurally Inspired Computer Vision
System architecture based on knowledge of neuroscience!
Serre, Wolf, and Poggio (2005).
![Page 22: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/22.jpg)
Neurally Inspired Computer Vision
![Page 23: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/23.jpg)
Cracking the Brain’s Visual Code
![Page 24: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/24.jpg)
Blakemore and Cooper (1970)
Watch video: http://www.youtube.com/watch?v=QzkMo45pcUo
![Page 25: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/25.jpg)
Barlow 1961
![Page 26: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/26.jpg)
The View from Shannonland
An Image that falls on the retina
Primary Visual Cortex
Optic Nerve to LGN
![Page 27: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/27.jpg)
Bell and Sejnowski 1997
![Page 28: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/28.jpg)
What is the Best Neural Code?Our goal is to choose the filters w such that the filtered image Y retains the most information about the input image X
We can maximize using using gradient ascent… The gradient simplifies to:
![Page 29: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/29.jpg)
A Special Case: 1 input 1 output
![Page 30: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/30.jpg)
What about 2 output units?
Redundancy
Generalization to N inputs and N outputs given in Bell and Sejnowski (1995).
![Page 31: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/31.jpg)
Learned Filters
![Page 32: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/32.jpg)
Spinoff Application: Solving the Cocktail Party Problem
• http://cnl.salk.edu/~tewon/Blind/blind_audio.html
• How might this be useful?
![Page 33: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/33.jpg)
Is vision completely learned?
Johnson, Dziurawiec, Ellis, and Morton (1989).
Goren, Sarty, and Wu (1975).
![Page 34: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/34.jpg)
Brief Aside About Auditory Coding
![Page 35: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/35.jpg)
Optimal Auditory Coding
![Page 36: Neural Information in the Visual System](https://reader035.vdocument.in/reader035/viewer/2022062310/56816675550346895dda10b5/html5/thumbnails/36.jpg)
Summary
• Sensory processing centers of the brain are some of the most well-understood parts of the neural code.
• Information theory gives us a theoretical framework to not only make predictions about the organization of the system but to answer the question of why the system is organized the way it is.