mapping electric fields with fish and robots: how weakly electric … · 2019. 8. 7. · model...
TRANSCRIPT
![Page 1: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/1.jpg)
Brian Rasnow, Ph.D. 12 April 2007
Mapping electric fields
with fish and robots:
How weakly electric fish may
perceive their environment
![Page 2: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/2.jpg)
Outline
Why study electric fish? How does electric sense work?
Superficially and quantitatively
Can we generalize these lessons? Understand how other sensory and motor systems work Engineer useful systems on these principles
![Page 3: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/3.jpg)
How do our brains work?
In our heads is an internal reality that models the external world
The internal reality is built from genetics and our senses (“nature and nurture”)
Our brains do a great job of this, but they reveal little about the underlying biophysics and neural computation to our consciousness
![Page 4: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/4.jpg)
How do brains process sensory information?
We don’t know. Around 1960 a graduate student was given a video
camera and computer and a thesis goal to connect them and program the computer to see
About a year ago an autonomous vehicle drove ~150 miles through the desert The winning car didn’t rely primarily on vision
Our best computers and robots don’t come close to the sensorimotor capabilities of a cockroach We don’t understand the biological paradigm
![Page 5: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/5.jpg)
![Page 6: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/6.jpg)
Electrolocation and electrocommunication
![Page 7: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/7.jpg)
Time and frequency domains
![Page 8: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/8.jpg)
Most neural structures and circuits are highly conserved throughout evolution
Species mainly differ in relative size and elaboration of the same basic structures
Attractors?
Evolution of brains
![Page 9: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/9.jpg)
What does the cerebellum do?
An ancient neural circuit Simpler than cortex, few cell types Highly conserved over time “crystalline” structure
The cerebellum inputs, outputs, and computation (transfer function) are all poorly understood
![Page 10: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/10.jpg)
Electric fish have huge cerebellums!
Electroreceptors in the fish’s skin detect local transdermal electric fields and transmit the sensory information to the electrosensory lateral line lobe (ELL)
The ELL (and DCN) have many similarities to cerebellum
![Page 11: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/11.jpg)
Model systems
Electric fish are model systems for sensorimotor integration Sensory receptors are relatively accessible on the skin Their electric organ discharge (EOD) is both an output and an
input that is easily and noninvasively monitored Many other practical reasons make these fish easier to study
Simpler organisms highlight principles of biology, chemistry, physics, and computation that generally are conserved in higher organisms
![Page 12: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/12.jpg)
![Page 13: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/13.jpg)
Measuring electrosensory input
![Page 14: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/14.jpg)
Robotic electric field mapper
![Page 15: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/15.jpg)
After extensive electronic and software engineering and development of protocols and methods, I achieved ~200 nV resolution, <1 µsec phase jitter, electrode position uncertainty <20 µm, and the ability to record millions of voltages from thousands of positions around a fish in a few hours
![Page 16: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/16.jpg)
At the time (phase) indicated by the vertical line, voltages are interpolated between measurement points and displayed in pseudocolor
Multiple
Pseudocolor midplane maps of a wave EOD
![Page 17: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/17.jpg)
These pseudocolor potential maps result from millions of automated measurements of the fish’s electric organ discharge (EOD)
The maps enable modeling electrosensory input to ELL
Correlating the input with known neuroanatomy and physiology enabled me to propose a neurocomputational model of electrolocation
Note: the actual EOD is 10,000 times faster than this movie
Mapping and visualizing the EOD
![Page 18: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/18.jpg)
Fig. 7. A The outline of the unperturbed electric field vector at a point where the perturbation of a 1 cm radius conducting sphere is simulated. The potential perturbation (B) and the perturbation of the lateral electric field (C) at the skin at the four EOD phases denoted by arrows in A. Even when the electric field at the object is nearly tangential to the skin (phase 1), the perturbations are finite, and in the locations shown by arrows, exceed the perturbations of the other phases. D Vector representation of the electric field perturbation during the same four phases of the EOD.
![Page 19: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/19.jpg)
The fish’s electrosensory world
The tedious path of self-education with a new model system ultimately revealed a complex electrosensory world, rich in spatiotemporal structure, that others had largely overlooked
Electric fish have also provided a much better understanding of what cerebellum does
![Page 20: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/20.jpg)
![Page 21: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/21.jpg)
Of brains and robots
Autonomous dynamic systems include complex hierarchies and loops of components
Components communicate using diverse protocols, symbols, and semantics Abstraction at successive levels simplify the signals but the
representations become more complex to parse (e.g., a toral neuron may respond unambiguously to object distance)
Biological systems … Rely more on feedback and feedforward than hierarchies Mix computation and communication
As lab automation matures and increases robustness and adaptability, it becomes more dimensionally complex
Machines, neural networks, and genetic networks likely exhibit universality at some scale
![Page 22: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/22.jpg)
FEM simulations of objects
![Page 23: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/23.jpg)
mV R
MS
10-3
10-2
10-1
100
100 101
o oooooooo o o ooo o o oo
+++++++++ + ++++ ++
++
skin to object center (cm)
o, +simulatedmeasured
10-3
10-2
10-1
100
mV R
MS
100 101
o oooooooo o o oooo
o oo
+++++++++ + +++++
++
+
. . . . ..... . . . . . . . . .
skin to object center (cm)
100 101
o oooooooo oo ooo
o oo
o
+++++++++ + ++++ ++
++
skin to object center (cm)0 101
o oooooooo o o oooo o o
o
skin to object center (cm)10
Perturbation Amplitudes
![Page 24: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/24.jpg)
00.1
0.2
0.3
0.4
0 1 2 3 4
+
+
+
+
+
++
++
+
+ ++ + +
+ + + + +
distance from head (cm)
! mV
RMS
+, o
0
0.1
0.2
0.3
4 6 8 10distance from head (cm)
0
0.2
0.4
0.6
10 12 14distance from head (cm)
! mV
RMS
00.20.40.60.8
1
14 16 18 20distance from head (cm)
...
. ....
..............................................................................
A. B.
C. D.....
...
.............................................................. .......................................................
measuredsimulated
o
o
o
oo
oo
oo o
o oo o
o
o o o oo
...............
Midline Electric Images
![Page 25: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/25.jpg)
![Page 26: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/26.jpg)
![Page 27: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/27.jpg)
Electrosensory architecture
Summary of the proposed mapping between sets of electric image (sensory) features and object (physical) attributes.
Where and how in the fish’s brain might these computations take place?
![Page 28: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/28.jpg)
Rasnow B, Bower JM (1997) Imaging with Electricity: How Weakly Electric Fish Might Perceive Objects. Computational Neuroscience: Trends in Research. Bower JM (ed) Plenum, New York, pp 795-800.
1. Object image = sensory input minus expectation
Expectation of sensory reafference
2. Image size = Object image convolved with center-surround receptive fields
3. Object distance (and image size) ∝∫ ELL activity, computed in the convergent projections to the TS
Proposed Neural implementation 4. Object size, shape, and higher
order features computed in the torus, tectum, and higher areas
![Page 29: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/29.jpg)
Summary
The engineering and math underlying biological paradigms for perception are largely unknown
Electroreception is a powerful model system for studying and elucidating sensory-motor algorithms The neural inputs and outputs are electric fields in water, and
are relatively easy to noninvasively measure and simulate The physics and math underlying bioelectric fields are fully
understood (Maxwell’s Equations, electrostatics) Our lack of innate intuition may actually help rather than
hinder our ability to discover and understand the neurocomputational algorithms
![Page 30: Mapping electric fields with fish and robots: How weakly electric … · 2019. 8. 7. · Model systems Electric fish are model systems for sensorimotor integration Sensory receptors](https://reader035.vdocument.in/reader035/viewer/2022081615/5fe0b45f5d04f70aac2f8130/html5/thumbnails/30.jpg)
Summary
Mapping and modeling electric images has led to testable predictions of neurophysiological responses in various electrosensory areas of the fish’s brain Future measurements of these responses should lead to
construction of more accurate models, thus bootstrapping a better understanding of the electrosensory system, and general principles of neural computation.