neon: neuromorphic navigation with danna · example 15x15 danna network lidar 2 lidar 3 lidar 4...
TRANSCRIPT
![Page 1: NeoN: Neuromorphic Navigation with DANNA · Example 15x15 DANNA Network LIDAR 2 LIDAR 3 LIDAR 4 LIDAR 5 SWITCH 1 SWITCH 2 Left Motor FW Left Motor BW Right Motor BW Right Motor FW](https://reader030.vdocument.in/reader030/viewer/2022041116/5f2a53bde819e1522f4f6f51/html5/thumbnails/1.jpg)
NeoN: Neuromorphic Navigation with DANNA
J. Parker Mitchell, Grant Bruer, Mark E. Dean
![Page 2: NeoN: Neuromorphic Navigation with DANNA · Example 15x15 DANNA Network LIDAR 2 LIDAR 3 LIDAR 4 LIDAR 5 SWITCH 1 SWITCH 2 Left Motor FW Left Motor BW Right Motor BW Right Motor FW](https://reader030.vdocument.in/reader030/viewer/2022041116/5f2a53bde819e1522f4f6f51/html5/thumbnails/2.jpg)
Overview
● EECS Senior Design Project● Create roaming robot
○ Avoid obstacles○ Avoid ledges
● Design a physical framework for deploying DANNA
● Explore robotics control as a problem domain
![Page 3: NeoN: Neuromorphic Navigation with DANNA · Example 15x15 DANNA Network LIDAR 2 LIDAR 3 LIDAR 4 LIDAR 5 SWITCH 1 SWITCH 2 Left Motor FW Left Motor BW Right Motor BW Right Motor FW](https://reader030.vdocument.in/reader030/viewer/2022041116/5f2a53bde819e1522f4f6f51/html5/thumbnails/3.jpg)
Robot Design
● Tank style drivetrain● LIDAR mounted on servo● Limit switches● All computation through FPGA
30°30° 30°
30°
![Page 4: NeoN: Neuromorphic Navigation with DANNA · Example 15x15 DANNA Network LIDAR 2 LIDAR 3 LIDAR 4 LIDAR 5 SWITCH 1 SWITCH 2 Left Motor FW Left Motor BW Right Motor BW Right Motor FW](https://reader030.vdocument.in/reader030/viewer/2022041116/5f2a53bde819e1522f4f6f51/html5/thumbnails/4.jpg)
Network I/O
Lidar Reading (meters)
Fire Weight
LIDAR Fire Weight Conversion
● 9 Inputs○ 5 LIDAR readings○ 2 switches○ Bias○ Random
● 4 Outputs○ Left motor forward/backward○ Right motor forward/backward
![Page 5: NeoN: Neuromorphic Navigation with DANNA · Example 15x15 DANNA Network LIDAR 2 LIDAR 3 LIDAR 4 LIDAR 5 SWITCH 1 SWITCH 2 Left Motor FW Left Motor BW Right Motor BW Right Motor FW](https://reader030.vdocument.in/reader030/viewer/2022041116/5f2a53bde819e1522f4f6f51/html5/thumbnails/5.jpg)
Network I/ONeuronSynapseOutputInput
Legend
Example 15x15 DANNA Network
LIDAR 2
LIDAR 3
LIDAR 4LIDAR 5
SWITCH 1
SWITCH 2
Left Motor FWLeft Motor BW
Right Motor BWRight Motor FW
RANDOM
BIAS
LIDAR 1
![Page 6: NeoN: Neuromorphic Navigation with DANNA · Example 15x15 DANNA Network LIDAR 2 LIDAR 3 LIDAR 4 LIDAR 5 SWITCH 1 SWITCH 2 Left Motor FW Left Motor BW Right Motor BW Right Motor FW](https://reader030.vdocument.in/reader030/viewer/2022041116/5f2a53bde819e1522f4f6f51/html5/thumbnails/6.jpg)
Training● Train using evolutionary optimization (EO)● Simulate in an empty room, room with
obstacles, and table with obstacles● Score based on grid coverage● Penalize for critical failures
○ Hitting an obstacle○ Falling off ledge
Grid Coverage Example
![Page 8: NeoN: Neuromorphic Navigation with DANNA · Example 15x15 DANNA Network LIDAR 2 LIDAR 3 LIDAR 4 LIDAR 5 SWITCH 1 SWITCH 2 Left Motor FW Left Motor BW Right Motor BW Right Motor FW](https://reader030.vdocument.in/reader030/viewer/2022041116/5f2a53bde819e1522f4f6f51/html5/thumbnails/8.jpg)
Future Work
● DANNA with leaky IAF neurons● Nonsquare networks, input spacing● Optimized FPGA logic● Harder task
○ Target tracking○ Autonomous flying drone
● Implementation with mrDANNA
![Page 9: NeoN: Neuromorphic Navigation with DANNA · Example 15x15 DANNA Network LIDAR 2 LIDAR 3 LIDAR 4 LIDAR 5 SWITCH 1 SWITCH 2 Left Motor FW Left Motor BW Right Motor BW Right Motor FW](https://reader030.vdocument.in/reader030/viewer/2022041116/5f2a53bde819e1522f4f6f51/html5/thumbnails/9.jpg)
Any Questions?
Visit our website at neuromorphic.eecs.utk.edu