brain machine interfaces

16
Brain Machine Interfaces (BMI) Controlling “Robot” with “Mind” Wednesday 11 February 15

Upload: anshu-gupta

Post on 15-Apr-2017

147 views

Category:

Education


0 download

TRANSCRIPT

Page 1: brain machine interfaces

Brain Machine Interfaces (BMI)

Controlling “Robot” with “Mind”

Wednesday 11 February 15

Page 2: brain machine interfaces

Wednesday 11 February 15

Page 3: brain machine interfaces

Wednesday 11 February 15

Page 4: brain machine interfaces

Wednesday 11 February 15

Page 5: brain machine interfaces

From Theory to Practice

• In the early 1980s Apostolos P. Georgopoulos of Johns Hopkins University recorded the electrical activity of single motor-cortex neurons in macaque monkeys. He found that the nerve cell typically reacted most strongly when a monkey moved its arm in a certain direction. Yet when the arm moved at an angle away from a cell’s preferred direction, the neuron’s activity didn’t cease; it diminished in proportion to the cosine of that angle. The finding showed that motor neurons were broadly tuned to a range of motion and that the brain most likely relied on the collective activity of dispersed populations of single neurons to generate a motor command.

Wednesday 11 February 15

Page 6: brain machine interfaces

Wednesday 11 February 15

Page 7: brain machine interfaces

Wednesday 11 February 15

Page 8: brain machine interfaces

Belle, our tiny owl monkey, was seated in her special chair inside a soundproof chamber at our Duke University laboratory. Her right hand grasped a joystick as she watched a horizontal series of lights on a display panel. She knew that if a light suddenly shone and she moved the joystick left or right to correspond to its position, a dispenser would send a drop of fruit juice into her mouth. She loved to play this game. And she was good at it.

Wednesday 11 February 15

Page 9: brain machine interfaces

Wednesday 11 February 15

Page 10: brain machine interfaces

Wednesday 11 February 15

Page 11: brain machine interfaces

A BMI with multiple feedback loops being developed at the Duke University Center for Neuroengineering. A rhesus macaque is operating an artificial robotic manipulator that reaches and grasps different objects. The manipulator is equipped with touch, proximity and position sensors. Signals from the sensors are delivered to the control computer (right), which processes them and converts to microstimulation pulses delivered to the sensory areas in the brain of the monkey, to provide it with feedback information (red loop). A series of microstimulation pulses is illustrated in the inset on the left. Neuronal activity is recorded in multiple brain areas and translated to commands to the actuator, via the control computer and multiple decoding algorithms (blue loop). Arm position is monitored using an optical tracking system that tracks the position of several markers mounted on the arm (green loop). We hypothesize that continuous operation of this interface would lead to incorporation of the external actuator into the representation of the body in the brain. Figure designed by Nathan Fitzsimmons.

Wednesday 11 February 15

Page 12: brain machine interfaces

Wednesday 11 February 15

Page 13: brain machine interfaces

Figure: Classification of brain–machine interfaces. Abbreviations: BMI, brain machine interface; EEG, electroencephalogram; LFP, local field potential; M1, primary motor cortex; PP, posterior parietal cortex.

Wednesday 11 February 15

Page 14: brain machine interfaces

Wednesday 11 February 15

Page 15: brain machine interfaces

Wednesday 11 February 15

Page 16: brain machine interfaces

Wednesday 11 February 15