make me think. a brief introduction to brain-computer interfaces
DESCRIPTION
A BRIEF INTRODUCTION TO THE BRAIN-COMPUTER INTERFACES A brain-computer interface (BCI) is a hardware and software system that allows brain activity alone to control computers or external devices. In this short talk, I will review the state-of-the-art of BCIs, looking at the different steps that form a brain-computer interface: signal acquisition, preprocessing or enhancement, feature extraction and classification and the control interface. We will discuss different BCI types their advantages, drawbacks, and latest advances, and we survey the numerous technologies reported so far (including commercially available devices). At the first part, I will introduce basics of the Brain functioning and will review the neuroimaging modalities used in the signal acquisition, each of which monitors a different functional brain activity such as electrical, magnetic or metabolic activity. Then, we will discuss different electrophysiological control signals that determine user intentions, which canTRANSCRIPT
![Page 1: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/1.jpg)
MAKE ME THINKA BRIEF INTRODUCTION TO THE
BRAIN-COMPUTER INTERFACES
Nikita LukianetsNeuroscience Researcher, SIGNALIFE
@nikiluk #BCI #WUD2013
![Page 2: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/2.jpg)
WHAT IS THE BRAIN-COMPUTER INTERFACE?
![Page 3: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/3.jpg)
system that permits neuronal
activity alone to communicate
with an external device“
![Page 4: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/4.jpg)
A BIT OF FASHION: CONCEPT IS NOT NEW
1929: Hans Berger discovers the EEG. Studies of brain diseases
1959: David H. Hubel and TorstenWiesel. Single neuron recordings to map the visual cortex
1967: The first record by multi-electrode arrays.
1998: Kennedy and Bakay, control of a cursor.
![Page 5: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/5.jpg)
Intention
(User Effort)
Raw signal
filtering
Signal
Features
Intent
Classification
Feature Extraction
Feedback Strategy
Use
r Tr
ain
ing
Ma
chin
e L
ea
rnin
g
BCI LOGICAL SCHEME
Envi
ronm
ent
![Page 6: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/6.jpg)
FREQUENCIES
1-4 4-7 7-13 13-30
delta alpha
theta beta
25-100
gamma
8-13
mu
Oscillatory activity is observed throughout
the central nervous system at all levels of
organization. Three different levels have been
widely recognized: the micro-scale (activity of a
single neuron), the meso-scale (activity of a
local group of neurons) and the macro-scale
(activity of different brain regions)
![Page 7: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/7.jpg)
NEUROIMAGING How can we record from
the brain?
![Page 8: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/8.jpg)
BCI CLASSIFICATION BY NEUROIMAGING
Invasive
ECoG
Intracortical
Non-Invasive
EEG
fMRI
NIRS
MEG
![Page 9: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/9.jpg)
DEEP BRAIN STIMULATION/RECORDING
Stimulation/recording usingmicroelectrodes/Microarrays
• Parkinson
• Severe depression
• Tourette Syndrome
• Chronic pain
![Page 10: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/10.jpg)
EEG
Recording of electrical activity along the scalp. EEG measures voltage fluctuations resulting from ionic current flows within the neurons of the brain
![Page 11: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/11.jpg)
ECOG
Electrocorticography (ECoG), or intracranial EEG (iEEG), is the practice of using electrodes placed directly on the exposed surface of the brain to record electrical activity from the cerebral cortex. ECoG may be performed either in the operating room during surgery (intraoperative ECoG) or outside of surgery (extraoperative ECoG)
![Page 12: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/12.jpg)
FMRI
Detecting associated changes in blood
flow
• Non-Invasive
• High precision
• Robust, expensive
• Non-portable
![Page 13: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/13.jpg)
MEG
The spatial distributions of the magnetic fields are analyzed to localize the sources of the activity within the brain
![Page 14: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/14.jpg)
NIRS
fNIR is a non-invasive imaging method involving the quantification of chromophore. NIR spectrum light takes advantage of the optical window in which skin, tissue, and bone are mostly transparent to NIR light in the spectrum of 700-900 nm, while hemoglobin (Hb) and deoxygenated-hemoglobin (deoxy-Hb) are stronger absorbers of light.
![Page 15: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/15.jpg)
BCI NEUROIMAGING COMPARISON
//Luis Fernando Nicolas-Alonso, Brain Computer Interfaces, a Review, Sensors 2012
![Page 16: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/16.jpg)
REGISTRATION POSSIBILITIES
Non-invasive 0-60 Hz
Invasive 0-10 000 Hz
![Page 17: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/17.jpg)
CONTROL SIGNALS What are Control signal
types in BCI?
![Page 18: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/18.jpg)
COMPARISON
![Page 19: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/19.jpg)
STEADY STATE VISUALLY EVOKED POTENTIALS
Based on “resonance” effect
SSVP + Transcranial focused ultrasound (FUS, TMS)
http:// www.youtube.com/watch?v=VaJjHgyHnEc
![Page 20: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/20.jpg)
EVENT-RELATED POTENTIALS (P300/N400)
When recorded by electroencephalography (EEG), it surfaces as a positive deflection in voltage with a latency ~300ms.
![Page 21: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/21.jpg)
NEUROFEEDBACK What Modalities could be
used for Feedback?
![Page 22: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/22.jpg)
NEUROFEEDBACK
• Appropriate feedback strategy should depend on the control signal
• Incapable users may particularly benefit from positively-biased feedback
• Intracortical stimulation/Optogenetics/FUS/TMS/Visual and Auditory
fMRI
20 mins
EEG
30 hours
>
![Page 23: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/23.jpg)
APPLICATIONS What are the applications
of BCI?
![Page 24: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/24.jpg)
APPLICATIONS
Use
r ca
pa
bility
Information Transfer Rate
CLIS users
LIS users
Users with no severe disability
//Luis Fernando Nicolas-Alonso, Brain Computer Interfaces, a Review, Sensors 2012
Communication
Entertainment
Environment
Locomotion
Neuroprosthesis
![Page 25: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/25.jpg)
BEYOND MEDICAL APPLICATIONS
Gaming & Entertainment
Evaluation
User state monitoring
Training & Education
Cognitive improvement
Device Control
Security & Safety
![Page 26: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/26.jpg)
CONSUMER APPS What is available on the
market today?
![Page 27: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/27.jpg)
NECOMIMI
Electrodos: 1
1 mental state
July 2012
Neuroware
![Page 28: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/28.jpg)
MINDWAVE MOBILE
Electrodos: 1
2 mental states (based on 4 brainwaves), eyeblinks
21 March 2011
Neurosky
.NET,Android,iPhone,Arduino
![Page 29: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/29.jpg)
MINDSET
Electrodos: 1
2 mental states (based on 4 brainwaves), eyeblinks
1 December 2011
Neurosky
![Page 30: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/30.jpg)
MINDBALL
Electrodos: 1
1 mental state
21 December 2009
Mattel (Neurosky partner)
![Page 31: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/31.jpg)
STAR WARS FORCE TRAINER
Electrodos: 1
1 mental state
21 June 2009
Uncle Milton (Neurosky partner)
![Page 32: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/32.jpg)
XWAVE SPORT
Electrodos:1
8 EEG bands
5 January 2011
XWave
![Page 33: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/33.jpg)
MYNDPLAY
Electrodos:1
8 EEG bands
1 December 2011
MyndPlay
![Page 34: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/34.jpg)
NEURAL IMPULSE ACTUATOR
Electrodos:3
2 brainwaves (Alpha & Beta), facial muscle and eye movements
May 2008
OCZ Technology
Python
![Page 35: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/35.jpg)
EMOTIV EPOC
Electrodos:14
4 mental states (based on brainwaves), 13 conscious thoughts, facial expressions, head movements (sensed by 2 gyros)
21 December 2009
Emotiv Systems
C#, C++, Java, Matlab, Python
![Page 36: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/36.jpg)
INTENDIX
Electrodos: 64
It can detect different brain signals with an accuracy of 99%
March 2012
G.TEC
![Page 37: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/37.jpg)
OPENEEG
OpenEEG project is about making plans and software for do-it-yourself EEG devices available for free (as in GPL)
![Page 38: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/38.jpg)
OPENVIBE
OpenViBE is a Open Source oftware platform dedicated to designing, testing and using brain-computer interfaces
![Page 39: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/39.jpg)
TO LEARN MORE
1) http://www.coursera.org 2) http://www.gocognitive.net/
![Page 40: Make Me Think. A Brief Introduction to Brain-Computer Interfaces](https://reader031.vdocument.in/reader031/viewer/2022020310/568c56861a28ab4916c6f4a9/html5/thumbnails/40.jpg)
THANK YOU!Nikita Lukianetshttp://linkedin.com/in/nikiluk