bciplayer: a direct brain-computer interface for ...elliott forney, charles anderson, william gavin...

1
Elliott Forney, Charles Anderson, William Gavin and Patricia Davies What are Brain-Computer Interfaces? Brain-Computer Interfaces (BCI) are technologies that aim to establish a direct channel of communication between the human brain and a computerized device. Non-invasive BCI achieve this using a cap lined with sensitive electrical sensors that are capable of detecting changes in a person's mental activity, a technique known as Electroencephalography (EEG). EEG does not require dangerous and expensive surgical interventions and is also relatively inexpensive, portable and easy to use. The EEG signals are then combined with a communication protocol, filters and pattern recognition algorithms in order to construct a useful BCI system, capable of controlling any number of computerized devices. What Makes BCIPlayer Different? A Direct Brain-Computer Interface for Multimedia and Environmental Controls What is The Market For BCI? How Does BCIPlayer Work? Why The CSU BCI Laboratory? Several BCI systems are currently available. However, none of these systems has become a commercial or practical success. There are four primary innovations that make our BCI system more likely to succeed: 1. BCIPLayer is not a toy. It is designed to help people with motor impairments perform actual tasks that they want to do now. 2. The interface for BCIPlayer is more pleasurable to use than other systems that involve flashing and/or flickering. 3. We have developed advanced machine learning algorithms that make BCIPlayer faster and more reliable than competing BCI systems. 4. We have pioneered several new filtering algorithms that make BCIPlayer more robust to the noise and interference that is encountered when using a BCI in real-world environments. There is currently very little data on how many people may benefit from assistive BCI. However, we do know that there are millions of people who currently suffer from severe and disabling motor impairments. As many as 30,000 people have ALS, 40,000 are in a vegetative state and as many as 450,000 suffer from cerebral palsy, in the USA alone. It is unknown how many of these people, and people with other diseases, may benefit from BCI. The first target audience for our BCI are neural rehabilitation centers that specialize in neurological diseases and trauma. As these facilities identify people that can use this technology, we believe that a market for individuals will expand. BCI may have a number of potential uses; however, an immediately useful application is the development of assistive technologies for people with severe motor impairments. There are many causes of sever motor impairments, including stroke, traumatic brain injury, spinal cord injury, ALS and other neurodegenerative diseases. For these people, even a somewhat slow BCI may prove to be an invaluable tool. Having the restored ability to perform basic functions, like controlling a music player or TV or send a text message or adjust the thermostat could result in tremendous improvements in quality-of-life. What Impact Could BCI Have? BCIPlayer relies on a well-known technique for eliciting changes in EEG that can be used to pass messages, known as the P300 response . The P300 response occurs when the user attends to rare-but-expected stimuli. In BCIPlayer, we present a circular, pie-shaped menu of options for the user to choose from. Each section of the menu "pops out" in a random order. The user needs only to attend to the item that they wish to select. After a short calibration phase, a pattern analysis algorithm can identify the P300 response corresponding to the selected item. When a P300 is identified, a bar grows toward the menu item until it is selected. The CSU Brain Computer Interfaces Laboratory is uniquely positioned to develop the next-generation of BCI technology for several reasons: 1. We have been a leader in BCI research for over 20 years. 2. We have a multidisciplinary team with participating specialists from computer science, occupational therapy, human development, mathematics, biology and engineering. 3. In recent years we have developed a number of novel algorithms and interfaces and have begun testing them under realistic conditions. 4. We have created a state-of-the-art software platform, The Colorado EEG and BCI Lab (CEBL), for rapidly developing new BCI technologies. Brain-Computer Interfaces Lab. Grant Number 1065513. Brainwaves Research Lab. EEG Signal Communication Protocol Pattern Recognition Algorithm Instruction User Device Action Stimuli Time (s) F1 F2 C3 C4 P3 P4 O1 O2 0 1 2 3 4 5

Upload: others

Post on 16-Aug-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: BCIPlayer: A Direct Brain-Computer Interface for ...Elliott Forney, Charles Anderson, William Gavin and Patricia Davies What are Brain-Computer Interfaces? Brain-Computer Interfaces

Elliott Forney, Charles Anderson, William Gavin and Patricia Davies

What are Brain-Computer Interfaces?Brain-Computer Interfaces (BCI) aretechnologies that aim to establish a directchannel of communication between thehuman brain and a computerized device.

Non-invasive BCI achieve this using acap lined with sensitive electrical sensorsthat are capable of detecting changes in aperson's mental activity, a technique known as Electroencephalography (EEG).EEG does not require dangerous and expensive surgical interventions and is alsorelatively inexpensive, portable and easy to use.

The EEG signals are then combined with a communication protocol, filters andpattern recognition algorithms in order to construct a useful BCI system,capable of controlling any number of computerized devices.

What Makes BCIPlayer Different?

A Direct Brain-Computer Interface forMultimedia and Environmental Controls

What is The Market For BCI?How Does BCIPlayer Work?

Why The CSU BCI Laboratory?Several BCI systems are currently available. However,none of these systems has become a commercial or practicalsuccess. There are four primary innovations that makeour BCI system more likely to succeed:

1. BCIPLayer is not a toy. It is designed to help peoplewith motor impairments perform actual tasks that theywant to do now.

2. The interface for BCIPlayer is more pleasurable touse than other systems that involve flashingand/or flickering.

3. We have developed advanced machinelearning algorithms that make BCIPlayerfaster and more reliable than competingBCI systems.

4. We have pioneered several new filteringalgorithms that make BCIPlayer more robust to the noise and interference that isencountered when using a BCI in real-world environments.

There is currently very littledata on how many peoplemay benefit from assistiveBCI.

However, we do know thatthere are millions of peoplewho currently suffer fromsevere and disabling motorimpairments.

As many as 30,000 people have ALS, 40,000 are in a vegetative stateand as many as 450,000 suffer from cerebral palsy, in the USA alone.It is unknown how many of these people, and people with otherdiseases, may benefit from BCI.

The first target audience for our BCI are neural rehabilitation centersthat specialize in neurological diseases and trauma.

As these facilities identify people that can use this technology, we believethat a market for individuals will expand.

BCI may have a number of potential uses; however,an immediately useful application is the developmentof assistive technologies for people with severemotor impairments.

There are many causes of sever motor impairments,including stroke, traumatic brain injury, spinal cordinjury, ALS and other neurodegenerative diseases.

For these people, even a somewhat slow BCI may prove to be an invaluable tool.

Having the restored ability to perform basic functions, like controlling a musicplayer or TV or send a text message or adjust the thermostat could result intremendous improvements in quality-of-life.

What Impact Could BCI Have?

BCIPlayer relies on a well-known technique foreliciting changes in EEG that can be used to passmessages, known as the P300 response .

The P300 response occurs when the user attendsto rare-but-expected stimuli.

In BCIPlayer, we present a circular, pie-shapedmenu of options for the user to choose from.

Each section of the menu "pops out" in arandom order. The user needs only to attend tothe item that they wish to select.

After a short calibration phase, a pattern analysisalgorithm can identify the P300 responsecorresponding to the selected item.

When a P300 is identified, a bar grows toward the menu item until it is selected.

The CSU Brain Computer InterfacesLaboratory is uniquely positioned todevelop the next-generation of BCItechnology for several reasons:

1. We have been a leader in BCIresearch for over 20 years.

2. We have a multidisciplinary teamwith participating specialists fromcomputer science, occupational therapy,human development, mathematics, biology and engineering.

3. In recent years we have developed a number of novel algorithms andinterfaces and have begun testing them under realistic conditions.

4. We have created a state-of-the-art software platform, The ColoradoEEG and BCI Lab (CEBL), for rapidly developing new BCI technologies.

Brain-Computer Interfaces Lab. Grant Number 1065513.Brainwaves Research Lab.

EEG Signal CommunicationProtocol

Pattern RecognitionAlgorithm

Instruction

User Device Action

Stimuli

Time (s)

F1

F2

C3

C4

P3

P4

O1

O2

0 1 2 3 4 5