MIND READING USING FUNCTIONAL NEAR-INFRARED SPECTROSCOPY

Presented By,Tarun Kumar,

IMSEC,GHAZIABAD

CONTENTS Introduction What is Mind Reading? Why Mind Reading? How does it Work? Algorithm Databases Application Advantages and uses Conclusion Reference

INTRODUCTION People express their mental states, including

emotions, thoughts and desires, all the time through facial expressions and gestures. This is true when they are interacting with machines

Mind reading machine is co-ordination of human psychology and computer techniques.

Some equipment are used to gather data & then analyzed. To use those data for further prediction of mind is known as theory of mind reading.

WHAT IS MINREADING? Drawing inspiration from psychology, computer

vision and machine learning has developed mind reading machine computers.

Using a digital video camera, the mindreading computer system analyzes a person’s facial expressions in real time and infers that person’s underlying mental state.

Prior knowledge of how particular mental states are expressed in the face is combined with analysis of facial expressions and head gestures occurring in real-time , its very use full for future.

WHY MIND READING? The Mind Reading computer system presents

information about mental state as easily as a keyboard and mouse present text and commands.

Current projects in Cambridge are considering further inputs such as body postures and gestures to improve the inference.

We are also looking at the use of mind reading to support on-line shopping and learning systems.

The mind reading computer system may also be used to monitor and suggest improvements in human –human interaction.

The Affective Computing Group at the MIT media laboratory is developing an emotional-social intelligence prosthesis that explores new technologies to augment and improve people’s social interactions and communication skills.

To implement this system in cars, to detect driver’s mental states such as drowsiness, distraction and anger.

HOW DOES IT WORKS?Futuristic Head Band:

The mind reading actually involves measuring the volume and oxygen level of the blood around the subject’s brain using technology called functional near-infrared spectroscopy (fNIRS).

The user wears a futuristic head band that sends light in that spectrum into the tissues of the head where it is absorbed by active, blood filled tissues.

Futuristic Headband

Process:

The results are often compared to an MRI, but can be gathered with lightweight, non-invasive equipment.

Wearing the fNIRS sensor, experimental subjects were asked to count the number of squares on a rotating onscreen cube and to perform other tasks.

Measuring mental workload, frustration and distraction is typically limited to qualitatively observing computer users.

Preliminary results show that using

buttonized sensors.

Biological signals arise when reading or

speaking to oneself with or without actual

lip or facial movement.

Web search: For the first test of sensors, scientists

trained the program to recognize six words-including ”go", "left” and “right” -10 numbers.

Then researchers put the letters of the alphabet in to a matrix with each column and row labeled with a single digit number.

These were used to silently spell ”NASA” into a web search engine using program.

“This proved we could browse the web without touching a keyboard”.

1.Neuroscience It deals with anatomy and molecular

biology of neurons. A neuron is a nerve cell that is the

basic building block of the nervous system. Neurons are specialized to transmit information throughout the body.

It is done by measuring oxygen level of blood using FNIRS.

2. Techniques:Facial effect detection It is done using hidden Markov Model, Neural Network processing or active

appearance model.

Emotional Classification

Classification by Paul Ekman Anger, Fear, Happiness, Disgust, Sadness, Surprise.

Facial Electromyography: It is used to measure electrical activity of the facial Muscles. Muscles used are ”corruguator supercilii muscle” and others. Galvanic Skin Response: It is a measure of Skin conductivity, Which is dependent on how moist the skin is.

Blood Volume Pulse:

It is measured by process called photoplethysmography.

It produce a graph indicating blood flow through the extremities.

Algorithm

LDA, k-NN, GMM, SVM, Decision Tree Algorithm.

LDA (Linear Discriminant Analysis):-1. Used in statistics , pattern recognition

and machine learning to find a linear combination of features.2. LDA is closely related to regression analysis. 3. Few mathematical methods like-Probability , Co-variance and mean for 2-class data.

Databases

Data recorded has to be matched with subject’s data.

First data base was created FAU Aibo Emotion Corpus for CEICES (Combining Efforts for Improving Automatic Classification of Emotional User States).

APPLICATION:

1) Mind-reading computers could 'save your life‘

2) Emergency

3) Control robots by brain power

4) Mind-Reading Technology Speeds Ahead

5) The mind-reading computer that could communicate with coma patients

Mind-reading computers could 'save your life‘

Devices allowing people to write letters or play pinball using just the power of their brains have become a major draw at the world's biggest high-tech fair.

Scientists are researching ways to monitor motorists' brain waves to improve reaction times in a crash.

Emergency

In an emergency stop situation, the brain activity kicks in on average around 200 milliseconds before even an alert driver can hit the brake.

There is no question of braking automatically for a driver - "we would never take away that kind of control," said Tangermann.

Using this brain-wave monitoring technology, a car can also tell whether the driver is drowsy or not, potentially warning him or her to take a break.

Control robots by brain power:

Another device allows users to control robots by brain power. The small box has lights flashing at different frequencies at the four points of the compass.

The user concentrates on the corresponding light, depending on whether he wants the robot to move up, down, left or right and the brainwaves generated by viewing that frequency are monitored and the robot is controlled.

Mind-Reading Technology Speeds Ahead

By scanning blogs of brain activity, scientists may be able to decode people's thoughts, dreams and intentions By Kerri Smith and Nature magazine

Jack Gallant perches on the edge of a swivel chair in his lab at the University of California, Berkeley, fixated on the screen of a computer that is trying to decode someone's thoughts.

The mind-reading computer that could communicate with coma patients: Canadian researchers have developing a

mind-reading computer that could help communicate with people in a coma.

The University of Western Ontario researchers used neuroimaging to read human thoughts via brain activity when they are conveying specific ‘yes’ or ‘no’ answers.

The team say their research could lead to dramatic new ways of attempting to communicate with patients in a vegetative state.

Example When Stephen Hawking talks

(http://www.hawking.org.uk/the-computer.html), a laser pointed at his face detects whether he's moving one of the only muscles he still has control over as a computer cycles through individual letters of the alphabet, determining what he’s trying to say. It's an excruciatingly slow process, and it can take several minutes for him to say anything at all. What if, instead, a computer could simply read his mind .

CONCLUSION: Tufts university researches have begun a 3 year

research project which, if successful, will allow computers to respond to the brain activity of the computer’s users.

Users wear a futuristic looking headbands to shine light on their foreheads and then performs a series of increasingly difficult tasks while the device reads what parts of the brain are absorbing the light. That info is then transferred to the computer and from there the computer can adjust it’s interface and functions to each individual.

REFERENCES: www.eurescom.de/message/default_Dec2004.as

p blog.marcelotoledo.org/2007/10 www.newscientist.com/article/dn4795-nasa-

develops-mindreading-system http://blogs.vnunet.com/app/trackback/95409   Facestation tracking cti, 2002.  S. Baron-Cohen. How to build a baby that can

read minds: Cognitive mechanisms in mindreading. Current Psychology of Cognition, 13(5):513–552, 1994. 

S. Baron-Cohen and T. H. E. Tead. Mind reading: The interactive guide to emotion, 2003.