BLUE EYESTECHNOLOGY

Human operatormonitoring system

presented by

KCET 01.04.2011

1

DIVYA MOHAN S.NAGA PRIYA

WHAT IS BLUE EYES TECHNOLOGY?

Aims at creating computational machines that have perceptual and sensory ability.

Use camera and microphone to identify user actions and emotions

?

KCET 01.04.2011

2

THE TERM BLUE EYES BLUE in the term stands for Bluetooth, which enables reliable wireless

communication

EYES , because the eye movement enables

us to obtain a lot of interesting and important information.

KCET 01.04.2011

3

NEED OF BLUE EYES TECHNOLOGY

To built a machine that can understand your emotions

A pc that can listen, talk or scream

Verify your identity, feels your presence and interact with you.

KCET 01.04.2011

4

TECHNOLGIES USED Emotion Mouse

Manual And Gaze Input Cascaded (MAGIC)

Artificial Intelligent Speech Recognition

Simple User Interest Tracker (SUITOR)

The eye movement Sensor

KCET 01.04.2011

5

EMOTION MOUSE

Simplest way

People spend approximately 1/3 of their total computer time touching input device

Physiological data is obtained and emotional state is determined

A user model will be built that reflects the personality of user.

KCET 01.04.2011

6

KCET 01.04.2011

7

IBM RESEARCH

BLUE EYE – EMOTIONAL MOUSE sensors in the mouse ,sense the physiological attributes which are correlated to emotions using corr- -elation model -by simply touching the mouse ,the computer will be able to determine a person’s emotional state.

BLUE EYE enabled TELEVISION – could become active when the user makes

an eye contact.

KCET 01.04.2011

8

MAGIC POINTING Reduce the cursor movement needed for

target selection

Click on the target with a regular manual input device

Two magic pointing techniques

Liberal Conservative

KCET 01.04.2011

9

APPROACHES

LIBERAL APPROACH

To warp the cursor to every new object user looks at

CONSERVATIVE APPROACH

Does not warp the cursor target until the manual input device has been actuated

KCET 01.04.2011

10

ARTIFICIAL INTELLIGIENT SPEECH RECOGNITION

Input words are scanned and matched against internally stored words

Identification causes some action to be taken

User speaks to the computer through microphone

Filtered and fed to ADC and then stored in RAM

pattern matching is designed to look for the best fit because of variations in loudness, pitch, frequency difference, time gap etc.

KCET 01.04.2011

11

APPLICATION OF ARTIFICIAL INTELLIGIENT SPEECH RECOGNITION

To control weapons by voice commands

Pilot give commands to computers by speaking into microphones

Can be connected to word processors and instead of writing, simply dictate to them

KCET 01.04.2011

12

SUITOR

Help by fetching more information at desktop

Notice where the user’s eyes focus on the screen

Fills a scrolling ticker on a computer screen with information related to user’s task

Ex. If reading headline ,pops up the story in the browser window

KCET 01.04.2011

13

THE EYE MOVEMENT SENSOR DESIGNING

A personal area network for linking all the operators and the supervising system

Two major units- DAU (data acquisition unit )- CSU (central system unit )

KCET 01.04.2011

14

DAU

The DAU consists of the following components

ATMEL 8952 microcontroller BLUE TOOTH MODULE – supports

synchronous voice data transmission central system sound feedback microcontroller (115200 bps) ALPHAUNUMERIC LCD display LED indicators ID CARD interface

KCET 01.04.2011

15

DAU - FEATURES

Lightweight Runs on batteries - low

power consumption Easy to use - does not

disturb the operator working

ID cards for operator authorization

Voice transmission using hardware PCM codec

Data Acquisition Unit

Atmel 89C52microcontroller

JazzMultisensor

Bluetooth

KCET 01.04.2011

16

MICROCONTROLLER & BLUETOOTH MODULE

KCET 01.04.2011

17

CSU – COMPONENTS

CONNECTION MANAGER – main task toperform low-level blue tooth

communication DATA ANALYSIS MODULE – performs theanalysis of the raw sensor data

DATA LOGGER MODULE – provides support

for storing the monitored data.

VISULAIZATION MODULE – provides userinterface for the supervisors

KCET 01.04.2011

18

CSU FEATURESCentral System Unit

ConnectionManager

Data Analysis

VisualizationModuleBluetooth

ConnectionManager

DataLogger

Connection management

Data processing

Data recording

Access verification

System maintenance

KCET 01.04.2011

19

MULTISENSORS

KCET 01.04.2011

20

FUTURE IMPROVEMENTS

DAUsmall CMOS camera to monitor the

operator’s point of gaze single PCB (SMD technology) low voltage ICs

CSUdata mining algorithms advanced

data- base encryption using

KCET 01.04.2011

21

EXPERIMENT Measurement of heart rate,

temperature, galvanic skin response (GSR), general somatic activity

Six basic emotions are anger, fear, sadness, disgust, joy and surprise

KCET 01.04.2011

22

DATA SECURITY

Only registered mobile devices can connect to the system

Bluetooth connection authentication

Bluetooth connection encryption

Access rights restrictions

Personal and physiological data encryption

KCET 01.04.2011

23

APPLICATIONS

In retailing record and interpret customer movements

In automobile industry In video games To create “Face Responsive Display”

and “Perceptive Environment” Generic control rooms

Power station Flight control centreso Operating theatres

KCET 01.04.2011

24

BLUE EYES ENABLED DEVICES

POD Technology used

in cars

PONG A Robot

KCET 01.04.2011

25

CONCLUSION

Provide more delicate and user friendly facilities in computing devices

Gap between the electronic and physical world is reduced

The computers can be run using implicit commands instead of the explicit commands

KCET 01.04.2011

26

REFERENCES

n www.seminar4u.com n www.howstuffswork.com n www.cs.put.poznan.com n www.whitepapers.com n www.ibmresearchcenter.com n www.almaden.ibm.com

KCET 01.04.2011

27

Thank u…

ANY QUESTIONS ???

KCET 01.04.2011

28