6th sence technology

8/2/2019 6th Sence Technology

1/22

Presented

By:-


2/22


3/22

Sixth Sense is a wearable gestural interface that augments thephysical world around us with digital information and lets ususe natural hand gestures to interact with that information.

It was developed byPranav Mistry, a PhD student in the FluidInterfaces Group at the MIT Media Lab.

SixthSense bridges the gap by bringing intangible, digitalinformation out into the tangible world, and allowing us tointeract with this information via natural hand

SixthSense comprises apocket projector, a mirror and acamera. The hardware components are coupled in a pendant likemobile wearable device.

INTRODUCTION


4/22

WHY SIXTH SENSE?


5/22

Camera

Projector

Mirror

Mobile Component

Colored Markers

The hardware components are coupled in a pendant likemobile wearable device.

COMPONENTS


6/22

Captures an object in view andtracksthe users handgestures

It sends the data to smart phone

It acts as a digital eye, connecting you to the world of digitalinformation

Camera


7/22

The projectorprojects visual information enablingsurfaces and physical objects to be used as interfaces

The project itself contains a battery inside, with3 hoursof battery life.

A tiny LED projector displays data sent from the smartphone on any surface in view-object, wall, or person.

ro ec or


8/22

A Web -enabledsmart phone in the users pocket processesthe video data

Other software searches the Web and interprets the handgestures .

Smart Phone

The usage of the mirror is significant as the projector danglespointing downwards from the neck.

MIRROR

Mirror


9/22

It is at the tip of the users fingers .

Marking the users fingers with red, yellow, green, and bluetape helps the webcam recognize gestures.

The movements and arrangements of these makers areinterpreted into gestures that act as interaction instructions

for the projected application interfaces.

Color Markers


10/22

HOW IT WORKS?

Send Info

nd forcessing

captureImagesPicturesGestures

Project imageReflect ondesired surface Info on

surface


11/22

The hardware that makes Sixth Sense work is a pendant likemobile

wearable interface

It has a camera, a mirror and a projector and is connectedwirelessly to a bluetooth smart phone that can slipcomfortably into ones pocket

The camera recognizes individuals, images, pictures, gesturesone makes with their hands

Information is sent to the Smartphone for processing

The downward-facing projectorprojects the output image onto the mirror

Mirrorreflects image on to the desired surface

Thus, digital information isfreed from its confines and placed

in thephysical world

Cont.


12/22

RELATED TECHNOLOGIES

Augmentedreality is a term for a live direct or indirect

view of a physical real world environment whose elementsare augmentedby virtual computer generated imagery.

Gesturerecognition is a topic in computer science andlanguage technology with the goal ofinterpreting humangestures via

mathematical algorithms.

Computer vision is the science and technology ofmachines that see. Itis concerned with the theory behind artificial systemsthatextract information from images.

Radio Frequency Identification is basically an electronictagging technology that allows the detection, tracking oftags and consequently the objects that they are affixedto.


13/22

APPLICATIONS


14/22

Make a call

You can use the Sixth Sense to

project a keypad onto your hand,then use that virtual keypad to makea call

Call up a map

With the map application we cancall up the map of our choice and

then use thumbs and index fingers tonavigate the map


15/22

Check the time

Draw a circle on your wrist to geta virtual watch that gives you thecorrect time

Create multimedia readingexperiences

Sixth Sense can be programmed toproject related videos ontonewspaper articles you are reading


16/22

Drawing application

The drawing application lets the user drawon any surface by tracking the fingertipmovements of the users index finger

Zooming features

The user can zoom in or zoom outusing intuitive hand movements


17/22

Get product information

Sixth Sense uses image recognition ormarker technology to recognize

products we pick up, then feeds usinformation on those products

Get book information

The system can project Amazonratings on that book, as well as

reviews and other relevantinformation


18/22

Get flight updates

The system will recognize your boardingpass and let you know whether your fligis on time and if the gate has changed.

Feed information on pe

The system will project relevantinformation about a person such as

what they do, where theywork, and so on.


19/22

Take pictures

If you fashion your index fingand thumbs into a square("framing" gesture), the systewill snap a photo.

After taking the desired number ophotos, we can project them ontosurface, and use gestures to sort

through the photos, and organizeand resize them


20/22

ADVANTAGES

Portable

Supports multi-touch and multi-user interaction

Connectedness between world and information

Cost effectiveData access directly from machine in real time

Mind map the idea anywhere

It is an open source


21/22

CONCLUSION

Sixth Sense recognizes the objects around us, displayinginformation automatically and letting us to access it inany way we need

The Sixth Sense prototype implements several applications thatdemonstrate the usefulness, viability and flexibility of thesystem

Allowing us to interact with this information via natural hand

gestures

The potential of becoming the ultimate "transparent" userinterface for accessing information about everything around us


22/22

THANK YOU

6th sence technology

Documents