jithu

Augmented Reality: Technology & Applications

Jithu Sunny

November 20, 2011

Jithu Sunny Augmented Reality: Technology & Applications

What is Augmented Reality?

A Picture is worth a 1000 words..!

Figure: Wikitude drive, an Augmented Reality Navigation system forsmart phones.

Jithu Sunny Augmented Reality: Technology & Applications

What is Augmented Reality?

A Picture is worth a 1000 words..!

Figure: Wikitude drive, an Augmented Reality Navigation system forsmart phones.

Jithu Sunny Augmented Reality: Technology & Applications

What is Augmented Reality?

A Picture is worth a 1000 words..!

Figure: Wikitude drive, an Augmented Reality Navigation system forsmart phones.

Jithu Sunny Augmented Reality: Technology & Applications

Overview of Session

Description

Hardware

How Stuff Works?

Software & Algorithms

A Sample Algorithm

Software Toolkits

Applications

Future

Conclusion

Q&A and TY!

Jithu Sunny Augmented Reality: Technology & Applications

Formal Description

Augmented reality (AR) is a term for a live direct or anindirect view of a physical, real-world environment whoseelements are augmented by computer-generated sensoryinput such as sound, video, graphics or GPS data.

Artificial information about the environment and its objectscan be overlaid on the real world.

Enhances ones current perception of reality.

By contrast, virtual reality replaces the real world with asimulated one.

Jithu Sunny Augmented Reality: Technology & Applications

Hardware

- Processor, camera, display & sensors such as accelerometer, GPS,solid state compass.

Display

HMDHandheldSpatial

Tracking

Input Devices

Jithu Sunny Augmented Reality: Technology & Applications

Display Technique

Head Mounted Display(HMD)

Places AR over theuser’s view of the world.

Either optical seethroughor video seethrough.

Optical see-throughemploys half-silver mirrorsto pass images throughthe lens and overlayinformation to be reflectedinto the user’s eyes.

Increased immersiveexperience.

Jithu Sunny Augmented Reality: Technology & Applications

Display Techniques

Handheld Devices

A smalldisplay in user’s hand.

Apt for portabilityand video see-through.

Disadvantageis that in most cases userhave to hold the deviceout in front of them.

Jithu Sunny Augmented Reality: Technology & Applications

Display Techniques

Spatial Augmented Reality

Uses digital projectors to display graphical information onphysical objects.

The tangible nature of SAR provides the passive hapticsensation.

The user is not required to carry equipment or wear thedisplay over their eyes.

This makes it a perfect candidate for collaboration.

MIT-ian Pranav Mistry’s Sixth sense is all about SAR.

Jithu Sunny Augmented Reality: Technology & Applications

Pranav Mistry Sixth Sense

Figure: Pranav Mistry, Sixth Sense Technology

Jithu Sunny Augmented Reality: Technology & Applications

Tracking

Tracking is following.

May use: Digital cameras, accelerometers, GPS, gyroscopes,compasses, RFID, wireless sensors.

The users can interact with the system using Pinch gloves.

In Sixth sense the finger caps is basically pinch gloves.

Jithu Sunny Augmented Reality: Technology & Applications

Dream come true..!

Jithu Sunny Augmented Reality: Technology & Applications

Dream come true..!

Jithu Sunny Augmented Reality: Technology & Applications

Dream come true..!

Jithu Sunny Augmented Reality: Technology & Applications

How stuff works? - Overview

1 Capture video of the real world.

2 Search through each video frame for markers/target object.

3 Calculate the position of the camera relative to the marker.

4 Draw a computer graphics model from that position.

5 Model is drawn on top of the video of the real world and soappears stuck on the marker.

6 The final output is shown back in the display.

Jithu Sunny Augmented Reality: Technology & Applications

Sample Algorithm

Jithu Sunny Augmented Reality: Technology & Applications

Sample Algorithm Contd.

Jithu Sunny Augmented Reality: Technology & Applications

Software Toolkits

ARToolKit, an open source (dual-license: GPL, commercial)C-library to create augmented reality applications; was portedto many different languages and platforms like Android, Flashor Silverlight.

ArUco, a minimal library for augmented reality applicationsbased on OpenCv; licenses: BSD, Linux, Windows mixare,Open-source (GPLv3) augmented reality engine for Androidand iPhone.

OpenMAR, Open Mobile Augmented Reality componentframework for the Symbian platform, released under EPL

Jithu Sunny Augmented Reality: Technology & Applications

Applications

Jithu Sunny Augmented Reality: Technology & Applications

Applications

Advertising

Task support - Surgery, Underground pipe layout, see thefetus inside the womb..!

Navigation

Industrial - simulate models, reduce real time prototypes.

Military and emergency services - provide info such asmaps, enemy locations, etc.

Architecture - simulate planned construction projects.

Entertainment and education - virtual objects, immersiveambience, deepen the level of perception.

Jithu Sunny Augmented Reality: Technology & Applications

AR in Hollywood!

Jithu Sunny Augmented Reality: Technology & Applications

Future

Augmented reality has the potential to change the waywe see the world in future.

Jithu Sunny Augmented Reality: Technology & Applications

Future

Augmented reality has the potential to change the waywe see the world in future.

Jithu Sunny Augmented Reality: Technology & Applications

Conclusion

Has the potential

Undergoing active development.

Open libraries like ARToolKit.

Yet to witness applications that are so cool AND convenient.

Jithu Sunny Augmented Reality: Technology & Applications

References

Sorce, S.; Augello, A.; Santangelo, A.; Gentile, A.; Genco, A.;Gaglio, S.; Pilato, G.; Interacting with AugmentedEnvironments Pervasive Computing, IEEE Journals 2010

Livingston, Mark A.; Behringer, Reinhold; Kato, Hirokazu;Drummond, Tom; Guest Editors’ Introduction: SpecialSection on The International Symposium on Mixed andAugmented Reality (ISMAR) Visualization and ComputerGraphics, IEEE Journals 2009

Henderson, S.; Feiner, S.; Opportunistic Tangible UserInterfaces for Augmented Reality Visualization and ComputerGraphics, IEEE Journals 2010

Harders, M.; Bianchi, G.; Knoerlein, B.; Szekely, G.;Calibration, Registration, and Synchronization for HighPrecision Augmented Reality Haptics Visualization andComputer Graphics, IEEE Journals 2009

Wikipedia.org http://www.wikipedia.org/

Jithu Sunny Augmented Reality: Technology & Applications

Jithu Sunny Augmented Reality: Technology & Applications

Jithu Sunny Augmented Reality: Technology & Applications