Download - AR presentation used at Webinar
![Page 1: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/1.jpg)
The Mobile Future of Augmented Reality
Qualcomm Technologies, Inc.December 2016
![Page 2: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/2.jpg)
2
Agenda
2
Brief introduction to Augmented Reality1
Evolution of AR fromtoday to the future2
New technologies for AR requirements3
![Page 3: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/3.jpg)
3
Augmented reality vs. virtual realitySimilar underlying technologies but distinct experiences
Augmented realitySuperimposes content over the real world such that the content appears to be part of the real-world scene
Simulates physical presence in real or imagined worlds, and enables the user to interact in that world
Virtual reality
![Page 4: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/4.jpg)
4
Evolution of user experience from VR to AR
Today Soon The Future
VR: Mostly 3-DOF, lower resolution videos & games
AR: Pokémon Go, Google Translate,Snapchat, and other rudimentary AR apps
VR: Ability to move around through liveevents, with better sense of “presence”
AR: Still rudimentary, yet more usefuland immersive, streaming AR services,abled to be accessed on the go
AR: Entire scenes, like entertainment events, can be accessed with your mobile AR device that are so realistic and interactive that they’ll be nearly indistinguishable from reality. VR becomes an occasionally used “mode” within AR
![Page 5: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/5.jpg)
5
AR will serve a broad spectrum of roles in daily lifeApplicable across ages, genders, and activities
Children Playing
Young Adults Exploring
Families Communicating
Professionals Working
Fitness Enthusiasts Thriving
Kids chasingvirtual characters
in more interactive & immersive games
A young manexploring Rome and
seeing the Colosseumas originally built
Families virtually brought together with life-like
communication
Architects collaborating on a shared design to improve efficiency
Group running witha virtual trainer to
motivate them
![Page 6: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/6.jpg)
6
AR will eventually revolutionize industries and enterprisesIncreased productivity, efficiency, and safety
Healthcare• More efficient patient care
• Diagnosis and treatment assistance• Surgical training and visualization
Industrial & manufacturing• Guided training and remote support
• Improved safety• Real-time factory diagnostics
Education• Immersive, self-guided, interactive
visual learning• Any subject, from history and
physics to vocational
Military• Instructional training
• In-the-field assistance
Retail• Try before you buy: clothes, furniture,
car, real estate shopping, etc.• Navigation to products and
personalized coupons
Engineering• 3D visualization and CAD• Colleague collaboration and communication
Marketing & advertising• Personalized ads based on context• Consumer data – what they like,
what they look at, etc.
Emergency response• Police, fire, security response• Potential improvements in safety,
response time, and saving lives.
![Page 7: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/7.jpg)
7
AR is the next mobile computing platformNearly everything we’ve learned for smartphones will be used for AR
Laptop
Smartphone
AR glasses
![Page 8: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/8.jpg)
8
AR technologies & use cases evolve from mobileVR usage primarily comes from console/TV/PC, but it’s also moving towards AR
Ultimately, this becomesan imperceptible device that replaces nearlyall others
VR HMD
Camera
Smartphone
Gaming consoles
Laptop
Desktop PC
Landline
TV
PDA
Handheld gaming AR glasses
![Page 9: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/9.jpg)
9
AR is here today, but it is still in its infancyLike smartphones, the AR evolution will take years but has the potential to be huge
AR will follow a similar ~30 year cycle of sleeker designs, with tremendously increasing functionality
Technology Phase: InfancyMarket: Mostly early adopter “Prosumers”
Technology Phase: Rapid evolutionMarket: Surging consumer adoption
Technology Phase: MaturityMarket: Worldwide, ubiquitous use
![Page 10: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/10.jpg)
10
AR is here today, but it is still in its infancyCurrently shipping devices that use Qualcomm® Snapdragon™ processors
Today’s Smartphones and Phablets Glasses
Qualcomm Snapdragon is a product of Qualcomm Technologies, Inc.
![Page 11: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/11.jpg)
11
A glimpse into the futureFirst responder AR glasses
New optics andprojection technologies
within a durable,semitransparent
AR display
Rear camera
Directional speakers
Tracking & recording cameras
Ultra-bright LED lights
Inertial, haptic, environmental,& health sensors
• Many passive & active cameras with fisheye and telephoto lenses
• Optoelectronic night vision and thermal imaging sensors
Ambient light sensors
Multiple high sensitivityaudio microphones
Eye tracking cameras
Bone conduction transducers Multimode connectivity (4G, 5G, etc.)
![Page 12: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/12.jpg)
12
New technologies for future AR requirementsProviding an always-on experience that intelligently enhances our lives
ImmersiveThe visuals, sounds, and interactions are so realistic that they are true to life
CognitiveIt understands the real world, learns personal preferences, and provides security & privacy
ConnectedAn always-on, low power wearable with
fast wireless cloud connectivity anywhere
![Page 13: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/13.jpg)
13
Intuitiveinteractions
Sound quality
Visual quality Immersion
AR shares requirements similar to VR for immersionAchieving realistic AR at low power to enable a comfortable, sleek form factor
Extreme pixel quantity and qualityScreen is very close to the eyes
Stereoscopic displayHumans see in 3D
Spherical viewLook anywhere with
a full 360° spherical view
High resolution audioUp to human hearing capabilities
3D audioRealistic 3D, positional, surround audio that is accurate to the real world
Crystal clear voiceClear voice that is enhanced with
noise cancellation technology
Precise motion trackingAccurate on-device motion tracking
Minimal latencyMinimized system latency
to remove perceptible lag
Natural user interfacesSeamlessly interact with VR using
natural movements, free from wires
Learn more about our vision for the future of VR: www.qualcomm.com/VR
![Page 14: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/14.jpg)
14
Intuitiveinteractions
Sound quality
Visual quality Immersion
AR introduces additional requirements for immersion Seamlessly integrating virtual objects with the real world
Keeping the world stableSeamlessly anchor virtual
objects to the real world
Common illuminationLighting virtual objects
realistically and dynamically
OcclusionShowing and hiding virtual
objects appropriately
Realistic virtual soundsModifying virtual sounds based on the real world environment
Natural user interfacesSeamlessly interact with AR using
natural movements, free from wires
![Page 15: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/15.jpg)
15
Keeping the world stableIn an unstable environment, virtual objects are NOTseamlessly anchored to the real world
![Page 16: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/16.jpg)
16
Keeping the world stableIn a stable environment, virtual objects areseamlessly anchored to the real world
![Page 17: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/17.jpg)
17
Occluding virtual objects correctlyIncorrect occlusion breaks immersion
![Page 18: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/18.jpg)
18
Occluding virtual objects correctlyCorrect occlusion accounts for the depth of virtual and real objects
![Page 19: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/19.jpg)
19
Occluding virtual objects correctlySmart occlusion accounts for both object depth and user preferences
![Page 20: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/20.jpg)
20
Lighting virtual objects realistically and dynamicallyIncorrect lighting poorly represents the position, intensity,and orientation of all light sources
Poor environment processing• Virtual objects look fake and out of place
• Static lighting; often incorrect for environment
• Solid objects do not look solid
• Materials look physically incorrect
• Interactivity is not smooth
20
![Page 21: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/21.jpg)
21
Lighting virtual objects realistically and dynamicallyCorrect lighting considers the position, intensity,and orientation of all light sources
Proper AR environment processing• Virtual objects look real and correctly placed
• Dynamic lighting; correct for the environment
• Solid objects look solid
• Materials look physically correct
• Interactivity is smooth
Making it possible• Intelligent, fast interaction between many
different sensors & rendering systems
• New computer vision and global illuminationalgorithms to dynamically render andoverlay realistic AR objects
21
![Page 22: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/22.jpg)
22
Creating virtual sounds based on the real world Sound reflections spread and interact with the environment appropriately
Airport• Limited
soundreflections
• Significantambientsound
Hotelroom• Significant
sounddampening
Conferenceroom• Enclosed room
with reflectivesurfaces
• Virtual peopleshould soundlike they are inthe conferenceroom
Required technologies• Environment modeling
• Noise filtering
• Reverberation
• Positional audio
![Page 23: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/23.jpg)
23
Adaptive, multimodal, user interfaces
Interacting naturally with ARInteractions will become more intuitive & adaptive to personal preferences
Speech recognition and learning Use of natural language processing, intelligently
personalized to user’s voice and lexicon
Motion & gesture recognitionUse CV along with motion sensors, and new types of connected,
haptic devices to help users interact within AR
Face recognitionUse of advanced CV to authenticate and accurately recognize facial expressions
Personalized interfacesLearn and know a myriad of user preferences
based on machine learning
Eye tracking Use CV to much more accurately authenticate, and also track & measure point of gaze
Bringing life to objectsEfficient user interfaces for controlling
interaction with IoT devices and cloud services
![Page 24: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/24.jpg)
24
Cognitive technologies are key for AR adoptionMaking sense of the world while protecting our privacy and security
Security & privacy are critical for ARMachine learning
Visual Processing Audio Processing Other sensor
processing
Machine Learning
On-device privacy & security
• Continuous authentication necessary for identityand access
• Makes visual, audio, andother sensor processingmore intelligent
• Utilize combined machine learning on biometricsand behavioral activity
![Page 25: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/25.jpg)
25
Cognitive AR will greatly expand our human abilitiesBy understanding the environment and providing personalized assistance
Assist the visually impairedHelp the visually impaired map their
environment and get around
Make travel easierDescribe the landmarks around you and translate street signs
Become a proMake a gourmet meal, fix your car,
or perfect your jump shot
![Page 26: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/26.jpg)
26
Contextual intelligence to “sense” the worldMany types of sensors and personal information are required
• Efficient, heterogeneous architectures • Sensor fusion and machine learning
• Low-energy wireless technologies(e.g. BT-LE, LTE IoT, LTE Direct, 802.11ah)
• Integrated, always-on data capturing
Ambient light Microphone GyroscopeCamera PulseEnvironment Compass Temperature Humidity
Low power sensing, processing, and connectivity
Calendar Messaging Apps Cloud data Connectivity
Sensor data
On-device data Cloud and IoT data
Iris scan
26
![Page 27: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/27.jpg)
27
Visual intelligence to “see” the world around youContinually monitoring the visual world to intelligently identify
Determine the size, direction, and distance of different objects, and (sometimes) store the whole 3D scene for various uses
3D depth capture,interpolation &reconstructionUsing passive + active cameras,along with advanced CV &machine learning algorithms
Object recognition, tracking & registrationUsing CV and machine learningso that objects in the real andvirtual worlds are properly alignedwith respect to each other
11 feet
29 feet
8 feet
![Page 28: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/28.jpg)
28
Recognize, track, map & reconstruct surroundings
Underlying technologiesObject recognition, trackingand registration
Visual inertial odometry (VIO)
Simultaneous localizationand mapping (SLAM)
3D reconstruction
![Page 29: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/29.jpg)
29
Understand and informRecognize the relationship between objects & provide relevant information
Identify real objects
Understandtext
Recognize people
Perceptual tasks
Cable CarCost: €3Departing: 10 minDestination time: 1 hr
18th Street
Café4.5 starsServes Caldo Verde
Sarah M.Last talked: 2 monthsAsk about her son, Joe
TaxiCost: €25Departing: NowDestination time: 15 min
Distinguish activities
Passenger boarding
Lisbon, Portugal Temp: 98° F
![Page 30: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/30.jpg)
30
Recommend actionsPersonalized virtual tour guide
“Catch this trolley to take your next tour.
This one also has air conditioning available.
Have €3 ready.”
![Page 31: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/31.jpg)
31
Machine learning to autonomously take actionsInfer context and anticipate needs
High level concept understanding with learned perception and awareness
Autonomously take predictive, necessary actions
Motion classification
User identification & preferences
Ambient speech & audio classification
Personal places and location understanding
Object detection and recognition
Cloud data & services
![Page 32: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/32.jpg)
32
AR requires the next level of ubiquitous connectivityConnecting everything and enabling cloud computing
Continuous AR use:• Generates and demands more data
• Requires constant connectivity
• Must be very fast and affordable
Uplink/Share
Downlink/Consume
AR needs consistent, faster, higher-capacity uplink and downlink connectivity than today
![Page 33: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/33.jpg)
33
Taking AR experiences to the next level with 5GUbiquitous LTE coverage with Gigabit LTE / 5G multi-mode devices
Extreme throughputmulti-gigabits per second
Ultra-low latencydown to 1ms latency
Uniform experience with much more capacity
Enjoy AR experiences everywhereAt home, at work, at school, in the car, walking around, …
Share real-time/interactive experiencesEvents, meetings, telepresence, …
All while improving energy efficiency and lowering costLearn more about our vision for the future of mobile networks: www.qualcomm.com/5G 33
![Page 34: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/34.jpg)
34
Power efficiency is also essential for ARThe AR headset needs to be comfortable to wear all day
Constrained mobile wearable environment
Thermally efficient for sleek, ultra-light designs
Long battery life for all-day use
AR workloads
Compute intensive
Complex concurrencies
Always-on
Real-time
![Page 35: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/35.jpg)
35
We’re developing foundational technology for ARQualcomm Technologies’ investments and the confluence of mobile technologies
ComputerVision
Cognitive & Security
Heterogeneous Computing
Next-GenConnectivity
• 6-DOF VIO• SLAM & 3DR• Object detection
& recognition
• AI for advanced cognitive processing
• Local and cloud machine learning
• Security and privacy
• Lower power, higher perf. AR visual processing
• Advancements in always-on sensor fusion
• Next-gen AR audio
• Gigabit LTE and Wi-Fi• Pioneering 5G
technologies• Connectivity convergence
![Page 36: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/36.jpg)
36
We are also investing in these innovative start-upsQualcomm Ventures portfolio
Professional “light field” cameras & software
Professional 3D reconstruction cameras & software
Smartphone AR software for “visual marketing”
Virtual reality game studioSoftware & hardware for AR/VR controllers
Wearable mixed reality
![Page 37: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/37.jpg)
3737
AR is the next mobilecomputing platform
AR is here today, but still in infancy
Advancements are required to make AR optimally immersive, cognitive, and connected
Qualcomm Technologies willcontinue to innovate AR technologies
![Page 38: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/38.jpg)
Thank you
All data and information contained in or disclosed by this document is confidential and proprietary information of Qualcomm Technologies, Inc. and/or its affiliated companies and all rights therein are expressly reserved. By accepting this material the recipient agrees that this material and the information contained therein is to be held in confidence and in trust and will not be used, copied, reproduced in whole or in part, nor its contents revealed in any manner to others without the express written permission of Qualcomm Technologies, Inc. Nothing in these materials is an offer to sell any of the components or devices referenced herein.
©2016 Qualcomm Technologies, Inc. and/or its affiliated companies. All Rights Reserved.
Qualcomm and Snapdragon are trademarks of Qualcomm Incorporated, registered in the United States and other countries. Other products and brand names may be trademarks or registered trademarks of their respective owners.
References in this presentation to “Qualcomm” may mean Qualcomm Incorporated, Qualcomm Technologies, Inc., and/or other subsidiaries or business units within the Qualcomm corporate structure, as applicable. Qualcomm Incorporated includes Qualcomm’s licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm Incorporated, operates, along with its subsidiaries, substantially all of Qualcomm’s engineering, research and development functions, and substantially all of its product and services businesses, including its semiconductor business, QCT.
Follow us on:For more information, visit us at: www.qualcomm.com & www.qualcomm.com/blog
![Page 39: AR presentation used at Webinar](https://reader031.vdocument.in/reader031/viewer/2022030323/58a1a2941a28abf84d8c4143/html5/thumbnails/39.jpg)
39
Websites• Augmented reality: https://www.qualcomm.com/AR
• Virtual reality: https://www.qualcomm.com/VR
• Immersive experiences: https://www.qualcomm.com/Immersive
• Developers: https://developer.qualcomm.com
• Newsletter signup: http://www.qualcomm.com/mobile-computing-newsletter
Presentations• Virtual reality: https://www.qualcomm.com/documents/making-immersive-virtual-reality-possible-mobile
• Immersive experiences: https://www.qualcomm.com/documents/immersive-experiences-presentation
• SlideShare: http://www.slideshare.net/qualcommwirelessevolution
Papers• Virtual reality: https://www.qualcomm.com/documents/whitepaper-making-immersive-virtual-reality-possible-mobile
• Immersive experiences: https://www.qualcomm.com/documents/whitepaper-driving-new-era-immersive-experiences-qualcomm
Videos:• Immersive experiences webinar: https://www.qualcomm.com/videos/webinar-new-era-immersive-experiences-whats-next
• Virtual reality webinar: https://www.qualcomm.com/videos/webinar-making-immersive-virtual-reality-possible-mobile
Resources