nyit ui design lesson_augme… · augmented reality (ar), is a live direct or indirect view of a...
TRANSCRIPT
NYITUI Design
Augmented Reality
XR | AR | VR | MR
https://en.wikipedia.org/wiki/Augmented_reality
X Reality (XR). It encompasses a wide spectrum of hardware and software, including sensory interfaces, applications, and infrastructures, that enable content creation for virtual reality (VR), mixed reality (MR), Augmented Reality (AR), cinematic reality (CR).
https://en.wikipedia.org/wiki/X_Reality_(XR)#cite_note-1
Virtual reality (AR) is a simulated experience that can be similar to or completely different from the real world. Currently standard virtual reality systems use either virtual reality headsets or multi-projected environments to generate realistic images, sounds and other sensations that simulate a user's physical presence in a virtual environment.
https://en.wikipedia.org/wiki/Virtual_reality
https://www.youtube.com/watch?v=dc8_dJV6e-ohttps://www.youtube.com/channel/UCJZnyHeWyS_5abW0qnFNHMg
Augmented reality (AR), is a live direct or indirect view of a physical, real-world environment whose elements are augmented by computer-generated sensory input such as sound, video, graphics or GPS data.
Augmentation techniques are typically performed in real time and in semantic context with environmental elements, such as overlaying supplemental information like scores over a live video feed of a sporting event.
https://en.wikipedia.org/wiki/Augmented_reality
https://www.psfk.com/2017/01/paper-vr-controller-virtual-reality.htmlhttps://www.youtube.com/watch?v=p7Wclfx1xSs
https://www.youtube.com/watch?v=dc8_dJV6e-ohttps://www.youtube.com/channel/UCJZnyHeWyS_5abW0qnFNHMg
Mixed reality (MR), sometimes referred to as hybrid reality, is the merging of real and virtual worlds to produce new environments and visualizations where physical and digital objects co-exist and interact in real time.
Mixed reality takes place not only in the physical world or the virtual world, but is a mix of reality and virtual reality, encompassing both augmented reality and augmented virtuality via immersive technology.
https://en.wikipedia.org/wiki/Mixed_reality
https://www.microsoft.com/en-us/store/d/acer-windows-mixed-reality-headset-developer-edition/8pb4twx13m2n
https://www.youtube.com/watch?v=uIHPPtPBgHkhttps://www.microsoft.com/en-us/hololens
ARA brief history of Augmented Reality
A brief history of AR and VRPrecursor technologies:● Solar Eclipse● Cave painting● Gnomon and Sundials● Shadow puppet play (likely originated in Central Asia-China or in India in
the 1st millennium BCE)● Camera obscura box (Prehistory to 500 BCE: Possible inspiration for
prehistoric art and possible use in religious ceremonies, gnomons)● Horse-drawn carriage rear view mirror.● Sailing Tell-tale and cabin-compass
https://slideplayer.com/slide/5360548/
https://en.wikipedia.org/wiki/Cave_paintinghttps://en.wiktionary.org/wiki/gnomon
https://www.sciencedirect.com/science/article/pii/S2352226717300247#f0030
Cueva de las Manos, Perito Moreno, Argentina. The art in the cave is dated between 13,000–9,000 BP, stenciled, mostly left hands are shown.
The gnomon (sense 1) of this sundial in Taganrog, Rostov Oblast, Russia, is shaped like a triangular blade
A painted stick dating from 2300 BC that was excavated at the astronomical site of Taosi is the oldest gnomon, in China
https://en.wikipedia.org/wiki/Camera_obscura
1292(or_earlier), A picture of a three-tiered camera obscura (see illustration) has been attributed to Bacon
First published picture of camera obscura in Gemma Frisius' 1545 book De Radio Astronomica et Geometrica
Leonardo da Vinci (1452–1519): Let a b c d e be the object illuminated by the sun and o r the front of the dark chamber in which is the said hole at n m.
A diagram of a camera obscura with an upright projected image at the top.
1901: L. Frank Baum, The Wonderful Wizard of Oz (children’s book).1906-1911: Ray Harroun, Indy 500 race on Decoration Day, first rear-view mirror.1909: Dorothy Levitt, Rear-view mirror, The Woman and the Car (book).1957: Morton Heilig, Sensorama.1968: Ivan Sutherland HMD (head-mounted display).1975: Myron Krueger, Videoplace (Metaplay), University of Wisconsin Madison.1977: Star Wars, George Lucas, R2-D2 a holographic recording of Leia.1979: GUI1980: Gavan Lintern, University of Illinois, HUD (Heads up display) for flight.1980: Steve Mann, University of Toronto, EyeTap first wearable computer.1981: Dan Reitan, geospatially maps.1986: Ron Feigenblatt, IBM, smart flat panel display.1987: Douglas George and Robert Morris, astronomical telescope-based HUD.1990: Thomas Caudell, U of New Mexico, and David Mizell, Introduced the term 'Augmented Reality', Boeing research project.
https://slideplayer.com/slide/5360548/
1992: Louis Rosenberg, Virtual Fixtures, US Air Force Research Laboratory1992: Steven Feiner, Blair MacIntyre and Doree Seligmann present an early paper on an AR system prototype, KARMA, at the Graphics Interface conference.1993: CMOS active-pixel sensor, metal–oxide–semiconductor (MOS), NASA's Jet Propulsion Laboratory1993: Mike Abernathy, identifying space debris using Rockwell WorldView by overlaying satellite geographic trajectories on live telescope video.1993: Loral WDL, live AR-equipped vehicles and manned simulators. 1994: Julie Martin, Augmented Reality Theater production, Dancing in Cyberspace.1995: S. Ravela, University of Massachusetts, vision-based system using monocular cameras to track objects
1998: Ramesh Raskar, Welch, Henry Fuchs, University of North Carolina at Chapel Hill, Spatial Augmented Reality.1999: Frank Delgado, Mike Abernathy, flight test of LandForm software video map overlay from a helicopter, overlaying video with runways, taxiways, roads and road names.1999: The US Naval Research Laboratory, the Battlefield Augmented Reality System (BARS), wearable systems for dismounted soldier operating in urban environment for situation awareness and training.1999: Dryden Flight Research Center, NASA X-38 flown using LandForm software video map overlays.2000: Rockwell International Science Center, tetherless wearable augmented reality systems receiving analog video and 3-D Audio over radio-frequency wireless channels.
2004: Outdoor helmet-mounted AR system, Trimble Navigation and the Human Interface Technology Laboratory (HIT lab).2008: Wikitude AR, Travel Guide launches, Android phone.2009: ARToolkit to Adobe Flash, Saqoosha, AR to the web browser.2010: Mine detection robot, Korean minefield at demilitarized zone (DMZ)2012: Lyteshot, interactive AR gaming platform, smart glasses for game data.2013: Meta announces the Meta 1 developer kit.[294][295]2015: Microsoft, HoloLens augmented reality headset. 2016: Niantic released Pokémon Go for iOS and Android, the most popular smartphone applications and augmented reality games.2017: Magic Leap, Digital Lightfield technology 2019: Microsoft, HoloLens 2, improvements of FOV and ergonomics.
Industrial augmented reality
1990: Thomas Caudell, U of New Mexico, and David Mizell, Introduced the term 'Augmented Reality', Boeing research project.
The term "augmented reality" was coined at Boeing in 1990 by researcher Tom Caudell. He and a colleague, David Mizell, were asked to come up with an alternative to the expensive diagrams and marking devices then used to guide workers on the factory floor. They proposed replacing the large plywood boards, which contained individually designed wiring instructions for each plane, with a head-mounted apparatus that would display a plane's specific schematics through high-tech eyeware and project them onto multipurpose, reusable boards. Instead of reconfiguring each plywood board manually in each step of the manufacturing process, the customized wiring instructions would essentially be worn by the worker and altered quickly and efficiently through a computer system.
http://www.idemployee.id.tue.nl/g.w.m.rauterberg/presentations/hci-history/tsld096.htmhttps://slideplayer.com/slide/5360548/
https://slideplayer.com/slide/5360548/
Factory workers at Boeing using traditional wiring instructions vs an AR headset to wire aeroplanes
https://slideplayer.com/slide/5360548/
Divid Mizell, Intel Research Slides
https://slideplayer.com/slide/5360548/
Divid Mizell, Intel Research Slides
https://slideplayer.com/slide/5360548/
Divid Mizell, Intel Research Slides
https://slideplayer.com/slide/5360548/
Divid Mizell, Intel Research Slides
https://slideplayer.com/slide/5360548/
Divid Mizell, Intel Research Slides
https://slideplayer.com/slide/5360548/
Divid Mizell, Intel Research Slides
https://slideplayer.com/slide/5360548/
Divid Mizell, Intel Research Slides
https://slideplayer.com/slide/5360548/
Divid Mizell, Intel Research Slides
https://www.boeing.com/features/2018/01/augmented-reality-01-18.page
Boeing Tests Augmented Reality in the Factory
1838Charles Wheatstone
Wheatstone Stereoscope
Leonardo Da Vinci, The eye — which sees all objects reversed — retains the images for some time. This conclusion is proved by the results; because, the eye having gazed at light retains some impression of it. After looking (at it) there remain in the eye images of intense brightness, that make any less brilliant spot seem dark until the eye has lost the last trace of the impression of the stronger light.
Leonardo Da Vinci commented about what happens when you look at an object. He realised that each eye sees something different.
Leonardo di ser Piero da Vinci (April 15, 1452 – May 2, 1519)Italian Renaissance
https://artefactual.co.uk/tag/charles-wheatstone/https://en.wikiquote.org/wiki/Leonardo_da_Vinci
1839David Brewster
Lenticular Stereoscope
https://en.wikipedia.org/wiki/Stereoscope
Brewster-type stereoscope, 1870
Stereoscope
https://en.wikipedia.org/wiki/Stereoscopehttps://en.wikipedia.org/wiki/Stereoscopy
https://en.wikipedia.org/wiki/Stereoscopy#/media/File:Strereoscope-_Western_Wall_Jerusalem.jpgA company of ladies looking at stereoscopic views, painting by Jacob Spoel, before 1868
https://en.wikipedia.org/wiki/Stereoscopy#/media/File:Strereoscope-_Western_Wall_Jerusalem.jpg
1901L. Frank Baum
The Wonderful Wizard of Oz
https://en.wikipedia.org/wiki/L._Frank_Baum#cite_note-34
An American children's novel written by author L. Frank Baum and illustrated by W. W. Denslow, originally published by the George M. Hill Company in May 1900
The Wonderful Wizard of Oz, This stage version opened in Chicago in 1902
The Fairylogue and Radio-Plays (1908), which combined a slideshow, film, and live actors with a lecture by Baum as if he were giving a travelogue to Oz
https://www.youtube.com/watch?v=C1PfVVFq97I
The Wizard of Oz is a 1939 produced by MGM. Directed primarily by Victor Fleming
1906-1911Ray Harroun
Indy 500 race on Decoration Day (Memorial Day)
first rear-view mirror.
Ray Harroun’s idea was that by ditching his mechanic, the guy who’s main job during the race was to tell him it was clear to pass, he dumped around 160 pounds of weight. Replacing that man with a mirror would have been brilliant, had the race track not been so cobbled it shook beyond use. Harroun’s mirror was worthless to him because he couldn’t see anything in it.
https://orangebeanindiana.com/2018/10/11/rearview-mirror-invented/https://historygarage.com/history-rear-view-mirror-driving-faster/
https://en.wikipedia.org/wiki/Rear-view_mirror
https://orangebeanindiana.com/2018/10/11/rearview-mirror-invented/https://historygarage.com/history-rear-view-mirror-driving-faster/
https://en.wikipedia.org/wiki/Rear-view_mirror
The general claim of “first rear-view mirror” is disputed by some auto historians, who note that there was mention of a potential driving mirror in a 1906 trade magazine.
1950-60Morton Healing
First head mounted display or hmdThe telesphere mask
http://uschefnerarchive.com/mortonheilig/Morton Leonard Heilig patented the Sensorama in 1962
http://uschefnerarchive.com/mortonheilig/Morton Leonard Heilig patented the Sensorama in 1962
http://uschefnerarchive.com/mortonheilig/Morton Leonard Heilig patented the Sensorama in 1962
https://timelineofphotography.wordpress.com/View-Master 1939 New York World’s Fair
https://www.youtube.com/watch?v=vSINEBZNCksMorton Heilig's Sensorama Interview
https://vimeo.com/246184069https://www.youtube.com/watch?v=vSINEBZNCks
Morton Heilig’s Sensorama Promo late 1980’s
1961Philco
HMD for surveillance through telepresence
Philco Safari First Portable Battery Operated Television
1961, Philco: HMD for surveillance through telepresence, 1961 Philco Headsight television system provides remote surveillance, CP Comeau, JS Bryan - Electronics, Nov, 1961 The Philco HMD was part of the Philco "Headsight TV Surveillance System" and was mounted in a building, not portable or wearable.
https://en.wikipedia.org/wiki/Philcohttps://collection.cooperhewitt.org/objects/18796291/
https://www.worthpoint.com/worthopedia/vintage-1959-philco-safari-model-h-2010-tvhttp://wearcam.org/ar/
https://www.youtube.com/watch?v=VgVYiuLZ47ghttps://www.youtube.com/watch?v=U5eAIEO4fPk
1959 Philco Safari Model H-2010
1960’sBell Helicopter Company
Early camera-based augmented-reality systems.
Bell Helicopter Company, in 1960’s, performed several early camera-based augmented-reality systems. In one, the head-mounted display was coupled with an infrared camera that would give military helicopter pilots the ability to land at night in rough terrain. An infrared camera, which moved as the pilot’s head moved, was mounted on the bottom of a helicopter. The pilot’s field of view was that of the camera.
http://www.bellflight.com/https://en.wikipedia.org/wiki/Bell_Helicopter
1965 and 1968 Ivan Sutherland
Head Mounted Displays (HMD)The Sword of Damocles
VR/AR
https://www.youtube.com/watch?v=Hp7YgZAHLos
Ivan Sutherland Virtual Reality in the 1960'sFirst Head mounted display 1965 The Sword of Damocles
https://www.youtube.com/watch?v=Y2AIDHjylMIIvan Sutherland Virtual Reality lecture on March 19, 1996, and Proto Awards 2015
1971Perkinelmer company
Head mounted display
Figure3showsone helmetmountconfiguration.Figure4 sho� ... s ahelmetmountattachedtotheArmy'5ne,"SPH-4helmet.TheSPH-4ismorestableon theheadthanorevioushel metsbecauseof an internalheadharnessdesignthatcan be adjustedto thein dividual.
https://www.youtube.com/watch?v=Y2AIDHjylMI&t=660shttp://archives.rotor.com/documents/PUBLICATIONS/DOC102209-033.pdf
https://www.youtube.com/watch?v=Y2AIDHjylMI&t=660shttp://archives.rotor.com/documents/PUBLICATIONS/DOC102209-033.pdf
1970 and 80’Phenomenal Augmented Reality
https://www.youtube.com/watch?v=Hp7YgZAHLos
Steve Mann, PHENOMENAmplification as a visual art form in the 1980s
1975Myron Krueger
Videoplace
http://thedigitalage.pbworks.com/w/page/22039083/Myron%20Kruegerhttps://www.youtube.com/watch?v=d4DUIeXSEpk
Myron Krueger, VIDEOPLACE University of Connecticut
1977George Lucas
Star WarsR2-D2 a holographic recording of Leia
https://en.wikipedia.org/wiki/Star_Wars_(film)https://www.youtube.com/watch?v=8N_Cj3ZS9-A
Star Wars (retroactively titled Star Wars: Episode IV – A New Hope) is a 1977 American epic space opera film written and directed by George Lucas, produced by Lucasfilm and distributed by 20th Century-Fox.
Princess Leia's hologram message.
https://www.youtube.com/watch?v=C1PfVVFq97I
The Wizard of Oz is a 1939 produced by MGM. Directed primarily by Victor Fleming
1977GUI (Graphical user interface)
GUI is a type of user interface that allows users to interact with electronic devices through graphical icons and visual indicators, instead of text-based user interfaces.
https://en.wikipedia.org/wiki/History_of_the_graphical_user_interface
http://www.computerhistory.org/revolution/input-output/14/348
GUI technology being developed at Xerox PARC, Jobs had negotiated a visit to see the Xerox Alto computer and Smalltalk development tools in exchange for Apple stock options. The Lisa and Macintosh user interfaces were partially influenced by technology seen at Xerox PARC and were combined with the Macintosh group's own ideas.
http://www.computerhistory.org/revolution/input-output/14/348
Apple Lisa, 1984 Ca.
Xerox PARC: Dorado Smalltalk, 1979
VS
http://www.computerhistory.org/revolution/input-output/14/348
1990The MIT Wearable Computing Project
1992Steven Feiner, Blair MacIntyre and Doree Seligmann, Columbia Univ
AR system prototype, KARMAKARMA Knowledge-based
Augmented Reality for Maintenance Assistance
https://www.academia.edu/2758388/Knowledge-based_augmented_realityhttps://graphics.cs.columbia.edu/projects/karma/karma.html
Steven Feiner, Blair MacIntyre, Dorée Seligmann, KARMA (Knowledge-based Augmented Reality for Maintenance Assistance)
1993Wearable HDR combined with
panoramics:
1993Thad Starner’s
“Tin Lizzy” wearable computer
1994-Steve Mann
Wearable Wireless Webcam
In 1989, sold by Reflection Technology, Private Eye head-mounted display scanned a vertical array of LEDs across the visual field using a vibrating mirror. The monochrome screen is 1.25-inches on the diagonal, but images appear to be a 15-inch display at 18-inches distance.
19982000
2005
2008
2009 2013: Meta Eyewear 2013: Google Glass
AR by Natural User Interface with 3D Gesture-based wearable computing, S. Mann, 1997, IEEE Computer, Vol. 30, No. 2, pp25-32.
1999, Mann: Contact lens display2000, Mann, Desjardins, and Spence: Implantable Camera System for the visually-impaired http://wearcam.org/ar/
http://www.media.mit.edu/wearables/lizzy/timeline.htmlhttp://www.irma-international.org/viewtitle/10158/
https://docs.google.com/viewer?url=patentimages.storage.googleapis.com/pdfs/US2388170.pdfhttps://docs.google.com/viewer?url=patentimages.storage.googleapis.com/pdfs/US2955156.pdf
http://www.mortonheilig.com/SensoramaPatent.pdfhttp://90.146.8.18/en/archiv_files/19902/E1990b_123.pdf
EyeTap inventor Steve Mann wearing a metal frame Laser EyeTap (computer-controlled laser light source run from "GlassEye" camera)
Man wearing a one-eyed injection-molded EyeTap
https://en.wikipedia.org/wiki/EyeTap
3 different types of AR
Marker-based / Markerless /Location based
https://en.wikipedia.org/wiki/Augmented_realityhttps://www.blippar.com/blog/2018/08/14/marker-based-markerless-or-location-based-ar-different-types-of-ar
https://library.vuforia.com/content/vuforia-library/en/features/images/image-targets/best-practices-for-designing-and-developing-image-based-targets.html
Marker-based AR (Image Targets)
The digital world is anchored to the real world. We call the distinctive picture that can be recognised by the device, the marker. A marker can be anything, as long as it has enough unique visual points.
QR code,
https://library.vuforia.com/content/vuforia-library/en/features/images/image-targets/best-practices-for-designing-and-developing-image-based-targets.html
Figure A – Image Target with coordinate axes for explanation. This image is fed into the online Target Manager to create the target database. Figure B – Image showing the natural features that the Vuforia Engine uses to detect the image target.
https://en.wikipedia.org/wiki/Augmented_reality
Markerless AR
The user moves the virtual objects
Imagine an AR application that can place virtual furniture inside your living room. This allows you to try different combinations of objects, styles and location. For this application, the user needs to decide where to place the virtual object. This is called “markerless AR”.
https://en.wikipedia.org/wiki/Synthetic_vision_systemhttps://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20080018605.pdf
https://www.microsoft.com/en-us/hololens/buy
Synthetic vision system
Location based AR
the virtual world is in a physical space
Location based AR ties augmented reality content to a specific location.
https://www.wikitude.com/geo-augmented-reality/
Figure A – Image Target with coordinate axes for explanation. This image is fed into the online Target Manager to create the target database. Figure B – Image showing the natural features that the Vuforia Engine uses to detect the image target.
https://niantic.helpshift.com/a/pokemon-go/?s=accessories&f=catching-pokemon-in-ar-mode&l=en&p=webhttps://www.magicleap.com/en-us/enterprise/solutions/spatial
https://www.youtube.com/watch?v=5iTLN3AuBwsSigur Rós in collaboration with Magic Leap Studios | Tónandi
AR / Geolocation / GeotaggingLocation-based AR
To specific locations in the real-world
https://www.wikitude.com/products/wikitude-sdk-features/https://en.wikipedia.org/wiki/Geotagginghttps://en.wikipedia.org/wiki/Geolocation
GeoLocation
GeoLocation consists of latitude and longitude and an optional altitude property. If the altitude is not specified, the altitude will be set to AR.
Depending on the use case, location is used via GPS, network or beacon. Geo AR is the ideal feature for gaming, navigation, retail, tourism, communication, and more.
https://www.wikitude.com/geo-augmented-reality/
Indoor positioning system
An indoor positioning system (IPS) is a network of devices used to locate people or objects where GPS and other satellite technologies lack precision or fail entirely, such as inside multistory buildings, airports, alleys, parking garages, and underground locations.
https://en.wikipedia.org/wiki/Indoor_positioning_system
Indoor positioning system
A large variety of techniques and devices are used to provide indoor positioning ranging from reconfigured devices already deployed such as smartphones, WiFi and Bluetooth antennas, digital cameras, and clocks; to purpose built installations with relays and beacons strategically placed throughout a defined space.
https://en.wikipedia.org/wiki/Indoor_positioning_system
Indoor vs. Outdoor vs. Virtual Space
https://en.wikipedia.org/wiki/Geotagginghttps://www.wikitude.com/geo-augmented-reality/
https://www.google.com/maps/d/u/0/viewer?ie=UTF8&hl=en&msa=0&ll=42.45031308470501%2C-76.47474611027621&spn=0.003444%2C0.009313&z=17&mid=1CldU0O1vaJS9hnD-YIDKwOww-K8
https://en.wikipedia.org/wiki/Location-based_game
https://www.pointr.tech/https://litlong.org/welcome
https://apps.apple.com/us/app/curious-edinburgh/id1113602530?ls=1http://www.walkingthroughtime.co.uk/
QR Codes, RFID, Beacon, and NFC
https://www.meetingplay.com/blog/qr-rfid-beacon-nfc
Beacon vs. NFC
http://zugara.com/beacon-vs-nfc-infographic
https://www.getelastic.com/mobile-commerce-ibeacon-vs-nfc-infographics
http://zugara.com/beacon-vs-nfc-infographic
https://www.getelastic.com/mobile-commerce-ibeacon-vs-nfc-infographics
http://zugara.com/beacon-vs-nfc-infographic
https://www.getelastic.com/mobile-commerce-ibeacon-vs-nfc-infographics
Indoor positioning with Bluetooth beacons
https://www.wikitude.com/geo-augmented-reality/
https://www.scape.io/https://medium.com/scape-technologies/designing-large-scale-ar-apps-with-scapekit-a3bce1be1fbc
XRStandards and Best practice
https://xra.org/
https://developer.apple.com/design/human-interface-guidelines/ios/system-capabilities/augmented-reality/https://developers.google.com/ar
https://docs.microsoft.com/en-us/windows/mixed-reality/https://developer.magicleap.com/en-us/learn/guides/design-principles
Designing for the User’s Environmentreviews the concept of designing for many different environments and considerations about people may use the app, including the private space of a room or the vast openness of a real-world environment.
https://xra.org/
Designing for the User’s Experiencedetails how users are just beginning to become familiar with a 360-degree XR environment and reviews considerations for how users may expect to consume augmented experiences.
https://xra.org/
SURFACESSmartphone AR software platforms are constantly improving their understanding of the real-world environment. They can cluster and recognize feature points that appear to lie on common horizontal and angled surfaces and make these surfaces available to the app as planes.
LIGHTINGAR requires an exceptional level of detail to overlay believable-looking objects onto real- world environments. Accurately detecting the light type, source, and intensity are important components of selling realism.
https://xra.org/
USER MOVEMENTUsers are just beginning to become familiar with 360-degree XR environments. When initially engaging in smartphone AR experiences, they tend to remain stationary due to habits built by 2D mobile interactions.
Based on each user’s environment and comfort level, their movement while using a smartphone AR application can go through four phases:1. Seated, with hands fixed2. Seated, with hands moving 3. Stationary with hands fixed 4. Full range of motion
ACCESSIBILITY AND EASE OF ACCESS
USER COMFORT
REDUCING USER FRUSTRATIONhttps://xra.org/
OPTIMAL PLACEMENT RANGEAn optimal placement range indicator helps ensure that the user will place an object at a comfortable viewing distance. Guide users to optimal object placement by clearly labeling regions of the screen, setting maximum placement distance defaults and using visual indicators for object destinations.
Scene Staging
Maximum Placement Distance
Destination Point
https://xra.org/
TYPES OF OBJECT PLACEMENTObjects in AR can be placed automatically or manually.
Auto Placement
Manual PlacementTap-to-PlaceDrag-to-PlaceFree Placement
https://xra.org/
MANIPULATING VIRTUAL OBJECTSAny interactive objects placed by the user in a scene should be easily manipulated, from selecting the object, to moving it between surfaces, to scaling it larger or smaller.Selection, Translation, Multi-Surface Translation, Translation Limits
ROTATIONRotation is the ability to orient the object in a desired direction. Rotation can be either auto or manual.Manual Rotation, Auto-Rotation
SCALINGScaling is the ability to increase or decrease the size of an object, most commonly with a pinch gesture.Constraints, Scale and Gameplay
https://xra.org/
VOLUMETRIC INTERFACE DESIGNVolumetric interfaces allow users to interact with objects that appear to have three- dimensional depth. Volumetric interfaces necessitate a range of design considerations.Gestures, Proximity, Accidental Gestures
MAINTAINING IMMERSION
MAINTAINING IMMERSIONDesign for an immersive experience, but empower users to feel in control.
Allow users to perform primary and secondary tasks within the app.
https://xra.org/
ONBOARDING AND INSTRUCTIONSAllow users to launch the smartphone AR experience quickly and teach users how to perform key tasks contextually in the first-run experience. This will tie helpful instructions to relevant tasks and build retention.
FAMILIARITY (Jakob’s Law)Leverage familiar UI patterns and conventions. Align to standard UX interaction models and patterns without breaking the immersiveness of the experience. This will help reduce the need for providing instructions or detailed onboarding.
LANDSCAPE AND PORTRAIT MODESCamera and button placementLayoutOne-mode supportKey target placement
https://xra.org/
AUDIO EXPLORATIONAudio can encourage engagement and enhance the user’s experience. Be mindful of the following though while infusing audio in 3D objects or the 360-degree environmentAvoid playing sounds simultaneously.Add attenuation for sound effects.
VISUAL EXPLORATIONVisual or audio cues can encourage off- screen exploration. For example, a bird flying off-screen until the user brings it back in the scene can help direct the user to complete the intended goal.
https://xra.org/
AVOIDING VISIBLE DEPTH COLLISIONSTo avoid depth collisions — when a virtual object appears to intersect a real-world object — be mindful of reasonable room sizes and the various environments in which users will use the app. Set expectations up front by clearly communicating how much space is needed for the experience, from a tabletop, to an entire room, to a world-scale space.
Carry over from VR:● Occlusion● Collision● Teaching the control scheme
https://nianticlabs.com/en/blog/nrwp-update-110619/https://xra.org/
Snapchat / Lens Studio
https://lensstudio.snapchat.com/guides/general/panels/https://lensstudio.snapchat.com/guides/getting-started/
https://www.youtube.com/watch?v=ZkeQXpi_5Pg&feature=emb_logohttps://www.youtube.com/playlist?list=PL0rDQ-c-_kxcwwBccaz1N9Rmz_xgyijRg
https://lensstudio.snapchat.com/guides/general/panels/
Scene Object Inspector
Resources
Preview Scene Config Pair To Snapchat
Loggerhttps://lensstudio.snapchat.com/guides/general/panels/
Snapchat / Lens Studio /AR Landmarkers
https://lensstudio.snapchat.com/templates/landmarker/download/https://www.youtube.com/watch?v=s1aYoaQ3oe4
https://www.theverge.com/2019/4/4/18294062/snapchat-landmarkers-ar-lenses-filters-eiffel-tower-rainbows
https://lensstudio.snapchat.com/templates/landmarker/download/https://www.youtube.com/watch?v=s1aYoaQ3oe4
https://www.theverge.com/2019/4/4/18294062/snapchat-landmarkers-ar-lenses-filters-eiffel-tower-rainbows
Snapchat / Lens Studio /Face Mask
https://lensstudio.snapchat.com/guides/general/panels/https://lensstudio.snapchat.com/guides/getting-started/
