Download - COMP 4010 Lecture 9 AR Interaction
![Page 1: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/1.jpg)
LECTURE 9: AR INTERACTIONCOMP 4010 – Virtual Reality
Semester 5 – 2017
Bruce Thomas, Mark BillinghurstUniversity of South Australia
October 12th 2017
![Page 2: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/2.jpg)
Augmented Reality Definition• Defining Characteristics [Azuma 97]
• Combines Real and Virtual Images• Both can be seen at the same time
• Interactive in real-time• The virtual content can be interacted with
• Registered in 3D• Virtual objects appear fixed in space
Azuma, R. T. (1997). A survey of augmented reality. Presence, 6(4), 355-385.
![Page 3: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/3.jpg)
Augmented Reality Technology
• Combining Real and Virtual Images• Display technologies
• Interactive in Real-Time• Input and interactive technologies
• Registered in 3D• Viewpoint tracking technologies
Display
Processing
Input Tracking
![Page 4: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/4.jpg)
AR INTERFACE DESIGN
![Page 5: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/5.jpg)
Interface Design Path
1/ Prototype Demonstration
2/ Adoption of Interaction Techniques from other interface metaphors
3/ Development of new interface metaphors appropriate to the medium
4/ Development of formal theoretical models for predicting and modeling user actions
Desktop WIMP
Virtual Reality
Augmented Reality
![Page 6: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/6.jpg)
AR Interaction• Designing AR System = Interface Design
• Using different input and output technologies
• Objective is a high quality of user experience• Ease of use and learning • Performance and satisfaction
![Page 7: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/7.jpg)
Interacting with AR Content• You can see spatially registered AR..
how can you interact with it?
![Page 8: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/8.jpg)
Types of AR Interaction
• Browsing Interfaces• simple (conceptually!), unobtrusive
• 3D AR Interfaces• expressive, creative, require attention
• Tangible Interfaces• Embedded into conventional environments
• Tangible AR• Combines TUI input + AR display
![Page 9: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/9.jpg)
AR Interfaces as Data Browsers
• 2D/3D virtual objects are registered in 3D• “VR in Real World”
• Interaction• 2D/3D virtual viewpoint control
• Applications• Visualization, training
![Page 10: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/10.jpg)
AR Information Browsers• Information is registered toreal-world context• Hand held AR displays
• Interaction• Manipulation of a window
into information space• Applications
• Context-aware information displays Rekimoto, et al. 1995
Rekimoto, J., & Nagao, K. (1995, December). The world through the computer: Computer augmented interaction with real world environments. In Proceedings of the 8th annual ACM symposium on User interface and software technology (pp. 29-36). ACM.
![Page 11: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/11.jpg)
NaviCam Demo
https://www.youtube.com/watch?v=S6XKPEexRbU
![Page 12: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/12.jpg)
Navicam Architecture
![Page 13: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/13.jpg)
Current AR Information Browsers• Mobile AR
• GPS + compass• Many Applications
• Layar• Wikitude• Acrossair • PressLite• Yelp• AR Car Finder• …
![Page 14: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/14.jpg)
Example Layar• AR Browser from Layar
• http://www.layar.com• AR browsing
• GPS + compass• 2D/3D object placement• Photos/live video• Community viewing
![Page 15: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/15.jpg)
![Page 16: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/16.jpg)
Advantages and Disadvantages
• Important class of AR interfaces• Wearable computers• AR simulation, training
• Limited interactivity• Modification of virtualcontent is difficult
![Page 17: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/17.jpg)
3D AR Interfaces
• Virtual objects displayed in 3D physical space and manipulated• HMDs and 6DOF head-tracking • 6DOF hand trackers for input
• Interaction• Viewpoint control• Traditional 3D user interface
interaction: manipulation, selection, etc.
Kiyokawa, et al. 1998
![Page 18: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/18.jpg)
AR 3D Interaction – VLEGO II
Kiyokawa, K., Iwasa, H., Takemura, H., & Yokoya, N. (1998, October). Collaborative immersive workspace through a shared augmented environment. In Proc. SPIE (Vol. 98, pp. 2-13).
![Page 19: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/19.jpg)
Recent Example: AR Graffiti
https://www.youtube.com/watch?v=d4WZpYFRhg4
![Page 20: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/20.jpg)
Advantages and Disadvantages• Important class of AR interfaces
• Entertainment, design, training• Advantages
• User can interact with 3D virtual object everywhere in space
• Natural, familiar interaction• Disadvantages
• Usually no tactile feedback• User has to use different devices for
virtual and physical objectsOshima, et al. 2000
![Page 21: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/21.jpg)
Augmented Surfaces and Tangible Interfaces
• Basic principles• Virtual objects are projected on a surface
• Physical objects are used as controls for virtual objects
• Support for collaboration
![Page 22: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/22.jpg)
Augmented Surfaces
• Rekimoto, et al. 1999• Front projection• Marker-based tracking• Multiple projection surfaces
Rekimoto, J., & Saitoh, M. (1999, May). Augmented surfaces: a spatially continuous work space for hybrid computing environments. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (pp. 378-385). ACM.
![Page 23: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/23.jpg)
Augmented Surfaces Demo
https://www.youtube.com/watch?v=r4g_fvnjVCA
![Page 24: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/24.jpg)
Tangible User Interfaces (Ishii 97)• Create digital shadows for physical objects
• Foreground• graspable UI
• Background• ambient interfaces
Ishii, H., & Ullmer, B. (1997, March). Tangible bits: towards seamless interfaces between people, bits and atoms. In Proceedings of the ACM SIGCHI Conference on Human factors in computing systems (pp. 234-241). ACM.
![Page 25: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/25.jpg)
Tangible Interfaces - Ambient• Dangling String
• Jeremijenko 1995• Ambient ethernet monitor• Relies on peripheral cues
• Ambient Fixtures• Dahley, Wisneski, Ishii 1998• Use natural material qualities
for information display
![Page 26: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/26.jpg)
Tangible Interface: Argroove (2000)
• Collaborative Instrument• Exploring Physically Based Interaction• Map physical actions to Midi output• Translation, rotation• Tilt, shake
Poupyrev, I., Berry, R., Kurumisawa, J., Nakao, K., Billinghurst, M., Airola, C., ... & Baldwin, L. (2000). Augmented groove: Collaborative jamming in augmented reality. In ACM SIGGRAPH 2000 Conference Abstracts and Applications (p. 77).
![Page 27: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/27.jpg)
ARgroove in Use
![Page 28: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/28.jpg)
Visual Feedback
•Continuous Visual Feedback is Key•Single Virtual Image Provides:
• Rotation• Tilt• Height
![Page 29: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/29.jpg)
i/O Brush (Ryokai, Marti, Ishii)
Ryokai, K., Marti, S., & Ishii, H. (2004, April). I/O brush: drawing with everyday objects as ink. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 303-310). ACM.
![Page 30: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/30.jpg)
i/O Brush Demo
https://www.youtube.com/watch?v=04v_v1gnyO8
![Page 31: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/31.jpg)
Other Examples• Triangles (Gorbert 1998)
• Triangular based story telling• ActiveCube (Kitamura 2000-)
• Cubes with sensors
![Page 32: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/32.jpg)
Lessons from Tangible Interfaces• Physical objects make us smart
• Norman’s “Things that Make Us Smart”• encode affordances, constraints
• Objects aid collaboration• establish shared meaning
• Objects increase understanding• serve as cognitive artifacts
![Page 33: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/33.jpg)
TUI Limitations• Difficult to change object properties
• can’t tell state of digital data• Limited display capabilities
• projection screen = 2D• dependent on physical display surface
• Separation between object and display• ARgroove
![Page 34: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/34.jpg)
Advantages and Disadvantages
• Advantages• Natural - users hands are used for interacting with both virtual and real objects.• No need for special purpose input devices
• Disadvantages• Interaction is limited only to 2D surface
• Full 3D interaction and manipulation is difficult
![Page 35: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/35.jpg)
Orthogonal Nature of AR Interfaces
![Page 36: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/36.jpg)
Back to the Real World
• AR overcomes limitation of TUIs• enhance display possibilities• merge task/display space• provide public and private views
• TUI + AR = Tangible AR• Apply TUI methods to AR interface design
![Page 37: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/37.jpg)
Space vs. Time - Multiplexed• Space-multiplexed
• Many devices each with one function• Quicker to use, more intuitive, clutter • Real Toolbox
• Time-multiplexed• One device with many functions
• Space efficient• mouse
![Page 38: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/38.jpg)
Tangible AR: Tiles (Space Multiplexed)
• Tiles semantics• data tiles• operation tiles
• Operation on tiles• proximity• spatial arrangements• space-multiplexed
Poupyrev, I., Tan, D. S., Billinghurst, M., Kato, H., Regenbrecht, H., & Tetsutani, N. (2001). Tiles: A Mixed Reality Authoring Interface. In Interact (Vol. 1, pp. 334-341).
![Page 39: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/39.jpg)
Space-multiplexed Interface
Data authoring in Tiles
![Page 40: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/40.jpg)
Proximity-based Interaction
![Page 41: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/41.jpg)
Tangible AR: Time-multiplexed Interaction• Use of natural physical object manipulations to control virtual objects
• VOMAR Demo• Catalog book:
• Turn over the page• Paddle operation:
• Push, shake, incline, hit, scoop
Kato, H., Billinghurst, M., Poupyrev, I., Tetsutani, N., & Tachibana, K. (2001). Tangible augmented reality for human computer interaction. In Proceedings of Nicograph 2001.
![Page 42: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/42.jpg)
VOMAR Interface
![Page 43: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/43.jpg)
Advantages and Disadvantages
• Advantages• Natural interaction with virtual and physical tools
• No need for special purpose input devices• Spatial interaction with virtual objects
• 3D manipulation with virtual objects anywhere in space
• Disadvantages• Requires Head Mounted Display
![Page 44: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/44.jpg)
Wrap-up
• Browsing Interfaces• simple (conceptually!), unobtrusive
• 3D AR Interfaces• expressive, creative, require attention
• Tangible Interfaces• Embedded into conventional environments
• Tangible AR• Combines TUI input + AR display
![Page 45: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/45.jpg)
DESIGNING AR SYSTEMS
![Page 46: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/46.jpg)
Basic Design Guides• Provide good conceptual model/Metaphor
• customers want to understand how UI works
• Make things visible• if object has function, interface should show it
• Map interface controls to customer’s model• infix -vs- postfix calculator -- whose model?
• Provide feedback• what you see is what you get!
![Page 47: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/47.jpg)
• Interface Components• Physical components• Display elements
• Visual/audio
• Interaction metaphors
Physical Elements
Display ElementsInteraction
MetaphorInput Output
AR Design Principles
![Page 48: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/48.jpg)
Tangible AR Metaphor
• AR overcomes limitation of TUIs• enhance display possibilities• merge task/display space• provide public and private views
• TUI + AR = Tangible AR• Apply TUI methods to AR interface design
![Page 49: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/49.jpg)
Tangible AR Design Principles
•Tangible AR Interfaces use TUI principles• Physical controllers for moving virtual content• Support for spatial 3D interaction techniques• Time and space multiplexed interaction• Support for multi-handed interaction• Match object affordances to task requirements• Support parallel activity with multiple objects• Allow collaboration between multiple users
![Page 50: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/50.jpg)
AR Design Space
Reality Virtual Reality
Augmented Reality
Physical Design Virtual Design
![Page 51: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/51.jpg)
Design of Objects• Objects
• Purposely built – affordances• “Found” – repurposed• Existing – already at use in marketplace
• Make affordances obvious (Norman)• Object affordances visible• Give feedback• Provide constraints• Use natural mapping• Use good cognitive model
![Page 52: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/52.jpg)
Object Design
![Page 53: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/53.jpg)
Affordances: to give a clue• Refers to an attribute of an object that allows people to know how to use it• e.g. a button invites pushing, a door handle affords pulling
• Norman (1988) used the term to discuss the design of everyday objects
• Since has been much popularised in interaction design to discuss how to design interface objects• e.g. scrollbars afford moving up and down, icons afford clicking
![Page 54: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/54.jpg)
Physical Affordances • Physical affordances:
How do the following physical objects afford? Are they obvious?
![Page 55: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/55.jpg)
‘Affordance’ and Interface Design?• Interfaces are virtual and do not have affordances like physical objects
• Norman argues it does not make sense to talk about interfaces in terms of ‘real’ affordances
• Instead interfaces are better conceptualized as ‘perceived’ affordances• Learned conventions of arbitrary mappings between action
and effect at the interface• Some mappings are better than others
![Page 56: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/56.jpg)
Virtual Affordances• Virtual affordances
How do the following screen objects afford?What if you were a novice user?Would you know what to do with them?
![Page 57: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/57.jpg)
•AR is mixture of physical affordance and virtual affordance
•Physical• Tangible controllers and objects
•Virtual• Virtual graphics and audio
![Page 58: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/58.jpg)
Case Study 1: 3D AR Lens
Goal: Develop a lens based AR interface
• MagicLenses• Developed at Xerox PARC in 1993• View a region of the workspace differently to the rest• Overlap MagicLenses to create composite effects
![Page 59: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/59.jpg)
3D MagicLenses
MagicLenses extended to 3D (Veiga et. al. 96)§ Volumetric and flat lenses
![Page 60: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/60.jpg)
AR Lens Design Principles
• Physical Components• Lens handle
• Virtual lens attached to real object
• Display Elements• Lens view
• Reveal layers in dataset
• Interaction Metaphor• Physically holding lens
Looser, J., Billinghurst, M., & Cockburn, A. (2004, June). Through the looking glass: the use of lenses as an interface tool for Augmented Reality interfaces. In Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia (pp. 204-211). ACM.
![Page 61: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/61.jpg)
3D AR Lenses: Model Viewer
§ Displays models made up of multiple parts§ Each part can be shown or hidden through the lens§ Allows the user to peer inside the model§ Maintains focus + context
![Page 62: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/62.jpg)
AR Lens Demo
https://www.youtube.com/watch?v=3zIq_qb8CSE&t=66s
![Page 63: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/63.jpg)
AR Lens Implementation
Stencil Buffer Outside Lens
Inside Lens Virtual Magnifying Glass
![Page 64: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/64.jpg)
AR FlexiLens
Real handles/controllers with flexible AR lens
![Page 65: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/65.jpg)
Techniques based on AR Lenses
§ Object Selection§ Select objects by targeting them with the lens
§ Information Filtering§ Show different representations through the lens§ Hide certain content to reduce clutter, look inside things
§ Move between AR and VR§ Transition along the reality-virtuality continuum§ Change our viewpoint to suit our needs
![Page 66: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/66.jpg)
Case Study 2 : LevelHead
• Block based game
![Page 67: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/67.jpg)
Case Study 2: LevelHead
• Physical Components• Real blocks
• Display Elements• Virtual person and rooms
• Interaction Metaphor• Blocks are rooms
![Page 68: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/68.jpg)
![Page 69: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/69.jpg)
LevelHead Demo
https://www.youtube.com/watch?v=5ks1u0A8xdU&t=74s
![Page 70: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/70.jpg)
Case Study 3: AR Chemistry (Fjeld 2002)• Tangible AR chemistry education
Fjeld, M., & Voegtli, B. M. (2002). Augmented chemistry: An interactive educational workbench. In Mixed and Augmented Reality, 2002. ISMAR 2002. Proceedings. International Symposium on (pp. 259-321). IEEE.
![Page 71: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/71.jpg)
Goal: An AR application to test molecular structure in chemistry
•Physical Components• Real book, rotation cube, scoop, tracking markers
•Display Elements• AR atoms and molecules
• Interaction Metaphor• Build your own molecule
![Page 72: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/72.jpg)
AR Chemistry Input Devices
![Page 73: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/73.jpg)
![Page 74: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/74.jpg)
AR Chemistry Demo
https://www.youtube.com/watch?v=2klsb4BNb-k
![Page 75: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/75.jpg)
Case Study 4: Transitional Interfaces
Goal: An AR interface supporting transitions from reality to virtual reality
•Physical Components• Real book
•Display Elements• AR and VR content
• Interaction Metaphor• Book pages hold virtual scenes
![Page 76: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/76.jpg)
Milgram’s Continuum (1994)
Reality(Tangible Interfaces)
Virtuality(Virtual Reality)
Augmented Reality (AR)
Augmented Virtuality (AV)
Mixed Reality (MR)
Central Hypothesis• The next generation of interfaces will support transitions
along the Reality-Virtuality continuum
![Page 77: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/77.jpg)
Transitions
• Interfaces of the future will need to support transitions along the RV continuum
• Augmented Reality is preferred for:• co-located collaboration
• Immersive Virtual Reality is preferred for:• experiencing world immersively (egocentric)• sharing views• remote collaboration
![Page 78: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/78.jpg)
The MagicBook
•Design Goals:•Allows user to move smoothly between reality and virtual reality
•Support collaboration
Billinghurst, M., Kato, H., & Poupyrev, I. (2001). The MagicBook: a transitional AR interface. Computers & Graphics, 25(5), 745-753.
![Page 79: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/79.jpg)
MagicBook Metaphor
![Page 80: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/80.jpg)
MagicBook Demo
https://www.youtube.com/watch?v=tNMljw0F-aw&t=42s
![Page 81: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/81.jpg)
Features
• Seamless transition between Reality and Virtuality• Reliance on real decreases as virtual increases
• Supports egocentric and exocentric views• User can pick appropriate view
• Computer becomes invisible• Consistent interface metaphors• Virtual content seems real
• Supports collaboration
![Page 82: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/82.jpg)
Collaboration in MagicBook
• Collaboration on multiple levels:• Physical Object• AR Object• Immersive Virtual Space
• Egocentric + exocentric collaboration• multiple multi-scale users
• Independent Views • Privacy, role division, scalability
![Page 83: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/83.jpg)
Technology
• Reality• No technology
• Augmented Reality• Camera – tracking• Switch – fly in
• Virtual Reality• Compass – tracking• Press pad – move• Switch – fly out
![Page 84: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/84.jpg)
Scientific Visualization
![Page 85: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/85.jpg)
Education
![Page 86: COMP 4010 Lecture 9 AR Interaction](https://reader035.vdocument.in/reader035/viewer/2022082211/5a6479807f8b9a2c568b47d1/html5/thumbnails/86.jpg)
Summary
•When designing AR interfaces, think of:• Physical Components
• Physical affordances
• Virtual Components• Virtual affordances
• Interface Metaphors• Tangible AR or similar