comp 4010 - lecture 1: introduction to virtual reality
TRANSCRIPT
![Page 1: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/1.jpg)
LECTURE 1: INTRODUCTION TO VIRTUAL REALITY
COMP 4010 - Virtual Reality July 26th 2016
Mark Billinghurst, Bruce Thomas University of South Australia
![Page 2: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/2.jpg)
Overview • Introduction • Class Overview • What is Virtual Reality? • History of Virtual Reality
![Page 3: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/3.jpg)
Lecturers • Mark Billinghurst
• Director of the Empathic Computing Lab • Expert in AR, 3D user interfaces
• Bruce Thomas • Director of the Wearable Computing Lab • Expert in AR/VR, wearable computing
• Teaching Assistants • Tham Piumsomboon (Unity expert) • Bradley Herbert (AR/Unity)
![Page 4: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/4.jpg)
Class Logistics • Weekly lecture (2 hrs)
• Tuesday 11am – 1pm • Room F1-16
• Weekly Lab (1 hr) • Tuesday 2-3pm
• Assessment • 3 projects @ 20%, 30%, 40% • Paper reading/class presentation @ 10%
• What you will need • iOS or Android phone/tablet • Google Cardboard VR display
![Page 5: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/5.jpg)
Google Cardboard
• Buy a cardboard viewer or compatible viewer ($10+)
![Page 6: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/6.jpg)
Unity3D
• Who has Unity3D Experience?
![Page 7: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/7.jpg)
Lecture Schedule – 13 Lectures • July 26th : 1. Introduction - (no lab) • Aug 2nd : 2. VR Technology – Intro to Unity • Aug 9th : 3. VR Content Creation – Intro to Cardboard SDK • Aug 16th : 4. VR Systems – Building VR scenes in Unity • Aug 23rd : 5. 3D User Interfaces – Scripting in Unity • Aug 30th : 6. Interaction Design – Navigation in VR • Sept 6th : 7. VR Applications – Interaction in VR • Sept 13th : 8. Introduction to AR – Interaction in VR • Oct 4th : 9. AR Tracking – Building Apps using ARToolKit • Oct 11th : 10. AR Interface Design – AR Tracking • Oct 18th : 11. Mobile AR – Handheld AR Interaction • Oct 25th : 12. AR Applications - Handheld AR Interaction • Nov 1st : 13. Research Directions - (no lab)
![Page 8: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/8.jpg)
Projects • Assignment One – VR Scene – August 23rd
• Create a VR scene with at least 10 objects in it • Include complex 3D models, texture, skybox, lighting, animations • Deploy to Google Cardboard
• Assignment Two – VR Interaction – September 13th • Add interactivity to the VR scene • Movement navigation • Ability to select and manipulation objects
• Assignment Three – AR Application – November 1st • Handheld AR application • Using image based tracking • Screen based interaction techniques
![Page 9: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/9.jpg)
What You Will Learn • What Augmented Reality/Virtual Reality is • History of AR/VR • Current AR/VR commercial market • Different AR/VR applications • Human perception side of VR/AR • AR/VR technology • 3D user interface guidelines • How to design good AR/VR experiences • How to build your own AR/VR applications • Important directions for future research in AR/VR
![Page 10: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/10.jpg)
WHAT IS VIRTUAL REALITY?
![Page 11: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/11.jpg)
Ivan Sutherland (1963)
• Sketchpad – first interactive graphics program
![Page 12: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/12.jpg)
Ivan Sutherland Sketchpad Demo
• https://www.youtube.com/watch?v=DWAIp3t6SLU
![Page 13: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/13.jpg)
The Ultimate Display “The ultimate display would, of course, be a room within which the computer can control the existence of matter. A chair displayed in such a room would be good enough to sit in. Handcuffs displayed in such a room would be confining, and a bullet displayed in such a room would be fatal”.
Ivan Sutherland, 1965
![Page 14: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/14.jpg)
An Invisible Interface
![Page 15: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/15.jpg)
Holodeck (1974)
• First shown in Star Trek; The Animated Series
![Page 16: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/16.jpg)
HoloDeck Video
• https://www.youtube.com/watch?v=oZwtVz7z0wM
![Page 17: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/17.jpg)
Trend Towards Invisible Interfaces
• Trend from room scale to invisible computing • Making Computers Invisible
• hide the computer in the real world • Ubiquitous Computing
• put the user inside the computer • Virtual Reality
![Page 18: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/18.jpg)
Making Interfaces Invisible
Rekimoto, J. and Nagao, K. 1995. The world through the computer: computer augmented interaction with real world environments. In Proceedings of the 8th Annual ACM Symposium on User interface and Software Technology. UIST '95. ACM, New York, NY, 29-36.
![Page 19: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/19.jpg)
Graphical User Interfaces
• Separation between real and digital worlds • WIMP (Windows, Icons, Menus, Pointer) metaphor
![Page 20: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/20.jpg)
Ubiquitous Computing
• Computing and sensing embedded in real world • Particle devices, RFID, motes, arduino, etc
![Page 21: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/21.jpg)
Virtual Reality
• 1985…
![Page 22: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/22.jpg)
Virtual Reality
• Immersive VR • Head mounted display, gloves • Separation from the real world
![Page 23: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/23.jpg)
What is Virtual Reality?
![Page 24: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/24.jpg)
VR Goggles and Gloves
• https://www.youtube.com/watch?v=Ak-Bt7IM8Jc
![Page 25: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/25.jpg)
Types of VR
25
![Page 26: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/26.jpg)
Other Definitions Virtual reality is..
a computer technology that replicates an environment, real or imagined, and simulates a user's physical presence and environment to allow for user interaction. (Wikipedia)
electronic simulations of environments experienced via head mounted eye goggles and wired clothing enabling the end user to interact in realistic three-dimensional situations. (Coates, 1992)
an alternate world filled with computer-generated images that respond to human movements. (Greenbaum, 1992)
an interactive, immersive experience generated by a computer (Pimental 1995)
![Page 27: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/27.jpg)
Key Characteristics for VR • Virtual Reality has three key characteristics
• 3D stereoscopic display • Wide field of view display • Low latency head tracking
• When these three things are combined they provide a compelling immersive experience
![Page 28: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/28.jpg)
Defining Characteristics
• https://www.youtube.com/watch?v=FPcbBJbGhmk
![Page 29: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/29.jpg)
VR Experience
• “This is so real..” • https://www.youtube.com/watch?v=pAC5SeNH8jw
![Page 30: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/30.jpg)
Defined in Terms of Presence
• Presence is the key to defining VR in terms of experience
• Presence is defined as the sense of being in an environment
• Telepresence is defined as the experience of presence in an environment by means of a communication medium.
• A “virtual reality” is defined as a real or simulated environment in which a perceiver experiences telepresence.
![Page 31: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/31.jpg)
David Zeltzer’s AIP Cube
! Autonomy – User can to react to events and stimuli.
! Interaction – User can interact with objects and environment.
! Presence – User feels immersed through sensory input and output channels
Interaction
Autonomy
Presence
VR
Zeltzer, D. (1992). Autonomy, interaction, and presence. Presence: Teleoperators & Virtual Environments, 1(1), 127-132.
![Page 32: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/32.jpg)
Defined in Terms of User Experience Inducing targeted behavior in an organism by using artificial sensory stimulation, while the organism has little or no awareness of the interference. (LaValle 2016) • Targeted Behavior: Having an experience designed by
another person. • Organism: Person or other life form • Artificial Sensory Stimulation: One or more sensors
replaced by artificial means • Awareness: Organism unaware of the interface
![Page 33: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/33.jpg)
Virtuix Omni – Human on VR Treadmill
• https://www.youtube.com/watch?v=aTtfAQEeAJI
![Page 34: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/34.jpg)
Fly on Treadmill – Insect VR
• Fruit fly on treadmill and VR display • https://www.youtube.com/watch?v=1ezL8nGo--I
![Page 35: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/35.jpg)
Augmented Reality
1977 – Star Wars
![Page 36: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/36.jpg)
Augmented Reality Definition
• Defining Characteristics [Azuma 97] • Combines Real and Virtual Images
• Both can be seen at the same time • Interactive in real-time
• The virtual content can be interacted with • Registered in 3D
• Virtual objects appear fixed in space
Azuma, R. T. (1997). A survey of augmented reality. Presence, 6(4), 355-385.
![Page 37: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/37.jpg)
2008 - CNN
https://www.youtube.com/watch?v=v7fQ_EsMJMs
![Page 38: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/38.jpg)
• Put AR pictures here
Augmented Reality Examples
![Page 39: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/39.jpg)
Pokemon GO..
![Page 40: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/40.jpg)
AR vs VR
![Page 41: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/41.jpg)
Making Interfaces Invisible
Rekimoto, J. and Nagao, K. 1995. The world through the computer: computer augmented interaction with real world environments. In Proceedings of the 8th Annual ACM Symposium on User interface and Software Technology. UIST '95. ACM, New York, NY, 29-36.
![Page 42: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/42.jpg)
From Reality to Virtual Reality
Ubiquitous Computing Augmented Reality Virtual Reality
![Page 43: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/43.jpg)
Milgram’s Reality-Virtuality continuum
Mixed Reality
Reality - Virtuality (RV) Continuum
Real Environment
Augmented Reality (AR)
Augmented Virtuality (AV)
Virtual Environment
"...anywhere between the extrema of the virtuality continuum."
P. Milgram and A. F. Kishino, Taxonomy of Mixed Reality Visual Displays IEICE Transactions on Information and Systems, E77-D(12), pp. 1321-1329, 1994.
![Page 44: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/44.jpg)
Augmented Virtuality
• VR with windows into the real world
![Page 45: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/45.jpg)
Other Context: The Metaverse
• Neal Stephenson’s “SnowCrash” • The Metaverse is the convergence of:
• 1) virtually enhanced physical reality • 2) physically persistent virtual space
• Metaverse Roadmap • http://metaverseroadmap.org/
![Page 46: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/46.jpg)
Metaverse Dimensions
• Augmentation technologies that layer information onto our perception of the physical environment.
• Simulation refers to technologies that model reality
• Intimate technologies are focused inwardly, on the identity and actions of the individual or object;
• External technologies are focused outwardly, towards the world at large;
![Page 47: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/47.jpg)
Metaverse Components
• Four Key Components • Virtual Worlds • Augmented Reality • Mirror Worlds • Lifelogging
![Page 48: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/48.jpg)
![Page 49: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/49.jpg)
Mirror Worlds
• Mirror worlds are informationally-enhanced virtual models of the physical world. • Google Earth, MS Street View, Google Maps
![Page 50: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/50.jpg)
Mark’s House in New Zealand
![Page 51: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/51.jpg)
LifeLogging
• Technologies record and report the intimate states and life histories of objects and users • Nokia LifeBlog, Nike+, FitBit
![Page 52: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/52.jpg)
Narrative Clip
• Wearable camera • Automatic picture capture - 2 pics/minute • http://getnarrative.com
![Page 53: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/53.jpg)
Summary
• Virtual Reality can be defined in a number of ways • In terms of technology • From a Presence perspective • In terms of User Experience
• VR can also be classified with other technologies • Invisible Interfaces • Milgram’s Mixed Reality continuum • MetaVerse
![Page 54: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/54.jpg)
HISTORY OF VR
![Page 55: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/55.jpg)
VR History Timeline
https://immersivelifeblog.files.wordpress.com/2015/04/vr_history.jpg
![Page 56: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/56.jpg)
When anything new comes along, everyone, like a child discovering the world thinks that they’ve invented it, but you scratch a little and you find a caveman scratching on a wall is creating virtual reality in a sense.
Morton Helig (Hammit 1993)
![Page 57: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/57.jpg)
Early History (30,000 BC - )
The history of VR is rooted in human’s first attempts to reproduce the world around them
![Page 58: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/58.jpg)
1800’s – Capturing Reality • Panoramas (1790s)
• Immersive paintings
• Photography (1820-30s) • Oldest surviving photo (Niépce, 1826)
• Stereo imagery (1830s) • Wheatstone (1832) • Brewster (1851)
• Movies (1870s) • Muybridge (1878) • Roundhay Garden Scene (1888)
![Page 59: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/59.jpg)
Stereo Viewers
Wheatstone (1832) Brewster (1860)
![Page 60: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/60.jpg)
Viewmaster (1939)
![Page 61: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/61.jpg)
3D Cinema Golden Era (1950-60s)
• Polarized 3D projection or anaglyph (red/blue)
![Page 62: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/62.jpg)
1900s – Interactive Experiences • Early Simulators (<1960s)
• Flight simulation • Sensorama (1955)
• Early HMDs (1960s) • Philco, Ivan Sutherland
• Military + University Research (1970-80s) • US Airforce, NASA, MIT, UNC
• First Commercial Wave (1980-90s) • VPL, Virtual i-O, Division, Virtuality • VR Arcades, Virtual Boy
![Page 63: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/63.jpg)
Pygmalion's Spectacles (1935) • Stanley Weinbaum Short Story • Main character, Dan Burke, tries
a pair of goggles
The goggle provide: "a movie that gives one sight and sound [...] taste, smell, and touch. [...] You are in the story, you speak to the shadows (characters) and they reply, and instead of being on a screen, the story is all about you, and you are in it."
![Page 64: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/64.jpg)
Link Trainer (1929 – 1950s)
• Flight Simulator Training • Full six degree of freedom rotation • Force feedback and motion control • Simulated instruments • Modeling common flight conditions
• Over 500,000 pilots trained
![Page 65: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/65.jpg)
Link Trainer Video (1966)
• https://www.youtube.com/watch?v=MEKkVg9NqGM
![Page 66: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/66.jpg)
Sensorama (1955) • Created by Morton Heilig • Experience Theater • Multi-sensory
• Visuals • Sound • Wind • Vibration • Smell
• No financial support • Commercial failure
![Page 67: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/67.jpg)
Sensorama Video
• https://www.youtube.com/watch?v=vSINEBZNCks
![Page 68: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/68.jpg)
Early HMD Patents
![Page 69: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/69.jpg)
First HMD (1961)
• Philco Headsight– Remote Camera Viewing • Components – HMD,closed circuit television • Custom magnetic tracking for head orientation
![Page 70: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/70.jpg)
Ivan Sutherland (1960s)
70
Ivan Sutherland’s Head-Mounted Display (1968)
![Page 71: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/71.jpg)
Sutherland Display
https://www.youtube.com/watch?v=NtwZXGprxag
![Page 72: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/72.jpg)
Super Cockpit (1965-80’s) • US Airforce Research Program
• Wright Patterson Air Force Base
• Tom Furness III • Multisensory
• Visual, auditory, tactile • Head, eye, speech, and hand input
• Addressing pilot information overload • Flight controls and tasks too complicated
• Research only • big system, not safe for ejecting
![Page 73: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/73.jpg)
![Page 74: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/74.jpg)
UNC Haptic Systems (1967 – 80’s) • Haptic/kinesthetic display system
• 6D force fields of molecular structures
• Progression • Grope I, simple fields, particle feedback • Grope II, 1978, children’s building blocks • Grope III, late 80’s, Remote Manipulator
• Sarcos arm
![Page 75: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/75.jpg)
StarWars (1977)
• Use of 3D graphics and AR interfaces
![Page 76: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/76.jpg)
Aspen Movie Map (1978) • Andrew Lippman, MIT • Car driven through Aspen
• 4 stop motion cameras • Pictures every 10 feet
• Interactive playback • Played from laserdisc, touch screen • People able to navigation in any direction • Map interface • 3D graphics overlay
• Early version of Google StreetView
![Page 77: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/77.jpg)
Aspen Movie Map Demo
• https://www.youtube.com/watch?v=X5Oj4S_x2Cc
![Page 78: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/78.jpg)
VideoPlace (1975-80’s) • Myron Krueger • Graphics/gesture recognition
• Real time interaction
• VideoDesk • camera captures gestures • relays to remote collaborator • gestures control graphics • paint, draw, menu selection
• Wrote Book – Artificial Reality 2
![Page 79: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/79.jpg)
VideoPlace Demo
• https://www.youtube.com/watch?v=dqZyZrN3Pl0
![Page 80: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/80.jpg)
LEEP Optics (1979)
• Large Expanse, Extra Perspective optics • Developed by Eric Howlett
• Lens design for extremely wide field of view • High resolution in centre, lower resolution in periphery • 90o direct FOV, 140o corneal FOV
• Used as basis for most VR HMDs
![Page 81: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/81.jpg)
LEEP Optics Design
![Page 82: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/82.jpg)
Tron (1982)
• asdfa
![Page 83: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/83.jpg)
The Data Glove (1981-82) • Precursor, Sayre Glove
• Univ. of Illinois, 1977 • Thomas Zimmerman (1982) • Fiber optic bend sensors
• Detecting finger bending • Commercialized by VPL
• Mattel PowerGlove (1989)
![Page 84: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/84.jpg)
VPL DataGlove Demo
• https://www.youtube.com/watch?v=fs3AhNr5o6o
![Page 85: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/85.jpg)
NASA VIEW/VIVED (1981-86) • Early HMD (McGreevy Humphries)
• LCD “Watchman” displays
• VIEW (Scott Fisher) • Polhemus tracker • LEEP-based HMD • 3D audio (Convolvotron) • DataGlove gesture input • Simple graphics
![Page 86: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/86.jpg)
Virtual Interface Environment Workstation
• Motorbike helmet + LEEP
![Page 87: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/87.jpg)
Jaron Lanier
• Founded VPL, coined term “Virtual Reality”
![Page 88: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/88.jpg)
VPL Research (1985 – 1999)
• First Commercial VR Company • Jaron Lanier, Jean-Jacques Grimaud
• Provided complete systems • Displays, software, gloves, etc • DataGlove, EyePhone, AudioSphere
![Page 89: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/89.jpg)
The University of North Carolina at Chapel Hill (1980s-1990s)
89
Head-Mounted Displays Tracking, Haptics, Applications
![Page 90: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/90.jpg)
University of Washington (1989 - )
• Human Interface Technology Laboratory (HIT Lab) • Founded by Tom Furness III
• Many AR/VR Innovations • Virtual Retinal Display • ARToolKit AR Tracking library • GreenSpace shared VR experience • VR and pain care • VR and Education
![Page 91: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/91.jpg)
The Virtual Retinal Display (1991)
• Image scanned onto retina • Commercialized through Microvision
• Nomad System - www.mvis.com • Lead to MagicLeap technology
![Page 92: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/92.jpg)
Lawnmower Man (1992)
![Page 93: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/93.jpg)
VR Learning in Lawnmower Man
• https://www.youtube.com/watch?v=zTrgHXNAs24
![Page 94: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/94.jpg)
CAVE (1992)
• Projection VR system • 3-6 wall stereo projection, viewpoint tracking • Developed at EVL, University of Illinois Chicago
• Commercialized by Mechdyne Corporation(1996)
C. Cruz-Neira, D. J. Sandin, T. A. DeFanti, R. V. Kenyon and J. C. Hart. "The CAVE: Audio Visual Experience Automatic Virtual Environment", Communications of the ACM, vol. 35(6), 1992, pp. 64–72.
![Page 95: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/95.jpg)
CAVE Demo Video
• https://www.youtube.com/watch?v=aKL0urEdtPU
![Page 96: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/96.jpg)
Desktop VR - 1995 • Expensive - $150,000+ • 2 million polys/sec • VGA HMD – 30 Hz • Magnetic tracking
![Page 97: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/97.jpg)
Virtual Reality was HOT! .. In 1995..
![Page 98: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/98.jpg)
My VR Predictions (1996)
• I knew everyone would use VR when: • HMDs were cheap (<$500) • Computers generate millions of polys/sec • Tracking was inexpensive • Good 3D input devices
![Page 99: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/99.jpg)
Rise of Commercial VR Companies • W Industries/Virtuality (1985 - 97)
• Location based entertainment • Virtuality VR Arcades
• Division (1989 – 1998) • Turn key VR systems • Visual programming tools
• Virtual i-O (1993 -1997) • Inexpensive gamer HMDs
• Sense8 (1990 - 1998) • WorldToolKit, WorldUp • VR authoring tools
![Page 100: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/100.jpg)
Dactyl Nightmare
• https://www.youtube.com/watch?v=L60wgPuuDpE
![Page 101: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/101.jpg)
Overview of VR in the 1990’s
https://www.youtube.com/watch?v=tdAaU0CRHng&feature=youtu.be&t=1m51s
![Page 102: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/102.jpg)
![Page 103: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/103.jpg)
• April 2007 Computer World • VR Voted 7th on list of 21 biggest technology flops
• MS Bob #1
![Page 104: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/104.jpg)
Lessons Learned
• Don’t believe the hype • Not everything is better in VR
• Many factors determine technology acceptance • Human Centered Design/Design for users
• Need to move from Demo to Production • Profitable niche markets first
• Follow the money
![Page 105: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/105.jpg)
VR Second Wave (2010 - ) • Palmer Luckey
• HMD hacker • Mixed Reality Lab (MxR) intern
• Oculus Rift (2011 - ) • 2012 - $2.4 million kickstarter • 2014 - $2B acquisition FaceBook • $350 USD, 110o FOV
![Page 106: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/106.jpg)
The Oculus Kickstarter Video
• https://www.youtube.com/watch?v=aNSYscbxFAw
![Page 107: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/107.jpg)
Desktop VR in 2016 • Graphics Desktop
• $1,500 USD • >4 Billion poly/sec
• $600 HMD • 1080x1200, 90Hz
• Optical tracking • Room scale
![Page 108: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/108.jpg)
Oculus Rift
Sony Morpheus
HTC/Valve Vive
2016 - Rise of Consumer HMDs
![Page 109: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/109.jpg)
HTC Vive
• Room scale tracking • Gesture input devices
![Page 110: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/110.jpg)
Example Vive App – Tilt Brush
• https://www.youtube.com/watch?v=ijukZmYFX-0
![Page 111: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/111.jpg)
VR2GO (2013)
• MxR Lab • 3D print VR viewer for mobiles • Open source hardware + software • http://projects.ict.usc.edu/mxr/diy/vr2go/
• Early Mobile VR viewer
![Page 112: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/112.jpg)
Google Cardboard
• Released 2014 (Google 20% project) • >5 million shipped/given away • Easy to use developer tools
+ =
![Page 113: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/113.jpg)
Many Different Cardboard Viewers
![Page 114: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/114.jpg)
Multiple Mobile VR Viewers Available
![Page 115: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/115.jpg)
• zxcvz
![Page 116: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/116.jpg)
Gartner Hype Cycle (2016)
![Page 117: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/117.jpg)
Gartner Hype Cycle (2016)
![Page 118: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/118.jpg)
Projected HMD Sales
• asdf
![Page 119: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/119.jpg)
Market Size
![Page 120: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/120.jpg)
AR / VR Market Size
• sadf
![Page 121: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/121.jpg)
AR/VR Investments
• > $1 Billion USD from VCs, > 120 deals in US alone
![Page 122: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/122.jpg)
Companies
• sdfa
![Page 123: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/123.jpg)
• sdas
![Page 124: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/124.jpg)
Potential for Disruption (BDMI)
• asD
![Page 125: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/125.jpg)
Why 2016 won’t be like 1996 • It’s not just VR anymore • Huge amount of investment • Inexpensive hardware platforms • Easy to use content creation tools • New devices for input and output • Proven use cases – no more Hype!
• Most important: Focus on User Experience
![Page 126: COMP 4010 - Lecture 1: Introduction to Virtual Reality](https://reader034.vdocument.in/reader034/viewer/2022042422/587081d71a28ab57368b68dd/html5/thumbnails/126.jpg)
Conclusion • Virtual Reality has a long history
• > 50 years of HMDs, simulators
• Key elements for VR were in place by early 1990’s • Displays, tracking, input, graphics • Strong support from military, government, universities
• First commercial wave failed in late 1990’s • Too expensive, bad user experience, poor technology, etc
• We are now in second commercial wave • Better experience, Affordable hardware • Large commercial investment, Significant installed user base
• Will Virtual Reality be a commercial success this time?