virtual reality applications pablo figueroa computing science department university of alberta
TRANSCRIPT
![Page 1: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/1.jpg)
Virtual Reality ApplicationsVirtual Reality Applications
Pablo Figueroa
Computing Science Department
University of Alberta
![Page 2: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/2.jpg)
ObjectivesObjectives
Overview of related research in VR
Discuss research problems I am interested
![Page 3: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/3.jpg)
What is a VR World?What is a VR World?
Virtual objects that – can be sensed by the user– can interact with the user• Seen, heard, touched, smelled, tasted
Minimal Requirements– 3D geometry
![Page 4: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/4.jpg)
Main IssuesMain Issues
HardwarePlatforms
SoftwarePlatforms
ApplicationDomain
InteractionTechniques
Realism
![Page 5: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/5.jpg)
Hardware PlatformsHardware Platforms
HardwarePlatforms
SoftwarePlatforms
ApplicationDomain
InteractionTechniques
Realism
![Page 6: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/6.jpg)
Hardware PlatformsHardware Platforms
DesktopFish tankImmersive– HMD based– CAVE based
Big projection spaces
...
![Page 7: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/7.jpg)
New DevicesNew Devices
Cubic MouseVirtual Retinal
DisplayVirtual Notepad
![Page 8: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/8.jpg)
Software PlatformsSoftware Platforms
HardwarePlatforms
SoftwarePlatforms
ApplicationDomain
InteractionTechniques
Realism
![Page 9: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/9.jpg)
Development EnvironmentsDevelopment Environments
VRMLJava3DOpenGLPerformerMRToolkit/MRObjectsDiverse, Maverik, MASSIVE, SVE, Dive,
VRJuggler, ...WorldToolKit, Vega, ...
PlusHardware Specific APIs
![Page 10: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/10.jpg)
ApplicationsApplications
HardwarePlatforms
SoftwarePlatforms
ApplicationDomain
InteractionTechniques
Realism
![Page 11: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/11.jpg)
Successful ApplicationsSuccessful Applications
SimulatorsIndustrial
designTreatment of
fears
![Page 12: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/12.jpg)
Successful Applications (2)Successful Applications (2)
Military Applications
![Page 13: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/13.jpg)
Successful Applications (3)Successful Applications (3)
EntertainmentInformation Visualization
![Page 14: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/14.jpg)
RealismRealism
HardwarePlatforms
SoftwarePlatforms
ApplicationDomain
InteractionTechniques
Realism
![Page 15: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/15.jpg)
RealismRealism
RepresentationAreas of Interest
![Page 16: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/16.jpg)
Realism (2)Realism (2)
Level-of-DetailImage-Based RenderingLayered-Depth Images
![Page 17: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/17.jpg)
Interaction TechniquesInteraction Techniques
HardwarePlatforms
SoftwarePlatforms
ApplicationDomain
InteractionTechniques
Realism
![Page 18: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/18.jpg)
Interaction TechniquesInteraction Techniques
Examples– Isolated– Families• Image plane• Proprioception
Classifications
![Page 19: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/19.jpg)
ITs: ExamplesITs: Examples
Go-goAperture SelectionDaisy menu
![Page 20: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/20.jpg)
ITs: Examples (2)ITs: Examples (2)
Image-plane
![Page 21: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/21.jpg)
ITs: Examples (3)ITs: Examples (3)
Proprioception
![Page 22: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/22.jpg)
ITs: ControlITs: Control
MenusWidgets
![Page 23: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/23.jpg)
ClassificationsClassifications
![Page 24: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/24.jpg)
What I am interested in…What I am interested in…
HardwarePlatforms
SoftwarePlatforms
ApplicationDomain
InteractionTechniques
Realism
![Page 25: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/25.jpg)
What I am interested in… (2)What I am interested in… (2)
Given that– VR applications should run in different
platforms– A VR application should use the interaction
techniques that best fit a specific platform
How VR applications can be adapted to different platforms?
![Page 26: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/26.jpg)
What I am interested in… (3)What I am interested in… (3)
Given that– VR applications are difficult to build,
because of the many details involved
How the development of VR applications can be facilitated to novice users?
![Page 27: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/27.jpg)
RetargetingRetargeting
Application Description
![Page 28: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/28.jpg)
Application Description
Interaction Techniques
Hardware Configuration
Retargeting (2)Retargeting (2)
World Creators
IT Developers
Configurators
![Page 29: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/29.jpg)
DevelopmentDevelopment
Descriptive Language
Scripting Language
Compiled Language
World Creators
IT Developers
Configurators
![Page 30: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/30.jpg)
Application DescriptionApplication Description
HardwarePlatforms
ApplicationDomainInteraction
Techniques
Limited by– User model– Ergonomic considerations
![Page 31: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/31.jpg)
Application DomainApplication Domain
Objects– composed– rigid transformations– change color– bounding box– collision detection– loaded from files
NO– creation– non-rigid t.– particles– sound– ...
![Page 32: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/32.jpg)
Hardware PlatformHardware Platform
Input Types– Locator, Valuator,Pick , Button…– Example: Joystick• pos: Pos2D• buttons: Button[5]
Output Languages– Describe available elements to render
![Page 33: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/33.jpg)
Based on the concept of a filter
A dataflow of filters
Interaction TechniquesInteraction Techniques
Filters +objects
Filters +objects
Parameters Signals
![Page 34: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/34.jpg)
Interaction Techniques (2)Interaction Techniques (2)
Allow compositionAllow encapsulationAllow different execution modelsAllow replacements
![Page 35: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/35.jpg)
ITs: Go-Go TechniqueITs: Go-Go Technique
![Page 36: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/36.jpg)
ITs: Go-Go EncapsulatedITs: Go-Go Encapsulated
![Page 37: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/37.jpg)
ITs: Campus demoITs: Campus demo
![Page 38: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/38.jpg)
Open ProblemsOpen Problems
Representation– objects, ITs, devices
Heterogeneity– retargeting
Learning curveDevelopment environment
![Page 39: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/39.jpg)
BibliographyBibliography
Tutorials 18 and 36; SIGGRAPH 2000Brooks paper in CG&A, Nov 1999van Dam paper in CG&A, Nov 2000Selected papers from Green,
Forsberg, Poupyrev, Bowman, Mine, ...
![Page 40: Virtual Reality Applications Pablo Figueroa Computing Science Department University of Alberta](https://reader035.vdocument.in/reader035/viewer/2022062620/551b3cfb550346ae7a8b4816/html5/thumbnails/40.jpg)
Questions?Questions?