November 9, 2015 Sam Siewert

CS415 Human Computer Interaction

Lecture 12 – Ubiquitous Computing VR, AR, Pervasive (Ch. 20)

Assignments Assignment #5 – Explore HCI’s, Propose Group Project (Groups of 3) Assignment #6 – Proof-of-Concept or Evaluation with Final Report Final Oral Exam – Presentation of Project Myself, Jim Weber, Dr. Davis, Dr. Bruder Emily and Adam Molson – Controls Lab Monitors – 9-5 on Sat, 12 noon – 9pm Sun

Sam Siewert 2

http://mercury.pr.erau.edu/%7Esiewerts/cs415/assignments/Exercise-5-Requirements.pdfhttp://mercury.pr.erau.edu/%7Esiewerts/cs415/assignments/Exercise-6-Requirements.pdfhttp://mercury.pr.erau.edu/%7Esiewerts/cs415/assignments/HCI-Software-System-Design-Presentation-Outline.ppt

Advanced HCI … Future

Microsoft Research HCI Vision Interesting HCI Innovations and Experiments (Examples) – MS Hololens, – Magic Leap, – jibo, – sixthsense, – Oculus VR, – NVIDIA AR/VR, PX, – Intel Real Sense, – Google Project Tango, – Interactive Film, – Gear VR

Sam Siewert 3

http://research.microsoft.com/en-us/um/cambridge/projects/hci2020/downloads/BeingHuman_A3.pdfhttps://www.microsoft.com/microsoft-hololens/en-ushttp://www.magicleap.com/https://www.jibo.com/http://www.pranavmistry.com/projects/sixthsense/https://www.oculus.com/http://www.nvidia.com/object/total_immersion_success.htmlhttp://www.nvidia.com/object/drive-px.htmlhttp://www.intel.com/content/www/us/en/architecture-and-technology/realsense-overview.htmlhttps://www.google.com/atap/project-tango/http://www.thewildernessdowntown.com/http://www.samsung.com/global/microsite/gearvr/

Ubiquitous Computing Ted Talk on Minority Report Style UI Pranav Mistry Ted Talk on Interaction David Merrill Ted Talk on Siftables MIT Media Lab – “reinvent—how humans experience, and can be aided by, technology.” - History MIT Media Lab Founder Ted Talk

Next, Week 12 … Augmented Reality Week 13 … Advanced Avionics and UAV/UAS Week 14 – Quiz, Review for Exam #2, A#6 Help Week 15 – Exam #2

Sam Siewert 4

https://www.ted.com/talks/john_underkoffler_drive_3d_data_with_a_gesture?language=enhttps://www.ted.com/talks/pranav_mistry_the_thrilling_potential_of_sixthsense_technology?language=enhttps://www.ted.com/talks/david_merrill_demos_siftables_the_smart_blockshttps://www.media.mit.edu/https://www.media.mit.edu/about/mission-historyhttps://www.ted.com/talks/nicholas_negroponte_a_30_year_history_of_the_future

Definitions Ubiquitous Computing – Merge computational artifacts smoothly with world of physical artifacts

(applications integrated with things) – Superimpose relevant information over top of the object – Objects in the physical world to manipulate virtual (graspable) – Context aware applications (Who, What, Where, When, Why) –

Recommendation Engines, Adware, Personal Assistants – Vannevar Bush (Memex) – Often compared to Hypertext Today

VR (Virtual Reality) – Immersive – Desktop – Simulated World

AR (Augmented Reality) – Project Onto World – See World Through Mobile Screen / Glasses With Annotation – Requires Computer Vision (Object Recognition) for True AR

Sam Siewert 5

https://en.wikipedia.org/wiki/Vannevar_Bushhttps://en.wikipedia.org/wiki/Memex

Ubiquitous Computing Term Credited to Mark Weiser – “The Computer of the 21st Century”, Scientific American,

265(3):66-75, September 1991 – Vision Described Previously at Many HCI Research

Organizations [e.g. Xerox PARC, MIT Media Lab, GIT, …]

Some Enabling Technologies – Computer Vision – Generalization of Machine Vision (for

Automation) to Use Visual Perception in the Field and to Emulate Human Visual Perception

– Projection, 3D, High Resolution Large Displays and Mobile Computing (Fields of View: Inches, Feet, Yards)

– Head tracking Independent Display Eyeware, 3D Glasses (Polarized, Shutters)

– Large Scale Interactive Surfaces (Large Touch Screens) – Data Gloves and Body Suits

Sam Siewert 6

https://en.wikipedia.org/wiki/Mark_Weiser

Playing with Concepts Cost Reduction is Key to Become Ubiquitous (Killer App) MERL DiamondTouch (2003) CU Computer Vision Chess, Automatic Duck Hunter

Sam Siewert 7

http://www.merl.com/publications/docs/TR2003-125.pdfhttps://www.youtube.com/watch?v=0unBCGBcSZ0https://www.youtube.com/watch?v=MmicTl32sYg

VR, AR Killer Applications Remains to Be Seen Today – Scientific Visualization (VR) – Digital Cinema Animation (VR, AR) – Training Systems (Surgery, AR Overlay to Identify Objects) – Games and Entertainment (VR) – First Person Viewing and Sensing (Remote Presence), E.g.

UAVs (AR)

Ubiquitous Use – Not Yet? – Cost and Convenience (Pranav Mistry Pendant – Good Start -

$350, Easy to Wear) – Compelling Value (Wear Computer or Build into Things – IoT)

Sam Siewert 8

https://en.wikipedia.org/wiki/Internet_of_Things

New HCI is Risky Does the HCI Define the Product? Is this the Right Place to Innovate the HCI? Catalogue of Catastrophe – Why Products Have Failed Classic Mistakes [According to One PM Consulting Firm] 1. The underestimation of complexity, cost and/or schedule – NRE

Cost, Capex, Opex 2. Failure to establish appropriate control over requirements and/or

scope – Creeping Featurism 3. Lack of communications – Expectations and Goals 4. Failure to engage stakeholders – Users and Evaluation 5. Failure to address culture change issues – Social Acceptance 6. Lack of oversight / poor project management – Micro-management

vs. No management 7. Poor quality workmanship - SQA 8. Lack of risk management – Initial assessment and adjustment 9. Failure to understand or address system performance

requirements – Interactive as well as batch systems 10. Poorly planned / managed transitions - Deployment

Sam Siewert 9

http://calleam.com/WTPF/?page_id=3http://calleam.com/?page_id=5http://calleam.com/WTPF/?page_id=799#Complexityhttp://calleam.com/WTPF/?page_id=799#Requirementshttp://calleam.com/WTPF/?page_id=799#Requirementshttp://calleam.com/WTPF/?page_id=799#Commshttp://calleam.com/WTPF/?page_id=799#Stakeholdershttp://calleam.com/WTPF/?page_id=799#Culturehttp://calleam.com/WTPF/?page_id=799#Oversighthttp://calleam.com/WTPF/?page_id=799#Qualityhttp://calleam.com/WTPF/?page_id=799#Riskhttp://calleam.com/WTPF/?page_id=799#Performancehttp://calleam.com/WTPF/?page_id=799#Performancehttp://calleam.com/WTPF/?page_id=799#Transitions

Minute Paper Beyond Today’s Vertical Applications Previously Enumerated… VR, What is it Good for? AR, What is it Good for? Will Ubiquitous Computing Envisioned by Mark Weiser be Realized?

Sam Siewert 10

CS415�Human Computer InteractionAssignmentsAdvanced HCI … FutureUbiquitous ComputingDefinitionsUbiquitous ComputingPlaying with ConceptsVR, AR Killer ApplicationsNew HCI is RiskyMinute Paper