engaging technolog(ies) for effective interaction jeremy r. cooperstock centre for intelligent...
TRANSCRIPT
![Page 1: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/1.jpg)
Engaging Technolog(ies) for Effective Interaction
Jeremy R. CooperstockCentre for Intelligent Machines
McGill University
Centre for Interdisciplinary Research in Music Media and Technology
McGill University
![Page 2: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/2.jpg)
A Brief Roadmap
Shared Reality
Intelligent Classrooms
Ultra-Videoconferencing
![Page 3: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/3.jpg)
Inspiration
Mark Weiser“The most profound technologies
are those that disappear.”
Jef Raskin“Graphical User Interfaces
are not human-compatible.”
![Page 4: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/4.jpg)
Classroom Technology
![Page 5: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/5.jpg)
“High-tech” touch-screen control…
![Page 6: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/6.jpg)
Simplified button control
light controls
motor controls
context-sensitive volume control
![Page 7: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/7.jpg)
I don’t want to control all
of that!
![Page 8: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/8.jpg)
Solution: Intelligent Classroom “Reactive” Technology
room senses events…. and responds automatically
![Page 9: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/9.jpg)
Full-featured button panel
left right
![Page 10: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/10.jpg)
Simplifying Lecture Capture
![Page 11: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/11.jpg)
What about the cameraman?
![Page 12: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/12.jpg)
Student Questionnaires
technology viewed favourably by most users
2000-01: 90 survey responses, 83% positive
2002-03: 115 survey responses, 77% positive (most negative comments related to technical problems)
2003-04: 110 survey responses, 85% positive
![Page 13: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/13.jpg)
Videoconferencing: the past(AT&T PicturePhone – 1956)
![Page 14: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/14.jpg)
Videoconferencing: the future?Zack Snyder’s “Online Jam”, October 2001
![Page 15: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/15.jpg)
For those with DSL at home...For those with DSL at home...
yeah, right!
![Page 16: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/16.jpg)
You don’t say!
"As depicted in the spot, it's a bit of a stretch for the home consumer to run that instantaneously
and smoothly; that's more the realm of the professional musician…. there's a little more to it
than just going on the net."
![Page 17: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/17.jpg)
"Playing Together" experimentNew York-Ottawa, Remote Masters class, Dec. 8, 2000
Pinchas Zuckerman, Columbia U, NYC
Wu Ji, Canarie ARDNOC, Ottawa
![Page 18: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/18.jpg)
Latency:Latency: The Interaction-KillerThe Interaction-Killer
or put another way...
![Page 19: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/19.jpg)
Tolerated Synchronicity
compress transmit
100 20 4030 50 7060 80ms
speed of light: Mtl-LA
net latency Mtl-LA
networks
smallensemble
large ensemble
lip synch
musicalactivity
* This is a theoretical “best-case” scenario. Actual performance may vary. The manufacturer makes no warranties, either express or implied, and will not be held liable for damage resulting from use of the product. Certain restrictions may apply. Offer void where prohibited by law. Batteries not included.
MPEG*acquire
![Page 20: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/20.jpg)
Distributed Violin DuetMcGill-Université de Montréal for RISQnet Conference, Nov. 21, 2001
![Page 21: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/21.jpg)
"The medium is the message" - Marshall McLuhan
Cooperstock's Corollary:
"The medium must be faster than the message.” *
* but between protocol deficiencies (TCP, UDP), competing data flows, process scheduling on a budget, ARQ (retransmission management) without QoS, interface HW/SW “uncooperativeness”, aggressive router policies, multi-format support, echo suppression, and interface complexity… it’s much more than just the medium
![Page 22: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/22.jpg)
Note:look of anguish
![Page 23: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/23.jpg)
The BrassMontreal-Ottawa (NRC) Trial with Pace Sturdevant, February 2, 2002
![Page 24: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/24.jpg)
Violin Masters ClassMontreal-Ottawa (NRC) Trial with Pinchas Zuckerman, Feb. 20, 2002
![Page 25: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/25.jpg)
Size does matter
![Page 26: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/26.jpg)
Distributed Jazz JamMontreal-Stanford (CCRMA), Research Demonstration, Oct. 24, 2002
![Page 27: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/27.jpg)
Remote Video Interpretation (Sign Language)Montreal-Fredericton (UNB), research trials, 2003
physician's setup
patient's setup
![Page 28: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/28.jpg)
Shared Reality and Shared Spaces: Toward Immersive Telepresence
![Page 29: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/29.jpg)
![Page 30: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/30.jpg)
Vibrosensory TransmissionVRQ demo, March 8, 2004
![Page 31: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/31.jpg)
… and another application
![Page 32: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/32.jpg)
Next Steps: Multi-screen High-DefFunded by Canarie’s Advanced Applications Program
![Page 33: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/33.jpg)
Conference Room Configuration
![Page 34: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/34.jpg)
New challenge: Real-time mosaicing
![Page 35: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/35.jpg)
Sample Result: Can your camera do this?
![Page 36: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/36.jpg)
And going deep under…Funded by Canarie’s Intelligent Infrastructure Program and NEPTUNE
![Page 37: Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary](https://reader038.vdocument.in/reader038/viewer/2022110209/56649e255503460f94b13c27/html5/thumbnails/37.jpg)
Thank you...
software download:
http://www.ultravideo.mcgill.edu
Shared Reality Lab:
http://www.cim.mcgill.ca/sre