designing novel applications inspired by emerging media ... fileinventory of technologies...
TRANSCRIPT
![Page 1: Designing Novel Applications Inspired by Emerging Media ... fileInventory of TECHNOLOGIES (mainstream, robust/proven) • Computation • Database • Web • 3-D rendering • Streaming:](https://reader033.vdocument.in/reader033/viewer/2022041418/5e1d13cf617b6e25272d4585/html5/thumbnails/1.jpg)
UNIVERSITY COLLEGE DUBLIN DUBLIN CITY UNIVERSITY TYNDALL NATIONAL INSTITUTE
Designing Novel Applications Inspired by Emerging Media TechnologiesFraming the Development of Novel Technologies
Hyowon Lee
CLARITY: Centre for Sensor Web Technologies Dublin City University
![Page 2: Designing Novel Applications Inspired by Emerging Media ... fileInventory of TECHNOLOGIES (mainstream, robust/proven) • Computation • Database • Web • 3-D rendering • Streaming:](https://reader033.vdocument.in/reader033/viewer/2022041418/5e1d13cf617b6e25272d4585/html5/thumbnails/2.jpg)
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
INTERACTION DESIGNDOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
PROBLEM SOLUTION
?
?
?
Interaction Platform-
specific Knowledge
Desktop/Web•
Design principles•
Usability guidelines/ heuristics
•
Designer’s skill/ experience
Mobile
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
TableTop
InteractiveTV
WallEmbedded Appliance
•
General Design Knowledge
:
![Page 3: Designing Novel Applications Inspired by Emerging Media ... fileInventory of TECHNOLOGIES (mainstream, robust/proven) • Computation • Database • Web • 3-D rendering • Streaming:](https://reader033.vdocument.in/reader033/viewer/2022041418/5e1d13cf617b6e25272d4585/html5/thumbnails/3.jpg)
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
INTERACTION DESIGNDOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching •
Design principles•
Usability guidelines/ heuristics
•
Designer’s skill/ experience
PROBLEM SOLUTION
?
?
?
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
::
Mobile Interaction Characteristics:•
Small screen
•
Awkward input mechanism
•
Distraction
•
Reduce required attention•
Quick return
•
Reduce browsing effort:
![Page 4: Designing Novel Applications Inspired by Emerging Media ... fileInventory of TECHNOLOGIES (mainstream, robust/proven) • Computation • Database • Web • 3-D rendering • Streaming:](https://reader033.vdocument.in/reader033/viewer/2022041418/5e1d13cf617b6e25272d4585/html5/thumbnails/4.jpg)
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
INTERACTION DESIGNDOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
PROBLEM SOLUTION
?
?
?
Interaction Platform-
specific Knowledge
Desktop/Web•
Design principles•
Usability guidelines/ heuristics
•
Designer’s skill/ experience
Mobile
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
TableTop
•
General Design Knowledge
:
Tabletop Interaction Characteristics:•
Horizontal
•
Multi-user, Collaborative setting
•
Task allocation (division)•
Workspace awareness
•
Coordination (eg. conflict)
Photo from Dialog Table, Walker Art Center http://dialogtable.com/
![Page 5: Designing Novel Applications Inspired by Emerging Media ... fileInventory of TECHNOLOGIES (mainstream, robust/proven) • Computation • Database • Web • 3-D rendering • Streaming:](https://reader033.vdocument.in/reader033/viewer/2022041418/5e1d13cf617b6e25272d4585/html5/thumbnails/5.jpg)
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
INTERACTION DESIGNDOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
PROBLEM SOLUTION
?
?
?
Interaction Platform-
specific Knowledge
Desktop/Web•
Design principles•
Usability guidelines/ heuristics
•
Designer’s skill/ experience
Mobile
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
TableTop
InteractiveTV
•
General Design Knowledge
:
•
Large widgets, large text•
Minimal, simple interaction
•
Multiple levels of attention:
“Lean-back Interaction”
•
Viewed 2-3m away
•
Use of remote control
TV Interaction Characteristics:
Photo from Tutorial, K. Chorianopoulos, EuroITV 2008
![Page 6: Designing Novel Applications Inspired by Emerging Media ... fileInventory of TECHNOLOGIES (mainstream, robust/proven) • Computation • Database • Web • 3-D rendering • Streaming:](https://reader033.vdocument.in/reader033/viewer/2022041418/5e1d13cf617b6e25272d4585/html5/thumbnails/6.jpg)
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
INTERACTION DESIGNDOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
PROBLEM SOLUTION
?
?
?
Interaction Platform-
specific Knowledge
Desktop/Web•
Design principles•
Usability guidelines/ heuristics
•
Designer’s skill/ experience
Mobile
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
TableTop
InteractiveTV
Wall
•
General Design Knowledge
:
INTERACTION DESIGN
Interaction Platform-
specific Knowledge
•
Design principles•
Usability guidelines/ heuristics
•
Designer’s skill/ experience
TableTop
•
General Design Knowledge
:
Interactive Wall Characteristics:•
Large
•
Public
•
Multi-user setting
•
Focal/peripheral interplay•
Coordination (conflict resolution)
:
![Page 7: Designing Novel Applications Inspired by Emerging Media ... fileInventory of TECHNOLOGIES (mainstream, robust/proven) • Computation • Database • Web • 3-D rendering • Streaming:](https://reader033.vdocument.in/reader033/viewer/2022041418/5e1d13cf617b6e25272d4585/html5/thumbnails/7.jpg)
INTERACTION DESIGN
Interaction Platform-
specific Knowledge
Desktop PC (Web)
Mobile
TableTop
Interactive TV
Wall
Embedded Appliance
DOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
PROBLEM SOLUTION
?
?
?
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
New practice
Imagined practice
•
General Design Knowledge
:
![Page 8: Designing Novel Applications Inspired by Emerging Media ... fileInventory of TECHNOLOGIES (mainstream, robust/proven) • Computation • Database • Web • 3-D rendering • Streaming:](https://reader033.vdocument.in/reader033/viewer/2022041418/5e1d13cf617b6e25272d4585/html5/thumbnails/8.jpg)
DOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
PROBLEM SOLUTION
?
?
?
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
INTERACTION DESIGN
Interaction Platform-
specific Knowledge
Desktop PC (Web)
Mobile
TableTop
Interactive TV
Wall
Embedded Appliance
•
General Design Knowledge
:
-
SIFT tool*
Museum Information
![Page 9: Designing Novel Applications Inspired by Emerging Media ... fileInventory of TECHNOLOGIES (mainstream, robust/proven) • Computation • Database • Web • 3-D rendering • Streaming:](https://reader033.vdocument.in/reader033/viewer/2022041418/5e1d13cf617b6e25272d4585/html5/thumbnails/9.jpg)
Blighe M, Sav S, Lee H
and O'Connor N. Mo Músaem Fíorúil: A Web-based Search and Information Service for Museum Visitors. ICIAR 2008 -
International Conference on Image Analysis and Recognition, Povoa de Varzim, Portugal, 25-27 June 2008.
![Page 10: Designing Novel Applications Inspired by Emerging Media ... fileInventory of TECHNOLOGIES (mainstream, robust/proven) • Computation • Database • Web • 3-D rendering • Streaming:](https://reader033.vdocument.in/reader033/viewer/2022041418/5e1d13cf617b6e25272d4585/html5/thumbnails/10.jpg)
DOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
PROBLEM SOLUTION
?
?
?
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
INTERACTION DESIGN
Interaction Platform-
specific Knowledge
Desktop PC (Web)
Mobile
TableTop
Interactive TV
Wall
Embedded Appliance
•
General Design Knowledge
:
-
Video indexing-
Content similarity-
Web connectivity
Museum Information
Clip searching during TV watching
![Page 11: Designing Novel Applications Inspired by Emerging Media ... fileInventory of TECHNOLOGIES (mainstream, robust/proven) • Computation • Database • Web • 3-D rendering • Streaming:](https://reader033.vdocument.in/reader033/viewer/2022041418/5e1d13cf617b6e25272d4585/html5/thumbnails/11.jpg)
Lee H, Ferguson P, Gurrin C, Smeaton A.F, O'Connor N and Park H. Balancing the Power of Multimedia Information Retrieval and Usability in Designing Interactive TV.
uxTV 2008 -
International Conference on Designing Interactive User Experiences for TV and Video, Mountain View, CA, 22-24 October 2008.
![Page 12: Designing Novel Applications Inspired by Emerging Media ... fileInventory of TECHNOLOGIES (mainstream, robust/proven) • Computation • Database • Web • 3-D rendering • Streaming:](https://reader033.vdocument.in/reader033/viewer/2022041418/5e1d13cf617b6e25272d4585/html5/thumbnails/12.jpg)
DOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
PROBLEM SOLUTION
?
?
?
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
INTERACTION DESIGN
Interaction Platform-
specific Knowledge
Desktop PC (Web)
Mobile
TableTop
Interactive TV
Wall
Embedded Appliance
•
General Design Knowledge
:
-
Video indexing-
Content similarityClip searching during TV watching
Collaborative media searching
Museum Information
![Page 13: Designing Novel Applications Inspired by Emerging Media ... fileInventory of TECHNOLOGIES (mainstream, robust/proven) • Computation • Database • Web • 3-D rendering • Streaming:](https://reader033.vdocument.in/reader033/viewer/2022041418/5e1d13cf617b6e25272d4585/html5/thumbnails/13.jpg)
Smeaton A.F, Lee H, Foley C and Mc Givney
S. Collaborative Video Searching on a Tabletop. Multimedia Systems Journal, Vol. 12, No. 4, 2006.
![Page 14: Designing Novel Applications Inspired by Emerging Media ... fileInventory of TECHNOLOGIES (mainstream, robust/proven) • Computation • Database • Web • 3-D rendering • Streaming:](https://reader033.vdocument.in/reader033/viewer/2022041418/5e1d13cf617b6e25272d4585/html5/thumbnails/14.jpg)
DOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
PROBLEM SOLUTION
?
?
?
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
INTERACTION DESIGN
Interaction Platform-
specific Knowledge
Desktop PC (Web)
Mobile
TableTop
Interactive TV
Wall
Embedded Appliance
•
General Design Knowledge
:
-
Video indexing-
Content similarity
Collaborative media searching
Museum Information
Clip searching during TV watching
![Page 15: Designing Novel Applications Inspired by Emerging Media ... fileInventory of TECHNOLOGIES (mainstream, robust/proven) • Computation • Database • Web • 3-D rendering • Streaming:](https://reader033.vdocument.in/reader033/viewer/2022041418/5e1d13cf617b6e25272d4585/html5/thumbnails/15.jpg)
DOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
PROBLEM SOLUTION
?
?
?
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
INTERACTION DESIGN
Interaction Platform-
specific Knowledge
Desktop PC (Web)
Mobile
TableTop
Interactive TV
Wall
Embedded Appliance
•
General Design Knowledge
:
Clip searching during TV watching
In-Home Power Monitor
-
Power Sensors-
Device ID
Collaborative media searching
Museum Information
–
Always ON (day/night readability)–
Constant data display for passer-by
–
Simple finger-touch interaction–
Context information required
–
No ‘main menu’: useful information upfront, requiring no interaction
–
Rich data presented simple–
Real-time data in context (to history data, yesterday, average, neighbour, etc.)
In-Home Display: Characteristics
![Page 16: Designing Novel Applications Inspired by Emerging Media ... fileInventory of TECHNOLOGIES (mainstream, robust/proven) • Computation • Database • Web • 3-D rendering • Streaming:](https://reader033.vdocument.in/reader033/viewer/2022041418/5e1d13cf617b6e25272d4585/html5/thumbnails/16.jpg)
DOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
PROBLEM SOLUTION
?
?
?
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
INTERACTION DESIGN
Interaction Platform-
specific Knowledge
Desktop PC (Web)
Mobile
TableTop
Interactive TV
Wall
Embedded Appliance
•
General Design Knowledge
:
-
Event Detection & Similarity
Museum Information
Clip searching during TV watching
In-Home Power Monitor
Collaborative media searching
LifeLogging
![Page 17: Designing Novel Applications Inspired by Emerging Media ... fileInventory of TECHNOLOGIES (mainstream, robust/proven) • Computation • Database • Web • 3-D rendering • Streaming:](https://reader033.vdocument.in/reader033/viewer/2022041418/5e1d13cf617b6e25272d4585/html5/thumbnails/17.jpg)
Lee H, Smeaton A.F, O'Connor N, Jones G, Blighe
M, Byrne D, Doherty A and Gurrin C. Constructing a SenseCam Visual Diary as a Media Process. Multimedia Systems Journal, 14(6), 2008.
![Page 18: Designing Novel Applications Inspired by Emerging Media ... fileInventory of TECHNOLOGIES (mainstream, robust/proven) • Computation • Database • Web • 3-D rendering • Streaming:](https://reader033.vdocument.in/reader033/viewer/2022041418/5e1d13cf617b6e25272d4585/html5/thumbnails/18.jpg)
UNIVERSITY COLLEGE DUBLIN DUBLIN CITY UNIVERSITY TYNDALL NATIONAL INSTITUTE
Conclusion
In designing novel applications that incorporate novel technologies:
Be aware of exciting new technologiesPlenty solutions but no problem?
Build working prototypes first, THEN worry about fitting them to real world
Lack of domain knowledge shouldn’t be the bottleneck in exploring new possibilities
Design expertise spanning multiple platform