phd defense presentation
DESCRIPTION
Presentation for my PhD defense at University of Minho 29 January 2014.TRANSCRIPT
![Page 1: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/1.jpg)
An Interaction Abstraction Toolkit for Public Display Applications
Jorge C. S. [email protected]
http://jorgecardoso.eu
![Page 2: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/2.jpg)
Outline
● Motivation● Objective● Challenges● Interaction Abstractions● Evaluation● Conclusion
![Page 3: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/3.jpg)
Motivation: “We need to do better”
![Page 4: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/4.jpg)
Motivation
Each display uses its own approach to interactivity
![Page 5: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/5.jpg)
Objective: Interaction abstractions for public displays“toolkits for novel and perhaps unfamiliar application areas enhance the
creativity of these programmers. By removing low-level implementation burdens
and supplying appropriate building blocks, toolkits give people a ‘language’ to
think about these new interfaces, which in turn allows them to concentrate on
creative designs.” - Greenberg, S. (2007). Toolkits and interface creativity.
Multimedia Tools and Applications, 32(2), 139–159.
![Page 6: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/6.jpg)
Interaction in public displays
Focus● Generic information displays● Multi-user● Shared environment● Multiple input devices
![Page 7: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/7.jpg)
Interaction in public displays
Challenges● Very different interaction environment
○ What kind of abstractions are useful?● No accepted interaction paradigms
○ No accepted set of “controls”● Variety of interaction mechanisms
![Page 8: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/8.jpg)
SMS
![Page 9: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/9.jpg)
QR Codes
![Page 10: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/10.jpg)
Gestures
![Page 11: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/11.jpg)
Bluetooth
![Page 12: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/12.jpg)
Touch
![Page 13: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/13.jpg)
Keyboard + trackball!
![Page 14: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/14.jpg)
What kind/level of abstractions?● Footprints for socially-aware
display systems○ Designers
● User Interaction Controls○ Developers
![Page 15: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/15.jpg)
Footprints for socially-aware display systems
What information can the display gather from interactions that can be used for context-aware content adaptation?
Focus on adaptation to the social situation around the display
Abstract interaction mechanisms and application semantics
![Page 16: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/16.jpg)
Footprints for socially-aware display systems
❏ Cardoso, J. C. S., & Jose, R. (2009). A Framework for Context-Aware Adaptation in Public Displays. In R. Meersman, P. Herrero, & T. Dillon (Eds.), On the Move to Meaningful Internet Systems: OTM 2009 Workshops (Vol. 5872/2009, pp. 118–127). Vilamoura, Portugal: Springer Berlin / Heidelberg. doi:10.1007/978-3-642-05290-3_21
❏ Jose, R., & Cardoso, J. C. S. (2011). Opportunities and Challenges of Interactive Public Displays as an Advertising Medium. In J. Mueller, F. Alt, & D. E. Michelis (Eds.), Pervasive Advertising (pp. 139–157). Springer-Verlag London Limited. doi:10.1007/978-0-85729-352-7_7
![Page 17: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/17.jpg)
Footprints for socially-aware display systems
![Page 18: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/18.jpg)
User Interaction Controls
❏ Cardoso, J. C. S., & José, R. (2013) Interaction tasks and controls for public display applications. Submitted to the International Journal on Human-Computer Interaction.
(under review)
![Page 19: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/19.jpg)
PuReWidgets toolkit for web-based public display applications
● High-level abstractions○ Widgets
● Various controls○ Action buttons, list boxes, text entry, download, upload, checkin
● Independence from interaction mechanism
❏ Cardoso, J. C. S., & José, R. (2012). Creating web-based interactive public display applications with the PuReWidgets toolkit. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia - MUM ’12 (p. 1). New York, New York, USA, Germany: ACM Press. doi:10.1145/2406367.2406434 (Demo)
❏ Cardoso, J. C. S., & José, R. (2012). The PuReWidgets Toolkit for Interactive Public Display Applications. In The International Symposium on Pervasive Displays. Porto, Portugal. (Poster)
❏ Cardoso, J. C. S., & José, R. (2012). PuReWidgets: a programming toolkit for interactive public display applications. In S. R. José Creissac Campos, Simone D. J. Barbosa, Philippe Palanque, Rick Kazman, Michael Harrison (Ed.), Proceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems - EICS ’12 (p. 51). New York, NY, USA, Denmark: ACM Press. doi:10.1145/2305484.2305496
![Page 20: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/20.jpg)
Widgets
![Page 21: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/21.jpg)
Interaction
Touch Text-based (SMS, email, …)
QR codes Mobile interface(Automatically generated)
❏ Cardoso, J. C. S. (2014). Dynamic Graphical User Interface Generation for Web-based Public Display Applications. In Proceedings of the 4th International Conference on Pervasive and Embedded Computing and Communication Systems (pp. 5–13). Lisbon, Portugal: SCITEPRESS - Science and and Technology Publications. doi:10.5220/0004707500050013
![Page 22: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/22.jpg)
Toolkit evaluation
Author unknown. Taken from http://www.flixya.com/photo/2162704/BasikalBicycle
System scalability
API usability
Real-world deployment
❏ Cardoso, J. C. S., & José, R. (2013). Evaluation of a programming toolkit for interactive public display applications. In Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia - MUM ’13 (pp. 1–10). New York, New York, USA, Sweden: ACM Press. doi:10.1145/2541831.2541834
❏ Cardoso, J. C. S., & José, R. (2011). Assessing Feedback for Indirect Shared Interaction with Public Displays. In R. Meersman, T. Dillon, & P. Herrero (Eds.), On the Move to Meaningful Internet Systems: OTM 2011 Workshops (Vol. 7046, pp. 553–561). Springer Berlin / Heidelberg. doi:10.1007/978-3-642-25126-9_67
![Page 23: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/23.jpg)
Conclusion: Summary of contributions1. A framework of digital footprints that designers of public displays can use to map several sensing and interaction
features to content adaptation strategies. 2. A design space of interaction tasks and controls that can serve as a basis for programming toolkits that provide
high-level interaction widgets. 3. Identification of the fundamental requirements for an interaction abstraction toolkit for public displays. 4. The PuReWidgets software toolkit itself for incorporating interactive features into public display applications5. An in-breadth evaluation of the PuReWidgets toolkit along several dimensions, including the system’s
performance and scalability, the API usability, and a real-world deployment. 6. Open-source software projects, allowing anyone to use, modify, and adapt for further research and development.
● https://code.google.com/p/purewidgets/ i. – The PuReWidgets toolkit .ii. – Three interactive public display applications
● https://code.google.com/p/public-display-scheduler/ A Google Chrome extension that serves as an application scheduler for public displays.
![Page 24: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/24.jpg)
Conclusion: Summary of contributions1. Cardoso, Jorge C. S. (2014). Dynamic Graphical User Interface Generation for Web-based Public Display Applications. In Proceedings of the 4th
International Conference on Pervasive and Embedded Computing and Communication Systems (pp. 5–13). Lisbon, Portugal: SCITEPRESS - Science and and Technology Publications.
2. Cardoso, J. C. S., & José, R. (2013) Interaction tasks and controls for public display applications. Submitted to the International Journal on Human-Computer Interaction. (under review)
3. Taivan, C., Rui José, Silva, B., Elhart, I., & Cardoso, J. (2013). Design considerations for application selection and control in multi-user public displays. JUCS special issue: Towards Sustainable Computing through Ambient Intelligence.
4. Cardoso, Jorge C. S., & José, R. (2013). Evaluation of a programming toolkit for interactive public display applications. In Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia - MUM ’13 (pp. 1–10). New York, New York, USA, Sweden: ACM Press.
5. José, R., Cardoso, J., Alt, F., Clinch, S., & Davies, N. (2013). Mobile applications for open display networks: common design considerations. In Proceedings of the 2nd ACM International Symposium on Pervasive Displays -- PerDis ’13 (pp. 97–102). ACM. doi:10.1145/2491568.2491590
6. Cardoso, Jorge C S, & José, R. (2012). Creating web-based interactive public display applications with the PuReWidgets toolkit. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia - MUM ’12 (p. 1). New York, New York, USA, Germany: ACM Press.
7. Cardoso, Jorge C. S., & José, R. (2012a). The PuReWidgets Toolkit for Interactive Public Display Applications. In The International Symposium on Pervasive Displays. Porto, Portugal. Retrieved from http://dx.doi.org/10.6084/m9.figshare.92165
8. Cardoso, Jorge C. S., & José, R. (2012b). PuReWidgets: a programming toolkit for interactive public display applications. In S. R. José Creissac Campos, Simone D. J. Barbosa, Philippe Palanque, Rick Kazman, Michael Harrison (Ed.), Proceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems - EICS ’12 (p. 51). New York, NY, USA, Denmark: ACM Press. doi:10.1145/2305484.2305496
9. Cardoso, Jorge C. S., & José, R. (2011). Assessing Feedback for Indirect Shared Interaction with Public Displays. In Robert Meersman, T. Dillon, & P. Herrero (Eds.), On the Move to Meaningful Internet Systems: OTM 2011 Workshops (Vol. 7046, pp. 553–561). Springer Berlin / Heidelberg.
10. Jose, R., & Cardoso, J. C. S. (2011). Opportunities and Challenges of Interactive Public Displays as an Advertising Medium. In J. Mueller, F. Alt, & D. E. Michelis (Eds.), Pervasive Advertising (pp. 139–157). Springer-Verlag London Limited. doi:10.1007/978-0-85729-352-7_7
11. Cardoso, Jorge C. S., & Jose, R. (2009). A Framework for Context-Aware Adaptation in Public Displays. In R. Meersman, P. Herrero, & T. Dillon (Eds.), On the Move to Meaningful Internet Systems: OTM 2009 Workshops (Vol. 5872/2009, pp. 118–127). Vilamoura, Portugal: Springer Berlin / Heidelberg.
![Page 25: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/25.jpg)
Conclusion
● We need better tools to create applications for open display networks
○ Interaction abstractions
● PuReWidgets is just one attempt/model
![Page 26: PhD defense presentation](https://reader035.vdocument.in/reader035/viewer/2022062418/554938e4b4c905144d8b4ae0/html5/thumbnails/26.jpg)
An Interaction Abstraction Toolkit for Public Display Applications
Jorge C. S. [email protected]
http://jorgecardoso.eu