awareness checklist: reviewing the quality of awareness support in collaborative applications
DESCRIPTION
Presentation from CRIWG 2010, session on awareness.TRANSCRIPT
Awareness Checklist: Reviewing the Quality of Awareness Support in
Collaborative Applications
Pedro Antunes, Claudio Sapateiro, José A. Pino, Valeria Herskovic and Sergio F. Ochoa
Department of Informatics of the Faculty of Sciences, University of LisbonComputer Science Department, Universidad de Chile
Contents
• Introduction
• Awareness Elements
• Awareness Checklist Proposal
• Case Study
• Conclusions
Awareness
• Distinctive feature of collaborative systems• How to assess awareness support?– Questionnaires, interviews, logging– Without user participation?
• Awareness checklist – Useful to system developers– Complement or substitute users’ evaluation
Related Work
Methodology
• Definition of – Awareness types– Design elements contributing to awareness– Correlations between design elements and awareness types with help from experts
• Construction of awareness checklist• Validation of checklist with case studies
Awareness Elements
Time x Place
• Same place, different place, any place
• Co-located, virtual co-located, remote places
• Drawbacks of technology-mediated communication
• Collaboration awareness: perception of temporal and spatial structures in group of peers
[Rodden&Blair, 1991]
[Johansen et al. 1991]
Geographical space
• Location– Cartesian– Topological
• Distance• Orientation
[Dix et al. 2000]
Physical space
• Mobility– Wandering, visiting,traveling
– Fixed,mobile,autonomous,free,embedded,pervasive
[Kristoffersen&Ljunberg 1998]
[Dix et al. 2000]
Virtual space
• Collection of computer-supported interaction spaces– Conceptual topology– Interactive– Shared– Malleable– Populated
• Navigation– Spatial– Logical
[Rodden, 1996]
Social space
• Broader issues related to social practice and context
• Geographical, physical and virtual affordances + social interaction, cultural meaning, experience, knowledge
[Brewer&Dourish, 2008]
Workspace• Container of places with ongoing activities
• Peripheral awareness: understand activities of others in nearby places
• Workspace awareness: another person’s interactions– Who– What– Where– When– How
[Snowdon et al., 2000]
[Liechti, 1998]
[Gutwin&Greenberg, 1999]
Situation awareness
• Perception of elements in current situation
• Comprehension of current situation
• Projection of future status
[Endsley et al., 1988]
Design elements Design category Design elements
1 Accessibility Same place, different place, any place, co-located, virtually co-located, remote
2 Communication Synchronous, asynchronous, network connectivity, message delivery, network management
3 Spatiality Cartesian locations, topological locations, distances, orientation, focus/nimbus
4 Mobility Wandering, visiting, traveling, fixed, mobile, autonomous, independent, embedded, pervasive
5 Physicality Physical constraints, physical places, physical topology, physical attributes
6 Navigation Viewports, links, radar views, teleports
7 Virtuality Private, group, public, data access privileges, concurrency control, floor control, version control, virtual constraints, virtual places, virtual topology, virtual attributes
8 Membership Participants, roles, activities, privileges, group history
9 Attention Eye-gaze orientation, body orientation, voice filtering, portholes/peepholes
10 Task Who, what, where, when, how, task history
11 Interaction Feedback, feedthrough, backchannel feedback
12 Interdependence Parallel activities, coordinated activities, mutually adjusted activities, loosely coupled, tightly coupled
13 Internalization Events, actions, resources, critical elements, meaning, future scenarios
14 Externalization Individual cognition, distributed cognition, team cognition
Main relationshipsType of awareness Design categories
1 Time x place Accessibility, communication
2 Geographical space Spatiality
3 Physical space Mobility, physicality
4 Virtual space Navigation, virtuality
5 Social space Membership, attention
6 Workspace Task, interaction, interdependence
7 Situation Internalization, externalization
• Example:– Design element: Different place – Design category: Accesibility– Main relationship: Time x place– Also negatively influences workspace awareness
Correlation Matrix
Example of use: COIN
Awareness Checklist
+ implementation contributes to realize design element- implementation is detrimental to design requirement
Awareness Report
Awareness Report
• Low positive scores:– Physical awareness (3)– Virtual space awareness (4)
• High negative scores:– Situation awareness (7)
Conclusions
• Awareness checklist based on QA principles, 77 design elements, 7 awareness types
• Correlations matrix contains knowledge extracted from experts
• Developers must balance benefit of awareness item with information overload and implementation cost
• Allows formal review of awareness support, may help examine and improve awareness support
Thank you for your attention