hci: cognitive walkthrough - school of informatics ... · initial evaluation of a system low budget...

46
HCI: COGNITIVE WALKTHROUGH Dr Kami Vaniea 1

Upload: others

Post on 07-Oct-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

HCI: COGNITIVE WALKTHROUGH

Dr Kami Vaniea

1

Page 2: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Tutorial next week: Writing unambiguous questions and tasks.

Page 3: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Today we will be practicing the Cognitive Walkthrough method in class

You need to setup TopHat

Page 4: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

In addition to Cognitive Walkthrough we will be learning about:

Personas

A bit of survey design

Interface flow

4

Page 5: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Cognitive WalkthroughA method that evaluates whether the order of cues

and prompts in a system supports the way people process tasks and anticipate the “next steps” of a system.

When to use it: Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situationsAccess to HCI experts

When to not use it: Formal evaluation of your own system with you as an

evaluator Systems a user will use frequently

5

Page 6: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Stages of a cognitive walkthrough

Briefing session to tell experts what to do

Evaluation period of 1-2 hours where: Each expert works separately

Take one pass to get a feel for the product Take a second pass to focus on specific features

Debrief session in which experts work together to prioritize problems.

6

Page 7: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

The four questions1. Will users want to produce whatever effect the

action has?

2. Will users see the control (button, menu, label, etc.) for the action?

3. Once users find the control, will they recognize that it will produce the effect they want?

4. After the action is taken, will users understand the feedback they get, so they can confidently continue on to the next action?

7

Page 8: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Task: Open the tasks lecture slides in DrawboardPDF.

8

Page 9: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 1

9

Page 10: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 2

10

Page 11: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 3

11

Page 12: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 4

12

Page 13: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

13

Page 14: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Task: Delete a node from a mindmap

14

Page 15: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 1

User must press and hold the circle they

wish to delete.

Page 16: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 2

User must drag the little circle over to

the black dot.

Page 17: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 3

Page 18: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Done

Page 19: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Problem: How can we accurately judge what the user does or does not know?

19

Page 20: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Personas

Page 21: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

PersonaA short biography about a fictitious user that

describes a reasonably large segment of your intended user population.

Helpful as a way to gather together data from interviews and present it clearly to others

Useful to explain who the user is to other people

21

Page 22: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Burnett et al., The GenderMag Kit

Page 23: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

23

Stoll, Jennifer, et al. "Adapting personas for use in security visualization design." VizSEC 2007. Springer Berlin Heidelberg, 2008. 39-52.

Page 24: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

24Stoll, Jennifer, et al. "Adapting personas for use in security visualization design." VizSEC 2007. Springer Berlin Heidelberg, 2008. 39-52.

Page 25: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

25Stoll, Jennifer, et al. "Adapting personas for use in security visualization design." VizSEC 2007. Springer Berlin Heidelberg, 2008. 39-52.

Page 26: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Cognitive Walkthrough with Persona

26

Page 27: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

You can combine Personas with Cognitive Walkthrough to better define if something is or is not usable.

27

Page 28: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

PatriciaPatricia is a design student who is taking Human

Computer Interaction this semester

She has been using technology most of her life and is proficient with software like Word or Excel as well as complex drawing programs like Adobe Photoshop

She is generally adventurus when it comes to downloading and trying out new apps

She has recently been learning to code in Arduino as part of her courses but she is still working on the basics

Page 29: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Patricia’s project supervisor recommends she use a program called JabRef for tracking publications she reads as part of her thesis project.

Today she wants to add the HCI course textbook into JabRef.

29

Page 30: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 1

Page 31: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 2

Page 32: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 3

Page 33: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 4

Page 34: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 5

Page 35: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 6

Page 36: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Cognitive Walkthrough with Heuristics

36

Page 37: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Neilson’s 10 Heuristics1. Visibility of system status2. Match between system and the real world3. User control and freedom 4. Consistency and standards5. Error prevention 6. Recognition rather than recall7. Flexibility an deficiency of use8. Aesthetics and minimalist design9. Help users recognize, diagnose, and recover from

errors 10. Help and documentation

37

Page 38: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Write the word “important” on one of the lecture slide PDFs.

38

Page 39: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 11. Visibility of system status

2. Match between system and the real world

3. User control and freedom

4. Consistency and standards

5. Error prevention

6. Recognition rather than recall

7. Flexibility an deficiency of use

8. Aesthetics and minimalist design

9. Help users recognize, diagnose, and recover from errors

10. Help and documentation

Page 40: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 21. Visibility of system status

2. Match between system and the real world

3. User control and freedom

4. Consistency and standards

5. Error prevention

6. Recognition rather than recall

7. Flexibility an deficiency of use

8. Aesthetics and minimalist design

9. Help users recognize, diagnose, and recover from errors

10. Help and documentation

Page 41: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 3

41

Page 42: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 4

42

Page 43: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 5

43

Page 44: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 6

44

Page 45: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Step 7

45

Page 46: HCI: Cognitive Walkthrough - School of Informatics ... · Initial evaluation of a system Low budget Walk-up-and-use systems or first-use situations Access to HCI experts When to not

Questions?