ux at imperial library a case study of qualitative approaches to primo usability studies karine...

UX at Imperial Library a case study of qualitative approaches to Primo usability studiesKarine LaroseSystems Librarian

@karinenrose #igelu15

Slides and notes

These slides: http://bit.ly/karineUX

Background: Library Services

UX in Libraries

‘User experience design testing’ by Flickr user: Andy Bright.

Why: UX at Imperial

To support our strategic priority of reviewing and improving user experience, we carried out 2 rounds of usability research of Primo.

How - Primo UX work at Imperial Library

Round 1:

• Primo discount usability testing (Pilot project)

• Student Placement: Sherif Khedry from UCL Qatar

Round 2:

• Primo usability testing – Focus of qualitative/iterative

approach

• Student Placement: George Bray from UCL @NexGenGB

UX round 1 - pilot

• Review the literature

• Usability research

• Central Library

• Interviews

What did we find?

Library Search meets user expectations

What did we find?

• Library Search meets expectations

• Discovery happens elsewhere

Discovery happens elsewhere

• Google et al.• Library databases• Citations• Lecturers• Friends

What did we find?

• Library Search meets expectations

• Discovery happens elsewhere• Issues in ‘discovery to

delivery’

Issues in ‘discovery to delivery’

Issues in ‘discovery to delivery’

Where is the book?

Issues in ‘discovery to delivery’

?!

Issues in ‘discovery to delivery’ #2

1.Extra click2.No

emphasis

What did we find?

• Library Search meets expectations

• Discovery happens elsewhere• Issues in ‘discovery to

delivery’• ‘…& more’

‘…and more’

Summary Findings

• Single search box

• Improve discoverability

• Primo look and feel

How: UX round 2 timeline

• April 14: planning

• April 27: UCL placement student

• First week of May: interviews

and data analysis

How -Planning 2nd Round UX

• Primo UX team

• UX workshops

• Selecting Interviewees

• Interviews at Central and

Chelsea and Westminster

Research Questions – Main Themes

• Purpose, construction, and use of search and resources

• Presentation of information: what matters to the user when selecting the right results?

How - Research Methodology

• Grounded theory approach

• Qualitative data from

1. Interviews

2. Card Sorting

Data – Notes from Interviews

Facet card sorting

Results II: card sorting

‘Books’ sort order

1. Resource Type

2. Topic/Subject

3. Availability

4. Date

5. Author

6. New search on Subject

7. Library

8. New search on Author

‘Articles’ sort order

1. Resource Type

2. Topic/Subject

3. Date

4. Author

5. Availability

6. Collection

7. Language

8. Expand Search

9. New search on Author

Primo Reports Jan-May 15

1. Resource Type

2. Availability

3. Date

4. Library

5. Author

6. Topic/Subject

7. Collection

8. Language

Primo reports facet summary

Primo Reports Jan-May 15

1. Resource Type

2. Availability

3. Date

4. Library

5. Author

6. Topic/Subject

7. Collection

8. Language

Resource Type36%

Availability21%

Date20%

Library11%

Author5%

Subject4%

Collection2%

Language1%

Facet clicks by % of total

Outcomes of ux investigation

• Improve search and browse speed; simplify presentation

Outcomes of ux investigation

• Improve search and browse speed; simplify presentation

• Make Primo typography beautiful

Outcomes of ux investigation

• Improve search and browse speed; simplify presentation

• Make Primo typography beautiful

• Outstanding issues…

Results I: main themes

• Searching should be as fast as possible

Results: main themes

• Searching should be as fast as possible

• Searching should be painless

Results: main themes

• Searching should be as fast as possible

• Searching should be painless

• Information is prioritised in selecting results

Switch over Timeline

• July - Complete work on Primo SB

• 3rd August - Acceptance testing

• 6th August - Switch Over

• 6th August onwards - Working

through Bugs and Issues

New Primo: Single Search box

New Primo: Search results

New Primo: Facets

New Primo: Terminology

New Primo – more options

Key Issues after Switchover

• Changes in Scope and Schedule

• Advanced Search

• The A-Z dilemma

• Prioritising search results

• Inconsistent Metadata

The A-Z dilemma

Find E-journal by Title

Key Issues after Switchover (Cont…)

• Changes in Scope and Schedule

• Advanced Search

• The A-Z dilemma

• Prioritising search results

• Inconsistent Metadata

Lessons learned

• Involve staff early in UX Project

• Opportunity for staff development

• Acceptance testing

• Going live success.

• Be prepare to justify design decisions

• Open Communication

Switch over feedback

Future development

• Quantitative studies

• UX investigation in October

Read these:

• Andrew Preater blog post: “UX for the win”

https://www.preater.com/2015/06/11/ux-for-the-win-at-citymash-open-coding

/

• Ex-Libris research: How Do Users Search and Discover? Christine Stohn

• Pickard, A.J. (2004) Research methods in information. 2nd edn. London:

Facet

• Krug, S. (2006) Don’t make me think! 2nd edn. Berkeley, CA: New Riders

• Charmaz, K. (2014) Constructing grounded theory. 2nd edn. London: Sage

• Glaser, B.G. & Strass, A.L. (1967) The discovery of grounded theory.

Chicago, IL: de Gruyter

Library and Information Systems Team Andrew Preater @preater

Simon Barron @SimonXIX

Simon Mackenzie

Karine Larose @karinenrose

Email us: library-systems@imperial.ac.uk