ux at imperial
TRANSCRIPT
Imperial College London
UX at Imperial Library a case study of qualitative approaches to Primo usability studiesKarine LaroseSystems Librarian @karinenrose
#igelu15
1
Slides and notes
These slides: http://bit.ly/karineUX
2The online version of these Slides are available on Slideshare.
Background: Library Services
1) Imperial College specializes in science, engineering, medicine, and business.2) We are highly research-intensive with a strong focus on research translation and technology transfer to health and industrial applications.3) We have more than 14,700 students (about 9,000 of them undergrads) and around 7,000 staff.4) We are spread over nine campuses the main one is at South Kensington in London. These sites include a large medical faculty which means we need to meet the needs of clinical NHS staff too.
5) As a library service we support our mission in teaching, learning and research.6) We have our main library our central library at South Kensington, and our site libraries which are mostly medical libraries at our teaching hospitals.7) Our libraries are busy and heavily used and there is an upward trend of use of the physical space.
3
UX in Libraries
User experience design testing by Flickr user: Andy Bright.
4
Why: UX at Imperial To support our strategic priority of reviewing and improving user experience, we carried out 2 rounds ofusability research of Primo.
5
How - Primo UX work at Imperial Library
Round 1:Primo discount usability testing (Pilot project)Student Placement: Sherif Khedry from UCL Qatar Round 2: Primo usability testing Focus of qualitative/iterative approachStudent Placement: George Bray from UCL @NexGenGB
6
7
UX round 1 - pilot
Review the literatureUsability research Central Library Interviews
8
What did we find?Library Search meets user expectations
9
What did we find?Library Search meets expectationsDiscovery happens elsewhere
10
11
Discovery happens elsewhereGoogle et al.Library databasesCitationsLecturersFriends
12
What did we find?Library Search meets expectationsDiscovery happens elsewhereIssues in discovery to delivery
13
Issues in discovery to delivery
14
Issues in discovery to delivery
Where is the book?
15
Issues in discovery to delivery
?!
16
Issues in discovery to delivery #2
Extra clickNo emphasis
17
What did we find?Library Search meets expectationsDiscovery happens elsewhereIssues in discovery to delivery& more
18
and more
19
Summary Findings
Single search boxImprove discoverabilityPrimo look and feel
20
How: UX round 2 timeline April 14: planningApril 27: UCL placement studentFirst week of May: interviews and data analysis
21
How -Planning 2nd Round UX
Primo UX teamUX workshops Selecting Interviewees Interviews at Central and Chelsea and Westminster
22
Research Questions Main ThemesPurpose, construction, and use of search and resources
Presentation of information: what matters to the user when selecting the right results?
23
How - Research Methodology
Grounded theory approachQualitative data from Interviews Card Sorting
24
Data Notes from Interviews
25The person working with this data will uses recordings alongside the facilitators notes to form a more complete or thick description of user behaviour and experience.
Facet card sorting
26
Results: card sortingBooks sort order1. Resource Type2. Topic/Subject3. Availability4. Date5. Author6. New search on Subject7. Library8. New search on AuthorArticles sort order1. Resource Type2. Topic/Subject3. Date4. Author5. Availability6. Collection7. Language8. Expand Search9. New search on AuthorPrimo Reports Jan-May 151. Resource Type2. Availability3. Date4. Library5. Author6. Topic/Subject7. Collection8. Language
27
Primo reports facet summaryPrimo Reports Jan-May 151. Resource Type2. Availability3. Date4. Library5. Author6. Topic/Subject7. Collection8. Language
28Here is the Primo reporting broken down showing you clicks for each facet type.
Primo reporting results on facets do not exactly match up with users own reported, but these quantitative data do not say anything about usefulness just numbers of clicks.
There could of course be a difference in reported preferences versus what people actually do.
Interesting resource type is use large percentage even when search is separated to books and more and articles and more
Availability are books available in our library finadability of physical resources important ( refers back to slide where is the book?
We are not big on language and collection we are a science focus uni
Are all facets essential/ what needs to stay what needs to go
Library make sense cause we have 9 libraries
Outcomes of ux investigationImprove search and browse speed; simplify presentation
29
Outcomes of ux investigation Improve search and browse speed; simplify presentationMake Primo typography beautiful
30
Outcomes of ux investigation Improve search and browse speed; simplify presentationMake Primo typography beautifulOutstanding issues
31
Results I: main themesSearching should be as fast as possible
32
Results: main themesSearching should be as fast as possibleSearching should be painless
33
Results: main themesSearching should be as fast as possibleSearching should be painlessInformation is prioritised in selecting results
34
Switch over Timeline
July - Complete work on Primo SB3rd August - Acceptance testing6th August - Switch Over 6th August onwards - Working through Bugs and Issues
35
New Primo: Single Search box
36
New Primo: Search results
37
New Primo: Facets
38
New Primo: Terminology
39
New Primo more options
Key Issues after SwitchoverChanges in Scope and ScheduleAdvanced SearchThe A-Z dilemmaPrioritising search resultsInconsistent Metadata
41
The A-Z dilemma
Google analytics
There is a distinction to be made between the e-journal A-to-Z list and the e-journal "title begins with" search. Both of these features appeared on the page, confusingly, called the "E-journal A-to-Z" (pic attached).I provided an interpretation of the statistics to be clear on the distinction between two features:The alphanumeric "browse by letter, 30 results at a time" e-journal A-to-Z is hardly usedThe "title begins with" search is used quite a bit42
Find E-journal by Title
43
Key Issues after Switchover (Cont)Changes in Scope and ScheduleAdvanced SearchThe A-Z dilemmaPrioritising search resultsInconsistent Metadata
44
Lessons learned
Involve staff early in UX ProjectOpportunity for staff developmentAcceptance testingGoing live success.Be prepare to justify design decisionsOpen Communication
45
Switch over feedback
Working through issues and bugs
Trello: Track the questions (similar/related questions together) and develop/update boards46
Future development
Quantitative studiesUX investigation in October with Oxford University
We are continuing to improve Library Search, and will be running additional testing including from September onwards including a quantitative investigation of preferences for specific elements of the user interface. This is an iterative process. Library Search is not finished, but will continue to be shaped by our research and user feedback.
Quantitative studiesgoogle analyticsPrimo reportsDesign Primo Survey investigate user preference based on Round1 and Round2, outcomes. Primo Survey open for students - seek feedback from new Primo.Survey questions will also be qualitative (describing stuff in their own words ( doc del forms) survey questions (how do you know library doesnt have )
Iteration from an improved baseline
UX investigation in October with Oxford UniversityNew round of UX investigation in October with oxford
47
Read these:
Andrew Preater blog post: UX for the win https://www.preater.com/2015/06/11/ux-for-the-win-at-citymash-open-coding/Ex-Libris research: How Do Users Search and Discover? Christine Stohn Pickard, A.J. (2004) Research methods in information. 2nd edn. London: FacetKrug, S. (2006) Dont make me think! 2nd edn. Berkeley, CA: New RidersCharmaz, K. (2014) Constructing grounded theory. 2nd edn. London: SageGlaser, B.G. & Strass, A.L. (1967) The discovery of grounded theory. Chicago, IL: de Gruyter
48
Library and Information Systems Team
Andrew Preater @preaterSimon Barron @SimonXIXSimon Mackenzie Karine Larose @karinenrose
Email us: [email protected]
49