user-generated content and social discovery in the academic library catalogue: findings from user...
DESCRIPTION
Co-presented with Martha Whitehead at Access 2008TRANSCRIPT
![Page 1: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/1.jpg)
1
User-Generated Content and Social Discovery in the Academic Library Catalogue:
Findings From User ResearchMartha Whitehead, Queen’s University Library
Steve Toub, BiblioCommons
Access 2008, Hamilton, October 2, 2008
![Page 2: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/2.jpg)
2
Agenda
1 Overview of the problems we want to address2 Observations about research and intriguing ideas
to explore3 User research on user-generated content and
social discovery at an academic library4 Preliminary thoughts on how to ensure quality5 Vision and status of BiblioCommons academic
product at Queens6 Questions
![Page 3: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/3.jpg)
3
The Problem
Discovery
getting answers to questions you don’t know how to ask
finding gems you don’t know exist
![Page 4: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/4.jpg)
4
![Page 5: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/5.jpg)
5
Observation: Learning and Research are Social
Social
considering the judgements
and insights of others
![Page 6: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/6.jpg)
6
User-Generated Content
Narrow sensetags, ratings,
reviews
Broader sensecurated content
![Page 7: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/7.jpg)
7
Existing Implementations: UGC in the narrow sense
![Page 8: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/8.jpg)
8
Existing Implementations: UGC in the broader sense
![Page 9: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/9.jpg)
9
Existing Implementations: UGC in the broader sense
![Page 10: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/10.jpg)
10
Existing Implementations: UGC in the broader sense
![Page 11: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/11.jpg)
11
Existing Implementations: UGC in broader sense
![Page 12: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/12.jpg)
12
What have scholars told us about research?
Ontario Council of University Libraries (OCUL) Scholars Portal User Study, May 2008, with Usability Matters
Primary Objective:Understand the information research processes of experienced researchers in a variety of disciplines
Methodology6 collaborative design sessions with 8-10 participants each3 discipline areas
Arts & HumanitiesSocial SciencesSciences (Natural, Applied, Health, etc.)
![Page 13: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/13.jpg)
13
Discover, gather, create, share
A Multi-Dimensional Framework for Academic Support, June 2006, University of Minnesota Libraries funded by Mellon Foundation*, building upon John Unsworth’s concept of scholarly primitives: “basic functions common to scholarly activity across disciplines, over time, and independent of theoretical orientation.”**
Validated in OCUL study: A number of groups introduced the terms “interaction”, “collaboration” or “conversation” and ultimately decided that these are not discrete steps in the process but, rather, are overarching throughout all “phases”. They were adamant about the importance of this aspect of their information research process.
* http://www.lib.umn.edu/about/mellon/UMN_Multi-dimensional_Framework_Final_Report.pdf**John Unsworth. “Scholarly Primitives: What Methods do Humanities Researchers Have in Common and How Might Our Tools Reflect This?”
Humanities Computing, Formal Methods, Experimental Practice Symposium, Kings College, London, May 13, 2000. http://jefferson.village.virginia.edu/~jmu2m/Kings.5-00/primitives.html
![Page 14: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/14.jpg)
14
Aspects of “typical” research process
Thinking of keyword search termsBrainstorm with colleaguesUse a familiar or seminal article or journalUse books and bibliographies/references
Participants appreciate being able to find sources based on:What others searched forMost accessed resourcesMost cited resourcesMost credible or prestigious sources
In storyboarding the ideal discovery process, they included: Seeing recommendations from “authorities”Classics in the fieldWays to find “surprises”, unanticipated sources
![Page 15: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/15.jpg)
15
Social?
The research process is social, but that doesn’t refer to social tools
Few had heard of Del.icio.usEveryone had heard of Facebook but only one or
two were using it for academic purposes
![Page 16: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/16.jpg)
16
“Social discovery,” not “social networking”
User consultation at Queen’s University, February 2007, with Usability Matters
4 focus groups, 6-8 participants each, undergrads, grads, facultyObjectives
Elicit opinions regarding current state of the library website(s)Determine how the library website can support user needsExplore user expectations around information searching
and browsingDetermine user interest and expectations around library
instruction and guidanceElicit ideas for new website features and services
Personalized website featuresSocial networking features
![Page 17: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/17.jpg)
17
Research on UGC: Attitudes
![Page 18: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/18.jpg)
18
![Page 19: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/19.jpg)
19
![Page 20: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/20.jpg)
20
The main point
Participants expressed their desireto know what trusted colleagues (professors, fellow researchers) think
![Page 21: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/21.jpg)
21
March 2008: Research on the research process
At Queen’s, held in a library conference roomFaculty, graduate students and undergraduates
Recruitment of faculty through emailRecruitment of others through link/survey on website, catalogueHour-long one-on-onesStarting with library website, existing catalogue
Also got reaction to several NGCs
4 faculty; 2 staff researchers (both taught occasionally); 2 graduate students; 5 undergraduates
Librarians2 focus groups of 8-10 librarians each
![Page 22: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/22.jpg)
22
March 2008: Key findings on the research process (1)
Faculty, graduate students, and undergraduatesEmploy post-search limiting very infrequently
Only people who’ve seen facets before noticed facets in NGCsReformulate queries via back button and typing variant terms
insteadDo not reformulate queries by ORing all terms or using
truncation, wildcards
LibrariansWant the power of a comprehensive command-line query syntax
(e.g., fielded searches, Boolean operators, truncation)
![Page 23: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/23.jpg)
23
March 2008: key findings on the research process (2)
Faculty, graduate students, and undergraduatesAvoid hyperlinked subject headings
Result screens that list headings are perceived as confusing and unhelpful
Virtual shelf-browsing tested well
LibrariansValue the bibliographic control provided by subject headings
![Page 24: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/24.jpg)
24
March 2008: key findings on the research process (3)
Faculty, graduate students, and undergraduatesDon’t experience pain when manually managing and formatting
citations
LibrariansThink DirectExport to RefWorks is high priority
![Page 25: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/25.jpg)
25
March 2008: key findings on the research process (4)
Faculty, graduate students, and undergraduatesWhen frustrated, students tend not to as for help, especially
from librariansEven in the face of atrocious information literacy skillsInformation literacy skills not dependent on age/role
LibrariansWant to help
![Page 26: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/26.jpg)
26
June 2008 one-on-ones devoted to UGC
Recruited May 28-30 via Facebook ad that linked to SurveyMonkey survey
175,662 impressions. 111 clicks = 0.06% click-through rate
36 completed surveys = 32% who viewed survey completed it
Nine one-hour sessions June 4, 5 at BiblioCommonsEight undergraduates (U of T, Queens, Western)
3 completed fourth year2 completed second year1 completed first year
Two graduate students: brother-sister pair who attended the same hour session
![Page 27: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/27.jpg)
27
Solicited feedback using a variety of different media
• Web sites they’ve used to make product choices (e.g., Restaurantica.com, Rotten Tomatoes)
• Their university library web page and OPAC• And a page in University of Michigan’s OPAC directing
their attention to MTagger• On-screen mockups of three different ways
in which they could contribute UGC in the library context
• Paper mockup of a course-related hub page that provided links to various items associated with a course
• List of possible motivations for contributing UGC
![Page 28: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/28.jpg)
28
This round focused more on narrow UGC than broad
Existing application already has strong support for curated listsCompleted initial exploratory R&D on broad UGC in public library productWill need more R&D to tweak list creation flows
Faculty syllabus tool that outputs to course reserves, bookstore, courseware
Convert ad hoc reference interview into a BiblioCommons list
Still early days for narrow UGC in academic library catalogueNot sure why data elements and motivations apply in academic contextNot aware of any published research on this
Concepts and motivations apply equally well
![Page 29: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/29.jpg)
29
Attitudes about UGC
![Page 30: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/30.jpg)
30
Attitudes about UGC
![Page 31: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/31.jpg)
31
Tagging?
What is this?“I’m not entirely sure… I would like to assume… some sort of user feedback…but I don’t why they’d say “tag” … but if you were a student there you’d probably know what it was…”
D_____, graduated 4th year, entering FIS
![Page 32: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/32.jpg)
32
Tagging!
Have you ever heard of tagging?“No.”Have you ever tagged on Facebook?
“Of course. That’s with photos. They have it for text – but no one uses it.”D____, Graduated 4th year, entering FIS
![Page 33: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/33.jpg)
33
![Page 34: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/34.jpg)
34
![Page 35: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/35.jpg)
35
The most important data elements (course context)
Relevance to courseA lot of “Is it going to be on the test?” But some nuances we could explore further:
“How related is this reading is to other readings?” or “How related this reading is to the lecture?”
Clarity [a.k.a. level of difficulty] was second most popular data element
![Page 36: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/36.jpg)
36
Mechanics of data entry process for UGC
Most said they might not fill out more than 1-2 data elements.The “sliders” represented in the mockups tested well.
Moving a “slider” is perceived to be easier than typing. If there are no open-ended comments that involve typing, it may be
possible to ask for more than two data elements using “sliders”. Segments on the “sliders” should be visually apparent; could be 5-or
10-point scale.
Anonymity, i.e., having the ability to choose a username that isn’t personally identifiable, will make contributions more likely.
Most wanted other students to view their comments.Even the person least likely to contribute (when we first saw the concept,
her reaction was, “Why would I do that?”) in the end said she would be willing to share comments with others if she only had to fill in 1-2 things for each item and if her comments were anonymous.
![Page 37: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/37.jpg)
37
![Page 38: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/38.jpg)
38
Course hub mockup
![Page 39: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/39.jpg)
39
Reaction to the course hub mockup
“That would be amazing!”
“That would become my new first place to go to start my searches.”
--L_____, completed 2nd year at Western
![Page 40: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/40.jpg)
40
Likeliest opportunities to contribute
The course reading context seems the likeliest opportunity to contribute.Solicitation in this context only works if the syllabus were online and the student is
looking at the syllabus online rather than a paper copy.When using the syllabus online, if they were looking at what to read for Week 2,
they wouldn’t mind an invitation to comment on the readings for Week 1.They would like the ability to edit their comments later on.
Soliciting contributions from a “recently returned” also well received.Mixed reaction on email solicitations on “recently returned”.
Need to probe further on how to make emails palatable. Several said they didn’t want email at all. One person said that if she’d much prefer email but not on each recently returned item but only if she got a single email once a month.
The “answers” mockup may only be utilized by who would ask questions, a definite minority.
Many fiercely resist the idea of asking others for help, even a TA or professor.
![Page 41: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/41.jpg)
41
Possible motivations to contributeEarn Campus Credits
Chances to win prizes$ off fines, bookstore, foodservices “Printer Points”Charitable contributions
Opportunity to give feedback / Have my say.which online articles, library materials or course readings are useful; which are not
To the libraryTo my professors
Contribute / Give back to my university…the library. Help build a richer, more useful catalogue / database.
Get recommendations, suggestions – for materials I might not have otherwise found
Help others/everyone get to useful resources faster. More time thinking – less time finding
Quid pro Quo: I earn rights to ask others questions, when I answer some myself.
![Page 42: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/42.jpg)
42
Possible motivations to contributeEarn Campus Credits
Chances to win prizes$ off fines, bookstore, foodservices “Printer Points”Charitable contributions
Opportunity to give feedback / Have my say.which online articles, library materials or course readings are useful; which are not
To the libraryTo my professors
Contribute / Give back to my university…the library. Help build a richer, more useful catalogue / database.
Get recommendations, suggestions – for materials I might not have otherwise found
Help others/everyone get to useful resources faster. More time thinking – less time finding
Quid pro Quo: I earn rights to ask others questions, when I answer some myself.
![Page 43: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/43.jpg)
43
The #1 motivation
Helps [others] get to useful resources fasterHelp us be more helpful to youCould do more probing on languageSeveral commented that they liked the idea of spending
“less time finding, more time writing”
Strong sense ofPay it forward
“If I do it now, it will help others later” “If others do it, it will help me when I need it”
Empty restaurant syndromeSome fears of being the first to contribute
if they did not see evidence that others were doing the sameStronger indication they’d contribute
if they saw that everyone else was doing it
![Page 44: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/44.jpg)
44
It seems pretty easy to “buy” student participation
Even the one student who had consistently said she wouldn’t be likely to contribute quickly checked off all 4 “Campus Credit” concepts as motivating.
![Page 45: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/45.jpg)
45
Primary barriers to contributing
Many (but not all) are unwilling to support freeloaders.
However, they do like being able to freeload themselves and do see the connection that someone must contribute for others to freeload.
Worried about being accused of plagiarism makes students reluctant to share with peers.
Course-related sharing may need to be sanctioned by the professor of that course to allay these fears.
![Page 46: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/46.jpg)
46
Strategies for ensuring quality
Patron authentication: fosters more measured and insightful commentsIt is not possible to leave anonymous comments in our systemEvery username is associated back to a real user authenticated against the library
database
Aggregation: helps you not draw conclusions from a single sourceAbility to see all reviews by particular reviewerAbility to view reviews on an item by many different customers.
Design a marketplace of ideas: self-managed system, not editorial reviewCapture positive/negative sentiment in a structured wayReview the reviewsExpose more attributes than binary hasReview vs. lacksReview
“3 students in your class found this reading helpful to prepare for the midterm exam”
“4 faculty included this item in course reading lists”
![Page 47: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/47.jpg)
47
Vision for BiblioCommons’ academic product
Provide a smart catalogue that offers an outstanding user experienceWhen searching, for most of the people, most of the time, less is moreConditional display of request actions, no buttons leading to a dead endSurface curated content: lists, course reading lists, student bibliographies, etc.Provide ways to get answers to questions that users didn’t know how to ask
Organize by courses, assignments; not LCSH or broad subject guidesEnsure UGC data elements are course-centric, assignment-centricProvide course hubs that unify access to disparate course-related links
Break down artificial barriers between data silosLibrary web siteElectronic resource A-Z listsCourseware (e.g., WebCT)Article databases
![Page 48: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/48.jpg)
48
Our research and development with Queen’s
Priorities grounded in user researchSignificant new development for BiblioCommons2008/2009: Iterative beta release process
![Page 49: User-Generated Content and Social Discovery in the Academic Library Catalogue: Findings From User Research](https://reader033.vdocument.in/reader033/viewer/2022061120/546d5efbaf7959693c8b60f2/html5/thumbnails/49.jpg)
49
Questions?
Martha WhiteheadAssociate University Librarian, Queen’s University [email protected]
Steve ToubProduct Manager, Academic Services, [email protected]