library analytics: measuring the impact of library use on arts disciplines graham stone information...
TRANSCRIPT
![Page 1: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/1.jpg)
Library analytics:measuring the impact of
library use on arts disciplines
Graham Stone
Information Resources Manager
This work is licensed under a Creative Commons Attribution 3.0 Unported License
#lidp #jiscLAMPhttp://eprints.hud.ac.uk/ 19775
![Page 2: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/2.jpg)
…to improve existing services
…to gain insights into user behaviour
…to measure the impact of the library
Using Usage Data since 2005…
![Page 3: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/3.jpg)
Library Impact Data Project
![Page 4: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/4.jpg)
To support the hypothesis that…
“There is a statistically significant correlation across a number of universities between
library activity data and student attainment”
![Page 5: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/5.jpg)
Library Impact Data Project 1Original data requirements
• For each student who graduated in a given year, the following data was required:– Final grade achieved– Number of books borrowed– Number of times e-resources were accessed – Number of times each student entered the library, e.g.
via a turnstile system that requires identity card access– School/Faculty
![Page 6: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/6.jpg)
Library Impact Data ProjectPhase I
– Showed a statistical significance between:
• Final grade achieved• Number of books
borrowed• Number of times e-
resources were accessed
– Across all 8 partners
Not a cause and effect relationship
![Page 7: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/7.jpg)
Library Impact Data Project
Phase I looked at over 33,000 students across 8 universities
Phase II looked at around 2,000 FT undergraduate students at Huddersfield
![Page 8: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/8.jpg)
Library Impact Data Project 2Additional data
• Demographics• Discipline• Retention• On/off campus use• Breadth and depth of e-
resource usage• UCAS points (entry data)• Correlations for Phase 1
![Page 9: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/9.jpg)
Library usageEthnicity
![Page 10: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/10.jpg)
Library usageCountry of domicile
![Page 11: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/11.jpg)
Library usageAggregated subject groups
![Page 12: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/12.jpg)
Library usageArts group
![Page 13: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/13.jpg)
Library usageArts group
• Music skewed the data and should probably have gone into the humanities group
• There are fewer significant differences in the rest of the arts group
• Architects do not visit the library very often compared to the other clusters in this group…
• …fashion designers do• 3D designers are fond of e-resources
![Page 14: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/14.jpg)
Library usageThe effect of discipline
• Discipline has a big effect on patterns of library usage
• Although probably not earth shattering news in itself, LIDP does provide statistical evidence
• A starting point for conversations with academics– Low usage by their students is a cause for concern– What might be done to increase it?
![Page 15: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/15.jpg)
Library usageThe ‘personalized boutique service’
• Library analytics can help to identify the ‘context’, which, “…allows us to prioritize areas of our service for improvement” (Tilley, 2013, p.91)
• “Knowledge of users’ needs and activity - their preferences, the irritants - and their methods of working” (Tilley, 2013, p.82) could be used to target known ‘low-use’ subjects in order to give a more personalized boutique service to the end user
Tilley, E. (2013). Personalized boutique service: critical to academic library success? New review of academic librarianship, 19(1), 78-97. http://dx.doi.org/10.1080/13614533.2012.753464
![Page 16: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/16.jpg)
Library Impact Data ProjectSpreading the word
![Page 17: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/17.jpg)
Number of e-resources accessedDepth and breadth
![Page 18: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/18.jpg)
Other factorsNumber of e-resources accessed
• Both borrowing books and logging onto electronic resources does not guarantee the item has been read, understood and referenced
• Heavy usage does not equate to high information seeking or academic skills
• Additionally, students on particular courses may be using more primary materials only available outside of library resources: non-use of library resources does not mean students are using poor quality information
![Page 19: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/19.jpg)
Library usageRetention
• Looking at one year of data for every student• Using a cumulative measure of usage for the first two
terms of the 2010-11 academic year• Only looking at people who dropped out in term three• All the students included in this study were at the
university in the first two terms, and they have all had exactly the same opportunity to accumulate usage.
![Page 20: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/20.jpg)
Library usageRetention
![Page 21: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/21.jpg)
Going forward@Huddersfield
• Identifying retention issues and our impact on lowering them as part of a University dashboard
Engagement
Workload
Performance
Thanks to Lee O’Farrell,
University College Dublin,
for the inspiration for this image
![Page 22: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/22.jpg)
Going forward@Huddersfield
• Two spin off projects– Lemon Tree– Roving Librarian
• Look at specific subjects in order to work towards– A best practice toolkit for information skills sessions– Further understanding by holding focus groups with target areas
• Creating an action plan to engage with academics• Showing value for money and the impact of the service
on the student experience
![Page 24: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/24.jpg)
Drivers for change 1And we know all this is firmly on Libraries’ radars
Our survey: How important will analytics be to academic libraries now and in the future, and what is the potential for a service in this area?
![Page 25: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/25.jpg)
Significant appetite for analytics services
• There’s a significant appetite (96%) for analytics services…
• …but hesitation over sharing entry data and other student data than other forms of usage data
• Only 46% would be willing to share data if the institution was named…
• …but if institutional identity can be anonymised, that changes to 91%
![Page 26: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/26.jpg)
Is this a current strategic priority?
![Page 27: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/27.jpg)
What about the next five years?
![Page 28: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/28.jpg)
![Page 29: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/29.jpg)
JiscLAMPLibrary Analytics and Metrics Project
• Looking at the benefits of scale• To develop a prototype shared library analytics service
for UK academic libraries– Envisioned as a data dashboard– Enabling libraries to capitalise on the many types of data
they capture in day-to-day activities – To support the improvement and development of new
services and demonstrate value and impact in new ways across the institution
![Page 30: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/30.jpg)
JiscLAMPProject partners
![Page 31: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/31.jpg)
JiscLAMPA brief (important) word on ethics
• Should we be holding and analyzing this kind of data– Data protection issues and ‘Big brother’ concerns– All students pay the same fees – shouldn’t they be treated the
same?
• But what if we didn’t do this– What would the reaction be if it was found that we had this data
but didn’t act on it?– We have a duty to care for the individual wellbeing of our
students
![Page 32: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/32.jpg)
Job storiesConsulting with the community
![Page 33: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/33.jpg)
JiscLAMPNormalisation of Data
![Page 34: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/34.jpg)
JiscLAMPWhat did we achieve?
• LAMP project outputs– We managed to clean up and process the data from all of the partners– We created a prototype – our analytics engine– We performed a benchmarking exercise
• We showed that the idea of a shared library analytics service was feasible
![Page 35: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/35.jpg)
JiscLAMPWhat can we do with the data?
• We can demonstrate usage by cohorts:
DepartmentDegree nameCourseCourse ‘type’?Gender/Ethnicity/Nationality/Disability/AgeLevel of attainmentAttendance mode (full time/part time)UCAS points
• We can demonstrate correlations between usage and attainment/usage and cohort)
![Page 36: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/36.jpg)
JiscLAMPThe data dashboard
![Page 37: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/37.jpg)
JiscLAMPThe ugly prototype
![Page 38: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/38.jpg)
JiscLAMPThe wireframe
![Page 39: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/39.jpg)
JiscLAMPWhat could we do?
![Page 40: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/40.jpg)
Where do we go from here? Our key areas for focus 2014-15
• Merge data from multiple systems– Library, student registry, IT services
• Make the data beautiful and compelling through iterative testing and development
• Contribute to the institutional analytics mission
• Usage data to ‘profile’ individuals– e.g. Key usage indicators by discipline
• Crack e-resource item level usage– the current approach of the UK Access
Management Federation
![Page 41: Library analytics: measuring the impact of library use on arts disciplines Graham Stone Information Resources Manager This work is licensed under a Creative](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e995503460f94b9bb95/html5/thumbnails/41.jpg)
How can you get involved?http://jisclamp.mimas.ac.uk
• Follow and comment on our blog: http://jisclamp.mimas.ac.uk
• Attend a LAMP workshop (tba)
• Become a data contributor! – email: [email protected]
– email [email protected]
– email [email protected]
This work is licensed under a Creative Commons Attribution 3.0 Unported License
#lidp #jiscLAMPhttp://eprints.hud.ac.uk/ 19775