library metrics and measurement
TRANSCRIPT
-
8/13/2019 Library Metrics and Measurement
1/52
LIBRARY METRICS AND
MEASUREMENT:COUNTING WHAT COUNTS &
MAKING IT MATTER
Emily Clasper
Wild Wisconsin Winter Web Conference 2014
-
8/13/2019 Library Metrics and Measurement
2/52
Todays Big Question
-
8/13/2019 Library Metrics and Measurement
3/52
http://farm6.staticflickr.com/5478/11442225495_0ff925eda3_o.jpg
-
8/13/2019 Library Metrics and Measurement
4/52
Library Statistics
Circulation Transactions
Door Count
Reference Questions
Web site visits
Program Attendance
Collection Inventory
Staff Actions
http://farm7.staticflickr.com/6074/6033655868_6b53ef4ebb_b.jpg
-
8/13/2019 Library Metrics and Measurement
5/52
The Panicked Call
Weve been doing
so well! How can ourstats all be down?
http://farm9.staticflickr.com/8006/7706143020_e533940f18_b.jpg
-
8/13/2019 Library Metrics and Measurement
6/52
Depending on Our Numbers
Securing Funds
Justifying expenses
Complying with mandates
Gaining support fromstakeholders
Demonstrating the value ofservices, ROI
Data-driven decision making Allocation of our internal
resources
Service development decisions
http://farm3.staticflickr.com/2602/3678747186_b63d82fe2c_o.jpg
-
8/13/2019 Library Metrics and Measurement
7/52
Moving Beyond Circ Stats
https://reader010.{domain}/reader010/html5/0621/5b2b441239fda/5b2b44161c114.jpg
-
8/13/2019 Library Metrics and Measurement
8/52
Asking The Right Questions
htt : farm3.staticflickr.com 2318 2201907500 6f0741be40 o.
-
8/13/2019 Library Metrics and Measurement
9/52
The Wrong Question
http://static.flickr.com/7062/6845000770_ebd5fb87d5.jpg
We bought a 3-D printer
and it seems to get a lot of
use, but circulation down!
-
8/13/2019 Library Metrics and Measurement
10/52
The Wrong Question
http://farm5.staticflickr.com/4141/4817786416_282faf5324_o.jpg
That long jumper seems like
a really strong athlete, but
she doesnt run very fast!
-
8/13/2019 Library Metrics and Measurement
11/52
Asking New Questions
Is this a question that we can
Will the answer lead to new
Does this knowledge help us assess our
Can this assessment be used to suggest
Will the actions help lead us closer to our
-
8/13/2019 Library Metrics and Measurement
12/52
Go Back to Your Goals
http://farm3.staticflickr.com/2773/4318924726_85eae8b991_o.jpg
-
8/13/2019 Library Metrics and Measurement
13/52
Outputs vs. Outcomes
http://farm5.staticflickr.com/4040/5143354092_e15831241a_b.jpg http://static.flickr.com/2565/3810230521_35410d4b38.jpg
-
8/13/2019 Library Metrics and Measurement
14/52
Outcomes Measurement
Inputs Activities Output InterimOutcomes
Outcomes Goals
Process Results of Process
Library Perspective: What
Library Does/Provides
User Perspective: Results of
the Users Experience
Adapted from: Rubin, Rhea Joyce. 2006.Demonstrating Results: Using Outcome Measurement in Your Library
. PLA ResultsSeries. Chicago: American Library Association.
-
8/13/2019 Library Metrics and Measurement
15/52
What Defines Success?
What is it that were
actually trying to DO?
How will we know if
weve accomplished
that goal?
-
8/13/2019 Library Metrics and Measurement
16/52
Data Collection
http://static.flickr.com/2423/3971932491_27e5acf65b.jpg
-
8/13/2019 Library Metrics and Measurement
17/52
What Data Do We Need?
http://farm9.staticflickr.com/8514/8450658347_06c56211f9_b.jpg
-
8/13/2019 Library Metrics and Measurement
18/52
Key Performance Indicators
Measureable
Indicates progress towards goals
Actionable Measured frequently and consistently
May be objective or subjective
-
8/13/2019 Library Metrics and Measurement
19/52
Library KPIs Can Take Many Forms
http://www.bu.edu/library/files/2013/03/Faculty-Satisfaction-Services.bmp
0
50,000
100,000
150,000
200,000
250,000
12
am-
1am
3-
4
am
4-
5
am
5-
6
am
6-
7
am
7-
8
am
8-
9
am
9-
10
am
10-
11
am
11a
m-
12pm
12-
1
pm
1-
2
pm
2-
3
pm
3-
4
pm
4-
5
pm
5-
6
pm
6-
7
pm
7-
8
pm
8-
9
pm
9-
10
pm
10-
11
pm
11p
m-
12am
-
8/13/2019 Library Metrics and Measurement
20/52
KPIs as Strategic Goals
By 2015, 80% of users surveyed will indicate that theywaited no longer than three minutes for staff assistanceat a public service desk.
By 2015, at least 85% of all purchased items will beinvoiced, cataloged, processed, ad sent for shelvingwithin two weeks of receipt.
By 2016, the number of children aged 6-11 withlibrary cards will increase from X to Y.
Each year, a minimum of 80% of adults and teens whoattend a training session on how to use technology tocreate content will indicate that the training session wasvery good or excellent.
-
8/13/2019 Library Metrics and Measurement
21/52
Qualitative Measures
https://reader010.{domain}/reader010/html5/0621/5b2b441239fda/5b2b441de9037.jpg
-
8/13/2019 Library Metrics and Measurement
22/52
Standards
http://farm7.staticflickr.com/6049/6372676915_b651c4614d_o.jpg
-
8/13/2019 Library Metrics and Measurement
23/52
Open Data
http://static.flickr.com/5002/5265955179_4a33d2f2cb.jpg
-
8/13/2019 Library Metrics and Measurement
24/52
Available Tools
https://reader010.{domain}/reader010/html5/0621/5b2b441239fda/5b2b441fafc01.jpg https://reader010.{domain}/reader010/html5/0621/5b2b44
-
8/13/2019 Library Metrics and Measurement
25/52
Available Tools
htt : online.ws .com news articles SB10001424052702303332904579230401030827722
-
8/13/2019 Library Metrics and Measurement
26/52
Questions for Data Collection
Are we counting effectively?
What structures do libraries have in place for
gathering performance data?
What kind of models can we emulate for improvingour data collection strategies?
How do we get closer to gathering qualitative
measures as well?
http://farm3.staticflickr.com/2197/2200500024_33038620af_o.jpg
-
8/13/2019 Library Metrics and Measurement
27/52
Use of Tools
http://farm4.staticflickr.com/3119/3132662146_b305c1c058_b.jpg
-
8/13/2019 Library Metrics and Measurement
28/52
Accessing and Storing Data
http://farm4.staticflickr.com/3245/2294144289_3102e0de26_o.jpg
-
8/13/2019 Library Metrics and Measurement
29/52
Analysis and Interpretation
http://farm3.staticflickr.com/2173/2121472112_8ac5d673ff_b.jpg
-
8/13/2019 Library Metrics and Measurement
30/52
Now That We Have The Data
http://static.flickr.com/6017/5961260280_f38d3cbee9.jpg
-
8/13/2019 Library Metrics and Measurement
31/52
Drawing Conclusions
http://farm9.staticflickr.com/8389/8597760704_70f681d096_k.jpg
-
8/13/2019 Library Metrics and Measurement
32/52
What Does This Really Mean?
http://farm3.staticflickr.com/2891/9354301543_30e405da0a_b.jpg
-
8/13/2019 Library Metrics and Measurement
33/52
Using Data for Good, Not Evil
http://farm4.staticflickr.com/3674/10868394285_6a10dc9e99_b.jpg
-
8/13/2019 Library Metrics and Measurement
34/52
Making it Matter
http://static.flickr.com/5213/5397741531_84b940fea1.jpg
-
8/13/2019 Library Metrics and Measurement
35/52
Using and Presenting Data
http://farm9.staticflickr.com/8330/8436405977_d0613c3cac_b.jpg
-
8/13/2019 Library Metrics and Measurement
36/52
http://farm6.staticflickr.com/5144/5659510216_657431c231_b.jpg
Making Data Easy to Understand
-
8/13/2019 Library Metrics and Measurement
37/52
http://farm3.staticflickr.com/2842/10950781743_5ffecf486c_o.png
Making Data Relatable
-
8/13/2019 Library Metrics and Measurement
38/52
Making Decisions
http://www.nytimes.com/newsgraphics/2014/01/05/poverty-map/
http://www.nytimes.com/newsgraphics/2014/01/05/poverty-map/http://www.nytimes.com/newsgraphics/2014/01/05/poverty-map/http://www.nytimes.com/newsgraphics/2014/01/05/poverty-map/http://www.nytimes.com/newsgraphics/2014/01/05/poverty-map/ -
8/13/2019 Library Metrics and Measurement
39/52
http://farm8.staticflickr.com/7018/6785112263_1bdc801df8_o.png
Making Connections
-
8/13/2019 Library Metrics and Measurement
40/52
http://farm9.staticflickr.com/8192/8112404383_669f0c715a_h.jpg
Making a Point
-
8/13/2019 Library Metrics and Measurement
41/52
http://farm2.staticflickr.com/1128/585861831_c3647f199d_b.jpg
Making an Impression
-
8/13/2019 Library Metrics and Measurement
42/52
Telling a Story
http://media-cache-
ak0.pinimg.com/736x/43/80/84/438084e70887229c890b9deae32a0db1.jpghttp://media-cache-
ec0.pinimg.com/736x/9f/c2/aa/9fc2aa3f178ff11634dfe236bd68b96c.jpg
-
8/13/2019 Library Metrics and Measurement
43/52
Promoting a Brand
http://obieosobalu.files.wordpress.com/2011/01/history-of-microsoft-final.jpg http://www.coca-colacompany.com/our-company/infographic-coca-cola-at-a-glance
-
8/13/2019 Library Metrics and Measurement
44/52
http://www.heroicpixels.com/wp-
content/uploads/2013/02/school_library_impact_blog13.jpg
http://www.thisblogrules.com/wp-content/uploads/2011/07/lib-550x317.jpg
https://fbcdn-sphotos-e-a.akamaihd.net/hphotos-ak-ash3/1229853_10151835031660743_782695969_n.jpg
-
8/13/2019 Library Metrics and Measurement
45/52
Turning Outcomes Into Impact
htt : media-cache-ec0. inim .com 736x 6d 23 29 6d232935bd4317fdf3547144ebad6dba.
-
8/13/2019 Library Metrics and Measurement
46/52
Moving Forward
http://farm5.staticflickr.com/4062/4529934744_98a8f4bcc7_o.png
-
8/13/2019 Library Metrics and Measurement
47/52
Questions for Libraries
What areas of measurement might we get into in
response to changing organizational goals?
How can we present the data we gather and the
conclusions we draw from it to more effectivelydemonstrate success, promote the library and its goals,
boost productivity, make more informed decisions, tell
the librarys story to stakeholders?
What skills do we, as Information Pros, Managers, andAdvocates need to develop in order to effectively make
analytics the powerful tool we need it to be?
-
8/13/2019 Library Metrics and Measurement
48/52
http://farm8.staticflickr.com/7171/6632168217_bdc32df214_b.jpg
Do We Have the Skills?
-
8/13/2019 Library Metrics and Measurement
49/52
http://farm1.staticflickr.com/113/286709039_105881e4b9_o.jpg
Do We Have The Tools?
-
8/13/2019 Library Metrics and Measurement
50/52
Can We Make it Matter?
htt : media-cache-ec0. inim .com 736x 6d 23 29 6d232935bd4317fdf3547144ebad6dba.
-
8/13/2019 Library Metrics and Measurement
51/52
Recommended Reading
Brophy, Peter. 2006. Measuring Library Performance: Principles and Techniques. London: Facet.
Hernon, Peter, Robert E. Dugan, and Joseph R. Matthews. 2014. Getting Started with Evaluation. Chicago:
American Library Association.
Ishak, Das. 2014. Discovering the Right Key Performance Indicators in Libraries: A Review of Literatures.
Accessed January 14.
http://www.academia.edu/1805631/Discovering_the_right_key_performance_indicators_in_libraries_a_review
_of_literatures. Larkin, Richard. 2013. Using Outcomes to Measure Nonprofit Success. NPQ - Nonprofit Quarterly. July 2.
http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.
Matthews, Joseph R. 2007. The Evaluation and Measurement of Library Services. Westport, Conn: Libraries
Unlimited.
Rubin, Rhea Joyce. 2006. Demonstrating Results: Using Outcome Measurement in Your Library . PLA Results Series.
Chicago: American Library Association.
Webbmedia Group. 20:12:02 UTC. Key Performance Indicators For Libraries. Education.
http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.
Wolf, Lesile. 2010. What Gets Measured Gets Done: Key Performance Indicators. California Digital Library.
http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/.
Zappone, Marisa. 2013. Why It Makes Sense for Nonprofits To Focus on Contribution, Not Causation.
Greenlights for Nonprofit Success. http://www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-
nonprofits-to-focus-on-contribution-not-causation/#more-7572.
http://www.academia.edu/1805631/Discovering_the_right_key_performance_indicators_in_libraries_a_review_of_literatures.http://www.academia.edu/1805631/Discovering_the_right_key_performance_indicators_in_libraries_a_review_of_literatures.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://greenlights%20for%20nonprofit%20success.%20http/www.greenlights.org/blog/2013/09/16/why-it-makes-sense-for-nonprofits-to-focus-on-contribution-not-causation/#more-7572http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.cdlib.org/cdlinfo/2010/09/15/what-gets-measured-gets-done-key-performance-indicators/http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.slideshare.net/webbmedia/key-performance-indicators-for-libraries.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.nonprofitquarterly.org/management/22549-using-outcomes-to-measure-nonprofit-success.html.http://www.academia.edu/1805631/Discovering_the_right_key_performance_indicators_in_libraries_a_review_of_literatures.http://www.academia.edu/1805631/Discovering_the_right_key_performance_indicators_in_libraries_a_review_of_literatures. -
8/13/2019 Library Metrics and Measurement
52/52
EMILY CLASPERHTTP://BIT.LY/CLASPERWWWC14
http://eclasper.com
http://bit.ly/clasperwwwc14http://bit.ly/clasperwwwc14http://bit.ly/clasperwwwc14