Download - Outcome Measures for Eurekans
Outcome Measures for EurekansDr. Cindy MediavillaLibrary Programs Consultant
Monday, March 3, 201412 Noon Pacific
Outcome Measures Experience
Let’s take a Poll
What are some of the most difficult aspects of using outcomes to plan and evaluate library services?
To start our conversation,Type your thoughts into the
chat box.
Defining “Outcomes:”
How our services impact a particular target population
The benefits derived from using
the library
Outcomes result in a positive change in a person’s:
AttitudeBehaviorKnowledgeSkill(s)Life status/Condition
Why use outcomes?
Demonstrate the library’s value, instead of its workload
Tell the stories behind library statistics Measure how the library helped effect
positive change in the community
Stakeholders understand benefits better than numbers
Outcomes terminology
Inputs =
Internal resources the library uses to provide service
Example:
Textbooks + after-school teacher/tutor (inputs)
Borderline students pass math class
Outputs =
How much a library service or resource is used
Outputs vs. outcomes Tallies vs. results
Implementing outcomes1. Identify community
needs/interests2. Determine what changes
(outcomes) need to occur 3. Design library
programs/services to effect change
4. Evaluate whether positive change (outcomes) occurred
Backwards design:
Create target outcomes before designing program/services—i.e., the “If . . . Then” scenario
Outcome statements:Focused on benefits to the end-
user, not on library outputs Realistic and achievable – don’t
try to change the entire world! Measurable
Example statements:As a result of using the library’s after-school
homework center, 45% of borderline students will pass their math class (change in knowledge)
50% of participants will indicate they can now
use their e-readers after receiving the library’s one-on-one e-reader training (change in skill)
As a result of attending the library’s “History of
Rock ‘n Roll” lecture/film series, 60% of teens will say they have a greater appreciation for 1960s rock music (change in attitude)
Measuring outcomes:Decide evaluation strategy at the
beginning of the project planning process
If possible, pre- and post-test to
measure change
Defining “evaluation:”Measures the effectiveness of
services/programs the library provides
Can occur while (formative evaluation) or after (summative evaluation) a program/service is delivered
Why evaluate?Gauge the library’s performance,
as well as diagnose problem areas
Document the library’s
effectiveness Demonstrate the library’s
commitment to providing excellent service
Data collection techniques by outcome type:
Types of change Evaluation Methods
Knowledge TestSurvey/Interview
Skill TestObservationSurvey/Interview
Attitude Survey/Interview
Behavior ObservationSurvey/Interview
Life status/Condition Survey/InterviewObservationFocus group
Challenges of measuring outcomes:Whole new way of measuring what the
library does (benefits vs. numbers) Often difficult to capture outcomes,
especially if results aren’t immediate or readily observable
Data may seem too “soft” or anecdotal Cannot always assume that the outcomes,
by themselves, led to change
Outcomes and grant proposals:Funders want to know what
impact your proposed project will have on the community
What changes will occur as a
result of your grant project? Objectives vs. outcomes
Questions?
Thank you.
Infopeople webinars are supported in part by the U.S. Institute of Museum and Library Services under the provisions of the Library Services and Technology Act, administered in California by the State Librarian. This material is licensed under a Creative Commons 3.0 Share & Share-Alike license. Use of this material should credit the author and funding source.