wilk apr20-2
TRANSCRIPT
WHY IS THIS ASSESSMENT DIFFERENT FROM ALL OTHERS?Assessment of Archives & Special Collections
NISO Virtual ConferenceWednesday April 20, 2016
About the RBML
Why A Special Kind of Assessment?
• Lack of information regarding RBML services from existing LibQual+ surveys
• Major changes at RBML in 5 year period but no quantifiable data to validate informal observations of increased use and patron satisfaction
• Library administration increasingly invested in using data to drive decision making
Preparations
• Review of current literature in both library assessment and user satisfaction studies
• Institutional Research Board (IRB) training and approval
• Brainstorming information needs
• Soliciting input from stakeholders
Brainstorming Worksheet
Goals• To understand users’ needs and experiences using the
RBML
• To evaluate service at the RBML
• To collect data in a more strategic way and support Libraries’ commitment to assessment
• Build a culture of assessment into RBML in a programmatic and repeatable way
Lots of Data- No
Big Picture
LibQual
In-house Database
Reading Room Stats
Archival Metrics Toolkit
Archival Metrics Toolkit Surveys
• Onsite Users• Students who have attended an orientation session
• Instructors who use the archives for teaching
• Online users of the website• Online users of finding aids
ARCHIVALMETRICS.ORG
Survey Form and Collection Box
Methodology
• Instrument - Archival Metrics Toolkit Researcher Questionnaire
• Data collection - September 1, 2011 to August 30, 2012
• Participants - visiting researchers who volunteered to participate in the project.
• Response rate – 62% (566 respondents)
12
Are you affiliated with Columbia University?
Yes37%
No63%
What best describes your position?
Faculty member or post-doc
24%
Other23%
Undergrad.15%
Master's16%
Doctoral22%
Students53%
Which best characterizes the project that motivated this visit to the Rare Book and Manuscript Library?
7 (1%)
9 (2%)
10 (2%)
29 (5%)
42 (7%)
49 (9%)
117 (21%)
134 (24%)
198 (35%)
Film or video
Curriculum development/teaching preparation
Family history project
Administrative or work-related product
Gathering information, but don't have a finalproject in mind
Other
Class assignment
Dissertation or thesis
Publication (e.g. article, book)
RESPONSE COUNT (RESPONSE %)
TYPE
OF
PRO
JEC
T
How many times have you used the Rare Book and Manuscript Library?
74%
16%
4%7%
First time 2-5 times 6-10 times > 10 times
How long have you been using archival materials?
31%
11%
26%
32%
First time < one year 1-5 years > 5 years
Please indicate your level of satisfaction with the facilities, services and staff of the RBML.
Questionnaire items 1 (completely dissatisfied) 5 (completely satisfied)No
opinionResponse
countStudy areas 0% 0% 4% 16% 72% 8% 495Noise level 0% 2% 6% 21% 71% 0% 502Furniture 1% 1% 7% 18% 71% 2% 498Physical Access to the building 0% 1% 4% 18% 70% 7% 489Lighting 1% 3% 8% 21% 67% 0% 504Informational/ navigational signs 0% 2% 8% 20% 60% 9% 491Temperature 2% 5% 12% 20% 60% 0% 502Internet access 0% 1% 1% 7% 57% 34% 479Hours of service 1% 5% 16% 26% 51% 1% 499Website 0% 1% 6% 21% 50% 22% 477Catalogs/ indexes/ findings aids 0% 2% 5% 20% 43% 30% 467Exhibits 0% 0% 1% 10% 41% 47% 466Reference books 0% 0% 2% 5% 28% 65% 465Photocopying / duplication services 1% 2% 2% 5% 24% 67% 455
Microfilm and fiche viewing facilities 0% 1% 1% 3% 19% 76% 466
19
A Culture of Assessment
20
Online registration and request system
for special collectionsOnline reference tracking system used by all CUL
