developing the digiqual protocol for digital library evaluation
DESCRIPTION
DigiQUAL™. Developing the DigiQUAL Protocol for Digital Library Evaluation. Martha Kyrillidou, Director, Statistics & Measurement Program Sarah Giersch, Consultant Association of Research Libraries. MERLOT International Conference 2005 Nashville, Tennessee, USA July 27, 2005. - PowerPoint PPT PresentationTRANSCRIPT
Developing the DigiQUAL Protocol forDigital Library Evaluation
MERLOT International Conference 2005Nashville, Tennessee, USA
July 27, 2005
Martha Kyrillidou, Director, Statistics & Measurement ProgramSarah Giersch, Consultant
Association of Research Libraries
www.digiqual.org
DigiQUAL™
www.digiqual.org
Terminology & Context
• It’s…? “familiar” and digital
• National Science Digital Library - Evaluating the entity and Evaluating the projects
• DigiQUAL: measure service quality in DLs
www.digiqual.org
Developing DigiQUAL Survey Items
• Background: ServQUAL ->LibQUAL ->DigiQUAL
LibQUAL Dimensionsof Service Quality
• Affect of Service• Information Control• Library as Place
DigiQUAL: 12 themes of DL service qualityAccessibility Collection building DL as community for users Copyright
Navigability Resource use ...developers Role of federations
Interoperability Evaluating collections ...reviewers DL sustainability
www.digiqual.org
Pilot Testing Survey Items & Implementation
www.digiqual.org
Building a Survey
• Review and select items
• Issue: aligning items to individual DL needs and users – vocabulary & content
www.digiqual.org
Building a Survey (cont.)
CustomizeSurvey
Issue: Flexibility vs. Standardization
www.digiqual.org
Implementing Survey – Notification Methods
• Links on site
• Newsletters
• Next to resources
Issues: no pop-ups, no individual emails
www.digiqual.org
Implementing Survey - Incentives
Issues: must be easily transferable, requires email address - clear IRB
www.digiqual.org
(mis)Interpreting results from individual digital libraries in the context of other sites
Sites reluctant to sharedata and results
Analysis & Reporting - Issues
www.digiqual.org
Outstanding Issues & Challenges
• Unique DLs: niche market, critical mass, both?
• Balance:– custom vs. generic content ->results– flexible vs. standard implementation -> scaling
• Mixed methods– Preserving user privacy– Collecting truly useful data
• Moving target: digital libraries as… it depends
www.digiqual.org
Next Steps
• Continue pilot testing: NSDL and beyond• Expand implementation• Consider sustainability models
• Want to Participate? Contact:– Sarah Giersch
[email protected]– Martha Kyrillidou
• For more info:– www.digiqual.org