hitting the road towards a greater digital destination: evaluating and testing dams at the...
TRANSCRIPT
![Page 1: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/1.jpg)
Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries
Annie Wu, Rachel Vacek, Santi Thompson, Andy Weidner, Sean Watkins, Valerie Prilop Texas Conference on Digital Libraries | Austin, TX | April 27, 2015
![Page 2: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/2.jpg)
Overview
Background and Methodology Evaluation and Results
Insights Next Steps
2
![Page 3: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/3.jpg)
Background and Methodology
3
...with Annie
![Page 4: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/4.jpg)
UH Digital Library
● Launched in 2009 ● 64 collections ● 60,000+ digital
objects ● Images, text,
audio, video ● CONTENTdm with a
custom user interface
4
http://digital.lib.uh.edu/
![Page 5: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/5.jpg)
DAMS Evaluation - Rationale
● CONTENTdm allowed us to build an initial digital library
● We needed a more robust DAMS for new digital initiatives ○ Is more flexible, scalable, interoperable ○ Manages larger amount of data in a variety of formats ○ Accommodates creative workflows ○ Allows for configuration of additional functionalities ○ Supports and enables linked data
5
![Page 6: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/6.jpg)
UH Libraries Strategic Directions
“...work assiduously to expand our unique and comprehensive collections that support curricula and spotlight research. We will pursue seamless access and expand digital collections to increase national recognition.”
http://info.lib.uh.edu/p/strategic-directions 6
![Page 7: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/7.jpg)
DAMS Implementation Task Force
7
http
://w
ww
.soc
iale
arth
.org
![Page 8: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/8.jpg)
The Team
Special Collections
Digital Projects Librarian
(Valerie Prilop)
Digital Repository Services
Web Services Metadata & Digitization
Services
Head of Metadata & Digitization Services (Annie Wu)
Metadata Services
Coordinator (Andy Weidner)
Co-
Cha
ir Head of Web
Services (Rachel Vacek)
Head of Digital Repository Services
(Santi Thompson)
Web Projects Manager
(Sean Watkins)
Co-
Cha
ir
8
![Page 9: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/9.jpg)
The Charge
● Perform a needs assessment and build criteria and policies based on evaluation of the current system and requirements for the new DAMS
● Research and explore DAMS on the market and identify the top 2-3 systems for beta testing in a development environment
● Generate preliminary recommendations from stakeholders' comments and feedback
● Coordinate installation of the new DAMS and finish data migration
● Communicate the task force work to UH colleagues 9
![Page 10: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/10.jpg)
Methodology
● Needs assessment ● Broad evaluation
o Evaluate 12 systems using broad criteria ● Detailed evaluation
o Install systems for testing environment o Evaluate top 2 systems from previous evaluation
using detailed criteria ● Data analysis and recommendation
10
![Page 11: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/11.jpg)
Needs Assessment - Goal
● Collect key requirements of stakeholders
● Identify future features of the new DAMS
● Gather data in order to craft criteria for evaluation
http
://su
blim
estu
dies
.com
11
![Page 12: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/12.jpg)
Needs Assessment - Activities
● Internal focus group interviews ● Reviewed scholarly literature on DAMS evaluation and
migration ● Researched peer/aspirational institutions ● Reviewed national standards around DAMS ● Identified materials and users ● Determined both the current use of the DL as well as its
projected use of the DL
12
![Page 13: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/13.jpg)
Evaluation and Results
13
...with Sean
![Page 14: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/14.jpg)
Broad Evaluation
Building the criteria: ● Focus group interviews ● Literature reviews ● DAMS best practices
Organizing the criteria:
● Covered 4 topics o System Function o Content Acquisition / Management o Metadata o User Interface and Search Support
14
![Page 15: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/15.jpg)
Broad Evaluation Results
Scoring: ● Scores were determined by reviewing supporting
documentation, marketing information, or talks with venders
● 0 - Does not support criteria ● 1 - Supports criteria ● Scores where totaled up and top 2 systems were
evaluated for the final round
15
![Page 16: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/16.jpg)
16
DAMS Evaluation Score Possible Score
Fedora 27 29
Fedora / Hydra 26 29
Fedora / Islandora 26 29
Collective Access 24 29
DSpace 24 29
CONTENTdm 20 29
Rosetta 20 29
Trinity (iBase) 19 29
Preservica 16 29
Luna Imaging 15 29
RODA 6 29
Invenio 5 29
Score of 12 DAMS from testing using Broad Evaluation Criteria
![Page 17: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/17.jpg)
Detailed Evaluation ● Detailed criteria drawn from the same sources
used previously ● Looked at specific features for DAMS ● Criteria was divided into eight testing sections
o System Environment and Testing o Administrative Access o Content Ingest and Management o Metadata o Content Access o Discoverability o Report and Inquiry Capabilities o System Support
17
![Page 18: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/18.jpg)
System Setup
● Virtual servers were set up for each system ● Latest stable versions were chosen (no betas)
and installed ● All supporting server software was installed ● Additional software to support the evaluation
testing was installed and set up
18
![Page 19: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/19.jpg)
Gathering Collections for testing
● Wide variety of item formats currently available ● Variety of item formats for future projects ● Large collections ● Included items with bad metadata, wrong
formats, and corrupted data
19
![Page 20: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/20.jpg)
Detailed Evaluation Results
Scoring: ● Each system was tested with the same set of collection
items ● Ranged score 0 - 3 (0 failed - 3 fully supported) ● Yes / No criteria was scored 0 or 3 ● System documentation was still used in some scoring
20
![Page 21: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/21.jpg)
21
Score of top 2 DAMS from testing using Detailed Evaluation Criteria
Testing Sections DSpace Score
Fedora Score
Possible Score
System Environment and Testing 21 21 36
Administrative Access 15 12 18
Content Ingest and Management 59 96 123
Metadata 32 43 51
Content Access 14 18 18
Discoverability 46 84 114
Report and Inquiry Capabilities 6 15 21
System Support 12 11 12
TOTAL SCORE: 205 300 393
![Page 22: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/22.jpg)
Top 2 System Evaluation Results
● Scores were tallied to show top ranked system ● Systems summarized into advantages and
disadvantages ● Recommendation was compiled and written
into the final report
22
![Page 23: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/23.jpg)
Fedora/Hydra - Advantages and Disadvantages
23
Advantages Disadvantages Open source Steep learning curve
Large development community Long setup time
Linked Data ready Requires additional tools for discovery
Modular design through API No standard model for multi-file objects
Scalable, sustainable, and extensible
Batch import / export of metadata
Handles any file format
![Page 24: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/24.jpg)
DSpace - Advantages and Disadvantages
24
Advantages Disadvantages Open source Flat file and metadata structure
Easy installation / turnkey system Limited reporting capabilities
Existing familiarity through TDL Limited metadata features
User group / profile controls Does not support Linked Data
Metadata quality module Limited API
Batch import of objects Not scalable or extensible
Poor user interface
![Page 25: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/25.jpg)
Insights
25
...with Rachel
![Page 26: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/26.jpg)
Project Management
● Initial planning ● Tools ● Flexibility ● Meetings ● Food ● Milestones
26
http://infospace.ischool.syr.edu/files/2014/04/Project-Management.jpg
![Page 27: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/27.jpg)
Committee
● Size ● Representation ● Shared
understanding ● Diverse skillsets
27
http://www.uniquelyhis.net/wp-content/uploads/puzzle-pieces.jpg
![Page 28: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/28.jpg)
Time
● Manage expectations ● Balance ● Intensive
research
28
http://img.timeinc.net/time/2007/eating/makes_eat/makes_eat_time.jpg
![Page 29: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/29.jpg)
Communication
● Administration ● Key stakeholders ● Entire library ● Other libraries
29
http://dineability.com/wp-content/uploads/2013/04/communication.jpg
![Page 30: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/30.jpg)
Testing
● Turnkey vs. framework systems ● User interfaces
o Local installation o Other institutions
30
![Page 31: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/31.jpg)
Evaluation
● Different criteria sets ● Consistency ● Vetting process ● Awareness of possibilities
31
![Page 32: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/32.jpg)
Next Steps
32
...with Andy
![Page 33: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/33.jpg)
Next Steps
● Phase 1: Systems Installation ● Phase 2: Data Migration ● Phase 3: Interface Development ● Assessment, Documentation and Training
33
![Page 34: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/34.jpg)
Phase 1: Systems Installation
● Development environment
● Rewrite DL front-end for Fedora/Solr
● Data models
● Digital preservation workflow
● Hydra content management application
34
![Page 35: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/35.jpg)
Phase 2: Data Migration
● Content migration strategy ● Migrate test collections ● Data migration ● Continued Hydra development
35
http://southsidepride.com/wp-content/uploads/2014/01/Migrating-birds.jpg
![Page 36: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/36.jpg)
Phase 3: Interface Development
● Re-evaluate user interface o Conduct user testing
o Re-write DL front-end in Hydra OR …
o Update current PHP front-end
● Inter-departmental production workflows
● Refine Hydra content management application
36
![Page 37: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/37.jpg)
Assessment, Documentation, and Training
● Assess service impact ● User testing
● System enhancements
● New workflows ● Create and maintain documentation ● Get training
o Conferences, webinars, workshops, etc.
37
![Page 38: Hitting the Road towards a Greater Digital Destination: Evaluating and Testing DAMS at the University of Houston Libraries](https://reader030.vdocument.in/reader030/viewer/2022032420/55a5b2a91a28aba07b8b4650/html5/thumbnails/38.jpg)
Thank you!
Annie Wu, Head of Metadata & Digitization Services, [email protected] Rachel Vacek, Head of Web Services, [email protected] Santi Thompson, Head of Digital Repository Services Andy Weidner, Metadata Services Coordinator Sean Watkins, Web Projects Manager Valerie Prilop, former Digital Projects Librarian
Slides at: http://bit.ly/tcdl-2015
38