katherine skinner, executive director, educopia institute christina drummond, research associate...
TRANSCRIPT
Using Informatics & Visualizationsto Understand Digital Preservation Activity
Katherine Skinner, Executive Director, Educopia InstituteChristina Drummond, Research Associate Professor, University of North Texas
CNI Fall Forum - 2013Washington D.C.December 10, 2013
Data Visualization for Education
Skinner and Drummond 2013CNI Fall Forum - 2013
Skinner and Drummond 2013CNI Fall Forum - 2013
Skinner and Drummond 2013CNI Fall Forum - 2013
How can analytics guide the development of a niche field?Digital Preservation
Metrics
1) ACTIVITY PERFORMANCE
Success Impact other projects,
sectors Seeding follow-on
projects Sustainability
Collaborators Sector diversity Geographic diversity
ACADEMIC PERFORMANCE Publications
Prestige Frequency Quantity
Grants Dollar value Quantity Frequency
Awards Collaborators Activity level
Leadership Sector diversity Program creation, hosting
2) ORGANIZATION PERFORMANCE
Skinner and Drummond 2013
CNI Fall Forum - 2013
Metrics
1) ACTIVITY PERFORMANCE
Success Impact other projects,
sectors Seeding follow-on
projects Sustainability
Collaborators Sector diversity Geographic diversity
Activity level Leadership
Sector diversity Program creation, hosting
2) ORGANIZATION PERFORMANCE
3) COMPOSITE STATE PERFORMANCE Activity involvement Organizational
involvement
Skinner and Drummond 2013
CNI Fall Forum - 2013
Enter ICONC
Pilot Data Sources
Reports: National Forum on Archival Continuing Education …(2002) Connecting the Archival Community (2002) Electronic Records Agenda Report (2003) Status of the Preservation of Electronic Records by State Archives (2004) Survey of State Historical Records Advisory Boards (2006) State of State Records…(2007) NDIIPP Preserving our Digital Heritage… (2010) NDIIPP States of Sustainability…(2012) SERI Phase 1 (2012) State Historical Records Advisory Boards…(2013) NEH NCRR Evaluation Report (2013)
Websites: LC Digital Preservation Partners Best Practices Exchange conferences SAA, SERI, NASCIO, NAGARA, Legal Information Preservation Alliance, OCLC, LOCKSS,
LC, Repository ExchangeSurveys:
NASCIO and NAGARA membersGrant awards:
IMLS, NEH, NHPRC, NSF (incl. DataNet), NIH, DOE, Mellon FoundationCNI Fall Forum - 2013
Data Collection
Who: Post-doctoral researchers Digital preservation field experts
Caveats: Sector and organizational type taxonomies need to be
refined. Required publically accessible URL to validate data. Disproportionately represents efforts with open
collaborator lists.
Aspire to opennessCNI Fall Forum - 2013
Pilot Inclusion Criteria
1. Collaborative across institutions Institutional repositories generally not
included
2. Stated digital preservation aim3. U.S. partners
Events: Hosts, planning committees
CNI Fall Forum - 2013
Pilot Dataset
3298 records211 unique collaborative activities1856 organizations
1274 based in U.S.A.▪ including organizational subunits
CNI Fall Forum - 2013
Activity Data
General info: Name, URL, short description
Activity type classificationStart and End YearGeographic focusFounding institutionCurrent host
CNI Fall Forum - 2013
Collaborating Organization DataActivity involvement
Organizational role Primary contact (if known)
AddressStructure (e.g. nonprofit, academic)Organizational Type (e.g. library,
museum)Thematic Focus (e.g. legal, health,
aerospace)
CNI Fall Forum - 2013
Data Interface 1/3
Excel: Raw data store Pivot tables, mockups, printable reports
• Relational data in flat data structure• Relational database more ideal, more
costly
CNI Fall Forum - 2013
Activities within States
CNI Fall Forum - 2013
Organizational Engagement
CNI Fall Forum - 2013
Directory Function
CNI Fall Forum - 2013
Geographic Analysis
Geographic Questions
Concentration of activities, organizations
Under-representation
Activity location = organizational collaborator locations
CNI Fall Forum - 2013
Data Interface 2/3
Web-based mapsSQL based, customizableEase-of-use factor – simple GUI,
quick results
CNI Fall Forum - 2013
http://cdb.io/1bf9zwU
CNI Fall Forum - 2013
http://cdb.io/17vbRux
CNI Fall Forum - 2013
Interactive Queries
Interactive Queries
Dynamic filtering of viewsFor activities:
by state, NDIIPP funding, activity type, end date
For organizations: by state, sector (structure), organization
type, field
CNI Fall Forum - 2013
Data Interface 3/3
Combination of Excel and CartoDB functionality
Web-based, open data accessFree
Risk of pilot data being overextended as final
CNI Fall Forum - 2013
Organization Dashboard
CNI Fall Forum - 2013
Activity Dashboard
CNI Fall Forum - 2013
Engagement by Activity Characteristics
CNI Fall Forum - 2013
Measures for Investigation
Geographic hubs Under-represented areasSector, disciplinary engagementBalance of activity offerings and
organization engagement
CNI Fall Forum - 2013
Which Sectors Dominate Efforts in an Area?
Chronopolis
Data Preservation Alliance for the Social Sciences - Data-PASS
DataONE - Data Observation Network on Earth
DPN - Digital Preservation Network
ECHO DEPository - Exploring Collaborations to Harness Objects with a Digital Environment for Preservation
GPO LOCKSS Pilot Project
HathiTrust
IIPC - International Internet Preservation Coalition
LOCKSS Alliance
MetaArchive
Terra Populus
USDocs - Digital Federal Depository Library Program
0% 10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Sector Diversity Among Washington D.C. Collabo-rators
Preservation Networks
Academia Not-for-Profit U.S.A. Federal Government
CNI Fall Forum - 2013
State-based Collaboration
Number of Involved Organizations
Number of
Activities
Many Activities,Few Players
Few Activities,Few Players
Many Activities,Many Players
Few Activities,Many Players
Increase Outreach / Engagement
Increase Programmatic Opportunities
CNI Fall Forum - 2013
0 20 40 60 80 100 120 140 1600
20
40
60
80
100
120
DC
WA
MI
MDNC
MAVA
TX
IL
NY
PA
CA
Number of Organizations
Number of Activities
CNI Fall Forum - 2013
Most activities fewest
collaborators
Fewest activities with
most collaborators
CNI Fall Forum - 2013
Should data driven dashboards support digital stewardship policy and program development?
How?
Skinner and Drummond 2013CNI Fall Forum 2013
Who is best positioned to actas data stewards?
As interface stewards?
Skinner and Drummond 2013CNI Fall Forum 2013
Which metrics or relationshipsare most useful to measure impact?
Skinner and Drummond 2013CNI Fall Forum 2013
Which metrics or relationshipsare most useful to identify opportunities?
Skinner and Drummond 2013CNI Fall Forum 2013
Which metrics or relationshipsare most useful to identify risks?
Skinner and Drummond 2013CNI Fall Forum 2013
Next phase
Funding contingentActivity lineage tree
Track impact on program development
Individual level data Identify champions, creators
Transition from pilot to refined taxonomies, maintained data
CNI Fall Forum - 2013