katherine skinner, executive director, educopia institute christina drummond, research associate...

40
Using Informatics & Visualizations to Understand Digital Preservation Activity Katherine Skinner, Executive Director, Educopia Institu Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum - 2013 Washington D.C. December 10, 2013

Upload: phillip-barton

Post on 27-Dec-2015

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Using Informatics & Visualizationsto Understand Digital Preservation Activity

Katherine Skinner, Executive Director, Educopia InstituteChristina Drummond, Research Associate Professor, University of North Texas

CNI Fall Forum - 2013Washington D.C.December 10, 2013

Page 2: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Data Visualization for Education

Skinner and Drummond 2013CNI Fall Forum - 2013

Page 3: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Skinner and Drummond 2013CNI Fall Forum - 2013

Page 4: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Skinner and Drummond 2013CNI Fall Forum - 2013

Page 5: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

How can analytics guide the development of a niche field?Digital Preservation

Page 6: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Metrics

1) ACTIVITY PERFORMANCE

Success Impact other projects,

sectors Seeding follow-on

projects Sustainability

Collaborators Sector diversity Geographic diversity

ACADEMIC PERFORMANCE Publications

Prestige Frequency Quantity

Grants Dollar value Quantity Frequency

Awards Collaborators Activity level

Leadership Sector diversity Program creation, hosting

2) ORGANIZATION PERFORMANCE

Skinner and Drummond 2013

CNI Fall Forum - 2013

Page 7: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Metrics

1) ACTIVITY PERFORMANCE

Success Impact other projects,

sectors Seeding follow-on

projects Sustainability

Collaborators Sector diversity Geographic diversity

Activity level Leadership

Sector diversity Program creation, hosting

2) ORGANIZATION PERFORMANCE

3) COMPOSITE STATE PERFORMANCE Activity involvement Organizational

involvement

Skinner and Drummond 2013

CNI Fall Forum - 2013

Page 8: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Enter ICONC

Page 9: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Pilot Data Sources

Reports: National Forum on Archival Continuing Education …(2002) Connecting the Archival Community (2002) Electronic Records Agenda Report (2003) Status of the Preservation of Electronic Records by State Archives (2004) Survey of State Historical Records Advisory Boards (2006) State of State Records…(2007) NDIIPP Preserving our Digital Heritage… (2010) NDIIPP States of Sustainability…(2012) SERI Phase 1 (2012) State Historical Records Advisory Boards…(2013) NEH NCRR Evaluation Report (2013)

Websites: LC Digital Preservation Partners Best Practices Exchange conferences SAA, SERI, NASCIO, NAGARA, Legal Information Preservation Alliance, OCLC, LOCKSS,

LC, Repository ExchangeSurveys:

NASCIO and NAGARA membersGrant awards:

IMLS, NEH, NHPRC, NSF (incl. DataNet), NIH, DOE, Mellon FoundationCNI Fall Forum - 2013

Page 10: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Data Collection

Who: Post-doctoral researchers Digital preservation field experts

Caveats: Sector and organizational type taxonomies need to be

refined. Required publically accessible URL to validate data. Disproportionately represents efforts with open

collaborator lists.

Aspire to opennessCNI Fall Forum - 2013

Page 11: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Pilot Inclusion Criteria

1. Collaborative across institutions Institutional repositories generally not

included

2. Stated digital preservation aim3. U.S. partners

Events: Hosts, planning committees

CNI Fall Forum - 2013

Page 12: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Pilot Dataset

3298 records211 unique collaborative activities1856 organizations

1274 based in U.S.A.▪ including organizational subunits

CNI Fall Forum - 2013

Page 13: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Activity Data

General info: Name, URL, short description

Activity type classificationStart and End YearGeographic focusFounding institutionCurrent host

CNI Fall Forum - 2013

Page 14: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Collaborating Organization DataActivity involvement

Organizational role Primary contact (if known)

AddressStructure (e.g. nonprofit, academic)Organizational Type (e.g. library,

museum)Thematic Focus (e.g. legal, health,

aerospace)

CNI Fall Forum - 2013

Page 15: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Data Interface 1/3

Excel: Raw data store Pivot tables, mockups, printable reports

• Relational data in flat data structure• Relational database more ideal, more

costly

CNI Fall Forum - 2013

Page 16: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Activities within States

CNI Fall Forum - 2013

Page 17: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Organizational Engagement

CNI Fall Forum - 2013

Page 18: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Directory Function

CNI Fall Forum - 2013

Page 19: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Geographic Analysis

Page 20: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Geographic Questions

Concentration of activities, organizations

Under-representation

Activity location = organizational collaborator locations

CNI Fall Forum - 2013

Page 21: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Data Interface 2/3

Web-based mapsSQL based, customizableEase-of-use factor – simple GUI,

quick results

CNI Fall Forum - 2013

Page 22: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

http://cdb.io/1bf9zwU

CNI Fall Forum - 2013

Page 23: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

http://cdb.io/17vbRux

CNI Fall Forum - 2013

Page 24: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Interactive Queries

Page 25: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Interactive Queries

Dynamic filtering of viewsFor activities:

by state, NDIIPP funding, activity type, end date

For organizations: by state, sector (structure), organization

type, field

CNI Fall Forum - 2013

Page 26: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Data Interface 3/3

Combination of Excel and CartoDB functionality

Web-based, open data accessFree

Risk of pilot data being overextended as final

CNI Fall Forum - 2013

Page 27: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Organization Dashboard

CNI Fall Forum - 2013

Page 28: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Activity Dashboard

CNI Fall Forum - 2013

Page 29: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Engagement by Activity Characteristics

CNI Fall Forum - 2013

Page 30: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Measures for Investigation

Geographic hubs Under-represented areasSector, disciplinary engagementBalance of activity offerings and

organization engagement

CNI Fall Forum - 2013

Page 31: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Which Sectors Dominate Efforts in an Area?

Chronopolis

Data Preservation Alliance for the Social Sciences - Data-PASS

DataONE - Data Observation Network on Earth

DPN - Digital Preservation Network

ECHO DEPository - Exploring Collaborations to Harness Objects with a Digital Environment for Preservation

GPO LOCKSS Pilot Project

HathiTrust

IIPC - International Internet Preservation Coalition

LOCKSS Alliance

MetaArchive

Terra Populus

USDocs - Digital Federal Depository Library Program

0% 10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Sector Diversity Among Washington D.C. Collabo-rators

Preservation Networks

Academia Not-for-Profit U.S.A. Federal Government

CNI Fall Forum - 2013

Page 32: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

State-based Collaboration

Number of Involved Organizations

Number of

Activities

Many Activities,Few Players

Few Activities,Few Players

Many Activities,Many Players

Few Activities,Many Players

Increase Outreach / Engagement

Increase Programmatic Opportunities

CNI Fall Forum - 2013

Page 33: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

0 20 40 60 80 100 120 140 1600

20

40

60

80

100

120

DC

WA

MI

MDNC

MAVA

TX

IL

NY

PA

CA

Number of Organizations

Number of Activities

CNI Fall Forum - 2013

Page 34: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Most activities fewest

collaborators

Fewest activities with

most collaborators

CNI Fall Forum - 2013

Page 35: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Should data driven dashboards support digital stewardship policy and program development?

How?

Skinner and Drummond 2013CNI Fall Forum 2013

Page 36: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Who is best positioned to actas data stewards?

As interface stewards?

Skinner and Drummond 2013CNI Fall Forum 2013

Page 37: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Which metrics or relationshipsare most useful to measure impact?

Skinner and Drummond 2013CNI Fall Forum 2013

Page 38: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Which metrics or relationshipsare most useful to identify opportunities?

Skinner and Drummond 2013CNI Fall Forum 2013

Page 39: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Which metrics or relationshipsare most useful to identify risks?

Skinner and Drummond 2013CNI Fall Forum 2013

Page 40: Katherine Skinner, Executive Director, Educopia Institute Christina Drummond, Research Associate Professor, University of North Texas CNI Fall Forum -

Next phase

Funding contingentActivity lineage tree

Track impact on program development

Individual level data Identify champions, creators

Transition from pilot to refined taxonomies, maintained data

CNI Fall Forum - 2013