21 st century tools for archivists: a progress report on persistent archives at the stanford linear...

21ST Century Tools For Archivists:A Progress Report on Persistent Archives at the Stanford Linear Accelerator Center (SLAC)

Jean Marie Deken Archivist

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 2

Overview SLAC Test Collection: SLD Records SLAC Metadata development PAWN Workflow: SLAC NARA Some conclusions / issues for the

future

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 3

SLAC Test Collection: SLD SLAC Large Detector for the SLAC Linear

Collider (SLC) 1983-1988 Early and prolific user of world-wide web No further need to keep data confidential Many types of electronic documents Meet US Department of Energy/NARA

criteria for retention

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 4

SLAC Test Collection: SLDInitial Electronic Records Appraisal Surfed SLD web site – “manual crawl” http://www-

sld.slac.stanford.edu/sldwww/sld-working.html Generated list of records series – technical appraisal

http://www.slac.stanford.edu/history/sldpat.htm Interviewed collaboration’s

Data Czar Web manager Spokesperson

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 5

SLAC Test Collection: SLDTargeted Web Crawls SDSC crawl agent combs site, starting at

http://www-sld.slac.stanford.edu and http://www-sldnt.slac.stanford.edu

Crawl result reviewed by SLAC Too broad horizontally

1100 pages 112 urls of interest “No Crawl” messages stopped the agent

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 6

SLAC Metadata Development Began with the data elements that we

currently use for our archives collections database, SLACARC

Looked at Dublin Core METS NARA metadata scheme

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 7

SLAC Metadata Development Now :

Application and revision Some automated application of std. Metadata http://www.slac.stanford.edu/history/projects/Met

adataScheme8.html

Future: Automate application of std. metadata Automate extraction of metadata

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 8

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 9

PAWN WORKFLOW:

SLAC NARA

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 11

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 12

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 13

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 14

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 15

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 16

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 17

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 18

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 19

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 20

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 21

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 22

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 23

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 24

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 25

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 26

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 27

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 28

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 29

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 30

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 31

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 32

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 33

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 34

Conclusions / Future issues … Metadata

What Where How

Generalize lessons to other collections GLAST project (NASA records schedule) Non-science archival collections

First US Web site Public Affairs photographs

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 35

For further information…. TPAP at SLAC:

http://www.slac.stanford.edu/history/projects.shtml

PAWN: http://www.umiacs.umd.edu/research/adapt Or “I’m feeling lucky” Google keywords:

ADAPT UMIACS **A Digital Approach to Preservation Technology,

University of Maryland Institute for Advanced Computer Studies

July 20, 2007 Jean Marie Deken, SLAC AHO, NAGARA 2007 36

Contact information….

Jean Marie Deken

Archivist and Head

Archives and History Office

Stanford Linear Accelerator Center

jmdeken@slac.stanford.edu