KE EMu

Peabody Museum of Natural History

at the

The four YPM buildings

Peabody(YPM)

EnvironmentalScience Center

(ESC)

Geology / Geophysics(KGL)

175 Whitney(Anthropology)

Confluence of YPM, KGL, ESC

KGL YPM

ESC

Peabody CollectionsCounts & Functional Cataloguing Unit

• Anthropology 325,000 Lot• Botany 350,000 Individual• Entomology 1,000,000 Individual• Invertebrate Paleontology 300,000 Lot• Invertebrate Zoology 300,000 Lot• Mineralogy 35,000 Individual• Paleobotany 150,000 Individual• Scientific Instruments 2,000 Individual• Vertebrate Paleontology 125,000 Individual• Vertebrate Zoology 185,000 Lot / Individual

2.7 million functional units => ~11 million items

Peabody CollectionsFunctional Units Databased

• Anthropology 325,000 90 %• Botany 350,000 1 %• Entomology 1,000,000 1 %• Invertebrate Paleontology 300,000 55 %• Invertebrate Zoology 300,000 20 %• Mineralogy 35,000 85 %• Paleobotany 150,000 60 %• Scientific Instruments 2,000 100 %• Vertebrate Paleontology 125,000 60 %• Vertebrate Zoology 185,000 95 %

930,000 of 2.7 million => 35 % overall

VZKristof Zyskowski (Vert. Zool. - ESC)

Greg Watkins-Colwell(Vert. Zool. - ESC)

HSIShae Trewin

(Scientific Instruments – KGL )

VPMary Ann Turner

(Vert. Paleo. – KGL / YPM)

ANTMaureen DaRos

(Anthro. - YPM / 175 Whitney)

EMu Planning

2002 Collections Computerization Committee deliberations

2003 Q2 on-site demonstrations from CM vendors

2003 Q3+ talk with existing clients of CM vendors

EMu Planning

2002 Collections Computerization Committee deliberations

2003 Q2 on-site demonstrations from CM vendors

2003 Q3+ talk with existing clients of CM vendors

Lots of other folks…

Classic Argus

Argus Module EMu Module

Object CatalogueObject ConservationObject Internal MovementsLexicon TaxonomyActivity Accession LotsActivity LoansSite Collecting EventsSite SiteConstituent PartiesPublication Bibliography

Old to the New

Single CMS shared by all Departments for about a decade - YPM staff cohabiting

internally and realizing commonalities

- streamlined system administration- ease strain of future migration path

Prior Argus Experience

EMu Implementation

01/2004 Data mapping starts, contract refinement02/2004 Major data parsing & cleaning starts in Argus07/2004 Contracts signed, Vancouver starts08/2004 Servers configured, YPM-test environment running09/2004 Begin iterative screen design & tests with tiny datasets10/2004 Draft YPM-live environment added to server10/2004 One week of KE training for collections staff11/2004 Staff working with draft YPM-live environment02/2005 Larry to Vancouver to work with Negar03/2005 YPM-live screen design & data mappings stabilizing04/2005 Last uploads to Argus, prep for final data migration05/2005 Final data migration, all curatorial disciplines

1.5 years total

EMu Implementation

01/2004 Data mapping starts, contract refinement02/2004 Major data parsing & cleaning starts in Argus07/2004 Contracts signed, Vancouver starts08/2004 Servers configured, YPM-test environment running09/2004 Begin iterative screen design & tests with tiny

datasets10/2004 Draft YPM-live environment added to server10/2004 One week of KE training for collections staff11/2004 Staff working with draft YPM-live environment02/2005 Larry to Vancouver to work with Negar03/2005 YPM-live screen design & data mappings stabilizing04/2005 Last uploads to Argus, prep for final data migration05/2005 Final data migration, all curatorial disciplines

Local Emu web site

EMu training session

19 trainees

Even with best intentions the ‘EMu Big Picture’ can remain a bit fuzzy…

Clarity…

Ian TurnbullNegar Samenirad

EMu Implementation

01/2004 Data mapping starts, contract refinement02/2004 Major data parsing & cleaning starts in Argus07/2004 Contracts signed, Vancouver starts08/2004 Servers configured, YPM-test environment running09/2004 Begin iterative screen design & tests with tiny datasets10/2004 Draft YPM-live environment added to server10/2004 One week of KE training for collections staff11/2004 Staff working with draft YPM-live environment02/2005 Larry to Vancouver to work with Negar03/2005 YPM-live screen design & data mappings stabilizing04/2005 Last uploads to Argus, prep for final data migration05/2005 Final data migration, all curatorial disciplines

06/2005 Safe to jump into the water…

EMu Users Group

a.k.a. Weekly Therapy

- started meetings at go-live- topic du jour as a kick off- then open season on issues - driven by users' experiences

Specimens

Some Miscellaneous Statistics

• 1,200,000 Argus records => 2,100,000 EMu records

• 3 days for Argus server to spit out the final migration files

• 12 days for EMu server to ingest the final migration files

• held a final migration “race” between the KE & YPM servers

• lost few weeks to Vancouver server hiccups, office move, etc.

operating in Emu - IZ Chomping at the bit…

Invertebrate Zoology

Lourdes Rojas

Eric Lazo-Wasem

Dan Drew

operating in Emu - IZpartitioning backlogged multi-species samples…

operating in Emu - IZ

Site record for lot

operating in Emu - IZ

Site record for lot RTF label

operating in Emu - IZ

Site record for lot RTF label

Datamax I-4406 (thermal)

operating in Emu - IZ

Site record for lot RTF label

Datamax I-4406 (thermal) …label(s) into jar

Excerpts from YPM Modules

Catalogue - adjustments for speed

Taxonomy - Lexicon tab

Catalogue ANT

Catalogue HSI

Catalogue IZ

DET – IZ4

Cloned the grid elements for:"Current" Identification

"Filed Asth" Identificationinto additional, separate fields

Yowza ! An identification updater is coming to EMu !

Tax – higher

Tax - lex

Tax – lex expand1

Tax – lex expand2

Tax – lex expand2

- levels of children to display is regulated by a registry entry- assigning the parent sets the full path back up the tree- optional viewing mechanism grafted onto the base module

PRINCIPLE #1 = LEAVE EXTANT MODULE INTACT !

taxontree1

taxontree2

taxontree2

Other external resources?Drag and drop reparenting?Alternate classifications?Autopopulating Luts fields?

Backend Script Tinkering

= Creative Destruction

JPEG 2000 and EMu - protem freeware fix

Admin Module - the proverbial black box

http://www.jpeg.org/jpeg2000

non-proprietary standardmathematically losslesslossy (much smaller files)"perceptually" losslessdesktop sofwtare emerging

http://www.fnordware.com/j2k

JP2 spicebush

JP2 spicebush with J2K

JP2 spicebush with J2K and tail target

JP2 spicebush tails with file sizes

1.54 mB 15 kB

JP2 spicebush tails with moral

lossless JP2 => circa 30-40% original TIFF size

lossy JP2 => go to circa 1%-5%, depending on purpose

Reed Beaman1, Nico Cellinese1, Bryan Heidorn2, Ashley Green1, Youjun Guo1,

Michael Donoghue1, Barbara Thiers3,Heather Rolan3 & Melissa Tulig3

1Peabody Museum of Natural History, Yale University

2Graduate School of Library and Information Science, University of Illinois at Urbana-Champaign

1The New York Botanical Garden

Funded by the US National Science Foundation

Digital Darkroom

• TTI 30 x 40 inch vacuum easel copy stand

• UV free, minimal IR lighting

• Hardware colorimetric calibration

• Apple G5 workstation• 3.2 Tbytes RAID storage

and tape library backup• Pipeline to image

processing web services

Lynn Jones (Botany)

261 kb 1,302 kb

5,166 kb 62,640 kb

JP2 - withoutoops… no thumbnail

JP2 - coding

find imagedir –name *.jp2 –mtime -2 –print

loop on the matches and test to see which recently loaded JP2 files are missing a thumbnail JPG, or which JP2 files have been modified more recently than their existing thumbnail JPG ; then build filenames for any qualifying target JPGs ; execute script several times per hour from cron

jasper –f match –F tempfile

convert tempfile –resize 90x90 target

JP2 - without

JP2 - with

JP2 – size matters

a hefty TIFF… or a ballet of tiny JP2s ?

Ask your EMu server what it might prefer

Scripting a data load

Scripting a data load

Save to simple text format

Scripting a data load

Save to simple text format

Script to convertto Texpress input

Scripting a data load

Save to simple text format

Script to convertfor Texpress

Texpress 'fidsbrief'

Scripting a data load

Save to simple text format

Script to convertfor Texpress

Texpress 'fidsbrief'

Texpress grammar file

Scripting a data load

Save to simple text format

Script to convertfor Texpress

Texpress 'fidsbrief'

Texpress grammar file

Admin

Send output to location of your choice (e.g., Admin Results window)

Admin

Send output to location of your choice (e.g., Admin Results window)

texload -ch -ddatafile -ggrammarfile ecataloguetexload -as -ddatafile -ggrammarfile ecatalogue

Local catalog service

Ornis

Paleoportal

Cope and labels

Cope MacClintock (Inv. Paleo.)

Cope chopping

another Happy Camper

finis