d eveloping s ynergies b etween l arge -s cale r esearch and g eodatabases : n eotoma a nd p al eon...

37
DEVELOPING SYNERGIES BETWEEN LARGE-SCALE RESEARCH AND GEODATABASES: NEOTOMA AND PALEON Simon Goring , John W. Williams, Eric C. Grimm, Russell W. Graham, Chris J Paciorek, Andria Dawson, Jason McLachlan, Brian Bills, Michael Anderson

Upload: maria-blake

Post on 18-Dec-2015

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

DEVELOPING SYNERGIES BETWEEN LARGE-SCALE

RESEARCH AND GEODATABASES: 

NEOTOMA AND PALEONSimon Goring, John W. Williams, Eric C. Grimm, Russell W. Graham, Chris J Paciorek, Andria Dawson, Jason McLachlan,

Brian Bills, Michael Anderson

Page 2: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell
Page 3: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell
Page 4: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Databases:Adapt or go extinct

Image Credit: Barry Mieny

Page 5: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Databases aren’t just boxes

Data input is critical

So is data access

Page 6: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Databases aren’t just boxes

Requirements change

Dishes

Page 7: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Databases aren’t just boxes

Requirements change

Databases must change

DishesSheets

Page 8: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Databases:Adapt or go extinct

Image Credit: Barry Mieny

Debugging Expand User Support

Tool Development Modify Structure

Page 9: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Databases:Adapt or go extinct

Debugging

Correct & Track Data ErrorsImprove Table RelationshipsStandardize Terminology

Page 10: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Databases:Adapt or go extinct

Expand User Support

Facilitate Data InputImprove User InterfaceImprove Search CapabilitiesCustomize Data Outputs

Page 11: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Databases:Adapt or go extinct

Tool Development

Facilitate Data InputImprove Data OutputProvide Multiple Platforms

Page 12: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Databases:Adapt or go extinct

Modify StructureSupport for New Data-TypesImprove Metadata

Page 13: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Databases:Adapt or go extinct

Image Credit: Barry Mieny

Debugging Expand User Support

Tool Development Modify Structure

Page 14: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Neotoma Paleoecological Database

Page 15: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Early collaboration in paleoclimatology/paleoclimate

North American Pollen Database

COHMAP Members. 1988. Science, 241.

Page 16: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Early collaboration in paleoclimatology/paleoclimate

European Pollen Database

Page 17: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

North American Pollen Database

Neotoma

FAUNMAP

Page 18: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Ongoing but Periodic Contribution

Page 19: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

How do you find user needs?

◦Community development◦Ongoing review◦Ongoing development

Page 20: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

PalEON: Paleoecological Observatory Network

Page 21: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

PalEON

◦ PaleoEcological Observatory Network

PresentForest Inventory & AnalysisFlux TowersWater Chemistry

HistoricalPublic Land Survey

Fort Climate Data

PastPollen

DendrochronologyIsotope Data

Freidlingstein et al. 2012

Page 22: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

PalEON

◦ PaleoEcological Observatory Network

PresentForest Inventory & AnalysisFlux TowersWater Chemistry

HistoricalPublic Land Survey

Fort Climate Data

PastPollen

DendrochronologyIsotope Data

Freidlingstein et al. 2012

Cum

ula

tive La

nd

Flux

(PgC

)

Page 23: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

PalEON

◦ PaleoEcological Observatory Network

PresentForest Inventory & AnalysisFlux TowersWater Chemistry

HistoricalPublic Land Survey

Fort Climate Data

PastPollen

DendrochronologyIsotope Data

Freidlingstein et al. 2012

Cum

ula

tive La

nd

Flux

(PgC

)

Page 24: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

NeotomaAdaptation

Image Credit: Barry Mieny

Debugging Add Support

Develop New Tools Modify Structure

Page 25: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Debugging

◦ Age – Depth Models◦ Need to characterize uncertainty◦ Geochronology data limitations◦ Age model limitations◦ Improved API outputs

Page 26: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

NeotomaAdaptation

Image Credit: Barry Mieny

Identify CriticalDevelopment

Add Support

Develop New Tools Modify Structure

Page 27: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Making Connections

Neotoma

Pollen Data

Pollen Data User

Data Generators

Page 28: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Making Connections

Neotoma

Pollen Data

Pollen Data User

Data Generators

Data Generators

Page 29: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Making Connections

Neotoma PalEON

neotomahttp://github.com/ropensci/netoma

Page 30: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

NeotomaAdaptation

Image Credit: Barry Mieny

Identify Weaknesses Add Support

Develop New Tools Modify Structure

Page 31: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Written by

WorkerIs#

Surface Sample

Described by

Sediment lithology

Collected from

Published on

Site

Publication

Author Collector Analyst

Responsible for Collected by

Analyzed by

Count

In

For

Pollen VariableIs also a

Synonym of

Worker

Sampled from

Pollen Sample

Contact person

Worker is

Country Phone Fax EMailAddr

Site#

PolDiv1

SiteName SiteCode SiteExists

PolDiv2 PolDiv3

Elevation

Latitude Longitude

AreaOfSite

Has info on ICode

DepthAtLoc

SampDevice

E#

DescriptorEntLoc

HasAnLam

LocalVegSampDate

C14DepthAdj

DataSource DataForm UseStatus

Var# VarCode VarName

Thickness DepthCM

Sample#

Count

Lith# Descript

DepthTopCM DepthBotCM LoBoundary

Acc# Publ#

Stratigraphic Entity

Authority for

the name

Auth#

Contact#

Analyst#

Notes

Published in

Published in

AccVar#SynType

OrderAuthor#

Coll#

Site#

Pollen Entity

HVar#

Name

YearOfPubl

Sigle

AnalyDate Citation

Worker#Status

LastNameFirstName

InitialsSuffix

Title

Address

MHVar#

Notes

IceThickCM

Divided into

Annual LaminationSegment

Annual LaminationDepth

Dated sample

Sampled from

DepthTopCM DepthBotCM

Seg#

DepthCM Sample# Thickness CountTop CountBot

Thickness

Sampled from Synchronous EventDating Sample

Event

Classified as

DepthCM Event# Name Event AgeBP AgeUncertUp AgeUncertLo

PhysiographySurroundVeg

VegFormationIGCPtype

SiteDescript

Loss-on-ignition

Sampled from

Sample# DepthCM Thickness TempLo

LOILo TempHi LOIHi BulkDens

Section Core

CoreDiamCM DepthAtLoc

Subsection

Taken for Sample# DepthCM Thickness TempLo

Drive

Taken for DriveBotCM InfTopCM InfBotCM RecoveryCM

DriveTopCM DriveLabel Drive#

Sampled from Dating SampleGeochronological

Sample#

Method DepthCM Thickness MaterialDated

USeries

TL

AAR

C14FT

KAR

ESRPB210 AgeBP

ErrorLimits LabNumber

Notes

AgeBP ErrorLimits LabNumber

AgeBP ErrorLimits LabNumber

AgeBP ErrorLimits LabNumber

AgeBP ErrorLimits GrainSize LabNumber

AgeAD

AgeSDUp AgeSDLo GrThanAge

AgeBPErrorLimits

TaxonDatedLabNumber

AgeBPAgeSDUpAgeSDLo

GrThanAge

EnrichedLabNumber

DeltaC13

Basis

Notes

Page 32: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

NeotomaAdaptation

Image Credit: Barry Mieny

Identify Weaknesses Add Support

Develop New Tools Modify Structure

Page 33: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

Develop New Tools

◦API Development (Neotoma Side)

◦Package Development (PalEON Side)

Goring et al. neotoma: A Programmatic Interface to the Neotoma Paleoecological Database. Open Quaternary. submitted

Page 34: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell

NeotomaAdaptation

Image Credit: Barry Mieny

Identify Weaknesses Add Support

Develop New Tools Modify Structure

Page 35: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell
Page 36: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell
Page 37: D EVELOPING S YNERGIES B ETWEEN L ARGE -S CALE R ESEARCH AND G EODATABASES : N EOTOMA A ND P AL EON Simon Goring, John W. Williams, Eric C. Grimm, Russell