biological and chemical oceanography data management office slide 1 of 19 cameo data management bob...

Biological and Chemical Oceanography Data Management Office slide 1 of 19

CAMEO Data Management

Bob Groman

Biological and Chemical Oceanography Data Management Office

26 – 27 July 2010CAMEO Science Steering Committee Meeting

Woods Hole, MA USA


Discussion Topics

Why data management matters and the new paradigm

Biology and Chemical Oceanography Data Management Office (BCO-DMO) – working with investigators from the beginning. Preserving data, modeling results and information


Good data management practices have always been integral to the scientific method.

Careful and deliberate record keeping

Results reported and made publicly available: expectations have changed (a new research paradigm)

Enabling reproducibility of results

Enabling reuse of the data and results

NSF is enforcing their data reporting policies

Why data management matters


New research paradigms . . .

Science themes are trending toward interdisciplinary Basic-wide

Research teams have changed from single Pi to interdisciplinary, collaborative teams boundaries being: funding agency, national, disciplinary

Studies involving coupling of complex models atmospheric and hydrologic end-to-end food web

. . . require access to data from many disciplines


Some definitions … what do I mean by …

Data Management

End-to-end data management

Proposal to preservation

Having a plan (policy) from the beginning ► Data and metadata are recorded

accurately, ► Data preservation (backups)► Made accessible to others


Metadata

Metadata ~ “about the data” ; also, “about the model”. Information required to interpret the data and results and reuse them

Metadata records capture the information required to answer the who, what, where, why, how and when questions that are asked about a dataset. It is important to know who collected, analyzed and contributed the data and where, when and how those data were acquired or generated and subsequently analyzed and processed.


All data and information (D)necessary to reuse the data.

Data (d)Metadata (m)

D ≠ m + d


Likelihood of Having All Necessary Information

Probability of having all the necessary information to reuse data or a model is inversely proportional to the time they were collected or generated. (P ~1/t)

So, collect metadata early and often!


these data . . . . . . are incomplete and of little use to colleagues

The dataset lacks sufficient metadata to enable efficient and accurate reuse.

Presumably the data originator would decode Sample ‘DIL 10’ because they know it to be a proxy for where, when and how the data were collected.


Biological and Chemical Oceanography Data Management Office

BCO-DMO

NSF funded project to provide short and medium term data management, including web based access, to all NSF funded projects from the biological, chemical oceanographic programs and the Office of Polar Programs

Large NSF projects are expected to have their own data management offices – a person

Web site: http://www.bco-dmo.org/

Recognition of the importance of people in the process of making data and information available

Peter Wiebe

Dave Glover

Cyndy Chandler

Bob Groman

Dicky Allison

Steve Gegg

Tobias Work

http://www.bco-dmo.org/





BCO-DMO ‘Proposal to preservation’

Partner with investigators before, during and after project begins Long-term parnership Community building Started in US JGOFS and US GLOBEC programs

Capture and record documentation (metadata) sufficient to support data reuse

Make high quality data and metadata available online Collaborative development of metadata records Better practice recommendations for management of ocean research

data and modeling results outreach to researchers and data managers

Ensure final archive of data and results in appropriate center (e.g. NODC); contribute to special repositories (CDIAC)


BCO-DMO Home Page (www.bco-dmo.org)



Text Based Access

http://osprey.bcodmo.org/index.cfm


Geospatial access

http://mapservice.bco-dmo.org/maps-bin/global/map


Simple search by program and project


New time series type of plotCARIACO Niskin Bottle Samples

Southern Ocean Acoustic Backscatter

EN331 CTD_CG

OC341 zoo_square_meter Calanus finmarchicus

Plotting Samples


• Research in oceanography proceeds along three major lines: field observation, field and laboratory experimentation, and modeling. Data management and informatics until now have been an after-thought.

• Efforts like ecosystem-based management requires the integration of oceanographic, biodiversity, fisheries, and other marine environmental data, as well as the development of analysis and assessment tools.

• Exponential increase in data sources and the proliferation and distributed nature of databases have created a fourth new and important line of marine research. Data management and informatics is now on par with the other lines of oceanographic research (Baker et al. 2008).

FO EX

MO

Past

EX

FO MO

DM&I

Future

Baker, D.N., C. E. Barton, W. K. Peterson, and P. Fox. 2008. Informatics

and the 2007–2008 Electronic Geophysical Year. Eos. 89(48): 485-486.


Takeaway message:

Plan for data management from the beginning

Establish expectations for PIs and Investigators – create a data policy

For large programs, have a local data manager responsible and responsive to your investigators

Sharing data and results early yields better science

BCO-DMO provides access to high quality data

BCO-DMO will work with CAMEO investigators, preferably from the beginning, to help make their results available to others


Actually, no. It is the beginning.


Metadata database schema

biological and chemical oceanography data management office slide 1 of 19 cameo data management bob...

Documents

beginning data

data originator

data managementend

data management offices

data reuse mak

end data managementproposal

data preservation backups

data dmetadata md