data and information—the legacy of the ipy mark a. parsons parsonsm@nsidc.org

Data and information—the legacy of the IPY

Mark A. Parsonsparsonsm@nsidc.org

MAP 2006.04.05 2

Two IPY Data Meetings in Cambridge

• 2 March: Inaugural meeting of the IPY Data Policy and Management Subcommittee

• 3-4 March: An IPY data management planning workshop

MAP 2006.04.05 3

IPY Organization

ICSU/WMOJoint Committee

Data Policy & Management

Subcommittee

ObservationsSubcommittee

Education, Outreach & Communication Subcommittee

ProgrammeOffice

MAP 2006.04.05 4

Data SubcommitteeMark Parsons, USA; co-chairTaco de Bruin, Netherlands; co-

chairNathan Bindoff, Australia

(represented by Kim Finney)Joan Eamer, Norway/UNEPHannes Grobe, GermanyRay Harris, UK/GEOSSEllsworth LeDrew, CanadaXin Li, China (absent)Håkan Olsson, SwedenAlexander Sterin, Russia/WMO

(Evgeny Vyazilov)Vladimir Papitashvilli, USA/eGYBirger Poppel, Greenland

Eberhard Fahrbach – liaison to JCDave Carlson – Director IPY- IPO

Addressing issues of• IPY data definition• Data policy• Relations to observational

systems

MAP 2006.04.05 5

Overarching Purpose

• Our primary purpose should be to serve the objectives of IPY, esp:• International exchange (>60 countries)• Interdisciplinary science (>50,000

participants representing physical, life, and social scientists)

• Building a legacy

MAP 2006.04.05 6

What are IPY Data?

Working with Observations Committee to address preservation and access to ongoing operational data

MAP 2006.04.05 7

An IPY Data Management Workshop

• Over 40 participants from 13 countries

• Major goal: determine functions, form, and implementation for an IPY Data and Information Service

• Results at

http://nsidc.org/events/ipydis

MAP 2006.04.05 8

Organization of IPY Data Management

IPY Joint Committee

Data Policy & Management Subcommittee

ProgrammeOffice Data

& InformationService

eGY

Projects Data Centers, Virtual Observatories, etc.

Users

MAP 2006.04.05 9

Alternate Views of the DIS

DIS?

DIS?

MAP 2006.04.05 10

Format of the meeting

• Presentations on back ground and some existing approaches

• Breakout groups to identify issues and recommendations• Standards• Managed data access• Identifying archives• Data discovery• Data submission/publication• Semantics

MAP 2006.04.05 11

Reference Documents

www.icsu.org/1_icsuinscience/DATA_Paa_1.htmlor google “icsu paa”

earthobservations.org/

ISO 14721:2003

public.ccsds.org/publications/archive/650x0b1.pdfor google “oais”

MAP 2006.04.05 12

Overarching themes

• Outreach to the scientific community• Data discovery and access• Interoperability• A data coordination office• A phased approach• Funding

MAP 2006.04.05 13

Vision: a cultural shift in science

“Preserve or Perish”

You are not finished until you have done the research, published the results, and published the data, receiving formal credit for everything.

MAP 2006.04.05 14

catalog 3(Mirror)

catalog 2

catalog 1

catalog 9

catalog 4

catalog 8

catalog 7

catalog 6(Mirror)

catalog 5

Data Discovery & Access—the “Union”Catalog

MAP 2006.04.05 15

Data Discovery & Access

• Revised data policy on free and open access coming soon

• Working with the ICSU CODATA Global Information Commons for Science Initiative

MAP 2006.04.05 16

Interoperability

“What few things must be the same so everything else can be different.”

• A few good standards: • ISO19115 metadata• Open Geospatial Consortium

• Explore advanced semantic approaches

MAP 2006.04.05 17

The Data Coordination Office

DIS

DISDISCO

MAP 2006.04.05 18

A Phased Approach

Think BIG but start small

IPY provides a unique opportunity to revolutionize data management, but…

IPY is only 329 days away

MAP 2006.04.05 19

Funding

• Letter from the JC to national committees requesting that solicitations explicitly include funds for data management as part of each project

• Developing a prospectus to shop around to funding agencies, foundations, and corporations.

MAP 2006.04.05 20

Draft Timeline of a Phased Approach

Before IPY• Seek funding • Web site• Promote the plan—ask about at CODATA06!• Survey projects and collect basic catalog metadata• ID data managers, archives, and gaps• Educate and assist community • ID or create essential reference data. • Develop data release plans to support field

programs• Plan the overall organizational data flow.

MAP 2006.04.05 21

Draft TimelineMarch 2007- March 2008—first field phase• Track and catalog data in progress • Develop and link portals through a union catalog of

data • Collect metrics on archiving and use data• Link (improve interoperability of) key data systems• Develop derived data/information resources for

education and public outreach

March 2008- March 2009—second field phase• Promote interdisciplinary data exchange

through standard-based services• Implement prototype data integration

systems.

MAP 2006.04.05 22

Draft Timeline

After IPY• Implement comprehensive,

interdisciplinary Polar Data and Information System

• Ongoing long-term stewardship, including negotiating long-term-support commitments and assessing the risk of data loss.

MAP 2006.04.05 23

Outstanding issues

• Ensuring coordination of elements• Linkages to operational community• Ensuring data quality• Funding!

MAP 2006.04.05 24

Discussion

• Final Report to be available soon athttp://nsidc.org/events/ipydis

• Subscribe to the ipydis mailing list by mailing me at parsonsm@nsidc.org

• Other ways to get involved• IPY Knowledge Organization Group

contact Siri Jodha Singh Khalsa (sjsk@nsidc.org)

• Ad hoc outreach task group, contact Taco de Bruin (bruin@nioz.nl)