ghrc overview and highlights...agile development and management internal process documents state of...

21
Manil Maskey, DAAC Manager (MSFC ST11) Dr. Geoffrey Stano, DAAC Scientist GHRC Overview and Highlights 2019 GHRC User Working Group Meeting 10/22/2019 1

Upload: others

Post on 05-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

Manil Maskey, DAAC Manager (MSFC ST11)

Dr. Geoffrey Stano, DAAC Scientist

GHRC Overview and Highlights

2019 GHRC User Working Group Meeting10/22/2019 1

Page 2: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

Overall Organization

HQ: https://earthdata.nasa.gov/earth-science-data-systems-program/about-the-esds-program

GSFC: https://earthdata.nasa.gov/about/esdis-project

2019 GHRC User Working Group Meeting10/22/2019 2

Page 3: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

A Distributed Active Archive Center is a NASA-funded entity charged with processing, archiving, documenting and distributing data from Earth Observing System (EOS) satellites and field measurement programs

A Distributed Active Archive Center is a NASA-funded entity charged with processing, archiving, documenting and distributing data from Earth Observing System (EOS) satellites and field measurement programs

NASA’s Earth Science DAACs

Each DAAC serves one or more specific Earth science disciplines and provides services unique to its particular science

Each DAAC serves one or more specific Earth science disciplines and provides services unique to its particular science

Socioeconomic Data and Applications Center

Atmospheric Sciences Data Center

Oak Ridge National Laboratory DAAC

Land Processes Distributed Active Archive Center

National Snow and Ice Data Center

Physical Oceanography DAAC

Alaska Satellite Facility

MODIS Level 1 Atmospheres Archive and Distribution System

Crustal Dynamics Data Information System

Goddard Space Flight Center Earth Sciences Data and Information Services Center

Global Hydrology Resource Center

Ocean Biology Processing Group

2019 GHRC User Working Group Meeting10/22/2019 3

Page 4: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

Make NASA’s free and open Earth science data interactive, interoperable and accessiblefor research and societal benefit today and tomorrow.

ESDSVISION

GHRC MISSION

To provide a comprehensive active archive of data and knowledge augmentation services with a focus on hazardous weather, its governing dynamical and physical processes, and associated applications.

Focus on lightning, tropical cyclones, and storm-induced hazards through integrated collections of satellite, airborne, and in-situ data sets.

ESDS Vision & GHRC Mission

2019 GHRC User Working Group Meeting10/22/2019 4

Page 5: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

DAAC Role in supporting science

RESEARCH DATA

LIFECYCLE

2019 GHRC User Working Group Meeting10/22/2019 5

Page 6: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

DAAC Role in Supporting Science

PLANNING

DATA COLLECTION

DATA PREPARATION/ANALYSIS

PUBLICATION/SHARING

LONG-TERMMANAGEMENT

DATA PRODUCERDAACDMP DMP/GuidelinesData Stewardship

Responsibility• Assist data producers in developing

Data Management Plans (DMPs) to support transparency and openness during research phase

• Use DAAC DMPs to efficiently manage data

• Utilize workflows and policies in accordance with standards to serve as a trustworthy repository

Data Stewardship Responsibility• Assist data producers in developing

Data Management Plans (DMPs) to support transparency and openness during research phase

• Use DAAC DMPs to efficiently manage data

• Utilize workflows and policies in accordance with standards to serve as a trustworthy repository

Trustworthy Repository

2019 GHRC User Working Group Meeting10/22/2019 6

Page 7: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

DAAC Role in Supporting Science

PLANNING

DATA COLLECTION

DATA PREPARATION/ANALYSIS

PUBLICATION/SHARING

LONG-TERMMANAGEMENT

REUSE

DISTRIBUTION (Search, Access)

{Documentation, Code}

ANALYSIS

VISUALIZATION

USER SUPPORT

SERV

ICES

DATA PRODUCERDAACSECONDARY USERSDomain Community DMP DMP/Guidelines

Trustworthy Repository

2019 GHRC User Working Group Meeting10/22/2019 7

Services• Make data discoverable,

accessible and reusable• Maximize research potential

of the data• Provide greater returns on

the public investment in research

Services• Make data discoverable,

accessible and reusable• Maximize research potential

of the data• Provide greater returns on

the public investment in research

Page 8: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

Creating a Common Process for Different Data Sources

2019 GHRC User Working Group Meeting10/22/2019 8

Assigned Satellite Mission (LIS)

Assigned Field Campaign (GPM-GV)

SIPS/MEaSUREs Program

Recommendation from the User CommunityUWG/ESDIS/HQ Approval

Page 9: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

Geoffrey Stano

Ajinkya Kulkarni

Will Ellett

Data Management, Outreach, and User Services

IT Infrastructure and Operations

System Architecture and Development

GHRC Organization

2019 GHRC User Working Group Meeting10/22/2019 9

Page 10: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

DAAC Scientist

Students

Software Developers

Dr. Geoffrey Stano

Brian Ellingson and John Simmons

Slesa Adhikari, Bibek Dahal, Essence Raphael, and Khomsun Singhirunnusorn

New Personnel

Page 11: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

GHRC UWG Board Members

2019 GHRC User Working Group Meeting10/22/2019 11

Page 12: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

Operational Improvements

Agile development and management

Internal process documents

State of GHRC (FY19)

Metadata Improvements

Analysis and Review of CMR

Collection – 100%

Granule – 96%

Web Improvements

Lightning primer

Website cleanup

2019 GHRC User Working Group Meeting10/22/2019 12

Page 13: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

Tool Improvements

State of GHRC (FY19)

Cloud Migration

All Data Published

Ongoing Datasets Published

Training Operations

Data Publication - DAPPeR

Bulk Data Downloader

Field Campaign Explorer

2019 GHRC User Working Group Meeting10/22/2019 13

Page 14: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

Data Publication

State of GHRC (FY19)Community Engagement

Science Teams

Micro Articles

Data Recipes

46 total datasets

Key datasets• GPM-GV

• Lightning – ISS LIS Validation

• GOES-R Post Launch Test

• ICE-POP Field Campaign

Virtual Collections

Mastheads

Webinar

Conferences/Meetings

IMPACTS mission data support

2019 GHRC User Working Group Meeting10/22/2019 14

Page 15: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

Improve cloud operations

Prepare for cloud-only operations

Earthdata Pub

ESDIS activities

Looking to FY20 and Beyond

Cloud Cross DAAC Collaborations

Tools

Field Campaign Explorer

Bulk Download Manager

Strategic acquisition of data based on portfolio gaps

2019 GHRC User Working Group Meeting10/22/2019 15

ORNL, GHRC, NSIDC, GES-DISC

Service Architecture, User Needs, Cloud Primer, Cumulus*

Page 16: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

GHRC User Working Group MandatePrimary objectives include but are not limited to:• Suggesting improvements to enhance

overall user experience including discovery, access, and usability of data

• Suggesting new research and development ideas relevant to GHRC to support product/tool prototyping and generation

• Facilitating communications with the general user community and interested members of other communities

• Assisting GHRC in prioritization and pursuit of new data holdings within the bounds of budget and ESDIS mission constraints

2019 GHRC User Working Group Meeting10/22/2019 16

Page 17: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

UWG 2018 Recommendations

• Primary recommendation• Development of a 5 and 10 year plan• Improve links in GHRC mission and holdings with Earth Sciences• Include more coordination between UWG and GHRC

• GHRC response• GHRC has begun drafting the 5 and 10 year plan• Additional work to occur, including more communication with Dr.

Skofronic-Jackson and coordinating with the UWG• First step is the 6 month webinar in early 2020 and iterate with

UWG on the strategic plan

2019 GHRC User Working Group Meeting10/22/2019 17

Page 18: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

UWG 2018 Recommendations• Secondary recommendation

• UWG to work with GHRC to identify critical missing elements to help with validation of NASA-sponsored precipitation products

• GHRC response• Emphasis has been completing the dataset backlog• Coordination with Walt Petersen and later Patrick Gatlin

• Will continue to update GPM GV Validation Network data• Identifying GPM GV datasets to publish, but GHRC does not

have yet• ITSC earned an AIST proposal building off the Validation Network

using GHRC GPM GV data

2019 GHRC User Working Group Meeting10/22/2019 18

Page 19: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

UWG 2018 Recommendations• Secondary recommendation

• Become an event driven repository

• GHRC response• FCX is a step towards this

• Data model behind FCX is event based model

2019 GHRC User Working Group Meeting10/22/2019 19

Page 20: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

UWG 2018 Recommendations

• Secondary recommendation• Search ISS LIS and Lightning Mapping Arrays (LMA) together

• GHRC response: • Currently waiting on LMAs to be ready to start publishing• Will investigate methods to do a joint search• Can then be applied to TRMM LIS data as well

2019 GHRC User Working Group Meeting10/22/2019 20

Page 21: GHRC Overview and Highlights...Agile development and management Internal process documents State of GHRC (FY19) Metadata Improvements Analysis and Review of CMR Collection – 100%

QUESTIONS?THANK YOU!

2019 GHRC User Working Group Meeting10/22/2019 21