nsidc nasa daac uwg tim meeting oct 9-10, 2013 · 2016-06-09 · • new assigned responsibilities:...
TRANSCRIPT
• DAAC Highlights • Bringing Value to NSIDC DAAC Data • NSIDC Search Project Overview
NSIDC NASA DAAC UWG TIM Meeting Oct 9-10, 2013 Meeting Presentations
DAAC Highlights
Outline
• New Contract • Project Activities • Metrics
NSIDC NASA DAAC Contract Do you have questions about what we proposed?
See pre-meeting materials
New Contract – Financial
• Period of Performance: June 1, 2013 – May 31, 2018
• Awarded July 31, 2013, 1 year with 4 one year options – different than past contracts
• Budget targets set for each yearly option • Total contract value: $ 41.6 MY
New Contract – What is Different • Incremental (yearly) funding with more NASA
oversight • New assigned responsibilities: SMAP, ICESat-2,
Operation IceBridge, Aquarius, AMSR-2 • Greater utilization of ESDIS technologies and
services (e.g. ECS, GIBS, ECHO, URS …) • Key needs:
§ Expanding our on-site scientist support § Maintain relevance of data portfolio in a dynamic
cryosphere research world § IT systems that match user needs/demands
Project Activities Since Last Face to Face Meeting
DAAC Work Categories Mission Support Engineering &
Development
Operations User Support
External Coordination
Infrastructure
Completed Project • Enterprise DataBase (EDB): Replace
underlying metadata infrastructure which powers: § Data Search
http://nsidc.org/data/search/data-search.html
§ Catalog pages http://nsidc.org/data/mod10a1.html
§ Metadata http://nsidc.org/api/metadata?id=mod10a1
On-going Projects • Data Search: Re-design and re-implement
NSIDC Data Search § Current Search
http://nsidc.org/data/search/data-search.html • Operation IceBridge Data Portal
§ http://nsidc.org/icebridge/portal/
Engineering & Development
• Enterprise DataBase: replace underlying metadata infrastructure § Deployed and operational (24 Sept 2012) § Provides new opportunities for tools and
services
• Data Search § Completion of EDB has allowed us to improve
data search, as encouraged by the UWG § Will provide faceted, filtered search tool for
NSIDC held data
DAAC Work Categories
On-Going Missions • Operation Icebridge (OIB)
§ http://nsidc.org/data/icebridge/ • Passive Microwave (SMMR, SSM/I, SSMIS)
§ http://nsidc.org/data/polar_stereo § http://nsidc.org/data/ease
• Aqua/AMSR-E § http://nsidc.org/data/amsre
• ICESat/GLAS § http://nsidc.org/data/icesat
• Aqua & Terra/MODIS § http://nsidc.org/data/modis
• MEaSUREs § http://nsidc.org/data/measures
Mission Support Engineering & Development
Operations User Support
External Coordination
Infrastructure
New Missions • Nimbus (1960s)
§ http://nsidc.org/data/nimbus/ • SMAP
§ http://smap.jpl.nasa.gov/mission/ • Aquarius (Soil Moisture)
§ http://aquarius.nasa.gov/ • ICESat-2
§ http://icesat.gsfc.nasa.gov/icesat2/
On-going Mission Support
• Operation IceBridge § Ingesting/archiving all new OIB data products
through the EOS Core System o Provides more permanent archival and
improved access services o Legacy OIB data remain in the FastTrack
temporary system § OIB portal enhancements are on-going and
usage is increasing
On-going Mission Support
• Passive Microwave § All recommendations from the PM Workshop
(5/2011) have been implemented o Versions explained in guide documentation o User friendly guide documentation o More accessible web pages
§ All production responsibilities now within the Operations Group
o Enables better monitoring and more timely delivery of products
On-going Mission Support
• AMSR-E § Instrument remains stable at 2 rpm rotation
(operational is 40 rpm) o JAXA will make available the 2 rpm data
collected for intercalibration with AMSR-2 § Reprocessing of Level-2A TB time series
completed using RSS V7 standard (07/2013) o Higher-level products will be reprocessed using
new TBs
On-going Mission Support
• ICESat / GLAS § Wrapping up the Long Term Archive § Awaiting altimetry products with centroid
vs gaussian correction
• MODIS § Collection 6 reprocessing campaign
scheduled to begin this fall o Has been delayed several months
§ Continuing operations through 2017
New Mission Support
• NIMBUS 1960s Data Rescue § Visible Level 1 and Level 3 daily composites plus
monthly sea ice extents § Infrared corrected Level-1 swath and Level-3
daily composites
Visible Light Infrared
2 km resolution 8km resolution
Global coverage global coverage
100o polar orbit 3.4 µm to 4.2 µm
daytime acquisition nighttime acquisition
HDF5 HDF5
New Mission Support
• Soil Moisture Active Passive (SMAP) § Distributing simulated SMAP data to members of
Early Adopter program § Data management activities have increased with
approaching launch (31 Oct 2014) o Algorithms and product structures being finalized o Data systems development and testing
New Mission Support • ICESat-2
§ Attempting to address key data management issues
o Data file size and format o Point-cloud data representation
§ Participating in mission reviews and Science Team meetings
§ Unofficially launch now in 2017
New Mission Support
• Aquarius (soil moisture) § Per request from HQ, will provide distribution
of Aquarius Soil Moisture products (T. Jackson, R. Bindlish)
§ Developing documentation and Web site for public release (11/2013)
• AMSR-2 (Level-2B and Level-3 products) § Planning ingest/archival of NASA-produced
science products o HQ has approved effort
Other Data Sets • MEaSUREs
§ Greenland (Joughin) and Antarctic (Rignot) ice velocity data added as base layers in OIB portal
§ Freeze/Thaw (Kimball) will be used as a test case for ESDIS Global Imagery Browse Services (GIBS)
§ Planning for new MEaSUREs assigned products
PI Product MEaSUREs Year
M.J. Brodzik Passive Microwave TBs 2012
I. Joughin Greenland ice velocities 2006, 2012
J. Kimball Freeze/Thaw 2006, 2012
E. Rignot Antarctic ice velocities 2006, 2012
D. Robinson Snow and sea ice 2006
NSIDC NASA DAAC Metrics
Top 10 Data Sets by Unique Hosts based on 2012 FTP Metrics
0
500
1000
1500
2000
2500
2010 2011 2012 2013*
Uniqu
e Ho
sts D
ownloa
ding Data
Near-‐Real-‐Time Daily Polar Gridded Sea Ice Conc. (NSIDC-‐0081)
Sea Ice Conc. from Nimbus-‐7 SMMR and DMSP SSM/I-‐SSMIS (NSIDC-‐0051)
Sea Ice Trends and Climatologies (NSIDC-‐0192)
MODIS/Terra Snow Cover Daily L3 Global 500m Grid (MOD10A1)
Images of AntarcPc Ice Shelves (NSIDC-‐0102)
AMSR-‐E/Aqua Daily L3 Soil Moisture (AE_Land3)
MODIS/Terra Snow Cover 8-‐Day L3 Global 500m Grid (MOD10A2)
Daily EASE-‐Grid Brightness Temperatures (NSIDC-‐0032)
AMSR-‐E/Aqua Daily L3 12.5 km Sea Ice Conc. (AE_SI12)
AMSR-‐E/Aqua L2A Brightness Temperatures (AE_L2A)
*2013 data through 25 September 2013.
Data Set Users (2012)
Near-‐Real-‐Time DMSP SSM/I-‐SSMIS Daily Polar Gridded Sea Ice ConcentraEons hXp://nsidc.org/data/nsidc-‐0081 1396
Sea Ice ConcentraEons from Nimbus-‐7 SMMR and DMSP SSM/I-‐SSMIS Passive Microwave Data hXp://nsidc.org/data/nsidc-‐0051
1181
Sea Ice Trends and Climatologies from SMMR and SSM/I-‐SSMIS hXp://nsidc.org/data/nsidc-‐0192 1166
MODIS/Terra Snow Cover Daily L3 Global 500m Grid hXp://nsidc.org/data/mod10a1 861
Images of AntarcEc Ice Shelves hXp://nsidc.org/data/nsidc-‐0102 853
AMSR-‐E/Aqua Daily L3 Surface Soil Moisture, InterpreEve Parameters, & QC EASE-‐Grids hXp://nsidc.org/data/ae_land3 781
MODIS/Terra Snow Cover 8-‐Day L3 Global 500m Grid hXp://nsidc.org/data/mod10a2 692
DMSP SSM/I-‐SSMIS Pathfinder Daily EASE-‐Grid Brightness Temperatures hXp://nsidc.org/data/nsidc-‐0032 566
AMSR-‐E/Aqua Daily L3 12.5 km Brightness Temperature, Sea Ice ConcentraEon, & Snow Depth Polar Grids hXp://nsidc.org/data/ae_si12
561
AMSR-‐E/Aqua L2A Global Swath SpaEally-‐Resampled Brightness Temperatures hXp://nsidc.org/data/ae_l2a 549
Top 10 Data Sets by Unique Hosts based on 2012 FTP Metrics
BoZom 10 Data Sets by Unique Hosts based on 2012 FTP Metrics
0
5
10
15
20
25
30
35
40
45
50
2010 2011 2012 2013*
DMSP-‐F8 SSM/I Pathfinder Global Level 2 Sea Ice ConcentraPons
Nimbus-‐7 SMMR Derived Monthly Global Snow Cover and Snow Depth
CLPX NCAR Data Analysis and Numerical Modeling
Airborne Cloud Radar (ACR) ReflecPvity, Wakasa Bay, Japan (AMSR-‐E ValidaPon)
GLAS/ICESat L2 AntarcPc and Greenland Ice Sheet AlPmetry Data (HDF5)**
IceBridge GPS/IMU L1B Primary PosiPon and Aetude SoluPon**
BalPc Sea Experiment (BALTEX) Ground-‐Based Radar Polar Volume Data (AMSR-‐E ValidaPon)
CLPX NOAA FSL Rapid Update Cycle 20 km (RUC-‐20) Dataset
GLAS/ICESat L2 Ocean AlPmetry Data (HDF5)**
GLAS/ICESat L2 Sea Ice AlPmetry Data (HDF5)**
*2013 data through 25 September 2013. **These data sets were new in 2012.
Data Set Users (2012)
DMSP-‐F8 SSM/I Pathfinder Global Level 2 Sea Ice ConcentraEons hXp://nsidc.org/data/nsidc-‐0028 0
Nimbus-‐7 SMMR Derived Monthly Global Snow Cover and Snow Depth hXp://nsidc.org/data/nsidc-‐0024 1
CLPX NCAR Data Analysis and Numerical Modeling hXp://nsidc.org/data/nsidc-‐0291 2
Airborne Cloud Radar (ACR) ReflecEvity, Wakasa Bay, Japan (AMSR-‐E ValidaEon) hXp://nsidc.org/data/nsidc-‐0212 2
GLAS/ICESat L2 AntarcEc and Greenland Ice Sheet AlEmetry Data (HDF5)** hXp://nsidc.org/data/glah12 3
IceBridge GPS/IMU L1B Primary PosiEon and Actude SoluEon** hXp://nsidc.org/data/iputg1b 4
BalEc Sea Experiment (BALTEX) Ground-‐Based Radar Polar Volume Data (AMSR-‐E ValidaEon) hXp://nsidc.org/data/nsidc-‐0209
5
CLPX NOAA FSL Rapid Update Cycle 20 km (RUC-‐20) Dataset hXp://nsidc.org/data/nsidc-‐0180 6
GLAS/ICESat L2 Ocean AlEmetry Data (HDF5)** hXp://nsidc.org/data/glah15 6
GLAS/ICESat L2 Sea Ice AlEmetry Data (HDF5)** hXp://nsidc.org/data/glah13 6
BoZom 10 Data Sets by Unique Hosts based on 2012 FTP Metrics
Bringing Value to NSIDC DAAC Data
Why? • To address the Users and Data Trends that we have
identified § User Types: non-expert users § User Workflow: increasing amount of data, broader base of
people, and technological advances
• We aim to accomplish § Providing customizable data delivery § Enabling more efficient data selection and analysis
workflows § Making data and information accessible to a broader
audience
Why now?
People
Infrastructure
Metadata Software
Organization
Agile
• Over the past few years, we have assembled the building blocks needed for innovation
New NSIDC Data Services
• Operation IceBridge Portal § Allows for map-based visualization of the flight
paths via polar views of the Northern and Southern Hemispheres
§ Using a variety of filters and image base layers, one can visualize, search and download IceBridge data
§ http://nsidc.org/icebridge/portal/
New NSIDC Data Services
• Charctic Interactive Sea Ice Graph § Provides users the ability to explore sea
ice data by comparing years and climatologies, and viewing associated browse imagery.
§ http://nsidc.org/arcticseaicenews/charctic-interactive-sea-ice-graph/ Metrics
New NSIDC Data Services
• Greenland Ice Sheet Today § Daily images based on NRT data across
Greenland § Graphs of current melt extent compared to the
longer-term satellite record. § Background information to help place current
Greenland melt conditions into context § Expert analysis of ongoing status of the ice
sheet § http://nsidc.org/greenland-today/
New ESDIS Data Service
• Global Imagery Browse Service (GIBS) § Provides global, full-resolution imagery in a
highly responsive manner § 100+ NASA EOS products are available and
more being added o AMSR-E o MODIS o MEaSUREs Freeze/Thaw
§ https://earthdata.nasa.gov/labs/worldview/
Potential Data Services • Enable subsetting, reformatting, reprojection
§ Reformatting: GeoTIFF § Subsetting: Parameter, Spatial, Temporal
• Analysis for raster data at a point § Time series for values at a point § Compare point data with raster at a location
• Animate browse imagery • Create additional images for data products • Anomaly/Feature detection
Questions for UWG • What value do you see in these services? • What other service ideas do you have? • What data products are most in need of these
services?
NSIDC Search Project Overview
Project Motivation • We are not adequately serving users who want to
compare, select, and access data from our catalog well, as evidenced by: § NASA ACSI feedback § UWG feedback § Requests to USO for data selection assistance § ESDIS-contracted Blink usability study
• We now have the metadata and system infrastructure necessary to make a dramatic improvements to the data selection workflow
Where we are
• Have implemented and improved all major functionality of the current Search § This is not the fully-realized Search § It sets the stage for the dramatic improvements
• We have performed intensive in-house testing • We are looking for feedback on the usability of
the current functionality
Usability Testing
“The extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use.” ~ISO 924-11
• Usability testing provides a qualitative method of gathering feedback from users about: § Effectiveness - can users do what they want to do? § Efficiency – is the amount of effort required in line with
expectations? § Satisfaction – how do users feel about their experience?
• Usability tests are conducted by watching users conduct a set of relevant tasks. Users are asked to verbalize their thoughts throughout the process.
Search Usability Debrief
Thank you for your participation!
Where we are
• Have implemented and improved all major functionality of the current Search § Keyword searching § Spatial searching § Temporal searching § Relevance Ranking
• Do you have general comments or questions from the usability testing?
What’s next
• Agile methodology promotes iterative and incremental development
• We intend to release the new Search with its current functionality soon § Will incorporate any major bugs or changes
identified in usability testing § Will replace the existing Search
1. Facets
2. Sorting
*Designs are mock ups. Actual design may vary.
3. Compare Data Sets
5. Place Names
4. Sample Images
6. Display More Detail
8. Usage Suggestion/Guidance
9. User Feedback
10. Usage Metrics