1 aura dswg meeting esdis status 09/27/10 alfreda hall esdis daac engineer nasa gsfc code 423...
TRANSCRIPT
1
Aura DSWG MeetingESDIS Status
09/27/10
Alfreda Hall
ESDIS DAAC Engineer
NASA GSFC Code 423
301-614-5147
2
EOSDIS FacilitiesData centers, collocated with centers of science discipline expertise, archive and distribute standard data products
produced by Science Investigator-led Processing Systems (SIPSs)
ASF DAACSAR ProductsSea Ice, Polar
Processes
SEDACHuman Interactions
in Global Change
LP DAACLand Processes
& Features
PO.DAACOcean Circulation
Air-Sea Interactions
ASDCRadiation Budget,Clouds, Aerosols,Tropo Chemistry
ORNL DAACBiogeochemical
Dynamics, EOS Land Validation
GES DISCAtmos Composition &
Dynamics, GlobalModeling, Hydrology,
Radiance
LAADS/MODAPS
Atmosphere
OBPGOcean Biology &Biogeochemistry
GHRCHydrological Cycle &
Severe Weather
CDDISCrustal Dynamics
Solid Earth
NCAR, U of Col.HIRDLS, MOPITT,
SORCE
GSFCGLAS, MODIS,
OMI, OBPG
LaRCCERES, SAGE III
GHRCAMSR-E, LIS
JPLMLS, TES
San DiegoACRIM
NSIDC DAACCryosphere, Polar
Processes
SIPSs
Key
DataCenter
EOSDIS Data Centers 12
Science Investigator-Led Processing Systems (SIPSs) 14
EOSDIS Products Delivered: FY00 thru Aug 2010
30
25
50
75
100
125
150
175
200
225
250
275
300
325
350
375
FY00 FY01 FY02 FY03 FY04 FY05 FY06 FY07 FY08 FY09 FY10 to date Aug
(in Millions)
34,841 K
4
FY09 Metrics EOSDIS Aura Instruments
Unique Data Products > 4000 155
Distinct Users of EOSDIS Data and Services > 910K 5,056
Web Site Visits of 1 Minute or more > 1M ---
Average Daily Archive Growth 1.8 TB/day 55.26 GB/day
Total Archive Volume 4.2 PB 95,841 GB*
End User Distribution Products > 254M 5M
End User Average Daily Distribution Volume 6.7 TB/day 143.09 GB/day
EOSDIS Performance
--- = DAAC specific metric* = as of 8/31/10
EOSDIS ACSI Customer Satisfaction Survey 2009: Relative Rankings
5
73
77
69
30 40 50 60 70 80
E-Business News & Information
(Public/Private Sectors)
NASA EOSDIS
Federal GovernmentOverall
EOSDIS sponsors an annual independent customer survey in conjunction with the American Customer Satisfaction Index (ACSI) EOSDIS consistently exceeds the Federal Government averageRatings in the mid to upper 70s are considered “very good” by the rating organization, the CFI Group2009 Survey results based on 3842 responses (10%)
6
Status of ICDs
Title / Book Boss Status ICD between GES DISC S4PA and SSE / Alfreda Hall and Bruce Vollmer
Original July 2007. No CCRs pending.
Appendix A. MLS Data Flows / Karen Michael and Alfreda Hall
Original July 2007. Updated 11/12/2008. No CCRs pending.
Appendix B. HIRDLS Data Flows / Alfreda Hall
Original July 2007. Updated 11/12/2008. No CCRs pending.
Appendix C. OMI Data Flows / Alfreda Hall
Original July 2007. Updated 01/26/2009. No CCRs pending.
Appendix D. ODPS Data Flows / Alfreda Hall
Original July 2007. Updated 04/30/2009. No CCRs pending.
Appendix H. GMAO Data Flows / Alfreda Hall
Original January 2008. No CCRs pending.
Appendix L. GES DISC – ECS ASDC Data Flows / Karen Michael
Original July 2007. Published 03/03/2009. No CCRs pending.
ICD between ECS and SIPS, Volume 0 Karen Michael
Revision J October 2008. No CCRs pending.
ECS-TES SIPS ICD / Brian Krupp
Revision C April 2010. No CCRs pending.
7
What’s Coming Up
• The Land, Atmosphere Near-real-time Capability for EOS (LANCE)
– CCR in formal review to baseline the requirements
• EOSDIS Network ICDs being replaced with a core document with each elements’ requirements specified in separate appendices:
– ICD Between the EOS Networks and the EOSDIS Elements (core document). Baselined – February 2010
• Initial planning for long term data retention and preservation for EOSDIS data
• Data centers infusing technologies to improve core capabilities of EOSDIS in the near-term (FY10-FY11)
• Uniform user registration system being developed and implemented across DAACs
• Distribution and management of MEaSURES datasets as they mature
• Continuous focus on improved EOSDIS data access and interoperability within the next year
• Advance planning science system support for Decadal Survey missions
• Earth Science Data System Working Groups (ESDSWG) Meeting; New Orleans, LA – October 20-22, 2010
• A-Train Symposium, New Orleans, LA – October 26-28, 2010
The Land, Atmosphere Near-real-time Capability for EOS(LANCE)
8
LANCE Architecture
GES DISC
MODAPS
OMI SIPS
AIRS
MLS
MODIS*
AMSR-E
OMI
ED
OS
Leve
l Zer
o P
roce
ssin
g F
acili
ty Format: RBD
Format: S-PDS
GMAO
SPoRT
NRL
UMBC
USGS
Others
UsersProtocols: HTTP/FTP
RBD: Rate Buffered DataS-PDS: Session Based Production Data Set* L2G and L3 daily products have latency of 27-28 hours. The Climate Modeling Grid (CMG) is the only L3 MODIS product produced by LANCE.
Format: RBD
Format: RBD
Format: RBD
Operating LANCE Element
Observation to availability latency: 30-180 min. Transfer latency: bandwidth dependent
Data Available:-AIRS L1 and L2-MLS L2
Protocols: HTTP/FTP
Protocols: HTTP/FTP
LANCE Architecture
Data Available:-MODIS L1, L2, L2G*and selected L3*-AMSR-E L1, L2 and L3
Data Available:-OMI L1B and L2
LANCE Element Under Development
• Building on existing EOSDIS elements provides data from MODIS, OMI, AIRS, MLS, and AMSR-E instruments in near real-time (< 3 hours from observation)
• Utilizes PGE Code from Standard Science Products, but relaxes requirements for ancillary data inputs
• High operational availability
• Applications of LANCE data include:
– Numerical weather & climate prediction/forecasting
– Monitoring of Natural Hazards
– Disaster Relief
– Agriculture
– Air quality
– Homeland Security
User Registration
9
• EOSDIS will implement a system-wide user registration system in the near-term– One set of credentials to access data– Users will self-register with username and
password recovery
• Prototype capability exists for the LANCE systems
• Development is underway by Raytheon. Phase I rolls out to LP and NSIDC DAACs (late Spring 2011)
ECHO/WIST/GCMD Status
10
• Warehouse Inventory Search Tool (WIST): ECHO’S general purpose, web-based WIST client allows users to submit cross-discipline queries using spatial and temporal criteria
• Current Holdings:– 3,092 Collections, with 87 million Granules, and 57 million Browse
products– Data Partners: ASF, GHRC, GSFC, LAADS, LARC ( ECS &
ANGe), LPDAAC, NSIDC, ORNL, SEDAC,USGS/ Landsat, PO DAAC
• Enhancements status:– Improved operational availability by deploying a fully redundant
system with automated failover– New general purpose web-based client employing new technology
coming available May 2011– Simplifying end-user Client development by providing pre-built
components to allow for rapid, low cost client deployment• Global Change Master Directory (GCMD) Holdings:
– >30,000 descriptions of Earth science data sets, services and ancillary descriptions covering all aspects of Earth and environmental sciences
– More active than ever….>100 portals already in use– URL: http://gcmd.nasa.gov
11
ESDIS ProjectProject Manager
Dawn Lowe
Deputy Project ManagerJeanne Behnke
Deputy PM/ResourcesJ. Steve Metcalf
Assistant Project ManagerH. K. “Rama” Ramapriyan
Science SystemsDevelopment Office
Dan Marinelli
System ManagerKaren Michael
Financial ManagerDiane Hronek
SystemsEngineering
Development& SustainingEngineering
Science Operations OfficeJeanne Behnke
Data CenterEngineers
NetworksEngineer
Outreach/User Support
Resource Analysts Barbara Haskell
Alfreda HallJohn MosesAnne KosloskyKevin MurphyDrew Kittel
Carol BoquistKevin KranacsEvolution/SW Dev Mgr VacantECHO Development & Ops Andrew Mitchell
System Engineer Dan Marinelli (Acting)Hardware Engineer Chris Bock
Project SupportLucia Gayhart
Advanced Planning& Interoperability
Frank Lindsay