noaa’s npoess data exploitation (nde) system jim yoe 1, geof goodrum 1, jim silva 1, tom schott 1...
TRANSCRIPT
NOAA’sNPOESS Data Exploitation (NDE)
System
Jim Yoe1, Geof Goodrum1, Jim Silva1, Tom Schott1
1. NOAA/NESDIS Office of Systems Development
SoS Work Shop October 6-7, 2009 NDE2
Agenda
• Polar Satellites and NPOESS• NDE
─ Mission and Goals ─ Architecture─ Interoperability: Standards & Formats─ Schedules: Development &Transition─ Stakeholder Integration
• Summary / Next Steps• Contact Information
SoS Work Shop October 6-7, 2009 NDE3
Polar Satellites
• Provide high-resolution imagery and soundings of the earth’s atmosphere and surface (land, sea, and ice)
• Complement in situ, land-based remote sensors, and geosynchronous satellite data
• Most substantial current contribution is to global numerical weather prediction
• Growing contributions for other real-time applications• US Military and Civilian polar satellite systems merging
─ National Polar-orbiting Operational Environmental Satellite System, or NPOESS
SoS Work Shop October 6-7, 2009 NDE4
NPOESS OverviewNational Polar-orbiting Operational Environmental Satellite System
Space Segment
NPOESS delivers a common set of global products to four US processing centers
State 1: NPP
State 2: NPP & NPOESS C1
State 3: NPOESS C1 &C2
Command, Control, Communications Segment (C3S)
RF
State 1: Single Receptor (Svalbard)
State 2: Multiple Receptors
State 3: 15 Receptors
Interface Data Processing Segment
(IDPS)
State 2,3: 4 sites
APs
APs
APs
State 1: 2 sites
APs
Processing Centers
HDF5
NESDIS
AFWA
NAVOCEANO
FNMOC
HDF5
HDF5
HDF5
SoS Work Shop October 6-7, 2009 NDE5
NDE Mission & Goals
• Connect civilian users to NPOESS- Near-real time product processing- Near-real time product dissemination
Service response
Service request
Environmental Product
Data Record (generic)
NPOESSGroundSystems
NPOESSData
Exploitation(NDE)
CivilianUsers
NDE implements science algorithms and services to meet user requirements
• Provide new and improved products- Based on new sensors & science
• Provide new services to users
SoS Work Shop October 6-7, 2009 NDE6
NDE Architecture
NDE chose a Service Oriented Architecture to meet data processing requirements
StorageArea Network
IngestCustomer Services
Product Generation
Distribution
Products pushed from
NPOESS IDPS
Product User
File Detection
Production Rule Trigger
Registration & Order
Management
Order Profiles
User System
SoS Work Shop October 6-7, 2009 NDE7
NDE Interoperability
NDE implements NOAA recommended standards for interoperability
• NDE Data Formats Standardized─ Support User Applications─ GIS: GeoTIFF─ Numerical Weather Models: BUFR; GRIB2─ Research/Long Term Archive: NetCDF4
Climate Forecast Convention; HDF5─ Visualization: JPEG; MPEG─ Messages: XML [e.g. Common Alerting
Protocol; RSS; SOAP]• Product Distribution and Access
─ NDE supports NESDIS enterprise capabilities
• NDE products support metadata standards─ ISO 19115-2
SoS Work Shop October 6-7, 2009 NDE8
2nd Qtr 3rd Qtr 4th Qtr 1st Qtr 2nd Qtr 3rd Qtr 4th Qtr 1st Qtr 2nd Qtr 3rd Qtr 4th Qtr 1st Qtr 2nd Qtr 3rd Qtr 4th QtrCY08 CY09 CY10 CY11 CY12
1st Qtr
NPP Launch“Work To”
16 Jan 2011
NDE SW Build Schedule
NDE’s initial build cycle will support NPP launch
Ingest
Distribution
Customer Services
Monitoring & Reporting
Product Generation
NPP LaunchReadiness Review Oct
2010
Initial Distribution
Capability Aug 2010
SoS Work Shop October 6-7, 2009 NDE9
Transition Schedule for NPP
Help Desk and 24 x7 Support
NDE will engage the NWS and other stakeholders to review the Transition Plan
before it is finalized
SoS Work Shop October 6-7, 2009 NDE10
Summary / Next Steps
• Address satellite data flow into SoS comprehensively─ Future ESPC Product Distribution and Access (PDA) system for
NDE and non-NOAA Satellites─ GOES-R Access System (GAS)─ Recommend a Service Level Agreement between NWS and
NESDIS
• Address need for interim network solution─ NOAA Enterprise Solution too late for NPP─ Upgrade NWS TLS circuit to 1 Gbps?─ NWS accept NPP data over NOAA MAN?
SoS Work Shop October 6-7, 2009 NDE11
Contact
For more information:
Web http://projects.osd.noaa.gov/nde/
Phone 1-301-817-4418
E-mail [email protected]
SoS Work Shop October 6-7, 2009 NDE12
Back Up Slides
SoS Work Shop October 6-7, 2009 NDE13
NPP Phase 13-20 months after NPP
Launch─ Legacy mission continuity replacement products comprised of currently funded NUPs and xDRs
CrIS Thinned Radiances Blended SST Sea Surface Temperature (SST)
CrIS Cloud Cleared Radiances SST Anomalies Nadir Profile Ozone
Total Precipitable Water (ATMS) SST Degree Heating Weeks Ozone Total Column
Snow Cover (ATMS) SST Hot Spots Snow Cover and Depth
Precipitation Rate (ATMS) Coral Reef Bleaching Indices/Alerts Imagery
Land Surface Emissivity (ATMS) Total Ozone (CrIS) Ocean Color/Chlorophyll
Cloud Liquid Water (ATMS) Trace Gases (Carbon) Vegetation Index
Sea Ice Concentration (ATMS) SST (AVHRR-like) Active Fires
Snow Water Equivalent (ATMS) Aerosol (AVHRR-like) Atmospheric Temperature Profile
Ice Water Path (ATMS) ATMS Radiances Atmospheric Moisture Profile
Land Surface Temperature (ATMS) CrIS Radiances Aerosol Optical Thickness
Temperature Profiles (ATMS) VIIRS Radiances Land Surface Type
Moisture Profiles (ATMS) OMPS Radiances Surface Albedo
Rain Water Path (ATMS) Cloud Mask Cloud Cover/Layers
Y NOAA Unique Products (NUPs) B NPOESS Delivered xDRs (SDR, TDR, EDR, ARP, IP)
SoS Work Shop October 6-7, 2009 NDE14
NPP Phase 2: 20 months after NPP Launch to 1 month prior to
C1 launch─ Additional legacy products and enhanced products comprised of
NUPs and xDRs not linked to mission continuity
Polar Winds (VIIRS) Fire & Smoke Analysis Cloud Base Height
Green Vegetation Fraction Near Coast Ocean Color Cloud Effective Particle Size
Limb Profile Ozone Harmful Algal Blooms (VIIRS) Cloud Optical Thickness
Blended Snow Cover Clear Sky Radiances (VIIRS) Cloud Top Height (VIIRS)
Blended Total Precipitable Water Integrated xDRs at CrIS Resolution Ice Surface Temperature
Tropical Rainfall Potential Cloud Liquid Water Path (VIIRS) Sea Ice Characterization (VIIRS)
Blended Ozone Cloud Ice Water Path (VIIRS) Atmospheric Pressure Profile
Vegetation Health Cloud Top Temperature (VIIRS) Quarterly Surface Type Gridded
Vegetation Moisture Suspended Matter
Drought Indices Aerosol Particle Size
Vegetation Thermal Conditions Cloud Top Temperature
Leaf Area Index Cloud Top Pressure
Fire Potential/Risk Land Surface Temperature (VIIRS)
Y NOAA Unique Products (NUPs) B NPOESS Delivered xDRs (SDR, TDR, EDR, ARP, IP)
SoS Work Shop October 6-7, 2009 NDE15
NPP Not In Phase 1 or 2
Net Solar Radiation at TOA (CERES) Rainfall Prediction (ATMS)
Outgoing Longwave Radiation at TOA (CERES) Tropical Cyclone Intensity (ATMS)
Downward Longwave Radiation at TOA (CERES) Volcanic Ash (VIIRS)
Downward Shortwave Radiation at TOA (CERES) Hazard Support (Tropical) (VIIRS)
Cloud Products (CERES) Fire Burn Scars (VIIRS)
Outgoing Longwave Radiation TOA (VIIRS) Cloud Types (AVHRR-like)
Outgoing Longwave Radiation (CrIS) Inversion Strength and Height (CrIS)
Downward Shortwave Radiation TOA (VIIRS) CO2 Slicing Derived Cloud Top Pressure (CrIS)
Ocean Optimized Cloud Mask
Chesapeake Bay Ocean Color
Emiliania Huxleyi Blooms
Y NOAA Unique Products (NUPs)
SoS Work Shop October 6-7, 2009 NDE16
Stakeholder Integration Team (SIT) Concept
Selection ─ Targeted solicitation of proposals (within NOAA)
Implementation─ Each effort will
Analyze target systems Identify user technology upgrades needed Develop test procedures, transition plans Identify user training requirements
○ Coordinate training modules development─ SIT composition will vary by discipline/maturity
Management─ SIC Oversight─ Monthly or Quarterly Reports─ Annual Review - Meeting, Workshop, or Report
NOAAStakeholder Integration
Teams(NCEP, CoastWatch,
AWIPS & Others)
NOAAStakeholder Integration
Teams(NCEP, CoastWatch,
AWIPS & Others)
NDESystems
IntegrationCoordinator
NDESystems
IntegrationCoordinator
SoS Work Shop October 6-7, 2009 NDE17
Stakeholder Integration
• Put the “E” in NDE─ Ensure continuity of support for current users and applications─ Expand base of applications and users─ Enhance the impact and societal benefits of NPP/NPOESS
• Communicate, Coordinate actions w/ Stakeholders ─ “Upstream and downstream”
• Scope of coordination─ Schedules─ Products─ Systems – interfaces, architecture, SW/HW configuration─ Tools ─ Documentation ─ Training─ Testing