1 presenter: donna mcnamara, data access manager noaa / nesdis / ospo / mission operations division...
TRANSCRIPT
1OFFICE OF SATELLITE AND PRODUCT OPERATIONS
Near Real-Time Data Access - PDA Presenter:Donna McNamara, Data Access ManagerNOAA / NESDIS / OSPO / Mission Operations Division (MOD)
Contributors:Don Slater, ESPDS Transition to Operations Lead (contractor)NOAA / NESDIS / OSGS / PETD / CDACCBChris Sisko, Data Operations ManagerNOAA / NESDIS / OSPO / Mission Operations Division (MOD)
NOAA Satellite Conference – April 29, 2015
2OFFICE OF SATELLITE AND PRODUCT OPERATIONS
Presentation OutlineThe Focus of this presentation is on data access to the near real-time distribution systems, DDS (today) and PDA (tomorrow).
- Overview of the Office of Satellite and Product Operations Overview (OSPO)
- Processing and Distribution (today)- Processing and Distribution (near future) – PDA- Data Access Overview- Contingency data access (near future)- Summary- Q&A
PDA – Product Distribution and Access (Enterprise Distribution)
3OFFICE OF SATELLITE AND PRODUCT OPERATIONS
NESDIS Office of Satellite and Product Operations (OSPO) Supported Missions
NOAA Satellite Operations Facility
Command and Control, Ingest, Product Generation and Distribution for the nation’s 15 environmental satellites– 3 Geostationary (GOES) by NOAA– 3 Polar-Orbiting (POES) by NOAA– 6 Defense Meteorological Satellite
Program (DMSP) operated by NOAA– 1 OSTM Jason-2 (Ocean Surface
Topography Mission) Joint NOAA, NASA, CNES, EUMETSAT effort
– 1 Suomi National Polar-orbiting Partnership (NPP) by NOAA & NASA
– 1 DSCOVR (Solar Observatory) by NOAA & NASA
• Pre-Launch and Post-Launch Testing
• Operational Testing, Validation, and Verification
• User Readiness• Long-Term Continuity of
Products and Services
4OFFICE OF SATELLITE AND PRODUCT OPERATIONS
NESDIS Office of Satellite and Product Operations (OSPO)• OSPO has locations at four major
facilities.• NOAA Satellite Operations Facility (NSOF)
in Suitland, Maryland – Mission Operations Division
• NOAA Center for Weather & Climate Prediction (NCWCP) in College Park, Maryland.– Satellite Product and Services Division
• Command and Data Acquisition Stations in Alaska and Virginia.
Wallops CDAS
Fairbanks CDAS
NCWCP
NSOF
5OFFICE OF SATELLITE AND PRODUCT OPERATIONS
OSPO (Satellite Operations, Processing and Distribution)
Fairbanks Wallops
Customers
Non-NOAA (Jason2, DMSP, Meteosat, MTSAT,
Metop, EOS, COSMIC, others)
Command and ControlSatellite Operations Control Center
Office of Satellite Ground Services (OSGS)
Ground Systems Development and Sustainment,
IT Enterprise Architecture Archive and AccessNESDIS Data Centers
Data andProducts
Product DevelopmentAlgorithm Development
Science Maintenance
Center for Satellite Applications and Research (STAR)
Office of Satellite and Product Operations (OSPO)
METOP-B/C (AM)
POES NOAA-19
GOES-West GOES-East
Processing and DistributionEnvironmental Satellite Processing Center
Svalbard McMurdo / Troll
Suitland
SNPP/JPSS-1 (PM)
TDRSS
6OFFICE OF SATELLITE AND PRODUCT OPERATIONS
Data Processing and Distribution (Today)• NDE (NPP Data Exploitation) provides NPP data and derived products.• GEODIST provides McIDAS products via ADDE.
– McIDAS products are satellite imagery and primarily GOES derived products
• DDS (Data Distribution Server) provides all other non-McIDAS operational products.
• GINI (GOES Ingest NOAAPORT Interface) provides data to the NWS AWIPS Satellite Broadcast Network (SBN) and to NOAAPORT.
• Existing data access process:– Users complete a standard data access request form found at:URL: http://www.ospo.noaa.gov/Organization/About/access.html
– Technical assessment conducted to ensure system and infrastructure resources are available to service the request.
– Access is reviewed and adjudicated by the Data Access Review Board to validate the near real-time access requirement.
– Data activation and subscriptions are actively managed by OSPO/ESPC personnel.
7OFFICE OF SATELLITE AND PRODUCT OPERATIONS
Data Access Policy: http://www.ospo.noaa.gov/Organization/About/access.html
Requestors must: • Have an operational need for near real-time data• Agree to adhere to the rules of behavior on the
Data Access Request form• Understand that requests may be prioritized due
to data volume issues.• Send request to: [email protected]
8OFFICE OF SATELLITE AND PRODUCT OPERATIONS
Processing and Distribution (near Future) - PDAPurpose of the Production Distribution and Access (PDA) system is to serve as the NESDIS enterprise distribution system for our near real-time users.
• All near real-time distribution except for McIDAS will be migrated to PDA – phased approach (new missions and then current missions).
• McIDAS ADDE access will remain on GEODIST systems for the foreseeable future.• GOES-R products will be provided to AWIPS2/Satellite Broadcast Network (SBN),
GOES Re-Broadcast (GRB) and the primary PDA system at NSOF.• S-NPP/JPSS products will be provided via PDA.• PDA is being developed for OSPO by the Office of Satellite Ground Services (OSGS).
PDA Distribution Service Improvements:• User managed subscriptions• User managed search and tailoring• Enhanced security controls / transfer protocols• Enhanced reporting and control for system optimization• Ability to handle large data volumes
9OFFICE OF SATELLITE AND PRODUCT OPERATIONS
High Data Volumes - ExampleExample of bandwidth capacity needed to transfer one full orbit of uncompressed S-NPP data as a function of time.Key points:• Data transfers can only go as fast as the slowest link speed.• Accessing new mission data via terrestrial communication circuits require
significant bandwidth capacity increase.• Vast amounts of new data require capacity changes by provider and end user.
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52 55 580.0
1.0
2.0
3.0
4.0
5.0
6.0
7.0
8.0
9.0
10.0
time (mins)
estim
ated
ban
dwid
th (G
bps)
Need 1 Gbps of available bandwidth capacity to transfer one full orbit of data in 38 mins
10OFFICE OF SATELLITE AND PRODUCT OPERATIONS
PDA Systems
• There are three PDA instantiations:– Full Operational System at NSOF
• S-NPP/JPSS, GOES-R and current mission data
– Test system at NSOF• Internal test system only
– Smaller capacity operational contingency system at Consolidated Back-Up (Fairmont, West Virginia)
• S-NPP/JPSS data (prime mission sensor only)• GOES-R data only available via GRB (GOES Re-
Broadcast) and AWIPS
11OFFICE OF SATELLITE AND PRODUCT OPERATIONS
Future Contingency Operations Note• In the event of an outage at the primary Facility (NSOF in
Suitland, MD), PDA access is transferred to the Consolidated Back-up in Fairmont, West Virginia, to support only the JPSS/S-NPP mission.
• Data fail-over requirement is under 12 hours.• Just the JPSS primary mission sensor data will be available, since
the backup system is smaller scale than the operational system at NSOF.
• Supports both full and partial failover scenarios – i.e. GOES-R can be nominal a NSOF while JPSS is failed over to CBU– This flexibility requires different network addresses at NSOF and CBU,
therefore Pull users will need to change to CBU if needed.
12OFFICE OF SATELLITE AND PRODUCT OPERATIONS
PDA Schedule• Internal readiness reviews:
– Operational Readiness Review (ORR) scheduled for 30 October 2015– System Acceptance Review (SAR) scheduled for 6 January 2016– Actual near real-time data flow is dependent upon the new JPSS ground system
upgrade (Jan 2016)• Existing users of S-NPP NDE system are already being integrated or are in the
process of being scheduled for integration.• Existing users with further questions should contact:
– Donna McNamara (Data Access Manager) [email protected]– Chris Sisko (JPSS Data Operations Manager) [email protected]– Matt Seybold (GOES-R Data Operations Manager) [email protected]
• New users with questions should contact NESDIS Satellite User Services: [email protected]
13OFFICE OF SATELLITE AND PRODUCT OPERATIONS
PDA User Training• PDA user training will be made available in the Fall of
2015.• A PDA external User’s Guide will be available as well.• Training will be done locally in the Washington area, as
well as remotely via Webinar.• Primary PDA Training POC:
– Don Slater, [email protected], 301-817-4168
14OFFICE OF SATELLITE AND PRODUCT OPERATIONS
Summary• The PDA will be the authorized enterprise distribution system
for our near real-time users. • PDA will enable OSPO to:
- deliver the large mission data (such as GOES-R, JPSS, etc.) to authorized users,
- have greater management control and insight into distribution, and
- enable NESDIS to more easily scale to meet future distribution demands while ensuring a secure distribution framework.
15OFFICE OF SATELLITE AND PRODUCT OPERATIONS
Questions?
16OFFICE OF SATELLITE AND PRODUCT OPERATIONS
24/7 Help Desk [email protected]
User Services [email protected]
Data Access [email protected]
Webmaster [email protected]
Web www.ospo.noaa.gov
www.facebook.com/NOAANESDIS
www.twitter.com/noaasatellites
Contact Information & Social Media
Author Contact Info:Donna McNamara, [email protected], 301-817-3803
Don Slater, [email protected], 301-817-4168
Chris Sisko, [email protected], 301-817-4455