Air Force Weather AgencyFly - Fight - Win

NPOESS Data Exploitation (NDE)

Status Update

WG-CSAB Oct 2008John Zapotocny

Approved for Public Release Distribution Unlimited

F l y - F i g h t - W i n

Overview

Risk Reduction Strategy Early centrals interface Use current advanced sensor data Collaboration via JCSDA

Infrastructure Enhancements MetSat ingest and data storage redesign Weather Data Analysis (WDA) program

Data Processing and Applications Global high resolution cloud analysis Regional high-res cloud forecasts

F l y - F i g h t - W i n 3

IDPS Early Centrals Interface Supports testing for AFWA internal applications Improves the quality of the delivered IDPS by identifying issues

early-on IDPS development/test resources on-site to support AFWA’s

software development process IDPS software installed on AFWA equipment AFWA staff training completed (Nov 07)

Independent testing by AFWA on-going Canned test data (~2TB) transferred from replicated IDPS Datasets are roughly 100x legacy volume

Risk Reduction StrategyEarly Centrals Interface

F l y - F i g h t - W i n 4

JCSDA is AFWA’s primary vehicle for data assimilation capability development in preparation for NPOESS 6 AFWA-funded projects directly related to NPP/NPOESS

Impact assessment of AIRS (CrIS proxy) in WRF MODIS (VIIRS proxy) skin temperatures in Land Information System (LIS) Integration of CRTM (will support NPP sensors) into LIS Impacts of AMSU cloud-cleared, AMSU and AIRs cloudy radiances Integrate MODIS/METOP cloud optical properties into WWMCA Impact of VIIRS cloudy/precipitating radiances on WRF using GSI

AFWA migrating to GSI data assimilation engine for WRF More effectively leverages community development NCAR energized – provides transition path and synergy

More on-site presence at WWB through Visiting Scientist program Currently 1 position increases to 3 for FY09

Risk Reduction StrategyCollaboration via JCSDA

F l y - F i g h t - W i n 5

MODIS NPOESS data in HDF 5 format, MODIS data comes in HDF EOS

format (precursor to HDF 5) and is a good proxy Currently ingesting MODIS data via DREN (RDT&E only) Continuing challenges with data feed from NESDIS - only partial

data receipt via DATMS-U

METOP MetOp on orbit and planned to fill third constellation

requirement during NPOESS era AFWA receiving 1km resolution AVHRR imagery data which is

very valuable especially for snow cover products Primary issues is 120+ min latency of MetOp data as this does

not meet AFWA timeliness requirements for global cloud analysis

Risk Reduction StrategyUse of Current Advanced Sensor Data

F l y - F i g h t - W i n

Infrastructure EnhancementsIngest and Data Storage

AFWA has redesigned ingest sub-system for NPOESS era

Data placed directly on SAN landing zone prior to processing to allow virus scanning before promoting to a trusted location for product generation and dissemination

Redesign enables ingest of MODIS and METOP data from DATMS-U network emulating NPOESS IDPS connection

Systems Engineering, Management, and Sustainment (SEMS) team worked with IDPS staff to design an efficient and secure connection between the IDPS and AFWA SAN Initial connectivity pending Certification & Accreditation

approval (ECD Dec 2008) Connectivity required to support NPP system tests planned for

Dec-Jan timeframe and early Spring 2009

F l y - F i g h t - W i n 7

DMZ

Landing

Zone

AFWA CentralStorage

WPMDS

Meteosat-8GOES-E/W

POES, DMSPMTSATMODIS data

MSG Dell front end

boxes

Sun V40zFront end

boxes

Shared

Data

Environment

DATMS-U

KenCastSatellite feeds

Meteosat-7Metop-A

NOAA-18 “blind”

CentralAPPSServer

Emulates IDPS

Emulates NPOESSSecurity Architecture

Infrastructure EnhancementsIngest and Data Storage

F l y - F i g h t - W i n

Infrastructure EnhancementsWeather Data Analysis Program

AFWA’s Weather Data Analysis (WDA) program will ingest, store, and disseminate NPOESS/NPP data Technical challenges

Massive volume of time critical data, integration with existing WDA capabilities, relay of NPP data to Navy Centrals

Requirements to “slice & dice” incoming science data sets, sampling for spatial resolution, and AOI extraction to meet users requests

AFWA’s internal applications will migrate to HDF5 format usage and adjust to the granule based data of NPOESS/NPP

Vendor not yet on contract – becoming critical issue

F l y - F i g h t - W i n 9

6km global cloud analysis MODIS polar orbiting satellite data coverage limits timeliness

of cloud observations

DCF statistical model technique limits risk exposure to non-timely cloud observations

MODIS data latency is 2-5 hours from observation

Direct readout using Mark-Ivb offer possible faster delivery supporting near real-time regional cloud analyis

Land surface backgrounds (e.g. snow/ice and highly reflective desert conditions) negatively affect products

Need to continue updating AFWA land surface characterization capabilities

Data Processing & ApplicationsHigh Resolution Global Cloud Analysis

F l y - F i g h t - W i n

LINK: https://weather.afwa.af.mil/host_home/DNXM/SPECM/dcf.html

Data Processing & ApplicationsHigh Resolution Global Cloud Analysis

F l y - F i g h t - W i n 11

https://weather.afwa.af.mil/cgi-bin/aneph_data.cgi

Data Processing & ApplicationsHigh Resolution Regional Cloud Forecasts

F l y - F i g h t - W i n 12

LINK: https://weather.afwa.af.mil/host_home/DNXM/SPECM/dcf.html

Data Processing & ApplicationsHigh Resolution Regional Cloud Forecasts

F l y - F i g h t - W i n

Summary

AFWA working aggressively to prepare for NPP/NPOESS Several Infrastructure, data processing, and application

projects underway and planned Leveraging collaborative development via JCSDA for

NPOESS model data assimilation AFWA will play important role in VIIRS Calibration &

Validation (CalVal)

Goal: Achieve initial operational capability (IOC) for NPP-based processing by end of CalVal period

13

F l y - F i g h t - W i n 14

Questions?