Air Force Weather AgencyFly - Fight - Win

NPOESS Data Exploitation

Status Update

COPC 13 Nov 2008John Zapotocny

Approved for Public Release Distribution Unlimited

F l y - F i g h t - W i n

Overview

Risk Reduction Strategy Early centrals interface Use current advanced sensor data Collaboration via JCSDA

Infrastructure Enhancements MetSat ingest and data storage redesign Weather Data Analysis (WDA) program

Data Applications Imagery products Model data assimilation High resolution cloud analysis & forecasts

F l y - F i g h t - W i n 3

IDPS Early Centrals Interface Supports testing for AFWA internal applications Improves the quality of the delivered IDPS by identifying issues

early-on IDPS development/test resources on-site to support AFWA’s

software development process IDPS software installed on AFWA equipment AFWA staff training completed nearly a year ago

Independent testing by AFWA on-going Canned test data (~2TB) transferred from replicated IDPS Datasets are roughly 100x legacy volume

IA process issues continue to be a challenge Interim Approval to Test (IATT) allowing connection to AFWA

operational network expected NLT Dec 08

Risk Reduction StrategyEarly Centrals Interface

F l y - F i g h t - W i n 4

MODIS Data comes in HDF EOS format (precursor to HDF 5) and is a

good proxy for NPP/NPOESS format Currently ingesting MODIS data via DREN (RDT&E only) Continuing challenges with data feed from NESDIS

Only partial data receipt via DATMS-U

METOP Planned to fill third orbit requirement during NPOESS era AFWA receiving 8-minute data granules via DATMS-U 120+ min latency of MetOp data does not meet AFWA

timeliness requirements for global cloud analysis

Risk Reduction StrategyUse of Current Advanced Sensor Data

F l y - F i g h t - W i n 5

JCSDA is AFWA’s primary vehicle for data assimilation capability development 6 AFWA-funded projects directly related to NPP/NPOESS

Impact assessment of AIRS (CrIS proxy) in WRF MODIS (VIIRS proxy) skin temperatures in Land Information System (LIS) Integration of CRTM into LIS (will support NPP sensors) Impact of AMSU and AIRs cloudy radiances in WRF Integrate MODIS/METOP cloud optical properties into WWMCA Impact of VIIRS cloudy/precipitating radiances on WRF using GSI

AFWA migrating to GSI data assimilation engine for WRF More effectively leverages community development NCAR is energized – provides transition path and synergy

Increased on-site presence at JCSDA Visiting Scientist positions increase to 3 beginning CY09

Risk Reduction StrategyCollaboration via JCSDA

F l y - F i g h t - W i n

Infrastructure EnhancementsIngest and Data Storage

AFWA has redesigned ingest sub-system in preparation for NPOESS era

Data placed directly on SAN landing zone prior to processing to allow virus scanning before promoting to a trusted location for product generation and dissemination

Redesign enables ingest of MODIS and METOP data from DATMS-U network emulating NPOESS IDPS connection

Systems Engineering, Management, and Sustainment (SEMS) team worked with IDPS staff to optimize connection and data flow between the IDPS and AFWA SAN Required to support NPP system tests planned for Jan – Mar

2009

F l y - F i g h t - W i n 7

DMZ

Landing

Zone

AFWA CentralStorage

WPMDS

Meteosat-8GOES-E/W

POES, DMSPMTSATMODIS data

MSG Dell front end

boxes

Sun V40zFront end

boxes

Shared

Data

Environment

DATMS-U

Meteosat-7Metop-A

NOAA-18 “blind”

CentralAPPSServer

Emulates IDPS

Emulates NPOESSSecurity Architecture

Infrastructure EnhancementsIngest and Data Storage

F l y - F i g h t - W i n

Infrastructure EnhancementsWeather Data Analysis Program

AFWA’s Weather Data Analysis (WDA) program will store, process, and disseminate NPOESS/NPP data Technical challenges

Massive volume of time critical data Integration with existing WDA capabilities Relay of NPP data to Navy Centrals Requirements to “slice & dice” incoming data sets, sampling

for spatial resolution, and subset extractions to meet users requests

Evaluating opportunities for NESDIS collaboration/reuse

AFWA’s internal applications will migrate to HDF5 format and adjust to granule based data of NPOESS/NPP

Vendor not yet on contract Projected award late Spring 09

F l y - F i g h t - W i n 9

Vis IR MSI

Data ApplicationsMultispectral Imagery Products

F l y - F i g h t - W i n 10

Fog

Data ApplicationsMulti-channel Fog Detection

F l y - F i g h t - W i n

WRF Data Assimilation System will ingest raw brightness temperature radiances—SDR’s Planned integration to operations as follows:

AMSU (NOAA/MetOp) — Nov 2008 COSMIC (FORMOSAT) — Spring 2009 AIRS (NASA EOS) — Spring 2009 SSMIS (DMSP) —Winter 2010 CrIS/ATMS (NPP) — Winter 2011* IASI (METOP) — Winter 2012* GRAS (METOP) — Winter 2013*

*May be operational sooner with AFWA transition to GSI in early 2011

11

Data ApplicationsTheater NWP Model

F l y - F i g h t - W i n

Land Information System (LIS) MODIS/NPP/NPOESS

Snow Cover (R&D ongoing, initial integration FY09/10) Vegetation cover/health (R&D ongoing, initial integration FY09/10) Land Surface temperature (R&D ongoing, integration FY09/10)

AMSR-E/NPOESS-MIS (mission C2) Snow Depth (R&D complete, integration AMSR-E capability FY09/10) Soil Moisture (planned FY09/10 R&D, integration FY11/12)

Cloud Analysis and Forecasting (CDFS-II) MODIS/NPP/NPOESS

VIIRS cloud mask integration FY09 Cloud Optical Properties (R&D Ongoing, integration FY10-11)

12

Data ApplicationsLand Surface and Cloud Modeling

F l y - F i g h t - W i n 13

6 km resolution global cloud analysis using MODIS Analysis generated hourly but data are 2-4 hours latent

Land surface backgrounds (e.g. snow/ice and highly reflective desert conditions) negatively affect products

Need to continue updating AFWA land surface characterization capabilities

5 km resolution regional cloud forecasts using Diagnostic Cloud Forecast (DCF) based on WRF

Hi-res global cloud analysis is used to tune the WRF DCF coefficients for optimal performance

Forecasts showing skill improvement over traditional WWMCA-based forecasts particularly beyond 9 hours

Data ApplicationsHigh Resolution Global Cloud Analysis & Forecast

F l y - F i g h t - W i n

LINK: https://weather.afwa.af.mil/host_home/DNXM/SPECM/dcf.html

Data ApplicationsHigh Resolution Global Cloud Analysis

F l y - F i g h t - W i n 15

https://weather.afwa.af.mil/cgi-bin/aneph_data.cgi

Data ApplicationsHigh Resolution Regional Cloud Forecasts

F l y - F i g h t - W i n 16

LINK: https://weather.afwa.af.mil/host_home/DNXM/SPECM/dcf.html

Data ApplicationsHigh Resolution Regional Cloud Forecasts

F l y - F i g h t - W i n

Summary

AFWA aggressively preparing for NPP/NPOESS Several Infrastructure, data processing, and application

projects underway and planned Leveraging collaborative development via JCSDA for

NPOESS model data assimilation Advanced sensor data assimilation showing favorable impact

in WRF based on NCAR studies Prototype high res cloud forecast showing skill improvement

AFWA will play important role in VIIRS Calibration & Validation (CalVal)

Goal is to achieve initial operational capability (IOC) for most NPP processing by end of respective CalVal periods

17

F l y - F i g h t - W i n 18

Questions?