goes-r awg fsw team: abi flood/standing water ( fsw ) algorithm (afswa) june 15, 2010
Post on 31-Jan-2016
28 Views
Preview:
DESCRIPTION
TRANSCRIPT
1
GOES-R AWG FSW Team: ABI Flood/Standing Water (FSW)
Algorithm (AFSWA)June 15, 2010
Presented by: Donglian Sun1
With contributions from FSW team: Rui Zhang1, Sanmei Li1, and Bob Yu2
1George Mason University2NOAA/NESDIS/STAR
2
Outline
Executive Summary (1 slide) Algorithm Description (2-4 slides) ADEB and IV&V Response Summary (1-2 slides) Requirements Specification Evolution (2 slides) Validation Strategy (3-5 slides) Validation Results (3-5 slides) Summary (1-2 slides)
3
Executive Summary This ABI Flood/Standing Water Algorithm (AFSWA) generates the Option
2 product of flood/standing water.
Version 5 will be delivered in June. ATBD (100%) is on track for a July delivery
A unique decision tree approach has been developed that utilizes improved GOES-R ABI spectral capabilities over GOES-IM and GOES-NOP.
Validation tools have been developed and applied to MODIS data. Map of river flooding from the USGS, River Flood Outlook and River Forecasting from the National weather Services of NOAA and analysis of flood/water spatial distribution and temporal change
MODIS and SEVIRI analyses indicate spec compliance for all products.
4
Algorithm Description
Decision tree (DT) method: a supervised machine learning approach to find hidden relationships among multiple attributes/parameters.
DT algorithms tested: the J48 (C4.5, originally proposed by Quinlan (1986)), NBTree, which is a Naïve Bayes/Decision Tree hybrid (Kohavi, 1996), Random Tree, Random Forest (Breiman, 2001), REP Tree, BFTree, Decision stump, and CART (Classification and Regression Trees) and FT (Final Tree) tree classifiers.
The basic strategy is to select an attribute that will best separate the samples into individual classes by a measurement ‘Information Gain Ratio’.
5
Algorithm Description
Predictors Selected Predictors selected:Predictors selected:
CH2, CH3, CH5, CH3/CH2 , CH3-CH2 , NDVI, NDWI.According to the spectral characteristics, water has lower reflectance in near-infrared (GOES-R ABI Channel 3, 0.88 µm ) than vegetation and other land cover types. On the contrary, water has slightly higher values than land features in ABI channel 2 (0.64 µm). Therefore, the ratio image and the difference image between CH3 and CH2 can be used to enhance the difference between water and land (Sheng and Xiao, 1994). In the ratio image, water has extremely low value, while land has relatively high value.
MODIS/SEVIRI data were used as the proxy data for the GOES-R ABI data. The MODIS CH2 corresponds to the ABI CH3, and MODIS CH1 is similar to ABI CH2.
6
For binary yes/no detection of standing water, we select decision tree algorithm. This algorithm can integrate all useful predictors, and gives accuracy estimates.
Input Datasets: Proxy ABI data are used to test the algorithm: 1) 1 km MODIS, 2) 3 km MSG SEVIRI.
Water/Land are firstly identified.
Flood detections can then be made based on the difference in water/land classification map after and before flooding
A series of tests are performed to ensure that the algorithm can meet the accuracy requirements
Algorithm Summary
7
Motivation for Algorithm Channel
Selection• The AFSWA represents a new approach for flood remote sensing on GOES.
•The GOES Imagers before GOES-R don’t provide near infrared measures (0.86 um). This NIR channel can provide the most useful information for flood/standing water identification.
•The GOES-R ABI provides near IR (NIR) and shortwave IR (SWIR) channels that provide sensitivity to flood/water identification.
8
Expected ABI Performance Relative
to Other Sensors• Like the ABI, the VIIRS (like MODIS) sensor onboard the NPP/JPSS offers similar visible (VIS: 0.672 um) and near IR (NIR: 0.865 um), which are critical for water identification, and shortwave IR (SWIR: 1.61 um) channels. This makes VIIRS a very attractive and good candidate sensor for flood detection. ABI is skilled in identifying flood/standing water as well as SEVIRI, MODIS and VIIRS.
ABI FSW channelsABI FSW channels Similar MODIS/VIIRS FSW channelsSimilar MODIS/VIIRS FSW channels
AFSWA Processing Schematic
9
10
Example FSW Output(Japan Tsunami/Flood)
11
Algorithm Changes from 80% to 100%
Directly work with simulated ABI data. At the 80% version, the proxy MODIS and SEVIRI were used to test the algorithm performance.
Metadata output added.
Quality control flags standardized.
12
ADEB and IV&V Response Summary
Recommendation 1: Insufficient Validation For the validation of the FSW product of the GOES-R in the development phase, two
validation methods will be included. The first validation method is gauging station based spot validation. Flood locations occurred on rivers or lakes over the CONUS, which can be obtained from the USGS waterwatch service or NOAA/NWS significant river flood outlook, will be matched to the satellite image derived flood maps according to the geolocation, and streamdage-based flood information will be used as the true flood spot to validate the effectiveness and accuracy of the FSW algorithm output derived from the proxy remote sensing images.
The second validation method is using high spatial resolution satellite data as the reference flood map. When flood events occur, high spatial resolution remote sensing data covering the same flood event will be collected simultaneously, and flood detection will be performed in the high-resolution data. After downscaling the high resolution reference data to GOES-R FSW product resolution, it will then be compared with the FSW detection map, and correct classification rate or accuracy will be reported. Because the high spatial resolution remote sensing data is rarely available during flood events, the second validation method will only be performed for some specific flood cases.
1313
ADEB and IV&V Response Summary
All ATBD errors and clarification requests have been addressed.
No feedback required substantive modifications to the approach.
Requirements
14
Nam
e
User &
Priority
Geograp
hic
Coverage
(G, H
, C, M
)
Vertical
Resolution
Horizon
tal
Resolution
Mapp
ing
Accu
racy
Measurem
ent
Ran
ge
Measurem
ent
Accu
racy
Produ
ct Refresh
Rate/C
overage Tim
e Option (M
ode 3)
Ven
dor Allocated
Grou
nd L
atency (O2) M
ode
3 Produ
ct Measurem
ent P
recision
Tem
poral Coverage Q
ualifiers
Produ
ct Exten
t Qu
alifier
Cloud
Cover C
ondition
s Qu
alifier
Produ
ct Statistics Q
ualifier
Flood/Standing Water
Flood/Standing Water
GOES-R
GOES-R
M
F
N/A
N/A
1 km
1 km
5 km
5 km
Binary yes/no detection of water accumulation over 5 cm vertical depth
Binary yes/no detection of water accumulation over 5 cm vertical depth
60% correct detection
60% correct detection
60 min
60 min
19,435 sec
19,435 sec
N/A
N/A
Day with sun at less then 67 degree solar zenith angle
Day with sun at less then 67 degree solar zenith angle
Quantitative out to at least 67 degrees LZA and qualitative at larger LZA
Quantitative out to at least 67 degrees LZA and qualitative at larger LZA
Clear conditions associated with threshold accuracy
Clear conditions associated with threshold accuracy
Over specified geographic area
Over specified geographic area
Request to change the FSW product resolution from 10 km to 1km is still pending!
15
Qualifiers
Theses are made with the following qualifiers. Daytime Sensor zenith angle < 67 degrees Local zenith angle < 67 degrees Cloud mask available
16
Validation Approach
17
Validation Approach Validate GOES-R FSW Algorithm against the Streamgage-
Based Flood Observations from the USGS and NOAA Water Watch (http://waterwatch.usgs.gov) at the U.S.
Geological Survey (USGS) provides streamgage-based flood maps that show the locations of more than 3,000 long-term (30 years or more) USGS streamgages; displays maps, graphs, and tables describing real-time, recent, and past stream flow conditions for the United States; and highlights locations where floods are occurring.
The flood map detected from the USGS streamgage observations are valuable to evaluate GOES-R FSW algorithm accuracy.
18
Validation Approach USGS WaterWatch also provides tables of flooding locations above National
Weather Service (NWS) defined flood stage (http://waterwatch.usgs.gov/new/index.php?id=flood-table).
These products are automated applications of a calibrated stream hydraulic model which mines USGS streamgages and NWS river flood forecast data.
The latitude and longitude of flooding from the USGS streamgages will be extracted and saved in a txt file.
Software is developed to read this file and search the same locations in the flood images generated from proxy MODIS data and GOES-R FSW algorithm.
Summary statistics is performed to calculate the accuracy as the percentage of accurate detection (USGS flood locations are correctly detected by GOES-R FSW algorithm); omission error as the percentage of omitted floods which are observed by the streamgages but not detected by GOES-R FSW algorithm; and commission error as the percentage of non-flood cases in USGS flood map but misclassified as flood by FSW algorithm.
19
Validation Results
Validation Strategy
Late on May 2, 2011, in an effort to save the city of Cairo, Illinois, the U.S. Army Corps of Engineers used explosives to breach a protective levee near the confluence of the Ohio and Mississippi Rivers. As predicted, the two-mile hole in the levee flooded 130,000 acres of nearby farmland in what is known as the Birds Point-New Madrid Floodway.
20
Flood Detection from FSW Algorithm
2121April 29, 20011 May 4, 20011 May 4, 20011
FSW Validation
22
FSW Validation
USGSstationnumber
USGS stationname
Stage (ft)
NWS Flood stage
(ft)
dateflood days
Latitude Longitude
03345500EMBARRAS RIVER AT STE. MARIE, IL
19.6 192011-05-04
4 38°56'11", 88°01'21"
03346500
EMBARRAS RIVER AT LAWRENCEVILLE, IL
39.26 302011-05-04
10 38°43'25 87°39'52"
03377500WABASH RIVER AT MT. CARMEL, IL
34.01 192011-05-04
15 38°24'07", 87°45'10"
03379500LITTLE WABASH RIVER BELOW CLAY CITY, IL
21.31 162011-05-04
7 38°38'05" 88°17'50"
03381500LITTLE WABASH RIVER AT CARMI, IL
36.23 272011-05-04
15 38°03'40" 88°09'35"
23……. All similar tables are merged and saved into a file
Summary of Recent Flood and High Flow Conditions(2011-05-01 -- 2011-05-15)
Validation Results Summary
The proposed algorithm has ability of detecting floods on major rivers and lakes.
If the reflectance values of the water bodies are similar to surrounded land pixels, these water pixels are difficult to be classified correctly, and thus these flood pixels are difficult to detect.
If flood occurred on minor stream and river, and the width of river is smaller than the spatial resolution of the sensor, the water pixels cannot be identified from the image. For these kind of situations, floods cannot be detected.
24
25
Validation Results Summary
Class Flood Land Total
Flood 8977 807 9784
Land 1150 67099 68249
Total 10127 67906 100501
Overall Accuracy = (8977/10127) 88.64% Flood commission error = (807/9784) 8.25%Flood omission error = (1150/10127) 11.36%
26
Summary
The ABI Flood/Standing Water Algorithm provides a unique solution that utilizes the new capabilities offered by the ABI
Version 5 will be delivered in June and the 100% ATBD is coming.
These products meet the specifications and are proving useful to downstream applications
top related