evaluation aerosol cci satellite retrievals macc assimilations reading 2012
TRANSCRIPT
evaluation
aerosol CCI satellite retrievals
MACC assimilations
Reading 2012
the participants / the task
• AATSR F v142• AATSR O v202/v2q2• AATSR S v040/v031• MERIS A v21• MERIS B v11• MERIS E 802• PARASOL v30
• MODIS_aqua c5.1
• MODIS_terrac5.1
• SEAWIFS• MISR v31• FBOV AOD (MODIS)• FMNG AOD & fine-fr
• evaluate for the year
2008 daily global AOD
and Angstrom data of
– aerosol-CCI retrievals
– MACC assimilations
• compare to
– AERONET / MAN
– MODIS (AOD)
the scoring concept
• rescale all data to a common 1x1 lat/lon grid
– establish 1x1 gridded AERONET daily data)
• identify local data pairs (satellite/model test
data versus AERONET reference data)
• require 10+ days with 10+ sites (spatial test) or
10+ sites with 10+ temporal records (time test)
to evaluate bias and correlation in any region
• both, a valid spatial score and a valid temporal
score, are required for a valid regional score
scoring steps
• establish regional scores (1: best, 0: poor)
– step1regional spatial score for each day• (rank) correlation and (rank) bias
– step2regional temporal score for each 1x1 • (rank) correlation and (rank) biast
– step3combined regional score• total score = bias * spat.corr * temp.corr
– step4combine regional to one global score• ‘single score’ from regional total scores
• investigated properties: AOD550, Angstrom
error / bias evaluation
• explore– total error = (1 - |score, total|)– bias error = (1 - |score, bias|)– spatial error = (1 - score, space)– temporal error = (1 - score, time)
score, total = score, bias * score, space * score, time
– bias•general direction ( + > test-data / - < test-data )•absolute bias (IQ test-data minus IQ reference)
• test vs AERONET: AOD, Angstrom• test vs MODIS, terra: AOD
AOD scores vs AERONET
global land ocean• MODIS A/T .63 .59 .66• AATSR S v40 -.60 .63 -.61• FMNG -.59 -.54 -.62• FBOV .57 .55 .59• AATSR O v202 -.56 -.56 -.58• MISR .53 .58 .53• AATSR F v142 -.52 -.56 -.53• AATSR S v31 -.48 -.56 -.47• MERIS ESA 802 .45 .48• MERIS B v11 .42 .35 .46• SEAWIFS -.41 -.37 -.45• PARASOL .64• MERIS A 21 .49
based on a10+ sample statistics
absolutelarger scoreis better
+/- sign for overall bias
AOD score detail vs AERONET
global land ocean
• FBOV– total score .57 .55 .59– seasonal score .83 .82 .84– bias score .84 .86 .84– spatial score .82 .77 .84
• FMNG– total score -.59 -.54 -.62– seasonal score .82 .81 .84– bias score -.88 -.86 -.91– spatial score .81 .77 .81
10 + events
Angstrom scores vs AERONET
global land ocean• AATSR S v40 .60 .56 .65• FBOV .56 .55 .55• FMNG .48 -.49 .48• AATSR S v31 .52 .47 .57• AATSR F v142 .47 .51 .47• AATSR O v202 .41 .38 .43• MISR .38 .43 .37• MERIS ESA 802 . 38 .34 .37• PARASOL .44• MERIS A 21 .33
based on a10+ sample statistics
absolutelarger scoreis better
+/- sign for overall bias
ANG score detail vs AERONET
global land ocean
• FBOV– total score .56 .55 .55– seasonal score .82 .80 .82– bias score .81 .84 .80– spatial score .84 .83 .85
• FMNG– total score .48 -.49 .48– seasonal score .73 .73 .72– bias score .85 -.85 .86– spatial score .77 .79 .77
10 + events
assimilation data performance
• regional error assessment
– vs AERONET AOD
– vs MODIS-AOD
– vs AERONET Angstrom
ECMWF AOD
FBOV (single assim.) FMNG (dual assim.)
FBOV AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
FMNG AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
2ass … minus … 1 ass
improvement deteriation
FBOV AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
FMNG AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
2ass … minus … 1 ass
improvement deteriation
ECMWF Angstrom
FBOV (single assim.) FMNG (dual assim.)
FBOV ANG performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
FNMG ANG performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
2ass … minus … 1 ass
improvement deteriation
satellite data performance
• regional error assessment
– vs AERONET AOD
– vs MODIS-AOD
the participants / the task
• AATSR F v142• AATSR O v202/v2q2• AATSR S v040/v031• MERIS A v21• MERIS B v11• MERIS E 802• PARASOL v30
• MODIS_aqua c5.1
• MODIS_terrac5.1
• SEAWIFS• MISR v31
• evaluate daily global
‘CCI-aerosol’ retrievals
– for the entire year 2008• AOD 550nm• Angstrom (if offered)
• versus AERONET / MAN
• performance in context
of established retrievals
data content AOD year 2008
MISR
MODIS TERRA
PARASOL
MERIS-ESA
MERIS-BAER
MERIS-ALAMO
ATSR-SU
ATSR ORAC
ATSR ADV
data volume AOD 1/1/2008
MODIS AQUA
MISR
PARASOL
MERIS-ESA
MERIS-BAER
MERIS-ALAMO
ATSR-SU
ATSR ORAC
ATSR ADV
MODIS TERRA
MODIS TERRA AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– albsolute
MODIS AQUA AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
MISR AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
POLDER AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
MERIS ESA AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
MERIS BEAR AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
MERIS ALAMO AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
AATSR SU40 AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
AATSR SU31 AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
AATSR O202 AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
AATSR O202iq AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
effectively ‘identical to O202
AATSR ADV142 AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
AATSR SU40 AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
MODIS terra
AATSR O202 AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
MODIS terra
AATSR ADV142 AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
MODIS terra
POLDER AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
MERIS ESA AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
MERIS BEAR AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute
MERIS ALAMO AOD performance
• total error
– bias
– spatial
– temporal
• bias
– tendency
– absolute