keith eggleston regional climatologist northeast rcc

43
Keith Eggleston Keith Eggleston Regional Regional Climatologist Climatologist Northeast RCC Northeast RCC Climate Data Tools: Climate Data Tools: xmACIS, NOWData and ThreadEx xmACIS, NOWData and ThreadEx

Upload: malise

Post on 01-Feb-2016

61 views

Category:

Documents


0 download

DESCRIPTION

Climate Data Tools: xmACIS, NOWData and ThreadEx. Keith Eggleston Regional Climatologist Northeast RCC. Applied Climate Information System (ACIS). xmACIS. CLIMOD. ThreadEx. ACIS Maps. NOWData. AgACIS. ACIS Database. ACIS Database. NCDC archive. ACIS Database. NCDC archive. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Keith Eggleston Regional Climatologist Northeast RCC

Keith EgglestonKeith Eggleston

Regional ClimatologistRegional Climatologist

Northeast RCCNortheast RCC

Climate Data Tools:Climate Data Tools:xmACIS, NOWData and ThreadExxmACIS, NOWData and ThreadEx

Page 2: Keith Eggleston Regional Climatologist Northeast RCC

Applied Climate Information System Applied Climate Information System (ACIS)(ACIS)

ACIS Database

xmACIS ThreadEx

NOWData

ACIS MapsCLIMOD

AgACIS

Page 3: Keith Eggleston Regional Climatologist Northeast RCC

ACIS DatabaseACIS Database

NCDC archiveNCDC archive

Page 4: Keith Eggleston Regional Climatologist Northeast RCC

ACIS DatabaseACIS Database

NCDC archive NCDC archive

Page 5: Keith Eggleston Regional Climatologist Northeast RCC

ACIS DatabaseACIS Database

NCDC archive –NCDC archive –Data from Climate Data from Climate

Database Database Modernization ProgramModernization Program

Page 6: Keith Eggleston Regional Climatologist Northeast RCC

ACIS DatabaseACIS Database

Daily Summary Daily Summary Messages for ASOS Messages for ASOS

stations added as stations added as received, beginning received, beginning

around 4am ETaround 4am ET

Page 7: Keith Eggleston Regional Climatologist Northeast RCC

ACIS DatabaseACIS Database

Daily CLI Messages Daily CLI Messages from NWS added as from NWS added as received, beginning received, beginning

4am ET4am ET

Page 8: Keith Eggleston Regional Climatologist Northeast RCC

ACIS DatabaseACIS Database

Preliminary COOP Preliminary COOP station data from NWS station data from NWS

added as received added as received throughout the daythroughout the day

Page 9: Keith Eggleston Regional Climatologist Northeast RCC

ACIS DatabaseACIS Database

Some data is keyed Some data is keyed and QC’ed at the and QC’ed at the Regional Climate Regional Climate

Centers – about 2-3 Centers – about 2-3 weeks after the end of weeks after the end of

the data monththe data month

Page 10: Keith Eggleston Regional Climatologist Northeast RCC

ACIS DatabaseACIS Database

Unique data contributed Unique data contributed by NWS offices allows by NWS offices allows

extension of record extension of record back in timeback in time

Page 11: Keith Eggleston Regional Climatologist Northeast RCC

ACIS DatabaseACIS Database

NCDC datasets NCDC datasets updated as data are updated as data are

released – preliminary released – preliminary keyed, preliminary keyed, preliminary quality control, final quality control, final

quality controlquality control

Page 12: Keith Eggleston Regional Climatologist Northeast RCC

ACIS DatabaseACIS Database

Other Networks:Other Networks:High Plains automated High Plains automated

networknetwork

Page 13: Keith Eggleston Regional Climatologist Northeast RCC

ACIS DatabaseACIS Database

Other Networks:Other Networks:USDA SNOTEL and USDA SNOTEL and

SCAN networksSCAN networks

Page 14: Keith Eggleston Regional Climatologist Northeast RCC

ACIS DatabaseACIS Database

Flexible architecture Flexible architecture allows for future allows for future

expansionexpansion

Page 15: Keith Eggleston Regional Climatologist Northeast RCC

Buffalo ACIS DataBuffalo ACIS Data

Jan 1871 - Dec 1921 CRB

Jan 1922 - Dec 1945 DSI-3200 (COOP id 301012)

Jan 1946 - Apr 2007 DSI-3210 (WBAN id 14733)

May - June 2007 Extracted from CLI

DSI-3210 updated monthly as received from NCDC.CLI statements added to database every morning.Datzilla updates added as processed.

Page 16: Keith Eggleston Regional Climatologist Northeast RCC

Ithaca ACIS DataIthaca ACIS Data

Jan 1893 - Dec 1925 DSI-3206 (COOP id 304174)

Jan 1926 - Jan 2007 DSI-3200 (COOP id 304174)

Feb 2007 DSI-3202 NCDC Prelim

Mar - Apr 2007 NRCC Keyed

May - June 2007 Extracted from RR3

DSI-320x updated 3/month as received from NCDC.SHEF-encoded data added to database every morning.Datzilla updates added as processed.

Page 17: Keith Eggleston Regional Climatologist Northeast RCC

xmACIS - New FeaturexmACIS - New Feature

Page 18: Keith Eggleston Regional Climatologist Northeast RCC

xmACIS - New FeaturexmACIS - New Feature

Page 19: Keith Eggleston Regional Climatologist Northeast RCC

NOWDataNOWData

Public interface to ACIS database.Public interface to ACIS database.

Available on all NWS climate web pages.Available on all NWS climate web pages.

Subset of data and products available on Subset of data and products available on

xmACIS interface.xmACIS interface.

Station lists can be modified upon request Station lists can be modified upon request

through the Regional CSPMs.through the Regional CSPMs.

Page 20: Keith Eggleston Regional Climatologist Northeast RCC

NOWDataNOWData

Page 21: Keith Eggleston Regional Climatologist Northeast RCC

NOWDataNOWData

Station list• All real-time stations with normals• Other stations as requested by NWS offices

Page 22: Keith Eggleston Regional Climatologist Northeast RCC

ThreadEx - The IssueThreadEx - The Issue

What climatological records should be used What climatological records should be used as the basis for U.S. daily climate extremes as the basis for U.S. daily climate extremes that are reported by the media, NWS, and that are reported by the media, NWS, and others?others?

Current extreme records reporting are Current extreme records reporting are inconsistent, based on varying combinations inconsistent, based on varying combinations of multiple observing sites.of multiple observing sites.

Page 23: Keith Eggleston Regional Climatologist Northeast RCC

Example - ChicagoExample - Chicago

1870 1880 1890 1900 1910 1920 1930 1940 1950 1960 1970 1980 1990 2000

Chicago O’Hare Airport 1958-Present

Chicago Midway Airport 1928-Present

University of Chicago 1916-95

1872-1970 Chicago Weather Bureau City Office

Page 24: Keith Eggleston Regional Climatologist Northeast RCC

Threading ProcessThreading Process

Target Stations: Published LCD sites (~260)Target Stations: Published LCD sites (~260) Starting Point: Current ASOS SiteStarting Point: Current ASOS Site Consideration of Historical PrecedentConsideration of Historical Precedent

1) NWS / WB 1) NWS / WB

2) COOP2) COOP Overlaps: Yield to the More Recent Site Overlaps: Yield to the More Recent Site No Adjustments for InhomogeneitiesNo Adjustments for Inhomogeneities!! Station Threads Vetted by Partners:Station Threads Vetted by Partners:

• Northeast Regional Climate Center (Developer)Northeast Regional Climate Center (Developer)• NWS Field, State Climatologists (Reviewers)NWS Field, State Climatologists (Reviewers)

Page 25: Keith Eggleston Regional Climatologist Northeast RCC

Back to Chicago ExampleBack to Chicago Example

1. Chicago CRB

5. Chicago O’Hare Airport

4. Chicago Midway Airport

3. University of Chicago

2. Chicago WB Office

1958-Present

1870 1880 1890 1900 1910 1920 1930 1940 1950 1960 1970 1980 1990 2000

1958-Present

1942-58

1926-41

1896-1925

1871-95

Threaded RecordThreaded Record Unused Portion of RecordUnused Portion of RecordUnused Portion of Record

Page 26: Keith Eggleston Regional Climatologist Northeast RCC

ThreadEx ExtremesThreadEx Extremes

Station tables are available on the webStation tables are available on the web• Will be updated at least annuallyWill be updated at least annually• http://threadex.rcc-acis.orghttp://threadex.rcc-acis.org

Daily top three records and years for:Daily top three records and years for:• Highest Maximum TemperatureHighest Maximum Temperature• Lowest Maximum TemperatureLowest Maximum Temperature• Highest Minimum TemperatureHighest Minimum Temperature• Lowest Minimum TemperatureLowest Minimum Temperature• Greatest PrecipitationGreatest Precipitation

Page 27: Keith Eggleston Regional Climatologist Northeast RCC

ThreadEx BenefitsThreadEx Benefits

ThreadEx will provide…ThreadEx will provide…

• MaximizedMaximized• ConsistentConsistent• Routinely updatedRoutinely updated• Freely available Freely available

… … daily climate records for principal observing stations daily climate records for principal observing stations in the United States.in the United States.

ThreadEx is for general public use, NOT for research (no ThreadEx is for general public use, NOT for research (no homogeneity adjustments).homogeneity adjustments).

Page 28: Keith Eggleston Regional Climatologist Northeast RCC

Additions to ACIS DatabaseAdditions to ACIS Database

NOAA’s Climate Database Modernization Program NOAA’s Climate Database Modernization Program (CDMP) has keyed a large amount of pre-1948 data – (CDMP) has keyed a large amount of pre-1948 data – data that has not been consistently used before.data that has not been consistently used before.

NRCC, in cooperation with the National Weather NRCC, in cooperation with the National Weather Service, has obtained a significant amount of historical Service, has obtained a significant amount of historical data digitized by local NWS offices that was not part of data digitized by local NWS offices that was not part of the NCDC archives.the NCDC archives.

NRCC is performing quality control of historical data from NRCC is performing quality control of historical data from the CDMP Climate Record Books project. This will add the CDMP Climate Record Books project. This will add as much as 75 years to the beginning of station records.as much as 75 years to the beginning of station records.

Page 29: Keith Eggleston Regional Climatologist Northeast RCC

San Francisco ThreadSan Francisco Thread

SAN FRANCISCO INTL AP (DSI-3210) 07/1945 to 12/2005

SAN FRANCISCO CITY (DSI-3210) 01/1921 to 06/1945

SAN FRANCISCO CITY (CRB) 01/1871 to 12/1920

SAN FRANCISCO CITY (supplied by NWS) 10/1849 to 12/1870

Page 30: Keith Eggleston Regional Climatologist Northeast RCC

NWS-Contributed DataNWS-Contributed Data

Daily data - max and min temperature, precipitation, Daily data - max and min temperature, precipitation,

snowfall and snow depthsnowfall and snow depth

Variety of formatsVariety of formats• XMClimate netCDFXMClimate netCDF• Excel spreadsheetExcel spreadsheet• Text fileText file

Data has been contributed for 70 stations to dateData has been contributed for 70 stations to date

Contact Keith Eggleston (Contact Keith Eggleston ([email protected]@cornell.eduedu))

Page 31: Keith Eggleston Regional Climatologist Northeast RCC

ATL 090456: 10/1878-08/1928 090451: 09/1928-12/2005 ATT 410420: 09/1891-08/1942 410428: 09/1942-11/2005 BDL 063451: 10/1904-12/1948 BHM 010836: 04/1895-11/1945 010831: 12/1945-12/2005 BIL 240807: 08/1934-11/2005 BIS 320819: 10/1874-09/2005 BOS 190775: 01/1872-12/1919 BRO 413259: 01/1878-10/1916 …411136: 04/1942-11/2005 BTV 431081: 01/1893-05/2005 BWI 180470: 01/1871-07/1950 180465: 07/1950-11/2005 CNK 141769: 05/1885-04/1962 141767: 05/1962-01/2005 CRP 412010: 02/1887-10/1942 412015: 10/1942-12/2005 DCA 189290: 01/1871-06/1929 448906: 07/1929-11/2005 DRT 412357: 01/1906-04/1951 …412360: 03/1963-11/2005 DSM 132208: 08/1878-11/2005 DTW 202118: 12/1894-12/1933 …202103: 04/1966-12/2005 EKA 042910: 12/1886-04/2003 ELP 412799: 01/1879-11/1942 412797: 12/1942-12/2004 FAI 509641: 09/1904-11/1929 502968: 12/1929-12/2002 FLG 023007: 09/1898-12/1949 023010: 01/1950-11/2005 FSD 397667: 01/1893-01/2006 FSM 032580: 06/1882-12/1900 GEG 457938: 02/1881-11/2005 GJT 053485: 01/1893-04/1946 053488: 05/1946-01/2006 GRI 253395: 10/1895-12/1899 GRR 203337: 04/1892-12/1940 …203333: 12/1963-12/2005 GTF 243749: 12/1891-03/1937 243751: 04/1937-11/2005 HLN 244057: 04/1880-04/1940 244055: 05/1940-11/2005 HON 394135: 07/1881-02/1939 394127: 02/1939-01/2006 HSV 014976: 02/1894-12/1936 …014064: 09/1958-11/2005 HVR 243994: 01/1880-01/1961 243996: 02/1961-11/2005 IND 124264: 02/1871-12/1942 124259: 01/1943-11/2004 IPT 369733: 02/1895-12/1944 369728: 01/1945-12/2004 LAN 202394: 04/1863-04/1948 …204641: 05/1959-10/2005

Page 32: Keith Eggleston Regional Climatologist Northeast RCC

LBF 256070: 09/1874-12/1947 256065: 01/1948-12/2005 LIT 034248: 07/1879-12/1897 LMK 154958: 11/1995-12/2005 LOT 117457: 01/1992-08/1997 LSE 474375: 10/1872-12/1950 474370: 01/1951-08/2004 LWS 105230: 09/1881-12/1947 105241: 08/1948-11/2005 LYH 445121: 01/1893-01/1930 445120: 02/1930-01/2005 MCI 234370: 07/1888-12/1893 MDT 363711: 01/1889-05/1939 …365703: 10/1991-12/2004 MEM 405964: 01/1872-12/1939 405954: 01/1940-12/2005 MGM 015555: 09/1892-06/1948 015550: 07/1948-12/2005 MIA 085668: 12/1900-01/1939 085663: 02/1939-12/1945 MSP 217386: 01/1871-06/1933 OMA 256220: 01/1871-05/1935 …256255: 01/1994-11/2005 ORD 111582: 01/1871-12/1896 ORF 446144: 01/1874-12/1945 446139: 01/1946-04/1951 ORH 199928: 01/1904-12/1947 PBI 084471: 01/1888-12/1899 …089520: 01/1930-12/1945 PHL 366909: 01/1872-6/1940 366889: 06/1940-01/1999 PHX 026486: 08/1895-09/1963 026481: 10/1963-11/2005 PVD 376703: 11/1904-05/1932 376698: 06/1932-12/1947 RAP 396937: 08/1942-12/1948 RIC 447206: 01/1887-12/1929 447201: 01/1930-04/1951 RST 217004: 07/1886-02/1893 SAT 417950: 03/1885-12/1940 …417945: 07/1942-11/2005 SDF 154956: 08/1872-06/1945 154954: 07/1945-12/2005 SFO 047772: 10/1849-01/1871 SPI 118184: 07/1879-12/1879 SUX 137712: 07/1889-04/1941 137708: 05/1941-01/2006 TOP 148172: 06/1887-07/1946 148167: 08/1946-01/2005 TUL 348987: 08/1893-12/1930 348992: 01/1931-12/1992 TUP 229000: 01/1930-04/1969 229003: 05/1969-12/2005 TUS 028815: 10/1894-12/1929 028820: 01/1930-11/2005 UNR 396947: 01/1888-04/1972 396948: 01/1996-11/2005 YUM 029662: 01/1893-07/1949 …029646: 12/1995-11/2005

Page 33: Keith Eggleston Regional Climatologist Northeast RCC

Climate Record BooksClimate Record Books

Daily dataDaily data• Maximum, minimum and average temperatureMaximum, minimum and average temperature• PrecipitationPrecipitation• SnowfallSnowfall

Monthly summarized dataMonthly summarized data• Totals, meansTotals, means• ExtremesExtremes• Number of daysNumber of days

Period of recordPeriod of record• Back to late-1800s for many locationsBack to late-1800s for many locations

Page 34: Keith Eggleston Regional Climatologist Northeast RCC

Existing Period of RecordExisting Period of Record

Nashville, TN

Fort Worth, TX

Newark, NJ

1866 1886 1906 1926 1946 1966 1986 2006

1935-2006

1946-2006

1948-2006

Page 35: Keith Eggleston Regional Climatologist Northeast RCC

Addition of CRBAddition of CRB

Nashville CRB

Nashville, TN

Fort Worth CRB

Fort Worth, TX

Newark CRB

Newark, NJ

1866 1886 1906 1926 1946 1966 1986 2006

1935-2006

1946-2006

1948-2006

1931-1990

1898-1970

1871-1970

Page 36: Keith Eggleston Regional Climatologist Northeast RCC

Seattle PrecipitationSeattle Precipitation

Annual Precipitation - Seattle from TD3200

10.00

15.00

20.00

25.00

30.00

35.00

40.00

45.00

50.00

55.00

1948 1958 1968 1978 1988 1998

Precipitation (inches)

Page 37: Keith Eggleston Regional Climatologist Northeast RCC

… … with CRB addedwith CRB added

Seattle Annual Precipitation - CRB and TD3200

10.00

20.00

30.00

40.00

50.00

60.00

1878 1898 1918 1938 1958 1978 1998

Precipitation (inches)

CRB TD3200

Overlap period

Page 38: Keith Eggleston Regional Climatologist Northeast RCC
Page 39: Keith Eggleston Regional Climatologist Northeast RCC
Page 40: Keith Eggleston Regional Climatologist Northeast RCC
Page 41: Keith Eggleston Regional Climatologist Northeast RCC

Number of CorrectionsNumber of Corrections

StationStation CorrectionsCorrections Total ObsTotal Obs PercentPercent

Augusta, GAAugusta, GA 18451845 218,845218,845 0.8%0.8%

Key West, FLKey West, FL 10731073 219,000219,000 0.5%0.5%

Raleigh, NCRaleigh, NC 962962 116,800116,800 0.8%0.8%

Fresno, CAFresno, CA 27272727 188,900188,900 1.4%1.4%

Syracuse, NYSyracuse, NY 11691169 124,702124,702 0.9%0.9%

Wilmington, NCWilmington, NC 19301930 219,000219,000 0.9%0.9%

Fort Worth, TXFort Worth, TX 407407 132,625132,625 0.3%0.3%

(~99% of corrections are key-entry errors)(~99% of corrections are key-entry errors)

Page 42: Keith Eggleston Regional Climatologist Northeast RCC

Station HistoryStation History

Dallas Fort Worth observing sites for ThreadEx:

Begin End WBAN Coop Name and Location9/1/1898 10/31/1934 23905 - Federal Building: Jennings Ave between Texas and 11th St11/1/1934 12/31/1939# 23905 - US Courthouse: 10th St between Burnett and Lamar St1/1/1940 4/25/1953 13961 413284 Fort Worth Meacham Field4/26/1953 8/13/1974 03927 413283 Fort Worth Greater Southwest Intl Airport8/14/1974 present 03927 412242 Dallas Fort Worth Intl Airport

# Office moved 1/5/1940. Unsure when exactly instruments were moved.

WBAN ids for CRB:9/1/1898 12/31/1939 239051/1/1940 4/25/1953 139614/26/1953 12/31/1970 03927

Sources: NCDC LCD, NCDC MMS, Climate Record Books, Daniel Huckaby NWS FWD, Form 1001.

DFW - Dallas/Fort Worth

Page 43: Keith Eggleston Regional Climatologist Northeast RCC