![Page 1: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/1.jpg)
1
Data Discovery and Access to The International Surface Pressure
Databank (ISPD)
Thomas Cram Gilbert P. Compo*Doug Schuster Chesley McColl*Steven Worley
National Center for Atmospheric Research, Boulder, CO*NOAA/CIRES, Boulder, CO
AGU 2012 Fall Meeting: IN44A-05
![Page 2: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/2.jpg)
2
Research Data Archive (RDA) at NCARrda.ucar.edu
1. 600+ distinct datasets for climate and weather research
2. Collections: ocean & atmosphere observations, analyses, reanalyses, operational NWP outputs
3. Free and open accesshttp://rda.ucar.edu
AGU 2012 Fall Meeting: IN44A-05
![Page 3: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/3.jpg)
3
ISPD Overview• World’s largest collection of surface & sea level pressure observations
Land station Marine observations Tropical cyclone best track
• Period (version 2): 1768 – 2010• Volume: 465 Gbyte• Available since Aug 2010
AGU 2012 Fall Meeting: IN44A-05
![Page 4: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/4.jpg)
4
ISPD Overview• 60+ Contributors
o Atmospheric Circulation Reconstructions over the Earth (ACRE)o Australian Bureau of Meteorologyo British Antarctic Surveyo Cook Islands Meteorological Serviceo Danish Meteorological Instituteo Deutscher Wetterdienst (DWD; German Weather Service)o European and North Atlantic Daily to Multidecadal Climate Variability
(EMULATE)o ETH Zurich, Switzerlando GCOS/WCRP Working Group on Observational Data Sets for
Reanalysiso MANY MANY MORE….
• Assembled by NOAA/ESRL, CIRES (Univ. of Colorado), & NOAA/NCDC
AGU 2012 Fall Meeting: IN44A-05
![Page 5: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/5.jpg)
5
20th Century Reanalysis• Global reanalysis of atmospheric
circulation• Period: 1869 – 2010• Assimilates ISPDv2 as input• Compo et al. (2011) QJRMS
AGU 2012 Fall Meeting: IN44A-05
![Page 6: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/6.jpg)
6
20th Century Reanalysis:Oct 1950 mean 1000 hPa temperature
ISPD stations ISPD marine obs
AGU 2012 Fall Meeting: IN44A-05
![Page 7: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/7.jpg)
7
ISPD stations ISPD marine obs
AGU 2012 Fall Meeting: IN44A-05
20th Century Reanalysis:Nov 1960 mean 1000 hPa temperature
![Page 8: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/8.jpg)
8
• ISPD obs assimilated into 20CR• 20CR data quality control feedback
contained in ISPD Provides estimated uncertainty in obs Helps improve underlying
observational database
AGU 2012 Fall Meeting: IN44A-05
ISPD & the 20th Century Reanalysis
![Page 9: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/9.jpg)
9
ISPD Sample Annual Station Distribution
1850 * Land stations only* No marine stations
AGU 2012 Fall Meeting: IN44A-05
![Page 10: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/10.jpg)
10
18501900
* Land stations only* No marine stations
AGU 2012 Fall Meeting: IN44A-05
ISPD Sample Annual Station Distribution
![Page 11: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/11.jpg)
11
18501900
1950* Land stations only* No marine stations
AGU 2012 Fall Meeting: IN44A-05
ISPD Sample Annual Station Distribution
![Page 12: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/12.jpg)
12
18501900
19502000
* Land stations only* No marine stations
AGU 2012 Fall Meeting: IN44A-05
ISPD Sample Annual Station Distribution
![Page 13: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/13.jpg)
13
ISPD Observations/Year
Figure courtesy Chesley McColl, NOAA/ESRL
2010: 53 Million
~ 1.5 Billion total observations
AGU 2012 Fall Meeting: IN44A-05
![Page 14: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/14.jpg)
14
Data Access: Problem Background• Large computational/storage resources
needed– Store data– Extract desired data from large grids/files– Convert data to desirable format(s)
Scientific data centers have these resources
Individual researchers generally don’t
AGU 2012 Fall Meeting: IN44A-05
![Page 15: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/15.jpg)
15
• Goals– Make data more accessible and easier to use for
individual researchers• Reasonable access volumes• Desired data formats• User defined parameters/grids
• Researchers stay focused on research
AGU 2012 Fall Meeting: IN44A-05
Data Access: Problem Background
![Page 16: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/16.jpg)
16
ISPD Data Access Services
• Powerful computing resources @ NCAR
• Large disk storage (~ 0.5 PB)• Rich and detailed metadata• Direct file download via web• Customized data sub-setting• HDF-5 to ASCII software tools
AGU 2012 Fall Meeting: IN44A-05
![Page 17: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/17.jpg)
17
ISPD Metadata Features• Both group- and file-level metadata• Drive interfaces for file grouping and sub-
setting tools• Support efficient back-end processing• Improve scalability• Provide “quick look” at data samples
AGU 2012 Fall Meeting: IN44A-05
![Page 18: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/18.jpg)
18
ISPD Metadata Interface Example
AGU 2012 Fall Meeting: IN44A-05
![Page 19: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/19.jpg)
19AGU 2012 Fall Meeting: IN44A-05
![Page 20: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/20.jpg)
20AGU 2012 Fall Meeting: IN44A-05
![Page 21: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/21.jpg)
21AGU 2012 Fall Meeting: IN44A-05
![Page 22: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/22.jpg)
22
Data Access: ISPD Subset Interface
AGU 2012 Fall Meeting: IN44A-05
![Page 23: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/23.jpg)
23
ISPD Data Access ServicesTemporal range sub-
setting (daily)
Spatial sub-setting Lat/Lon region Individual station ID
![Page 24: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/24.jpg)
24
ISPD Data Access Services
Data sub-setting options (cont.)• Observation type
Land station Marine obs Radiosonde Dropsonde TC best track
![Page 25: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/25.jpg)
25
ISPD Data Access Services
• Subsetting processed in delayed mode• E-mail notification• Download via server-provided scripts
(wget)
![Page 26: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/26.jpg)
26
ISPD 2012 Subset metrics
Data accessed: ~ 6.5 TB
Data served: ~ 46 GB
![Page 27: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/27.jpg)
27
Summary & Future Directions
• RDA – Supply “User Friendly” Data Parameter & spatial sub-setting Metadata discovery Format conversion Improved and additional services
• NWSC-Cheyenne opening – more computing power
AGU 2012 Fall Meeting: IN44A-05
![Page 28: Data Discovery and Access to The International Surface Pressure Databank (ISPD)](https://reader035.vdocument.in/reader035/viewer/2022081604/56815ea2550346895dcd30af/html5/thumbnails/28.jpg)
28
• DOI assignment
• Geoscience Data Journal article
• ISPD v3 (1755-2010) Spring 2013
AGU 2012 Fall Meeting: IN44A-05
ISPD Forthcoming