COOP Modernization: NOAA’s COOP Modernization: NOAA’s Environmental Real-time Observation Environmental Real-time Observation

Network in New England, the Network in New England, the Southeast and Addressing NIDIS in Southeast and Addressing NIDIS in

the Westthe West

Ken CrawfordKen CrawfordNWS Office of Science and TechnologyNWS Office of Science and Technology

Special Presentation at a Workshop ForSpecial Presentation at a Workshop ForA National Phenology NetworkA National Phenology Network

August 23, 2005August 23, 2005

Objectives for Today’s Objectives for Today’s PresentationPresentation

• To share important details about how the To share important details about how the NERON system is being designed and NERON system is being designed and implementedimplemented

• To gain your feedback and constructive To gain your feedback and constructive suggestions on how best to improve the suggestions on how best to improve the NERON program and its designNERON program and its design

First, The Really Good News….First, The Really Good News….

Synoptic Plot of Air Temperature from Modernized Synoptic Plot of Air Temperature from Modernized COOP Sites COOP Sites 8:30 PM EDT on 4/20/05 (Color Fill: Blue = 8:30 PM EDT on 4/20/05 (Color Fill: Blue =

Cold; Red = Warm)Cold; Red = Warm)

Time-Series Plot of Air Temperature from Modernized Time-Series Plot of Air Temperature from Modernized COOP COOP Sites at Milford, MA (Red) and Middlebury, VT (Blue) Sites at Milford, MA (Red) and Middlebury, VT (Blue)

— 4/20-21/05— 4/20-21/05

And Now, the Most Important And Now, the Most Important Component of NERON….Component of NERON….

A Data Ingest, Processing, QA/QC, A Data Ingest, Processing, QA/QC, and Dissemination Systemand Dissemination System

ISOS Data Processing SystemISOS Data Processing System• Key feature of desired data-processing system for Key feature of desired data-processing system for

NERON: Quality control/quality assure observations NERON: Quality control/quality assure observations with human intervention to:with human intervention to:- Provide QC’d observations in real time (latency <5 Provide QC’d observations in real time (latency <5

minutes)minutes)- Not let ‘bad data’ go publicNot let ‘bad data’ go public- Provide QA metrics to monitor contract Provide QA metrics to monitor contract

maintenancemaintenance

• System must be end-to-end to include data ingest, System must be end-to-end to include data ingest, dissemination and archivingdissemination and archiving

• In my opinion, the processing system will prove to be In my opinion, the processing system will prove to be the ‘lynch pin’ that ties NERON with other forms of the ‘lynch pin’ that ties NERON with other forms of surface weather data to produce ISOSsurface weather data to produce ISOS

NERON Data Ingest & Processing SystemNERON Data Ingest & Processing SystemConcept of OperationsConcept of Operations

Suite of Suite of SensorsSensorsSuite of Suite of SensorsSensors

RemoteRemoteField SitesField Sites

CommunicationsCommunications DeviceDevice

CommunicationsCommunications DeviceDevice

Distributed Data Distributed Data IngestIngest

Distributed Data Distributed Data IngestIngest

Mirrored DataMirrored Data ProcessingProcessing

Mirrored DataMirrored Data ProcessingProcessing

Real-time Data Real-time Data Quality AssuranceQuality AssuranceReal-time Data Real-time Data

Quality AssuranceQuality Assurance

Site MetadataSite MetadataSite MetadataSite Metadata

Collection of Collection of Missing DataMissing DataCollection of Collection of Missing DataMissing Data

MaintenanceMaintenance MetricsMetrics

MaintenanceMaintenance MetricsMetrics

Local ArchivesLocal ArchivesLocal ArchivesLocal Archives

Data Processing ComponentData Processing Component

NWS NWS CommsComms

Broad Broad User User

CommunityCommunity

InternetInternet

**GOES, Cellular PhonesGOES, Cellular Phonesand LETS/NLETSand LETS/NLETS

*

What Is Happening Right NowWhat Is Happening Right Now

Scope of the COOP/NERON Scope of the COOP/NERON ModernizationModernization

• Deploy modernized COOP/NERON stations with high quality Deploy modernized COOP/NERON stations with high quality sensors maintained to accepted professional levelssensors maintained to accepted professional levels

• Acquire observations with a 5-minute time resolution and Acquire observations with a 5-minute time resolution and download all data at hourly or better intervals — with a goal to download all data at hourly or better intervals — with a goal to download data at 5 minute intervalsdownload data at 5 minute intervals

• Develop an integrated network that is Develop an integrated network that is expandable and expandable and adaptableadaptable to meet future observing needs to meet future observing needs

• Provide opportunities for the private sector to develop Provide opportunities for the private sector to develop thousands of value-added applicationsthousands of value-added applications

• Emphasize partnering with the public & private sectorEmphasize partnering with the public & private sector

Long-Term Legacy Goal:Long-Term Legacy Goal:‘‘Accurate Data — Reliably Available’Accurate Data — Reliably Available’

A zoomed-in look A zoomed-in look at the NERON at the NERON density for density for Vermont and New Vermont and New Hampshire Hampshire relative to the relative to the spacing grid for spacing grid for NERON sites (20 NERON sites (20 mile by 20 mile). mile by 20 mile). Sites selected Sites selected (dots) from the (dots) from the Fall of 2004 in Fall of 2004 in shaded grid cells. shaded grid cells. Non-shaded cells Non-shaded cells — the sites are — the sites are TBD during FY06-TBD during FY06-07 with sensors 07 with sensors added in either added in either FY06-07.FY06-07.

Status of COOP ModernizationStatus of COOP ModernizationModernized COOP Sites Operating as of 8/18/2005:Modernized COOP Sites Operating as of 8/18/2005:

• ~100 modernized & 3 beta sites operational in New England~100 modernized & 3 beta sites operational in New England• 10 meter winds being added at 23 sites10 meter winds being added at 23 sites

– Prototype ‘Monitoring & Processing System’ underwayPrototype ‘Monitoring & Processing System’ underway– Operational home and how to merge with other NOAA Operational home and how to merge with other NOAA

systems will be determined by 2007systems will be determined by 2007– Contract maintenance underway in New EnglandContract maintenance underway in New England– Expansion with partners in the South is underway (GA & Expansion with partners in the South is underway (GA &

AL)AL)– LETS test-bed underway at 4 GA sites by 9/15/05LETS test-bed underway at 4 GA sites by 9/15/05

COEA ResultsCOEA Results(Cost and Operational Effectiveness (Cost and Operational Effectiveness

Analysis)Analysis)

• Dated 6/30/05Dated 6/30/05

• Many issues addressed:Many issues addressed:– What is the value of surface observations and What is the value of surface observations and

what is the requirement for “real-time”?what is the requirement for “real-time”?– What parameters should be measured, how dense What parameters should be measured, how dense

should the observing network be, and how should the observing network be, and how frequently should parameters be measured and frequently should parameters be measured and their observations transmitted?their observations transmitted?

• What are the relative costs and benefits of What are the relative costs and benefits of alternative approaches to meeting the surface alternative approaches to meeting the surface observation requirement?observation requirement?

COEA ResultsCOEA ResultsSix Alternatives Proposed - Two Listed:Six Alternatives Proposed - Two Listed:

#1 —#1 — Maintain the current configuration of Maintain the current configuration of observation stations and capabilities (i.e., the observation stations and capabilities (i.e., the status quo)status quo)

#6 —#6 — Procure and deploy an automated network Procure and deploy an automated network to measure air temperature and relative humidity, to measure air temperature and relative humidity, precipitation amount, a profile of soil precipitation amount, a profile of soil moisture/temperature, incoming solar radiation, moisture/temperature, incoming solar radiation, and wind speed and direction using a system that and wind speed and direction using a system that is expandable, adaptable, and sustainable to is expandable, adaptable, and sustainable to meet future observation needs (e.g., meet future observation needs (e.g., incorporation of manual observations of snow fall incorporation of manual observations of snow fall and snow depth and non-NOAA Mesonets).and snow depth and non-NOAA Mesonets).

NERON’s Evolving Partnership NERON’s Evolving Partnership with Many Agencies in Georgiawith Many Agencies in Georgia

Potential Potential NERONNERON

sites in GAsites in GA

Based upon Based upon >250>250

operational operational weather sites weather sites

owned by owned by many potential many potential

partnerspartners

The 24 x 7 LETSThe 24 x 7 LETSagencies in GAagencies in GA

NERON Prototype LETS Communications in NERON Prototype LETS Communications in GAGA

FutureFutureCOOP Modernization ActivitiesCOOP Modernization Activities

Selection Example - HCN Selection Example - HCN RelocationRelocation

• Close-up of Close-up of area north of area north of an HCN sitean HCN site

• Concentric Concentric rings around rings around the HCN every the HCN every 1 mile1 mile

• Search for Search for ‘suitable areas’ ‘suitable areas’ within 4 miles within 4 miles of the HCN siteof the HCN site

Selection Example - HCNSelection Example - HCN

• Potential sites Potential sites recommended recommended in spacious in spacious open areasopen areas

• Selections are Selections are general – general – anywhere anywhere within the field within the field is usable as a is usable as a quality sitequality site

Selection Example - HCNSelection Example - HCN

• Proposed sites Proposed sites within a grid within a grid cellcell

• Shows Shows proximity to proximity to nearby HCN nearby HCN and ASOS sitesand ASOS sites

Next in the Queue:Next in the Queue:Northern AlabamaNorthern Alabama

After That?After That?

A Move West in Response to NIDISA Move West in Response to NIDIS• Potential Partners - Depends on the Potential Partners - Depends on the

BudgetBudget• The National Park ServiceThe National Park Service• Probable: NMProbable: NM• Possible: AZ, CO and maybe MTPossible: AZ, CO and maybe MT• Focus on the HCN sites in each stateFocus on the HCN sites in each state

Reason: Limited funds, ~25 HCN sites/state, Reason: Limited funds, ~25 HCN sites/state, easy way to stretch resources/build easy way to stretch resources/build political supportpolitical support

The COEA, PPBES Submission and The COEA, PPBES Submission and Budget RealitiesBudget Realities

• Total funds possibly available to NERON during FY06 and Total funds possibly available to NERON during FY06 and FY07 appears to be <$5 million/yearFY07 appears to be <$5 million/year

• COEA alternatives are realistic but not affordableCOEA alternatives are realistic but not affordable• Possible PPBES solutions to be fleshed out before October:Possible PPBES solutions to be fleshed out before October:

– Solution One:Solution One: ~3000 NERON sites are NOAA-owned (many ~3000 NERON sites are NOAA-owned (many are expanded HCNs), ~1000 other NERON sites are are expanded HCNs), ~1000 other NERON sites are federally owned (ASOS, CRN, USGS, COE, etc.) and ~4000 federally owned (ASOS, CRN, USGS, COE, etc.) and ~4000 sites owned by NERON partners.sites owned by NERON partners.

– Solution Two:Solution Two: ~1500 HCN sites are fully modernized; ~1500 HCN sites are fully modernized; remaining 1500 NOAA sites are installed with precipitation remaining 1500 NOAA sites are installed with precipitation sensors at 1/9th density (i.e., 60 mi x 60 mi; See Program sensors at 1/9th density (i.e., 60 mi x 60 mi; See Program Development Plan). ~3000 sites are NOAA partners.Development Plan). ~3000 sites are NOAA partners.

– Solution Three:Solution Three: Only 1500 NOAA-owned sites are installed Only 1500 NOAA-owned sites are installed and 1500 sites are owned by NOAA partners.and 1500 sites are owned by NOAA partners.

Salisbury, NH — Installed and OperationalSalisbury, NH — Installed and OperationalOctober 2004 (View to North)October 2004 (View to North)

The EndThe End

Kenneth.Crawford@noaa.Kenneth.Crawford@noaa.govgov