global hydro-estimator satellite rainfall estimates operational readiness review

Global Hydro-Estimator Satellite Rainfall Estimates

Operational Readiness Review March 20, 2012

Prepared by: Limin Zhao1, Clay Davenport3, Peter Keehn2, Bob Kuligowski2 and Walter Wolf2

Other Contributors: Rusty Pennoyer, Yi Song, Kathy Moore, Zhaohui Cheng, Larisa Koval, Ed Ladd, Doyle George, Jessica Staude, George

Lawless and Joseph McIlvenny1NOAA/NESDIS/OSPO2NOAA/NESDIS/STAR

3 SSAIApril 6, 2012 1GHE Operational Readiness Review

22

Review AgendaIntroduction 1:00 pm – 1:25 pmRisks and Actions 1:25 pm – 1:40 pmSystem Requirements 1:40 pm – 2:05 pmSystem Description 2:05 pm – 2:35 pmBreak 2:35 pm – 2:45 pmSystem Test 2:45 pm – 3:25 pmSystem Operational Readiness 3:25 pm – 3:50 pmSummary 3:50 pm – 4:00 pm

2April 6, 2012 GHE Operational Readiness Review

33

OutlineOutline Introduction Risks and Action System Requirements System Description System Test System Operational Readiness Summary


IntroductionLimin Zhao

NESDIS/OSPO

4April 6, 2012 4GHE Operational Readiness Review

5

Meet SPSRB User Request # 1010-0019 from NWSProvide satellite global rainfall estimate from Hydro-

Estimator products will combine rainfall estimate derived from

GOES-East , GOES-West, METEOSAT-7, METEOSAT-9, MTSAT

available within 50 minutes of observation (or 20 minutes of data receipt)

Meet SPSRB User Request # 1006-0009 from NWSProvide multi-day rainfall accumulations from Hydro-

Estimator Retire the operational CONUS-only HE

Provide the same product to NWS users from GHE

GHE Project Objectives

April 6, 2012 GHE Operational Readiness Review

6

GHE Stakeholders Developers

STAR Bob Kuligowski

Walter Wolf

Peter Keehn

Yi Song

OSPOClay Davenport

Limin Zhao


7

GHE StakeholdersOperations and Maintenance

OSPO Products Area Lead – Limin Zhao

OSPO QA Lead – Zhaohui Cheng

Operational Implementation and Maintenance TeamClay DavenportWilliam Pennoyer Jessica Staude

Science Maintenance Team Bob KuligowskiZhihua Zhang


8

GHE Stakeholders Users

NWSDan Beardsley (NWS)David Kitzmiller (NWS/OHD)

NESDISLiqun Ma (NESDIS/SPB)Sheldon Kusselson (NESDIS/SAB)

HRCKonstantine Georgakakos, Bob Jubach (HRC)


Bob Kuligowski

Added Bob Jubach of HRC; he may call in instead of Kosta

9

GHE Project Task and Milestones

Tasks:Defined in “FY12_Geo_Global_Hydro_Estimator_V4.ppt” (SPSRB

PSDI), and reviewers can find it at ftp://satepsanone.nesdis.noaa.gov/HydroEst/GHE/ORR

Key milestones: Preliminary Design Review – WaivedCritical Design Review – Aug, 2011 Sept 9, 2011Software Code Review – Oct, 2011 Oct 11, 2011System Readiness Review – Jan, 2012 WaivedOperational Readiness Review – Feb, 2012 April 6, 2012SPSRB Briefing – Mar 2012 April 18, 2012Operations Commence – Mar 2012 April 30, 2012


10

GHE Project - Timeline


1111

GHE ORR – Review Objectives Review Project Plan

Review the open Risks and Action

Review the System Requirements

Review the System Description including operations concept, external interfaces, software

architecture and detailed design

Review the System Test Report including operational code, unit test data, and system test data

Review System Operational Readiness


1212

ORR ReviewersReviewersORR Review Lead:

Antonio Irving and Zhaohui Cheng

ORR Review Team:Limin Zhao (PAL)Donna McNamara (Distribution)Carl Bauer and George Lawless (Security) Joseph Mani and Ed Ladd (IT Architect and System)Bob Kuligowski (PREPOP)Dan Beardsley (User)

ORR Review Consultants:Tom Schott (OSD)Dave Benner (SPSD)Linda Stathoplos (MOD)


ORR Guidelines and Check List

Guidelines for the ORR review is the OSPO QA process assetORR reviewers can access this document at

ftp://satepsanone.nesdis.noaa.gov/HydroEst/GHE/ORR

The ORR Review Check List “GHE_ORR_Checklists.xls” can be accessed by the GHE ORR reviewers atftp://satepsanone.nesdis.noaa.gov/HydroEst/GHE/ORR

April 6, 2012 13GHE Operational Readiness Review

1414

OutlineOutline Introduction Risks and Actions System Requirements System Description System Test System Operational Readiness Summary


Risks and Actions Limin Zhao

NESDIS/OSPO


CDR Risks and Actions


17

CDR Report (1/4)7 project risk and actions identified at CDR have

been addressed5 have been closed1 related to archive is closed/deferred for

future consideration.1 closed/removed since the issue is no longer

exist

3 non-risk related comments from the CDR reviewers are addressed in the following slides

Assessments and updates for above risks and comments are documented and can be found in: ftp://satepsanone.nesdis.noaa.gov/HydroEst/GHE/ORR/HydroEstimater_Review_Item_Disposition_CDR_v1.1.xls


18

CDR Report (2/4)CDR Report (2/4)Reviewer Tom Schott

#8 Comment What was decided about whether to show all of the most recent data from each satellite, or leave the much older data blank in the composite?

Responses The composites for each time period will be repeated every 15 min out to 1 hour. Areas without any available satellite data will be filled with missing values. The repeated compositing will allow users with tight latency requirements to get the data very quickly, but will allow users with looser latency requirements to get a more complete dataset. This is preferred to using the most recent data from each satellite because that approach mixes rainfall rates from multiple time periods (with a spread up to 1 hour due to the relatively long latency of MTSAT) and the users will have no way of knowing which time periods to associate with a particular feature.

Status ClosedApril 6, 2012 18GHE Operational Readiness Review

19

Reviewer Tom Schott

#9 Comment

Should submit a NCDC request for archive

Responses The primary user has no archive requirement, but NESDIS takes initiative to submit the archive request through the Advanced Tracking and Resource tool for Archive Collections (ATRAC) at NCDC (project #56).

Status Closed

CDR Report (3/4)CDR Report (3/4)


20

CDR Report (4/4)CDR Report (4/4)

Reviewer G. Lawless

#10 Comment

In future, it would be useful to include the project schedule for reference

Responses The project schedule and milestones are included in the ORR.

Status Closed


Risks and Actions Since CDR


22

Pre-ORR Risks and Actions Pre-ORR Risk 1: SRR was waived. Going straight to ORR. Risk Assessment: Low Impact: If the overall system information is not provided at

the ORR then the system most likely will not be ready for the operational transition, and the project might fall behind schedule and increase costs

Likelihood: Low Mitigation:

Include key system review components, such as, unit test and system test, within ORR

Status: Closed


23

GHE ORR – Entry Criteria Entry # 1 - The ORR reviewers have access to the review version of the

following artifacts Critical Design Review Report Requirements Allocation Document (RAD) Review Item Disposition Spreadsheet (RID) Operational Readiness Review Document (ORRD)

Entry # 2 - The ORR reviewers have access to the review version of SPSRB Documents User Manuals Algorithm Theoretical Basis Document (ATBD) System Maintenance Manual

Entry # 3 - The ORR reviewers have access to the Software Code Review report

Entry # 4 - The ORR reviewers have access to the review version of the Operations Procedure


24

Risks and Actions - SummaryRisks and Actions - SummaryThis CDR report has closed the GHE CDR

3 CDR risks were identified, and proper actions have been taken to addresses the issues. 2 closed and 1 related archive is deferred.

4 pre-CDR risks were identified, and 3 are closed, and 1 removed.

3 non-risk-associated comments are addressed.1 pre-ORR risk was identified, and proper actions have

been taken to addresses the issue. The risk is no closed.The entry criteria and exit criteria for the GHE ORR have

been established.


25

GHE ORR – Exit Criteria

Exit # 1 - All open items in RID have been satisfactorily disposed of.

Exit # 2 - The updated RAD is satisfactory. Exit # 3 - The SPSRB documents (UM, SMM and ATBD)

have been reviewed and are deemed to be satisfactory. Exit # 4 - Test and validation results are satisfactory. Exit # 5 - The operation readiness are satisfactory. Exit # 6 - The security impact assessment (SIA) has been

completed.


2626



System Requirements Limin Zhao

NESDIS/OSPO


GHE Requirements SPSRB Requests

1010-0019, “Global Hydro-Estimator Satellite Rainfall Estimates”

Transition global Hydro-Estimator from STAR to OSPO to replace current CONUS Hydro-Estimator.

1006-0009, “Making Multi-day (more than 24hrs) NESDIS Hydro-Estimator Rain Estimates Operationally”

Make 2-7 day HE totals over CONUS

9712-8, “Implement Graphical Auto-Estimator on AWIPS.”The original request for automated satellite products at NESDIS,

which led to the Auto-Estimator and Hydro-Estimator over the CONUS.

April 6, 2012 GHE Operational Readiness Review 28

GHE Requirements Product Specifics

Product name

Geographic Coverage

Horizontal Resolution

Mapping Uncertainty

Measurement Range

Measurement Precision

Measurement Accuracy

Latency Refresh Rate

Instantaneous rainfall rate , 1-hour, 3-hour, 6-hour, 24-hour and multi-day rainfall accumulations

Global from 60°S to 60°N

4 km 4 km 0 ~ 76 mm/h

9 mm/h at rates of 10 mm/h, with higher values at higher rates

6 mm/h at rates of 10 mm/h, with higher values at higher rates

20 min 20 min


GHE RequirementsAllocation Document

Requirements Allocation Document (RAD) v1r0Established at Critical Design Review (CDR), as a CDR

artifact. Contains the basic and derived requirements for the work

productsRAD Document Guidelines in STAR EPL process asset DG-

6.2 at http://www.star.nesdis.noaa.gov/star/EPL_index.php

Requirements Allocation Document (RAD) v2r0Updated to include the allocation of the requirements to

system components and product components for Operational Readiness Review (ORR)

As a ORR artifact, can be obtained at ftp://satepsanone.nesdis.noaa.gov/HydroEst/GHE/ORR


31

GHE Requirements Basic Requirement 0.0

Basic Requirement 0.0: The Global Hydro-Estimator (GHE) project shall adopt the standard practices of the Satellite Products and Services Review Board, as established in the SPSRB Policy on Fiscal Year 2010 (FY10) Annual Review for Satellite Product Development. (process)


32


• Basic Requirement 1.0: Integrated Product Team (IPT) shall generate real-time estimates of rainfall at the full IR pixel scale for the entire globe. (product, functional)User request: (1010-0019, “Global Hydro-Estimator Satellite Rainfall Estimates”).


33


• Derived Requirement 1.1: The Global Hydro-Estimator algorithm shall be applied to data from GOES-E and GOES–W, METEOSAT-7 and -9, and MTSAT geosynchronous satellites, using GFS model data for the adjustments for the effects of moisture availability, evaporation, orographic modulation, and thermodynamic profile effects.

Derived Requirement 1.1.1: All satellite and model data shall be obtained from OSPO servers via ADDE.

Derived Requirement 1.1.2: The satellite imagery to be processed for rain rates shall be received as McIDAS AREA files.


34


Derived Requirement 1.1.3: Each of the five satellites shall run as a separate job to create a rainfall image within its field of view.

Derived Requirement 1.1.3.1: IPT shall develop routines to calculate the rainfall rates for each satellite/sector.

Derived Requirement 1.1.4: Data from GFS model shall be obtained in McIDAS GRID format and converted into McIDAS AREA format to match satellite imagery.


35


Derived Requirement 1.1.5: Static Local Data (Global Terrain Maps and Lookup tables for viewing angle corrections) shall be obtained in McIDAS AREA format.

Derived Requirement 1.1.5.1: IPT shall develop routines to calculate non-satellite inputs.

Derived Requirement 1.1.6: IPT shall develop routine to create a global composite rainfall image.


36


• Derived Requirement 1.2: The GHE system shall be able to run in the STAR Development Environment and OSPO Test Environment (Linux).

Derived Requirement 1.3: The GHE system shall be able to run in the ESPC Operations Environment (Linux).


37

Basic Requirement 2.0:The rainfall products shall include: (1) instantaneous rainfall rate and 1-hour rain rate over global; (2)1-hour, 3-hour, and 6-hour rainfall estimate, daily rainfall estimate, 2-day rainfall estimate, 3-day rainfall estimate, 4-day rainfall estimate, 5-day rainfall estimate, 6-day rainfall estimate and 7-day rainfall estimate over CONUS.

User requests: (1010-0019, “Global Hydro-Estimator Satellite Rainfall Estimates”; 1006-0009, “Making Multiday (more than 24hrs) NESDIS Hydro-Estimator Rain Estimated Operationally”).



38


• Derived Requirement 2.1: The GHE rainfall products shall have geographical coverage from 60°S to 60°N.

Derived Requirement 2.2: The GHE rainfall products shall have horizontal resolution of 4 km.

Derived Requirement 2.3: The GHE rainfall products shall have mapping uncertainty of 4 km.

Derived Requirement 2.4: The GHE rainfall products shall have measurement range of 0 ~ 76 mm/h.


39


• Derived Requirement 2.5: The GHE rainfall products shall have measurement precision of 9 mm/h at rates of 10 mm/h, with higher values at higher rates.

Derived Requirement 2.6: The GHE rainfall products shall have measurement accuracy of 6 mm/h at rates of 10 mm/h, with higher values at higher rates.

Derived Requirement 2.7: The GHE rainfall products shall be in netCDF4/McIDAS formats.


40


Basic Requirement 3.0: Global Rainfall Rates shall be generated and distributed within 50 minutes of observation (or 20 minutes of data receipt) to NWS, the Hydrologic Research Center, and NESDIS users through both DDS and McIDAS ADDE servers. (product) Derived Requirement 3.1: The GHE system

shall be able to push the data to DDSDerived Requirement 3.2: The GHE system

shall be able to push the data to SATEPSDIST1


41


Basic Requirement 4.0: The GHE system shall have QC monitoring capability.

Derived Requirement 4.1: The GHE Product files shall include overall quality control flags.

Derived Requirement 4.2: The GHE system shall be capable of monitoring input data latency and overall quality.

Derived Requirement 4.3: The GHE system shall be capable of monitoring product latency.

Derived Requirement 4.4: The GHE system shall be capable of monitoring product distribution status to ensure that the data/products are successfully available for transfer to the user community.


42


Derived Requirement 4.5: The GHE system shall be capable of monitoring product quality. Derived Requirement 4.5.1: The GHE system shall be

able to push data to the ESPC web servers Derived Requirement 4.5.2: The GHE system shall have a

web interface for displaying the products images, processing and distribution status and timelineness, etc.

Derived Requirement 4.6: The GHE system shall have the validation capability Derived Requirement 4.6.1: The GHE system shall be

capable of validating the hourly rain rate with radar data Derived Requirement 4.6.2: The GHE system shall be

capable of validating the daily rainfall total with CPC daily gauge data


43


Basic Requirement 5.0: The GHE system shall generate metadata for each rainfall product.

Derived Requirement 5.1: The GHE system shall write a metadata text file associated with the GHE products.


44


• Derived Requirement 5.2: The GHE product metadata shall include overall quality and summary level metadata.

Derived Requirement 5.3: The GHE metadata shall comply with ISO standards (defer).


45


Basic Requirement 6.0: The Integrated Product Team shall perform validation and verification of the GHE products.

Derived Requirement 6.1: GHE products shall be validated by comparing with retrieved instantaneous rainfall rates to Tropical Rainfall Measuring Mission (TRMM) spaceborne Precipitation Radar (PR) between 35ºS and 35ºN.

Derived Requirement 6.2: The IPT shall verify that the GHE products in the output files are generated correctly and documented.


46


• Basic Requirement 7.0: The GHE software shall be delivered to the OSPO team for testing and operational implementation.


47

GHE RequirementsBasic Requirement 8.0

Defer after ORR

Basic Requirement 8.0: The global Hydro-Estimator Rainfall products (netCDF4) and corresponding metadata shall be archived at NCDC/CLASS.

Derived Requirement 8.1: Distribution of the Archive Products to NCDC/CLASS shall be in accordance with a Data Submission Agreement (DSA). STAR plans to work with OSPO to create a DSA with CLASS.


48


Basic Requirement 9.0: The GHE shall maintain heritage with operational CONUS Hydro-Estimator and ensure continuity/consistency.

Derived Requirement 9.1: The current operational HE-SPE shall be integrated into the global Hydro-Estimator , and be taken as its sub-system.


49


Basic Requirement 10.0: The GHE system shall comply with OSPO Code Review Security check lists.

Derived Requirement 10.1: The GOES PS system shall comply with OSPO data integrity check list.

Derived Requirement 10.2: The GHE system shall

comply with OSPO development security check list.

Derived Requirement 10.3: The GHE system shall comply with OSPO code check list.


50


Basic Requirement 11.0: The GHE system shall have a data ingest capability.

Derived Requirement 11.1: The GHE system shall ingest GOES-E Imager data.


ingest GOES-W Imager data.

Derived Requirement 11.3: The GHE system shall ingest METEOSAT-9 SEVIRI data.


51


Derived Requirement 11.4 : The GHE system shall ingest METEOSAT-7 MVRI data.


ingest MTSAT Imager data.

Derived Requirement 11.6: The GHE system shall ingest GFS forecast data.

Derived Requirement 11.7: The GHE system shall ingest ancillary data for product generation and product validation.


52


Basic Requirement 12.0: The IPT shall deliver a GHE document package to OSPO.

Derived Requirement 12.1: The GHE document package shall include an Algorithm Theoretical Basis Document (ATBD).

Derived Requirement 12.2: The GHE document

package shall include a System Maintenance Manual (SMM).

Derived Requirement 12.3: The GHE document package shall include an External Users Manual (EUM).


53


Derived Requirement 12.4 : The GHE document package shall include an Internal Users Manual (IUM).

Derived Requirement 12.5: The GHE document package shall include the Operations Procedures (OP).


54

GHE Requirements Summary

The Global Hydro-Estimator Requirements have been established.

The Global Hydro-Estimator Requirements have been documented in the Requirements Allocation Document (RAD).

The Global Hydro-Estimator Requirements are traceable to drivers (customer needs or expectations) and other requirements.

The Global Hydro-Estimator Requirements have been allocated in the Requirements Allocation Document (RAD).


5555



System DescriptionClay Davenport and Limin Zhao

NESDIS/OSPO


57

GHE System Design

The GHE system provides an infrastructure that will enable the implementation of the GHE algorithms to meet requirements.


58

GHE Major Components

Calculation of non-satellite inputs

Calculation of Rainfall Rate for each satellite/sector

Composite Rainfall Rate outputs

NetCDF and GRIB ConvertersApril 6, 2012 GHE Operational Readiness Review

59

GHE IT Architecture and Network Connection


Note: CLASS is not in the picture since no archival is required

60

GHE Context Diagram

NCEP GFS Model Server

Ancillary Data

Satellite Servers

Algorithm Packages

File Server

GHE

Products

Products

Input Data

Model Data

LookupTables

Satellite Imagery


61

GHESystem Level (1/2)

PW RHOrog

EQL

Satellite Data

GOES-11GOES-13

Meteosat-7Meteosat-9MTSAT-1R

NCEP GFS Model Data

Zenith Angle Adjustment

Parallax Adjustmen

t

Rain Rates

Topo Maps

Joyce model


62

GHESystem Level (2/2)

GOES-11 Rain Rates

GOES-13 Rain Rates

Meteo-9 Rain Rates

Meteo-7 Rain Rates

MTSAT-1R Rain Rates

Global Rain Composite

Merger Algorithm


63

System DescriptionProduction (1/2)

Two Dedicated Servers for GHE - GHE1/GHE2Development – GHE2 Sever

Development and testing of GHE under $ANCHOR/GHE_dev

Testing and Backup– GHE2 Server Pre-operational codes (DAP) received from STAR has been

thoughly tested on GHE2 at ESPC since Jan 2012. ($ANCHOR/GHE_test)

GHE2 will also as served as the backup server for the operational GHE ($ANCHOR/GHE).

Production – GHE1 Server GHE will be run to generate the operational products on GHE1

The products will be distributed to users through ESPC Data Distribution System (DDS) and McIDAS ADDE server on GHE1


64

System DescriptionProduction (2/2)

ESPC GOES Ingest Systems provides all GEO satellite input data

ESPC Model Server provides GFS model data

The global HE product system is hosted on GHE1/GHE2, which collects the satellite inputs and required ancillary data to run the HE algorithm

The products are generated in McIDAS area and then converted into netCDF4 for archive


System DescriptionHardware/Software

The Configuration of GHE1/GHE2 2 quad core CPUs 2.66 GHz 8 GB memory 200 GB additional disk space gfortran version 4.1.2 gcc version 4.1.2 McIDAS version 2010.1 Shell scripts

NetCDF and HDF5 lib were installed NetCDF version 4.1.3 HDF5 version 1.8.6

GRIB1/GRIB2 lib are installed Grib1 lib are part of SPE codes GRIB2 version 2

CVS version control


66

System DescriptionInput Data Sources

Satellite Data for Product Generation GOES-W&-E GWR (McIDAS Area)

Meteosat-7 & -9 (McIDAS Area)

MTSAT (McIDAS Area)

Ancillary Data for Product Generation NCEP GFS Model data (GRIB2 converted to McIDAS)

Global Terrain Maps (McIDAS Area)

Lookup Tables for Viewing Angle Corrections (McIDAS Area)

Ancillary Data for Product Validation Radar (netCDF)

CPC Daily Rainfall from gauge (GRIB2)April 6, 2012 GHE Operational Readiness Review

67

System Description Inputs - McIDAS AREA Files (1/2)

The satellite imagery to be processed for rain rates will be received as McIDAS AREA filesFive satellites provide global coverage


68

System Description Inputs - McIDAS AREA Files (2/2)

In order to maximize coverage in both space and time, 13 different types of AREA files need to be pulled from the serversGOES-W: GEFDSK04I4 (3 hourly), GENHEM04I4 (30 min),

GECONS04I4 (15 min), GESHEM04I4 (30 min)GOES-E: GWFDSK04I4 (3 hr), GWNEM04I4 (30 min),

GWSHEM04I4 (30 min), GWPACU04I4(15 min)Meteosat-9: MSGLOB09I (15 min)Meteosat-7: INDOEXIR (30 min)MTSAT: MTGLOB04I2 (60 min), MTNHEM04I2 (30 min),

MTSHEM04I2 (6 hourly)


69

System Description Inputs - GFS Model Data

Model data are pulled every 6 hoursAlways selects the most current model run containing

data for the selected timeWill continue to work throughout two missed model

runsExtracts vertical profiles of temperature and humidity

at each grid point, total precipitable water, and 700 mb winds

Data is obtained in McIDAS GRID format, converted into AREA format to match satellite imagery


70

System Description Inputs - Static Local Data

Cloud-top temperatures are modified from a lookup table based on apparent temperature, zenith angle, latitude, and season (Joyce CPC model)

Global topographic files and land/sea masks, in AREA format, from SSEC and USGS


71

Product PrecedenceModel-based adjustments (PW, RH, Orography,

Stability) used by all satellites, are run as standalone jobs every hour

Each of the five satellite rainfall products is run as its own job (attempts every 15 minutes, skipped if no new satellite data)

Compositing programs create spatial mosaics and time summations; time summations run with each new rain image, global composite runs hourly


72

Product PrecedenceModel Data (1/2)

Precipitable water and relative humidity are directly taken from the GFS model, and interpolated between model runs for an hourly product

Data transformed into a global AREA file

Each satellite run will extract the portion of the global field required


73

Product PrecedenceModel Data (2/2)

Orographic and equilibrium level files have to be derived from GFS model dataOrographic data combined model winds with USGS

digital terrain dataStability calculated by running model profiles through

1D model

Built separately for each satellite field, not a single global product

Have traditionally been made every six hours, without interpolation


Product PrecedenceSatellite Runs (1/4)

Each of the five satellites will run as a separate job to create a rainfall image within its field of view

Satellites are spaced 58~82˚ apart, with a 108˚ FOV providing overlapping coverage

Latitudinal coverage to 62˚N and 62˚SEach job is completely independent of the others

and they can all run simultaneouslyLatencies to data receipt range from 6-32 minutes

after image time74April 6, 2012 GHE Operational Readiness Review


Zenith-angle adjustments to cloud-top temperature calculated from Bob Joyce’s model developed for CPC

Parallax adjustments to locations based on corrected temperatures and model profile data to determine cloud height

Rain calculation based primarily on corrected cloud-top temperatures and geometry, adjusted by other derived products



GOES products are the most complicatedNeed to follow a hierarchy to grab the best

available from Full-disk data (available every 3 hours), to hemispheric data (every 30 minutes), to CONUS/PACUS products (15 minutes)

Can lose South American data for up to 3 hours during RSOs

Frequent gaps in southeast Pacific76April 6, 2012 GHE Operational Readiness Review


Meteosat-9 covers Europe and Africa every 15 minutes

Meteosat-7 covers Indian Ocean and central Asia every 30 minutes

MTSAT covers Australia, east Asia, and the western PacificNorthern hemisphere every 30 minutesSouthern hemisphere every 60 minutes


Product PrecedenceComposites (1/2)

Each satellite will have its own routine to create an hourly time summation of the observed precipitation

Summation routine runs by pixel, adapts for different sized images being summed

Time-weighted average – each pixel weighted by the portion of the hour it represents 78April 6, 2012 GHE Operational Readiness Review

Product PrecedenceComposites (2/2)

Mosaic program will run hourly to create a global composite rainfall image

Creates ‘seamless’ smooth averaging in the overlap regions using zenith angle weighting

Will also run for previous hours to catch later-arriving data


80

System Description Output Files

Output files are in McIDAS AREA format and netCDF

Output files will be post-processed for final display and distribution to users and web

Composites over multiple time lengths instantaneous rainfall rate and 1-hour, 3-hour,

and 6-hour rainfall estimate, daily rainfall, 2-day, 3-day, 4-day, 5-day, 6-day and 7-day rainfall estimate.


81

System Description Products

Detailed Product SpecificationsParameters Specifications

Environmental parameter Instantaneous rainfall rate , 1-hour, 3-hour, 6-hour, 24-hour and multi-day rainfall accumulations

Geographical Coverage global from 60S to 60N

Horizontal Resolution/grid spacing

4 km

Mapping Uncertainty 4 km

Measurement Range 0 ~ 76 mm/h

Measurement Precision 9 mm/h at rates of 10 mm/h, with higher values at higher rates

Measurement Accuracy 6 mm/h at rates of 10 mm/h, with higher values at higher rates

Latency 20 mins

Refresh 20 mins

Formats McIDAS, netCDF4


8282



GHE System Test Clay Davenport

NESDIS/OSPO


GHE Unit Test Description

Each test has been done following the scenarioDescribe the test itemShow scheduled execution times (cron schedule)Show predefined McIDAS area numbers used for

intermediate and final outputShow directory listing of output files indicating

the file creation time is consistent with the scheduled execution time

Test results are available for review in Appendix


GHE System Test Objectives

Ensure that all requirements specified for the product processing system and products are satisfied, and the products meet the users’ needs and expectations.


GHE System Test Test Plan

The execution of integrated code consists of a series GHE runs configured with specified system test input data to verify all requirement items are satisfactory at the system test level.


GHE System TestTest Environment

The unit test is performed on GHE2, and the integration test is on GHE1The machines are located at the ESPC/OSPO

2 quad core CPUs 2.66 GHz 8 GB memory 200 GB additional disk space gfortran version 4.1.2 gcc version 4.1.2 McIDAS version 2010.1

NetCDF and HDF5 lib were installed NetCDF version 4.1.3 HDF5 version 1.8.6

GRIB1/GRIB2 lib are installed Grib1 lib are part of SPE codes GRIB2 version 2


GHE System TestTest Dataset

The system works off of the McIDAS data servers which provide all required real time data.GOES-E, GOES-W, METEOSAT, MTSAT, INDOEX IR images

(McIDAS format)GFS forecast models (McIDAS format)NCEP Stage IV radar/gauge data (ftpprd.ncep.noaa.gov)NCEP gauge data (ftp.emc.ncep.noaa.gov)


GHE System TestTest Configuration

Define output locationsscripts/setup_ghe.shsrc/globalghe.incdata/RESOLV.SRV

Compile source codeRun ghe_build.sh in src/ directory and move

executables to bin/ directoryRun makefile in ghe_ncd_code/main directoryRun makefile in SPE directory

Load ghe_crontab into cron daemonApril 6, 2012 89GHE Operational Readiness Review

GHE System TestTest Items

Production Component GHE Core process GHE/SPE process GHE/NetCDF process

Validation Component Hourly (Radar) Daily (Gauge)

Dissemination Component DDS – hourly for HRC user Satepsdist1 – all products for SAB users Sandia/Cyclone/Tornado – status and logs for operator monitoring GP5/GP50 – gifs for Web monitoring Satepsanone – test data

QC Monitoring


GHE System Test Test Sequence (1/2)

Set up the cronjob for generating GHE products to run at full GHE capacity This driver is capable of generating the global rainfall

products, including SPE and netCDF outputs GFS model data reevaluated every 60 minutes Instantaneous rain data generated every 15-60 minutes,

depending on sector Set up the cronjob for generating composite rain products

Instantaneous and hourly composites generated every 15 minutes

3- and 6-hourly composites generated at top of every hour SPE and global netCDF for HRC at top of every hour


GHE System Test Test Sequence (2/2)

Set up the cronjob for generating daily product at 1300 UTC every day. All observations collected during a calendar day (1200 –

1200 UTC) is processed at 1300 UTC the following day. Daily products are merged to create 2- through 7-day

global totals. Set up the cronjob for generating gif images Setup the cronjob for data and images transfer to data

distribution server and web farms Set up the cronjob for daily clean-up


System Test Core Product – GOES-East Rain


Available 17 minutes after scan time (29 minutes during full disk)

System Test Core Product – GOES-West Rain


Available 18 minutes after scan time (29 minutes during full disk)

System Test Core Product – Meteosat-9 Rain


Available 28 minutes after scan time, 4x per hour, full disk

System Test Core Product – Meteosat-7 Rain


Available 18 minutes after scan time, 2x per hour, full disk

System Test Core Product – MTSAT Rain


Available 36 minutes after scan time; scans at :30 are normally full disk, scans at :00 are NHEM or SHEM only

System Test Core Product – Merged Global File

Global instantaneous files, required at 20 min latency for N.A. and 50 minutes for globe

Produced at :19 for GOES, updated at :34 and :49 to capture later files


System Test Core Product – Global Daily Rain

Global daily rain total, 12Z-12Z, generated at 13:19 Z each day from 6-hour totals


System Test Core Product – Multi-day Rain Totals

Seven-day shown, available for each of 1-2-3-4-5-6 days


System Test Core Product – SPE

Generated immediately after instantaneous global merge r is made (~:19)


System Test Core Product – NetCDF Output

Log extracts showing the completion of the netCDF routine every 15 minutes

globalmerge_20120329_123401.log:Ending NETCDF at Thu Mar 29 12:36:32 UTC 2012













System Test Validation of Product Quality

• Algorithm• The HE has been run in operations since 2002• Two changes were made during the GHE

implementation• Replace NAM model data with GFS model data

for the global application• Extend the orographic and EQL adjustment over

global• The same algo is applied to each individual satellite• The global composite is then generated from

retrievals from each individual satellite


System Test Validation of Product Quality

• Product Quality Verification• Verified against the spec for instantaneous rain

rate• Verified against the current operational HE

products over CONUS• Verified against the same global products

generated from STAR• Validated against radar for hourly and gauge for

daily totals


System Test Validation – Instantaneous Rain Rate

Comparison with 1-h totals from the current global HE using TRMM Precipitation Radar (PR) as the benchmark for 24 March – 1 April 2012 shows slight but possibly not statistically meaningful differences:

Spec was calculated using the STAR version for May-November 2005. This data sample is much smaller (9 days) which results in much greater uncertainty in the statistics, so it is not surprising that it is outside of spec for this short period. However, performance of the OSPO version is similar to the STAR version which provides confidence that spec would be met for a longer study period.


System Test Validation – Daily Rainfall

Compared to NCEP daily gauges


Global H-EAREA THRESH NUMRN NUMEST NBIAS VBIAS CORR RMSE SUCC MISS FAR SKIL 621 0.0 184133. 112025. 61. 56. 0.50 5.54 0.42 0.58 0.19 0.89 621 7.0 72021. 37617. 52. 58. 0.14 15.73 0.27 0.73 0.25 0.50 621 26.0 11921. 6303. 53. 62. 0.22 29.29 0.28 0.72 0.29 0.48 621 52.0 1364. 741. 54. 57. 0.60 47.96 0.06 0.94 0.42 0.44 621 WTAVG 467191. 261395. 56. 56. 0.42 12.08 0.31 0.69 0.25 0.76

System Test Validation - Hourly Rainfall

Compared to NCEP Stage IV analysis


Global H-EAREA THRESH NUMRN NUMEST NBIAS VBIAS CORR RMSE SUCC MISS FAR SKIL 997 0.0 36867. 75690. 205. 72. 0.31 5.34 0.33 0.67 1.72 0.97 997 7.0 32515. 31743. 98. 61. 0.09 31.35 0.21 0.79 0.77 0.29 997 26.0 20138. 8408. 42. 42. 0.26 44.21 0.11 0.89 0.26 0.24 997 52.0 7285. 1818. 25. 35. 0.39 61.78 0.10 0.90 0.13 0.30 997 WTAVG 496121. 264616. 53. 67. 0.30 15.44 0.14 0.86 0.38 0.81

System Test Dissemination – DDS, SATEPSDIST1 and

SATEPSANON netCDF and SPE distribution go primarily to

the NWS and HRC

DDS connection has been tested without sending data – appending for the distribution rule be setup

Products are being send via SATEPSANON and verified as acceptable to the primary user

Products are being send to SATEPSDIST1


System Test Dissemination – Web Farms

3-hour total GIF (among others) sent to web page on GP50/GP5 every hour

Doubles as quick QC check for programmers


110

System Test Dissemination- Monitoring

List of continuously updating status files

Used to power the GUI monitor -rw-r--r-- 1 Pprecip precip 1184436 Mar 29 15:25 globalmerge.status

-rw-r--r-- 1 Pprecip precip 1087973 Mar 29 15:31 raingoesen.status

-rw-r--r-- 1 Pprecip precip 614463 Mar 29 15:19 raingoeses.status

-rw-r--r-- 1 Pprecip precip 1104953 Mar 29 15:32 raingoeswn.status

-rw-r--r-- 1 Pprecip precip 607832 Mar 29 15:04 raingoesws.status

-rw-r--r-- 1 Pprecip precip 591739 Mar 29 15:21 rainindia.status

-rw-r--r-- 1 Pprecip precip 1179035 Mar 29 15:31 rainmeteo.status

-rw-r--r-- 1 Pprecip precip 588631 Mar 29 15:11 rainmtsat.status

-rw-r--r-- 1 Pprecip precip 310877 Mar 29 15:04 setupworld.status

-rw-r--r-- 1 Pprecip precip 321352 Mar 29 15:20 transfergifs.status


System Test Dissemination- Monitoring

GUI Monitor installed on Sandia for Operator


System Test Verify Users’ Needs - Time Latency

Time latency of sector rain products from March 20-29, 2012

Satellite Number of images

Average latency(minutes)

GOES-E (NH) 754 19.04

GOES-E (SH) 263 18.93

GOES-W (NH) 654 19.13

GOES-W (SH) 297 17.97

Meteosat-9 927 27.97

India (Meteosat-7) 429 16.34

MTSAT 465 36.71


System Test Verify Users’ Needs - Time Latency

North American composite (SPE) generated and sent at :20 after each hour

Global composite first built at :19 after nominal time, with rebuilds at :34, :49, and 1:04 after.

The file at :49 after will usually be complete (MTSAT takes 36-40 minutes to process)

May be possible to adjust times to get global product closer to MTSAT time


System Test Verify Users’ need - Coverage

Global coverage to +/- 64 degrees


System Test Verify Users’ Need – Product Accuracy

Comparison to current operational H-E (daily gauges, US only, from 2/15 to 3/18/12). Test results show slight improvement of GHE over the current operational HE

All pixels

Weighted by precipitation thresholds

Num Bias

Vol Bias

R RMSE Success

False Alarm

OPS 1.03 1.35 .619 8.59 .730 .297

GHE 0.96 1.03 .615 7.56 .675 .286

Num Bias

Vol Bias

R RMSE Success

False Alarm

OPS 1.30 1.30 .408 23.51 .613 .865

GHE 1.04 1.04 .437 20.52 .558 .598


116116



System Operational Readiness

Limin ZhaoNESDIS/OSPO


118

System Operational ReadinessProduction Environment

Two Dedicated Servers for GHE - GHE1/GHE2Development – GHE2 Sever

Development and testing of GHE under $ANCHOR/GHE_dev

Testing and Backup– GHE2 Server Pre-operational codes (DAP) received from STAR has been

thoughly tested on GHE2 at ESPC since Jan 2012. ($ANCHOR/GHE_test)

GHE2 will also as served as the backup server for the operational GHE ($ANCHOR/GHE).

Production – GHE1 Server GHE will be run to generate the operational products on GHE1

The products will be distributed to users through ESPC Data Distribution System (DDS) and McIDAS ADDE server on GHE1


119

System Operational ReadinessInput Data Sources

Satellite Data for Product Generation GOES-W&-E GWR (McIDAS Area)

Meteosat-7 & -9 (McIDAS Area)

MTSAT (McIDAS Area)

Ancillary Data for Product Generation NCEP GFS Model data (GRIB2 converted to McIDAS)

Global Terrain Maps (McIDAS Area)

Lookup Tables for Viewing Angle Corrections (McIDAS Area)

Ancillary Data for Product Validation Stage-IV Hourly Rainfall (netCDF)

CPC Daily Rainfall from gauge (GRIB2)April 6, 2012 GHE Operational Readiness Review

120

System Operational Readiness IT Architecture and Network Connection


Note: CLASS is not in the picture since no archival is required

121

System Operational Readiness Products (1/2)

The global Hydro-Estimator rainfall estimate utilizes IR brightness temperatures to identify regions of rainfall and retrieve rainfall rate, then uses GFS model fields to adjust the rainfall rate for the effects of moisture availability, evaporation, orographic modulation, and thermodynamic profile effects.

The rainfall products include:Global: instantaneous rainfall rate and 1-hour rainfall

rate

CONUS: instantaneous rainfall rate and 1-hour, 3-hour, and 6-hour rainfall estimate, daily rainfall, 2-day, 3-day, 4-day, 5-day, 6-day and 7-day rainfall estimate.


122

System Operational Readiness Products (2/2)

Detailed Product SpecificationsParameters Specifications

Environmental parameter Instantaneous rainfall rate , 1-hour, 3-hour, 6-hour, 24-hour and multi-day rainfall accumulations

Geographical Coverage Global from 60°S to 60°N

Horizontal Resolution/grid spacing

4 km

Mapping Uncertainty 4 km

Measurement Range 0 ~ 76 mm/h

Measurement Precision 9 mm/h at rates of 10 mm/h, with higher values at higher rates

Measurement Accuracy 6 mm/h at rates of 10 mm/h, with higher values at higher rates

Latency 20 mins

Refresh 20 mins

Formats McIDAS, netCDF4


123


Users of ProductsUser POCs Products Dissemination

NWS/OHD David Kitzmiller Hourly Rainfall Estimate ESPC Data Distribution Sever

NWS/AWIPS James Heil Hourly Rainfall Estimate ESPC Data Distribution Sever

NWS Centers, i.e. HPC

James Heil Hourly Rainfall Estimate NAWIPS

NWS/HRC Dan BeardsleyKonstantine GeorgakakosBob Jubach

Hourly Rainfall Estimate ESPC data Distribution Sever

NESDIS/SAB Sheldon Kusselson Instantaneous rain rate, 1-hour, 3-hour, 6-hour, 24-hour rainfall accumulation, and multi-day rainfall accumulations

ESPC McIDAS ADDE Server

eTRAP Liqun Ma Hourly Rainfall Estimate ESPC McIDAS ADDE Server


124

System Operational ReadinessProduction

ESPC GOES Ingest Systems provides all GEO satellite input data

ESPC Model Server provides GFS model data

The global HE product system is hosted on GHE1/GHE2, which collects the satellite inputs and required ancillary data to run the HE algorithm

The products are generated in McIDAS area and then converted into netCDF4 for archive


125

System Operational ReadinessDissemination

DDSHourly rainfall over CONUS in GRIB format

Hourly rainfall over global in netCDF4 format Pending for the distribution rules on DDS, which will be setup

after the SPSRB’s approval for operation

McIDAS ADDE on SATEPSDIST1All GHE products

Internet (Web Interface)GHE product images

Image animation loops

Test DataApril 6, 2012 GHE Operational Readiness Review

126

System Operational Readiness Monitoring (1/2)

Multi-level Monitoring ToolsA GUI monitor for operator to monitoring the

processing statusAutomated email alerts for product generation and

distribution anomaliesWeb-based tools for product quality, timeliness

and distribution status (http://www.ospo.ssd.nesdis.noaa.gov/Products/atmosphere/ghe)

Offline product quality validation against Radar and Gauge dataApril 6, 2012 GHE Operational Readiness Review

127

System Operational ReadinessMonitoring (2/2)

Monitoring ProceduresOverall quality check for input data are performed inside

of the global HE algorithm.The job performance, including processes status, input

and output data latency, and product distribution, will be monitored by the ESPC help desk through the GUI monitor

Email alerts will be generated and send to the related people when an error occurs

Offline statistic comparison with radar and gauge data will be generated for product quality validation

The Precipitation PAL and maintenance personnel at OSPO will monitor the product quality and coordinate with the STAR scientists for any product quality issues


128


GUI Monitor for Operator


129


Web for Product Monitoring


130


GHE 5-Day Rainfall Total


131


Maintenance (1/2)GHE will be supported under the ESPC operationThe production machines are maintained by the

ESPC IT team 24/7Operation Procedure and System Maintenance

Manual will be in place to support O&M needsThe primary and backup maintenance

personnel have been identified to cover normal maintenance needs

The ESPC CM and security procedures will be followed for any codes and documents changes

The monitoring tools and procedures are in place as discussed before

The PAL will work with STAR scientists for any science maintenance needs when identified


132


Maintenance (2/2)Emergency Recovery CapabilityGHE will replace the current HE at the CIP

(Critical Infrastructure Protection) facility after the GHE is operational to make use of the current IT resource at CIP.

Any promotions and changes in the ESPC operation will be being made in the CIP at the same time

GHE products can be continued in the event of an unexpected and sustained loss of service at the NSOF ESPC


133

System Operational Readiness QA – Code Standards

The GHE operational team has been working with the development team to ensure that the GHE follows the ESPC operational requirements/guidanceDirectory structuresFile/directory naming conventionsOperational log file contentError tracking and handling

The GHE has passed through Code Review OSPO leads the Code Review for coding standards and

security, All the open items from code review have been closedResults have been documented in Code Review ReportThe code review report, as a ORR review artifact, can be found

at: ftp://satepsanone.nesdis.noaa.gov/HydroEst/GHE/ORR


134


QA – CM and IT security Product implementation Implementation on parallel test environment and transition to

operation are tasked and managed by Change Requests (CCRs/WRs) through the ESPC Request for Action Tracking System (RATS)

Software CM follows ESPC Software Configuration Management Process and Procedures Manual.

Codes will be checked into CVS

Security Procedures GHE processing passes the software security check and meets

NESDIS OSPO security standards GHE has being tested in a separate test environment before

installation in an operational environment SIA will be performed for GHE before the system declares

operational

Documents will be under the CM control at OSPO G:\Common\ESPC Library


135

System Operational Readiness QA – Documentation

ESPC Operation Procedure has been developed for operators

Operation maintenance procedures have been developed to support O&M needs at OSPO, which include:Procedures for installation and buildRun procedures (includes normal and emergency

operations)Monitoring, diagnosis, and recovery proceduresProduct distribution proceduresInterpretation of error messagesSystem shutdown and startup procedures

SPSRB Required Docs Completed the draft User Manuals, System

Maintenance Manual, ATBDNeed be finalized before the GHE is operational


136

System Operational ReadinessArchive

Appended for future revisitCurrent, no formal archive requirement is identified

in the user request for global HE productThe CONUS HE from STAR is archived voluntarily at

NCAR for the NAME projectThe IPT will take initiative to discuss with users and

CLASS the possibility of archiving the HE products with NCDC/CLASS An initial request to archive global Hydro-

Estimator Rainfall product has be submitted to NCDC/CLASS through its online Advanced Tracking and Resource Tool (ATRAC)


137

System Operational ReadinessUser Readiness

Data AccessAll users have access to the test data that are

provided on the ESPC ftp siteftp://satepsanone.nesdis.noaa.gov/HydroEst/GHE/

NWS/HRC has been granted the access to DDS for the operational data, and will switch to pull data from STAR to ESPC DDS when the GHE declares operational.

NWS/AWIPS user has been receiving the HE/SPE data from DDS since 2002. The transition from GHE to HE is transparent to them.

NESDIS/SAB users have access to GHE McIDAS files through ADDE server


138


Acceptance of ProductHRC user has verified its capability to ingest the

global HE data in netCDF4 format, and is ready to use it when it is operationally available.

NWS/AWIPS users will continue getting the CONUS HE data in GRIB1 format The data be provided from GHE instead of HE. The transition is transparent – no change in format,

data coverage User evaluation of the product quality is ongoing

NESDIS/SAB is provided the global products in McIDAS, and has flexibility to view only CONUS or any other interested region. Evaluation for the global products is ongoing


139


TrainingUser manuals will be made available to all

usersHRC users

have used the experimental products from STAR for a long time, and no particular training is required at this point except the change of format

Test data has been provided to users, and feedbacks from users regarding the filename convention, and metadata have been addressed

SAB users Help to make changes to their scripts to use the GHE

files instead of HE files over CONUS.


140


Training (cont)NWS/AWIPS (OHD) users

Test data is provided for checking out any potential issue in preparing the future transition from GRIB1 to GRIB2.

The E2E test for GRIB2 is pending for the AWIPS testing schedule.

ESPC Operator Operations Procedure has been submitted for review

by the ESPC help desk Training will be scheduled for all four Crews, and

completed by the time the GHE is declared operational


System Operational ReadinessSummary

The system is ready for operations

The documentation will be complete by the time the GHE is officially declared operational (final touches need to be done to the documents)

The users are ready to receive and use the data

April 6, 2012 GHE Operational Readiness Review 141

142142



SummarySummary Limin Zhao

NESDIS/OSPO


144

SummarySummaryRisk and Actions have been reviewedRequirements and their Allocations have been

reviewedSystem Description and Test have been reviewedProducts Quality Readiness have been reviewedOperation Readiness has been reviewedUser Readiness has been reviewed


145

Next StepsNext Steps

Operational PhaseSPSRB Decision Briefing – April 18, 2012Operational Commencement – April 30, 2012


146

Open DiscussionOpen Discussion

The review is now open for free discussion


AppendixAppendix


GHE Unit TestPeter Keehn

NESDIS/STAR


GHE Unit TestTest Environment

The development and tests are performed on ghe2.nesdis.noaa.gov Linux 64-bit

The machine is located at OSPO2 quad core CPUs2.66 GHz8 GB memory200 GB additional disk spacegfortran version 4.1.2gcc version 4.1.2McIDAS version 2010.1

NetCDF and HDF5 were manually installedNetCDF version 4.1.3HDF5 version 1.8.6


GHE Unit TestTest Dataset

The system works off of the McIDAS data servers which provide real time data.GOES-E, GOES-W, METEOSAT, MTSAT,

INDOEX IR images (McIDAS format)GFS forecast models (McIDAS format)


GHE Unit TestTest Configuration

Define output locationsScripts/setup_ghe.shSrc/globalghe.incData/RESOLVE.SRV

Compile source codeRun ghe_build.sh in src/ directory and move

executables to bin/ directoryRun makefile in ghe_ncd_code/main directory

Load ghe_crontab into cron daemonApril 6, 2012 151GHE Operational Readiness Review

GHE Unit TestTest Items

The following are the main driver routines for the GHE systemsetupworld.sh (globalsetup.k)raingoesen.sh (goesen2011.k)raingoeses.sh (goeses2011.k)raingoeswn.sh (goeswn2011.k)raingoesws.sh (goesws2011.k)rainindia.sh (indoex2011.k)rainmeteo.sh (meteo2011.k)rainmtsat.sh (mtsat2011.k)globalmerge.shtransfergifs.shclean_up.sh

Create ancillary data files:precipitable waterrelative humidityorographic correctionequilibrium-level

adjustment




Get the most recent GOES IR image and calculate rain rates




Get the most recent INDOEX IR image and calculate rain rates




Get the most recent METEOSAT IR image and calculate rain rates




Get the most recent MTSAT IR image and calculate rain rates




Merge instantaneous rain rate images into a global image.

Generate global hourly (1, 3, 6) and daily (1-7) totals.




Generate GIF images and transfer to web server



The following are the main driver routines for the GHE systemsetupworld.sh (globalsetup.k)raingoesen.sh (goesen2011.k)raingoeses.sh (goeses2011.k)raingoeswn.sh (goeswn2011.k)raingoesws.sh (goesws2011.k)rainindia.sh (indoex2011.k)rainmeteo.sh (meteo2011.k)rainmtsat.sh (mtsat2011.k)globalmerge.shtransfergifs.shclean_up.sh Remove old files that are

no longer needed


GHE Unit Test Test Description

Each test will follow this scenarioDescribe the test itemShow scheduled execution times (cron

schedule)Show predefined McIDAS area numbers used

for intermediate and final outputShow directory listing of output files indicating

the file creation time is consistent with the scheduled execution time


GHE Unit Test setupworld.sh

setupworld.shRuns once every hourExecutes globalsetup.k

Create global PW and RH data files. Create global orographic correction data files. Create global equilibrium-level adjustment files

(every 3 hours).



Cron schedule for setupworld.shRuns at 3 minutes past the hour (every hour)

# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh



AREA and GRID numbers used for PW and RH data files

C #############################################################CC PW,RH routinesCC ############################################################# INTEGER, PARAMETER :: PWRH_GRID = 110 INTEGER, PARAMETER :: PWRH_AREA = 25 INTEGER, PARAMETER :: GLOBAL_PW = 26 INTEGER, PARAMETER :: GLOBAL_RH = 27 INTEGER, PARAMETER :: DEFAULT_PW = 31 INTEGER, PARAMETER :: DEFAULT_RH = 32



Listing of PW and RH data filesFile creation time is 3 minutes past the hour

[Pprecip@ghe2 ~/GHE/mcidas/data]$ll GRID0110 AREA0025 AREA0026 AREA0027-rw-r--r-- 1 Pprecip precip 262724 Feb 16 16:03 AREA0025-rw-r--r-- 1 Pprecip precip 263316 Feb 16 16:03 AREA0026-rw-r--r-- 1 Pprecip precip 263316 Feb 16 16:03 AREA0027-rw-r--r-- 1 Pprecip precip 1570876 Feb 16 16:03 GRID0110



AREA and GRID numbers used for orographic data files INTEGER, PARAMETER :: GLOBAL_OROG_GE = 20 INTEGER, PARAMETER :: GLOBAL_OROG_GW = 21 INTEGER, PARAMETER :: GLOBAL_OROG_MSG = 22 INTEGER, PARAMETER :: GLOBAL_OROG_IND = 23 INTEGER, PARAMETER :: GLOBAL_OROG_MTS = 24



Listing of orographic data filesFile creation time is ~3 minutes past the hour

[Pprecip@ghe2 ~/GHE/mcidas/data]$ll AREA002[0,1,2,3,4] GRID002[0,1,2,3,4]-rw-r--r-- 1 Pprecip precip 14400848 Feb 16 16:03 AREA0020-rw-r--r-- 1 Pprecip precip 14400848 Feb 16 16:03 AREA0021-rw-r--r-- 1 Pprecip precip 14400848 Feb 16 16:03 AREA0022-rw-r--r-- 1 Pprecip precip 14400848 Feb 16 16:03 AREA0023-rw-r--r-- 1 Pprecip precip 14400848 Feb 16 16:04 AREA0024-rw-r--r-- 1 Pprecip precip 522480 Feb 16 16:03 GRID0020-rw-r--r-- 1 Pprecip precip 522480 Feb 16 16:03 GRID0021-rw-r--r-- 1 Pprecip precip 522480 Feb 16 16:03 GRID0022-rw-r--r-- 1 Pprecip precip 522480 Feb 16 16:03 GRID0023-rw-r--r-- 1 Pprecip precip 522480 Feb 16 16:03 GRID0024



AREA, GRID, and MD numbers used for EQL data files

C #############################################################CC EQL routines (eqlgrdw.pgm, eqtry2011.pgm)CC ############################################################# CHARACTER*12, PARAMETER :: ELDATA = "gfsmodeldata" INTEGER, PARAMETER :: GRID_EQLEQLMOD = 29 INTEGER, PARAMETER :: MD_EQLIN = 29 INTEGER, PARAMETER :: MD_EQLOUT = 30

INTEGER, PARAMETER :: AREA_TEL = 80 INTEGER, PARAMETER :: AREA_EQLOUT = 81 INTEGER, PARAMETER :: AREA_TTROP1 = 82 INTEGER, PARAMETER :: AREA_TTROP2 = 83 INTEGER, PARAMETER :: AREA_TMERGE = 84 INTEGER, PARAMETER :: AREA_TFIX = 85 INTEGER, PARAMETER :: GLOBAL_EQL = 29



Listing of EQL data files

[Pprecip@ghe2 ~/GHE/mcidas/data]$ll ????0029 ????0030 AREA008[0,1,2,3,4,5]-rw-r--r-- 1 Pprecip precip 2536588 Feb 16 14:04 AREA0029-rw-r--r-- 1 Pprecip precip 2535404 Feb 16 14:04 AREA0080-rw-r--r-- 1 Pprecip precip 2536508 Feb 16 14:04 AREA0081-rw-r--r-- 1 Pprecip precip 3496236 Feb 16 14:04 AREA0082-rw-r--r-- 1 Pprecip precip 2535484 Feb 16 14:04 AREA0083-rw-r--r-- 1 Pprecip precip 2535404 Feb 16 14:04 AREA0084-rw-r--r-- 1 Pprecip precip 2535916 Feb 16 14:04 AREA0085-rw-r--r-- 1 Pprecip precip 24313848 Feb 16 14:04 GRID0029-rw-r--r-- 1 Pprecip precip 46872800 Feb 16 14:04 MDXX0029-rw-r--r-- 1 Pprecip precip 9920716 Feb 16 14:04 MDXX0030


GHE Unit Test raingoesen.sh

raingoesen.shRuns 4 times every hourExecutes goesen2011.k

Get most recent IR image. Remap to mercator projection Do zenith-angle and parallax corrections Get PW, RH, orography, and EQL for this sector Calculate rain rate Smooth rain image Save rain image



Cron schedule for raingoesen.shRuns at 1,16,31,46 past the hour (every hour)




AREA and GRID numbers used for GOES-E North data filesC #############################################################CC GOES-East North routine (goesen2011.pgm)CC #############################################################c area files for creating rain estimates INTEGER, PARAMETER :: GEN_IR = 100 INTEGER, PARAMETER :: GEN_ZEN = 101 INTEGER, PARAMETER :: GEN_PLAX = 102 INTEGER, PARAMETER :: GEN_PW = 103 INTEGER, PARAMETER :: GEN_RH = 104 INTEGER, PARAMETER :: GEN_EQL = 105 INTEGER, PARAMETER :: GEN_OROG = 106 INTEGER, PARAMETER :: GEN_RAIN = 107 INTEGER, PARAMETER :: GEN_SRAIN = 108

c stored global data INTEGER, PARAMETER :: GLOBAL_OROG_GE = 20

c grid file for parallax calculations INTEGER, PARAMETER :: GEN_GRID_PLAX = 103

c data directory CHARACTER*100, PARAMETER :: GOESEN_DIR = "/data/Pprecip/pkeehn/globalhe/goesen/"



Listing of GOES-E North data files[Pprecip@ghe2 ~/GHE/mcidas/data]$ll AREA010? GRID0103-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 18:46 AREA0100-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 18:46 AREA0101-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 18:46 AREA0102-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 18:46 AREA0103-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 18:46 AREA0104-rw-r--r-- 1 Pprecip precip 14402704 Feb 16 18:46 AREA0105-rw-r--r-- 1 Pprecip precip 14401168 Feb 16 18:46 AREA0106-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 18:46 AREA0107-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 18:46 AREA0108-rw-r--r-- 1 Pprecip precip 9918100 Feb 16 18:46 GRID0103

[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/goesen]$ll AREA8775-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 18:46 AREA8775


GHE Unit Test raingoeses.sh

raingoeses.shRuns 2 times every hourExecutes goeses2011.k




Cron schedule for raingoeses.shRuns at 19 and 49 past the hour (every hour)




AREA and GRID numbers used for GOES-E South data filesC #############################################################CC GOES-East South routine (goeses2011.pgm)CC #############################################################c area files for creating rain estimates INTEGER, PARAMETER :: GES_IR = 150 INTEGER, PARAMETER :: GES_ZEN = 151 INTEGER, PARAMETER :: GES_PLAX = 152 INTEGER, PARAMETER :: GES_PW = 153 INTEGER, PARAMETER :: GES_RH = 154 INTEGER, PARAMETER :: GES_EQL = 155 INTEGER, PARAMETER :: GES_OROG = 156 INTEGER, PARAMETER :: GES_RAIN = 157 INTEGER, PARAMETER :: GES_SRAIN = 158

c grid file for parallax calculations INTEGER, PARAMETER :: GES_GRID_PLAX = 105

c data directory CHARACTER*100, PARAMETER :: GOESES_DIR = "/data/Pprecip/pkeehn/globalhe/goeses/"



Listing of GOES-E South data files[Pprecip@ghe2 ~/GHE/mcidas/data]$ll AREA015? GRID0105-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 11:49 AREA0150-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 11:49 AREA0151-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 11:49 AREA0152-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 11:49 AREA0153-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 11:49 AREA0154-rw-r--r-- 1 Pprecip precip 14402704 Feb 16 11:49 AREA0155-rw-r--r-- 1 Pprecip precip 14401168 Feb 16 11:49 AREA0156-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 11:49 AREA0157-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 11:49 AREA0158-rw-r--r-- 1 Pprecip precip 9918100 Feb 16 11:49 GRID0105

[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/goeses]$ll AREA8747-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 11:49 AREA8747


GHE Unit Test raingoeswn.sh

raingoeswn.shRuns 4 times every hourExecutes goeswn2011.k




Cron schedule for raingoeswn.shRuns at 2, 17, 32, 47 past the hour (every hour)# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh



AREA and GRID numbers used for GOES-W North data filesC #############################################################CC GOES-West North routine (goeswn2011.pgm)CC #############################################################c area files for creating rain estimates INTEGER, PARAMETER :: GWN_IR = 110 INTEGER, PARAMETER :: GWN_ZEN = 111 INTEGER, PARAMETER :: GWN_PLAX = 112 INTEGER, PARAMETER :: GWN_PW = 113 INTEGER, PARAMETER :: GWN_RH = 114 INTEGER, PARAMETER :: GWN_EQL = 115 INTEGER, PARAMETER :: GWN_OROG = 116 INTEGER, PARAMETER :: GWN_RAIN = 117 INTEGER, PARAMETER :: GWN_SRAIN = 118

c stored global data INTEGER, PARAMETER :: GLOBAL_OROG_GW = 21

c grid file for parallax calculations INTEGER, PARAMETER :: GWN_GRID_PLAX = 104

c data directory CHARACTER*100, PARAMETER :: GOESWN_DIR = "/data/Pprecip/pkeehn/globalhe/goeswn/"



Listing of GOES-W North data files[Pprecip@ghe2 ~/GHE/mcidas/data]$ll AREA011? GRID0104-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 19:02 AREA0110-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 19:02 AREA0111-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 19:02 AREA0112-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 19:02 AREA0113-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 19:02 AREA0114-rw-r--r-- 1 Pprecip precip 14402704 Feb 16 19:02 AREA0115-rw-r--r-- 1 Pprecip precip 14401168 Feb 16 19:02 AREA0116-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 19:03 AREA0117-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 19:03 AREA0118-rw-r--r-- 1 Pprecip precip 9918100 Feb 16 19:02 GRID0104

[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/goeswn]$ll AREA8776-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 19:03 AREA8776


GHE Unit Test raingoesws.sh

raingoesws.shRuns 2 times every hourExecutes goesws2011.k




Cron schedule for raingoesws.shRuns at 3 and 33 past the hour (every hour)# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh



AREA and GRID numbers used for GOES-W South data filesC #############################################################CC GOES-west South routine (goesws2011.pgm)CC #############################################################c area files for creating rain estimates INTEGER, PARAMETER :: GWS_IR = 160 INTEGER, PARAMETER :: GWS_ZEN = 161 INTEGER, PARAMETER :: GWS_PLAX = 162 INTEGER, PARAMETER :: GWS_PW = 163 INTEGER, PARAMETER :: GWS_RH = 164 INTEGER, PARAMETER :: GWS_EQL = 165 INTEGER, PARAMETER :: GWS_OROG = 166 INTEGER, PARAMETER :: GWS_RAIN = 167 INTEGER, PARAMETER :: GWS_SRAIN = 168

c grid file for parallax calculations INTEGER, PARAMETER :: GWS_GRID_PLAX = 106

c data directory CHARACTER*100, PARAMETER :: GOESWS_DIR = "/data/Pprecip/pkeehn/globalhe/goesws/"



Listing of GOES-W South data files[Pprecip@ghe2 ~/GHE/mcidas/data]$ll AREA016? GRID0106-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 19:03 AREA0160-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 19:03 AREA0161-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 19:03 AREA0162-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 19:03 AREA0163-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 19:03 AREA0164-rw-r--r-- 1 Pprecip precip 14402704 Feb 16 19:03 AREA0165-rw-r--r-- 1 Pprecip precip 14401168 Feb 16 19:03 AREA0166-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 19:03 AREA0167-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 19:03 AREA0168-rw-r--r-- 1 Pprecip precip 9918100 Feb 16 19:03 GRID0106

[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/goesws]$ll AREA8776-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 19:03 AREA8776


GHE Unit Testrainindia.sh

rainindia.shRuns 2 times every hourExecutes indoex2011.k




Cron schedule for rainindia.shRuns at 14 and 44 past the hour (every hour)# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh



AREA and GRID numbers used for INDOEX data filesC #############################################################CC Meteosat-7 routine (indoex2011.pgm)CC #############################################################c area files for creating rain estimates INTEGER, PARAMETER :: IND_IR = 130 INTEGER, PARAMETER :: IND_ZEN = 131 INTEGER, PARAMETER :: IND_PLAX = 132 INTEGER, PARAMETER :: IND_PW = 133 INTEGER, PARAMETER :: IND_RH = 134 INTEGER, PARAMETER :: IND_EQL = 135 INTEGER, PARAMETER :: IND_OROG = 136 INTEGER, PARAMETER :: IND_RAIN = 137 INTEGER, PARAMETER :: IND_SRAIN = 138

c stored global data INTEGER, PARAMETER :: GLOBAL_OROG_IND = 23

c grid file for parallax calculations INTEGER, PARAMETER :: IND_GRID_PLAX = 100

c data directory CHARACTER*100, PARAMETER :: INDOEX_DIR = "/data/Pprecip/pkeehn/globalhe/india/"



Listing of INDOEX data files[Pprecip@ghe2 ~/GHE/mcidas/data]$ll AREA013? GRID0100-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 18:44 AREA0130-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 18:44 AREA0131-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 18:44 AREA0132-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 18:44 AREA0133-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 18:44 AREA0134-rw-r--r-- 1 Pprecip precip 14402704 Feb 16 18:44 AREA0135-rw-r--r-- 1 Pprecip precip 14401168 Feb 16 18:44 AREA0136-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 18:47 AREA0137-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 18:47 AREA0138-rw-r--r-- 1 Pprecip precip 9918100 Feb 16 18:44 GRID0100

[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/india]$ll AREA8775-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 18:47 AREA8775


GHE Unit Testrainmeteo.sh

rainmeteo.shRuns 4 times every hourExecutes meteo2011.k



GHE Unit Test rainmeteo.sh

Cron schedule for rainmeteo.shRuns at 11, 26, 41, 56 past the hour (every

hour)# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh



AREA and GRID numbers used for METEOSAT data filesC #############################################################CC Meteosat-9 routine (meteo2011.pgm)CC #############################################################c area files for creating rain estimates INTEGER, PARAMETER :: MSG_IR = 120 INTEGER, PARAMETER :: MSG_ZEN = 121 INTEGER, PARAMETER :: MSG_PLAX = 122 INTEGER, PARAMETER :: MSG_PW = 123 INTEGER, PARAMETER :: MSG_RH = 124 INTEGER, PARAMETER :: MSG_EQL = 125 INTEGER, PARAMETER :: MSG_OROG = 126 INTEGER, PARAMETER :: MSG_RAIN = 127 INTEGER, PARAMETER :: MSG_SRAIN = 128

c stored global data INTEGER, PARAMETER :: GLOBAL_OROG_MSG = 22

c grid file for parallax calculations INTEGER, PARAMETER :: MSG_GRID_PLAX = 101

c data directory CHARACTER*100, PARAMETER :: METEO_DIR = "/data/Pprecip/pkeehn/globalhe/meteo/"



Listing of METEOSAT data files[Pprecip@ghe2 ~/GHE/mcidas/data]$ll AREA012? GRID0101-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 19:11 AREA0120-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 19:11 AREA0121-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 19:11 AREA0122-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 19:11 AREA0123-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 19:11 AREA0124-rw-r--r-- 1 Pprecip precip 14402704 Feb 16 19:11 AREA0125-rw-r--r-- 1 Pprecip precip 14401168 Feb 16 19:11 AREA0126-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 19:13 AREA0127-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 19:13 AREA0128-rw-r--r-- 1 Pprecip precip 9918100 Feb 16 19:11 GRID0101

[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/meteo]$ll AREA8776-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 19:13 AREA8776


GHE Unit Testrainmtsat.sh

rainmtsat.shRuns 2 times every hourExecutes mtsat2011.k




Cron schedule for rainmtsat.shRuns at 5 and 35 past the hour (every hour)# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh



AREA and GRID numbers used for MTSAT data filesC #############################################################CC MTSAT routine (mtsat2011.pgm)CC #############################################################c area files for creating rain estimates INTEGER, PARAMETER :: MTS_IR = 140 INTEGER, PARAMETER :: MTS_ZEN = 141 INTEGER, PARAMETER :: MTS_PLAX = 142 INTEGER, PARAMETER :: MTS_PW = 143 INTEGER, PARAMETER :: MTS_RH = 144 INTEGER, PARAMETER :: MTS_EQL = 145 INTEGER, PARAMETER :: MTS_OROG = 146 INTEGER, PARAMETER :: MTS_RAIN = 147 INTEGER, PARAMETER :: MTS_SRAIN = 148

c stored global data INTEGER, PARAMETER :: GLOBAL_OROG_MTS = 24

c grid file for parallax calculations INTEGER, PARAMETER :: MTS_GRID_PLAX = 102

c data directory CHARACTER*100, PARAMETER :: MTSAT_DIR = "/data/Pprecip/pkeehn/globalhe/mtsat/"



Listing of MTSAT data files[Pprecip@ghe2 ~/GHE/mcidas/data]$ll AREA014? GRID0102-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 19:05 AREA0140-rw-r--r-- 1 Pprecip precip 14400928 Feb 16 19:05 AREA0141-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 19:05 AREA0142-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 19:05 AREA0143-rw-r--r-- 1 Pprecip precip 14402192 Feb 16 19:05 AREA0144-rw-r--r-- 1 Pprecip precip 14402704 Feb 16 19:05 AREA0145-rw-r--r-- 1 Pprecip precip 14401168 Feb 16 19:05 AREA0146-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 19:08 AREA0147-rw-r--r-- 1 Pprecip precip 14401360 Feb 16 19:08 AREA0148-rw-r--r-- 1 Pprecip precip 9918100 Feb 16 19:05 GRID0102

[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/mtsat]$ll AREA8775-rw-r--r-- 1 Pprecip precip 14401008 Feb 16 19:08 AREA8775


GHE Unit Testglobalmerge.sh

globalmerge.shRuns 4 times every hourMerges instantaneous rain rate images into a

global image for each previous ¼ hourCreate 1-hour rain totalCreate 1-hour rain total in NetCDF at top of hourCreate 3 and 6 hour rain totals at top of the hourCreate 1, 2, 3, 4, 5, 6, and 7 day rain totals at

1300Compress older image files



Cron schedule for globalmerge.shRuns at 4, 19, 34, 49 past the hour (every hour)# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh



Listing of instantaneous rain rate data files

[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world]$ll AREA182{1..8}-rw-r--r-- 1 Pprecip precip 48001600 Feb 17 06:04 AREA1821-rw-r--r-- 1 Pprecip precip 48001600 Feb 17 06:20 AREA1822-rw-r--r-- 1 Pprecip precip 48001600 Feb 17 06:35 AREA1823-rw-r--r-- 1 Pprecip precip 48001600 Feb 17 06:50 AREA1824-rw-r--r-- 1 Pprecip precip 48001600 Feb 17 07:04 AREA1825-rw-r--r-- 1 Pprecip precip 48001600 Feb 17 07:20 AREA1826-rw-r--r-- 1 Pprecip precip 48001600 Feb 17 07:35 AREA1827-rw-r--r-- 1 Pprecip precip 48001600 Feb 17 07:50 AREA1828



Listing of 1-hour rain total data files

[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world/1hour]$ll AREA182{1..8}-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 06:05 AREA1821-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 06:20 AREA1822-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 06:35 AREA1823-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 06:50 AREA1824-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 07:05 AREA1825-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 07:20 AREA1826-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 07:35 AREA1827-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 07:50 AREA1828



Listing of 1-hour rain total NetCDf data files

[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world/1hour]$ll *.nc-rw-r--r-- 1 Pprecip precip 576000728 Mar 9 06:05 NPR.GEO.GHE.v1.S20120690400.E20120690500.nc-rw-r--r-- 1 Pprecip precip 576000728 Mar 9 07:05 NPR.GEO.GHE.v1.S20120690500.E20120690600.nc-rw-r--r-- 1 Pprecip precip 576000728 Mar 9 08:05 NPR.GEO.GHE.v1.S20120690600.E20120690700.nc-rw-r--r-- 1 Pprecip precip 576000728 Mar 9 09:05 NPR.GEO.GHE.v1.S20120690700.E20120690800.nc-rw-r--r-- 1 Pprecip precip 576000728 Mar 9 10:05 NPR.GEO.GHE.v1.S20120690800.E20120690900.nc-rw-r--r-- 1 Pprecip precip 576000728 Mar 9 11:05 NPR.GEO.GHE.v1.S20120690900.E20120691000.nc




[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world/3hour]$ll AREA182{1..8}ls: AREA1822: No such file or directoryls: AREA1823: No such file or directoryls: AREA1824: No such file or directoryls: AREA1826: No such file or directoryls: AREA1827: No such file or directoryls: AREA1828: No such file or directory-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 06:05 AREA1821-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 07:05 AREA1825




[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world/6hour]$ll AREA182{1..8}ls: AREA1822: No such file or directoryls: AREA1823: No such file or directoryls: AREA1824: No such file or directoryls: AREA1826: No such file or directoryls: AREA1827: No such file or directoryls: AREA1828: No such file or directory-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 06:06 AREA1821-rw-r--r-- 1 Pprecip precip 48001760 Feb 17 07:05 AREA1825



Listing of 1-day rain total data files

[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world/24hour]$ll *-rw-r--r-- 1 Pprecip precip 48001680 Feb 9 14:06 AREA3040-rw-r--r-- 1 Pprecip precip 48001680 Feb 10 14:06 AREA3041-rw-r--r-- 1 Pprecip precip 48001680 Feb 11 14:06 AREA3042-rw-r--r-- 1 Pprecip precip 48001680 Feb 12 14:06 AREA3043-rw-r--r-- 1 Pprecip precip 48001680 Feb 13 14:06 AREA3044-rw-r--r-- 1 Pprecip precip 48001680 Feb 14 14:06 AREA3045-rw-r--r-- 1 Pprecip precip 48001680 Feb 15 14:06 AREA3046-rw-r--r-- 1 Pprecip precip 48001680 Feb 16 14:06 AREA3047-rw-r--r-- 1 Pprecip precip 48001680 Feb 17 14:06 AREA3048




[Pprecip@ghe2 /data/Pprecip/pkeehn/globalhe/world/2day]$ll *-rw-r--r-- 1 Pprecip precip 48001680 Feb 9 14:06 AREA3040-rw-r--r-- 1 Pprecip precip 48001680 Feb 10 14:06 AREA3041-rw-r--r-- 1 Pprecip precip 48001680 Feb 11 14:06 AREA3042-rw-r--r-- 1 Pprecip precip 48001680 Feb 12 14:06 AREA3043-rw-r--r-- 1 Pprecip precip 48001680 Feb 13 14:06 AREA3044-rw-r--r-- 1 Pprecip precip 48001680 Feb 14 14:06 AREA3045-rw-r--r-- 1 Pprecip precip 48001680 Feb 15 14:06 AREA3046-rw-r--r-- 1 Pprecip precip 48001680 Feb 16 14:06 AREA3047-rw-r--r-- 1 Pprecip precip 48001680 Feb 17 14:06 AREA3048


GHE Unit Testtransfergifs.sh

transfergifs.shRuns once every hourExecutes makeheworldgifs.shExecutes makehenamgifs.shTransfers GIF images to web page

Not implemented on test machine



Cron schedule for transfergifs.shRuns at 20 minutes past the hour (every hour)# field allowed values# ----- --------------# minute 0-59# hour 0-23# day of month 1-31# month 1-12 (or names, see below)# day of week 0-7 (0 or 7 is Sun, or use names)#3 * * * * /home/Pprecip/GHE/mcidas/scripts/setupworld.sh14,44 * * * * /home/Pprecip/GHE/mcidas/scripts/rainindia.sh11,26,41,56 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmeteo.sh5,35 * * * * /home/Pprecip/GHE/mcidas/scripts/rainmtsat.sh1,16,31,46 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesen.sh19,49 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeses.sh2,17,32,47 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoeswn.sh3,33 * * * * /home/Pprecip/GHE/mcidas/scripts/raingoesws.sh4,19,34,49 * * * * /home/Pprecip/GHE/mcidas/scripts/globalmerge.sh20 * * * * /home/Pprecip/GHE/mcidas/scripts/transfergifs.sh55 23 * * * /home/Pprecip/GHE/mcidas/scripts/clean_up.sh



Listing of instantaneous world GIF images

[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t GHE_INST_2012047_*-rw-r--r-- 1 Pprecip precip 28118 Feb 17 00:20 GHE_INST_2012047_231500.GIF-rw-r--r-- 1 Pprecip precip 30011 Feb 17 00:20 GHE_INST_2012047_233000.GIF-rw-r--r-- 1 Pprecip precip 20289 Feb 17 00:20 GHE_INST_2012047_234500.GIF-rw-r--r-- 1 Pprecip precip 28386 Feb 16 23:20 GHE_INST_2012047_221500.GIF-rw-r--r-- 1 Pprecip precip 30454 Feb 16 23:20 GHE_INST_2012047_223000.GIF-rw-r--r-- 1 Pprecip precip 23173 Feb 16 23:20 GHE_INST_2012047_224500.GIF-rw-r--r-- 1 Pprecip precip 28236 Feb 16 23:20 GHE_INST_2012047_230000.GIF-rw-r--r-- 1 Pprecip precip 26079 Feb 16 22:20 GHE_INST_2012047_211500.GIF-rw-r--r-- 1 Pprecip precip 27416 Feb 16 22:20 GHE_INST_2012047_213000.GIF-rw-r--r-- 1 Pprecip precip 23161 Feb 16 22:20 GHE_INST_2012047_214500.GIF-rw-r--r-- 1 Pprecip precip 28265 Feb 16 22:20 GHE_INST_2012047_220000.GIF-rw-r--r-- 1 Pprecip precip 28138 Feb 16 21:20 GHE_INST_2012047_201500.GIF-rw-r--r-- 1 Pprecip precip 27145 Feb 16 21:20 GHE_INST_2012047_203000.GIF-rw-r--r-- 1 Pprecip precip 15167 Feb 16 21:20 GHE_INST_2012047_204500.GIF-rw-r--r-- 1 Pprecip precip 15155 Feb 16 21:20 GHE_INST_2012047_210000.GIF



Listing of 1-hour world GIF images[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t GHE_1HOUR_2012047_*-rw-r--r-- 1 Pprecip precip 32811 Feb 16 23:20 GHE_1HOUR_2012047_230000.GIF-rw-r--r-- 1 Pprecip precip 33577 Feb 16 22:20 GHE_1HOUR_2012047_220000.GIF-rw-r--r-- 1 Pprecip precip 29872 Feb 16 21:20 GHE_1HOUR_2012047_210000.GIF-rw-r--r-- 1 Pprecip precip 32142 Feb 16 20:20 GHE_1HOUR_2012047_200000.GIF-rw-r--r-- 1 Pprecip precip 34265 Feb 16 19:20 GHE_1HOUR_2012047_190000.GIF-rw-r--r-- 1 Pprecip precip 32357 Feb 16 18:20 GHE_1HOUR_2012047_180000.GIF-rw-r--r-- 1 Pprecip precip 32531 Feb 16 17:20 GHE_1HOUR_2012047_170000.GIF-rw-r--r-- 1 Pprecip precip 33538 Feb 16 16:20 GHE_1HOUR_2012047_160000.GIF-rw-r--r-- 1 Pprecip precip 31906 Feb 16 15:20 GHE_1HOUR_2012047_150000.GIF-rw-r--r-- 1 Pprecip precip 32218 Feb 16 14:20 GHE_1HOUR_2012047_140000.GIF-rw-r--r-- 1 Pprecip precip 34012 Feb 16 13:20 GHE_1HOUR_2012047_130000.GIF-rw-r--r-- 1 Pprecip precip 32424 Feb 16 12:20 GHE_1HOUR_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 32475 Feb 16 11:20 GHE_1HOUR_2012047_110000.GIF-rw-r--r-- 1 Pprecip precip 32174 Feb 16 10:20 GHE_1HOUR_2012047_100000.GIF-rw-r--r-- 1 Pprecip precip 31895 Feb 16 09:20 GHE_1HOUR_2012047_90000.GIF-rw-r--r-- 1 Pprecip precip 32294 Feb 16 08:20 GHE_1HOUR_2012047_80000.GIF-rw-r--r-- 1 Pprecip precip 33940 Feb 16 07:20 GHE_1HOUR_2012047_70000.GIF-rw-r--r-- 1 Pprecip precip 32402 Feb 16 06:20 GHE_1HOUR_2012047_60000.GIF-rw-r--r-- 1 Pprecip precip 32913 Feb 16 05:20 GHE_1HOUR_2012047_50000.GIF-rw-r--r-- 1 Pprecip precip 33957 Feb 16 04:20 GHE_1HOUR_2012047_40000.GIF-rw-r--r-- 1 Pprecip precip 32829 Feb 16 03:20 GHE_1HOUR_2012047_30000.GIF-rw-r--r-- 1 Pprecip precip 33460 Feb 16 02:20 GHE_1HOUR_2012047_20000.GIF-rw-r--r-- 1 Pprecip precip 35446 Feb 16 01:20 GHE_1HOUR_2012047_10000.GIF-rw-r--r-- 1 Pprecip precip 33820 Feb 16 00:20 GHE_1HOUR_2012047_0.GIFApril 6, 2012 214GHE Operational Readiness Review


Listing of 1-day world GIF images

[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t GHE_1DAY_*-rw-r--r-- 1 Pprecip precip 59469 Feb 17 14:20 GHE_1DAY_2012048_120000.GIF-rw-r--r-- 1 Pprecip precip 59866 Feb 17 13:20 GHE_1DAY_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 56836 Feb 16 13:20 GHE_1DAY_2012046_120000.GIF-rw-r--r-- 1 Pprecip precip 58012 Feb 15 13:20 GHE_1DAY_2012045_120000.GIF-rw-r--r-- 1 Pprecip precip 58324 Feb 14 13:20 GHE_1DAY_2012044_120000.GIF-rw-r--r-- 1 Pprecip precip 59896 Feb 13 13:20 GHE_1DAY_2012043_120000.GIF



Listing of instantaneous N. Amer. GIF images

[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t NAMHE_INST_2012047_*-rw-r--r-- 1 Pprecip precip 25788 Feb 17 00:20 NAMHE_INST_2012047_234500.GIF-rw-r--r-- 1 Pprecip precip 31537 Feb 16 23:20 NAMHE_INST_2012047_224500.GIF-rw-r--r-- 1 Pprecip precip 31338 Feb 16 23:20 NAMHE_INST_2012047_230000.GIF-rw-r--r-- 1 Pprecip precip 31068 Feb 16 22:20 NAMHE_INST_2012047_214500.GIF-rw-r--r-- 1 Pprecip precip 31432 Feb 16 22:20 NAMHE_INST_2012047_220000.GIF-rw-r--r-- 1 Pprecip precip 16797 Feb 16 21:20 NAMHE_INST_2012047_204500.GIF-rw-r--r-- 1 Pprecip precip 16791 Feb 16 21:20 NAMHE_INST_2012047_210000.GIF-rw-r--r-- 1 Pprecip precip 30207 Feb 16 20:20 NAMHE_INST_2012047_194500.GIF-rw-r--r-- 1 Pprecip precip 32676 Feb 16 20:20 NAMHE_INST_2012047_200000.GIF-rw-r--r-- 1 Pprecip precip 29514 Feb 16 19:20 NAMHE_INST_2012047_184500.GIF-rw-r--r-- 1 Pprecip precip 29904 Feb 16 19:20 NAMHE_INST_2012047_190000.GIF



Listing of 1-hour N. Amer. GIF images[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t NAMHE_1HOUR_2012047_*-rw-r--r-- 1 Pprecip precip 31999 Feb 16 23:20 NAMHE_1HOUR_2012047_230000.GIF-rw-r--r-- 1 Pprecip precip 31737 Feb 16 22:20 NAMHE_1HOUR_2012047_220000.GIF-rw-r--r-- 1 Pprecip precip 31392 Feb 16 21:20 NAMHE_1HOUR_2012047_210000.GIF-rw-r--r-- 1 Pprecip precip 30610 Feb 16 20:20 NAMHE_1HOUR_2012047_200000.GIF-rw-r--r-- 1 Pprecip precip 30154 Feb 16 19:20 NAMHE_1HOUR_2012047_190000.GIF-rw-r--r-- 1 Pprecip precip 28691 Feb 16 18:20 NAMHE_1HOUR_2012047_180000.GIF-rw-r--r-- 1 Pprecip precip 28141 Feb 16 17:20 NAMHE_1HOUR_2012047_170000.GIF-rw-r--r-- 1 Pprecip precip 28992 Feb 16 16:20 NAMHE_1HOUR_2012047_160000.GIF-rw-r--r-- 1 Pprecip precip 27461 Feb 16 15:20 NAMHE_1HOUR_2012047_150000.GIF-rw-r--r-- 1 Pprecip precip 28398 Feb 16 14:20 NAMHE_1HOUR_2012047_140000.GIF-rw-r--r-- 1 Pprecip precip 29672 Feb 16 13:20 NAMHE_1HOUR_2012047_130000.GIF-rw-r--r-- 1 Pprecip precip 28200 Feb 16 12:20 NAMHE_1HOUR_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 28667 Feb 16 11:20 NAMHE_1HOUR_2012047_110000.GIF-rw-r--r-- 1 Pprecip precip 29772 Feb 16 10:20 NAMHE_1HOUR_2012047_100000.GIF-rw-r--r-- 1 Pprecip precip 27730 Feb 16 09:20 NAMHE_1HOUR_2012047_90000.GIF-rw-r--r-- 1 Pprecip precip 28204 Feb 16 08:20 NAMHE_1HOUR_2012047_80000.GIF-rw-r--r-- 1 Pprecip precip 28537 Feb 16 07:20 NAMHE_1HOUR_2012047_70000.GIF-rw-r--r-- 1 Pprecip precip 26832 Feb 16 06:20 NAMHE_1HOUR_2012047_60000.GIF-rw-r--r-- 1 Pprecip precip 26801 Feb 16 05:20 NAMHE_1HOUR_2012047_50000.GIF-rw-r--r-- 1 Pprecip precip 26744 Feb 16 04:20 NAMHE_1HOUR_2012047_40000.GIF-rw-r--r-- 1 Pprecip precip 25476 Feb 16 03:20 NAMHE_1HOUR_2012047_30000.GIF-rw-r--r-- 1 Pprecip precip 24787 Feb 16 02:20 NAMHE_1HOUR_2012047_20000.GIF-rw-r--r-- 1 Pprecip precip 25067 Feb 16 01:20 NAMHE_1HOUR_2012047_10000.GIF-rw-r--r-- 1 Pprecip precip 23789 Feb 16 00:20 NAMHE_1HOUR_2012047_0.GIFApril 6, 2012 225GHE Operational Readiness Review


Listing of 1-day N. Amer. GIF images

[Pprecip@ghe2 ~/GHE/mcidas/gifs]$ll -t NAMHE_1DAY_*-rw-r--r-- 1 Pprecip precip 50131 Feb 17 14:20 NAMHE_1DAY_2012048_120000.GIF-rw-r--r-- 1 Pprecip precip 39105 Feb 17 13:20 NAMHE_1DAY_2012047_120000.GIF-rw-r--r-- 1 Pprecip precip 31013 Feb 16 13:20 NAMHE_1DAY_2012046_120000.GIF-rw-r--r-- 1 Pprecip precip 31486 Feb 15 13:20 NAMHE_1DAY_2012045_120000.GIF-rw-r--r-- 1 Pprecip precip 36092 Feb 14 13:20 NAMHE_1DAY_2012044_120000.GIF-rw-r--r-- 1 Pprecip precip 39398 Feb 13 13:20 NAMHE_1DAY_2012043_120000.GIF


GHE Unit Testclean_up.sh

clean_up.shRuns once every dayRemoves old log filesRemoves old AREA filesRemoves old NetCDF filesTrims the monitoring tools status files



Cron schedule for clean_up.shRuns at 23:55 every day




log file directory size and listing of files older than 8 days (note: no files older than 8 days)[Pprecip@ghe2 ~/GHE/mcidas]$du -s --si logs/; find logs/ -mtime +8119M logs/[Pprecip@ghe2 ~/GHE/mcidas]$



data file directory size and listing of files older than 8 days (note: no files older than 8 days)[Pprecip@ghe2 ~/GHE/mcidas]$du -s --si /data/Pprecip/pkeehn/globalhe/; find /data/Pprecip/pkeehn/globalhe/ -mtime +847G /data/Pprecip/pkeehn/globalhe//data/Pprecip/pkeehn/globalhe/[Pprecip@ghe2 ~/GHE/mcidas]$



Sample status file showing first 3 (oldest) and last 3 (newest) lines of text (note: first and last line of file show a date range of 8 days – 2012-02-09 to 2012-02-17)

[Pprecip@ghe2 ~/GHE/mcidas/monitoring]$date;\> head -3 raingoesen.status;\> echo " - - - - - ";\> tail -3 raingoesen.statusFri Feb 17 15:34:57 UTC 201220120209000101 20120209001512 S /home/Pprecip/GHE/mcidas/logs/raingoesen_20120209_000101.log successful completion20120209001601 20120209001602 W /home/Pprecip/GHE/mcidas/logs/raingoesen_20120209_001601.log detected warning msg. in log file20120209003101 20120209003317 S /home/Pprecip/GHE/mcidas/logs/raingoesen_20120209_003101.log successful completion - - - - -20120217150101 20120217151348 S /home/Pprecip/GHE/mcidas/logs/raingoesen_20120217_150101.log successful completion20120217151601 20120217151602 W /home/Pprecip/GHE/mcidas/logs/raingoesen_20120217_151601.log detected warning msg. in log file20120217153101 20120217153237 S /home/Pprecip/GHE/mcidas/logs/raingoesen_20120217_153101.log successful completion


GHE Unit TestTiming Information

Average run timesetupworld.sh 1:08s (n=141)raingoesen.sh 3:04s (n=741)raingoeses.sh 0:34s (n=299)raingoeswn.sh 3:03s (n=739)raingoesws.sh 0:45s (n=332)rainindia.sh 3:20s (n=380)rainmeteo.sh 2:22s (n=801)rainmtsat.sh 2:53s (n=416)globalmerge.sh 2:30s (n=837)transfergifs.sh 0:05s (n=210)clean_up.sh 0:19s (n=8)
