technical interchange meeting – roc / nssl / ncar roc / nssl / ncar tim boulder co 11 may 2005...

70
Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier (REC) for clutter detection in ORDA Mike Dixon NCAR

Upload: martina-horn

Post on 18-Jan-2016

219 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Technical Interchange Meeting – ROC / NSSL / NCAR

ROC / NSSL / NCAR TIM

Boulder CO

11 May 2005

Real-time time-series implementationof the Radar Echo Classifier (REC)

for clutter detection in ORDA

Mike Dixon

NCAR

Page 2: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Goal

The goal was to develop and test a version of the REC with the following properties:

• Fast and efficient for real-time operation, suitable for use in the

ORDA.

• Works with time series data, so that the algorithm has access to the

spectral domain.

• Is suitable for detecting clutter and AP.

Page 3: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Beam processing sequence

Beam 1 Beam 2 Beam3 Beam 4 Beam 5

IN

OutBeam Queue

ComputeMoments

ComputeMoments

ComputeMoments

ComputeMoments

ComputeMoments

ComputeREC

FilterClutter

FilteredMoments out

Page 4: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

REC for clutter or AP detection

• Kernel: 5 deg wide, 2 km along the beam.

• Uses the following fields:

– TDBZ - DBZ texture: squared change in dBZ from one gate to the next,

in range, averaged over the kernel.

– SPIN - DBZ ‘spin’: measure of how frequently the trend in reflectivity

along a beam changes with range. Averaged over the kernel.

– VEL: velocity at the gate.

– SDVE: standard deviation of velocity over the kernel.

– WIDTH: spectrum width at the gate.

– CLUTPROB: clutter probability, based on ratios of power near 0 m/s to

power in rest of spectrum.

Page 5: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Membership functions

0 45 1000

1

0

TDBZ SPIN

0 50 100

0

1

0 3.2

1

0

WIDTH

0 0.7

SDVE

0

1

VEL

-2.3 0 2.3

0

1

0 3 15

CLUTPROB

0

1

Page 6: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Data sets

This implementation of the REC was developed to handle time-series data in LIRP format. It was tested on the following data sets:

• KJIM, stratiform situation, non-phase-coded.

• SPOL at Boulder, convective situation, phase-coded.

• SPOL at NAME, Mexico, convective situation, non-phase-coded,

alternating-pulse dual-polarization.

Page 7: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM Case

• Non-phase-coded data

• Stratiform rain to NW

• Ground clutter

Page 8: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM dBZ

Page 9: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM Vel

Page 10: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM WIDTH

Page 11: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM TDBZ

Page 12: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM SPIN

Page 13: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM SDVE

Page 14: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM Clutter Probability

Page 15: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM REC

Page 16: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM Clutter Flag

Page 17: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM dBZ

Page 18: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM dBZ filtered

Page 19: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM VEL

Page 20: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM VEL filtered

Page 21: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM WIDTH

Page 22: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM WIDTH filtered

Page 23: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM filter everywhere

Page 24: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM dBZ

Page 25: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM dBZ filtered everywhere

Page 26: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM vel

Page 27: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

KJIM vel filtered everywhere

Page 28: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

SZ Case - SPOL

• SZ864 decoding

• Strong mountain ground clutter

• Convective weather situation

Page 29: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

SZ dBZ

Page 30: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

SZ VEL

Page 31: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

SZ WIDTH

Page 32: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

SZ Trip flags

Page 33: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

SZ TDBZ

Page 34: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

SZ SPIN

Page 35: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

SZ SDVE

Page 36: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

SZ REC

Page 37: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

SZ REC Clutter Flag

Page 38: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

SZ Clutter found

Page 39: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

SZ dBZ

Page 40: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

SZ dBZ filtered

Page 41: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

SZ VEL

Page 42: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

SZ VEL filtered

Page 43: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

SZ WIDTH

Page 44: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

SZ WIDTH filtered

Page 45: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Dual Polarization Case – SPOL at NAME

• Alternate-pulse dual polarization

• Strong ground clutter

• Some sea clutter at times

• Convective weather situation

Page 46: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Additional REC fields for Dual Pol

The following fields were added to the REC for the dual

polarization case:

– RHOHV – value at the gate.

– SD-ZDR – standard deviation of ZDR in range,

computed for the single beam only, no azimuth

averaging.

– SD-RHOHV – standard deviation of RHOHV in range,

computed for the single beam only, no azimuth

averaging.

Page 47: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Membership functions – Dual Pol

0 0.8 0.95

1

0

RHOHV

0 2 3

1

0

SD-ZDR

0 0.02 0.03

1

0

SD-RHOHV

Page 48: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Dual-pol dBZ

Page 49: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Dual-pol VEL

Page 50: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Dual-pol WIDTH

Page 51: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Dual-pol TDBZ

Page 52: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Dual-pol SPIN

Page 53: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Dual-pol SDVE

Page 54: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Dual-pol ZDR

Page 55: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Dual-pol SDZDR

Page 56: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Dual-pol RHOHV

Page 57: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Dual-pol SD-RHOHV

Page 58: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

REC – no dual-pol fields

Page 59: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

REC with dual pol fields

Page 60: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

REC FLAG – no dual-pol fields

Page 61: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

REC FLAG with dual pol fields

Page 62: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Dual-pol Clutter found

Page 63: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Dual-pol dBZ

Page 64: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Dual-pol dBZ filtered

Page 65: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Dual-pol VEL

Page 66: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Dual-pol Vel filtered

Page 67: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Dual-pol WIDTH

Page 68: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Dual-pol WIDTH filtered

Page 69: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Relative performance considerations

Some tests were carried out on the computer time taken by the REC and clutter filtering as compared to moments estimation.

The following table shows the number of seconds taken to compute moments, REC and filter clutter for a single PPI for each of the cases. The test machine was a 2.8GHz Pentium IV.

These numbers are useful to show the relative costs of each operation.

KJIM, filter only where

REC > thresh

KJIM, filter clutter everywhere

SZ, filteronly where REC > thresh

Dual Pol, filter only where REC > thresh

Moments estimation

3.18 3.18 9.58 8.23

REC computation

0.53 0.53 1.16 0.54

Clutter filtering

2.37 9.89 2.89 1.35

Page 70: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier

Further work

• Clutter filtering – handling residual power.• SZ clutter filtering.• Tuning the REC for dual polarization data.• Pattern matching for spectra in range (NESPA,

NIMA).

Thank you