broadening volcanic eruption forecasting using transfer

39
Broadening volcanic eruption forecasting using transfer machine learning. David Dempsey 1 Martin Letourneur 1 Shane Cronin 2 Andreas Kempa-Liehr 2 1 University of Canterbury 2 University of Auckland New Zealand [email protected] @DavidEDempsey eruption

Upload: others

Post on 10-Apr-2022

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Broadening volcanic eruption forecasting using transfer

Broadening volcanic eruption forecasting using transfer machine learning.

David Dempsey1

Martin Letourneur1

Shane Cronin2

Andreas Kempa-Liehr2

1University of Canterbury2University of AucklandNew Zealand

[email protected]@DavidEDempsey

eruption

Page 2: Broadening volcanic eruption forecasting using transfer

On 9 Dec 2019, Whakaari (White Island) erupted suddenly, killing 21 people. It was the 5th eruption in ten years.

[still footage provided to thespinoff.co.nz]

WSRZ

Page 3: Broadening volcanic eruption forecasting using transfer

At present, a Volcano Alert Level (VAL) is determined through expert consensus. This could be complemented with real-time forecasting.

[Potter et al., JAV, 2014]

Whakaari was at VAL 2 before

2019 eruption.

Page 4: Broadening volcanic eruption forecasting using transfer

average

max

gradient

Fourier coefficients

total energy

𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑

# peaks

We developed a short-term alert system that picks 4 out of 5 eruptions with good accuracy.

Page 5: Broadening volcanic eruption forecasting using transfer

We developed a short-term alert system that picks 4 out of 5 eruptions with good accuracy.

Page 6: Broadening volcanic eruption forecasting using transfer

model output is a “degree of concern”

We developed a short-term alert system that picks 4 out of 5 eruptions with good accuracy.

Page 7: Broadening volcanic eruption forecasting using transfer

requires a threshold to trigger an alert

We developed a short-term alert system that picks 4 out of 5 eruptions with good accuracy.

Page 8: Broadening volcanic eruption forecasting using transfer

Goal: broaden forecasting ability to other seismometers

WSRZ

Page 9: Broadening volcanic eruption forecasting using transfer

Goal: broaden forecasting ability to other seismometers and other volcanoes.

WSRZ

Te Ara (2006)

Page 10: Broadening volcanic eruption forecasting using transfer

1. The missing data problem. Records at WIZ and WSRZ have gaps.

2. The data comparison problem. WIZ and WSRZ record the same(ish) signal, but at different amplitudes.

3. The generalisation problem. Ruapehu has fewer recorded eruptions – what can be transferred from the Whakaari forecaster?

Page 11: Broadening volcanic eruption forecasting using transfer

1. The missing data problem. Records at WIZ and WSRZ have gaps.

2. The data comparison problem. WIZ and WSRZ record the same(ish) signal, but at different amplitudes.

3. The generalisation problem. Ruapehu has fewer recorded eruptions – what can be transferred from the Whakaari forecaster?

Page 12: Broadening volcanic eruption forecasting using transfer

WSRZ not operating during 2012 eruption and had outages before Oct 2013 eruption.

outage just prior to eruption

outage eruption

WSRZ

WIZ

Page 13: Broadening volcanic eruption forecasting using transfer

average

max

gradient

Fourier coefficients

total energy

𝑑𝑑𝑑𝑑𝑑𝑑𝑑𝑑

# peaks

Gap-filling: regression of concurrent pre-eruption features then stochastic interpolation.

Page 14: Broadening volcanic eruption forecasting using transfer

Gap-filling: regression of concurrent pre-eruption features then stochastic interpolation.

Page 15: Broadening volcanic eruption forecasting using transfer

Gap-filling: regression of concurrent pre-eruptionfeatures then stochastic interpolation.

Page 16: Broadening volcanic eruption forecasting using transfer

Gap-filling: regression of concurrent pre-eruption features then stochastic interpolation.

Page 17: Broadening volcanic eruption forecasting using transfer

Gap-filling: regression of concurrent pre-eruption features then stochastic interpolation.

Page 18: Broadening volcanic eruption forecasting using transfer

Gap-filling: regression of concurrent pre-eruption features then stochastic interpolation.

Page 19: Broadening volcanic eruption forecasting using transfer

Gap-filling: regression of concurrent pre-eruption features then stochastic interpolation.

Page 20: Broadening volcanic eruption forecasting using transfer

A WSRZ forecast model trained using gap-filling performs about as well as the WIZ model trained on all the data.

eruption

← WSRZ with gap-fillBest score: 0.83

Page 21: Broadening volcanic eruption forecasting using transfer

eruption

← WSRZ with gap-fill

← original WIZ

Best score: 0.83

Best score: 0.9

A WSRZ forecast model trained using gap-filling performs about as well as the WIZ model trained on all the data.

Page 22: Broadening volcanic eruption forecasting using transfer

eruptionWSRZ with gap-fill →

original WIZ →

Best score: 0.94

Best score: 0.94

A WSRZ forecast model trained using gap-filling performs about as well as the WIZ model trained on all the data.

Page 23: Broadening volcanic eruption forecasting using transfer

1. The missing data problem. Records at WIZ and WSRZ have gaps.

2. The data comparison problem. WIZ and WSRZ record the same(ish) signal, but at different amplitudes.

3. The generalisation problem. Ruapehu has fewer recorded eruptions – what can be transferred from the Whakaari forecaster?

Page 24: Broadening volcanic eruption forecasting using transfer

It would be better if there were some universal standardthat signals could be transformed back to.

Page 25: Broadening volcanic eruption forecasting using transfer

The raw data are somewhat log-normally distributed

Page 26: Broadening volcanic eruption forecasting using transfer

The raw data are somewhat log-normally distributed, so we used a log unit-normal transformation.

Page 27: Broadening volcanic eruption forecasting using transfer

The result is improved (if still imperfect) overlap between the signals.

[10-3] [10-3]

Page 28: Broadening volcanic eruption forecasting using transfer

Models trained on standardized signals perform about as well on the out-of-sample eruptions used for testing.

eruption

original forecast

Page 29: Broadening volcanic eruption forecasting using transfer

Models trained on standardized signals perform about as well on the out-of-sample eruptions used for testing.

eruption

original forecast

with standardized data…

Page 30: Broadening volcanic eruption forecasting using transfer

Models trained on standardized signals perform about as well on the out-of-sample eruptions used for testing.

eruption

original forecast

with standardized data……and regional EQs removed

Page 31: Broadening volcanic eruption forecasting using transfer

1. The missing data problem. Records at WIZ and WSRZ have gaps.

2. The data comparison problem. WIZ and WSRZ record the same(ish) signal, but at different amplitudes.

3. The generalisation problem. Ruapehu has fewer recorded eruptions – what can be transferred from the Whakaari forecaster?

Page 32: Broadening volcanic eruption forecasting using transfer

Standardise and merge data records for different volcanoes. Naively train and test forecast models.

10 years of standardized RSAM data

Five eruptions (2012, 2ב13, ‘16, ‘19)

7300 windows, 20 pre-eruption

Whakaari

Page 33: Broadening volcanic eruption forecasting using transfer

10 years of standardized RSAM data

Five eruptions (2012, 2ב13, ‘16, ‘19)

7300 windows, 20 pre-eruption

Whakaari

TRAIN TEST

Standardise and merge data records for different volcanoes. Naively train and test forecast models.

Page 34: Broadening volcanic eruption forecasting using transfer

10 years of standardized RSAM data

Five eruptions (2012, 2ב13, ‘16, ‘19)

7300 windows, 20 pre-eruption

Whakaari

15 years of standardized RSAM data

Two eruptions (2006, 2007)

11 000 windows, 8 pre-eruption

Ruapehu

Standardise and merge data records for different volcanoes. Naively train and test forecast models.

Page 35: Broadening volcanic eruption forecasting using transfer

10 years of standardized RSAM data

Five eruptions (2012, 2ב13, ‘16, ‘19)

7300 windows, 20 pre-eruption

Whakaari

15 years of standardized RSAM data

Two eruptions (2006, 2007)

11 000 windows, 8 pre-eruption

Ruapehu TRAIN

TEST

Standardise and merge data records for different volcanoes. Naively train and test forecast models.

Page 36: Broadening volcanic eruption forecasting using transfer

25 years of standardized RSAM data

Seven eruptions (2006, ‘07, ‘12, 2ב13, ‘16, ‘19)

19 000 windows, 28 pre-eruption

Whakaari-Ruapehu

Standardise and merge data records for different volcanoes. Naively train and test forecast models.

Page 37: Broadening volcanic eruption forecasting using transfer

25 years of standardized RSAM data

Seven eruptions (2006, ‘07, ‘12, 2ב13, ‘16, ‘19)

19 000 windows, 28 pre-eruption

Whakaari-Ruapehu

TRAIN TEST

Standardise and merge data records for different volcanoes. Naively train and test forecast models.

Page 38: Broadening volcanic eruption forecasting using transfer

25 years of standardized RSAM data

Seven eruptions (2006, ‘07, ‘12, 2ב13, ‘16, ‘19)

19 000 windows, 28 pre-eruption

Whakaari-Ruapehu

40 years of standardized RSAM data

Nine eruptions (2006, ‘07, 3ב12, 2ב13, ‘16, ‘19)

29 000 windows, 36 pre-eruption

Whakaari-Ruapehu-Tongariro

(coming soon)

Standardise and merge data records for different volcanoes. Naively train and test forecast models.

Page 39: Broadening volcanic eruption forecasting using transfer

More details in:

Dempsey, D. E., S. J. Cronin, S. Mei, and A. W. Kempa-Liehr. "Automatic precursor recognition and real-time forecasting of sudden explosive volcanic eruptions at Whakaari, New Zealand." Nature communications 11, no. 1 (2020): 1-8.

Thanks for watching.

We are addressing the “not enough data” problem in forecasting, using:

• feature interpolation to fill in network gaps,

• data standardization,

• transfer-learning for multi-volcano models.