modeling in aquatic environment · modeling in aquatic environment ... gsm ftp http / https ......

31
30.11.2016 Timo Huttula, Finnish Environment Institute 1 Modeling in aquatic environment Lecture 10 Data assimilation and data fusion in models Timo Huttula, Akiko Mano and Takayuki Shuku [email protected] http://www.ymparisto.fi/syke/jyvaskyla

Upload: truongtuyen

Post on 13-May-2018

216 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

30.11.2016 Timo Huttula, FinnishEnvironment Institute

1

Modeling in aquatic environmentLecture 10

Data assimilation and data fusion in models

Timo Huttula, Akiko Mano and Takayuki Shuku

[email protected]

http://www.ymparisto.fi/syke/jyvaskyla

Page 2: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Hydrological expertise in Finland Hydrological Modeling and Forecasting System (4/4)

•2

User and operatorinterface (mobile)

http://wsfs.vyh.fiHYDROLOGICALMODELING AND

FORECASTING SYSTEM

Public www

River discharges arelow throughout thecountryRiver discharges havedecreased duringsunny and dry period.Only light rains areforecasted sodischarges will staylow…

Water situationdescription

Page 3: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

•3

Weather radar observations and nowcasts (1/1)Hydrological expertise in Finland

Weather radarHourly radar data in 2x2km gridUsed for 2 days in modelUnderestimates large rainfalls

Corrected manually against raingauges

Radar nowcasting3hrs in Southern FinlandEnsamble of 50 members

LAPSCombines information from weatherradar, automatic real-time rain gauges,road weather measurements, …Will probably be used in WSFS as aweather radar replacement in nearfuture 3

Weather radar and LAPS in WSFS

Page 4: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Realtime and historical hydrometeorological andnutrients observations (1/4)Hydrological expertise in Finland

Observation networks

Synoptic weatherstations, 50daily measurements

Other weatherstations, 200daily measurements

Automatic realtime precipitation1-hour measurements from 100stations380 discharge stations

220 with daily measurements160 external stations withusually daily measurements

660 water level stations400 with daily measurements260 external stations withusually daily measurements

Snow courses140 montly measurements

Water quality measurements

Page 5: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Realtime and historical hydrometeorological andnutrients observations (2/4)Hydrological expertise in Finland

Measuring the snowwater equivalent

Snow water equivalent is measured bysnow course measurements

About 140 snow courses in Finland(less than what is shown at the map)

Areal snow water equivalents arecalculated for approximately 110 areas

Snow courses are 2-4 km long routesthrough various terrains

80 depth measurements8 manual weightings

Measurements are made onceor twice a month

Page 6: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Realtime and historical hydrometeorological andnutrients observations (3/4)Hydrological expertise in Finland

Measuring the snowwater equivalent

Page 7: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

•7

Realtime and historical hydrometeorological andnutrients observations (4/4)Hydrological expertise in Finland

SYKE

Hydro-logical

modellingand

forecastingsystem

Meteorologicalinstitute

Localenvironmentalagencies

SYKE’sautomatedmeasurementdevices (waterlevel, …)

Hydropowercompanies

Water supplycompanies

Sweden’sSMHI

Volunteerobservers

Other outsideobservers

Cellular modem

SMS

Report form

GPRS

email

GSM

FTP

http / https

Traditional / snail mail

Realtime hydro-meteorological data

• 2 600 000 linesduring normalday, many moreduring floodsituations

• 22 lines /second aresaved todatabase, onaverage

• Datacontrol

Page 8: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Data assimilation and control (1/6)Hydrological expertise in Finland

Manualmeasurements- Manual riverdischargemeasurement- Manualprecipitationobservations- Snow linemeasurements

Automaticobservations- Automatic riverwater levelobservation- Automaticprecipitationobservations- Snow depth fromautomatic stations

Derived results /algorithmic data- Weather radarprecipitation- Wind correctedprecipitationobservations- ”Near-by-complemented”precipitationobservations- Satellite value forsnow waterequivalent- Interpolatedsnow waterequivalent

Simulations- Arealprecipitation- Runoff,discharge, waterlevel, soilmoisture, …- Arealprecipitationcorrected tomatch waterbalance- Snow waterequivalent, snowdepth, groundfrost depth- Ice thickness

Observed data Calculated data

Page 9: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Data assimilation and control (2/6)Hydrological expertise in Finland

To estimate the state of the hydrological system today

Assimilation observations of:discharge and water levels (over 400 stations)snow water equivalent (over 150 stations)SnowCoverArea satellite dataflood cover area (experimental)

Corrects inputs of the model (daily precipitation and temperature)

Simulation is corrected to agree with observations on a 1-2 year long period backward

Expected result of the data assimilation:hydrological storages (snow, soil moisture, etc.) are more correct

Data assimilation algorithm

Page 10: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Data assimilation and control (3/6)Hydrological expertise in Finland

Example: forecast gone wrong when data is not filtered

Page 11: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Data assimilation and control (4/6)Hydrological expertise in Finland

Example: forecast gone wrong when data is not filtered

Page 12: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Data assimilation and control (5/6)Hydrological expertise in Finland

HYDRO

HYDROTEMPO

METEO

ComputerA

ComputerAComputer

AComputerAComputer

AComputerL

MotherComputer

Datafetching

Computer

User interface • Weather and seaforecasts

• Weather radar• Other data

ftp

databaseconnections

rsync

rsync

http

WWW server

ftp

HYDROFLOOD

ftp

Data transfers in Watershed Simulation and Forecasting System

Page 13: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Data assimilation and control (6/6)Hydrological expertise in Finland

State: OK State: DISCARD State: SUSPICION

O_RF (read flag)• ACCEPTABLE O_AO• REVISED O_AO• SUSPICIOUS O_TR• NULL O_TR

O_TR (test rejection)• PASS O_TS• FAIL D_FO

O_TS (test suspicion)• PASS O_AO• FAIL S_AO

O_AO (accept observ.)O_FO

O_FO (fetch observ.)O_RF

D_RF (read flag)• ACCEPTABLE D_AO• REVISED O_AO• SUSPICIOUS D_TR• NULL D_TR

D_TR (test rejection)• PASS D_TS• FAIL D_FO

D_TS (test suspicion)• PASS O_AO• FAIL S_AO

D_AO (accept observ.)D_FO

D_FO (fetch observ.)D_RF

S_RF (read flag)• ACCEPTABLE S_AO• REVISED O_AO• SUSPICIOUS S_TR• NULL S_TR

S_TR (test rejection)• PASS S_TS• FAIL D_FO

S_TS (test suspicion)• PASS O_AO• FAIL S_AO

S_AO (accept observ.)S_FO

S_FO (fetch observ.)S_RF

State: UNKNOWN(at the beginning)

U_AO (acceptobserv.)

U_FO

U_FO (fetch observ.)U_RF

U_RF (read flag)• ACCEPTABL.

U_AO• REVISED O_AO• SUSPICIOUS U_AO• NULL O_AO

Data Control State Machine

Page 14: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Wind data assimilation to Coherens (Shuku&Suito)

Coupled simulations between air flowand water flow are recommended

(http://www.ems.okayama-u.ac.jp/suito/)

Time consuming

Complex (Confusing)

How should we deal with the dilemma?

Local wind fields strongly impact on water current fields(Suito et al., 2014)

Page 15: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

15

Page 16: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Data and methodsModels

COHERENS V2(Luyten, 2011)Open boundary conditions at 3 river mouths:

River discharge (observation extracted from Hertta data baseof the Finnish Environmental Administration )Temperature (model results provided by VEMALA*)Total suspended sediment (observation interpolated by linearfunction)

Surface dataMeteorological data such as wind speed and direction, airtemperature, humidity, cloud coverage and air pressure.(observation provided by Finnish Meteorological Institute)

*VEMALA: the water quality component of the Watershed Simulation and ForecastingSystem (Vehviläinen B et al., 2005) of the Finnish Environment Institute. This systemsimulates variables such as the transport of total phosphorus and nitrogen andsuspended solids in land area, rivers and lakes. (Huttunen I. et al., 2008).

Huttunen I, Huttunen M, Tattari S, Vehviläinen B. 2008. Large scale phosphorus load modelling inFinland. In Northern Hydrology and its Global Role, Volume 2, Sveinsson ÓGB, GarðarssonSM, Gunnlaugsdóttir S (eds). XXV Nordic Hydrological Conference 2008. NHP Report No. 50.Icelandic Hydrological Committee: Reykjavik; 548-556.

Vehviläinen B, Huttunen M, Huttunen I. 2005. Hydrological forecasting and real time monitoring inFinland: The watershed simulation and forecasting system (WSFS). In Innovation, Advancesand Implementation of Flood Forecasting Technology, Conference Papers, Tromsø, Norway,17–19 October 2005.

Page 17: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

SPM(no biomass)

2 times

ObjectiveTa

neli

Duu

nari-

Työn

teki

jäin

en,S

YKE

17

Total Suspended Sediment.River dischargeTemperature

ModelModelModelModelModel

As much as possible10 days interval

20 days interval30 days interval

No assimilation

3 times5 times6 times

0 times

Aim:sensitivity test of assimilation

Meteorological data

Page 18: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

11/30/2016 Huttula Finnish EnvironmentInstitute, SYKE

18

Page 19: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Study area

Target areaTa

neli

Duu

nari-

Työn

teki

jäin

en,S

YKE

19

Pyhäjoki(in)

Ylaneenjoki(in)

Eurajoki(out)

(Reports of Finnish Environment Institute, 2008)Reports of Finnish Environment Institute 15/2008, 73 p. URN:ISBN: 987-952-11-3125-7 ISBN: 987-

952-11-3125-7 (PDF).Vehviläinen B, Huttunen M, Huttunen I. 2005. Hydrological forecastingand real time monitoring in Finland: The watershed simulation and forecasting system (WSFS).In Innovation, Advances and Implementation of Flood Forecasting Technology, ConferencePapers, Tromsø, Norway, 17–19 October 2005.

Page 20: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

11/30/2016 Huttula Finnish EnvironmentInstitute, SYKE

20

Page 21: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

30.1

1.20

16

6/1

6/8

6/18

6/21

6/26

7/6

Turbidiry TSMNo biomass

Model 06Amap

Model0810days

Model0920days

Model1030days

Model11None

Page 22: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

30.1

1.20

16

Results

Page 23: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

11/30/2016 Huttula Finnish EnvironmentInstitute, SYKE

23

Page 24: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

11/30/2016 Huttula Finnish EnvironmentInstitute, SYKE

24

Page 25: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Observation Station

Meteorological datawind direction, wind speed, temperature, humidity

Tuomiojärvi

Palokkajärvi

Page 26: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Observation Station

JEnergia

Kaijala

Laajavuori

Palokka

Ranta-Niemela

Lehtisaari

Page 27: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Temporal Modeling

Auto-Regressive (AR) Model

n

m

iinin vyay

1

ny

ia

nv

:nth time-series data: ith AR coefficient

: white noisem : autoregressive order

<Yule-Walker method>

mmmm

m

m

C

CC

a

aa

CCC

CCCCCC

ˆ

ˆˆ

ˆˆˆ

ˆˆˆˆˆˆ

2

1

2

1

021

201

110

iC : auto-correlation function

ia : AR coefficient

Page 28: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Spatial Modeling

Page 29: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Ordinary Kriging

1)(

)()(

011111)()()(

1)()()(1)()()(

0

02

01

2

1

21

22212

12111

yy

yyyy

w

ww

yyyyyy

yyyyyyyyyyyy

nnnnnn

n

n

System equation

0y)~1( niy

: Unknown value (wind speed and wind direction): Known value (wind speed and wind direction): Mean value

: Variogram (auto correlation function)

iw : Weight

Page 30: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Interpolated data

0 5000 100000

5000

10000

Y(m

)

X (m)

0.000.250.500.751.001.251.501.752.002.252.502.753.003.253.503.754.004.254.504.755.00

0 5000 100000

5000

10000

Y(m

)X (m)

0.000.250.500.751.001.251.501.752.002.252.502.753.003.253.503.754.004.254.504.755.00

0 5000 100000

5000

10000

Y(m

)

X (m)

0.000.250.500.751.001.251.501.752.002.252.502.753.003.253.503.754.004.254.504.755.00

0 5000 100000

5000

10000

Y(m

)

X (m)

0.000.250.500.751.001.251.501.752.002.252.502.753.003.253.503.754.004.254.504.755.00

0 5000 100000

5000

10000

Y(m

)

X (m)

0.000.250.500.751.001.251.501.752.002.252.502.753.003.253.503.754.004.254.504.755.00

1st August 20th August 30th August

10th September 20th September

Page 31: Modeling in aquatic environment · Modeling in aquatic environment ... GSM FTP http / https ... S_TR (test rejection) • PASS ÆS_TS • FAIL ÆD_FO S_TS (test suspicion)

Estimated local wind field

0 2000 4000 6000 8000 100000

2000

4000

6000

8000

10000

Y(m

)

X (m)