estimation of state noise for the ensemble kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15)...

34
Outline Introduction Ensemble Kalman filter algorithm Estimation of state noise Ensemble Kalman filter on real data Estimation of State Noise for the Ensemble Kalman filter algorithm for 2D shallow water equations. Aymeric Mellet and Julie Percelay May 6, 2009 Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Upload: others

Post on 27-Apr-2021

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Estimation of State Noise for the EnsembleKalman filter algorithm for 2D shallow water

equations.

Aymeric Mellet and Julie Percelay

May 6, 2009

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 2: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

IntroductionMotivation

Ensemble Kalman filter algorithmConstitutive EquationsEnKF algorithmSome results

Estimation of state noiseMethodNavier Stokes equations and assumptionsParameter adjustmentsGeneration of state noise occurrences

Ensemble Kalman filter on real dataValidation methodFuture work

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 3: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Motivation

IntroductionMotivation

Ensemble Kalman filter algorithmConstitutive EquationsEnKF algorithmSome results

Estimation of state noiseMethodNavier Stokes equations and assumptionsParameter adjustmentsGeneration of state noise occurrences

Ensemble Kalman filter on real dataValidation methodFuture work

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 4: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Motivation

Sacramento Delta

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 5: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Motivation

Sacramento Delta

Before the levee breach

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 6: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Motivation

Sacramento Delta

After the levee breach

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 7: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Motivation

Lagrangian sensors

Lagrangian sensors measure their positions as they drift along withthe flow.When trying to solve the two-dimensional shallow water equations,one needs accurate initial and boundary conditions which areusually not available.Data assimilation of the Lagrangian measurements from thedrifters allow to estimate the velocity field in the river even withoutaccurate boundary conditions.

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 8: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Constitutive EquationsEnKF algorithmSome results

IntroductionMotivation

Ensemble Kalman filter algorithmConstitutive EquationsEnKF algorithmSome results

Estimation of state noiseMethodNavier Stokes equations and assumptionsParameter adjustmentsGeneration of state noise occurrences

Ensemble Kalman filter on real dataValidation methodFuture work

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 9: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Constitutive EquationsEnKF algorithmSome results

Two-dimensional shallow water equations

∂u

∂t+−→U · ∇u = −g

∂η

∂x+ Fx +

1

h∇ · (hνt∇u) (1)

∂v

∂t+−→U · ∇v = −g

∂η

∂y+ Fy +

1

h∇ · (hνt∇v) (2)

∂h

∂t+−→U · ∇h + h∇ · −→u = 0 (3)

where

h: total water depth−→U = (u, v): velocity field

Fx = − 1cosα

gn2

h4/3 u√

u2 + v2 η: free surface elevation

Fy = − 1cosα

gn2

h4/3 v√

u2 + v2 νt : turbulent diffusion coefficient

α = α(x , y): bottom slope

n: Manning coefficient.

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 10: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Constitutive EquationsEnKF algorithmSome results

Two-dimensional shallow water equations

Boundary conditions:

u(x , y , t)∣∣∂Ωland

= 0, v(x , y , t)∣∣∂Ωland

= 0, (4)

(u(x , y , t), v(x , y , t))∣∣∂Ωupstream

= f (x , y , t), (5)

η(x , y , t)∣∣∂Ωdownstream

= g(x , y , t), (6)

Initial conditions:

u(x , y , 0) = u0, v(x , y , 0) = v0, h(x , y , 0) = h0, (7)

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 11: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Constitutive EquationsEnKF algorithmSome results

Drifter model

dxDi(t)

dt= u(xDi

(t), yDi(t), t), (8)

dyDi(t)

dt= v(xDi

(t), yDi(t), t), (9)

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 12: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Constitutive EquationsEnKF algorithmSome results

State Augmentation

We use state augmentation to simplify the observation model

θn =

u(tn)v(tn)h(tn)xD(tn)yD(tn)

(10)

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 13: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Constitutive EquationsEnKF algorithmSome results

Forward model

θn+1 = Fn(θn) + wn. (11)

Fn: one time step in the discretized shallow water and driftermodel.θn+1: predicted system state at time tn+1.wn: state noise (modeling error between the reality and the 2Dmodel).Qn: covariance of the state noise.

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 14: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Constitutive EquationsEnKF algorithmSome results

Observation model

yn = Cnθn + εn. (12)

yn: measurements from the drifters.Cn = (0 I): observation model.εn: measurement noise.Rn: covariance of the measurement noise.

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 15: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Constitutive EquationsEnKF algorithmSome results

EnKF Algorithm

1. Initialization: An ensemble of Nstates states ξ(p)0 indexed by p

are generated to represent the uncertainty in θ0.

2. Time update:

ξ(p)n|n−1

= Fn(ξ(p)n−1|n−1

) + w(p)n−1 (13)

θn|n−1 =1

Nstates

Nstates∑p=1

ξ(p)n|n−1

(14)

En|n−1 = [ξ(1)n|n−1

− θn|n−1, . . . ,

ξ(Nstates)n|n−1

− θn|n−1] (15)

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 16: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Constitutive EquationsEnKF algorithmSome results

EnKF Algorithm

3. Measurement update:

Γn|n−1 =1

Nstates − 1En|n−1E

Tn|n−1 (16)

Kn = Γn|n−1CTn (CnΓn|n−1C

Tn + Rn)−1 (17)

ξ(p)n|n = ξ

(i)n|n−1 + Kn(yn − Cnξ

(p)n|n−1 + ε

(p)n ) (18)

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 17: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Constitutive EquationsEnKF algorithmSome results

Twin experiment results

Drifters are released using a software and the EnKF algorithm runsusing those measurements.

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 18: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Constitutive EquationsEnKF algorithmSome results

Limitations

The state noise used here is realistic for twin experiments, since weknow the discrepancy between the ”reality” and the model, as theyare both from the same software.We need more realistic state noise in order to have the algorithmrun with the real data from November experiment.

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 19: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

MethodNavier Stokes equations and assumptionsParameter adjustmentsGeneration of state noise occurrences

IntroductionMotivation

Ensemble Kalman filter algorithmConstitutive EquationsEnKF algorithmSome results

Estimation of state noiseMethodNavier Stokes equations and assumptionsParameter adjustmentsGeneration of state noise occurrences

Ensemble Kalman filter on real dataValidation methodFuture work

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 20: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

MethodNavier Stokes equations and assumptionsParameter adjustmentsGeneration of state noise occurrences

Eulerian sensors - Boundary Conditions

Mike 3

θn

Interpolation

TELEMAC 2D

F (θn)

Mike 3

θn+1

State noise estimation wn = θn+1 − F (θn)

Statistical study

Covariance of the state noise Qn

Figure: State noise estimation process.Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 21: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

MethodNavier Stokes equations and assumptionsParameter adjustmentsGeneration of state noise occurrences

Navier-Stokes equations

1

ρc2s

∂P

∂t+∂uj

∂xj= SS (19)

∂ui

∂t+∂(uiuj)

∂xj+ 2Ωijuj = −1

ρ

∂P

∂xi+ gi

+∂

∂xj(νT

∂ui

∂xi+∂uj

∂xj − 2

3δijk) + uiSS (20)

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 22: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

MethodNavier Stokes equations and assumptionsParameter adjustmentsGeneration of state noise occurrences

Testing the hydrostatic assumption

Hydrostatic assumption: pressure in the river can be estimatedusing the hydrostatic pressure.Valid for L

H >> 1, where L is the horizontal characteristic length ofthe river.

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 23: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

MethodNavier Stokes equations and assumptionsParameter adjustmentsGeneration of state noise occurrences

Navier-Stokes equations using hydrostatic assumption

∂u

∂x+∂v

∂y+∂w

∂z= 0 (21)

∂u

∂t+∂u2

∂x+∂vu

∂y+∂wu

∂z= −g

∂η

∂x− 1

ρ0

∂pa

∂x− g

ρ0

∫ η

z

∂ρ

∂xdz

− 1

ρ0h

(∂sxx∂x

+∂sxy∂y

)+ Fu +

∂z

(νt∂u

∂z

)(22)

∂v

∂t+∂uv

∂x+∂v2

∂y+∂wv

∂z= −g

∂η

∂y− 1

ρ0

∂pa

∂y− g

ρ0

∫ η

z

∂ρ

∂ydz

− 1

ρ0h

(∂syx∂x

+∂sxy∂y

)+ Fv +

∂z

(νt∂v

∂z

)(23)

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 24: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

MethodNavier Stokes equations and assumptionsParameter adjustmentsGeneration of state noise occurrences

Telemac2D Mike 3

Eddy viscosity νt

Vertical Eddy Viscosity νt

Horizontal Eddy Viscosity A

Manning’s n Roughness height ks

Figure: Equivalence of parameters between the two dimensional and thethree dimensional models.

A relationship between the roughness height and the Manning’s ncan be found as:

n =k

16s

25.4(24)

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 25: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

MethodNavier Stokes equations and assumptionsParameter adjustmentsGeneration of state noise occurrences

Three dimensional simulations

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 26: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

MethodNavier Stokes equations and assumptionsParameter adjustmentsGeneration of state noise occurrences

Boundary conditions

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 27: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

MethodNavier Stokes equations and assumptionsParameter adjustmentsGeneration of state noise occurrences

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 28: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

MethodNavier Stokes equations and assumptionsParameter adjustmentsGeneration of state noise occurrences

Result of the 3D simulation

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 29: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

MethodNavier Stokes equations and assumptionsParameter adjustmentsGeneration of state noise occurrences

State noise characteristics

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 30: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Validation methodFuture work

IntroductionMotivation

Ensemble Kalman filter algorithmConstitutive EquationsEnKF algorithmSome results

Estimation of state noiseMethodNavier Stokes equations and assumptionsParameter adjustmentsGeneration of state noise occurrences

Ensemble Kalman filter on real dataValidation methodFuture work

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 31: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Validation methodFuture work

Real data

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 32: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Validation methodFuture work

Cross validation principle

No data are available to validate.

I Remove 1 or 2 drifters from the data set.

I Run the EnKF on the remaining drifters.

I Compute the trajectory of the extracted drifters using theestimated velocity field.

I Compare it with the real trajectory.

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 33: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Validation methodFuture work

Future work

I Run the EnKF using the real data set and the generated statenoise.

I Generate a state noise model for the drifters.

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF

Page 34: Estimation of State Noise for the Ensemble Kalman filter … · 2019. 12. 19. · njn 1 njn 1] (15) Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF. Outline Introduction

OutlineIntroduction

Ensemble Kalman filter algorithmEstimation of state noise

Ensemble Kalman filter on real data

Validation methodFuture work

Questions?

Aymeric Mellet and Julie Percelay State Noise Estimation for EnKF