iterative kalman filter using ensembles - nasa...may 21, 2009 vermelding onderdeel organisatie 1...

22
May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test Tannersvile PA / 8 th Adjoint Workshop Martin Verlaan Vermelding onderdeel organisatie

Upload: others

Post on 24-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009

Vermelding onderdeel organisatie

1

Iterative Kalman Filter using EnsemblesTechnical formulation and preliminary test

Tannersvile PA / 8th Adjoint Workshop

Martin Verlaan

Vermelding onderdeel organisatie

Page 2: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 2

Outline

" Motivation" Notation & review" DUD" Algorithm" Experiment" Summary

Page 3: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 3

Motivation

Page 4: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 4

Motivation

" particle filters have nice theoretical properties, but are very expensive to run

" Kalman Filter analysis is inconsistent with model if operators are non-linear (unlike VAR)

Page 5: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 5

Notation

Page 6: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 6

Incremental formulation

Page 7: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 7

Incremental form and Kalman

Page 8: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 8

Ensemble Kalman Filter

Page 9: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 9

Ensemble based VAR

ETKF, ENSR, MLEF, ...EnRML Gu & Oliver 2007 (SPE)En3DVAR Liu et. al. 2008

Page 10: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 10

DUD - Does not Use Derivatives

Ralston & Jennrich 1978

Page 11: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 11

DUD solve

Now update trial points

Page 12: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 12

DUD example

0.4

0.3

0.2

0.1

0

0.5m

X

Z0

1:20

10

1:10

20 30m

WAVES

STATIONS01 02 0403 0705 06 08 ( ) ( ) ( ) ( ) totx y

SNc N c N c N c N

t x y σ θσ θ σ �� �� + + + + = ����

Page 13: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 13

DUD example

Page 14: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 14

DUDEnKF

substititute in non-linear

MLEF Zupanski 2005

Page 15: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 15

DUDEnKF algorithm

" forecast

" minimize

using DUD,

Time loop

Page 16: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 16

Lorenz example

observations

Page 17: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 17

Lorenz example

Page 18: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 18

Lorenz example

Page 19: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 19

Iteration – quick convergence

Page 20: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 20

Iteration – slow convergence

Page 21: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 21

Summary / future

" Iterations in a maximum-likelihood/VAR approach can improve consistency

" Iterated Kalman Filter can approach VAR solution" No TLM or adjoint needed (except for efficiency)

" Next: smoothing and parameter estimation and applications

Page 22: Iterative Kalman Filter using Ensembles - NASA...May 21, 2009 Vermelding onderdeel organisatie 1 Iterative Kalman Filter using Ensembles Technical formulation and preliminary test

May 21, 2009 22

References" [Ralston and Jennrich, 1978] Ralston, M. and Jennrich, R. (1978). Dud, a

derivative-free algorithm for nonlinear least squares. Technometrics, 20(1):7- 14.

" [Zupanski, 2005] Zupanski, M. (2005). Maximum likelihood ensemble filter: Theoretical aspects. Monthly Weather Review, 133:1710-1725.

" [Chen et al., 2008] Chen, Y., Oliver, D., and Zhang, D. (2008). Efficient ensemble-based closed-loop production optimization. Society of Petrolium Enginieers

" [Liu et al., 2008] Liu, C., Xiao, Q., and Wang, B. (2008). An ensemble-based four-dimensional variational data assimilation scheme. part i: Technical for- mulation and preliminary test. Monthly Weather Review, 136:3363-3373.

" [Liu et al., 2009] Liu, C., Xiao, Q., and Wang, B. (2009). An ensemble-based four-dimensional variational data assimilation scheme. part ii: Observing system simulation experiments with advanced research wrf (arw). Monthly Weather Review.

" [Krymskaya et al., 2008] Krymskaya, M., Hanea, R., and Verlaan, M. (2008). An iterative ensemble kalman filter for reservoir engineering applications. Comput Geosci, pages DOI 10.1007/s10596-008-9087-9.

" [Li and Navon, 1999] Li, A. and Navon, I. (1999). Optimality of 4d-var and its relationship with the kalman filter and kalman smoother. submitted to Q.J.R. Meteorol. Soc.