minimisation techniques 1 assimilation algorithms: minimisation techniques yannick trémolet ecmwf...
TRANSCRIPT
![Page 1: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/1.jpg)
Min
imis
ati
on
Tech
niq
ues
1
Assimilation Algorithms:Minimisation Techniques
Yannick TrémoletECMWF
Data Assimilation Training CourseMarch 2006
![Page 2: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/2.jpg)
Min
imis
ati
on
Tech
niq
ues
2
4D Variational Data Assimilation
![Page 3: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/3.jpg)
Min
imis
ati
on
Tech
niq
ues
3
Incremental 4D-Var
![Page 4: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/4.jpg)
Min
imis
ati
on
Tech
niq
ues
4
Incremental 4D-Var
![Page 5: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/5.jpg)
Min
imis
ati
on
Tech
niq
ues
5
Incremental 4D-Var
![Page 6: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/6.jpg)
Min
imis
ati
on
Tech
niq
ues
6
The Outer Iterations
![Page 7: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/7.jpg)
Min
imis
ati
on
Tech
niq
ues
7
The Inner Iterations
![Page 8: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/8.jpg)
Min
imis
ati
on
Tech
niq
ues
8
Minimisation: Newton method
![Page 9: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/9.jpg)
Min
imis
ati
on
Tech
niq
ues
9
Minimisation: Newton method
![Page 10: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/10.jpg)
Min
imis
ati
on
Tech
niq
ues
10
Minimisation: Quasi-Newton method
![Page 11: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/11.jpg)
Min
imis
ati
on
Tech
niq
ues
11
Minimisation: Quasi-Newton method
![Page 12: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/12.jpg)
Min
imis
ati
on
Tech
niq
ues
12
Limited Memory Quasi-Newton
![Page 13: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/13.jpg)
Min
imis
ati
on
Tech
niq
ues
13
Minimisation: Steepest Descent
![Page 14: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/14.jpg)
Min
imis
ati
on
Tech
niq
ues
14
Minimisation: Steepest Descent
The first step fully minimizes the function in the descent direction, but this is undone by subsequent steps. We want to avoid this.
![Page 15: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/15.jpg)
Min
imis
ati
on
Tech
niq
ues
15
Minimisation: Conjugate Gradient
![Page 16: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/16.jpg)
Min
imis
ati
on
Tech
niq
ues
16
Conjugate Gradient Convergence
![Page 17: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/17.jpg)
Min
imis
ati
on
Tech
niq
ues
17
Preconditioning
![Page 18: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/18.jpg)
Min
imis
ati
on
Tech
niq
ues
18
4D-Var Preconditioning
![Page 19: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/19.jpg)
Min
imis
ati
on
Tech
niq
ues
19
A case of poor convergence
![Page 20: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/20.jpg)
Min
imis
ati
on
Tech
niq
ues
20
Theoretical example
![Page 21: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/21.jpg)
Min
imis
ati
on
Tech
niq
ues
21
Theoretical example
![Page 22: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/22.jpg)
Min
imis
ati
on
Tech
niq
ues
22
A case of poor convergence
![Page 23: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/23.jpg)
Min
imis
ati
on
Tech
niq
ues
23
Hessian Preconditioning
![Page 24: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/24.jpg)
Min
imis
ati
on
Tech
niq
ues
24
Hessian Eigenvectors Preconditioning
![Page 25: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/25.jpg)
Min
imis
ati
on
Tech
niq
ues
25
4D-Var Eigenvalues
Eig
enva
lue
N=1
1=3105.4
26=492.75
Preconditioning reduces the condition number k=1/N from 3105.4 to 492.75
![Page 26: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/26.jpg)
Min
imis
ati
on
Tech
niq
ues
26
Conjugate Gradient and Lanczos Algorithm
![Page 27: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/27.jpg)
Min
imis
ati
on
Tech
niq
ues
27
Lanczos Algorithm
![Page 28: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/28.jpg)
Min
imis
ati
on
Tech
niq
ues
28
Lanczos Algorithm
![Page 29: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/29.jpg)
Min
imis
ati
on
Tech
niq
ues
29
Conjugate Gradient and Lanczos Algorithm
![Page 30: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/30.jpg)
Min
imis
ati
on
Tech
niq
ues
30
Superlinear Convergence
![Page 31: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/31.jpg)
Min
imis
ati
on
Tech
niq
ues
31
Rounding Error
![Page 32: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/32.jpg)
Min
imis
ati
on
Tech
niq
ues
32
CG Cost function reduction
Quasi-Newton with inexact line searches
Quasi-Newton with exact line searches
Conjugate Gradient without orthogonalisation
Conjugate Gradient with orthogonalisation
![Page 33: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/33.jpg)
Min
imis
ati
on
Tech
niq
ues
33
CG Gradient norm reduction
Quasi-Newton with inexact line searches
Quasi-Newton with exact line searches
Conjugate Gradient without orthogonalisation
Conjugate Gradient with orthogonalisation
![Page 34: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/34.jpg)
Min
imis
ati
on
Tech
niq
ues
34
4D-Var Cost function reduction
Variational Quality Control
![Page 35: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/35.jpg)
Min
imis
ati
on
Tech
niq
ues
35
4D-Var gradient norm reduction
Convergence is roughly twice as fast with Hessian preconditioning.
![Page 36: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/36.jpg)
Min
imis
ati
on
Tech
niq
ues
36
CG reduction of norm of gradient
0.05
![Page 37: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/37.jpg)
Min
imis
ati
on
Tech
niq
ues
37
Spectrum of preconditioned Hessian
0
200
400
600
800
1000
1200
1 3 5 7 9 11 13 15 17 19 21 23
Min_42
Min_95
Min_255
![Page 38: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/38.jpg)
Min
imis
ati
on
Tech
niq
ues
38
RMS of T analysis increments
![Page 39: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/39.jpg)
Min
imis
ati
on
Tech
niq
ues
39
4D-Var Convergence
![Page 40: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/40.jpg)
Min
imis
ati
on
Tech
niq
ues
40
4D-Var Convergence
![Page 41: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/41.jpg)
Min
imis
ati
on
Tech
niq
ues
41
Summary
![Page 42: Minimisation Techniques 1 Assimilation Algorithms: Minimisation Techniques Yannick Trémolet ECMWF Data Assimilation Training Course March 2006](https://reader036.vdocument.in/reader036/viewer/2022062511/551d9d8c497959293b8c1143/html5/thumbnails/42.jpg)
Min
imis
ati
on
Tech
niq
ues
42