lecture 6: langevin equations

91
Lecture 6: Langevin equations ine: near/nonlinear, additive and multiplicative noise luble linear example w/ additive noise: Ornstein-Uhlenbeck pr neral 1-d nonlinear equation with multiplicative noise lation to Fokker-Planck equation o formulation, relation between Ito & Stratonovich approaches

Upload: wesley-stout

Post on 01-Jan-2016

19 views

Category:

Documents


0 download

DESCRIPTION

Lecture 6: Langevin equations. Outline: linear/nonlinear, additive and multiplicative noise soluble linear example w/ additive noise: Ornstein-Uhlenbeck process general 1-d nonlinear equation with multiplicative noise relation to Fokker-Planck equation - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Lecture 6: Langevin equations

Lecture 6: Langevin equations

Outline:• linear/nonlinear, additive and multiplicative noise• soluble linear example w/ additive noise: Ornstein-Uhlenbeck process• general 1-d nonlinear equation with multiplicative noise• relation to Fokker-Planck equation• Ito formulation, relation between Ito & Stratonovich approaches

Page 2: Lecture 6: Langevin equations

Stochastic differential equationsDifferential equations which contain (“are driven by”) random functions

Page 3: Lecture 6: Langevin equations

Stochastic differential equationsDifferential equations which contain (“are driven by”) random functions

Langevin equations: the random function is Gaussian white noise ξ(t):

Page 4: Lecture 6: Langevin equations

Stochastic differential equationsDifferential equations which contain (“are driven by”) random functions

Langevin equations: the random function is Gaussian white noise ξ(t):

ξ(t)ξ ( ′ t ) = 2σ 2δ(t − ′ t )

Page 5: Lecture 6: Langevin equations

Stochastic differential equationsDifferential equations which contain (“are driven by”) random functions

Langevin equations: the random function is Gaussian white noise ξ(t):

ξ(t)ξ ( ′ t ) = 2σ 2δ(t − ′ t )

ξ (t1)ξ (t2)ξ (t3)ξ (t4 ) = ξ (t1)ξ (t2) ξ (t3)ξ (t4 )

+ ξ (t1)ξ (t3) ξ (t2)ξ (t4 )

+ ξ (t1)ξ (t4 ) ξ (t2)ξ (t3) etc.

Page 6: Lecture 6: Langevin equations

Stochastic differential equationsDifferential equations which contain (“are driven by”) random functions

Langevin equations: the random function is Gaussian white noise ξ(t):

ξ(t)ξ ( ′ t ) = 2σ 2δ(t − ′ t )

ξ (t1)ξ (t2)ξ (t3)ξ (t4 ) = ξ (t1)ξ (t2) ξ (t3)ξ (t4 )

+ ξ (t1)ξ (t3) ξ (t2)ξ (t4 )

+ ξ (t1)ξ (t4 ) ξ (t2)ξ (t3) etc.

Simple example (Brownian motion/ Ornstein-Uhlenbeck process):

mdv

dt= −γv + ξ (t)

Page 7: Lecture 6: Langevin equations

Stochastic differential equationsDifferential equations which contain (“are driven by”) random functions

Langevin equations: the random function is Gaussian white noise ξ(t):

ξ(t)ξ ( ′ t ) = 2σ 2δ(t − ′ t )

ξ (t1)ξ (t2)ξ (t3)ξ (t4 ) = ξ (t1)ξ (t2) ξ (t3)ξ (t4 )

+ ξ (t1)ξ (t3) ξ (t2)ξ (t4 )

+ ξ (t1)ξ (t4 ) ξ (t2)ξ (t3) etc.

Simple example (Brownian motion/ Ornstein-Uhlenbeck process):

Solution v(t) is random (because it depends on ξ(t))

mdv

dt= −γv + ξ (t)

Page 8: Lecture 6: Langevin equations

Stochastic differential equationsDifferential equations which contain (“are driven by”) random functions

Langevin equations: the random function is Gaussian white noise ξ(t):

ξ(t)ξ ( ′ t ) = 2σ 2δ(t − ′ t )

ξ (t1)ξ (t2)ξ (t3)ξ (t4 ) = ξ (t1)ξ (t2) ξ (t3)ξ (t4 )

+ ξ (t1)ξ (t3) ξ (t2)ξ (t4 )

+ ξ (t1)ξ (t4 ) ξ (t2)ξ (t3) etc.

Simple example (Brownian motion/ Ornstein-Uhlenbeck process):

Solution v(t) is random (because it depends on ξ(t)) Want to know P[v], averages over distribution of ξ(t)

mdv

dt= −γv + ξ (t)

v(t) , v(t)v( ′ t ) , K

Page 9: Lecture 6: Langevin equations

More generally,

multivariate:

dx i

dt= − γ ij x j + ξ i(t), ξ i(t)ξ j ( ′ t ) = Δ ijδ(t − ′ t )

j

Page 10: Lecture 6: Langevin equations

More generally,

multivariate:

dx i

dt= − γ ij x j + ξ i(t), ξ i(t)ξ j ( ′ t ) = Δ ijδ(t − ′ t )

j

mi

d2x i

dt 2+ η ij

dx j

dtj

∑ = − κ ij x j + ξ i(t)j

∑higher-order:

Page 11: Lecture 6: Langevin equations

More generally,

multivariate:

dx i

dt= − γ ij x j + ξ i(t), ξ i(t)ξ j ( ′ t ) = Δ ijδ(t − ′ t )

j

mi

d2x i

dt 2+ η ij

dx j

dtj

∑ = − κ ij x j + ξ i(t)j

dx

dt= f (x, t) + ξ (t)nonlinear:

higher-order:

Page 12: Lecture 6: Langevin equations

More generally,

multivariate:

dx i

dt= − γ ij x j + ξ i(t), ξ i(t)ξ j ( ′ t ) = Δ ijδ(t − ′ t )

j

mi

d2x i

dt 2+ η ij

dx j

dtj

∑ = − κ ij x j + ξ i(t)j

dx

dt= f (x, t) + ξ (t)

dx

dt= f (x, t) + g(x, t)ξ (t)

nonlinear:

higher-order:

multiplicativenoise:

Page 13: Lecture 6: Langevin equations

Brownian motion

mdv

dt= −γv + ξ (t); ξ (t)ξ ( ′ t ) = σ 2δ(t − ′ t )

Page 14: Lecture 6: Langevin equations

Brownian motion

mdv

dt= −γv + ξ (t); ξ (t)ξ ( ′ t ) = σ 2δ(t − ′ t )

solution (with m = 1):

v(t) = v(0)e−γt + d ′ t e−γ (t− ′ t )ξ ( ′ t )0

t

Page 15: Lecture 6: Langevin equations

Brownian motion

mdv

dt= −γv + ξ (t); ξ (t)ξ ( ′ t ) = σ 2δ(t − ′ t )

solution (with m = 1):

v(t) = v(0)e−γt + d ′ t e−γ (t− ′ t )ξ ( ′ t )0

t

v(t) = v(0)e−γtt →∞

⏐ → ⏐ ⏐ 0averages:

Page 16: Lecture 6: Langevin equations

Brownian motion

mdv

dt= −γv + ξ (t); ξ (t)ξ ( ′ t ) = σ 2δ(t − ′ t )

solution (with m = 1):

v(t) = v(0)e−γt + d ′ t e−γ (t− ′ t )ξ ( ′ t )0

t

v(t) = v(0)e−γtt →∞

⏐ → ⏐ ⏐ 0

v(t1)v(t2) = v 2(0)e−γ ( t1 +t2 ) + d ′ t 0

t1∫ e−γ ( t1 − ′ t ) d ′ ′ t 0

t 2∫ e−γ (t2 − ′ ′ t ) ξ ( ′ t )ξ ( ′ ′ t )

averages:

Page 17: Lecture 6: Langevin equations

Brownian motion

mdv

dt= −γv + ξ (t); ξ (t)ξ ( ′ t ) = σ 2δ(t − ′ t )

solution (with m = 1):

v(t) = v(0)e−γt + d ′ t e−γ (t− ′ t )ξ ( ′ t )0

t

v(t) = v(0)e−γtt →∞

⏐ → ⏐ ⏐ 0

v(t1)v(t2) = v 2(0)e−γ ( t1 +t2 ) + d ′ t 0

t1∫ e−γ ( t1 − ′ t ) d ′ ′ t 0

t 2∫ e−γ (t2 − ′ ′ t ) ξ ( ′ t )ξ ( ′ ′ t )

averages:

t1 < t2 : σ 2 e−γ ( t1 +t2 −2 ′ t )d ′ t =σ 2

2γe−γ ( t1 +t2 ) e2γt1 −1( ) =

0

t1∫ σ 2

2γe−γ ( t2 −t1 ) − e−γ (t1 +t2 )

( )

Page 18: Lecture 6: Langevin equations

Brownian motion

mdv

dt= −γv + ξ (t); ξ (t)ξ ( ′ t ) = σ 2δ(t − ′ t )

solution (with m = 1):

v(t) = v(0)e−γt + d ′ t e−γ (t− ′ t )ξ ( ′ t )0

t

v(t) = v(0)e−γtt →∞

⏐ → ⏐ ⏐ 0

v(t1)v(t2) = v 2(0)e−γ ( t1 +t2 ) + d ′ t 0

t1∫ e−γ ( t1 − ′ t ) d ′ ′ t 0

t 2∫ e−γ (t2 − ′ ′ t ) ξ ( ′ t )ξ ( ′ ′ t )

averages:

t1 < t2 : σ 2 e−γ ( t1 +t2 −2 ′ t )d ′ t =σ 2

2γe−γ ( t1 +t2 ) e2γt1 −1( ) =

0

t1∫ σ 2

2γe−γ ( t2 −t1 ) − e−γ (t1 +t2 )

( )

t1 > t2: : L =σ 2

2γe−γ (t1 −t2 ) − e−γ ( t1 +t2 )

( )

Page 19: Lecture 6: Langevin equations

Brownian motion

mdv

dt= −γv + ξ (t); ξ (t)ξ ( ′ t ) = σ 2δ(t − ′ t )

solution (with m = 1):

v(t) = v(0)e−γt + d ′ t e−γ (t− ′ t )ξ ( ′ t )0

t

v(t) = v(0)e−γtt →∞

⏐ → ⏐ ⏐ 0

v(t1)v(t2) = v 2(0)e−γ ( t1 +t2 ) + d ′ t 0

t1∫ e−γ ( t1 − ′ t ) d ′ ′ t 0

t 2∫ e−γ (t2 − ′ ′ t ) ξ ( ′ t )ξ ( ′ ′ t )

averages:

t1 < t2 : σ 2 e−γ ( t1 +t2 −2 ′ t )d ′ t =σ 2

2γe−γ ( t1 +t2 ) e2γt1 −1( ) =

0

t1∫ σ 2

2γe−γ ( t2 −t1 ) − e−γ (t1 +t2 )

( )

t1 > t2: : L =σ 2

2γe−γ (t1 −t2 ) − e−γ ( t1 +t2 )

( )

⇒ v(t1)v(t2) = v 2(0)e−2γ (t1 +t2 ) +σ 2

2γe−γ t2 −t1 − e−γ ( t1 +t2 )

( )

Page 20: Lecture 6: Langevin equations

Brownian motion

mdv

dt= −γv + ξ (t); ξ (t)ξ ( ′ t ) = σ 2δ(t − ′ t )

solution (with m = 1):

v(t) = v(0)e−γt + d ′ t e−γ (t− ′ t )ξ ( ′ t )0

t

v(t) = v(0)e−γtt →∞

⏐ → ⏐ ⏐ 0

v(t1)v(t2) = v 2(0)e−γ ( t1 +t2 ) + d ′ t 0

t1∫ e−γ ( t1 − ′ t ) d ′ ′ t 0

t 2∫ e−γ (t2 − ′ ′ t ) ξ ( ′ t )ξ ( ′ ′ t )

averages:

t1 < t2 : σ 2 e−γ ( t1 +t2 −2 ′ t )d ′ t =σ 2

2γe−γ ( t1 +t2 ) e2γt1 −1( ) =

0

t1∫ σ 2

2γe−γ ( t2 −t1 ) − e−γ (t1 +t2 )

( )

t1 > t2: : L =σ 2

2γe−γ (t1 −t2 ) − e−γ ( t1 +t2 )

( )

⇒ v(t1)v(t2) = v 2(0)e−2γ (t1 +t2 ) +σ 2

2γe−γ t2 −t1 − e−γ ( t1 +t2 )

( ) t1 ,t2 →∞ ⏐ → ⏐ ⏐ σ 2

2γe−γ t1 −t2

Page 21: Lecture 6: Langevin equations

Brown (2)

equal-time correlation:

v 2(t) =σ 2

Page 22: Lecture 6: Langevin equations

Brown (2)

equal-time correlation:

but from equilibrium stat mech:

v 2(t) =σ 2

v 2(t) = T (m =1)

Page 23: Lecture 6: Langevin equations

Brown (2)

equal-time correlation:

but from equilibrium stat mech:

v 2(t) =σ 2

v 2(t) = T (m =1)

⇒ σ 2 = 2γT

Page 24: Lecture 6: Langevin equations

Brown (2)

equal-time correlation:

but from equilibrium stat mech:

v 2(t) =σ 2

v 2(t) = T (m =1)

⇒ σ 2 = 2γT

(another Einstein relation)

Page 25: Lecture 6: Langevin equations

Brown (2)

equal-time correlation:

but from equilibrium stat mech:

v 2(t) =σ 2

v 2(t) = T (m =1)

⇒ σ 2 = 2γT

(another Einstein relation)

Note: OU model also applies with v -> x (position) to overdamped motion in a parabolic potential

Page 26: Lecture 6: Langevin equations

Solution using Fourier transform

−iωx(ω) = −γx(ω) + ξ (ω)

Page 27: Lecture 6: Langevin equations

Solution using Fourier transform

−iωx(ω) = −γx(ω) + ξ (ω)

ξ (ω)ξ ( ′ ω ) = σ 2 ⋅2πδ(ω + ′ ω ) = 2γT ⋅2πδ(ω + ′ ω )

Page 28: Lecture 6: Langevin equations

Solution using Fourier transform

−iωx(ω) = −γx(ω) + ξ (ω)

ξ (ω)ξ ( ′ ω ) = σ 2 ⋅2πδ(ω + ′ ω ) = 2γT ⋅2πδ(ω + ′ ω )

i.e., ξ (ω)ξ (−ω) = ξ (ω)2

= σ 2 = 2γT

Page 29: Lecture 6: Langevin equations

Solution using Fourier transform

−iωx(ω) = −γx(ω) + ξ (ω)

ξ (ω)ξ ( ′ ω ) = σ 2 ⋅2πδ(ω + ′ ω ) = 2γT ⋅2πδ(ω + ′ ω )

i.e., ξ (ω)ξ (−ω) = ξ (ω)2

= σ 2 = 2γT

x(ω) =ξ (ω)

−iω + γsolution:

Page 30: Lecture 6: Langevin equations

Solution using Fourier transform

−iωx(ω) = −γx(ω) + ξ (ω)

ξ (ω)ξ ( ′ ω ) = σ 2 ⋅2πδ(ω + ′ ω ) = 2γT ⋅2πδ(ω + ′ ω )

i.e., ξ (ω)ξ (−ω) = ξ (ω)2

= σ 2 = 2γT

x(ω) =ξ (ω)

−iω + γ

x(ω)2

=ξ (ω)

2

ω2 + γ 2

solution:

Page 31: Lecture 6: Langevin equations

Solution using Fourier transform

−iωx(ω) = −γx(ω) + ξ (ω)

ξ (ω)ξ ( ′ ω ) = σ 2 ⋅2πδ(ω + ′ ω ) = 2γT ⋅2πδ(ω + ′ ω )

i.e., ξ (ω)ξ (−ω) = ξ (ω)2

= σ 2 = 2γT

x(ω) =ξ (ω)

−iω + γ

x(ω)2

=ξ (ω)

2

ω2 + γ 2=

σ 2

ω2 + γ 2

solution:

Page 32: Lecture 6: Langevin equations

Solution using Fourier transform

−iωx(ω) = −γx(ω) + ξ (ω)

ξ (ω)ξ ( ′ ω ) = σ 2 ⋅2πδ(ω + ′ ω ) = 2γT ⋅2πδ(ω + ′ ω )

i.e., ξ (ω)ξ (−ω) = ξ (ω)2

= σ 2 = 2γT

x(ω) =ξ (ω)

−iω + γ

x(ω)2

=ξ (ω)

2

ω2 + γ 2=

σ 2

ω2 + γ 2=

2Tγ

ω2 + γ 2

solution:

Page 33: Lecture 6: Langevin equations

Solution using Fourier transform

−iωx(ω) = −γx(ω) + ξ (ω)

ξ (ω)ξ ( ′ ω ) = σ 2 ⋅2πδ(ω + ′ ω ) = 2γT ⋅2πδ(ω + ′ ω )

i.e., ξ (ω)ξ (−ω) = ξ (ω)2

= σ 2 = 2γT

x(ω) =ξ (ω)

−iω + γ

x(ω)2

=ξ (ω)

2

ω2 + γ 2=

σ 2

ω2 + γ 2=

2Tγ

ω2 + γ 2

x(0)x(t) = σ 2 dω

2π∫ e iωt

ω2 + γ 2=

σ 2

2π2πi( )

e−γt

2iγ=

σ 2

2γe−γt , t > 0

solution:

inverse FT:

Page 34: Lecture 6: Langevin equations

Solution using Fourier transform

−iωx(ω) = −γx(ω) + ξ (ω)

ξ (ω)ξ ( ′ ω ) = σ 2 ⋅2πδ(ω + ′ ω ) = 2γT ⋅2πδ(ω + ′ ω )

i.e., ξ (ω)ξ (−ω) = ξ (ω)2

= σ 2 = 2γT

x(ω) =ξ (ω)

−iω + γ

x(ω)2

=ξ (ω)

2

ω2 + γ 2=

σ 2

ω2 + γ 2=

2Tγ

ω2 + γ 2

x(0)x(t) = σ 2 dω

2π∫ e iωt

ω2 + γ 2=

σ 2

2π2πi( )

e−γt

2iγ=

σ 2

2γe−γt , t > 0

=σ 2

2π2πi( )(−1)

e+γt

−2iγ=

σ 2

2γe+γt , t < 0

solution:

inverse FT:

Page 35: Lecture 6: Langevin equations

Solution using Fourier transform

−iωx(ω) = −γx(ω) + ξ (ω)

ξ (ω)ξ ( ′ ω ) = σ 2 ⋅2πδ(ω + ′ ω ) = 2γT ⋅2πδ(ω + ′ ω )

i.e., ξ (ω)ξ (−ω) = ξ (ω)2

= σ 2 = 2γT

x(ω) =ξ (ω)

−iω + γ

x(ω)2

=ξ (ω)

2

ω2 + γ 2=

σ 2

ω2 + γ 2=

2Tγ

ω2 + γ 2

x(0)x(t) = σ 2 dω

2π∫ e iωt

ω2 + γ 2=

σ 2

2π2πi( )

e−γt

2iγ=

σ 2

2γe−γt , t > 0

=σ 2

2π2πi( )(−1)

e+γt

−2iγ=

σ 2

2γe+γt , t < 0

=σ 2

2γe−γ t

solution:

inverse FT:

Page 36: Lecture 6: Langevin equations

Solution using Fourier transform

−iωx(ω) = −γx(ω) + ξ (ω)

ξ (ω)ξ ( ′ ω ) = σ 2 ⋅2πδ(ω + ′ ω ) = 2γT ⋅2πδ(ω + ′ ω )

i.e., ξ (ω)ξ (−ω) = ξ (ω)2

= σ 2 = 2γT

x(ω) =ξ (ω)

−iω + γ

x(ω)2

=ξ (ω)

2

ω2 + γ 2=

σ 2

ω2 + γ 2=

2Tγ

ω2 + γ 2

x(0)x(t) = σ 2 dω

2π∫ e iωt

ω2 + γ 2=

σ 2

2π2πi( )

e−γt

2iγ=

σ 2

2γe−γt , t > 0

=σ 2

2π2πi( )(−1)

e+γt

−2iγ=

σ 2

2γe+γt , t < 0

=σ 2

2γe−γ t = Te−γ t

solution:

inverse FT:

Page 37: Lecture 6: Langevin equations

Solution using Fourier transform

−iωx(ω) = −γx(ω) + ξ (ω)

ξ (ω)ξ ( ′ ω ) = σ 2 ⋅2πδ(ω + ′ ω ) = 2γT ⋅2πδ(ω + ′ ω )

i.e., ξ (ω)ξ (−ω) = ξ (ω)2

= σ 2 = 2γT

x(ω) =ξ (ω)

−iω + γ

x(ω)2

=ξ (ω)

2

ω2 + γ 2=

σ 2

ω2 + γ 2=

2Tγ

ω2 + γ 2

x(0)x(t) = σ 2 dω

2π∫ e iωt

ω2 + γ 2=

σ 2

2π2πi( )

e−γt

2iγ=

σ 2

2γe−γt , t > 0

=σ 2

2π2πi( )(−1)

e+γt

−2iγ=

σ 2

2γe+γt , t < 0

=σ 2

2γe−γ t = Te−γ t

solution:

inverse FT:

(as in direct calculation)

Page 38: Lecture 6: Langevin equations

Damped oscillator

md2x

dt 2+ η

dx

dt+ κx = ξ (t)

Page 39: Lecture 6: Langevin equations

Damped oscillator

FT:

−ω 2 − iωγ + ω02

( )x(ω) = ξ (ω) ω02 = κ /m, γ = η /m( )€

md2x

dt 2+ η

dx

dt+ κx = ξ (t)

Page 40: Lecture 6: Langevin equations

Damped oscillator

FT:

−ω 2 − iωγ + ω02

( )x(ω) = ξ (ω) ω02 = κ /m, γ = η /m( )

⇒ x(ω)2

=ξ (ω)

2m2

ω2 −ω02

( )2

+ γ 2ω2=

σ 2 m2

ω2 −ω02

( )2

+ γ 2ω2

md2x

dt 2+ η

dx

dt+ κx = ξ (t)

Page 41: Lecture 6: Langevin equations

Damped oscillator

FT:

−ω 2 − iωγ + ω02

( )x(ω) = ξ (ω) ω02 = κ /m, γ = η /m( )

⇒ x(ω)2

=ξ (ω)

2m2

ω2 −ω02

( )2

+ γ 2ω2=

σ 2 m2

ω2 −ω02

( )2

+ γ 2ω2

⇒ x(t)x(0) =σ 2

2ηκe−γ t / 2 cos ω0

2 − 14 γ 2 t( ) +

γ

2 ω02 − 1

4 γ 2sin ω0

2 − 14 γ 2 t( )

⎣ ⎢ ⎢

⎦ ⎥ ⎥

inverse FT:

md2x

dt 2+ η

dx

dt+ κx = ξ (t)

Page 42: Lecture 6: Langevin equations

General OU process

dx i

dt= − Γij x j + ξ i(t), ξ i(t)ξ j ( ′ t ) =

j

∑ Δ ijδ ijδ(t − ′ t )

Page 43: Lecture 6: Langevin equations

General OU process

dx i

dt= − Γij x j + ξ i(t), ξ i(t)ξ j ( ′ t ) =

j

∑ Δ ijδ ijδ(t − ′ t )

md2x

dt 2+ η

dx

dt+ κx = ξ (t)

damped oscillator:

Page 44: Lecture 6: Langevin equations

General OU process

dx i

dt= − Γij x j + ξ i(t), ξ i(t)ξ j ( ′ t ) =

j

∑ Δ ijδ ijδ(t − ′ t )

md2x

dt 2+ η

dx

dt+ κx = ξ (t)

˙ x =p

m˙ p = −κx − γp + ξ (t)

damped oscillator:

Page 45: Lecture 6: Langevin equations

General OU process

dx i

dt= − Γij x j + ξ i(t), ξ i(t)ξ j ( ′ t ) =

j

∑ Δ ijδ ijδ(t − ′ t )

md2x

dt 2+ η

dx

dt+ κx = ξ (t)

˙ x =p

m˙ p = −κx − γp + ξ (t)

damped oscillator:

Is a 2-d OU process with

Γ=0 −1 m

κ γ

⎝ ⎜

⎠ ⎟, Δ =

0 0

0 σ 2

⎝ ⎜

⎠ ⎟

Page 46: Lecture 6: Langevin equations

General OU process

dx i

dt= − Γij x j + ξ i(t), ξ i(t)ξ j ( ′ t ) =

j

∑ Δ ijδ ijδ(t − ′ t )

md2x

dt 2+ η

dx

dt+ κx = ξ (t)

˙ x =p

m˙ p = −κx − γp + ξ (t)

damped oscillator:

Is a 2-d OU process with

Γ=0 −1 m

κ γ

⎝ ⎜

⎠ ⎟, Δ =

0 0

0 σ 2

⎝ ⎜

⎠ ⎟

x(t) is not a Markov process (2nd order equation), but (x(t),p(t)) is (1st order equation).

Page 47: Lecture 6: Langevin equations

Formal solution by FT

−iωI+ Γ( )x(ω) = ξ (ω)

Page 48: Lecture 6: Langevin equations

Formal solution by FT

−iωI+ Γ( )x(ω) = ξ (ω)

x(ω)xT (−ω) = −iωI+ Γ( )−1

ξ (ω)ξ T (−ω) iωI+ ΓT( )

−1

Page 49: Lecture 6: Langevin equations

Formal solution by FT

−iωI+ Γ( )x(ω) = ξ (ω)

x(ω)xT (−ω) = −iωI+ Γ( )−1

ξ (ω)ξ T (−ω) iωI+ ΓT( )

−1

= −iωI+ Γ( )−1

Δ iωI+ ΓT( )

−1

Page 50: Lecture 6: Langevin equations

Formal solution by FT

−iωI+ Γ( )x(ω) = ξ (ω)

x(ω)xT (−ω) = −iωI+ Γ( )−1

ξ (ω)ξ T (−ω) iωI+ ΓT( )

−1

= −iωI+ Γ( )−1

Δ iωI+ ΓT( )

−1

damped oscillator case:

x(ω)xT (−ω) =−iω −1 m

κ −iω + γ

⎝ ⎜

⎠ ⎟

−10 0

0 σ 2

⎝ ⎜

⎠ ⎟

iω κ

−1 m iω + γ

⎝ ⎜

⎠ ⎟

−1

Page 51: Lecture 6: Langevin equations

Formal solution by FT

−iωI+ Γ( )x(ω) = ξ (ω)

x(ω)xT (−ω) = −iωI+ Γ( )−1

ξ (ω)ξ T (−ω) iωI+ ΓT( )

−1

= −iωI+ Γ( )−1

Δ iωI+ ΓT( )

−1

damped oscillator case:

x(ω)xT (−ω) =−iω −1 m

κ −iω + γ

⎝ ⎜

⎠ ⎟

−10 0

0 σ 2

⎝ ⎜

⎠ ⎟

iω κ

−1 m iω + γ

⎝ ⎜

⎠ ⎟

−1

=1

−iω(−iω + γ) + ω02 2

−iω + γ 1 m

−κ iω

⎝ ⎜

⎠ ⎟0 0

0 σ 2

⎝ ⎜

⎠ ⎟iω + γ −κ

1 m iω

⎝ ⎜

⎠ ⎟

Page 52: Lecture 6: Langevin equations

Formal solution by FT

−iωI+ Γ( )x(ω) = ξ (ω)

x(ω)xT (−ω) = −iωI+ Γ( )−1

ξ (ω)ξ T (−ω) iωI+ ΓT( )

−1

= −iωI+ Γ( )−1

Δ iωI+ ΓT( )

−1

damped oscillator case:

x(ω)xT (−ω) =−iω −1 m

κ −iω + γ

⎝ ⎜

⎠ ⎟

−10 0

0 σ 2

⎝ ⎜

⎠ ⎟

iω κ

−1 m iω + γ

⎝ ⎜

⎠ ⎟

−1

=1

−iω(−iω + γ) + ω02 2

−iω + γ 1 m

−κ iω

⎝ ⎜

⎠ ⎟0 0

0 σ 2

⎝ ⎜

⎠ ⎟iω + γ −κ

1 m iω

⎝ ⎜

⎠ ⎟

=σ 2 m2

−iω(−iω + γ) + ω02 2

1 iωm

−iωm ω2m2

⎝ ⎜

⎠ ⎟

Page 53: Lecture 6: Langevin equations

General 1-d Langevin equation

dx

dt= F(x) + ξ (t)nonlinear:

Page 54: Lecture 6: Langevin equations

General 1-d Langevin equation

dx

dt= F(x) + ξ (t)

dx

dt= −γ sin(x) + ξ (t)

nonlinear:

ex: overdamped pendulum

Page 55: Lecture 6: Langevin equations

General 1-d Langevin equation

dx

dt= F(x) + ξ (t)

dx

dt= −γ sin(x) + ξ (t)

dx

dt= F(x) + G(x)ξ (t)

nonlinear:

ex: overdamped pendulum

with multiplicative noise

Page 56: Lecture 6: Langevin equations

General 1-d Langevin equation

dx

dt= F(x) + ξ (t)

dx

dt= −γ sin(x) + ξ (t)

dx

dt= F(x) + G(x)ξ (t)

dx

dt= rx + xξ (t)

nonlinear:

ex: overdamped pendulum

with multiplicative noise

ex: geometric Brownian motion

Page 57: Lecture 6: Langevin equations

Fokker-Planck for nonlinear case

x(t + Δt) = x(t) + F(x(t))Δt + ξ (t)Δt

Page 58: Lecture 6: Langevin equations

Fokker-Planck for nonlinear case

By definition of Gaussian noise ξ,

x(t + Δt) = x(t) + F(x(t))Δt + ξ (t)Δt

P x(t + Δt) | x(t)( ) =1

2πσ 2Δtexp −

x(t + Δt) − F x(t)( )Δt − x(t)( )2

2σ 2Δt

⎣ ⎢ ⎢

⎦ ⎥ ⎥

Page 59: Lecture 6: Langevin equations

Fokker-Planck for nonlinear case

By definition of Gaussian noise ξ,

x(t + Δt) = x(t) + F(x(t))Δt + ξ (t)Δt

P x(t + Δt) | x(t)( ) =1

2πσ 2Δtexp −

x(t + Δt) − F x(t)( )Δt − x(t)( )2

2σ 2Δt

⎣ ⎢ ⎢

⎦ ⎥ ⎥

Δx = F x(t)( )Δt, (Δx)2 = σ 2Δt

Page 60: Lecture 6: Langevin equations

Fokker-Planck for nonlinear case

By definition of Gaussian noise ξ,

x(t + Δt) = x(t) + F(x(t))Δt + ξ (t)Δt

P x(t + Δt) | x(t)( ) =1

2πσ 2Δtexp −

x(t + Δt) − F x(t)( )Δt − x(t)( )2

2σ 2Δt

⎣ ⎢ ⎢

⎦ ⎥ ⎥

Δx = F x(t)( )Δt, (Δx)2 = σ 2Δt

r1(x) = F(x) = u(x), r2(x) = σ 2 = 2D

in terms of Kramers-Moyal expansion coefficients,

Page 61: Lecture 6: Langevin equations

Fokker-Planck for nonlinear case

By definition of Gaussian noise ξ,

x(t + Δt) = x(t) + F(x(t))Δt + ξ (t)Δt

P x(t + Δt) | x(t)( ) =1

2πσ 2Δtexp −

x(t + Δt) − F x(t)( )Δt − x(t)( )2

2σ 2Δt

⎣ ⎢ ⎢

⎦ ⎥ ⎥

Δx = F x(t)( )Δt, (Δx)2 = σ 2Δt

r1(x) = F(x) = u(x), r2(x) = σ 2 = 2D

∂P

∂t= −

∂xF(x)P(x, t)( ) + 1

2 σ 2 ∂ 2P(x, t)

∂x 2

in terms of Kramers-Moyal expansion coefficients,

=> FP equation

Page 62: Lecture 6: Langevin equations

Fokker-Planck for nonlinear case

By definition of Gaussian noise ξ,

x(t + Δt) = x(t) + F(x(t))Δt + ξ (t)Δt

P x(t + Δt) | x(t)( ) =1

2πσ 2Δtexp −

x(t + Δt) − F x(t)( )Δt − x(t)( )2

2σ 2Δt

⎣ ⎢ ⎢

⎦ ⎥ ⎥

Δx = F x(t)( )Δt, (Δx)2 = σ 2Δt

r1(x) = F(x) = u(x), r2(x) = σ 2 = 2D

∂P

∂t= −

∂xF(x)P(x, t)( ) + 1

2 σ 2 ∂ 2P(x, t)

∂x 2

in terms of Kramers-Moyal expansion coefficients,

=> FP equation

(FP equation is still linear, though Langevin equation is nonlinear)

Page 63: Lecture 6: Langevin equations

with multiplicative noise

x(t + Δt) = x(t) + u(x(t))Δt + G x(t)( )ξ (t)Δt

Page 64: Lecture 6: Langevin equations

with multiplicative noise

x(t + Δt) = x(t) + u(x(t))Δt + G x(t)( )ξ (t)Δt

But ξ(t) is composed of δ-functionseach δ-function causes a jump in x

Page 65: Lecture 6: Langevin equations

with multiplicative noise

x(t + Δt) = x(t) + u(x(t))Δt + G x(t)( )ξ (t)Δt

But ξ(t) is composed of δ-functionseach δ-function causes a jump in xis the G(x(t)) to be evaluated before or after the jump, or in between?

Page 66: Lecture 6: Langevin equations

with multiplicative noise

x(t + Δt) = x(t) + u(x(t))Δt + G x(t)( )ξ (t)Δt

But ξ(t) is composed of δ-functionseach δ-function causes a jump in xis the G(x(t)) to be evaluated before or after the jump, or in between?

If you implement it numerically exactly as written, you are adopting

Page 67: Lecture 6: Langevin equations

with multiplicative noise

x(t + Δt) = x(t) + u(x(t))Δt + G x(t)( )ξ (t)Δt

But ξ(t) is composed of δ-functionseach δ-function causes a jump in xis the G(x(t)) to be evaluated before or after the jump, or in between?

If you implement it numerically exactly as written, you are adoptingthe Ito convention

Page 68: Lecture 6: Langevin equations

with multiplicative noise

x(t + Δt) = x(t) + u(x(t))Δt + G x(t)( )ξ (t)Δt

But ξ(t) is composed of δ-functionseach δ-function causes a jump in xis the G(x(t)) to be evaluated before or after the jump, or in between?

If you implement it numerically exactly as written, you are adoptingthe Ito convention

An alternative approach is to takeand take the limit τ -> 0 at the end.

ξ(t)ξ ( ′ t ) =σ 2

τf

t − ′ t

τ

⎝ ⎜

⎠ ⎟, f (x)dx =1

−∞

Page 69: Lecture 6: Langevin equations

with multiplicative noise

x(t + Δt) = x(t) + u(x(t))Δt + G x(t)( )ξ (t)Δt

But ξ(t) is composed of δ-functionseach δ-function causes a jump in xis the G(x(t)) to be evaluated before or after the jump, or in between?

If you implement it numerically exactly as written, you are adoptingthe Ito convention

An alternative approach is to takeand take the limit τ -> 0 at the end. This is

the Stratonovich convention

ξ(t)ξ ( ′ t ) =σ 2

τf

t − ′ t

τ

⎝ ⎜

⎠ ⎟, f (x)dx =1

−∞

Page 70: Lecture 6: Langevin equations

with multiplicative noise

x(t + Δt) = x(t) + u(x(t))Δt + G x(t)( )ξ (t)Δt

But ξ(t) is composed of δ-functionseach δ-function causes a jump in xis the G(x(t)) to be evaluated before or after the jump, or in between?

If you implement it numerically exactly as written, you are adoptingthe Ito convention

An alternative approach is to takeand take the limit τ -> 0 at the end. This is

the Stratonovich conventionIt is equivalent to evaluating G at the midpoint of the jump.

ξ(t)ξ ( ′ t ) =σ 2

τf

t − ′ t

τ

⎝ ⎜

⎠ ⎟, f (x)dx =1

−∞

Page 71: Lecture 6: Langevin equations

with multiplicative noise

x(t + Δt) = x(t) + u(x(t))Δt + G x(t)( )ξ (t)Δt

But ξ(t) is composed of δ-functionseach δ-function causes a jump in xis the G(x(t)) to be evaluated before or after the jump, or in between?

If you implement it numerically exactly as written, you are adoptingthe Ito convention

An alternative approach is to takeand take the limit τ -> 0 at the end. This is

the Stratonovich conventionIt is equivalent to evaluating G at the midpoint of the jump.With multiplicative noise, these 2 conventions lead to different FP equations

ξ(t)ξ ( ′ t ) =σ 2

τf

t − ′ t

τ

⎝ ⎜

⎠ ⎟, f (x)dx =1

−∞

Page 72: Lecture 6: Langevin equations

with multiplicative noise

x(t + Δt) = x(t) + u(x(t))Δt + G x(t)( )ξ (t)Δt

But ξ(t) is composed of δ-functionseach δ-function causes a jump in xis the G(x(t)) to be evaluated before or after the jump, or in between?

If you implement it numerically exactly as written, you are adoptingthe Ito convention

An alternative approach is to takeand take the limit τ -> 0 at the end. This is

the Stratonovich conventionIt is equivalent to evaluating G at the midpoint of the jump.With multiplicative noise, these 2 conventions lead to different FP equations. (For additive noise, they are 2 different ways to do the problem but must give the same answer.)

ξ(t)ξ ( ′ t ) =σ 2

τf

t − ′ t

τ

⎝ ⎜

⎠ ⎟, f (x)dx =1

−∞

Page 73: Lecture 6: Langevin equations

FP equations from Ito and Stratonovich

Ito (same argument as for additive noise case):

Page 74: Lecture 6: Langevin equations

FP equations from Ito and Stratonovich

Ito (same argument as for additive noise case):

∂P

∂t= −

∂xu(x)P(x, t)( ) + 1

2 σ 2 ∂ 2

∂x 2G2(x)P(x, t)( )

Page 75: Lecture 6: Langevin equations

FP equations from Ito and Stratonovich

Ito (same argument as for additive noise case):

∂P

∂t= −

∂xu(x)P(x, t)( ) + 1

2 σ 2 ∂ 2

∂x 2G2(x)P(x, t)( )

∂P

∂t= −

∂xu(x)P(x, t)( ) + 1

2 σ 2 ∂

∂xG(x)

∂xG(x)P(x, t)( )

⎝ ⎜

⎠ ⎟

Stratonovich (it can be shown that):

Page 76: Lecture 6: Langevin equations

FP equations from Ito and Stratonovich

Ito (same argument as for additive noise case):

∂P

∂t= −

∂xu(x)P(x, t)( ) + 1

2 σ 2 ∂ 2

∂x 2G2(x)P(x, t)( )

∂P

∂t= −

∂xu(x)P(x, t)( ) + 1

2 σ 2 ∂

∂xG(x)

∂xG(x)P(x, t)( )

⎝ ⎜

⎠ ⎟

∂P

∂t= −

∂xu(x) + 1

2 σ 2G(x) ′ G (x)( )P(x, t)[ ] + 12 σ 2 ∂ 2

∂x 2G2(x)P(x, t)( )

Stratonovich (it can be shown that):

or,equivalently,

Page 77: Lecture 6: Langevin equations

FP equations from Ito and Stratonovich

Ito (same argument as for additive noise case):

∂P

∂t= −

∂xu(x)P(x, t)( ) + 1

2 σ 2 ∂ 2

∂x 2G2(x)P(x, t)( )

∂P

∂t= −

∂xu(x)P(x, t)( ) + 1

2 σ 2 ∂

∂xG(x)

∂xG(x)P(x, t)( )

⎝ ⎜

⎠ ⎟

∂P

∂t= −

∂xu(x) + 1

2 σ 2G(x) ′ G (x)( )P(x, t)[ ] + 12 σ 2 ∂ 2

∂x 2G2(x)P(x, t)( )

Stratonovich (it can be shown that):

“anomalous drift”

or,equivalently,

Page 78: Lecture 6: Langevin equations

Where does the anomalous drift come from?

dx = u(x)dt + G(x) + 12

′ G (x)dx[ ]ξ (t)dt

From Stratonovich midpoint prescription:

Page 79: Lecture 6: Langevin equations

Where does the anomalous drift come from?

dx = u(x)dt + G(x) + 12

′ G (x)dx[ ]ξ (t)dt

= u(x)dt + G(x)ξ (t)dt + ′ G (x) u(x)dt + G(x)ξ (t)dt( )ξ (t)dt

From Stratonovich midpoint prescription:

Page 80: Lecture 6: Langevin equations

Where does the anomalous drift come from?

dx = u(x)dt + G(x) + 12

′ G (x)dx[ ]ξ (t)dt

= u(x)dt + G(x)ξ (t)dt + ′ G (x) u(x)dt + G(x)ξ (t)dt( )ξ (t)dt

= u(x)dt + G(x)ξ (t)dt + 12

′ G (x)G(x)ξ 2(t)dt 2

From Stratonovich midpoint prescription:

Page 81: Lecture 6: Langevin equations

Where does the anomalous drift come from?

dx = u(x)dt + G(x) + 12

′ G (x)dx[ ]ξ (t)dt

= u(x)dt + G(x)ξ (t)dt + ′ G (x) u(x)dt + G(x)ξ (t)dt( )ξ (t)dt

= u(x)dt + G(x)ξ (t)dt + 12

′ G (x)G(x)ξ 2(t)dt 2

= u(x)dt + σG(x)ξ (t)dt + 12

′ G (x)G(x) ξ 2(t) dt 2

From Stratonovich midpoint prescription:

Page 82: Lecture 6: Langevin equations

Where does the anomalous drift come from?

dx = u(x)dt + G(x) + 12

′ G (x)dx[ ]ξ (t)dt

= u(x)dt + G(x)ξ (t)dt + ′ G (x) u(x)dt + G(x)ξ (t)dt( )ξ (t)dt

= u(x)dt + G(x)ξ (t)dt + 12

′ G (x)G(x)ξ 2(t)dt 2

= u(x)dt + σG(x)ξ (t)dt + 12

′ G (x)G(x) ξ 2(t) dt 2

= u(x)dt + G(x)ξ (t)dt + 12

′ G (x)G(x)σ 2

dtdt 2

From Stratonovich midpoint prescription:

Page 83: Lecture 6: Langevin equations

Where does the anomalous drift come from?

dx = u(x)dt + G(x) + 12

′ G (x)dx[ ]ξ (t)dt

= u(x)dt + G(x)ξ (t)dt + ′ G (x) u(x)dt + G(x)ξ (t)dt( )ξ (t)dt

= u(x)dt + G(x)ξ (t)dt + 12

′ G (x)G(x)ξ 2(t)dt 2

= u(x)dt + σG(x)ξ (t)dt + 12

′ G (x)G(x) ξ 2(t) dt 2

= u(x)dt + G(x)ξ (t)dt + 12 ′ G (x)G(x)

σ 2

dtdt 2

= u(x) + 12 σ 2 ′ G (x)G(x)( )dt + G(x)ξ (t)dt

From Stratonovich midpoint prescription:

Page 84: Lecture 6: Langevin equations

formalism using differentialsSDE is written

dx = u(x)dt + σG(x)dW (t)

Page 85: Lecture 6: Langevin equations

formalism using differentialsSDE is written

dx = u(x)dt + σG(x)dW (t)

dW

dt= ξ (t), W (t) = ξ (t ')d ′ t

0

t

∫ ξ (t)ξ ( ′ t ) = δ(t − ′ t )

Page 86: Lecture 6: Langevin equations

formalism using differentialsSDE is written

dx = u(x)dt + σG(x)dW (t)

dW

dt= ξ (t), W (t) = ξ (t ')d ′ t

0

t

∫ ξ (t)ξ ( ′ t ) = δ(t − ′ t )

dW (t) = ξ (t)dt

Page 87: Lecture 6: Langevin equations

formalism using differentialsSDE is written

dx = u(x)dt + σG(x)dW (t)

dW

dt= ξ (t), W (t) = ξ (t ')d ′ t

0

t

∫ ξ (t)ξ ( ′ t ) = δ(t − ′ t )

dW (t) = ξ (t)dt

dW = 0, dW 2 = dt

Page 88: Lecture 6: Langevin equations

formalism using differentialsSDE is written

dx = u(x)dt + σG(x)dW (t)

dW

dt= ξ (t), W (t) = ξ (t ')d ′ t

0

t

∫ ξ (t)ξ ( ′ t ) = δ(t − ′ t )

dW (t) = ξ (t)dt

dW = 0, dW 2 = dt

Ito’s lemma: Consider some function F(x,t). What is dF(x,t)? Expand:

dF = F(x + dx, t + dt) − F(x, t)

Page 89: Lecture 6: Langevin equations

formalism using differentialsSDE is written

dx = u(x)dt + σG(x)dW (t)

dW

dt= ξ (t), W (t) = ξ (t ')d ′ t

0

t

∫ ξ (t)ξ ( ′ t ) = δ(t − ′ t )

dW (t) = ξ (t)dt

dW = 0, dW 2 = dt

Ito’s lemma: Consider some function F(x,t). What is dF(x,t)? Expand:

dF = F(x + dx, t + dt) − F(x, t)

= F x + u(x)dt + σG(x)dW (t), t + Δt( ) − F(x, t)

Page 90: Lecture 6: Langevin equations

formalism using differentialsSDE is written

dx = u(x)dt + σG(x)dW (t)

dW

dt= ξ (t), W (t) = ξ (t ')d ′ t

0

t

∫ ξ (t)ξ ( ′ t ) = δ(t − ′ t )

dW (t) = ξ (t)dt

dW = 0, dW 2 = dt

Ito’s lemma: Consider some function F(x,t). What is dF(x,t)? Expand:

dF = F(x + dx, t + dt) − F(x, t)

= F x + u(x)dt + σG(x)dW (t), t + Δt( ) − F(x, t)

=∂F

∂xu(x) +

∂F

∂t+ 1

2 σ 2 ∂ 2F

∂x 2G2(x)

⎝ ⎜

⎠ ⎟dt + σ

∂F

∂xG(x)dW

Page 91: Lecture 6: Langevin equations

formalism using differentialsSDE is written

dx = u(x)dt + σG(x)dW (t)

dW

dt= ξ (t), W (t) = ξ (t ')d ′ t

0

t

∫ ξ (t)ξ ( ′ t ) = δ(t − ′ t )

dW (t) = ξ (t)dt

dW = 0, dW 2 = dt

Ito’s lemma: Consider some function F(x,t). What is dF(x,t)? Expand:

dF = F(x + dx, t + dt) − F(x, t)

= F x + u(x)dt + σG(x)dW (t), t + Δt( ) − F(x, t)

=∂F

∂xu(x) +

∂F

∂t+ 1

2 σ 2 ∂ 2F

∂x 2G2(x)

⎝ ⎜

⎠ ⎟dt + σ

∂F

∂xG(x)dW

______________

“because dW = O(Δt)”