![Page 1: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/1.jpg)
Reversing time as an analytical tool:Isn’t that just Radon-Nikodym?
Phil Pollett
http://www.maths.uq.edu.au/˜pkp
AUSTRALIAN RESEARCH COUNCILCentre of Excellence for Mathematicsand Statistics of Complex Systems
MASCOS MASCOS Colloquium, May 2006 - Page 1
![Page 2: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/2.jpg)
Menuetto al rovesci
Joseph Haydn’s Sonata No. 4 for Violin and Piano (pianopart only) Menuetto al rovescio
MASCOS MASCOS Colloquium, May 2006 - Page 2
![Page 3: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/3.jpg)
Motet Diliges Dominum
William Byrd’s motet Diliges Dominum
MASCOS MASCOS Colloquium, May 2006 - Page 3
![Page 4: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/4.jpg)
Hammerklavier Sonata
Beethoven’s Piano Sonata No. 29 in B flat, Op. 106(“Hammerklavier”), Last movement (fugue) Allegro risoluto
MASCOS MASCOS Colloquium, May 2006 - Page 4
![Page 5: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/5.jpg)
Canon cancrizans
J.S. Bach’s Das Musikalische Opfer (The Musical Offering),BWV 1079, Canon 1. a 2 cancrizans
MASCOS MASCOS Colloquium, May 2006 - Page 5
![Page 6: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/6.jpg)
Canon cancrizans
MASCOS MASCOS Colloquium, May 2006 - Page 6
![Page 7: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/7.jpg)
Setting
(Ω,F , P) is our carrier triple.
(Xt, t ∈ T ) will denote a stochastic process with (ordered)parameter set T and state space (E, E). (T would usually be“time”: Z or Z+, or, R or R+.)
The “elementary picture” is: for each t ∈ T ,
Xt : Ω → E and X−1t : E → F ,
with Xt with F-measurable.
We shall assume that E includes all point sets of E, that is,for all x ∈ E, x ∈ E. At this stage, we make no furthertopological assumptions about the measurable space (E, E).
MASCOS MASCOS Colloquium, May 2006 - Page 7
![Page 8: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/8.jpg)
The time reverse process
Definition. Let (Xt, t ∈ T ) and (X∗t , t ∈ T ) be two stochastic
processes with the same parameter set T and the samestate space (E, E). We say that X∗ is a time reverse of X if,for any finite sequence t1 < t2 < · · · < tn in T such that
tn − tn−1 = t2 − t1, tn−2 − tn−1 = t3 − t2, . . . ,
and for any A1, A2, . . . , An ∈ E,
P (Xt1 ∈ A1, . . . , Xtn∈ An) = P
(
X∗t1 ∈ An, . . . , X∗
tn∈ A1
)
.
We say that X is time reversible if
P (Xt1 ∈ A1, . . . , Xtn∈ An) = P (Xt1 ∈ An, . . . , Xtn
∈ A1) .
MASCOS MASCOS Colloquium, May 2006 - Page 8
![Page 9: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/9.jpg)
The time reverse process
In particular, for all A,B ∈ E and t, u ∈ T ,
P (Xt ∈ A,Xu ∈ B) = P (X∗t ∈ B,X∗
u ∈ A) .
On taking B = E, we see that P (Xt ∈ A) = P (X∗u ∈ A), which
implies π(A) := P (Xt ∈ A) = P (X∗t ∈ A) (the same for all t).
MASCOS MASCOS Colloquium, May 2006 - Page 9
![Page 10: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/10.jpg)
The time reverse process
In particular, for all A,B ∈ E and t, u ∈ T ,
P (Xt ∈ A,Xu ∈ B) = P (X∗t ∈ B,X∗
u ∈ A) .
On taking B = E, we see that P (Xt ∈ A) = P (X∗u ∈ A), which
implies π(A) := P (Xt ∈ A) = P (X∗t ∈ A) (the same for all t).
Conclusion. The above definition only makes sense if X∗
and X are stationary with the same stationary law π.
MASCOS MASCOS Colloquium, May 2006 - Page 9
![Page 11: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/11.jpg)
The time reverse process
In particular, for all A,B ∈ E and t, u ∈ T ,
P (Xt ∈ A,Xu ∈ B) = P (X∗t ∈ B,X∗
u ∈ A) .
On taking B = E, we see that P (Xt ∈ A) = P (X∗u ∈ A), which
implies π(A) := P (Xt ∈ A) = P (X∗t ∈ A) (the same for all t).
Conclusion. The above definition only makes sense if X∗
and X are stationary with the same stationary law π.
Example. Brownian motion has no time reverse.
MASCOS MASCOS Colloquium, May 2006 - Page 9
![Page 12: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/12.jpg)
The time reverse process
In particular, for all A,B ∈ E and t, u ∈ T ,
P (Xt ∈ A,Xu ∈ B) = P (X∗t ∈ B,X∗
u ∈ A) .
On taking B = E, we see that P (Xt ∈ A) = P (X∗u ∈ A), which
implies π(A) := P (Xt ∈ A) = P (X∗t ∈ A) (the same for all t).
Conclusion. The above definition only makes sense if X∗
and X are stationary with the same stationary law π.
Example. Brownian motion has no time reverse.
Exercise. Think of a diffusion that does have a time reverse.
MASCOS MASCOS Colloquium, May 2006 - Page 9
![Page 13: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/13.jpg)
Transition function
pt(x, A) = P(Xs+t ∈ A|Xs = x)
MASCOS MASCOS Colloquium, May 2006 - Page 10
![Page 14: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/14.jpg)
The time reverse of a Markov process
Definition. If (E, E) is a measurable space, then a transitionfunction p = (pt, t ≥ 0) on (E, E) is a family of mappingspt : E × E → R+ with the following properties:(1) for all A ∈ E, pt(·, A) is an E-measurable function,(2) for all x ∈ E, pt(x, ·) is a subprobability measure on (E, E)
(that is, a measure on (E, E) with pt(x,E) ≤ 1),(3) the Chapman-Kolmogorov equation holds, that is, for allx ∈ E and A ∈ E, ps+t(x,A) =
∫
E ps(x, dy)pt(y, A), s, t ≥ 0, and
The transition function p is called honest if, for all x ∈ E andt ≥ 0, pt(x, ·) is a probability measure (pt(x,E) = 1).
MASCOS MASCOS Colloquium, May 2006 - Page 11
![Page 15: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/15.jpg)
The time reverse of a Markov process
It is “usual” to have p0(x,A) = IA(x) (x ∈ E, A ∈ E), but wecertainly do not require limt↓0 pt(x,A) = IA(x).
MASCOS MASCOS Colloquium, May 2006 - Page 12
![Page 16: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/16.jpg)
The time reverse of a Markov process
It is “usual” to have p0(x,A) = IA(x) (x ∈ E, A ∈ E), but wecertainly do not require limt↓0 pt(x,A) = IA(x).
Interpretation. For an honest transition function p therealways exists a (time-homogeneous) Markov process(Xt, t ≥ 0) with pt(x,A) = P(Xs+t ∈ A|Xs = x) (s, t ≥ 0, A ∈ E).
(If p is dishonest, then we can append a coffin state ∂
making p honest over (E∂ , E∂), where E∂ = E ∪ ∂.)
MASCOS MASCOS Colloquium, May 2006 - Page 12
![Page 17: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/17.jpg)
The time reverse of a Markov process
It is “usual” to have p0(x,A) = IA(x) (x ∈ E, A ∈ E), but wecertainly do not require limt↓0 pt(x,A) = IA(x).
Interpretation. For an honest transition function p therealways exists a (time-homogeneous) Markov process(Xt, t ≥ 0) with pt(x,A) = P(Xs+t ∈ A|Xs = x) (s, t ≥ 0, A ∈ E).
(If p is dishonest, then we can append a coffin state ∂
making p honest over (E∂ , E∂), where E∂ = E ∪ ∂.)
If X has stationary law π, that is, P (Xs ∈ A) = π(A), s ≥ 0,then, by Total Probability,
P (Xs ∈ A,Xt+s ∈ B) =∫
A π(dx)pt(x,B) (s, t ≥ 0).
MASCOS MASCOS Colloquium, May 2006 - Page 12
![Page 18: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/18.jpg)
The time reverse of a Markov process
Theorem 1. Let (Xt, t ≥ 0) and (X∗t , t ≥ 0) be two Markov
processes on the same state space (E, E) with transitionfunctions p and p∗, respectively. Then, X∗ is the time reverseof X if and only if
(1) X and X∗ are stationary with the same stationary law π.
(2) p∗ is the reverse of p with respect to π.
In particular (corollary! ), X is time reversible if and only if X
is stationary with stationary law π and p is reversible withrespect to π.
MASCOS MASCOS Colloquium, May 2006 - Page 13
![Page 19: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/19.jpg)
The time reverse of a Markov process
Theorem 1. Let (Xt, t ≥ 0) and (X∗t , t ≥ 0) be two Markov
processes on the same state space (E, E) with transitionfunctions p and p∗, respectively. Then, X∗ is the time reverseof X if and only if
(1) X and X∗ are stationary with the same stationary law π.
(2) p∗ is the reverse of p with respect to π.
In particular (corollary! ), X is time reversible if and only if X
is stationary with stationary law π and p is reversible withrespect to π.
So, what do I mean by “p∗ is the reverse of p with respect toπ” and “p is reversible with respect to π”?
MASCOS MASCOS Colloquium, May 2006 - Page 13
![Page 20: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/20.jpg)
The reverse transition function
Definition. Let p and p∗ transition functions on the samemeasurable space (E, E), and let m be a measure on (E, E).Then, p∗ is the reverse of p with respect to m if
∫
Bm(dx)pt(x,A) =
∫
Am(dx)p∗t (x,B) (A,B ∈ E , t ≥ 0).
If p is its own reverse with respect to m, that is,∫
Bm(dx)pt(x,A) =
∫
Am(dx)pt(x,B) (A,B ∈ E , t ≥ 0),
then p is said to be reversible with respect to m.
MASCOS MASCOS Colloquium, May 2006 - Page 14
![Page 21: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/21.jpg)
The reverse transition function
Some implications. Putting B = E we get∫
E m(dx)pt(x,A) =∫
A m(dx)p∗t (x,E) (A ∈ E , t ≥ 0).
Since p∗ is a transition function, p∗t (x, ·) is a subprobabilitymeasure, we get
∫
E m(dx)pt(x,A) ≤∫
A m(dx) = m(A) (A ∈ E , t ≥ 0).
MASCOS MASCOS Colloquium, May 2006 - Page 15
![Page 22: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/22.jpg)
The reverse transition function
Some implications. Putting B = E we get∫
E m(dx)pt(x,A) =∫
A m(dx)p∗t (x,E) (A ∈ E , t ≥ 0).
Since p∗ is a transition function, p∗t (x, ·) is a subprobabilitymeasure, we get
∫
E m(dx)pt(x,A) ≤∫
A m(dx) = m(A) (A ∈ E , t ≥ 0).
We say that m is a subinvariant measure for p.
MASCOS MASCOS Colloquium, May 2006 - Page 15
![Page 23: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/23.jpg)
The reverse transition function
Some implications. Putting B = E we get∫
E m(dx)pt(x,A) =∫
A m(dx)p∗t (x,E) (A ∈ E , t ≥ 0).
Since p∗ is a transition function, p∗t (x, ·) is a subprobabilitymeasure, we get
∫
E m(dx)pt(x,A) ≤∫
A m(dx) = m(A) (A ∈ E , t ≥ 0).
We say that m is a subinvariant measure for p. Moreover, m
is an invariant measure for p, that is equality holds,∫
E m(dx)pt(x,A) = m(A) (A ∈ E , t ≥ 0),
if p∗ is honest.
MASCOS MASCOS Colloquium, May 2006 - Page 15
![Page 24: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/24.jpg)
The reverse transition function
Conversely, if m is invariant for p, then∫
Am(dx) = m(A) =
∫
Em(dx)pt(x,A) =
∫
Am(dx)p∗t (x,E)
for all A ∈ E and t ≥ 0, that is,∫
Am(dx)(1 − p∗t (x,E)) ≥ 0 (A ∈ E , t ≥ 0),
So, if m is, additionally, a σ-finite measure, we may applyRadon-Nikodym to showa that p∗ is m − a.e. honest , that is,for all t > 0, p∗t (x,E) = 1 for m−almost all x ∈ E.
aI will write out the argument carefully later
MASCOS MASCOS Colloquium, May 2006 - Page 16
![Page 25: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/25.jpg)
Markov chains
This is trivial for MCs. For example, the discrete-time,discrete-state case . . ..
MASCOS MASCOS Colloquium, May 2006 - Page 17
![Page 26: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/26.jpg)
Markov chains
This is trivial for MCs. For example, the discrete-time,discrete-state case . . ..
Exercise. Let P = (p(i, j), i, j ∈ E) be a transition matrix andlet m = (m(j), j ∈ E) be a collection of positive numbers.Define P ∗ = (p∗(i, j), i, j,∈ E) by p∗(i, j) = m(j)p(j, i)/m(i)
(i, j ∈ E). Show that P ∗ is a transition matrix whenever m isinvariant for P , that is,
∑
j∈E
m(j)p(j, i) = m(i) (i ∈ E).
MASCOS MASCOS Colloquium, May 2006 - Page 17
![Page 27: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/27.jpg)
Markov chains
This is trivial for MCs. For example, the discrete-time,discrete-state case . . ..
Exercise. Let P = (p(i, j), i, j ∈ E) be a transition matrix andlet m = (m(j), j ∈ E) be a collection of positive numbers.Define P ∗ = (p∗(i, j), i, j,∈ E) by p∗(i, j) = m(j)p(j, i)/m(i)
(i, j ∈ E). Show that P ∗ is a transition matrix whenever m isinvariant for P , that is,
∑
j∈E
m(j)p(j, i) = m(i) (i ∈ E).
Exercise. Agree that the n-step transition matrices bear thesame relationship: m(i)p∗n(i, j) = m(j)pn(j, i) (i, j ∈ E).
MASCOS MASCOS Colloquium, May 2006 - Page 17
![Page 28: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/28.jpg)
The reverse transition function
Question. Given a transition function p and a subinvariantmeasure m on (E, E), can we always find a transition functionp∗ on (E, E) that is the reverse of p with respect to m? That is,
∫
Bm(dx)pt(x,A) =
∫
Am(dx)p∗t (x,B) (A,B ∈ E , t ≥ 0).
MASCOS MASCOS Colloquium, May 2006 - Page 18
![Page 29: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/29.jpg)
The reverse transition function
Question. Given a transition function p and a subinvariantmeasure m on (E, E), can we always find a transition functionp∗ on (E, E) that is the reverse of p with respect to m? That is,
∫
Bm(dx)pt(x,A) =
∫
Am(dx)p∗t (x,B) (A,B ∈ E , t ≥ 0).
Exercise. (Hint!) Let m be a σ-finite measure on (E, E).Show that, for every B ∈ E with m(B) < ∞,µB(·) :=
∫
B m(dx)pt(x, ·) is a finite measure on (E, E).
MASCOS MASCOS Colloquium, May 2006 - Page 18
![Page 30: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/30.jpg)
The reverse transition function
Question. Given a transition function p and a subinvariantmeasure m on (E, E), can we always find a transition functionp∗ on (E, E) that is the reverse of p with respect to m? That is,
∫
Bm(dx)pt(x,A) =
∫
Am(dx)p∗t (x,B) (A,B ∈ E , t ≥ 0).
Exercise. (Hint!) Let m be a σ-finite measure on (E, E).Show that, for every B ∈ E with m(B) < ∞,µB(·) :=
∫
B m(dx)pt(x, ·) is a finite measure on (E, E).
Exercise. (Bigger hint!) Let m be a σ-finite measure on(E, E) that is subinvariant for p. Show that, for every B ∈ E,µB is a absolutely continuous with respect to m.
MASCOS MASCOS Colloquium, May 2006 - Page 18
![Page 31: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/31.jpg)
The time reverse of a Markov process
Theorem 1. Let (Xt, t ≥ 0) and (X∗t , t ≥ 0) be two Markov
processes on the same state space (E, E) with transitionfunctions p and p∗, respectively. Then, X∗ is the time reverseof X if and only if
(1) X and X∗ are stationary with the same stationary law π.
(2) p∗ is the reverse of p with respect to π.
MASCOS MASCOS Colloquium, May 2006 - Page 19
![Page 32: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/32.jpg)
The time reverse of a Markov process
Theorem 1. Let (Xt, t ≥ 0) and (X∗t , t ≥ 0) be two Markov
processes on the same state space (E, E) with transitionfunctions p and p∗, respectively. Then, X∗ is the time reverseof X if and only if
(1) X and X∗ are stationary with the same stationary law π.
(2) p∗ is the reverse of p with respect to π.
Proof. Suppose X∗ is the time reverse of X.
MASCOS MASCOS Colloquium, May 2006 - Page 19
![Page 33: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/33.jpg)
The time reverse of a Markov process
Theorem 1. Let (Xt, t ≥ 0) and (X∗t , t ≥ 0) be two Markov
processes on the same state space (E, E) with transitionfunctions p and p∗, respectively. Then, X∗ is the time reverseof X if and only if
(1) X and X∗ are stationary with the same stationary law π.
(2) p∗ is the reverse of p with respect to π.
Proof. Suppose X∗ is the time reverse of X. We havealready seen that X and X∗ are necessarily stationary withthe same stationary law π, and that
P (Xs ∈ A,Xt+s ∈ B) =
∫
Aπ(dx)pt(x,B) (A,B ∈ E , s, t ≥ 0).
MASCOS MASCOS Colloquium, May 2006 - Page 19
![Page 34: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/34.jpg)
The time reverse of a Markov process
Thus, for all A,B ∈ E, s, t ≥ 0,∫
Aπ(dx)pt(x,B) = P (Xs ∈ A,Xt+s ∈ B)
= P(
X∗s ∈ B,X∗
t+s ∈ A)
=
∫
Bπ(dx)p∗t (x,A).
MASCOS MASCOS Colloquium, May 2006 - Page 20
![Page 35: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/35.jpg)
The time reverse of a Markov process
Thus, for all A,B ∈ E, s, t ≥ 0,∫
Aπ(dx)pt(x,B) = P (Xs ∈ A,Xt+s ∈ B)
= P(
X∗s ∈ B,X∗
t+s ∈ A)
=
∫
Bπ(dx)p∗t (x,A).
Conversely, if (1) and (2) hold, then, as we have alreadyseen, π is an invariant measure for p (and for p∗):
∫
Eπ(dx)pt(x,B) = π(B), π(A) =
∫
Eπ(dx)p∗t (x,A).
MASCOS MASCOS Colloquium, May 2006 - Page 20
![Page 36: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/36.jpg)
The time reverse of a Markov process
Therefore, for any t1 < t2 < · · · < tn in T such thattn − tn−1 = t2 − t1, tn−2 − tn−1 = t3 − t2, . . . , and for anyA1, A2, . . . , An ∈ E,
P (Xt1 ∈ A1, . . . , Xtn∈ An) =
∫
E π(dx)∫
A1
pt1(x, dx1)∫
A2
pt2−t1(x1, dx2) . . .∫
Anptn−tn−1
(xn−1, dxn).
Since π is invariant for p, this becomes
∫
A1
π(dx1)∫
A2
pt2−t1(x1, dx2) . . .∫
Anptn−tn−1
(xn−1, dxn)
=∫
Anπ(dxn)
∫
An−1
p∗tn−tn−1(xn, dxn−1) . . .
∫
A1
p∗t2−t1(x2, dx1),
repeatedly applying∫
A π(dx)pt(x,B) =∫
B π(dx)p∗t (x,A).
MASCOS MASCOS Colloquium, May 2006 - Page 21
![Page 37: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/37.jpg)
The time reverse of a Markov process
Now use tn − tn−1 = t2 − t1, tn−2 − tn−1 = t3 − t2, . . . , togetherwith the fact that π is invariant for p∗, to complete the proof:
P (Xt1 ∈ A1, . . . , Xtn∈ An)
=∫
Anπ(dxn)
∫
An−1
p∗tn−tn−1(xn, dxn−1) . . .
∫
A1
p∗t2−t1(x2, dx1)
=∫
Anπ(dx1)
∫
An−1
p∗tn−tn−1(x1, dx2) . . .
∫
A1
p∗t2−t1(xn−1, dxn)
=∫
Anπ(dx1)
∫
An−1
p∗t2−t1(x1, dx2) . . .∫
A1
p∗tn−tn−1(xn−1, dxn)
= P(
X∗t1 ∈ An, . . . , X∗
tn∈ A1
)
.
MASCOS MASCOS Colloquium, May 2006 - Page 22
![Page 38: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/38.jpg)
The time reverse of a Markov process
Example. The Ornstein-Uhlenbeck (OU) process.
MASCOS MASCOS Colloquium, May 2006 - Page 23
![Page 39: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/39.jpg)
The time reverse of a Markov process
Example. The Ornstein-Uhlenbeck (OU) process. It is a(Gaussian) diffusion process (Zt, t ≥ 0) on (R,B(R)) thatsatisfies
dZt = −βZt dt + σdBt (t ≥ 0),
where (Bt, t ≥ 0) is standard Brownian motion on (R,B(R))
and β and σ are positive constants.
MASCOS MASCOS Colloquium, May 2006 - Page 23
![Page 40: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/40.jpg)
The time reverse of a Markov process
Example. The Ornstein-Uhlenbeck (OU) process. It is a(Gaussian) diffusion process (Zt, t ≥ 0) on (R,B(R)) thatsatisfies
dZt = −βZt dt + σdBt (t ≥ 0),
where (Bt, t ≥ 0) is standard Brownian motion on (R,B(R))
and β and σ are positive constants.
Its transition function p is absolutely continuous with respectto Lebesgue measurea in that pt(x,A) =
∫
A pt(x, y) dy, wherept(x, y) (the transition density) is the Gaussian density withmean xe−βt and variance σ2(1 − e−2βt)/(2β).
aTrue for all diffusions!
MASCOS MASCOS Colloquium, May 2006 - Page 24
![Page 41: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/41.jpg)
The time reverse of a Markov process
Exercise. Show that π given by π(A) =∫
A φ(y) dy, where φ isthe Gaussian density with mean 0 and variance σ2/(2β), isan invariant probability measure for p.
MASCOS MASCOS Colloquium, May 2006 - Page 25
![Page 42: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/42.jpg)
The time reverse of a Markov process
Exercise. Show that π given by π(A) =∫
A φ(y) dy, where φ isthe Gaussian density with mean 0 and variance σ2/(2β), isan invariant probability measure for p.
You will need to verify that∫
Rπ(dx)pt(x,A) = π(A),
or, equivalently, for the transition density,∫ ∞
−∞
φ(x)pt(x, y) dx = φ(y) (t ≥ 0, y ∈ R).
MASCOS MASCOS Colloquium, May 2006 - Page 25
![Page 43: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/43.jpg)
The time reverse of a Markov process
During that painful procedure you may discover a better way.
MASCOS MASCOS Colloquium, May 2006 - Page 26
![Page 44: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/44.jpg)
The time reverse of a Markov process
During that painful procedure you may discover a better way.
It is considerably easier to verify that
φ(x)pt(x, y) = φ(y)pt(y, x) (t ≥ 0, x, y ∈ R).
MASCOS MASCOS Colloquium, May 2006 - Page 26
![Page 45: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/45.jpg)
The time reverse of a Markov process
During that painful procedure you may discover a better way.
It is considerably easier to verify that
φ(x)pt(x, y) = φ(y)pt(y, x) (t ≥ 0, x, y ∈ R).
We conclude that∫
Aπ(dx)pt(x,B) =
∫
Bπ(dy)pt(y, A).
MASCOS MASCOS Colloquium, May 2006 - Page 26
![Page 46: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/46.jpg)
The time reverse of a Markov process
During that painful procedure you may discover a better way.
It is considerably easier to verify that
φ(x)pt(x, y) = φ(y)pt(y, x) (t ≥ 0, x, y ∈ R).
We conclude that∫
Aπ(dx)pt(x,B) =
∫
Bπ(dy)pt(y, A).
Hence, the transition function p is reversible with respect toπ, and (as before, putting A = E (= R)), π is invariant for p.
MASCOS MASCOS Colloquium, May 2006 - Page 26
![Page 47: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/47.jpg)
The time reverse of a Markov process
During that painful procedure you may discover a better way.
It is considerably easier to verify that
φ(x)pt(x, y) = φ(y)pt(y, x) (t ≥ 0, x, y ∈ R).
We conclude that∫
Aπ(dx)pt(x,B) =
∫
Bπ(dy)pt(y, A).
Hence, the transition function p is reversible with respect toπ, and (as before, putting A = E (= R)), π is invariant for p.
Also, by Theorem 1, our process Z (the stationary OUprocess) is time reversible.
MASCOS MASCOS Colloquium, May 2006 - Page 26
![Page 48: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/48.jpg)
The time reverse of a Markov process
Example. Brownian motion (this time on (Rn,B(Rn))).
MASCOS MASCOS Colloquium, May 2006 - Page 27
![Page 49: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/49.jpg)
The time reverse of a Markov process
Example. Brownian motion (this time on (Rn,B(Rn))). Wehave already agreed that there is no time reverse.
MASCOS MASCOS Colloquium, May 2006 - Page 27
![Page 50: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/50.jpg)
The time reverse of a Markov process
Example. Brownian motion (this time on (Rn,B(Rn))). Wehave already agreed that there is no time reverse.
But, its transition density
pt(x, y) = (2πt)−n/2 exp (−|y − x|/2t) (x, y ∈ Rn)
satisfies pt(x, y) = pt(y, x), and so its transition function p isreversible with respect to Lebesgue measure (and henceinvariant for p).
MASCOS MASCOS Colloquium, May 2006 - Page 27
![Page 51: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/51.jpg)
The time reverse of a Markov process
Example. Brownian motion (this time on (Rn,B(Rn))). Wehave already agreed that there is no time reverse.
But, its transition density
pt(x, y) = (2πt)−n/2 exp (−|y − x|/2t) (x, y ∈ Rn)
satisfies pt(x, y) = pt(y, x), and so its transition function p isreversible with respect to Lebesgue measure (and henceinvariant for p).
For the complete story on reversible diffusions (notnecessarily time-reversible!), see John Kent’s 1978 paper∗.
∗Kent, J. (1978) Time-reversible diffusions, Adv. Appl. Probab. 10, 819–835.
MASCOS MASCOS Colloquium, May 2006 - Page 27
![Page 52: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/52.jpg)
The reverse transition function
The reverse transition function as an analytical tool.Suppose that we are given a transition function p andmeasure m on (E, E). If we can determine the reversetransition function, that is, a transition function p∗ on (E, E)
satisfying∫
B m(dx)pt(x,A) =∫
A m(dx)p∗t (x,B), A,B ∈ E, t ≥ 0,then, as already remarked, m will be subinvariant for p andinvariant for p if p∗ is honest (and only if p∗ is m− a.e. honest).
MASCOS MASCOS Colloquium, May 2006 - Page 28
![Page 53: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/53.jpg)
The reverse transition function
The reverse transition function as an analytical tool.Suppose that we are given a transition function p andmeasure m on (E, E). If we can determine the reversetransition function, that is, a transition function p∗ on (E, E)
satisfying∫
B m(dx)pt(x,A) =∫
A m(dx)p∗t (x,B), A,B ∈ E, t ≥ 0,then, as already remarked, m will be subinvariant for p andinvariant for p if p∗ is honest (and only if p∗ is m− a.e. honest).
Of course, in most cases, we would be given morefundamental information, such as the diffusion coefficients(diffusions), or the transition rates (chains). We might hopeto be able to establish the existence, and then the honesty ofp∗ without actually exhibiting p∗ explicitly .
MASCOS MASCOS Colloquium, May 2006 - Page 28
![Page 54: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/54.jpg)
The reverse transition function
Recall the hints:
MASCOS MASCOS Colloquium, May 2006 - Page 29
![Page 55: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/55.jpg)
The reverse transition function
Recall the hints:Exercise. (Hint!) Let m be a σ-finite measure on (E, E).Show that, for every B ∈ E with m(B) < ∞,µB(·) :=
∫
B m(dx)pt(x, ·) is a finite measure on (E, E).
MASCOS MASCOS Colloquium, May 2006 - Page 29
![Page 56: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/56.jpg)
The reverse transition function
Recall the hints:Exercise. (Hint!) Let m be a σ-finite measure on (E, E).Show that, for every B ∈ E with m(B) < ∞,µB(·) :=
∫
B m(dx)pt(x, ·) is a finite measure on (E, E).
Solution. Clearly µB(·) ≥ 0, µB(∅) = 0 and µB(·) is countablyadditive by Fubini (since m is σ-finite). Also, sincept(x,E) ≤ 1, we have µB(E) ≤
∫
B m(dx) = m(B) < ∞.
MASCOS MASCOS Colloquium, May 2006 - Page 29
![Page 57: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/57.jpg)
The reverse transition function
Recall the hints:Exercise. (Hint!) Let m be a σ-finite measure on (E, E).Show that, for every B ∈ E with m(B) < ∞,µB(·) :=
∫
B m(dx)pt(x, ·) is a finite measure on (E, E).
Solution. Clearly µB(·) ≥ 0, µB(∅) = 0 and µB(·) is countablyadditive by Fubini (since m is σ-finite). Also, sincept(x,E) ≤ 1, we have µB(E) ≤
∫
B m(dx) = m(B) < ∞.
Exercise. (Bigger hint!) Let m be a σ-finite measure on(E, E) that is subinvariant for p. Show that, for every B ∈ E,µB is a absolutely continuous with respect to m.
MASCOS MASCOS Colloquium, May 2006 - Page 29
![Page 58: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/58.jpg)
The reverse transition function
Recall the hints:Exercise. (Hint!) Let m be a σ-finite measure on (E, E).Show that, for every B ∈ E with m(B) < ∞,µB(·) :=
∫
B m(dx)pt(x, ·) is a finite measure on (E, E).
Solution. Clearly µB(·) ≥ 0, µB(∅) = 0 and µB(·) is countablyadditive by Fubini (since m is σ-finite). Also, sincept(x,E) ≤ 1, we have µB(E) ≤
∫
B m(dx) = m(B) < ∞.
Exercise. (Bigger hint!) Let m be a σ-finite measure on(E, E) that is subinvariant for p. Show that, for every B ∈ E,µB is a absolutely continuous with respect to m.
Solution. We are told that∫
E m(dx)pt(x,A) ≤ m(A) (A ∈ E).So, µB(A) ≤ m(A), and hence m(N) = 0 ⇒ µB(N) = 0.
MASCOS MASCOS Colloquium, May 2006 - Page 29
![Page 59: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/59.jpg)
The reverse transition function
We’re in business! Radon-Nikodym provides us with anE-measurable (m-integrable) non-negative function f defineuniquely m − a.e. by µB(A) =
∫
A f(x)m(dx) (A ∈ E).
MASCOS MASCOS Colloquium, May 2006 - Page 30
![Page 60: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/60.jpg)
The reverse transition function
We’re in business! Radon-Nikodym provides us with anE-measurable (m-integrable) non-negative function f defineuniquely m − a.e. by µB(A) =
∫
A f(x)m(dx) (A ∈ E).
Writing this out carefully: if m is a σ-finite measure that issubinvariant for p, then, for all t ≥ 0, and for every B ∈ E withm(B) < ∞, there is an E-measurable ft(·, B) that satisfies
∫
B m(dx)pt(x,A) =∫
A m(dx)ft(x,B) (A ∈ E).
MASCOS MASCOS Colloquium, May 2006 - Page 30
![Page 61: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/61.jpg)
The reverse transition function
We’re in business! Radon-Nikodym provides us with anE-measurable (m-integrable) non-negative function f defineuniquely m − a.e. by µB(A) =
∫
A f(x)m(dx) (A ∈ E).
Writing this out carefully: if m is a σ-finite measure that issubinvariant for p, then, for all t ≥ 0, and for every B ∈ E withm(B) < ∞, there is an E-measurable ft(·, B) that satisfies
∫
B m(dx)pt(x,A) =∫
A m(dx)ft(x,B) (A ∈ E).
So, yes, for all such B, ft(·, B) is E-measurable.
MASCOS MASCOS Colloquium, May 2006 - Page 30
![Page 62: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/62.jpg)
The reverse transition function
We’re in business! Radon-Nikodym provides us with anE-measurable (m-integrable) non-negative function f defineuniquely m − a.e. by µB(A) =
∫
A f(x)m(dx) (A ∈ E).
Writing this out carefully: if m is a σ-finite measure that issubinvariant for p, then, for all t ≥ 0, and for every B ∈ E withm(B) < ∞, there is an E-measurable ft(·, B) that satisfies
∫
B m(dx)pt(x,A) =∫
A m(dx)ft(x,B) (A ∈ E).
So, yes, for all such B, ft(·, B) is E-measurable.
But, we are along way from proving anything pleasing.
MASCOS MASCOS Colloquium, May 2006 - Page 30
![Page 63: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/63.jpg)
The reverse transition function
We’re in business! Radon-Nikodym provides us with anE-measurable (m-integrable) function f define uniquelym − a.e. by µB(A) =
∫
A f(x)m(dx) (A ∈ E).
Writing this out carefully: if m is a σ-finite measure that issubinvariant for p, then, for all t ≥ 0, and for every B ∈ E withm(B) < ∞, there is an E-measurable ft(·, B) that satisfies
∫
B m(dx)pt(x,A) =∫
A m(dx)ft(x,B) (A ∈ E).
So, yes, for all such B, ft(·, B) is E-measurable.
But, we are along way from proving anything useful.
Why?
MASCOS MASCOS Colloquium, May 2006 - Page 31
![Page 64: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/64.jpg)
The reverse transition function
First, m being totally finite is too restrictive.
MASCOS MASCOS Colloquium, May 2006 - Page 32
![Page 65: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/65.jpg)
The reverse transition function
First, m being totally finite is too restrictive.
Second, we need to show
(2) that ft(x, ·) is a subprobability measure on (E, E), and
(3) that f satisfies the Chapman-Kolmogorov equationfs+t(x,A) =
∫
E fs(x, dy)ft(y, A),
before we can assert the existence of a reverse transitionfunction.
MASCOS MASCOS Colloquium, May 2006 - Page 32
![Page 66: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/66.jpg)
The reverse transition function
First, m being totally finite is too restrictive.
Second, we need to show
(2) that ft(x, ·) is a subprobability measure on (E, E), and
(3) that f satisfies the Chapman-Kolmogorov equationfs+t(x,A) =
∫
E fs(x, dy)ft(y, A),
before we can assert the existence of a reverse transitionfunction.
And third, we need a refinement of the usual definition of atransition function (because our reverse transition functioncan at best be known m − a.e. uniquely), which was . . .
MASCOS MASCOS Colloquium, May 2006 - Page 32
![Page 67: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/67.jpg)
The reverse transition function
Definition. If (E, E) is a measurable space, then a transitionfunction p = (pt, t ≥ 0) on (E, E) is a family of mappingspt : E × E → R+ with the following properties:(1) for all A ∈ E, pt(·, A) is an E-measurable function,(2) for all x ∈ E, pt(x, ·) is a subprobability measure on (E, E)
(that is, a measure on (E, E) with pt(x,E) ≤ 1),(3) the Chapman-Kolmogorov equation holds, that is, for allx ∈ E and A ∈ E, ps+t(x,A) =
∫
E ps(x, dy)pt(y, A), s, t ≥ 0
(unmarked sums shall be over E), and
The transition function p is called honest if, for all x ∈ E andt ≥ 0, pt(x, ·) is a probability measure (pt(x,E) = 1).
MASCOS MASCOS Colloquium, May 2006 - Page 33
![Page 68: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/68.jpg)
The reverse transition function
Definition. If (E, E) be a measurable space and let m be aσ-finite measure on (E, E). Then, an m − a.e. transitionfunction p = (pt, t ≥ 0) on (E, E) is a family of mappingspt : E × E → R+ with the usual properties (1)–(3), but (2) and(3) are required to hold for m−almost all x ∈ E.
An m − a.e. transition function p is called honest if, for allt ≥ 0, pt(x, ·) is a probability measure (pt(x,E) = 1) form−almost all x ∈ E.
MASCOS MASCOS Colloquium, May 2006 - Page 34
![Page 69: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/69.jpg)
The reverse transition function
Definition. If (E, E) be a measurable space and let m be aσ-finite measure on (E, E). Then, an m − a.e. transitionfunction p = (pt, t ≥ 0) on (E, E) is a family of mappingspt : E × E → R+ with the usual properties (1)–(3), but (2) and(3) are required to hold for m−almost all x ∈ E.
An m − a.e. transition function p is called honest if, for allt ≥ 0, pt(x, ·) is a probability measure (pt(x,E) = 1) form−almost all x ∈ E.
Next we will show that our candidate reverse transitionfunction f satisfies (2) and (3) assuming that outsubinvariant measure m is a finite measure–thus avoidingtechnicalities.
MASCOS MASCOS Colloquium, May 2006 - Page 34
![Page 70: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/70.jpg)
The reverse transition function
Recall that f is determined m − a.e. uniquely: for all t ≥ 0,and for every B ∈ E, there is an E-measurable ft(·, B) thatsatisfies
∫
B m(dx)pt(x,A) =∫
A m(dx)ft(x,B) (A ∈ E).
Remember we are assuming that m(B) < ∞ for all B ∈ E.
MASCOS MASCOS Colloquium, May 2006 - Page 35
![Page 71: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/71.jpg)
The reverse transition function
Recall that f is determined m − a.e. uniquely: for all t ≥ 0,and for every B ∈ E, there is an E-measurable ft(·, B) thatsatisfies
∫
B m(dx)pt(x,A) =∫
A m(dx)ft(x,B) (A ∈ E).
Remember we are assuming that m(B) < ∞ for all B ∈ E.
First we prove that for m-almost all x, ft(x, ·) is asubprobability measure on (E, E), that is, a measure on(E, E) with ft(x,E) ≤ 1.
MASCOS MASCOS Colloquium, May 2006 - Page 35
![Page 72: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/72.jpg)
The reverse transition function
Claim. ft(x,E) ≤ 1 . . . . . .
MASCOS MASCOS Colloquium, May 2006 - Page 36
![Page 73: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/73.jpg)
The reverse transition function
Claim. ft(x,E) ≤ 1 . . . . . .
Take B = E in the definition of f :∫
E m(dx)pt(x,A) =∫
A m(dx)ft(x,E) (A ∈ E , t ≥ 0).
So, for all A ∈ E,∫
A m(dx)ft(x,E) =∫
E m(dx)pt(x,A) ≤ m(A) =∫
A m(dx),
and hence∫
A m(dx) (1 − ft(x,E)) =∫
A m(dx) −∫
A m(dx)ft(x,E) ≥ 0.
MASCOS MASCOS Colloquium, May 2006 - Page 36
![Page 74: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/74.jpg)
The reverse transition function
It follows that∫
(·) m(dx) (1 − ft(x,E)) is a totally finite positivemeasure on (E, E).
It is absolutely continuous with respect to m, because if N isan m-null set in E, then
(0 ≤)∫
N m(dx) (1 − ft(x,E)) ≤∫
N m(dx) = m(N) = 0,
and hence it has the m − a.e. uniquely determinedRadon-Nikodym derivative 1 − ft(x,E).
Since the latter is m − a.e. unique, it is therefore m − a.e.
positive, that is, ft(x,E) ≤ 1, for m−almost all x ∈ E.
MASCOS MASCOS Colloquium, May 2006 - Page 37
![Page 75: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/75.jpg)
The reverse transition function
Claim. ft(x, ·) is a measure for m-almost all x . . . . . .
MASCOS MASCOS Colloquium, May 2006 - Page 38
![Page 76: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/76.jpg)
The reverse transition function
Claim. ft(x, ·) is a measure for m-almost all x . . . . . .
First,0 =
∫
∅m(dx)pt(x,A) =
∫
A m(dx)ft(x, ∅) (A ∈ E).
and hence, by the Radon-Nikodym Theorem, ft(x, ∅) = 0 form-almost all x.
MASCOS MASCOS Colloquium, May 2006 - Page 38
![Page 77: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/77.jpg)
The reverse transition function
Claim. ft(x, ·) is a measure for m-almost all x . . . . . .
First,0 =
∫
∅m(dx)pt(x,A) =
∫
A m(dx)ft(x, ∅) (A ∈ E).
and hence, by the Radon-Nikodym Theorem, ft(x, ∅) = 0 form-almost all x.
We already have ft(·, B) ≥ 0, m − a.e., so we only need tocheck σ-additivity.
MASCOS MASCOS Colloquium, May 2006 - Page 38
![Page 78: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/78.jpg)
The reverse transition function
Let B1, B2, . . . be a sequence of disjoint sets in E. Using thedefinition of f and Fubini, we have, for all A ∈ E,
∫
A m(dx)ft (x,∪jBj) =∫
(∪jBj)m(dx)pt(x,A)
=∑
j
∫
Bjm(dx)pt(x,A)
=∑
j
∫
A m(dx)ft(x,Bj)
=∫
A m(dx)∑
j ft(x,Bj) (< ∞),
That is,∫
A m(dx)(
ft (x,∪jBj) −∑
j ft(x,Bj))
, for all A ∈ E,
and hence ft (·,∪jBj) =∑
j ft(·, Bj), m − a.e. (again by theRadon-Nikodym Theorem).
MASCOS MASCOS Colloquium, May 2006 - Page 39
![Page 79: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/79.jpg)
The reverse transition function
Finally, we tackle the Chapman-Kolmogorov equation . . . . . .
MASCOS MASCOS Colloquium, May 2006 - Page 40
![Page 80: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/80.jpg)
The reverse transition function
Finally, we tackle the Chapman-Kolmogorov equation . . . . . .
Since∫
B m(dx)pt(x,A) =∫
A m(dx)ft(x,B) for all A,B ∈ E, we
have that∫
A m(dx)fs+t(x,B)=∫
B m(dx)ps+t(x,A)
=∫
B m(dx)∫
E pt(x, dy)ps(y, A)
=∫
A m(dx)∫
E fs(x, dy)ft(y,B).
The Radon-Nikodym Theorem then tells us that
fs+t( · , B) =∫
E fs( · , dy)ft(y,B), m − a.e.
MASCOS MASCOS Colloquium, May 2006 - Page 40
![Page 81: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/81.jpg)
The reverse transition function
Finally, we tackle the Chapman-Kolmogorov equation . . . . . .
Since∫
B m(dx)pt(x,A) =∫
A m(dx)ft(x,B) for all A,B ∈ E, we
have that∫
A m(dx)fs+t(x,B)=∫
B m(dx)ps+t(x,A)
=∫
B m(dx)∫
E pt(x, dy)ps(y, A)
=∫
A m(dx)∫
E fs(x, dy)ft(y,B).
The Radon-Nikodym Theorem then tells us that
fs+t( · , B) =∫
E fs( · , dy)ft(y,B), m − a.e.
We have proved the following simple result.
MASCOS MASCOS Colloquium, May 2006 - Page 40
![Page 82: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/82.jpg)
The reverse transition function
Proposition 1. Let p be a transition function on ameasurable space (E, E) and suppose that m is a totallyfinite measure on (E, E) that is subinvariant for p. Then thereexists an m − a.e. transition function p∗ which is the m − a.e.
unique reverse of p with respect to m.
MASCOS MASCOS Colloquium, May 2006 - Page 41
![Page 83: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/83.jpg)
The reverse transition function
Proposition 1. Let p be a transition function on ameasurable space (E, E) and suppose that m is a totallyfinite measure on (E, E) that is subinvariant for p. Then thereexists an m − a.e. transition function p∗ which is the m − a.e.
unique reverse of p with respect to m.
We would like to relax “m totally finite” to the weakercondition “m σ-finite”.
MASCOS MASCOS Colloquium, May 2006 - Page 41
![Page 84: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/84.jpg)
The reverse transition function
Proposition 1. Let p be a transition function on ameasurable space (E, E) and suppose that m is a totallyfinite measure on (E, E) that is subinvariant for p. Then thereexists an m − a.e. transition function p∗ which is the m − a.e.
unique reverse of p with respect to m.
We would like to relax “m totally finite” to the weakercondition “m σ-finite”.
I am happy to report the following pleasing result.
MASCOS MASCOS Colloquium, May 2006 - Page 41
![Page 85: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/85.jpg)
The reverse transition function
Theorem 2. Let (E,O, E) be an inner-regular, measurabletopological space with a countable basis. Let p be atransition function on (E, E) and suppose that m is a σ-finitemeasure on (E, E) that is subinvariant for p. Then, thereexists an m − a.e. transition function p∗ which is the m − a.e.
unique reverse of p with respect to m.
MASCOS MASCOS Colloquium, May 2006 - Page 42
![Page 86: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/86.jpg)
The reverse transition function
Theorem 2. Let (E,O, E) be an inner-regular, measurabletopological space with a countable basis. Let p be atransition function on (E, E) and suppose that m is a σ-finitemeasure on (E, E) that is subinvariant for p. Then, thereexists an m − a.e. transition function p∗ which is the m − a.e.
unique reverse of p with respect to m.
What is (E,O, E) and why?
MASCOS MASCOS Colloquium, May 2006 - Page 42
![Page 87: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/87.jpg)
An application
But first, an application . . .
MASCOS MASCOS Colloquium, May 2006 - Page 43
![Page 88: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/88.jpg)
An application
But first, an application . . .
Corollary. Let (E,O, E) be an inner-regular, measurabletopological space with a countable basis. Let p be atransition function on (E, E) and suppose that m is a σ-finitemeasure on (E, E) that is subinvariant for p. Let p∗ be them − a.e. unique reverse transition function with respect to m.Then, m is invariant for p if and only if p∗ is m − a.e. honest.
MASCOS MASCOS Colloquium, May 2006 - Page 43
![Page 89: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/89.jpg)
The reverse transition function
Why O?
MASCOS MASCOS Colloquium, May 2006 - Page 44
![Page 90: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/90.jpg)
The reverse transition function
Why O? We need to take limits.
MASCOS MASCOS Colloquium, May 2006 - Page 44
![Page 91: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/91.jpg)
The reverse transition function
Why O? We need to take limits.
Let m be a σ-finite measure that is subinvariant for p and letE0 be the subset of E that consists of all sets B withm(B) < ∞. Then, for every B ∈ E0, Radon-Nikodym gave usan E-measurable ft(·, B) such that
∫
B m(dx)pt(x,A) =∫
A m(dx)ft(x,B) (A ∈ E).
We showed that f satisfied the properties of an m − a.e.
transition function.
MASCOS MASCOS Colloquium, May 2006 - Page 44
![Page 92: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/92.jpg)
The reverse transition function
Why O? We need to take limits.
Let m be a σ-finite measure that is subinvariant for p and letE0 be the subset of E that consists of all sets B withm(B) < ∞. Then, for every B ∈ E0, Radon-Nikodym gave usan E-measurable ft(·, B) such that
∫
B m(dx)pt(x,A) =∫
A m(dx)ft(x,B) (A ∈ E).
We showed that f satisfied the properties of an m − a.e.
transition function.
We extend this from (E, E0,m) to (E, E ,m) by approximating(E, E ,m) by finite measure spaces (E, En, µ), n = 1, 2, . . . .
MASCOS MASCOS Colloquium, May 2006 - Page 44
![Page 93: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/93.jpg)
The reverse transition function
Let En∞n=1 be a countable partition of E with m(En) < ∞.
MASCOS MASCOS Colloquium, May 2006 - Page 45
![Page 94: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/94.jpg)
The reverse transition function
Let En∞n=1 be a countable partition of E with m(En) < ∞.
The idea. Statements (like the one immediately above)concerning a given σ-finite measure which hold over E0 areextended to E, for they are show to hold over each of theσ-algebras En
∞n=1 defined by En = A ∩ En : A ∈ E.
MASCOS MASCOS Colloquium, May 2006 - Page 45
![Page 95: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/95.jpg)
The reverse transition function
Let En∞n=1 be a countable partition of E with m(En) < ∞.
The idea. Statements (like the one immediately above)concerning a given σ-finite measure which hold over E0 areextended to E, for they are show to hold over each of theσ-algebras En
∞n=1 defined by En = A ∩ En : A ∈ E.
For example, our elementary argument (above) gives us anf (n) for each n with the right properties. We then set
p∗t (x,A) =∑∞
n=1 f(n)t (x,A ∩ En) (x ∈ E, A ∈ E , t ≥ 0)
and hope!!
MASCOS MASCOS Colloquium, May 2006 - Page 45
![Page 96: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/96.jpg)
The reverse transition function
Let En∞n=1 be a countable partition of E with m(En) < ∞.
The idea. Statements (like the one immediately above)concerning a given σ-finite measure which hold over E0 areextended to E, for they are show to hold over each of theσ-algebras En
∞n=1 defined by En = A ∩ En : A ∈ E.
For example, our elementary argument (above) gives us anf (n) for each n with the right properties. We then set
p∗t (x,A) =∑∞
n=1 f(n)t (x,A ∩ En) (x ∈ E, A ∈ E , t ≥ 0)
and hope!! The details are quite tough, and rely on us beingable exploit the inner regularity of measures relative tocompact sets that our topological structure permits.
MASCOS MASCOS Colloquium, May 2006 - Page 45
![Page 97: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/97.jpg)
The reverse transition function
So, what is (E,O, E)?
MASCOS MASCOS Colloquium, May 2006 - Page 46
![Page 98: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/98.jpg)
The reverse transition function
So, what is (E,O, E)?
Equip our set of states E with a topology O, but assume thatthis family of open sets has a countable basis, that is, acountable set B ⊂ O with the property that all members of Ocan be written as a union of sets in B.
MASCOS MASCOS Colloquium, May 2006 - Page 46
![Page 99: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/99.jpg)
The reverse transition function
So, what is (E,O, E)?
Equip our set of states E with a topology O, but assume thatthis family of open sets has a countable basis, that is, acountable set B ⊂ O with the property that all members of Ocan be written as a union of sets in B.
The triple (E,O, E) is called a measurable topological spacewith a countable basis whenever E = σ(O).
MASCOS MASCOS Colloquium, May 2006 - Page 46
![Page 100: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/100.jpg)
The reverse transition function
So, what is (E,O, E)?
Equip our set of states E with a topology O, but assume thatthis family of open sets has a countable basis, that is, acountable set B ⊂ O with the property that all members of Ocan be written as a union of sets in B.
The triple (E,O, E) is called a measurable topological spacewith a countable basis whenever E = σ(O).
If ν is a finite measure on (E, E), then ν is said to be innerregular if, for all A ∈ E, ν(A) = sup ν(K) : compact K ⊂ A.
MASCOS MASCOS Colloquium, May 2006 - Page 46
![Page 101: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/101.jpg)
The reverse transition function
So, what is (E,O, E)?
Equip our set of states E with a topology O, but assume thatthis family of open sets has a countable basis, that is, acountable set B ⊂ O with the property that all members of Ocan be written as a union of sets in B.
The triple (E,O, E) is called a measurable topological spacewith a countable basis whenever E = σ(O).
If ν is a finite measure on (E, E), then ν is said to be innerregular if, for all A ∈ E, ν(A) = sup ν(K) : compact K ⊂ A.
If every finite measure on (E, E) is inner regular, we say thatthe space is inner regular.
MASCOS MASCOS Colloquium, May 2006 - Page 46
![Page 102: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/102.jpg)
A simple stress release model
Stress accumulates in small amounts of expected size ǫ,and at rate λ, and all the stress accumulated so far isreleased completely (a seismic event–say a mine collapse)at points of a Poisson process with rate σ.
Let E = R+ and E = B(R+). Define “rates”
q(x,A) = σIA(0) +
∫
Ag(x, y) dy (A ∈ E , x ∈ E),
where
g(x, y) =λ
ǫ2exp (−(y − x)/ǫ) I(x,∞)(y).
MASCOS MASCOS Colloquium, May 2006 - Page 47
![Page 103: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/103.jpg)
A simple stress release model
This is a version of a stochastic slip-predictable model forearthquake occurrences∗. The state of the processrepresents the accumulated stress on a fault. The processwaits a time which is exponentially distributed with mean1/q(x) = 1/(σ + λ/ǫ) and then either jumps to 0, which isidentified as a seismic event (stress release), with probabilityα = σ/(σ + λ/ǫ) or otherwise jumps up a distance which isexponentially distributed with mean ǫ. For small ǫ, the later isa pure-jump analogue of a continuous constant stressincrease.
∗Kiremidjian, A.S. and Anagnos, T. (1984) Stochastic slip-predictable model for earth-
quake occurrences, Bull. Seism. Soc. Amer. 74, 739–755.
MASCOS MASCOS Colloquium, May 2006 - Page 48
![Page 104: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/104.jpg)
A simple stress release model
Define m = (m(x), x ∈ E) by m(0) = α and, for x > 0,m(dx) = ǫ−1α(1 − α) exp(−αx/ǫ)dx, so that m((0,∞)) = 1 − α,m(E) = m([0,∞)) = 1, and,
m((0, x)) = (1 − α)(1 − e−αx/ǫ) (x > 0)
m([0, x)) = 1 − (1 − α)e−αx/ǫ (x ≥ 0).
MASCOS MASCOS Colloquium, May 2006 - Page 49
![Page 105: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/105.jpg)
A simple stress release model
Define m = (m(x), x ∈ E) by m(0) = α and, for x > 0,m(dx) = ǫ−1α(1 − α) exp(−αx/ǫ)dx, so that m((0,∞)) = 1 − α,m(E) = m([0,∞)) = 1, and,
m((0, x)) = (1 − α)(1 − e−αx/ǫ) (x > 0)
m([0, x)) = 1 − (1 − α)e−αx/ǫ (x ≥ 0).
Is m an invariant measure?
MASCOS MASCOS Colloquium, May 2006 - Page 49
![Page 106: Reversing time as an analytical tool: Isn’t that just Radon-Nikodym? · 2006. 5. 12. · Beethoven’s Piano Sonata No. 29 in B flat, Op. 106 ... BWV 1079, Canon 1. a 2 cancrizans](https://reader036.vdocument.in/reader036/viewer/2022062611/6135ab880ad5d20676478644/html5/thumbnails/106.jpg)
A simple stress release model
Define m = (m(x), x ∈ E) by m(0) = α and, for x > 0,m(dx) = ǫ−1α(1 − α) exp(−αx/ǫ)dx, so that m((0,∞)) = 1 − α,m(E) = m([0,∞)) = 1, and,
m((0, x)) = (1 − α)(1 − e−αx/ǫ) (x > 0)
m([0, x)) = 1 − (1 − α)e−αx/ǫ (x ≥ 0).
Is m an invariant measure?
This shall remain one of life’s mysteries, at least until I havethe opportunity to speak again on this topic.
MASCOS MASCOS Colloquium, May 2006 - Page 49