calculus of finite differences - ecology...
TRANSCRIPT
![Page 1: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/1.jpg)
Calculus of Finite DifferencesAndreas Klappenecker
![Page 2: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/2.jpg)
MotivationWhen we analyze the runtime of algorithms, we simply count the number of operations. For example, the following loop
for k = 1 to n do
square(k);
where square(k) is a function that has running time T2k2. Then the total number of instructions is given by
where T1 is the time for loop increment and comparison.
T1(n+ 1) +n�
k=1
T2k2
![Page 3: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/3.jpg)
Motivation
The question is how to find closed form representations of sums such as
Of course, you can look up this particular sum. Perhaps you can even guess the solution and prove it by induction. However, neither of these “methods” are entirely satisfactory.
n�
k=1
k2
![Page 4: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/4.jpg)
MotivationThe sum
b�
k=a
g(k)
may be regarded as a discrete analogue of the integral
� b
ag(x)dx
We can evaluate the integral by finding a functionf(x) such that d
dxf(x) = g(x), since the fundamentaltheorem of calculus yields
� b
ag(x)dx = f(b)− f(a).
![Page 5: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/5.jpg)
MotivationWe would like to find a result that is analogous to the fundamental theorem of calculus for sums. The calculus of finite differences will allow us to find such a result.
Some benefits:
Closed form evaluation of certain sums.
The calculus of finite differences will explain the real meaning of the Harmonic numbers (and why they occur so often in the analysis of algorithms).
![Page 6: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/6.jpg)
Difference OperatorThe discrete version of the differential operator
![Page 7: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/7.jpg)
Difference Operator
Given a function g(n), we define the difference oper-ator ∆ as
∆g(n) = g(n+ 1)− g(n)
Let E denote the shift operator Eg(n) = g(n + 1),and I the identity operator. Then
∆ = E − I
![Page 8: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/8.jpg)
Examplesa) Let f(n) = n. Then
∆f(n) = n+ 1− n = 1.
b) Let f(n) = n2. Then
∆f(n) = (n+ 1)2 − n2 = 2n+ 1.
c) Let f(n) = n3.Then
∆f(n) = (n+ 1)3 − n3 = 3n2 + 3n+ 1.
![Page 9: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/9.jpg)
Falling Power
We define the m-th falling power of n as
nm = n(n− 1) · · · (n−m+ 1)
for m ≥ 0. We have
∆nm = mnm−1.
![Page 10: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/10.jpg)
Falling PowerTheorem. We have
∆nm = mnm−1.
Proof. By definition,
∆nm = (n+ 1)n · · · (n−m+ 2)−n · · · (n−m+ 2)(n−m+ 1)
= mn · · · (n−m+ 2)
![Page 11: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/11.jpg)
Negative Falling PowersSince
nm/nm−1 = (n−m+ 1),
we have
n2/n1 = n(n− 1)/n = (n− 1),
n1/n0 = n/1 = n
so we expect that
n0/n−1 = n+ 1
holds, which implies that
n−1 = 1/(n+ 1).
![Page 12: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/12.jpg)
Negative Falling Powers Similarly, we want
n−1/n−2 = n+ 2
so
n−2 =1
(n+ 1)(n+ 2)
We define
n−m =1
(n+ 1)(n+ 2) · · · (n+m)
![Page 13: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/13.jpg)
ExerciseShow that for m ≥ 0, we have
∆n−m = −mn−m−1
![Page 14: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/14.jpg)
Exponentials
Let c �= 1 be a fixed real number. Then
∆cn = cn+1 − cn = (c− 1)cn.
In particular,∆2n = 2n.
![Page 15: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/15.jpg)
Antidifference OperatorThe discrete version of an indefinite integral
![Page 16: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/16.jpg)
AntidifferenceA function f(n) with the property that
∆f(n) = g(n)
is called the antidifference of the function g(n).
Example. The antidifference of the function g(n) =nm is given by
f(n) =1
m+ 1nm+1.
![Page 17: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/17.jpg)
AntidifferenceExample. The antidifference of the function g(n) =cn is given by
f(n) =1
c− 1cn.
Indeed,
∆f(n) =1
c− 1(cn+1 − cn) = cn.
![Page 18: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/18.jpg)
Fundamental Theorem of FDCTheorem. Let f(n) be an antiderivative of g(n).Then
b�
n=a
g(n) = f(b+ 1)− f(a).
Proof. We have
b�
n=a
g(n) =b�
n=a
∆f(n)
=b�
n=a
(f(n+ 1)− f(n))
=b+1�
n=a+1
f(n)−b�
n=a
f(n) = f(b+ 1)− f(a).
![Page 19: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/19.jpg)
Example 1Suppose we want to find a closed form for the sum
64�
n=5
cn.
An antiderivative of cn is 1c−1c
n. Therefore, by thefundamental theorem of finite difference, we have
64�
n=5
cn =1
c− 1cn
�����
65
5
=c65 − c5
c− 1
![Page 20: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/20.jpg)
AntidifferenceWe are going to denote an antidifference of a functionf(n) by �
f(n) δn.
The δn plays the same role as the dx term in inte-gration.
For example,
�nm δn =
1
m+ 1nm+1
when m �= −1. What about m = −1?
![Page 21: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/21.jpg)
Harmonic Numbers = Discrete ln
We have
�n−1 δn = Hn = 1 +
1
2+ · · ·+ 1
n.
Indeed,
∆Hn = Hn+1 −Hn =1
n+ 1= n
−1.
Thus, the antidifference of n−1 is Hn.
![Page 22: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/22.jpg)
Linearity
Let f(n) and g(n) be two sequences and a and b twoconstants. Then
∆(af(n) + bg(n)) = a∆f(n) + b∆g(n).
Consequently, the antidifferences are linear as well:
�(af(n) + bg(n)) δn = a
�f(n) δn+ b
�g(n) δn
![Page 23: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/23.jpg)
ExampleTo solve our motivating example, we need to find aclosed form for the sum
n�
k=1
k2.
Since k2 = k2 + k1, an antiderivative of k2 is givenby
�k2 δk =
�(k2 + k1)δk =
1
3k3 +
1
2k2.
Thus, the sum
n�
k=1
k2 =1
3k3
����n+1
1
+1
2k2
����n+1
1
= . . . =n(2n+ 1)(n+ 1)
6.
![Page 24: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/24.jpg)
Binomial CoefficientsBy Pascal’s rule for binomial coefficients, we have
�n
k
�+
�n
k + 1
�=
�n+ 1
k + 1
�.
Therefore,
∆
�n
k + 1
�=
�n
k
�.
In other words,
��n
k
�δn =
�n
k + 1
�.
For example, this shows that
m�
n=0
�n
k
�=
�m+ 1
k + 1
�−
�0
k + 1
�=
�m+ 1
k + 1
�.
![Page 25: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/25.jpg)
Partial Summation
![Page 26: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/26.jpg)
Example
n�
k=0
k2k =?
![Page 27: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/27.jpg)
Product Rule
∆(f(n)g(n)) = f(n+ 1)g(n+ 1)− f(n)g(n)
= f(n+ 1)g(n+ 1)− f(n)g(n+ 1)+ f(n)g(n+ 1)− f(n)g(n)
= (∆f(n))g(n+ 1) + f(n)(∆g(n))
= (∆f(n))(Eg(n)) + f(n)(∆g(n))
![Page 28: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/28.jpg)
Partial Summation
�f(n)(∆g(n)) δn = f(n)g(n)−
�(∆f(n))(Eg(n))
![Page 29: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/29.jpg)
ExampleWe are now going to find a closed form for the sum
n�
k=0
k2k
Set f(k) = k and ∆g(k) = 2k, so that g(k) = 2k.Then by partial summation, we have
�nk=0 k2
k =�n
k=0 f(k)∆g(k)
= f(k)g(k)
����n+1
0
−�n
k=0(∆f(k))E(g(k))
= k2k����n+1
0
−�n
k=0 1 · 2k+1
= k2k + 2k+1
����n+1
0= (n+ 1)2n+1 − 2n+2 − (0 · 20 − 2)
![Page 30: Calculus of Finite Differences - ecology labfaculty.cs.tamu.edu/klappi/csce411-s15/csce411-setFDCalculus.pdf · fundamental theorem of calculus for sums. The calculus of finite differences](https://reader031.vdocument.in/reader031/viewer/2022011902/5f0ccca37e708231d4373062/html5/thumbnails/30.jpg)
References
D. Gleich: Finite Calculus: A Tutorial for Solving Nasty Sums
Graham, Knuth, Patashnik: Concrete Mathematics, Addison Wesley,
Ch. Jordan: Calculus of finite differences, AMS Chelsea, 1965.