christopher dougherty ec220 - introduction to econometrics (chapter 2) slideshow: random components,...
TRANSCRIPT
![Page 1: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/1.jpg)
Christopher Dougherty
EC220 - Introduction to econometrics (chapter 2)Slideshow: random components, unbiasedness of the regression coefficients
Original citation:
Dougherty, C. (2012) EC220 - Introduction to econometrics (chapter 2). [Teaching Resource]
© 2012 The Author
This version available at: http://learningresources.lse.ac.uk/128/
Available in LSE Learning Resources Online: May 2012
This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 License. This license allows the user to remix, tweak, and build upon the work even for commercial purposes, as long as the user credits the author and licenses their new creations under the identical terms. http://creativecommons.org/licenses/by-sa/3.0/
http://learningresources.lse.ac.uk/
![Page 2: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/2.jpg)
1
uXY 21
XbbY 21ˆ
The regression coefficients are special types of random variable. We will demonstrate this using the simple regression model in which Y depends on X. The two equations show the true model and the fitted regression.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
True model
Fitted model
![Page 3: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/3.jpg)
2
22
XX
YYXXb
i
iiuXY 21
XbbY 21ˆ
We will investigate the behavior of the ordinary least squares (OLS) estimator of the slope coefficient, shown above.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
True model
Fitted model
![Page 4: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/4.jpg)
3
22
XX
YYXXb
i
iiuXY 21
XbbY 21ˆ
Y has two components: a nonrandom component that depends on X and the parameters, and the random component u. Since b2 depends on Y, it indirectly depends on u.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
True model
Fitted model
![Page 5: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/5.jpg)
4
22
XX
YYXXb
i
iiuXY 21
XbbY 21ˆ
If the values of u in the sample had been different, we would have had different values of Y, and hence a different value for b2. We can in theory decompose b2 into its nonrandom and random components.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
True model
Fitted model
![Page 6: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/6.jpg)
We will start with the numerator, substituting for Y and its sample mean from the true model.
5
22
XX
YYXXb
i
ii
uuXXXX
uuXXXX
uXuXXXYYXX
iii
iii
iiiii
22
2
2121
][][
][][
uXY 21
XbbY 21ˆ
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
True model
Fitted model
![Page 7: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/7.jpg)
The 1 terms in the second factor cancel. We rearrange the remaining terms.
6
22
XX
YYXXb
i
ii
uuXXXX
uuXXXX
uXuXXXYYXX
iii
iii
iiiii
22
2
2121
][][
][][
uXY 21
XbbY 21ˆ
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
True model
Fitted model
![Page 8: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/8.jpg)
We expand the product.
7
22
XX
YYXXb
i
ii
uuXXXX
uuXXXX
uXuXXXYYXX
iii
iii
iiiii
22
2
2121
][][
][][
uXY 21
XbbY 21ˆ
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
True model
Fitted model
![Page 9: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/9.jpg)
Substituting this for the numerator in the expression for b2, we decompose b2 into the true value 2 and an error term that depends on the values of X and u.
8
22
XX
YYXXb
i
ii
uuXXXX
uuXXXX
uXuXXXYYXX
iii
iii
iiiii
22
2
2121
][][
][][
222
22
2XX
uuXX
XX
uuXXXXb
i
ii
i
iii
uXY 21 True model
XbbY 21ˆ
Fitted model
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
![Page 10: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/10.jpg)
9
22
XX
YYXXb
i
ii
uuXXXX
uuXXXX
uXuXXXYYXX
iii
iii
iiiii
22
2
2121
][][
][][
222
22
2XX
uuXX
XX
uuXXXXb
i
ii
i
iii
uXY 21
XbbY 21ˆ
The error term depends on the value of the disturbance term in every observation in the sample, and thus it is a special type of random variable.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
True model
Fitted model
![Page 11: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/11.jpg)
10
22
XX
YYXXb
i
ii
uuXXXX
uuXXXX
uXuXXXYYXX
iii
iii
iiiii
22
2
2121
][][
][][
222
22
2XX
uuXX
XX
uuXXXXb
i
ii
i
iii
uXY 21
XbbY 21ˆ
The error term is responsible for the variations of b2 around its fixed component 2. If we wish, we can express the decomposition more tidily.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
True model
Fitted model
![Page 12: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/12.jpg)
11
2222
XX
uuXX
XX
YYXXb
i
ii
i
ii
This is the decomposition so far.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
![Page 13: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/13.jpg)
12
2222
XX
uuXX
XX
YYXXb
i
ii
i
ii
The next step is to make a small simplification of the numerator of the error term. First, we expand it as shown.
ii
iii
iiiii
uXX
XXuuXX
uXXuXXuuXX
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
![Page 14: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/14.jpg)
13
2222
XX
uuXX
XX
YYXXb
i
ii
i
ii
The mean value of u is a common factor of the second summation, so it can be taken outside.
ii
iii
iiiii
uXX
XXuuXX
uXXuXXuuXX
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
![Page 15: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/15.jpg)
14
2222
XX
uuXX
XX
YYXXb
i
ii
i
ii
The second term then vanishes because the sum of the deviations of X around its sample mean is automatically zero.
ii
iii
iiiii
uXX
XXuuXX
uXXuXXuuXX
0 XnXnXnXXX ii
n
XX i
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
![Page 16: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/16.jpg)
15
2222
XX
uuXX
XX
YYXXb
i
ii
i
ii
Thus we can rewrite the decomposition as shown. For convenience, the denominator has been denoted .
iiii uXXuuXX
iiii
ii
iiii
uauXX
uXX
uXXuXX
b
222
222
1
1
2XX i
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
![Page 17: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/17.jpg)
16
2222
XX
uuXX
XX
YYXXb
i
ii
i
ii
A further small rearrangement of the expression for the error term.
iiii uXXuuXX
iiii
ii
iiii
uauXX
uXX
uXXuXX
b
222
222
1
1
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
![Page 18: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/18.jpg)
17
2222
XX
uuXX
XX
YYXXb
i
ii
i
ii
Another one.
iiii uXXuuXX
iiii
ii
iiii
uauXX
uXX
uXXuXX
b
222
222
1
1
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
![Page 19: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/19.jpg)
18
2222
XX
uuXX
XX
YYXXb
i
ii
i
ii
One more.
iiii uXXuuXX
iiii
ii
iiii
uauXX
uXX
uXXuXX
b
222
222
1
1
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
![Page 20: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/20.jpg)
19
2222
XX
uuXX
XX
YYXXb
i
ii
i
ii
Thus we have shown that b2 is equal to the true value and plus a weighted linear combination of the values of the disturbance term in the sample, where the weights are functions of the values of X in the observations in the sample.
iiii uXXuuXX
iiii
ii
iiii
uauXX
uXX
uXXuXX
b
222
222
1
1
2XX
XXXXa
j
iii
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
![Page 21: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/21.jpg)
20
2222
XX
uuXX
XX
YYXXb
i
ii
i
ii
As you can see, every value of the disturbance term in the sample affects the sample value of b2.
iiii uXXuuXX
iiuab 22
2XX
XXXXa
j
iii
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
![Page 22: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/22.jpg)
21
2222
XX
uuXX
XX
YYXXb
i
ii
i
ii
Before moving on, it may be helpful to clarify a mathematical technicality. In the summation in the denominator of the expression for ai, the subscript has been changed to j. Why?
iiii uXXuuXX
iiuab 22
2XX
XXXXa
j
iii
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
![Page 23: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/23.jpg)
22
The denominator is the sum, from 1 to n, of the squared deviations of X from its sample mean. This is made explicit in the version of the expression in the box.
iiuab 22
2XX
XXXXa
j
iii
221
2 ... XXXX
XX
XX
XXXXa
n
i
j
iii
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
![Page 24: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/24.jpg)
23
Written this way, the meaning of the denominator is clear, but the form is clumsy. Obviously, we should use –notation to compress it.
iiuab 22
221
2 ... XXXX
XX
XX
XXXXa
n
i
j
iii
n
jj
iii
XX
XXXXa
1
2
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
![Page 25: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/25.jpg)
24
For the -notation, we need to choose an index symbol that changes as we go from the first squared deviation to the last. We can use anything we like, EXCEPT i, because we are already using i for a completely different purpose in the numerator.
iiuab 22
221
2 ... XXXX
XX
XX
XXXXa
n
i
j
iii
n
jj
iii
XX
XXXXa
1
2
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
![Page 26: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/26.jpg)
25
We have used j here, but this was quite arbitrary. We could have used anything for the summation index (except i), as long as the meaning is clear. We could have used a smiley ☻ instead (please don’t).
iiuab 22
221
2 ... XXXX
XX
XX
XXXXa
n
i
j
iii
n
jj
iii
XX
XXXXa
1
2
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
![Page 27: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/27.jpg)
26
iiuab 22
221
2 ... XXXX
XX
XX
XXXXa
n
i
j
iii
n
jj
iii
XX
XXXXa
1
2
The error term depends on the value of the disturbance term in every observation in the sample, and thus it is a special type of random variable.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
![Page 28: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/28.jpg)
27
iiuab 22
221
2 ... XXXX
XX
XX
XXXXa
n
i
j
iii
n
jj
iii
XX
XXXXa
1
2
We will show that the error term has expected value zero, and hence that the ordinary least squares (OLS) estimator of the slope coefficient in a simple regression model is unbiased.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
![Page 29: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/29.jpg)
28
it
i
ii uaXX
YYXXb 222
uXY 21
XbbY 21ˆ
n
jj
ii
XX
XXa
1
2
2
22
22
iiii
ii
uEauaE
uaEEbE
The expected value of b2 is equal to the expected value of 2 and the expected value of the weighted sum of the values of the disturbance term.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
True model
Fitted model
![Page 30: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/30.jpg)
29
it
i
ii uaXX
YYXXb 222
uXY 21
XbbY 21ˆ
n
jj
ii
XX
XXa
1
2
2
22
22
iiii
ii
uEauaE
uaEEbE
2 is fixed so it is unaffected by taking expectations. The first expectation rule (Review chapter) states that the expectation of a sum of several quantities is equal to the sum of their expectations.
iinnnnii uaEuaEuaEuauaEuaE ...... 1111
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
True model
Fitted model
![Page 31: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/31.jpg)
30
it
i
ii uaXX
YYXXb 222
uXY 21
XbbY 21ˆ
n
jj
ii
XX
XXa
1
2
2
22
22
iiii
ii
uEauaE
uaEEbE
Now for each i, E(aiui) = aiE(ui). This is a really important step and we can make it only with Model A.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
True model
Fitted model
![Page 32: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/32.jpg)
31
it
i
ii uaXX
YYXXb 222
uXY 21
XbbY 21ˆ
n
jj
ii
XX
XXa
1
2
2
22
22
iiii
ii
uEauaE
uaEEbE
Under Model A, we are assuming that the values of X in the observations are nonstochastic. It follows that each ai is nonstochastic, since it is just a combination of the values of X.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
True model
Fitted model
![Page 33: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/33.jpg)
32
it
i
ii uaXX
YYXXb 222
uXY 21
XbbY 21ˆ
n
jj
ii
XX
XXa
1
2
2
22
22
iiii
ii
uEauaE
uaEEbE
Thus it can be treated as a constant, allowing us to take it out of the expectation using the second expected value rule (Review chapter).
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
True model
Fitted model
![Page 34: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/34.jpg)
33
it
i
ii uaXX
YYXXb 222
uXY 21
XbbY 21ˆ
n
jj
ii
XX
XXa
1
2
2
22
22
iiii
ii
uEauaE
uaEEbE
Under Assumption A.3, E(ui) = 0 for all i, and so the estimator is unbiased. The proof of the unbiasedness of the estimator of the intercept will be left as an exercise.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
True model
Fitted model
![Page 35: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/35.jpg)
uXY 21
It is important to realize that the OLS estimators of the parameters are not the only unbiased estimators. We will give an example of another.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
34
True model
![Page 36: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/36.jpg)
uXY 21
Someone who had never heard of regression analysis, seeing a scatter diagram of a sample of observations, might estimate the slope by joining the first and the last observations, and dividing the increase in the height by the horizontal distance between them.
1
12
1
112
1
112121
1
12
XX
uu
XX
uuXX
XX
uXuX
XX
YYb
n
n
n
nn
n
nn
n
n
Y
Y1
X1 Xn
Yn
X
Yn – Y1
Xn – X1
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
35
True model
![Page 37: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/37.jpg)
uXY 21
The estimator is thus (Yn–Y1) divided by (Xn–X1). We will investigate whether it is biased or unbiased.
1
12
1
112
1
112121
1
12
XX
uu
XX
uuXX
XX
uXuX
XX
YYb
n
n
n
nn
n
nn
n
n
Y
Y1
X1 Xn
Yn
X
Yn – Y1
Xn – X1
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
36
True model
![Page 38: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/38.jpg)
uXY 21
To do this, we start by substituting for the Y components in the expression.
1
12
1
112
1
112121
1
12
XX
uu
XX
uuXX
XX
uXuX
XX
YYb
n
n
n
nn
n
nn
n
n
Y
Y1
X1 Xn
Yn
X
nnn uXY 21
11211 uXY
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
37
True model
![Page 39: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/39.jpg)
uXY 21
The 1 terms cancel out and the rest of the expression simplifies as shown. Thus we have decomposed this naïve estimator into two components, the true value and an error term. This decomposition is parallel to that for the OLS estimator, but the error term is different.
1
12
1
112
1
112121
1
12
XX
uu
XX
uuXX
XX
uXuX
XX
YYb
n
n
n
nn
n
nn
n
n
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
38
True model
![Page 40: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/40.jpg)
uXY 21
1
12
1
112
1
112121
1
12
XX
uu
XX
uuXX
XX
uXuX
XX
YYb
n
n
n
nn
n
nn
n
n
211
2
1
122
)(1
)()(
uuEXX
XXuu
EEbE
nn
n
n
We now take expectations to investigate unbiasedness.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
39
True model
![Page 41: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/41.jpg)
uXY 21
1
12
1
112
1
112121
1
12
XX
uu
XX
uuXX
XX
uXuX
XX
YYb
n
n
n
nn
n
nn
n
n
211
2
1
122
)(1
)()(
uuEXX
XXuu
EEbE
nn
n
n
The denominator of the error term can be taken outside because the values of X are nonstochastic.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
40
True model
![Page 42: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/42.jpg)
uXY 21
1
12
1
112
1
112121
1
12
XX
uu
XX
uuXX
XX
uXuX
XX
YYb
n
n
n
nn
n
nn
n
n
211
2
1
122
)(1
)()(
uuEXX
XXuu
EEbE
nn
n
n
Given Assumption A.3, the expectations of un and u1 are zero. Therefore, despite being naïve, this estimator is unbiased.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
41
True model
![Page 43: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/43.jpg)
uXY 21
1
12
1
112
1
112121
1
12
XX
uu
XX
uuXX
XX
uXuX
XX
YYb
n
n
n
nn
n
nn
n
n
211
2
1
122
)(1
)()(
uuEXX
XXuu
EEbE
nn
n
n
It is intuitively easy to see that we would not prefer the naïve estimator to OLS. Unlike OLS, which takes account of every observation, it employs only the first and the last and is wasting most of the information in the sample.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
42
True model
![Page 44: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/44.jpg)
uXY 21
1
12
1
112
1
112121
1
12
XX
uu
XX
uuXX
XX
uXuX
XX
YYb
n
n
n
nn
n
nn
n
n
211
2
1
122
)(1
)()(
uuEXX
XXuu
EEbE
nn
n
n
The naïve estimator will be sensitive to the value of the disturbance term u in those two observations, whereas the OLS estimator combines all the disturbance term values and takes greater advantage of the possibility that to some extent they cancel each other out.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
43
True model
![Page 45: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/45.jpg)
uXY 21
1
12
1
112
1
112121
1
12
XX
uu
XX
uuXX
XX
uXuX
XX
YYb
n
n
n
nn
n
nn
n
n
211
2
1
122
)(1
)()(
uuEXX
XXuu
EEbE
nn
n
n
More rigorously, it can be shown that the population variance of the naïve estimator is greater than that of the OLS estimator, and that the naïve estimator is therefore less efficient.
RANDOM COMPONENTS, UNBIASEDNESS OF THE REGRESSION COEFFICIENTS
44
True model
![Page 46: Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: random components, unbiasedness of the regression coefficients Original](https://reader036.vdocument.in/reader036/viewer/2022062417/551a8a5f550346761a8b54e5/html5/thumbnails/46.jpg)
Copyright Christopher Dougherty 2011.
These slideshows may be downloaded by anyone, anywhere for personal use.
Subject to respect for copyright and, where appropriate, attribution, they may be
used as a resource for teaching an econometrics course. There is no need to
refer to the author.
The content of this slideshow comes from Section 2.3 of C. Dougherty,
Introduction to Econometrics, fourth edition 2011, Oxford University Press.
Additional (free) resources for both students and instructors may be
downloaded from the OUP Online Resource Centre
http://www.oup.com/uk/orc/bin/9780199567089/.
Individuals studying econometrics on their own and who feel that they might
benefit from participation in a formal course should consider the London School
of Economics summer school course
EC212 Introduction to Econometrics
http://www2.lse.ac.uk/study/summerSchools/summerSchool/Home.aspx
or the University of London International Programmes distance learning course
20 Elements of Econometrics
www.londoninternational.ac.uk/lse.
11.07.25