point estimation of parameters and sampling distributions outlines: sampling distributions and the...
TRANSCRIPT
![Page 1: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/1.jpg)
Point Estimation of Parameters and Sampling Distributions
Outlines: Sampling Distributions and the central
limit theorem Point estimation Methods of point estimation
Moments Maximum Likelihood
![Page 2: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/2.jpg)
Sampling Distributions and the central limit theorem
Random Sample
Sampling distribution: the probability distribution of a statistic.
Ex. The probability distribution of is called distribution of the mean.
x
![Page 3: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/3.jpg)
Sampling Distributions of sample mean
Consider the sampling distribution of the sample mean.
Xi is a normal and independent probability, then
),(n
NX
n
XXXXX n
...321
n
n
XEXEXEXEXE n
X
...
)(...)()()()( 321
nn
n
XVXVXVXVXV n
X
2
2
2222
23212
...
)(...)()()()(
![Page 4: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/4.jpg)
Central limit theorem
n >= 30, sampling from an unknown population => the sampling distribution of will be approximated as normal with mean µ and 2/n.
X
![Page 5: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/5.jpg)
Central limit theorem
![Page 6: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/6.jpg)
Central limit theorem
Ex. Suppose that a random variable X has a continuous uniform distribution
Find the distribution of the sample mean of a random sample of size n=40
Method: 1.Calculate the value of mean and variance of x 2.
otherwise
xxf
,0
64,2/1)(
4 5 6x
nx
x
xx
![Page 7: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/7.jpg)
Sampling Distribution of a Difference Two independent populations.
Suppose that both populations are normally distributed.
Then, the sampling distribution of is normal with
µ1 ,12
µ2 ,22
21 XX
2
22
1
21222
21
2121
1121
nnXXXX
XXXX
![Page 8: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/8.jpg)
Sampling Distribution of a Difference Definition
![Page 9: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/9.jpg)
Sampling Distribution of a Difference Ex. The effective life of a jet-turbine aircraft engine is a
random variable with mean 5000 hr. and sd. 40 hr. The distribution of effective life is fairly close to a normal distribution. The engine manufacturer introduces an improvement into the manufacturing process for the engine that increases the mean life to 5050 hr. and decrease sd. to 30 hr.
16 components are sampling from the old process. 25 components are sampling from the improve process. What is the probability that the difference in the two
sample means is at least 25 hr?
![Page 10: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/10.jpg)
Point estimation
Parameter Estimation: calculation of a reasonable number that can explains the characteristic of population.
Ex. X is normally distributed with unknown mean µ. The Sample mean( ) is a point estimator of
population mean (µ) => After selecting the sample, is the point
estimate of µ.
X
X̂x
![Page 11: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/11.jpg)
Point estimation
Unbiased Estimators
![Page 12: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/12.jpg)
Point estimation
Ex. Suppose that X is a random variable with mean μ and variance σ2 . Let X1,X2 ,..., Xn be a random sample of size n from the population. Show that the sample mean and sample variance S2
are unbiased estimators of μ and σ2 , respectively.
1. proof,
2. proof,
X
?)( XE
?)( 22 SE
![Page 13: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/13.jpg)
Point estimation
![Page 14: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/14.jpg)
Point estimation
Sometimes, there are several unbiased estimators of the sample population parameter.
Ex. Suppose we take a random sample of size n from a normal population and obtain the data x1 = 12.8, x2 = 9.4, x3 = 8.7, x4 = 11.6, x5 = 13.1, x6 = 9.8, x7 = 14.1,x8 = 8.5, x9 = 12.1, x10 = 10.3.
all of them are unbiased estimator of μ
![Page 15: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/15.jpg)
Point estimation
Minimum Variance Unbiased Estimator (MVUE)
![Page 16: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/16.jpg)
Point estimation
MVUE for μ
![Page 17: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/17.jpg)
Method of Point Estimation
Method of Moment Method of Maximum Likelihood Bayesian Estimation of Parameter
![Page 18: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/18.jpg)
Method of Moments
The general idea of the method of moments is to equate the population moments to the corresponding sample moments.
The first population moment is E(X)=μ........(1) The first sample moment is ........(2) Equating (1) and (2),
The sample mean is the moment estimator of the population mean
n
i
i XXn 1
1
X̂
![Page 19: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/19.jpg)
Method of Moments
Moment Estimators
Ex. Suppose that X1,X2 ,..., Xn be a random sample from an exponential distribution with parameter λ. Find the moment estimator of λ
There is one parameter to estimate, so we must equate first population moment to first sample moment.
first population moment = E(X)=1/λ, first sample moment =
n
i
i XXn 1
1
X/1ˆ
![Page 20: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/20.jpg)
Method of Moments
Ex. Suppose that X1,X2 ,..., Xn be a random sample from a normal distribution with parameter μ and σ2. Find the moment estimators of μ and σ2.
For μ: k=1; The first population moment is E(X)=μ ........(1)
The first sample moment is ........(2)
Equating (1) and (2), For σ2: k=2; The second population moment is
E(X2)=μ2+σ2 ......(3)
The second sample moment is ......(4)
Equating (3) and (4),
n
i
i XXn 1
1
X̂
n
i
iXn 1
21
n
XX
Xn
n
i
i
n
i
i
2
12
1
222
)(
ˆ
,1
![Page 21: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/21.jpg)
Method of Maximum Likelihood
Concept: the estimator will be the value of the parameter that maximizes the likelihood function.
![Page 22: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/22.jpg)
Method of Maximum Likelihood
Ex. Let X be a Bernoulli random variable. The probability mass function is
otherwise
xpppxf
xx
,0
1,0,)1();(
1
n
i
i
n
i
i
n
i
i
n
i
i
n
i
i
n
i
i
xnxn
i
xx
xxxxxx
Xn
P
xn
pp
xn
p
x
dp
pLd
pxnpxpL
pppp
pppppppLn
ii
n
ii
ii
nn
1
1
11
11
1
1
111
1ˆ
1ˆ,0
1
)()(ln
)1ln()(ln)()(ln
)1()1(
)1(...)1()1()(
11
2211
![Page 23: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/23.jpg)
Method of Maximum Likelihood
Ex. Let X be normally distributed with unknown μ and known σ2. Find the maximum likelihood estimator of μ
![Page 24: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/24.jpg)
Method of Maximum Likelihood
Ex. Let X be exponentially distributed with parameter λ. Find the maximum likelihood estimator of λ.
![Page 25: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/25.jpg)
Method of Maximum Likelihood
Ex. Let X be normally distributed with unknown μ and unknown σ2. Find the maximum likelihood estimator of μ, and σ2.
![Page 26: Point Estimation of Parameters and Sampling Distributions Outlines: Sampling Distributions and the central limit theorem Point estimation Methods](https://reader036.vdocument.in/reader036/viewer/2022081513/5697c0091a28abf838cc6f54/html5/thumbnails/26.jpg)
Method of Maximum Likelihood
The method of maximum likelihood is often the estimation method that mathematical statisticians prefer, because it is usually easy to use and produces estimators with good statistical properties.