gaussian distribution
TRANSCRIPT
-
7/28/2019 Gaussian Distribution
1/5
$0HWKRGIRU'LUHFWO\*HQHUDWLQJD*DXVVLDQ
'LVWULEXWLRQZLWK1RQXQLW9DULDQFHDQG1RQ]HUR
0HDQIURP8QLIRUP5DQGRP'HYLDWHV
0DUF$0XULVRQ
$VWURQRPLFDO$SSOLFDWLRQV'HSDUWPHQW
861DYDO2EVHUYDWRU\
:DVKLQJWRQ'&
PXULVRQ#DDXVQRQDY\PLO
KWWSDDXVQRQDY\PLOPXULVRQ
0D\
,QWURGXFWLRQ
,WLVXQLYHUVDOO\WKHFDVHWKDWZKHQDQDOJRULWKPLVSUHVHQWHGWKDWWDNHVXQLIRUPUDQGRP
GHYLDWHVDQGSURGXFHVD*DXVVLDQGLVWULEXWLRQWKH*DXVVLDQGLVWULEXWLRQKDV]HURPHDQDQGXQLW
YDULDQFH = * [0
[
)RUQRQ]HURPHDQDQGQRQXQLWYDULDQFHWKH*DXVVLDQGLVWULEXWLRQ
LV = * [ 0
[
ZLWKQRUPDOL]DWLRQ =G
* [ [ +RZGRHVRQHREWDLQD
GLVWULEXWLRQZLWKDJLYHQYDULDQFHIURPDGLVWULEXWLRQZLWKXQLWYDULDQFH"7KH*DXVVLDQIXQFWLRQ
KDVDXVHIXOLQYDULDQWUHODWLRQ = * [ * \
ZKHUH =\
[
+HQFHLIZHKDYHDVHWRI
UDQGRPGHYLDWHV\ZKLFKDUHGLVWULEXWHGDVD*DXVVLDQZLWKXQLWYDULDQFHDQG]HURPHDQZHPD\
FRQYHUWWKRVHGHYLDWHVWRD*DXVVLDQGLVWULEXWLRQZLWKQRQ]HURPHDQDQGQRQXQLWYDULDQFHE\WKHVLPSOHWULFNRIPXOWLSO\LQJE\DQGDGGLQJ+RZHYHURQHPLJKWVWLOOZLVKIRUDQDOJRULWKPWKDWWDNHVXQLIRUPGHYLDWHVDQGGLUHFWO\SURGXFHVWKHGHVLUHGQRQXQLWYDULDQFH*DXVVLDQGLVWULEXWLRQ
-
7/28/2019 Gaussian Distribution
2/5
$0RGLILHG%R[0XOOHU$OJRULWKP
7KHXVXDODOJRULWKPIRUSURGXFLQJD*DXVVLDQGLVWULEXWLRQIURPXQLIRUPUDQGRPGHYLDWHV
PDNHVXVHRIWKH%R[0XOOHUWUDQVIRUPDWLRQ:HZLOOPRGLI\WKHXVXDODOJRULWKPVRWKDWWKH%R[0XHOOHUWUDQVIRUPDWLRQSURGXFHVWKHGHVLUHGQRQXQLWYDULDQFH*DXVVLDQGLVWULEXWLRQ,I]
DQG
]DUHLQGHSHQGHQWDQGXQLIRUPO\GLVWULEXWHGLQWKHUDQJHWRWKHQFRQVLGHU\
DQG\
JLYHQE\
=\
OQ ]
FRV ]
=\
OQ ]
VLQ ]
7KLVLVWKH%R[0XOOHUWUDQVIRUPDWLRQZKLFKFRQYHUWVD'XQLIRUPGLVWULEXWLRQ ]
]WRD
ELYDULDWH*DXVVLDQGLVWULEXWLRQ \ \ZLWK]HURPHDQDQGXQLWYDULDQFH7KHSURRIWKDWWKLVWUDQVIRUPDWLRQ\LHOGVWKHGHVLUHG*DXVVLDQGLVWULEXWLRQLVDVSHFLDOFDVHRIWKHSURRIRIWKHPRGLILHG
WUDQVIRUPDWLRQZKLFKLVJLYHQEHORZ
7KHWULFNWRPDNLQJWKH%R[0XOOHUWUDQVIRUPDWLRQSURGXFHD*DXVVLDQGLVWULEXWLRQ [
[
ZLWKQRQXQLWYDULDQFHLVWRXVHWKHLQYDULDQWUHODWLRQPHQWLRQHGDERYH6HWWLQJ
=[ +\
ZHKDYH
=[
+ OQ ]
FRV ]
=[
+ OQ ]
VLQ ]
9HULILFDWLRQ
7RVKRZWKDWWKLVLVLQGHHGWKHGHVLUHGGLVWULEXWLRQZHKDYH
=+
[
[
OQ ]
ZKLFKZHVROYHIRU]
-
7/28/2019 Gaussian Distribution
3/5
=]
0
/ [
0
/ [
DQGZHKDYH
=[
[
+ OQ ]
VLQ ]
+ OQ ]
FRV ]
ZKLFKZHVROYHIRU]
]
DUFWDQ OQ ]
[
+[
[
=
+ OQ ] [
+[ [
OQ ]
[
+[
[
[
OQ ]
[
+[
[
[
+ OQ ]
[
+[
[
OQ ]
[
+[
[
+
/
6XEVWLWXWLQJIRU]DQGVLPSOLI\LQJZHILQG
=]
DUFWDQ
+[
+[
1RZWKHIXQGDPHQWDOWUDQVIRUPDWLRQODZRISUREDELOLWLHVVWDWHVWKDW = S \ G\ S [ G[
RU = S \ S [G[
G\ZKHUH S [ G[LVWKHSUREDELOLW\WKDW[OLHVEHWZHHQ[DQG +[ G[DQG S \ G\
LVWKHSUREDELOLW\WKDW\OLHVEHWZHHQ\DQG +\ G\7KHH[WHQVLRQRIWKLVWRQGLPHQVLRQVLV= S < G
-
7/28/2019 Gaussian Distribution
4/5
= - = ;
0
/ +[
0
/ +[
7KLVVD\VWKDWIRUDXQLIRUPGLVWULEXWLRQ ]
]WKHGLVWULEXWLRQRI [
[
LVDV\PPHWULF
ELYDULDWH*DXVVLDQGLVWULEXWLRQZLWKPHDQDQGYDULDQFH4('
1XPHULFDO7HVWV
,QWKHSORWEHORZWKHUHGFXUYHLVDSORWRI * [ ZKLOHWKHKLVWRJUDPLVWKHUHVXOWRI
UXQQLQJXQLIRUPUDQGRPGHYLDWHVWKURXJKWKHPRGLILHG%R[0XOOHUWUDQVIRUPDWLRQMXVW
GHVFULEHGZLWK = DQG =
7KHSHDNRIWKHFXUYHVKRXOGEH
=
7KLVVKRZVWKDWWKHPRGLILHGQXPHULFDODOJRULWKPFRUUHFWO\UHSURGXFHVWKHVWDQGDUGDOJRULWKPLQ
WKHDSSURSULDWHOLPLWV
-
7/28/2019 Gaussian Distribution
5/5
1RZIRUDWHVWRIWKHPRGLILHGDOJRULWKP,QWKHQH[WSORWWKHUHGFXUYHLVDSORWRI
* [ ZKLOHWKHKLVWRJUDPLVWKHUHVXOWRIUXQQLQJXQLIRUPUDQGRPGHYLDWHVWKURXJKWKH
PRGLILHG%R[0XOOHUWUDQVIRUPDWLRQZLWK = DQG =
7KHSHDNRIWKHFXUYHVKRXOGEH
=
7KLVVKRZVWKDWWKHPRGLILHGDOJRULWKPLVLQGHHGJHQHUDWLQJWKHFRUUHFW*DXVVLDQGLVWULEXWLRQZLWK
QRQXQLWYDULDQFHDQGQRQ]HURPHDQ