ml 94 1 chap3 bayesian decision theory
DESCRIPTION
machine learning course slides in persianTRANSCRIPT
-
)31-11-508-10(
4931
/iduomham_a~/ri.ca.ubs.seitlucaf//:ptth
gninraeL enihcaM
-
)(
2
-
. ) (
. )z(f=x
: )x=X(P
x t = }sessoT{#/}sdaeH{ # = op3
N / t
-
:: : low risk High risk
Input: x = [x1,x2]T ,Output: C {0,1}
: high risk(C=1) or low risk(C=0)
4
classification
otherwise 0
)|()|( if 1 choose
or
otherwise 0
)|( if 1 choose
C
C
C
C
,xxCP ,xxCP
. ,xxCP
2121
21
01
501
-
...)(
x . )x|C(P
5
eluR seyaB
x x
xp
PpP
CCC
| |
|11|00
011
CCCC
CC
ppPpP
PP
xxx
roiretsop
roirpdoohilekil ssalC
ecnedive
x . C
C . x
-
()...
6
pattern recognition using neural networks theory and algorithms for
engineers and scientists, by Carl G. Looney
xx
xp
pPP
CCC
| |
-
7
xx
xp
pPP iii
CCC
| |
x Ci
Class likelihood
K
kpP
pP
p
pPP
1|
| | |
ii
iiiii
CC
CCCCC
x
x
x
xx
xx |max| ki CC PPk
Ci .
-
. iC i
. i ki
. k ksir detcepxe
:
8
sksiR dna sessoL
1
| |K
k ki i
k
C P R
x x
x x R Rk k i i| nim | fi esoohc
-
ssoL 1/0
9
ik
ikki
fi
fi
1
0
x
x
xx
|
|
||
i
kik
K
kikik
PC
PC
RPC
1
1
-
.
. 1+k :)tcejer ( :
01
1
dna | | fi esoohc
k i| |
i k R R Ck i i
R R
x x
x x
x x k, , , i R Ri k | | tcejer2 1 1
-
()... :
11
otherwise reject
| and || if choose 1xxx ikii CPikCPCPC
10
1
1
0
otherwise
if
if
,Ki
ki
ik
xxx
xx
|||
||
iik
ki
K
kkK
CPCPR
CPR
1
1
1
-
12
Kigi ,, , 1x xx kkii ggC max if choose
xxx kkii gg max| R
ii
i
i
i
CPCp
CP
R
g
|
|
|
x
x
x
x
K decision regions R1,...,RK
Dichotomizer g(x) = g1(x) g2(x)
otherwise
if choose
2
1 0
C
gC x
Discriminant Functions
-
13
Equal losses
Unequal losses
With reject
-
x )x|kS( P : kS
: k i kiU
41
xx
xx
esoohC fi |xam |
||
jj
ii
kikik
UEUE
UEUPS
yroehT ytilitU
-
) (
.
.
51
seluR noitaicossA
Y X :elur noitaicossA
tnedecetna
tneuqesnoc
-
-
:)Y X( troppuS
Y X Y X
.
.
61
sremotsuc sremotsucohw thguob dna
#
#,
XY PXY
-
-
:)Y X( ecnedifnoC
. .
. )Y(P
71
X
XY
PX
PXYPYX
sremotsucohw thguob
sremotsucohw thguob dna
|
#
#
()
,
-
tfil -
:)Y X( tseretni/tfiL
1=tfiL . Y X
1>tfiL . Y X
1
-
91
-
: ( )tneuqerf( tesmeti
)Z,Y,X(
)Z,Y()Z,X( ,)Y,X( .
tesmeti . tesrepus
tesmeti
02
)6991 ,.la te lawargA( mhtirogla iroirpA
ytreporp enotonom-itnA
1
2