ml 94 1 chap3 bayesian decision theory

Upload: -

Post on 06-Mar-2016

230 views

Category:

Documents


0 download

DESCRIPTION

machine learning course slides in persian

TRANSCRIPT

  • )31-11-508-10(

    4931

    /iduomham_a~/ri.ca.ubs.seitlucaf//:ptth

    gninraeL enihcaM

  • )(

    2

  • . ) (

    . )z(f=x

    : )x=X(P

    x t = }sessoT{#/}sdaeH{ # = op3

    N / t

  • :: : low risk High risk

    Input: x = [x1,x2]T ,Output: C {0,1}

    : high risk(C=1) or low risk(C=0)

    4

    classification

    otherwise 0

    )|()|( if 1 choose

    or

    otherwise 0

    )|( if 1 choose

    C

    C

    C

    C

    ,xxCP ,xxCP

    . ,xxCP

    2121

    21

    01

    501

  • ...)(

    x . )x|C(P

    5

    eluR seyaB

    x x

    xp

    PpP

    CCC

    | |

    |11|00

    011

    CCCC

    CC

    ppPpP

    PP

    xxx

    roiretsop

    roirpdoohilekil ssalC

    ecnedive

    x . C

    C . x

  • ()...

    6

    pattern recognition using neural networks theory and algorithms for

    engineers and scientists, by Carl G. Looney

    xx

    xp

    pPP

    CCC

    | |

  • 7

    xx

    xp

    pPP iii

    CCC

    | |

    x Ci

    Class likelihood

    K

    kpP

    pP

    p

    pPP

    1|

    | | |

    ii

    iiiii

    CC

    CCCCC

    x

    x

    x

    xx

    xx |max| ki CC PPk

    Ci .

  • . iC i

    . i ki

    . k ksir detcepxe

    :

    8

    sksiR dna sessoL

    1

    | |K

    k ki i

    k

    C P R

    x x

    x x R Rk k i i| nim | fi esoohc

  • ssoL 1/0

    9

    ik

    ikki

    fi

    fi

    1

    0

    x

    x

    xx

    |

    |

    ||

    i

    kik

    K

    kikik

    PC

    PC

    RPC

    1

    1

  • .

    . 1+k :)tcejer ( :

    01

    1

    dna | | fi esoohc

    k i| |

    i k R R Ck i i

    R R

    x x

    x x

    x x k, , , i R Ri k | | tcejer2 1 1

  • ()... :

    11

    otherwise reject

    | and || if choose 1xxx ikii CPikCPCPC

    10

    1

    1

    0

    otherwise

    if

    if

    ,Ki

    ki

    ik

    xxx

    xx

    |||

    ||

    iik

    ki

    K

    kkK

    CPCPR

    CPR

    1

    1

    1

  • 12

    Kigi ,, , 1x xx kkii ggC max if choose

    xxx kkii gg max| R

    ii

    i

    i

    i

    CPCp

    CP

    R

    g

    |

    |

    |

    x

    x

    x

    x

    K decision regions R1,...,RK

    Dichotomizer g(x) = g1(x) g2(x)

    otherwise

    if choose

    2

    1 0

    C

    gC x

    Discriminant Functions

  • 13

    Equal losses

    Unequal losses

    With reject

  • x )x|kS( P : kS

    : k i kiU

    41

    xx

    xx

    esoohC fi |xam |

    ||

    jj

    ii

    kikik

    UEUE

    UEUPS

    yroehT ytilitU

  • ) (

    .

    .

    51

    seluR noitaicossA

    Y X :elur noitaicossA

    tnedecetna

    tneuqesnoc

  • -

    :)Y X( troppuS

    Y X Y X

    .

    .

    61

    sremotsuc sremotsucohw thguob dna

    #

    #,

    XY PXY

  • -

    :)Y X( ecnedifnoC

    . .

    . )Y(P

    71

    X

    XY

    PX

    PXYPYX

    sremotsucohw thguob

    sremotsucohw thguob dna

    |

    #

    #

    ()

    ,

  • tfil -

    :)Y X( tseretni/tfiL

    1=tfiL . Y X

    1>tfiL . Y X

    1

  • 91

  • : ( )tneuqerf( tesmeti

    )Z,Y,X(

    )Z,Y()Z,X( ,)Y,X( .

    tesmeti . tesrepus

    tesmeti

    02

    )6991 ,.la te lawargA( mhtirogla iroirpA

    ytreporp enotonom-itnA

    1

    2