korpela introduction

Upload: victor-noroc

Post on 22-Feb-2018

215 views

Category:

Documents


0 download

TRANSCRIPT

  • 7/24/2019 Korpela Introduction

    1/25

  • 7/24/2019 Korpela Introduction

    2/25

  • 7/24/2019 Korpela Introduction

    3/25

    [1] R. Kohavi and G. H. John. Wrappers for feature subset selection. ArtificialIntelligence, 97(12):273324, 1997.

  • 7/24/2019 Korpela Introduction

    4/25

  • 7/24/2019 Korpela Introduction

    5/25

  • 7/24/2019 Korpela Introduction

    6/25

  • 7/24/2019 Korpela Introduction

    7/25

  • 7/24/2019 Korpela Introduction

    8/25

  • 7/24/2019 Korpela Introduction

    9/25

  • 7/24/2019 Korpela Introduction

    10/25

    subset selectionFeatureInput

    features AlgorithmInduction

  • 7/24/2019 Korpela Introduction

    11/25

    Feature selection search

    estimation

    Accuracy

    EstimatedFinal EvaluationTest set

    AlgorithmFeature set

    Hypothesis

    Performance

    Training setTraining set

    Feature evaluation

    Induction Algorithm

    Feature set

    Feature setInduction

  • 7/24/2019 Korpela Introduction

    12/25

  • 7/24/2019 Korpela Introduction

    13/25

    0,0,1,1

    0,0,0,0

    1,0,0,0 0,1,0,0 0,0,1,0 0,0,0,1

    1,1,0,0 1,0,1,0 0,1,1,0 1,0,0,1 0,1,0,1

    1,1,1,0 1,1,0,1 1,0,1,1 0,1,1,1

    1,1,1,1

  • 7/24/2019 Korpela Introduction

    14/25

  • 7/24/2019 Korpela Introduction

    15/25

  • 7/24/2019 Korpela Introduction

    16/25

  • 7/24/2019 Korpela Introduction

    17/25

  • 7/24/2019 Korpela Introduction

    18/25

  • 7/24/2019 Korpela Introduction

    19/25

    0,0,0,0

    1,0,0,0 0,1,0,0 0,0,1,0 0,0,0,1

    1,1,0,0 1,0,1,0 0,1,1,0 1,0,0,1 0,1,0,1 0,0,1,1

    1,1,1,0 1,1,0,1 1,0,1,1 0,1,1,1

    1,1,1,1

  • 7/24/2019 Korpela Introduction

    20/25

    100 200 300 400Nodes

    crx - backward

    76

    7880

    82

    84

    real acc

    100 200 300 400Nodes

    soybean - forward

    20

    40

    60

    80

    real acc

  • 7/24/2019 Korpela Introduction

    21/25

  • 7/24/2019 Korpela Introduction

    22/25

    0 100 200 300 400 500 600 Nodes

    Rand - forward selection

    50

    5560

    65

    70

    75

    80

    Accuracy

    0 20 40 60 80Nodes

    Breast Cancer - forward selection

    70

    72

    7476

    78

    80

    82

    Accuracy

    0 20 40 60 80 100 Nodes

    Glass2 - backward elimination

    70

    75

    80

    85

    Accuracy

  • 7/24/2019 Korpela Introduction

    23/25

  • 7/24/2019 Korpela Introduction

    24/25

  • 7/24/2019 Korpela Introduction

    25/25