week 09 classification evaluation in rapidminerec/files_1112/lab09-evaluation.pdf · 2011. 11....

15
Week 09 Classification evaluation in Rapidminer Dataset: risk week 09 – datasets.xls Algorithms: classification 1

Upload: others

Post on 19-Mar-2021

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Week 09 Classification evaluation in Rapidminerec/files_1112/lab09-evaluation.pdf · 2011. 11. 23. · ad Excel S lit oata set Role 10 Role 2 Performance erformance Tre Ap Model

Week 09

Classification evaluation in

Rapidminer

� Dataset: risk

week 09 – datasets.xls

� Algorithms: classification

1

Page 2: Week 09 Classification evaluation in Rapidminerec/files_1112/lab09-evaluation.pdf · 2011. 11. 23. · ad Excel S lit oata set Role 10 Role 2 Performance erformance Tre Ap Model

2

Decision tree for the risk dataset

Page 3: Week 09 Classification evaluation in Rapidminerec/files_1112/lab09-evaluation.pdf · 2011. 11. 23. · ad Excel S lit oata set Role 10 Role 2 Performance erformance Tre Ap Model

3

Page 4: Week 09 Classification evaluation in Rapidminerec/files_1112/lab09-evaluation.pdf · 2011. 11. 23. · ad Excel S lit oata set Role 10 Role 2 Performance erformance Tre Ap Model

4

Computing the cost of the solution.

Page 5: Week 09 Classification evaluation in Rapidminerec/files_1112/lab09-evaluation.pdf · 2011. 11. 23. · ad Excel S lit oata set Role 10 Role 2 Performance erformance Tre Ap Model

5

Page 6: Week 09 Classification evaluation in Rapidminerec/files_1112/lab09-evaluation.pdf · 2011. 11. 23. · ad Excel S lit oata set Role 10 Role 2 Performance erformance Tre Ap Model

6

Changing the cost matrix values.

Page 7: Week 09 Classification evaluation in Rapidminerec/files_1112/lab09-evaluation.pdf · 2011. 11. 23. · ad Excel S lit oata set Role 10 Role 2 Performance erformance Tre Ap Model

7

Computing the cost of the solution while giving different costs to different errors.

Confusion matrix is the same...

but the overall cost is not.

Page 8: Week 09 Classification evaluation in Rapidminerec/files_1112/lab09-evaluation.pdf · 2011. 11. 23. · ad Excel S lit oata set Role 10 Role 2 Performance erformance Tre Ap Model

8

Using the cost matrix when building the model

Page 9: Week 09 Classification evaluation in Rapidminerec/files_1112/lab09-evaluation.pdf · 2011. 11. 23. · ad Excel S lit oata set Role 10 Role 2 Performance erformance Tre Ap Model

9

Page 10: Week 09 Classification evaluation in Rapidminerec/files_1112/lab09-evaluation.pdf · 2011. 11. 23. · ad Excel S lit oata set Role 10 Role 2 Performance erformance Tre Ap Model

10

creating a lift chart

Page 11: Week 09 Classification evaluation in Rapidminerec/files_1112/lab09-evaluation.pdf · 2011. 11. 23. · ad Excel S lit oata set Role 10 Role 2 Performance erformance Tre Ap Model

11

Page 12: Week 09 Classification evaluation in Rapidminerec/files_1112/lab09-evaluation.pdf · 2011. 11. 23. · ad Excel S lit oata set Role 10 Role 2 Performance erformance Tre Ap Model

12

lift chart for two models

Page 13: Week 09 Classification evaluation in Rapidminerec/files_1112/lab09-evaluation.pdf · 2011. 11. 23. · ad Excel S lit oata set Role 10 Role 2 Performance erformance Tre Ap Model

13

Lift chart for the naive Bayes model

Page 14: Week 09 Classification evaluation in Rapidminerec/files_1112/lab09-evaluation.pdf · 2011. 11. 23. · ad Excel S lit oata set Role 10 Role 2 Performance erformance Tre Ap Model

14

Page 15: Week 09 Classification evaluation in Rapidminerec/files_1112/lab09-evaluation.pdf · 2011. 11. 23. · ad Excel S lit oata set Role 10 Role 2 Performance erformance Tre Ap Model

15