data mining: weka - university of...

12
1 Data Mining: WEKA The University of Iowa Intelligent Systems Laboratory Outline •Preprocessing and “arff” files •Filters, classifiers, and visualization 10 f ld lid i The University of Iowa Intelligent Systems Laboratory 10-fold cross-validation •Training and testing •Quality measurements •Interpretation of results Data Mining Procedures Prepare the data into desired formats Preprocess the data if necessary Select different algorithms based on The University of Iowa Intelligent Systems Laboratory Select different algorithms based on application or domain expertise Evaluate the results and repeat experiments again if necessary Data Sets The University of Iowa Intelligent Systems Laboratory Arff file @relation weather @attribute No real The University of Iowa Intelligent Systems Laboratory @attribute No real @attribute outlook {sunny,overcast,rainy} @attribute temperature real @attribute humidity real @attribute windy {TRUE,FALSE} @attribute play {yes,no} Arff file The University of Iowa Intelligent Systems Laboratory

Upload: vonhi

Post on 18-Mar-2018

217 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Data Mining: WEKA - University of Iowauser.engineering.uiowa.edu/~coneng/lectures/Lecture_DM_Weka-6.pdf · 1 Data Mining: WEKA The University of Iowa Intelligent Systems Laboratory

1

Data Mining: WEKA

The University of Iowa Intelligent Systems Laboratory

Outline

•Preprocessing and “arff” files•Filters, classifiers, and visualization10 f ld lid i

The University of Iowa Intelligent Systems Laboratory

•10-fold cross-validation •Training and testing•Quality measurements•Interpretation of results

Data Mining Procedures

• Prepare the data into desired formats• Preprocess the data if necessary• Select different algorithms based on

The University of Iowa Intelligent Systems Laboratory

• Select different algorithms based on application or domain expertise

• Evaluate the results and repeat experiments again if necessary

Data Sets

The University of Iowa Intelligent Systems Laboratory

Arff file

@ relation weather@ attribu te No real

The University of Iowa Intelligent Systems Laboratory

@ attribu te No real@ attribu te ou tlook {sunny,overcast,rainy}@ attribu te temperatu re real@ attribu te humidity real@ attribu te windy {TRUE,FALSE}@ attribu te play {yes,no}

Arff file

The University of Iowa Intelligent Systems Laboratory

Page 2: Data Mining: WEKA - University of Iowauser.engineering.uiowa.edu/~coneng/lectures/Lecture_DM_Weka-6.pdf · 1 Data Mining: WEKA The University of Iowa Intelligent Systems Laboratory

2

Arff file

The University of Iowa Intelligent Systems Laboratory

Arff file

The University of Iowa Intelligent Systems Laboratory

WEKA

The University of Iowa Intelligent Systems Laboratory

WEKA Explorer

The University of Iowa Intelligent Systems Laboratory

WEKA

The University of Iowa Intelligent Systems Laboratory

WEKA

The University of Iowa Intelligent Systems Laboratory

Page 3: Data Mining: WEKA - University of Iowauser.engineering.uiowa.edu/~coneng/lectures/Lecture_DM_Weka-6.pdf · 1 Data Mining: WEKA The University of Iowa Intelligent Systems Laboratory

3

Parameter Distribution

The University of Iowa Intelligent Systems Laboratory

Filters

The University of Iowa Intelligent Systems Laboratory

Filters

The University of Iowa Intelligent Systems Laboratory

Filters

The University of Iowa Intelligent Systems Laboratory

Filters

The University of Iowa Intelligent Systems Laboratory

Filters

The University of Iowa Intelligent Systems Laboratory

Page 4: Data Mining: WEKA - University of Iowauser.engineering.uiowa.edu/~coneng/lectures/Lecture_DM_Weka-6.pdf · 1 Data Mining: WEKA The University of Iowa Intelligent Systems Laboratory

4

Filters

The University of Iowa Intelligent Systems Laboratory

Classifier

The University of Iowa Intelligent Systems Laboratory

Classifier

The University of Iowa Intelligent Systems Laboratory

Classifiers

The University of Iowa Intelligent Systems Laboratory

Classifiers

The University of Iowa Intelligent Systems Laboratory

Classifiers

The University of Iowa Intelligent Systems Laboratory

Page 5: Data Mining: WEKA - University of Iowauser.engineering.uiowa.edu/~coneng/lectures/Lecture_DM_Weka-6.pdf · 1 Data Mining: WEKA The University of Iowa Intelligent Systems Laboratory

5

Decision Tree

The University of Iowa Intelligent Systems Laboratory

Decision Tree

The University of Iowa Intelligent Systems Laboratory

Decision Tree

The University of Iowa Intelligent Systems Laboratory

Decision Tree

The University of Iowa Intelligent Systems Laboratory

Decision Tree

The University of Iowa Intelligent Systems Laboratory

Decision Tree

The University of Iowa Intelligent Systems Laboratory

Page 6: Data Mining: WEKA - University of Iowauser.engineering.uiowa.edu/~coneng/lectures/Lecture_DM_Weka-6.pdf · 1 Data Mining: WEKA The University of Iowa Intelligent Systems Laboratory

6

Classifier: PART

The University of Iowa Intelligent Systems Laboratory

Classifier: PART

The University of Iowa Intelligent Systems Laboratory

Classifier: PART

The University of Iowa Intelligent Systems Laboratory

Classifier: PART

The University of Iowa Intelligent Systems Laboratory

Neural Networks

The University of Iowa Intelligent Systems Laboratory

Neural Networks

The University of Iowa Intelligent Systems Laboratory

Page 7: Data Mining: WEKA - University of Iowauser.engineering.uiowa.edu/~coneng/lectures/Lecture_DM_Weka-6.pdf · 1 Data Mining: WEKA The University of Iowa Intelligent Systems Laboratory

7

Neural Networks

The University of Iowa Intelligent Systems Laboratory

Association Rules

The University of Iowa Intelligent Systems Laboratory

Association Rules

The University of Iowa Intelligent Systems Laboratory

Association Rules

The University of Iowa Intelligent Systems Laboratory

Visualization

The University of Iowa Intelligent Systems Laboratory

Visualization

The University of Iowa Intelligent Systems Laboratory

Page 8: Data Mining: WEKA - University of Iowauser.engineering.uiowa.edu/~coneng/lectures/Lecture_DM_Weka-6.pdf · 1 Data Mining: WEKA The University of Iowa Intelligent Systems Laboratory

8

Clustering

The University of Iowa Intelligent Systems Laboratory

Clustering

The University of Iowa Intelligent Systems Laboratory

Clustering

The University of Iowa Intelligent Systems Laboratory

Test Data Analysis

The University of Iowa Intelligent Systems Laboratory

Test Data Analysis

The University of Iowa Intelligent Systems Laboratory

Test Data Analysis

The University of Iowa Intelligent Systems Laboratory

Page 9: Data Mining: WEKA - University of Iowauser.engineering.uiowa.edu/~coneng/lectures/Lecture_DM_Weka-6.pdf · 1 Data Mining: WEKA The University of Iowa Intelligent Systems Laboratory

9

Test Data Analysis

The University of Iowa Intelligent Systems Laboratory

Test Data Analysis

The University of Iowa Intelligent Systems Laboratory

Test Data Analysis

The University of Iowa Intelligent Systems Laboratory

Test Data Analysis

The University of Iowa Intelligent Systems Laboratory

Test Data Analysis

The University of Iowa Intelligent Systems Laboratory

Test Data Analysis

The University of Iowa Intelligent Systems Laboratory

Page 10: Data Mining: WEKA - University of Iowauser.engineering.uiowa.edu/~coneng/lectures/Lecture_DM_Weka-6.pdf · 1 Data Mining: WEKA The University of Iowa Intelligent Systems Laboratory

10

Knowledge Flow: Evaluation

The University of Iowa Intelligent Systems Laboratory

Knowledge Flow: Visualization

The University of Iowa Intelligent Systems Laboratory

Knowledge Flow: Data files

The University of Iowa Intelligent Systems Laboratory

Knowledge Flow: Classifiers

The University of Iowa Intelligent Systems Laboratory

Knowledge Flow: Filters

The University of Iowa Intelligent Systems Laboratory

Knowledge Flow: Example

The University of Iowa Intelligent Systems Laboratory

Page 11: Data Mining: WEKA - University of Iowauser.engineering.uiowa.edu/~coneng/lectures/Lecture_DM_Weka-6.pdf · 1 Data Mining: WEKA The University of Iowa Intelligent Systems Laboratory

11

Knowledge Flow: Example

The University of Iowa Intelligent Systems Laboratory

Knowledge Flow: Example

The University of Iowa Intelligent Systems Laboratory

Knowledge Flow: Example

The University of Iowa Intelligent Systems Laboratory

Knowledge Flow: Example

The University of Iowa Intelligent Systems Laboratory

Knowledge Flow: Example

The University of Iowa Intelligent Systems Laboratory

Knowledge Flow: Example

The University of Iowa Intelligent Systems Laboratory

Page 12: Data Mining: WEKA - University of Iowauser.engineering.uiowa.edu/~coneng/lectures/Lecture_DM_Weka-6.pdf · 1 Data Mining: WEKA The University of Iowa Intelligent Systems Laboratory

12

Knowledge Flow: Example

The University of Iowa Intelligent Systems Laboratory

Knowledge Flow: Example

The University of Iowa Intelligent Systems Laboratory

Knowledge Flow: Example

The University of Iowa Intelligent Systems Laboratory

Knowledge Flow: Example

The University of Iowa Intelligent Systems Laboratory

Knowledge Flow: Example

The University of Iowa Intelligent Systems Laboratory

Knowledge Flow: Example

The University of Iowa Intelligent Systems Laboratory