ml toolkits – lightside and weka€¦ · weka explorer pick a model evaluation options results....

17
ML Toolkits – LightSIDE and Weka Sandeep Avula [email protected]

Upload: others

Post on 16-Oct-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: ML Toolkits – LightSIDE and Weka€¦ · Weka Explorer Pick a model Evaluation options Results. Title: 05-ML Toolkit Created Date: 5/31/2019 4:26:50 AM

ML Toolkits – LightSIDE and Weka

Sandeep [email protected]

Page 2: ML Toolkits – LightSIDE and Weka€¦ · Weka Explorer Pick a model Evaluation options Results. Title: 05-ML Toolkit Created Date: 5/31/2019 4:26:50 AM

Outline

Toolkits: LightSIDE and Weka

Workflow

Page 3: ML Toolkits – LightSIDE and Weka€¦ · Weka Explorer Pick a model Evaluation options Results. Title: 05-ML Toolkit Created Date: 5/31/2019 4:26:50 AM

Tips to become comfortable with scikit

Learn how to print “Hello world!”

Learn how to write a “function” that can return the sum of two numbers. (This means you should also check what a main method is)

Learn how to open and read csv and json files.

Learn how to read each line and column.

Where can you do all of this? YouTube or StackOverflow!

Page 4: ML Toolkits – LightSIDE and Weka€¦ · Weka Explorer Pick a model Evaluation options Results. Title: 05-ML Toolkit Created Date: 5/31/2019 4:26:50 AM

LightSIDE

Download ZIP file from the course website.

Unpack and open the LightSIDE application.

Go to your terminal when you extracted the file and type ./run.sh (for mac)

Page 5: ML Toolkits – LightSIDE and Weka€¦ · Weka Explorer Pick a model Evaluation options Results. Title: 05-ML Toolkit Created Date: 5/31/2019 4:26:50 AM

LightSIDE

Page 6: ML Toolkits – LightSIDE and Weka€¦ · Weka Explorer Pick a model Evaluation options Results. Title: 05-ML Toolkit Created Date: 5/31/2019 4:26:50 AM

LightSIDE Workflow

Prepare the data

Extract the features

Build models

Make predictions

Error analysis

Page 7: ML Toolkits – LightSIDE and Weka€¦ · Weka Explorer Pick a model Evaluation options Results. Title: 05-ML Toolkit Created Date: 5/31/2019 4:26:50 AM

Prepare the data

Csv file where one column is the text and the other is the label.

Page 8: ML Toolkits – LightSIDE and Weka€¦ · Weka Explorer Pick a model Evaluation options Results. Title: 05-ML Toolkit Created Date: 5/31/2019 4:26:50 AM

Extract the featuresLoad data

Select extractor

Configuration options

Performance of features

Execute

Page 9: ML Toolkits – LightSIDE and Weka€¦ · Weka Explorer Pick a model Evaluation options Results. Title: 05-ML Toolkit Created Date: 5/31/2019 4:26:50 AM

Feature Representation

Page 10: ML Toolkits – LightSIDE and Weka€¦ · Weka Explorer Pick a model Evaluation options Results. Title: 05-ML Toolkit Created Date: 5/31/2019 4:26:50 AM

Model Building + Predictions

Select the model: For example, select Naive Bayes

Evaluation: Feed independent test data set or do n-fold cross validation.

Page 11: ML Toolkits – LightSIDE and Weka€¦ · Weka Explorer Pick a model Evaluation options Results. Title: 05-ML Toolkit Created Date: 5/31/2019 4:26:50 AM

Model Building + Predictions

Model Selection

Evaluation optionsExecute

Check performance

Page 12: ML Toolkits – LightSIDE and Weka€¦ · Weka Explorer Pick a model Evaluation options Results. Title: 05-ML Toolkit Created Date: 5/31/2019 4:26:50 AM

Weka

Page 13: ML Toolkits – LightSIDE and Weka€¦ · Weka Explorer Pick a model Evaluation options Results. Title: 05-ML Toolkit Created Date: 5/31/2019 4:26:50 AM

Workflow

Prepare the data

Extract the features

Build models

Make predictions

Error analysis

Page 14: ML Toolkits – LightSIDE and Weka€¦ · Weka Explorer Pick a model Evaluation options Results. Title: 05-ML Toolkit Created Date: 5/31/2019 4:26:50 AM

Data

.arff formatRelation name

Features or attributes

Data

Page 15: ML Toolkits – LightSIDE and Weka€¦ · Weka Explorer Pick a model Evaluation options Results. Title: 05-ML Toolkit Created Date: 5/31/2019 4:26:50 AM

Weka Explorer

Select Explorer

Page 16: ML Toolkits – LightSIDE and Weka€¦ · Weka Explorer Pick a model Evaluation options Results. Title: 05-ML Toolkit Created Date: 5/31/2019 4:26:50 AM

Weka ExplorerOpen .arff file from here

Feature selection

Filtering options (eg: normalization)

Feature distribution

Page 17: ML Toolkits – LightSIDE and Weka€¦ · Weka Explorer Pick a model Evaluation options Results. Title: 05-ML Toolkit Created Date: 5/31/2019 4:26:50 AM

Weka Explorer

Pick a model

Evaluation options

Results