learn. connect. explore....machine learning for the masses: azure ml in action arvind shyamsundar...

70
Learn. Connect. Explore. Learn. Connect. Explore.

Upload: others

Post on 14-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

Learn. Connect. Explore.Learn. Connect. Explore.

Page 2: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 3: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

Machine Learning for the masses: Azure ML in action

Arvind Shyamsundar

Principal PFE, Microsoft Services

Sunil Kumar BS

Escalation Engineer, Microsoft Services

Page 4: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

What is Machine Learning?

Optimizean action given a utility

function

Predict new data based on recorded

data

Extracthidden

structure from the

data

Summarizedata into concise

descriptions

Adaptbased on recorded

data

Methods and Systems that …

Page 5: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

History of Machine Learning

• Distributed

computing &

storage

• Deep Neural

Networks

• Learning =

Scalable,

Adaptive

Computation for

Various Big

Data

2011 (“Big

Data, DNN”)

• Wide

application in

products

• Statistical

Modeling of

Data

• Learning =

Parameter

Estimation or

Inference

2005

(“Graphical

Models”)

• Statistical

Learning Theory

• Scoring Systems

• Learning =

Optimization of

Convex

Functions

2000

(“Kernel

Machines”)

• Expert Systems

• Decision-Tree

Learning (C4.5)

• Learning =

Methods to

automatically

build Expert

Systems

1990

(“Symbolic”)

• Neural

Networks

• Artificial

Intelligence

• Learning =

Adaptation of

Neurons based

on External

Stimuli

1980

(“Neuro”)

Page 6: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

Machine Learning IS NOT…

can yield Garbage-In-Knowledge-

Out

perform good predictions

without data modeling &

feature

engineering

Silver-bullet for all data-

driven tasks –it’s a powerful

data tool!

are a replacement for business rules – they

augment them!

Methods and Systems that …

Page 7: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

Common Classes of Problems

Classification Regression Recommenders Clustering

Page 8: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

What is MAML?

MAML consists of:

• ML Studio

• ML API Service

• Azure Marketplace

• Planned SDK

• Strong partner ecosystem

Our solution to address the shortage of data scientists and the huge demand for predictive analytics is MAML

Key Features:

• Industry leading algorithms

• Extensibility using R (plans to extend to Python)

• Easiest path from development to production applications

Page 9: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

Azure ML data sources• Read from various data sources including:

• Local drive

• HTTP

• Azure Blob

• SQL Azure

• Azure Table

• Hive Query (Hadoop)

• Power Query

• Write out the results:• Azure Blob

• SQL Azure

• Azure Table

• Hive Query (Hadoop)

Page 10: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

End – to End Modeling process

Page 11: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

Introducing Azure ML Studio

Demo

Page 12: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

Classification Problem

Demo

Page 13: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

Advanced Classification Problem

Demo

Page 14: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

Clustering Problem

Demo

Page 15: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

Questions ?

Page 16: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

ReferencesRelated references for you to expand your knowledge on the subject

• Azure ML Studio

technet.microsoft.com/en-in

aka.ms/mva

msdn.microsoft.com/

https://studio.azureml.net/

• Machine Learning Bloghttp://blogs.technet.com/b/machinelearning/

• MSDN

http://azure.microsoft.com/en-us/services/machine-learning/

http://azure.microsoft.com/en-us/documentation/services/machine-

learning/

http://blogs.microsoft.com/blog/2014/06/16/microsoft-azure-

machine-learning-combines-power-of-comprehensive-machine-

learning-with-benefits-of-cloud/

Page 17: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

Datasets Used• UCI Machine Learning Repository: Indian Liver Patient

Dataset• http://archive.ics.uci.edu/ml/datasets/ILPD+(Indian+Liver+Pat

ient+Dataset)

• Cricket data• http://CricSheet.org

• Bike Buyer: AdventureWorks sample

Page 18: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

Your Feedback is Important

OPTION 3: Feedback stations outside the hall

Fill out evaluation of this session and help shape future events.

OPTION 1 OPTION 2

Replace this space with the

actual QR Code

Page 19: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

Follow us online

Facebookfacebook.com/MicrosoftDeveloper.India

twitter.com/msdevindia

Twitter

Arvind Shyamsundar:

@arvisamhttp://aka.ms/arvindsh

Sunil Kumar B.S:

@Sunilbs_SQLDEV

Page 20: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

QUIZ!

Page 21: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

Name any 3 data sources which can be natively consumed in AzureML?

Page 22: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

Which MAML module is used to specify the categorical nature of a column?

Page 23: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

What is the relevance and interpretation of ‘AUC’?

Page 24: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

In what modes and from which languages can you invoke the MAML generated web service API?

Page 25: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

What is the benefit and purpose of using Cross Validation module?

Page 26: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

Which MAML module is used to specify the categorical nature of a column?

Page 27: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

Which ML problem type best fits a scenario where specific stock trading deals or companies have to be branded as ‘suspicious’?

Page 28: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

What do you need to configure when you get started with MAML from the Azure Portal?

Page 29: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

What are the benefits of Workspaces in Azure ML?

Page 30: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

How is the Azure MarketPlacerelated to Azure ML?

Page 31: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 32: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services

APPENDIX

Page 33: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 34: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 35: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 36: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 37: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 38: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 39: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 40: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 41: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 42: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 43: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 44: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 45: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 46: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 47: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 48: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 49: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 50: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 51: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 52: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 53: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 54: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 55: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 56: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 57: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 58: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 59: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 60: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 61: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 62: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 63: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 64: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 65: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 66: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 67: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 68: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 69: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services
Page 70: Learn. Connect. Explore....Machine Learning for the masses: Azure ML in action Arvind Shyamsundar Principal PFE, Microsoft Services Sunil Kumar BS Escalation Engineer, Microsoft Services