apache spark with machine learning
TRANSCRIPT
Machine learning ExamplesSpam OR Non Spam Clustering
Recommendations Market Basket Analysis
What is Machine learning? It is a field of artificial intelligence, which is a sub-field of
computer science, in which we teach computers by example and ask computer to predict for new example automatically .
Ex: 1) Spam email or not spam email.
2)Product Recommendation.
3)What will be tomorrow’s temperature.
Types Of Machine Learning
Terminology• Observations :Items or entities used for learning or evaluation
in the context of spam detection, emails.
• Features :Are attributes used to represent an observation.
Ex:In housing prices prediction ,size,area,floors etc..
• Labels :Are values or categories assigned to observations. and again, in the context of spam detection, these can be an email being defined as spam or not spam.
• Training and test data :Observations that we use to train and evaluate a learning algorithm.
Tools Or Programing languages Matlab.
Octave.
R.
SAS.
SPSS.
Python.
etc..
What is the Problem ? Most of the traditional analytical tools runs on single
machine.
Example Spam Or Non Spam.
TFIDF
i work on spark hadoop
I work on spark 1 1 1 1 0
I work on hadoop 1 1 1 0 1
Cross Industry Standard Process for Data Mining(CRISP-DM)
ML Use Cases Marketing
Ex:Customer segmentation, Product mix, Recommendation Sales
Ex:Demand forecasting Risk
Ex:Fraud detection Customer support
Ex:Call centers
ML Use Cases Cont.. Healthcare
Ex:Survival analysis
Consumer Financial
Ex:Credit card fraud
Retail
Ex:Market Basket Analysis
Insurance
Manufacturing
Thanks