churn prediction

27
Computational Computational Intelligence methods Intelligence methods for churn prediction in for churn prediction in telecommunication telecommunication companies companies Hossam Faris, PhD Associate Professor Business Information Technology Department King Abdullah II School for Information Technology The University of Jordan [email protected] [email protected]

Upload: gigi-lino

Post on 18-Jan-2017

179 views

Category:

Data & Analytics


0 download

TRANSCRIPT

Page 1: Churn prediction

Computational Computational Intelligence methods for Intelligence methods for churn prediction in churn prediction in telecommunication telecommunication companiescompanies

Hossam Faris, PhDAssociate ProfessorBusiness Information Technology DepartmentKing Abdullah II School for Information TechnologyThe University of [email protected]@gmail.com

Page 2: Churn prediction

IntroductionIntroductionThe market is very dynamic and

highly competitive.It is very easy for customers to

switch from one service provider to another for a better price rates or service quality.

Telecommunication companies suffer a loss of 20-40% of their customers every year!

Page 3: Churn prediction

IntroductionIntroduction• Companies are aware that

attracting new customers is much more costly than keeping current customers.

• Companies in the telecommunication market realize that customers are the most important asset for them.

Page 4: Churn prediction

What is What is customer churn customer churn ??In business, “customer churn” is a

term commonly refers to customers who stop using some services or terminate their contract and subscription with a company to switch to another competitor.

Customer churn has many reasons and factors. Such reasons include quality and cost of services.

Page 5: Churn prediction

Churn management and Churn management and predictionprediction

The goal of churn management is to keep current customers as long as the company is alive in the market.

Revenue comes from the creation and maintaining long-term relationships with the customers.

A better churn management can help Customer Relationship Management (CRM) in decision making and establishing effective customer retention campaigns.

Page 6: Churn prediction

The targetThe target• We need to identify (predict)

those customers who are probably will leave.

• Specific marketing campaigns could be designed to target the most risky customer segments.

• Special discounts and subscriptions could be offered.

Page 7: Churn prediction

From where to start ?From where to start ?Detecting a churn by observation is

almost impossible.Traditional surveys based on running

questionnaires or interviews suffer from a high cost, limited access to customer population and data self-reporting

Telecom companies realize that their existing customer database is the key.

Service providers started to invest more in data mining techniques that can aid in having an efficient churn prediction models

Page 8: Churn prediction

ChallengesChallengesThe available data is imbalanced.Different cost for each class.High number of related variables.BigData

Page 9: Churn prediction

Customer related featuresCustomer related features

Feature name Description 

3G The subscriber is provided with 3G service (Yes, No)

Total Consumption (con) Total monthly fees (calling +SMS) in (JD)Calling fees Total monthly calling fees (JD)

Local SMS fees Monthly local SMS fees(JD)Int. calling fees Monthly fees for international calling (JD)Local SMS count Number of monthly local SMSInt. SMS count Number of monthly international SMS

Int. MOU Total of international outgoing calls in minutes

Total MOU Total minutes of use for all outgoing callsOn net MOU Minutes of use for on-net-outgoing calls

Churn Churning customer status (Yes, No)

Page 10: Churn prediction

Research linesResearch lines The state-of-art basic classifiers approaches:

create or modify the algorithms that exist for churn prediction.

Data level approaches: add a preprocessing step where the data distribution is rebalanced in order to decrease the effect of the skewed class distribution in the learning process.

Ensembles of classifiers each ensemble is a group of classifiers trained independently then all their predictions are combines. Ensemble classifier proofed to have better generalization and outperform single classifiers.

Page 11: Churn prediction

1.Basic classifiers 1.Basic classifiers approachapproachExamples: The multilayer

Perceptron (MLP)

Page 12: Churn prediction

Genetic ProgrammingGenetic Programming

Page 13: Churn prediction

Identifying important Identifying important variables in MLPvariables in MLP

Page 14: Churn prediction

Change on Error (CoE)Change on Error (CoE)

Page 15: Churn prediction

Garson’s weights methodGarson’s weights method

Page 16: Churn prediction

Identifying important Identifying important variables in MLPvariables in MLP

During the evolutionary cycle of GP, input features that help GP in improving the fitness value of the generated individuals will survive while the weak the features will be excluded and disappear from the remaining generations.

Page 17: Churn prediction

Variable Frequency in GPVariable Frequency in GP

Page 18: Churn prediction

2.Data level approaches2.Data level approachesThis approach is performed on two

stages:Cleaning the data : A clustering method

is used to identify different behavior patterns of customers. Small and unrepresentative data are treated as outliers and noise. So they are eliminated.

Modeling: A classification technique is applied to develop the final prediction model.

Page 19: Churn prediction

SOM+GPSOM+GP

Page 20: Churn prediction

Self Organizing Maps (SOM)Self Organizing Maps (SOM)

Page 21: Churn prediction

Applied frameworkApplied framework

Page 22: Churn prediction

ResultsResults

Page 23: Churn prediction

3.Ensembles of classifiers3.Ensembles of classifiers• NCL is an ensemble

learning technique that encourages diversity explicitly among ensemble members through their negative correlation

• Negative correlation Learning based on MLP networks

Page 24: Churn prediction

NCL+MLP resultsNCL+MLP results

Page 25: Churn prediction

Future work Future work Investigating the application of

cost-sensitive methods in churn prediction.

It is very interesting to study the most influencing factors that affect customer churn in different regions.

Page 26: Churn prediction

Published researchPublished research• Faris, Hossam, Bashar Al-Shboul, and Nazeeh

Ghatasheh. "A genetic programming based framework for churn prediction in telecommunication industry." Computational Collective Intelligence. Technologies and Applications. Springer International Publishing, (2014).

• Rodan, Ali, Faris, Hossam and others. "A support vector machine approach for churn prediction in telecom industry." International Information Institute (Tokyo). Information17.8 (2014): 3961.

• Faris, Hossam. "Neighborhood cleaning rules and particle swarm optimization for predicting customer churn behavior in telecom industry."International Journal of Advanced Science and Technology 68 (2014): 11-22.

• Rodan, A., Fayyoumi, A., Faris, H., Alsakran, J., & Al-Kadi, O. “Negative Correlation Learning for Customer Churn Prediction: A Comparison Study”. The Scientific World Journal, (2015).

Page 27: Churn prediction

Questions Questions ??

Thank you