running the numbers: improving your position for enrollment planning and forecasting - jeancarlo...
DESCRIPTION
Conference presentation from the Texas Association of Graduate Admissions Professionals (TxGAP) 2012 Professional Development Conference. Author: Jeancarlo Bonilla Director of Graduate Enrollment Management Polytechnic Institute of New York University Description: Learn how to use predictive modeling techniques and apply them to the area of graduate enrollment management. For more information, visit www.txgap.com.TRANSCRIPT
![Page 1: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/1.jpg)
Running the Numbers: Improving Your Position for Enrollment Planning and
Forecasting”
TxGAP – Summer Conference July 20th, 2012
JeanCarlo (J.C) Bonilla
Director of Graduate Enrollment Management New York University, Polytechnic Institute
![Page 2: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/2.jpg)
The Plan for the Session: • Overview of predictive modeling & optimization for enrollment
management • Case 1: Do cycles have memory? The case of the 3-yr adjusted yield (4
examples) • Case 2: Am I making my class? Modeling for scenarios forecasting (3
examples) • Case 3: The magic ball, ranking and an enrollment predictor (2 examples) • Case 4: Opps, I ran out of time, but this is a very cool model
Worksheets download at EnrollmentAnalytics.com
![Page 3: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/3.jpg)
A little bit about me & where I work...
![Page 4: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/4.jpg)
![Page 5: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/5.jpg)
Where is the industry today with the idea of business analytics &
intelligence?
![Page 6: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/6.jpg)
Standard Reports
“what happened”
Ad hoc Report “how many, how often, where”
Query “what is exactly the problem”
Alert “what actions are
required”
Degree of intelligence
Descriptive Analytics
![Page 7: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/7.jpg)
Statistical Model
“why is this happening”
Randomized testing
“what happens if we try this”
Predictive Model/Forecast
“what will happened next”
Optimization “what is the best
that can happened”
Degree of intelligence
Predictive Analytics
![Page 8: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/8.jpg)
Informatics/Analytics industry is moving
from small data to big data from data
analytics to data scientist
![Page 9: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/9.jpg)
So, what do we know so far about
predictive modeling for Enrollment Management?
![Page 10: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/10.jpg)
TACTIC
SUSPECTS> PROSPECTIVE> APPLICANTS> ADMITS> DEPOSITS> NEW
Standard Reports “what happened”
Ad hoc Report “how many, how often, where”
Query “what is exactly the
problem”
Alert “what actions are
required”
![Page 11: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/11.jpg)
TACTIC
Statistical Model “why is this happening”
Random Testing “what happens if we
try this”
Predict & Forecast
“what will happened next”
Optimization “what is the best that
can happened”
Predictive Analytics
SUSPECTS> PROSPECTIVE> APPLICANTS> ADMITS> DEPOSITS> NEW
![Page 12: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/12.jpg)
Examples of Enrollment Predictive Modeling • Case 1: North Dakota University – Type of Model: inquiry model using geo-demographic
– Predictive Power: 36% of students who will enroll & 97% of student who will not enrolled
![Page 13: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/13.jpg)
Examples of Enrollment Predictive Modeling • Case 2: University of Minnesota – Type of Model: application generation model using, ACT and geo-
demographic information
– Predictive Power: 85% of applicants to a “large research university” are from within the same state or form a neighboring state
![Page 14: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/14.jpg)
Examples of Enrollment Predictive Modeling: • Case 3: State University of New York – Type of Model: lead modeling using geo-demographic, academic data,
and financial aid data
– Predictive Power: 45.67% of applicants predicted to enroll did in fact matriculate and 82.16% who where predicted not to enroll did not matriculate
![Page 15: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/15.jpg)
Better predictive power with students who
do not matriculate than with model that forecast actual students enrollments
![Page 16: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/16.jpg)
The “technique” is used in other consolidated markets... if it works for them, it should work for us!
![Page 17: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/17.jpg)
It requires quantitative analysis of past student characteristics to predict probabilities of
future results
![Page 18: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/18.jpg)
Your predictive modeling team should have people who are confortable doing:
The modeling guy: 1. Regression Analysis (logistic regression)
2. Business analytics
The computer guy: 1. Database architecture & design
2. Database querying 3. Data aggregation & integration
4. Data reporting
![Page 19: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/19.jpg)
![Page 20: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/20.jpg)
![Page 21: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/21.jpg)
![Page 22: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/22.jpg)
Access to historical data is required!
![Page 23: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/23.jpg)
Modeling 101: Defining Model Attributes
Student Behavior (influences, emotions,
competition)
Student Characteristics (geo-demographic, academic,
financial aid)
![Page 24: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/24.jpg)
![Page 25: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/25.jpg)
...and off course, there is a problem with that!
![Page 26: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/26.jpg)
SUSPECTS> PROSPECTIVE> APPLICANTS> ADMITS> DEPOSITS> NEW
Stealth Applications 30%-40% of adult students
Source: Aslanian Market Research
![Page 27: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/27.jpg)
...an approach for predictive modeling in enrollment management
![Page 28: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/28.jpg)
Applicants Prospective Students
![Page 29: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/29.jpg)
New students Applicants
![Page 30: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/30.jpg)
CASE#1:
Do cycles have memory? The case of the 3-yr adjusted yield
Predictions through the admissions funnel
Download worksheets at: www.EnrollmentAnalytics.com
![Page 31: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/31.jpg)
Recommendations
1. Rapid “back-of-the-envelop” modeling
2. You can go “up” or “down” the funnel
3. Need for historical data (static snapshots of cycles)
4. Student characteristics add more resolution to the model
5. Use of adjusted 3-year cycles are useful for historical modeling
6. Historical validity: account for new initiatives
![Page 32: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/32.jpg)
CASE#2: Am I making my class?
New Student forecaster
Download worksheets at: www.EnrollmentAnalytics.com
![Page 33: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/33.jpg)
CASE#3: The magic ball
ranking and an enrollment predictor (2 examples)
Download worksheets at: www.EnrollmentAnalytics.com
![Page 34: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/34.jpg)
5-Stage Admissions Funnel
Prospects
Applications
Admits
Deposits
New 2%
![Page 35: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/35.jpg)
Example: say that you have 20k leads in your cycle and only 300 matriculate, then you have a
2% conversion rate
![Page 36: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/36.jpg)
Now, you “observe” that 200 out of your 300 new students presents a subset of 5% of your
prospective students pool. This means that 1000 prospective students (5% of 20k) converted into 200 enrollments, which
means that your conversion rate for this subset is 20%
![Page 37: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/37.jpg)
95%
5%
33%
67%
20,000 prospective students
300 new students
New conversion rate or predictability of 20%
![Page 38: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/38.jpg)
20,000 prospective students
300 new students
FT-‐Dom, 20%
PT, 40%
FT-‐Int'l, 40%
FT-‐Dom, 5%
PT, 40% FT-‐Int'l, 55%
![Page 39: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/39.jpg)
..and if you get really good at understanding your students...
![Page 40: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/40.jpg)
Build a model that does the following:
Student Name Status Predictor
Hall, Joy
Inquiry 11/16/10
0.4 App. N/A Adm. N/A Conf. N/A Enr. N/A
Li, Xiao
Inquiry 12/22/10
0.6 App. 12/24/10 Adm. 3/23/11 Conf. 4/2/11 Enr. N/A
Lopez, Jose
Inquiry 12/5/10
0.2 App. 1/5/11 Adm. 1/29/11 Conf. 3/16/11 Enr. N/A
Mitchell, Tamara
Inquiry 12/20/10
0.2 App. 2/3/11 Adm. N/A Conf. N/A Enr. N/A
Smith, John
Inquiry 1/26/11
0.4 App. 1/28/11 Adm. 4/16/11 Conf. 5/5/11 Enr. N/A
Troy, Bryan
Inquiry 12/13/10
0.9 App. N/A Adm. N/A Conf. N/A Enr. N/A
![Page 41: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/41.jpg)
So, how can I build a model like that predicts enrollments?
![Page 42: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/42.jpg)
Student Uncertainty & Variance
Academic
Financial
Geographical
Demographical
Behavior & Personal Life
FT vs intl vs PT
![Page 43: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/43.jpg)
Recommendations for Advanced Models
1. It gets complicated
2. Its “easy” to model for student characteristics, but complexity increases when accounting for student behavior
3. Models are better at predicting student who do NOT register
4. Every school is different, so every model is also different
5. Trust your instincts! No one knows students better than you... Your job is then trying to articulate and generalized characteristics and behavior
![Page 44: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/44.jpg)
CASE#4: Opps, I ran out of time, but this is a very
cool model
Download worksheets at: www.EnrollmentAnalytics.com
![Page 45: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/45.jpg)
Final Recommendations
1. Plan for good, bad, and what you think is going to realistic
2. Avoid predictions but give options
3. Its about resource allocation
4. Work with other groups in your institution
5. Trust your GEM instincts
6. Its earsier to account for student characteristics, but modeling and forecasting behavior is very complex
![Page 46: Running the Numbers: Improving Your Position for Enrollment Planning and Forecasting - Jeancarlo Bonilla](https://reader033.vdocument.in/reader033/viewer/2022052900/555d829dd8b42a6c3d8b4c87/html5/thumbnails/46.jpg)