![Page 1: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/1.jpg)
Multi-Institutional Data Predicting Transfer Student
Success
Denise Nadasen Anna Van Wie
Institutional ResearchUniversity of Maryland
University College
![Page 2: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/2.jpg)
Outcomes for this Session• You will learn about the:
– Goals for this grant and the research project
– Process for integrating a multi-institutional data base
– Research questions, methods, and findings– Lessons learned and next steps
2
![Page 3: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/3.jpg)
Goals of the grant• Collaborate with the community colleges • Define research questions and variables• Build a dataset for transfer students• Explore predictor/outcome variables • Predict student success • Report the results at national conferences• Use the results to inform policy and
practice to better serve transfer students3
![Page 4: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/4.jpg)
Collaborative Partners
• UMUC is an online institution that enrolls over 90,000 diverse students each year worldwide
• Prince George’s Community College is located within two miles of UMUC’s Academic Center and enrolls over 37,000 diverse students.
• Montgomery College is located within 10 miles of UMUC’s largest regional center, and enrolls over 35,000 diverse students.
4
![Page 5: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/5.jpg)
The Team• PI– President, Provost• Sponsor – Institutional Research• Partners
– Montgomery College and Prince George’s Community College
– Undergraduate retention and data mining specialist– External evaluators
• Researchers:– Cheoleon Lee, Jing Gao, Futoshi Yumoto, Husein Abduhl-
Hamid• Data Mining Specialists
– Stephen Penn, The Two Crows5
![Page 6: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/6.jpg)
The Student Population• Students enrolled at UMUC between
2005 and 2011• PG and MC transfer students
– Direct compare (32,000)– National Student Clearinghouse (12,000)– UMUC records (8,000)
6
![Page 7: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/7.jpg)
Merging Multi-Institutional Data• Protect this data! • Balance institutional-specific protocols with
research-based definitions• Address data anomalies• Distinguish student level vs. course level• Define LMS data
– Limits on data extract
7
![Page 8: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/8.jpg)
KDM• Integrates student data
– Community College and UMUC SIS– Demographic– Courses – Performance– Classroom behavior (LMS)
• 300 source and derived variables• Gather from disparate sources• One time snapshot
8
![Page 9: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/9.jpg)
WTOnline
ClassroomPeopleSoft
Live SIS with UMUC students
PGCC students and
class data
MC-PGCC-UMUC TransfersUMUC students who transferred from MC or PGCC and
were matched in the BASE file
Base ExtractUMUC undergrad students enrolled
between Spring 2005 and Spring 2011
Data WarehouseUMUC students from
PeopleSoft Daily Update
MC students and class
data
WT extract
Classroom activity
Prior Work
derived data for transfer students
![Page 10: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/10.jpg)
Question• What barriers would your
institution face in merging multi-institutional data?
10
![Page 11: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/11.jpg)
Research Goals• Define outcome variables• Define predictor variables• Model the student lifecycle• Determine the success and failure
factors• Develop and implement interventions• Impact outcomes
11
![Page 12: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/12.jpg)
Outcome Variables• Successful course completion (percent)• First term GPA (dichotomized)• Reenrollment in next term (Y/N)• Retention (12 month window – Y/N)• Student Classification (Slackers,
Splitters, Strivers, and Stars)
12
![Page 13: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/13.jpg)
Transfer Student Progressions
13
cc
cc
First Semester
Semester 2 Last Semester
Four-Year Institution
Demog and Other
Academic Work
Transfer
Transfer
Graduate School
![Page 14: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/14.jpg)
Research Studies
14
![Page 15: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/15.jpg)
Which variables contribute to the prediction of online course success?
The data:• 4,558 new, undergraduate, first bachelor-
degree seeking enrollments in 15 UMUC online gateway courses in Spring 2011.
• Transfer data on students from partner institutions, Montgomery College (MC) and Prince George's Community College (PGCC).
![Page 16: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/16.jpg)
Methodology
• Exploratory factor analysis (EFA) was used to identify key covariates.
• Logistic regression was used to predict course success.
![Page 17: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/17.jpg)
Findings• Total number of transferred credits is the best
predictor of course success– pseudo R2 value around .12
• GPA from transferred credits is the second best predictor of course success – pseudo R2 around .11
• Semester course load contributes less to course success than other covariates.
![Page 18: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/18.jpg)
Findings
• Four of five predictors derived from online student behavior show a strong contribution to successful course completion.
![Page 19: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/19.jpg)
Final Predictive Model
Significant Variables
Total number of transfer credits
Summary of students’ week 0 behavior prior to the first day
GPA from transferred credits
Semester course load
Amount of time since students attended the last institution
Significant Online behaviors
Read a conference note
Entering a class
Created a conference note
Created a response note
![Page 20: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/20.jpg)
Which variables predict retention in an online environment?
• The same data set for the prediction of course success
• Add in retention status from Summer 2011, Fall 2011, and Spring 2012.
![Page 21: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/21.jpg)
Methodology
• Logistic regression
• Preliminary analysis focused on the evaluation of covariates (as identified in the previous analysis) predictors based on the students’ coursework behavior, and course success.
![Page 22: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/22.jpg)
Findings
• The covariates and student behavior variables made less of a contribution to this model than the prediction of course success.
• These results indicate that course success may be a good predictor of retention.
![Page 23: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/23.jpg)
What is the relationship between prior academic coursework and UMUC first
semester gateway course on re-enrollment?
The population:• Students new to UMUC in Fall 2008 to Fall
2010• Took ACCT220, BMGT110, CMIS102,
GVPT170, or PSYC100 in their first semester.
![Page 24: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/24.jpg)
Methodology
• Association algorithm Apriori to determine relationships between courses in previous academic work and re-enrollment rates.
• The algorithm indicates when a certain condition is found another condition can be expected.
![Page 25: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/25.jpg)
Findings
Significant Course Relationships
Community College Course Disciplines First UMUC Course
Math or Business ACCT 220
Math or Business CMIS 102
Business or Science BMGT 110
Science or communication GVPT 170
Math or communication PSYC 100
We cannot assume causality
![Page 26: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/26.jpg)
Current Studies
26
![Page 27: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/27.jpg)
Examine CC Courses
• Explore relationship between CC courses and first term GPA
• Identify courses of interest• Developmental Ed sequencing• Successful completion of CC course• Mixing course level and student level
data
27
![Page 28: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/28.jpg)
Predicting First Term GPA• What CC variables predict first term
GPA of 2.0 or higher?• Course Efficiency• CC courses
– English, Math, Speech, Computer, Honors, On-line Course, Remedial
• Demographics– Age, Gender, Race, Marital Status, Cohort,
Community College Origin, Terms skipped
28
![Page 29: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/29.jpg)
The Population
• 9,063 students from MC and PGCC• Mostly Single, African-American, and
female• Most do not skip terms• Most get A’s and B’s at CC• Most have >2.0 at UMUC• Only PGCC offered online courses
29
![Page 30: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/30.jpg)
Predictors of Success
Race
Gender
Math
Computer
On-line
Age
Speech
Course Efficiency
English
Success @ UMUC
Marital Status
C.C
. Cou
rses
Honors
Remedial Logistic Regression
30
![Page 31: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/31.jpg)
Question• What CC variables do you think are
good predictors?
31
![Page 32: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/32.jpg)
Findings
• Predictive variables:– Age, marital status, and under-represented
minorities have predictive power– Math and Honors courses have positive
effects– Remedial and Online have a negative
effect– Course efficiency has a positive effect
32
![Page 33: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/33.jpg)
Predicting Student Clusters
• Dataset includes all PGCC and MC students who transferred
• Student level derived variables• Cluster students based on retention and
first term GPA at UMUC• Predict clusters from prior CC work and
demographic variables
33
![Page 34: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/34.jpg)
34
Strivers Stars
Slackers
Splitters
Success QuadrantsR
eten
tion
Yes
Ret
entio
n N
o
GPA > 2.0GPA < 2.0
![Page 35: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/35.jpg)
Stay Tuned ….
• Data mining continues– So far, Stars appears to have
distinguishing features• Focus on top 50 CC courses and
combinations of courses as predictors• Focus on performance in gateway
courses at UMUC as outcomes
35
![Page 36: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/36.jpg)
Summary of Findings
• Positive effects– Transfer credit, prior GPA, math, honors,
course efficiency, online activity, age, marital status
– Course success can predict retention• Negative effects
– remedial, online, minority status
36
![Page 37: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/37.jpg)
Interventions
• Identify areas of risk • Collaborate with CC• Develop intervention strategies
– Advising– Messaging– Learning community– Course development
37
![Page 38: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/38.jpg)
3 Projects Synergizing
Kresge PAR
Civitas
38
Student Success
![Page 39: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/39.jpg)
Next Steps
• Examine course success at the CC• Implement/evaluate interventions• Update KDM with more data• Develop, understand, and explain
predictive models to identify at risk students at the CC
39
![Page 40: Multi-Institutional Data Predicting Transfer Student Success](https://reader036.vdocument.in/reader036/viewer/2022062501/568165e8550346895dd9092b/html5/thumbnails/40.jpg)
Lessons Learned
• Long term plan for data up front• Get a project manager• Manage expectations• Communicate progress far and
wide
40