what’s in your toolbox?
DESCRIPTION
What’s in YOUR toolbox?. Investigating Milestones and Completions at a Local Institution Based on adelman’s study, “The toolbox Revisited.”. Daniel Martinez, PhD Associate Dean, Institutional research Riverside community college district. Inspiration. What this is not Critique - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/1.jpg)
INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL
INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.”
What’s in YOUR toolbox?
DA N IEL M ARTIN EZ, PHDASS OC IATE DEA N, IN STITU TI O NA L R ESE AR C HR IVER SIDE C O M MU N I TY C O LLE GE DISTR IC T
![Page 2: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/2.jpg)
Inspiration
What this is not Critique Replication
What it is What if? Verification of milestones Exploration
![Page 3: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/3.jpg)
Difference From Toolbox
Datasets Adelman
NCES transcript-based grade cohort study Cooperative Institutional Research Project (CIRP) NCES Beginning Postsecondary Students (BPS) Survey
Martinez State MIS data Local administrative system Local assessment database National Student Clearinghouse
Decision rulesType of regression
![Page 4: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/4.jpg)
Analytic Steps: Adelman
1. Demographic background & high school history
2. Postsecondary entrance3. 1st postsecondary year history4. Factors of financing postsecondary
education5. Postsecondary attendance patterns6. Extended postsecondary performance7. Final model with complete academic history
![Page 5: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/5.jpg)
Analytic Steps: Martinez
1. Demographics2. High school history3. 1st semester performance4. 1st year performance5. Completion of transfer level English or math
within 1st 2 years of enrollment6. Extended postsecondary performance7. Continuous enrollment
![Page 6: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/6.jpg)
Population
First time students (self-reported) in Fall 2002
Prior enrollments used to verifyAge?
![Page 7: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/7.jpg)
Age Distribution
17.00
19.00
21.00
23.00
25.00
27.00
29.00
31.00
33.00
35.00
37.00
39.00
41.00
43.00
45.00
47.00
49.00
51.00
53.00
55.00
57.00
59.00
62.00
64.00
69.00
71.00
0
200
400
600
800
1000
1200
1400
1600
1800
2000
![Page 8: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/8.jpg)
Population
First time students (self-reported) in Fall 2002
Prior enrollments used to verifyAge < 20High school graduates
![Page 9: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/9.jpg)
Demographics
Gender
Ethnicity White/Asian Black/Latino
1st generation FG4 FG2
![Page 10: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/10.jpg)
High School History
Placement test scores English Math/Math test Reading
Self-reported high school information English grade Highest level of math Grade in highest level of math Time since last math class Geometry HS GPA
![Page 11: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/11.jpg)
1st Semester Performance
Units attemptedUnits earnedGPADelayTime of day
![Page 12: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/12.jpg)
1st Year Performance
Units attemptedUnits earnedGPA
![Page 13: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/13.jpg)
Transfer Level English/Math in 1st 2 Years
Units earned in transfer level math in the 1st 2 years of postsecondary enrollment
Units earned in transfer level English in the 1st 2 years of postsecondary enrollment
![Page 14: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/14.jpg)
Extended Postsecondary Performance
Overall GPA Transfer unitsDevelopmental education unitsSummer enrollmentWinter enrollmentPart-timeFinancial aidWithdrawalsRepeats
![Page 15: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/15.jpg)
Final Step
Continuous enrollment
![Page 16: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/16.jpg)
Completer
Tracked for 6 years2 year degree or certificate4 year degreeTransfer to a 4 year school
![Page 17: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/17.jpg)
The Analyses
![Page 18: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/18.jpg)
Step 1: Demographics
What was entered:Gender
Ethnicity
1st generation
![Page 19: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/19.jpg)
Step 1: Demographics
What survived:GenderEthnicity1st generation (modified)
![Page 20: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/20.jpg)
Step 1: Demographics
What survived:GenderEthnicity1st generation (modified)
R=.181R2=.033
![Page 21: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/21.jpg)
Step 2: High School History
What was entered:GenderEthnicity1st generation
Followed by:Placement test scores
English/Math/Math test/Reading
Self-reported high school information English grade Highest level of math Grade in highest level of
math Time since last math
class Geometry HS GPA
![Page 22: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/22.jpg)
Step 2: High School History
What survived:Gender1st generationPlacement Test: ReadingHS: Grade in EnglishHS: Highest level of mathHS: Grade in highest level of mathHS: Geometry
![Page 23: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/23.jpg)
Step 2: High School History
What survived:Gender1st generationPlacement Test: ReadingHS: Grade in EnglishHS: Highest level of mathHS: Grade in highest level of mathHS: Geometry
R=.328R2=.108
![Page 24: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/24.jpg)
Step 3: 1st Semester Performance
What was entered:Gender1st generationPlacement Test:
ReadingHS: Grade in EnglishHS: Highest level of
mathHS: Grade in highest
level of mathHS: Geometry
Followed by:Units Attempted 1stUnits Earned 1stGPA 1stDelayTime of day
![Page 25: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/25.jpg)
Step 3: 1st Semester Performance
What survived:Gender1st generationHS: Highest level of mathHS: Grade in highest level of mathHS: GeometryUnits earned 1stGPA 1st
![Page 26: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/26.jpg)
Step 3: 1st Semester Performance
What survived:Gender1st generationHS: Highest level of mathHS: Grade in highest level of mathHS: GeometryUnits earned 1stGPA 1st
R=.429R2=.184
![Page 27: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/27.jpg)
Step 4: 1st Year Performance
What was entered:Gender1st generationHS: Highest level of
mathHS: Grade in highest
level of mathHS: GeometryUnits earned 1st
GPA 1st
Followed by:Units attempted yearUnits earned yearGPA year
![Page 28: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/28.jpg)
Step 4: 1st Year Performance
What survived:Gender1st generationHS: Highest level of mathHS: Grade in highest level of mathHS: GeometryUnits earned 1st
GPA 1st
![Page 29: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/29.jpg)
Step 4: 1st Year Performance
What survived:Gender1st generationHS: Highest level of mathHS: Grade in highest level of mathHS: GeometryUnits earned 1st
GPA 1st
R=.427R2=.182
![Page 30: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/30.jpg)
Step 5: Transfer English/Math in 1st 2 Years
What was entered:Gender1st generationHS: Highest level of
mathHS: Grade in highest
level of mathHS: GeometryUnits earned 1st
GPA 1st
Followed by:Units earned in
transfer level English in 1st 2 years
Units earned in transfer level math in 1st 2 years
![Page 31: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/31.jpg)
Step 5: Transfer English/Math 1st 2 Years
What survived:Gender1st generationHS: Highest level of mathHS: GeometryUnits earned 1st
GPA 1st
Transfer level math in 1st 2 years
![Page 32: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/32.jpg)
Step 5: Transfer English/Math 1st 2 Years
What survived:Gender1st generationHS: Highest level of mathHS: GeometryUnits earned 1st
GPA 1st
Transfer level math in 1st 2 yearsR=.478R2=.228
![Page 33: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/33.jpg)
Step 6: Extended Postsecondary Performance
What was entered:Gender1st generationHS: Highest level of
mathHS: GeometryUnits earned 1st
GPA 1st
Transfer level math in 1st 2 years
Followed by:Overall GPA Transfer unitsDevelopmental
education unitsSummer enrollmentWinter enrollmentPart-timeFinancial aidWithdrawalsRepeats
![Page 34: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/34.jpg)
Step 6: Extended Postsecondary Performance
What survived:Gender1st generationHS: GeometryUnits earned 1st
Transfer level math in 1st 2 yearsSummer enrollmentDevelopmental education units
![Page 35: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/35.jpg)
Step 6: Extended Postsecondary Performance
What survived:Gender1st generationHS: GeometryUnits earned 1st
Transfer level math in 1st 2 yearsSummer enrollmentDevelopmental education units
R=.520R2=.270
![Page 36: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/36.jpg)
Step 7: Continuous Enrollment
What was entered:Gender1st generationHS: GeometryUnits earned 1st
Transfer level math in 1st 2 yearsSummer enrollmentDevelopmental education units
![Page 37: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/37.jpg)
Step 7: Continuous Enrollment
What was entered:Gender1st generationHS: GeometryUnits earned 1st
Transfer level math in 1st 2 yearsSummer enrollmentDevelopmental education units
Followed by:Continuous enrollment
![Page 38: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/38.jpg)
Step 7: Continuous Enrollment
What survived:Gender1st generationHS: GeometryUnits earned 1st
Transfer level math in 1st 2 yearsSummer enrollmentDevelopmental education unitsContinuous enrollment
![Page 39: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/39.jpg)
Step 7: Continuous Enrollment
What survived:Gender1st generationHS: GeometryUnits earned 1st
Transfer level math in 1st 2 yearsSummer enrollmentDevelopmental education unitsContinuous enrollment R=.526
R2=.276
![Page 40: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/40.jpg)
What’s NOT Here
EthnicityPlacement test scoresPart-time enrollmentFinancial aidWithdrawalsRepeats20 unit milestone
![Page 41: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/41.jpg)
Implications
Milestone research may not be applicable to local institutions
Effectiveness of placement tests needs to be examined
1st generation data needs to be utilizedThe outcomes used in research need to be
critically examined
![Page 42: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/42.jpg)
Limitations/Future Research
Not disaggregated by student characteristicsMeasures could be strengthenedIdentify gateway courses and investigate
their impact on student achievement
![Page 43: What’s in YOUR toolbox?](https://reader035.vdocument.in/reader035/viewer/2022062310/56816248550346895dd288b2/html5/thumbnails/43.jpg)
THANK YOU