investigating milestones and completions at a local institution based on adelman’s study, “the...
TRANSCRIPT
![Page 1: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/1.jpg)
INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL
INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.”
What’s in YOUR toolbox?
DAN IEL MARTINEZ, PHDASS O C IATE DEAN, IN S TITUTIO NAL RES EAR C HRIVER S IDE C O MMU NITY C O LLEGE DIS TRIC T
![Page 2: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/2.jpg)
Inspiration
What this is not Critique Replication
What it is What if? Verification of milestones Exploration
![Page 3: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/3.jpg)
Difference From Toolbox
Datasets Adelman
NCES transcript-based grade cohort study Cooperative Institutional Research Project (CIRP) NCES Beginning Postsecondary Students (BPS) Survey
Martinez State MIS data Local administrative system Local assessment database National Student Clearinghouse
Decision rulesType of regression
![Page 4: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/4.jpg)
Analytic Steps: Adelman
1. Demographic background & high school history
2. Postsecondary entrance3. 1st postsecondary year history4. Factors of financing postsecondary
education5. Postsecondary attendance patterns6. Extended postsecondary performance7. Final model with complete academic history
![Page 5: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/5.jpg)
Analytic Steps: Martinez
1. Demographics2. High school history3. 1st semester performance4. 1st year performance5. Completion of transfer level English or math
within 1st 2 years of enrollment6. Extended postsecondary performance7. Continuous enrollment
![Page 6: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/6.jpg)
Population
First time students (self-reported) in Fall 2002
Prior enrollments used to verifyAge?
![Page 7: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/7.jpg)
Age Distribution
17.0
0
19.0
0
21.0
0
23.0
0
25.0
0
27.0
0
29.0
0
31.0
0
33.0
0
35.0
0
37.0
0
39.0
0
41.0
0
43.0
0
45.0
0
47.0
0
49.0
0
51.0
0
53.0
0
55.0
0
57.0
0
59.0
0
62.0
0
64.0
0
69.0
0
71.0
00
200
400
600
800
1000
1200
1400
1600
1800
2000
![Page 8: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/8.jpg)
Population
First time students (self-reported) in Fall 2002
Prior enrollments used to verifyAge < 20High school graduates
![Page 9: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/9.jpg)
Demographics
Gender
Ethnicity White/Asian Black/Latino
1st generation FG4 FG2
![Page 10: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/10.jpg)
High School History
Placement test scores English Math/Math test Reading
Self-reported high school information English grade Highest level of math Grade in highest level of math Time since last math class Geometry HS GPA
![Page 11: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/11.jpg)
1st Semester Performance
Units attemptedUnits earnedGPADelayTime of day
![Page 12: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/12.jpg)
1st Year Performance
Units attemptedUnits earnedGPA
![Page 13: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/13.jpg)
Transfer Level English/Math in 1st 2 Years
Units earned in transfer level math in the 1st 2 years of postsecondary enrollment
Units earned in transfer level English in the 1st 2 years of postsecondary enrollment
![Page 14: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/14.jpg)
Extended Postsecondary Performance
Overall GPA Transfer unitsDevelopmental education unitsSummer enrollmentWinter enrollmentPart-timeFinancial aidWithdrawalsRepeats
![Page 15: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/15.jpg)
Final Step
Continuous enrollment
![Page 16: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/16.jpg)
Completer
Tracked for 6 years2 year degree or certificate4 year degreeTransfer to a 4 year school
![Page 17: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/17.jpg)
The Analyses
![Page 18: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/18.jpg)
Step 1: Demographics
What was entered:Gender
Ethnicity
1st generation
![Page 19: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/19.jpg)
Step 1: Demographics
What survived:GenderEthnicity1st generation (modified)
![Page 20: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/20.jpg)
Step 1: Demographics
What survived:GenderEthnicity1st generation (modified)
R=.181R2=.033
![Page 21: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/21.jpg)
Step 2: High School History
What was entered:GenderEthnicity1st generation
Followed by:Placement test scores
English/Math/Math test/Reading
Self-reported high school information English grade Highest level of math Grade in highest level of
math Time since last math
class Geometry HS GPA
![Page 22: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/22.jpg)
Step 2: High School History
What survived:Gender1st generationPlacement Test: ReadingHS: Grade in EnglishHS: Highest level of mathHS: Grade in highest level of mathHS: Geometry
![Page 23: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/23.jpg)
Step 2: High School History
What survived:Gender1st generationPlacement Test: ReadingHS: Grade in EnglishHS: Highest level of mathHS: Grade in highest level of mathHS: Geometry
R=.328R2=.108
![Page 24: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/24.jpg)
Step 3: 1st Semester Performance
What was entered:Gender1st generationPlacement Test:
ReadingHS: Grade in EnglishHS: Highest level of
mathHS: Grade in highest
level of mathHS: Geometry
Followed by:Units Attempted 1stUnits Earned 1stGPA 1stDelayTime of day
![Page 25: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/25.jpg)
Step 3: 1st Semester Performance
What survived:Gender1st generationHS: Highest level of mathHS: Grade in highest level of mathHS: GeometryUnits earned 1stGPA 1st
![Page 26: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/26.jpg)
Step 3: 1st Semester Performance
What survived:Gender1st generationHS: Highest level of mathHS: Grade in highest level of mathHS: GeometryUnits earned 1stGPA 1st
R=.429R2=.184
![Page 27: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/27.jpg)
Step 4: 1st Year Performance
What was entered:Gender1st generationHS: Highest level of
mathHS: Grade in highest
level of mathHS: GeometryUnits earned 1st
GPA 1st
Followed by:Units attempted yearUnits earned yearGPA year
![Page 28: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/28.jpg)
Step 4: 1st Year Performance
What survived:Gender1st generationHS: Highest level of mathHS: Grade in highest level of mathHS: GeometryUnits earned 1st
GPA 1st
![Page 29: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/29.jpg)
Step 4: 1st Year Performance
What survived:Gender1st generationHS: Highest level of mathHS: Grade in highest level of mathHS: GeometryUnits earned 1st
GPA 1st
R=.427R2=.182
![Page 30: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/30.jpg)
Step 5: Transfer English/Math in 1st 2 Years
What was entered:Gender1st generationHS: Highest level of
mathHS: Grade in highest
level of mathHS: GeometryUnits earned 1st
GPA 1st
Followed by:Units earned in
transfer level English in 1st 2 years
Units earned in transfer level math in 1st 2 years
![Page 31: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/31.jpg)
Step 5: Transfer English/Math 1st 2 Years
What survived:Gender1st generationHS: Highest level of mathHS: GeometryUnits earned 1st
GPA 1st
Transfer level math in 1st 2 years
![Page 32: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/32.jpg)
Step 5: Transfer English/Math 1st 2 Years
What survived:Gender1st generationHS: Highest level of mathHS: GeometryUnits earned 1st
GPA 1st
Transfer level math in 1st 2 yearsR=.478R2=.228
![Page 33: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/33.jpg)
Step 6: Extended Postsecondary Performance
What was entered:Gender1st generationHS: Highest level of
mathHS: GeometryUnits earned 1st
GPA 1st
Transfer level math in 1st 2 years
Followed by:Overall GPA Transfer unitsDevelopmental
education unitsSummer enrollmentWinter enrollmentPart-timeFinancial aidWithdrawalsRepeats
![Page 34: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/34.jpg)
Step 6: Extended Postsecondary Performance
What survived:Gender1st generationHS: GeometryUnits earned 1st
Transfer level math in 1st 2 yearsSummer enrollmentDevelopmental education units
![Page 35: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/35.jpg)
Step 6: Extended Postsecondary Performance
What survived:Gender1st generationHS: GeometryUnits earned 1st
Transfer level math in 1st 2 yearsSummer enrollmentDevelopmental education units
R=.520R2=.270
![Page 36: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/36.jpg)
Step 7: Continuous Enrollment
What was entered:Gender1st generationHS: GeometryUnits earned 1st
Transfer level math in 1st 2 yearsSummer enrollmentDevelopmental education units
![Page 37: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/37.jpg)
Step 7: Continuous Enrollment
What was entered:Gender1st generationHS: GeometryUnits earned 1st
Transfer level math in 1st 2 yearsSummer enrollmentDevelopmental education units
Followed by:Continuous enrollment
![Page 38: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/38.jpg)
Step 7: Continuous Enrollment
What survived:Gender1st generationHS: GeometryUnits earned 1st
Transfer level math in 1st 2 yearsSummer enrollmentDevelopmental education unitsContinuous enrollment
![Page 39: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/39.jpg)
Step 7: Continuous Enrollment
What survived:Gender1st generationHS: GeometryUnits earned 1st
Transfer level math in 1st 2 yearsSummer enrollmentDevelopmental education unitsContinuous enrollment R=.526
R2=.276
![Page 40: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/40.jpg)
What’s NOT Here
EthnicityPlacement test scoresPart-time enrollmentFinancial aidWithdrawalsRepeats20 unit milestone
![Page 41: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/41.jpg)
Implications
Milestone research may not be applicable to local institutions
Effectiveness of placement tests needs to be examined
1st generation data needs to be utilizedThe outcomes used in research need to be
critically examined
![Page 42: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/42.jpg)
Limitations/Future Research
Not disaggregated by student characteristicsMeasures could be strengthenedIdentify gateway courses and investigate
their impact on student achievement
![Page 43: INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,](https://reader037.vdocument.in/reader037/viewer/2022110320/56649c9a5503460f9495740b/html5/thumbnails/43.jpg)
THANK YOU