student achievement initiative - intranet home · 2016. 7. 19. · the student achievement...

29
Student Achievement Initiative >> Study Session AUGUST 22, 2015

Upload: others

Post on 21-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Student

Achievement

Initiative

>> Study SessionAUGUST 22, 2015

Page 2: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

What is SAI?

http://www.sbctc.ctc.edu/college/e_studentachievement.aspx

The Student Achievement Initiative is the

performance funding system for community and technical colleges. Its purposes are to both improve

public accountability by more accurately describing

what students achieve from enrolling in our colleges

each year, and to provide incentives through

financial rewards to colleges for increasing the levels

of achievement attained by their students. It

represents a shift from funding entirely for enrollment

inputs to also funding meaningful outcomes.

Page 3: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Goals for Session

Become familiar with SAI

Theory

Structure

Utilization

Gain insight into Shoreline’s SAI performance

Credits: Josh Slepin, WWCCSheila Delquadri, YVCC

http://www.sbctc.ctc.edu/college/e_studentachievement.aspx

Page 4: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Origins & Theory

Challenge: Assessing educational progress

for students with diverse learning goals

Extensive research identified key

achievement points

Meaningful for all students

Highly predictive of eventual completion

(i.e., “momentum”)

System developed in 2006, revision in 2012

Page 5: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Structure: Annual Cohorts

Includes all students who are enrolled at the college for the given year with the following characteristics:

State-supported

Running Start

Non-state supported, award-seeking students

It does not include students with the following characteristics:

International

Department of Corrections

Non-state, non-award seeking only

Page 6: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Structure: Points

Page 7: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

SAI Data Access

College-specific database

College point comparisons

Quarterly and Annually

SBCTC analyses

Cohort analyses

Measuring up

Page 8: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Utilization

Accountability

(state level)

Incentive

(state level)

Metrics and

benchmarks

(college level)

10%

45%

45%

Funding Buckets

Completions

Total points

Points-per-student

Page 9: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Shoreline, 2.8% by

headcount (#17), 2.5%

0.0%

1.0%

2.0%

3.0%

4.0%

5.0%

6.0%

7.0%

8.0%

College share (%) of total points

in relation to share (%) of cohort headcount

ShareTotalPts ShareHeadcount

Total Points

Page 10: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Points Per Student

Shoreline, 2.8% by headcount,

2.7% by Point-per-student

0.0%

1.0%

2.0%

3.0%

4.0%

5.0%

6.0%

7.0%

8.0%

College share (%) of Points Per Student (PPS),

in relation to share (%) of cohort headcount

Share of PPS ShareHeadcount

Page 11: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Completion Points

Shoreline, 2.8% by headcount,

3.4% of completion points

0.0%

1.0%

2.0%

3.0%

4.0%

5.0%

6.0%

7.0%

8.0%

College share (%) of completion points,

in relation to share (%) of cohort headcount

ShareComp ShareHeadcount

Page 12: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Awards 2014

Shoreline , $125,581,

2.8% of award

0.0%

1.0%

2.0%

3.0%

4.0%

5.0%

6.0%

7.0%

8.0%

$0

$50,000

$100,000

$150,000

$200,000

$250,000

Total award amount, share of award amount,

and share of headcount by college

Completions Total Points Less Completions Points Per Student Total Award ShareAward ShareHC

Page 13: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Basic Skills: SCC Data

Total number of CASAS* gains

made during the year for all

subjects pre and post tested.

Multiple possible points

State calculation, 1:3 or 1:5 ratio

Comprehensive Adult

Student Assessment System

• Administered at entry

and quarterly

• State requirement

• National testing system

20461931

1419 1454

1010 946859 836

2.03 2.04

1.651.74

0.00

0.50

1.00

1.50

2.00

2.50

0

500

1000

1500

2000

2500

2010-2011 2011-2012 2012-2013 2013-2014

Basic Skills Points Basic Skills Headount Points Per Student

Page 14: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Basic Skills: Measuring Up

28%29%

31%

13% 13% 13%

0%

5%

10%

15%

20%

25%

30%

35%

2011-12

(n = 1,257)

2012-13

(n = 1,111)

2013-14

(n = 1,041)

2011-12

(n = 55,942)

2012-13

(n = 54,513)

2013-14

(n = 51,234)

Shoreline All colleges

Percent of Basic Skills Students who Transition into

College-Level Courses

Page 15: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Pre-College English & Math

Students score 2 points when they finish the highest level of developmental English.

Bonus point for completing college level English within a year.

Bonus point for prior or current basic skills students

Students score 3 points when they finish the highest level of developmental math.

Bonus point for completing college level math within a year.

Bonus point for prior or current basic skills students

Page 16: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

College Ready English & Math

254236

194

290

127

118

97

94

37

32

25

26

418

386

316

410

0

50

100

150

200

250

300

350

400

450

2010-2011 2011-2012 2012-2013 2013-2014

College Ready English Points by

Type and Cohort Year

Pre-College College Level Basic Skills (Total)

1578

1782

1497 1530

279

324

355 352

42

44

30 29

1899

2150

1882 1911

0

500

1000

1500

2000

2500

2010-2011 2011-2012 2012-2013 2013-2014

College Ready Math Points by Type

and Cohort Year

Pre-College College Level Basic Skills (Total)

Page 17: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

College Ready Math:

Measuring Up

17%

20%

22%

19%20%

22%

2011-12 2012-13 2013-14 2011-12 2012-13 2013-14

Shoreline All colleges

Pre-College Math Students Who

Complete College Level Math

Page 18: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Credit Progress

First15 & 30 college-level credits 2.0 or higher

Bonus point for previous or current basic skills

First 45 credits

Workforce pathway: at least 30 of the 45 must be earned in classes that are designated as workforce (determined by the CIP code on the class).

Transfer pathway: points are earned when the student completes 45 college level credits in Math, English, Humanities, Social Science, and Science.

Bonus point for previous or current basic skills

Page 19: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Credit Progress

Pierce District, 4.5%,

#6 in size, #1 in 45 creditsShoreline, 2.8%,

#17 in size, #16 in 15-

credit, #15 in 30 & 45

0.0%

1.0%

2.0%

3.0%

4.0%

5.0%

6.0%

7.0%

8.0%

9.0%

College share (%) 15-credit, 30-credit, and 45-credit points,

in relation to share (%) of cohort headcount

Share15 Share30 Share45 ShareHeadcount

Page 20: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Quantitative Course Completion

Garnered by the college the first time a

student earns credit in college-level math (CIP

27 series) or quantitative reasoning classes

(PHIL& 117 or PHIL& 120).

Bonus point for current or previous basic skills

2.0 or higher

Page 21: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Quantitative Course Completion

825876

925972 980

30

45

5542 50

8.5%

9.3%

10.2%

11.0%11.6%

0%

2%

4%

6%

8%

10%

12%

14%

16%

18%

20%

0

200

400

600

800

1000

1200

2009-2010 2010-2011 2011-2012 2012-2013 2013-2014

Quantitative points and percent of cohort receiving that point,

by academic year

Quant BasicSkillsBonus %Quant

Page 22: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Quantitative Share

Shoreline, 2.8% share of

headcount, 2.7% share

of quantitative points

0.0%

1.0%

2.0%

3.0%

4.0%

5.0%

6.0%

7.0%

8.0%

9.0%

College share (%) quantitative points,

in relation to share (%) of cohort headcount

ShareQuant ShareHC

Page 23: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Retention Points

When a student was enrolled in the previous

year (in SAI) and earned at least one point in

the current year, they will receive one point

for retention.

Between 25% and 27% of SCC cohort has

received this point each year.

For Shoreline, share of retention points

commensurate to share of headcount

Page 24: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Completion Points

When a student earns one or more of:

degrees

long certificates (over 45 credits)

short certificates (between 20 and 44 credits) if at least 20 workforce credits earned in this or the preceding year

A maximum of 1 point can be earned in a single year.

Prior or current basic skills students earn one additional point.

Can earn multiple times in different years.

Page 25: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Completion Points

Shoreline, 2.8% by headcount,

3.4% of completion points

0.0%

1.0%

2.0%

3.0%

4.0%

5.0%

6.0%

7.0%

8.0%

College share (%) of completion points,

in relation to share (%) of cohort headcount

ShareComp ShareHeadcount

Page 26: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Completions: Degree Type

14%

24%19% 18% 20%

42%

33%

33% 36% 35%

11% 9%

8%8% 8%

5% 4%

4%4% 5%

25%24%

29%27% 25%

4% 6% 7% 6% 7%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

2009-2010 2010-2011 2011-2012 2012-2013 2013-2014

Percent of Completion Points by Degree Type (and bonus points)

WF_Degree TransferDegree LTCertificate LTCert_Bonus ST_Certificate ST_Cert_Bonus

Page 27: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Completions: Measuring Up

9%

10%10%

11% 11% 11%

2011-12 2012-13 2013-14 2011-12 2012-13 2013-14

Shoreline All colleges

Completions per Academic Transfer Students Enrolled

30% 29% 29%

20% 20% 20%

2011-12 2012-13 2013-14 2011-12 2012-13 2013-14

Shoreline All colleges

Completions per Professional-Tech Students Enrolled

Page 28: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Completions: Cohort Analysis

18%21%

23% 22%20%

18%

21%15%

15%23%

12%

7%11% 13%

9%

0%

10%

20%

30%

40%

50%

60%

Shoreline Cascadia Edmonds Everett All Colleges

Percent of 2010 Transfer student cohort completed, transferred, and

still enrolled, at SCC, all colleges, and comparison schools

Earned SAI Completion Transfer without Degree Still Enrolled (2013-2014)

Page 29: Student Achievement Initiative - Intranet Home · 2016. 7. 19. · The Student Achievement Initiative is the performance ... • National testing system 2046 1931 1419 1454 1010 946

Summary

SAI is a cohort- and point-based method for

assessing student progress, and plays a role in

how state funding is allocated.

SCC Performance

Basic skills area is small but effective

Garnering of progress points has been

consummate with SCC’s size

Workforce completions (short term certificates)

has been relatively high and transfer completion

has been relatively low