1

Accountability System

Overview of the

Accountability Rating Systemfor Texas Public Schools and Districts

2

Statutory Requirements of House Bill 3 (2009)◦ Focus on Postsecondary Readiness◦ Inclusion of Student Progress◦ Emphasis on Closing Achievement Gaps

New STAAR program with EOC-based assessments for middle schools and high schools

Lessons learned from previous state accountability rating systems

Successful models used by other states, e.g. CA, CO, FL, GA, KY, LA, OH, OK, NC, SC

Framework Development Process

Accountability System

Accountability System

Student Achievement

Index I

Student ProgressIndex 2

Closing Performance

GapsIndex 3

Postsecondary Readiness

Index 4

Overview of Proposed Performance Index Framework

3

STAAR Satisfactory Performance

4

All Students Only (Accountability Subset) Combined over All Subject Areas Credit given for Satisfactory performance level (Level II) phase-in

on:◦ STAAR English (Grades 3-8) and Spanish (Grades 3-5)

administered in the spring; first retest included.◦ EOC assessments administered in the spring and the previous fall

and summer.

Credit given for Satisfactory performance level (Level II) phase-in on:◦ STAAR Grades 3-8 and EOC Modified and Alternate;◦ STAAR L (linguistically accommodated) are included based on the

ATAC ELL Workgroup recommendations;◦ TAKS included in 2013 only: Grade 11 results at Met Standard

performance standard.

Student Achievemen

tIndex I

STAAR Satisfactory Performance

5

ELL Exclusions: 2013:

◦ Students in U.S. schools Year 1 through Year 3 excluded ◦ Students in U.S. schools Year 4 and beyond included at phase-in

Level II standard◦ Exceptions: asylees/refugees in U.S. schools Year 1 through Year 5

excluded; immigrants entering at Grade 9 or above excluded

Student Achievemen

tIndex I

STAAR Satisfactory Performance

6

ELL Exclusions: Proposed 2014 and beyond:

◦ Students in U.S. schools Year 1 excluded ◦ Students in U.S. schools Year 2 through Year 4 included based on

test version: English test version using STAAR ELL Progress Measure; Spanish test version using phase-in Level II performance

standard Students in U.S. schools Year 5 and beyond included at phase-in

Level II performance standard ◦ Exceptions: asylees/refugees in U.S. schools Year 1 through Year 5

excluded; immigrants entering at Grade 9 or above excluded

Student Achievemen

tIndex I

Scoring Table

7

Student Achievemen

tIndex I

Accountability Target: 50, 25 AEA

Reading Math Writing Science SocialStudies Total % Met

Level II

Students Met Level II

50 + 38 + 19 + 10 + 19 = 13645% 45

Students Tested 100 + 100 + 42 + 40 + 23 = 305

Index Score 45

Minimum Size RequirementsIndicator All Students Student Groups

Index 1 STAAR Percent Met Level II None; Special Analysis (SA) < 10 students

N/A

8

Ten Student Groups Evaluated:◦ All Students◦ Race/Ethnicity:

• African American, American Indian, Asian, Hispanic,

• Pacific Islander, White• Two or More Races

◦ Students with Disabilities (SWD)◦ English Language Learners (ELLs)

By Subject Area (Reading, Mathematics, and Writing)

Student Progress toward Satisfactory or Advanced Performance Levels

Student ProgressIndex 2

9

Same assessments used in Index 1 where student progress measures are available based on scale score in relation to growth expectations (Did Not Meet, Met, and Exceeded)

Credit based on weighted performance:◦ One point given for each percentage of students at the Met

growth expectations level◦ Two points given for each percentage of students at the

Exceeded growth expectations level

Student Progress toward Satisfactory or Advanced Performance Levels

Student ProgressIndex 2

10

ELL Exclusions:

English test version results 2013: ELL Excluded Proposed 2014 and beyond:

◦ Students in U.S. schools Year 1 excluded ◦ Students in U.S. schools Year 2 and beyond included using

STAAR ELL Progress Measure ◦ Exception: asylees/refugees in U.S. schools Year 1 through

Year 5 excluded

Student Progress toward Satisfactory or Advanced Performance Levels

Student ProgressIndex 2

11

ELL Exclusions: Spanish test version results 2013:

◦ Students in U.S. schools Year 1 through Year 3 excluded ◦ Students in U.S. schools Year 4 and beyond included using

STAAR growth measure ◦ Exception: asylees/refugees in U.S. schools Year 1 through

Year 5 excluded Proposed 2014 and beyond:

◦ Students in U.S. schools Year 1 excluded ◦ Students in U.S. schools Year 2 and beyond included using

STAAR growth measure ◦ Exception: asylees/refugees in U.S. schools Year 1 through

Year 5 excluded

Student Progress toward Satisfactory or Advanced Performance Levels

Student ProgressIndex 2

12

Scoring Table Student ProgressIndex 2

STAAR Weighted Growth Rate for Reading

All African Amer.

Amer. Indian Asian Hispanic Pacific

Island. White Two or More ELL Special

Ed.Total

PointsMax.

Points

Number of Tests 100 50 40 30Did Not Meet Expectation 20 10 0 10Met Expectation 60 20 10 15Exceeded Expectation 20 20 30 5Percent of Students: Met or Exceeded Expectation

80% 80% 100% 67%

Exceeded Expectation 20% 40% 75% 17%

Reading Weighted Growth Rate

100 120 175 84 479 800

13

Scoring Table

Student ProgressIndex 2

Accountability Target: 5th Percentile of Statewide Performance

Indicator All African Amer.

Amer. Indian Asian Hispanic Pacific

Island. White Two or More ELL Special

Ed.Total

PointsMax.

Points

STAAR ReadingWeighted Growth Rate 100 120 175 84 479 800STAAR Mathematics Weighted Growth Rate 85 98 150 160 493 800STAAR WritingWeighted Growth Rate 140 170 310 400Total 1282 2000Index Score (total points divided by maximum points) 64

Minimum Size RequirementsIndicator All Students Student Groups

Index 2 STAAR Percent Met Progress 2013>= 10 students 2014 = None, SA <10

>= 25 students

Achievement Gaps Measured for Satisfactory and Advanced Levels

14

All Economically Disadvantaged Students and Lowest Performing Racial/Ethnic Groups based on the Index 1 student achievement indicator reported in the prior year◦ If campus has three or more Racial/Ethnic Groups, only lowest two

included; If campus has two Racial/Ethnic Groups, only lowest included; If campus has only one Racial/Ethnic Group, it is not included

By Subject Area (Reading/ELA, Mathematics, Writing, Science, and Social Studies) ◦ Same Assessments Used in Index 1

Credit based on weighted performance:◦ One point credit given for each percentage of students meeting the

phase-in Level II performance standard◦ Two points credit given for each percentage of students at the Level III

Advanced performance standard (2014 and beyond)

Closing Performance

GapsIndex 3

Achievement Gaps Measured for Satisfactory and Advanced Levels

15

ELL Exclusions: 2013:

◦ Students in U.S. schools Year 1 through Year 3 excluded ◦ Students in U.S. schools Year 4 and beyond included at phase-in

Level II performance standard◦ Exceptions: asylees/refugees in U.S. schools Year 1 through

Year 5 excluded; immigrants entering at Grade 9 or above excluded

Closing Performance

GapsIndex 3

Achievement Gaps Measured for Satisfactory and Advanced Levels

16

ELL Exclusions: Proposed 2014 and beyond:

◦ Students in U.S. schools Year 1 excluded ◦ Students in U.S. schools Year 2 through Year 4 included based

on test version: ◦ English test version using STAAR ELL Progress Measure; ◦ Spanish test version using phase-in Level II performance

standard ◦ Students in U.S. schools Year 5 and beyond included at phase-in

Level II performance standard ◦ Exceptions: asylees/refugees in U.S. schools Year 1 through

Year 5 excluded; immigrants entering at Grade 9 or above excluded

Closing Performance

GapsIndex 3

Scoring Table

17

Closing Performance

GapsIndex 3STAAR Weighted

Performance Rate for Reading

Econ. Disadv. Lowest Performing Group - 1

Lowest Performing Group - 2

Total Points

Maximum Points

Number of Tests 80 40 25

Performance Results: Phase-in Level II and above Number Percent

80 100%

20 50%

25 100%

Level III Advanced (2014 and beyond) Number Percent

40 50%

0 0%

25 100%

Reading Weighted Performance

100 50 100 250 300

Minimum Size RequirementsIndicator All

Students Student Groups

Index 3 STAAR Performance NA gap group: >= 20 students

Scoring Table

18

Closing Performance

GapsIndex 3

Accountability Target: 55, 30 AEA

STAAR Weighted

Performance Rate

Economically Disadvantaged

Lowest Performing Race/Ethnic Group - 1

Lowest Performing Race/Ethnic Group - 2

Total Points Maximum Points

Reading 100 50 100 250 300 Math 100 100 90 290 300 Writing 80 90 90 260 300 Science 100 40 90 230 300 Social Studies

50 40 80 170 300

Total 1200 1500 Index Score (total points divided by maximum points) 80

Measures of Postsecondary Readiness

19

Credit based on average of two postsecondary indicators:STAAR postsecondary readiness standard (final Level II) – 2014 +High school graduation rates and diploma plans STAAR Postsecondary Readiness◦Eight Student Groups Evaluated: All Students and each Race/Ethnicity◦Combined over All Subject Areas◦Credit given for meeting postsecondary readiness standard (final Level

II) on one or more tests - 2014 and beyond. High School Graduation◦Four-year Graduation Rate or Five-year Graduation Rate (or Annual

Dropout Rate if no graduation rate)◦ Ten Student Groups Evaluated: All Students, each Race/Ethnicity,

Students with Disabilities, and ELLs Percent Recommended or Distinguished Achievement (Advanced)

High School Program Plan (RHSP/AHSP) Graduates◦ Eight Student Groups Evaluated: All Students and each Race/Ethnicity

Postsecondary Readiness

Index 4

Measures of Postsecondary Readiness

20

ELL Exclusions (2014): English test version results

◦ Students in U.S. schools Year 1 through Year 4 excluded ◦ Students in U.S. schools Year 5 and beyond included at final

Level II performance standard ◦ Exceptions: Asylees/refugees excluded; immigrants entering at

Grade 9 or above excluded Spanish test version results:

◦ Students in U.S. schools Year 1 excluded◦ Students in U.S. schools Year 2 and beyond included at final

Level II performance standard ◦ Exception: Asylees/refugees in U.S. schools Year 1 through Year

5 excluded

Postsecondary Readiness

Index 4

Scoring Table: High Schools with a Graduation Rate

21

Postsecondary Readiness

Index 4

Accountability Target: 75, 45 AEAIndicator All African

Amer.Amer. Indian Asian Hispanic Pacific

Island. White Two or More ELL Special

Ed.Total

PointsMax.

Points4-year grad. rate 84.3% 78.8% 78.8% 91.6% 86.0% 44.2% 69.8% 533.5 7005-year grad. rate 85.1% 78.8% 80.0% 92.1% 84.0% 48.9% 77.5% 546.4 700

RHSP/AHSP 82.7% 76.4% 83.6% 83.0% 325.7 400Graduation Total 872.1 1100Graduation Score (graduation total points divided by maximum points) 79

STAAR All Subjects% Met Level II

2014 and beyondSTAAR Score (STAAR total points divided by maximum points): 30Index Score (average of Graduation Score and STAAR Score): ( 79 + 30 / 2 = 55) 55

Minimum Size RequirementsIndicator All Students Student Groups

Index 4 Graduation Rates (4-year and 5-year) None, SA < 10 >= 25 students RHSP/AHSP Rates (4-year) None, SA < 10 >= 25 students STAAR Percent Met Level II None, SA < 10 >= 25 students

Scoring Table: High Schools without a Graduation Rate

22

Postsecondary Readiness

Index 4

Accountability Target: 75, 45 AEAIndicator All African

Amer.Amer. Indian Asian Hispanic Pacific

Island. White Two or More ELL Special

Ed.Total

PointsMax.

PointsGrade 9-12 Annual Dropout Rate

76(2.4%)

61(3.9%)

69(3.1%)

89(1.1%)

87(1.3%)

53(4.7%)

68(3.2%) 503 700

Graduation Score (dropout rate total points divided by maximum points) 72STAAR All Subjects % Met Level II

2014 and beyondSTAAR Scores 30

Index Score (average if Graduation Score and STAAR Score): (72 + 30 )/ 2 = 51 51

Annual Dropout Rate Conversion Formula: 100 – (Gr. 9-12 Annual Dropout Rate x 10), with a floor of zero

Minimum Size RequirementsIndicator All Students Student Groups

Index 4 Annual Dropout Rates Gr. 9-12 >= 10 Gr. 9-12 students >= 25

STAAR Percent Met Level II none; special analysis if < 10 students

>= 25

Scoring Table: Elementary and Middle Schools

23

Postsecondary Readiness

Index 4

Accountability Target: 75, 45 AEAIndicator All African

Amer.Amer. Indian Asian Hispanic Pacific

Island. White Two or More ELL Special

Ed.Total

PointsMax.

PointsSTAAR All Subjects*% Met Level II

2014 and beyondSTAAR Score (STAAR total points divided by maximum points): 30

Minimum Size RequirementsIndicator All Students Student Groups

Index 4 STAAR Percent Met Level II None; SA < 10 students >= 25

24

State Accountability Ratings & DistinctionsAccountability

System

Accountability Rating: 2013 Distinctions: 2013

Met Standard Top 25% Student ProgressAcademic Achievement in:

• Reading English / Language Arts• Mathematics Met Alternative

StandardImprovement

Required N/A

25

Performance Rates◦ 50% for all student groups in all subjects

Participation Rates◦ 95% for all student groups in Reading and Mathematics

Federal Graduation Rates◦ 4 year: 78% for all student groups◦ 5 year: 83% for all student groups

Limits on Use of Alternative Assessments◦ Modified = 2%; Alternate = 1% (Reading and Mathematics)

Safeguard Measures and Targets

Accountability System

26

HB 5 will not affect the ratings assigned this year on August 8th.

The number of EOC assessments required for graduation will affect the state rating system beginning with the 2013-2014 school year.

HB 5 requires ratings of A-F for districts and ratings of exemplary, recognized, acceptable, and unacceptable to campuses in 2016-2017.

How will HB 5 Affect the Accountability System?

Accountability System

27

ELL Growth Measure Student Progress Measure Intervention Requirements State and Federal Reporting

◦ AYP decision expected late June

Pending Issues

Accountability System

Questions

Student Achievement

Index I

Student ProgressIndex 2

Closing Performance

GapsIndex 3

Postsecondary Readiness

Index 4

Overview of Proposed Performance Index Framework

28