2006 Accountability Manual

May 23, 2006

2

Introduction

Selected sections are adopted as Commissioner of Education rule

These sections have been posted to the 2006 accountability site at: www.tea.state.tx/us/perfreport/account/2006/manual

Remaining sections (the Preview and Appendices) will be posted on 5/25/06

Email notification will be sent 5/25/06

3

Introduction (cont’d)

Manual Orientation

Manual Highlights (Standard Procedures)

2006 Accountability Schedule

4

Manual Orientation

Part I – Standard Procedures

Part II – Alternative Education Accountability Procedures

Part III – Items common to Standard and AEA Procedures

Appendices

5

Manual Orientation (cont’d)

Part I – Standard Procedures

Overview (Chapter 1)

The Basics

Base Indicators (Chapter 2)*

Additional Features (Chapter 3)*

Determining a Rating (Chapter 4)*

GPA (Chapter 5)*

Special Issues/Circumstances (Chapter 6)*

* Adopted in Commissioner's rule

6

Manual Orientation (cont’d)

Part II – AEA Procedures

Overview (Chapter 7)

Registration Criteria (Chapter 8)*

Attribution of AEC data (Chapter 9)

Base Indicators (Chapter 10)*

Additional Features (Chapter 11)*

AEA Ratings (Chapter 12)*

Index (Chapter 13)

* Adopted in Commissioner's rule

7

Manual Orientation (cont’d)

Part III – Items Common to Standard and AEA Procedures

Appeals (Chapter 14)*

Responsibilities and Consequences (Chapter 15)*

2007 Standards (Chapter 16) [NEW CHAPTER]*

Preview of 2007 and Beyond (Chapter 17) – This chapter combines the preview for both Standard and AEA procedures.

Calendar (Chapter 18)

* Adopted in Commissioner's rule

8

Manual Orientation (cont’d)

Appendices

A: Texas Administrative Code (provides the text of the Commissioner’s rule)

B: Statutory Citations

C: Comparison to AYP

D: Data Sources

E: Texas Growth Index

F: Campus Comparison Group

G: Contacts

H: Acknowledgments

I: Hurricanes Katrina and Rita [NEW APPENDIX]

9

Highlights of Manual

The following tables or sections of the manual are recommended for bookmarking.

These sections are noteworthy because:

they are summaries or overviews of a topic;

they are significantly changed from the previous edition; or,

they describe something new

10

Highlights of Manual (cont’d)

Table 2 Comparison

Provides a summary of changes to the 2006 System compared to the 2005 System.

Excerpts reflect 2006 changes only:

11

Highlights of Manual (cont’d)

Component 2006

Base Indicators for Determining Rating (Chapter 2)

TAKS No ChangeSDAA II No ChangeCompletion Rate II Changed to Completion Rate IDropout Rate No Change

Rating Standards(Chapter 2)

Acceptable Recognized Exemplary

TAKS 35%/40%/60% 70% 90%

SDAA II

No ChangeCompletion

Dropout

TAKS Subjects Evaluated (Chapter 2)

No Change (TAKS science for gr. 8 is assessed and reported, but not used for

accountability)

Table 2 Comparison

12

Highlights of Manual (cont’d)

Table 2 Comparison

Component 2006

TAKS Student Passing Standard (Chapter 2)

Panel Recommendation for all subjects, all grades

Student performance included for rating(Appendix I)

Same as 2005; additionally, performance of students with KRI (Katrina-Rita Indicator) codes on TAKS/SDAA II is excluded from ratings calculation

Required Improvement (Chapter 3)

TAKS: No ChangeSDAA II: RI to Academically Acceptable and Recognized possibleCompletion Rate I: RI still possible; prior year will be re-computed as Completion Rate IAnnual Dropout Rate: No Change

Exceptions (Chapter 3)

No Change(Exceptions applied in 2005 cannot be re-used in 2006)

13

Highlights of Manual (cont’d)

Table 2 Comparison

Component2006

Hurricane Rita(Appendix I)

Schools and districts closed for ten or more days may receive a rating of Not Rated: Other.

Gold Performance Acknowledgment Indicators (Chapter 5)

Same as 2005, except:Addition of TSI - Higher Education Readiness Component for English Language ArtsTSI - Higher Education Readiness Component for MathematicsDeletion of TAAS/TASP Equivalency

Standards for GPA(Chapter 5)

Same as 2005, except: Recommended High School Program is raised to 70.0%;Standard for the new TSI - Higher Education Readiness Component for Mathematics and ELA indicators is 50%

Underreported Students (Chapter 3)

No more than 100 underreported students; and,No more than 2.0% underreported

14

Highlights of Manual (cont’d)

Subset Scenarios

The subset scenarios describe a variety of student mobility situations and explain how these students’ test results will be used for accountability.

Location – In Chapter 2 – Base Indicators just after discussion of TAKS and SDAA II indicators (pp.16 – 19). Located here because subsetting only applies to these two base indicators.

New subset table – Focuses on SSI grades. Located in Data Sources (p.172). Chart format rather than written description of situations.

15

Highlights of Manual (cont’d)

Ratings

Table 4 (p. 34) Standard Rating Labels: provides description of all possible rating labels – what they mean and when they are applied.

Table 5 (pp. 36-40) Sample Data Table: shows what district admin will see in July on TEASE. Shows how to use data provided to determine a rating.

Note addition of prior year data and RI columns for SDAA II

Note on preview table:

no rating

no messages

no RI, Exceptions calculations

Analysis Groups ARE MARKED

16

Highlights of Manual (cont’d)

System Summaries

Tables 6 and 7 provide single page summaries of the 2006 system. Table 8 provides a summary of the GPA indicators.

Table 6 - Requirements for each Rating Category (columns are the Rating Categories)

Table 7 – Overview of 2006 System Components (columns are the Base Indicators)

Table 8 – GPA Standards for 2007

17

Highlights of Manual (cont’d)

Appeals Calendar (Chapter 14, p. 117)

June 20, 2006

Dropout/Completion Lists. Superintendents are given access to lists of official dropouts and lists of completion cohort membership. These reports provide a preview of the data that will be used to calculate the Annual Dropout Rate and Completion Rate I base indicators for the state accountability ratings.

July 21, 2006

Preview Data Tables. Superintendents are given access to preview accountability data tables for their district and campuses showing all state accountability indicator data. Principals and superintendents can use these data tables to anticipate their campus and district accountability ratings. Appeals may be submitted by the superintendent after receipt of the preview data tables.

August 1, 2006

Ratings Release. Due to the short timeline between the transmittal of the preview data tables and the ratings release date, no appeals will be resolved before the ratings release.

August 18, 2006

Appeals Deadline. Appeals must be postmarked no later than August 18, 2006 in order to be considered.

Late October, 2006

Ratings Update. The outcome of all appeals will be reflected in the ratings update scheduled for October, 2006. At that time the TEA website will be updated.

A more detailed calendar can be found in Chapter 18 – Calendar.

18

Highlights of Manual (cont’d)

Chapter 16 - NEW – Accountability Standards for 2007

Table 19 – Standard Procedures

Table 20 – AEA Procedures

Chapter 17 – Preview of 2007 and Beyond

See tables 22 and 23 for standards through 2010

Table 22 – Standard Procedures

Table 23 - AEA Procedures

19

Highlights of Manual (cont’d)

Appendix I – Hurricanes Katrina and Rita

Excluding Data for Displaced Students (use of KRI code values)

The assessment results (performance) of students displaced due to either Hurricane Katrina or Hurricane Rita will be removed from the accountability data. The Katrina-Rita Indicator (KRI) code collected on the TAKS and SDAA II answer documents will be used to determine which scores to exclude. Students with KRI codes of ‘2,’ ‘3,’ ‘4,’ or ‘5’ will be excluded from the assessment results used for accountability.

20

Highlights of Manual (cont’d)

Appendix I – Hurricanes Katrina and Rita

Hurricane Rita Provision

For identified districts and campuses, the accountability system will generate ratings using available data. If the 2006 ratings are not Academically Unacceptable and are equivalent to, or better than, the rating received in 2005, TEA will issue the new system-generated rating on August 1. For all others (meaning the 2006 rating is either Academically Unacceptable or lower than the rating received in 2005), TEA will issue a rating of Not Rated: Other on August 1. For these campuses and districts, a message will be included on the data table that states the Hurricane Rita Provision was used

21

2006 Accountability Schedule

Activity Date

Pairing relationships requested for identified campuses Mar. 29th-Apr. 28th

Commissioner’s final decisions for 2006 accountability system are posted online Apr. 5th

2006 Accountability Manual published (public web only) mid-May

Districts receive confidential dropout and completion lists and rates from TEA (secure web only) Jun. 20th (Tue)

Districts receive confidential preview data tables from TEA (secure web only) July 21st

TEA begins accepting ratings appeals July 21st

TEA issues 2006 district and campus accountability ratings (secure and public web) Aug. 1st (Tue)

Last day to appeal 2006 state accountability ratings Aug. 18th (Fri)

Appeals panel meeting late Sept. / early Oct.

Final ratings release—after resolution of all appeals (secure and public web) late Oct.

TEA issues 2006 Gold Performance Acknowledgments (GPA) late Oct.

TEA releases 2005-06 AEIS reports to district superintendents (secure web only) early Nov.

Release of 2005-06 AEIS reports on public website late Nov.

TEA notifies districts of campuses identified under PEG criteria effective for the 2007-08 school year (via mail) (not applicable to charters or registered AECs)

mid-Dec.

TEA releases 2005-06 School Report Cards mid-Dec.

Alternative Education Accountability (AEA)

Procedures

May 23, 2006

23

At-Risk Registration Criterion

An at-risk registration criterion will be phased in beginning in 2006.

Each registered AEC must have a minimum percentage of at-risk students enrolled on the AEC verified through current-year PEIMS fall enrollment data in order to be evaluated under AEA procedures.

The at-risk criterion will begin at 65% in 2006 and increase by five percentage points each year until it reaches 75% in 2008 where it is expected to remain.

24

At-Risk Registration Criterion (cont’d)

Safeguards are incorporated for those AECs that do not meet the at-risk requirement.

1. Prior-Year PEIMS At-Risk Data Safeguard: If a registered AEC does not meet the at-risk criterion in the current year, then it remains under AEA if the AEC meets the at-risk criterion in the prior year.

For example, an AEC with an at-risk enrollment of 64% in 2006 and 65% in 2005 remains registered in 2006.

25

At-Risk Registration Criterion (cont’d)

2. New Campus Safeguard: If a new campus is registered for evaluation under AEA procedures, then the AEC is not required to meet the at-risk criterion in its first year of operation.  This safeguard provides an accommodation for new campuses with no prior-year data.

3. At-Risk Statewide Average Safeguard: The 2006 at-risk statewide average is 49%.  If a registered AEC does not meet the 65% at-risk registration criterion and the two safeguards above are not applicable, then the AEC remains under AEA if the AEC has at least 49% at-risk in 2006.  This safeguard is a one-year accommodation for the new at-risk registration criterion and applies in 2006 only.

26

At-Risk Registration Criterion (cont’d)

On April 26, letters were mailed (return receipt required) to the 17 AECs that did not meet the 2006 at-risk registration criterion informing them that the AEC shifted from AEA to standard accountability and that the AEC will be evaluated under 2006 standard accountability procedures.

ESC Executive Directors and Accountability contacts were mailed copies of these letters.

The Final 2006 Registered AEC list was posted on the AEA website on May 19. A total of 417 AECs will be rated under 2006 AEA procedures.

A list of the 84 charter operators that will be rated under 2006 AEA procedures was also posted on the AEA website on May 19.

27

At-Risk Registration Criterion (cont’d)

A State Compensatory Education Questions and Answers (Q and A) document is on the TEA website at:

http://www.tea.state.tx.us/school.finance/audit/sce_presentation.html  

This Q and A addresses proper coding of at-risk students.  Also, ESC Compensatory Education contacts can assist with at-risk questions.

28

Attribution of Data to Registered AECs

For 2006 accountability:

Campus accountability subset determines attribution of AEC test data, but does not apply to exit-level retests.

2004-05 leaver data were attributed according to the 85-day rule for AECs that were registered for evaluation under AEA procedures in 2005.

2004-05 leaver data were attributed to the last campus of attendance for AECs that were not registered for evaluation under AEA procedures in 2005, but are registered in 2006.

As required in statute, DAEP and JJAEP data are attributed to the students’ home campus.

29

Attribution of Data to Registered AECs

For 2007 accountability:

Campus accountability subset determines attribution of AEC test data, but does not apply to exit-level retests.

2005-06 leavers are attributed to the last campus attended.

The 85-day rule is phased-out completely for 2007 accountability and beyond.

30

2006 AEA Standards

TAKS Progress indicator remains 40%.

SDAA II indicator remains 40%.

Completion Rate II indicator (includes graduates, continuing students, and GED recipients) remains 75.0%.

Annual Dropout Rate (Gr. 7-12) indicator remains 10.0%.

31

2006 TAKS Progress Indicator

For 2006, exit-level results from the June and December 2005 administrations will be included.

TAKS Tests IncludedApril2006

Feb2006

Dec2005

Oct2005

July2005

June2005

Grades 3-11 √  √        

Grade 11 Retests √ √ √ √ √ √

Grade 12 All tests √ √ √ √ √ √

32

SDAA II Required Improvement

In 2006 and 2007, the Required Improvement feature will be added to the SDAA II indicator allowing registered AEC and charter ratings to move from AEA: Academically Unacceptable to AEA: Academically Acceptable.

As with the other three AEA indicators, the SDAA II Required Improvement calculation is based on meeting the SDAA II indicator standard in two years.

33

2007 AEA Standards

TAKS Progress indicator increases to 45%.

SDAA II indicator increases to 45%.

Completion Rate II indicator (includes graduates, continuing students, and GED recipients) remains 75.0%.

Annual Dropout Rate (Gr 7-12) indicator remains 10.0%.

34

NCES Dropout Definition

The dropout definition is transitioning from the current state definition to the National Center for Education Statistics (NCES) definition.

Beginning with 2005-06 dropouts reported in 2006-07 and used for 2007 accountability, the definition of a dropout will change to comply with the NCES dropout definition.

In 2007, only one of the four years in the cohort will be affected. In 2008, two years of the cohort are affected, and so on, until 2010 when the denominator uses the NCES dropout definition for all four years of the cohort.

35

2007 Annual Dropout Rate Indicator

Required Improvement (RI) for the Annual Dropout Rate indicator cannot be calculated and will not be applied in 2007. The changes to the dropout definition will prevent comparisons of rates used in 2006 and 2007.

Due to the definitional and RI changes described above, if the Annual Dropout Rate is the only indicator causing a registered AEC or charter to be AEA: Academically Unacceptable, then the “hold harmless” provision is applied and the AEC or charter will be assigned the AEA: Academically Acceptable label. This provision will be in place for 2007 only.

36

2007 Completion Rate II Indicator

Required Improvement for the Completion Rate II indicator cannot be calculated and will not be applied in 2007. The changes to the dropout definition will prevent comparisons of rates used in 2006 and 2007.

37

2007 AEA Campus Registration Process

The 2007 AEA campus registration process begins on September 11, 2006.

An email notification will be sent to all superintendents stating that AECs rated in 2005-06 under AEA procedures will be re-registered automatically in 2006-07 subject to the 70% at-risk registration criterion.

A rescission letter will be required from AECs not wishing to remain registered for AEA.

38

2007 AEA Campus Registration Process

A 2006-07 AEA Campus Registration Form will be required from each AEC that wishes to be evaluated under 2006-07 AEA procedures that is not already on the list of registered AECs. A sample rescission letter and the registration form will be available on the AEA website at http://www.tea.state.tx.us/aea.

AECs not meeting the 2006 at-risk registration criterion that wish to be evaluated under 2007 AEA procedures will be required to register in 2007.

The 2007 registration process closes on September 22, 2006.

When finalized, the list of 2007 registered AECs will be available on the AEA website.

39

AEA FAQ

The AEA FAQ has been updated and will be reposted on the AEA website by May 25, 2006 along with the 2006 Accountability Manual.

40

Dates for Future TETN Accountability Sessions

June 27 – tentative agenda topics: Update on the 2006 Special Session Overview of the decisions reached with the USDE on

2006 AYP Review of 2006 AYP Guide Review Plans for August 1 Release

August 22

November 14

41

Contact Information

Phone: 512-463-9704

Email: performance.reporting@tea.state.tx.us

Online:http://www.tea.state.tx.us/accountability

http://www.tea.state.tx.us/aea/

http://www.tea.state.tx.us/ayp/