2014 accountability system 2014 accountability system jana schreiner senior consultant...
TRANSCRIPT
2014 Accountability
System
2014Accountability
System
Jana SchreinerSenior Consultant
Accountability State Assessment
Resources
http://ritter.tea.state.tx.us/perfreport/account/2014/index.html
www.lead4ward.com
www.region10.org/accountability
Reading Percent Meeting Phase In StandardLevel II: Satisfactory
Percent Meeting Recommended Standard
Level II: Satisfactory
Region 2013 Region 2014 Region 2013 Region 2014
Grade 579% 79% NC 44% 46% +2
Grade 886% 85% -1 51% 50% -1
MathPercent Meeting Phase In Standard
Level II: Satisfactory
Percent Meeting Recommended Standard
Level II: Satisfactory
Region 2013 Region 2014 Region 2013 Region 2014
Grade 575% 80% +5 42% 45% +3
Grade 8 77% 80% +3 35% 39% +4
5th Math 5th Reading 8th Math 8th Reading50%
55%
60%
65%
70%
75%
80%
85%
90%
95%
100%
80% 79% 80%
85%
79%76%
79%82%
Region 10Texas
5th and 8th Reading and Math
Agenda
Overview Accountability System Ratings Safeguards Distinctions
2014 Ratings Labels
Rating based on 4 Indexes
Performance Index Framework
Index 1 Index 2 Index 3 Index 4
Student Achievement
Student Progress
Closing Performance
Gaps
Postsecondary Readiness
Rating based on 4 Performance
Indexes
Performance Standards on STAAR
1st Phase-in Level II
2nd Phase-in Level II
Final Level II Performance
Unknown
Dec. 2014Could
Chang
e
2014 Target= 55
Index 1: Student AchievementIndex 1: Student Achievement provides an overview of student performance based on satisfactory student achievement across all subjects for all students.
2013
Combined over All Subjects: Reading, Mathematics, Writing, Science, and Social Studies.
Student Groups: All Students. Performance Standards: Phase-in 1 Level II
(Satisfactory).
STAAR End-of-Course (EOC) Assessments(15 total): Reading I; Reading II; Reading III Writing I; Writing II; Writing III Algebra l; Geometry; Algebra ll Biology; Chemistry; Physics World Geography; World History; US History
English Language Learners (English and Spanish tests): ELLs in US schools Years 1-3 excluded ELLs in US schools Year 4 or more included
2014
Combined over All Subjects: Reading, Mathematics, Writing, Science, and Social Studies.
Student Groups: All Students. Performance Standards: Phase-in 1 Level II
(Satisfactory).
STAAR End-of-Course (EOC) Assessments (5 total): English l; English ll Algebra l Biology US History
English Language Learners (English and Spanish tests): ELLs in US schools Year 1 excluded ELLs in US schools Year 2 and
beyond included
Index 1: Student Achievement English I and II from Spring 2014 + Include Reading I and II from July 2013 and
December 2013 Substitute Assessments EOCs (PSAT, PLAN,
SAT, ACT, AP)
Standard at Meeting Final Level II (CCR Standard)
Counted as PASSER for Index I Counted as Meeting CCR Standard for
Index IV Not used in Index 2 and 3
• Add STAAR M, STAAR ALT, ELL progress measure
Index 2: Student Progress
Progress Measures by Subject Area and School Type
2013
Elem. School Middle School High School
READING
Gr. 4 Reading Gr. 6 Reading English l Reading
Gr. 5 Reading Gr. 7 Reading English ll Reading
_ Gr. 8 Reading _
_ English l Reading
_
MATHEMATICS
Gr. 4 Mathematics
Gr. 6 Mathematics
Algebra l
Gr. 5 Mathematics
Gr. 7 Mathematics
_
_ Gr. 8 Mathematics
_
_ Algebra l _
WRITING
_ _ English ll Writing
Proposed 2014
Elem. School Middle School High School
READING
Gr. 4 Reading Gr. 6 Reading _
Gr. 5 Reading Gr. 7 Reading _
_ Gr. 8 Reading _
_ _ _
MATHEMATICS
Gr. 4 Mathematics
Gr. 6 Mathematics
Algebra l
Gr. 5 Mathematics
Gr. 7 Mathematics
_
_ Gr. 8 Mathematics
_
_ Algebra l _
WRITING
_ _ _
STAAR Weighted Progress Rate
AllStudent
sAfrican Amer.
Amer. Indian Asian Hispani
cPacific Islande
rWhite
Two or MoreRaces
ELL Special Ed.
Total Points
Max.Points
Example Calculation for Reading Progress Number of Tests
100 50 40 30
Performance Results: Met or Exceeded Progress Number Percent
8080%
4080%
40100%
2067%
Exceeded Progress Number Percent
2020%
2040%
3075%
517%
Reading Weighted Progress Rate 100 120 175 84 479 80018
Index 2: Student ProgressIndex 2: 2013 Construction – Table 1
STAAR Weighted Progress Rate
All Students
African
Amer.Amer. Indian Asian Hispani
cPacific Islande
rWhite
Two or More Races
ELL Special Ed.
Total Points
Max.Points
ReadingWeighted Progress 100 120 175 84 479 800
MathematicsWeighted Progress 85 98 150 160 493 800
WritingWeighted Progress 140 170 310 400
Total 1282 2000
Index 2 Score (total points divided by maximum points) 64
Index 2: 2013 Construction – Table 2
Index 2: Student Progress
Index 2: Student Progress focuses on actual student growth independent of overall achievement levels for each race/ethnicity student group, students with disabilities, and English language learners.
By Subject Area: Reading, Mathematics
One point for Met progress levelTwo points for Exceeded progress level
Progress Measures by Subject Area and School Type
New for 2014:No Index 2 for High Schools (9-12 campuses) or AEAInclusion STAAR-Modified, STAAR-AltInclusion of ELL Students
Index 2: Student Progress
Index 2: Student Progress focuses on actual student growth independent of overall achievement levels for each race/ethnicity student group, students with disabilities, and English language learners.
New for 2014: Students who skip grades included
Students who transition from Spanish to English in mathematics included
3rd grade student who receive ELL progress measure will count
ELL Denials: Students whose parent(s) have denied ELL services included Considered as Non-ELL student for Index 2
Index 2: Student Progress
Where can I find info?
Campus rosters Student have either STAAR Progress or
ELL Progress
2013
Points based on STAAR performance:
Phase-in 1 Level II satisfactory performance: One point for each percent of tests MET Phase-in 1 Level II
By Subject Area: Reading, Mathematics, Writing, Science, and Social Studies.
Student Groups: Economically Disadvantaged Lowest Performing Race/Ethnicity from
2012
Index 3: Closing Performance GapsIndex 3: Closing Performance Gaps emphasizes advanced academic achievement of economically disadvantaged students and the two lowest performing race/ethnicity student groups.
2014
Points based on STAAR performance:
Phase-in 1 Level II satisfactory performance: One point for each percent of tests MET Phase-in 1 Level II
Level III advanced performance:Two points for each percent of tests at the Level III advanced performance standard.
By Subject Area: Reading, Mathematics, Writing, Science, and Social Studies.
Student Groups: Economically Disadvantaged Lowest Performing Race/Ethnicity from 2013…
groups must have 25 tests in reading AND math
Inclusion of ELL Students
Index 3: Closing Performance Gaps
Index 3: 2014 Construction – Table 1 (based on 2014 STAAR performance)
STAAR Weighted Performance Rate
Economically Disadvantaged
Lowest Performing Race/Ethnic Group - 1
Lowest Performing Race/Ethnic Group - 2
Total Points
MaximumPoints
Example Calculation for Reading Weighted Performance Number of Tests
80 40 25
Performance Results: Phase-in 1 Level II Satisfactory and above Number Percent
80100%
2050%
25100%
Level III Advanced Number Percent
4050%
00%
25100%
Reading Weighted Performance Rate 150 50 200 400 600
STAAR Weighted Performance Rate
Economically Disadvantaged
Lowest Performing Race/Ethnic Group - 1
Lowest Performing Race/Ethnic Group - 2
Total Points
MaximumPoints
Reading Weighted Performance 150 50 200 400 600
Mathematics Weighted Performance 125 100 90 315 600
Writing Weighted Performance 80 90 125 295 600
Science Weighted Performance 120 40 90 250 600
Social Studies Weighted Performance 50 40 80 170 600
Total 1430 3000
Index 3 Score (total points divided by maximum points) 48
Index 3: 2014 Construction – Table 2 (based on 2014 assessment results by subject area)
Index 3: Closing Performance Gaps
For Discussion……
ELL http://ritter.tea.state.tx.us/perfreport/account/2014/index.html
Index 4: Postsecondary Readiness
2013
Graduation Score: Combined performance across the graduation and dropout rates for:
Grade 9-12 Four-Year Graduation Rate for All Students and all student groups; or
Grade 9-12 Five-Year Graduation Rate for All Students and all student groups, whichever contributes the higher number of points to the index.
RHSP/DAP Graduates: All Students and race/ethnicity student groups.
Index 4: Postsecondary Readiness emphasizes the importance of earning a high school diploma that provides students with the foundation necessary for success in college, the workforce, job training programs, or the military; and the role of elementary and middle schools in preparing students for high school.
2014
Graduation Score: Combined performance across the graduation and dropout rates for:
Grade 9-12 Four-Year Graduation Rate for All Students and all student groups; or
Grade 9-12 Five-Year Graduation Rate for All Students and all student groups, whichever contributes the higher number of points to the index.
RHSP/DAP Graduates: All Students and race/ethnicity student groups.
STAAR Score: STAAR Percent Met Final Level ll for All Students and race/ethnicity student groups.
Additional Indicators Required by House Bill 5 (83rd Texas Legislature, 2013)
College Ready Graduates.
Definition: Page 8, TAPR glossaryRate: Page 7, campus TAPR… “both subjects”
Ind
ex 4
: Posts
econ
dary
Read
iness
IndicatorAll
Students
African
Amer.
Amer. Indian
Asian
Hispanic
Pacific
Islander
White
Two or
MoreRaces
ELLSpecial Ed.
Total Point
s
Max.Poin
ts
STAAR ScoreSTAAR % MetFinal Level ll onTwo or More Tests
29% 16% 40% 23% 38% 36% 182 600
STAAR Score (STAAR total points divided by maximum points) 30
Graduation Score (Gr. 9-12)4-yr. graduation rate
84.3% 78.8% 78.8% 91.6% 86.0% 44.2% 69.8% 533.5 700
5-yr. graduation rate
85.1% 78.8% 80.0% 92.1% 84.0% 48.9% 77.5% 546.4 700
Highest Graduation Total 546.4 700Graduation Score (best of total graduation points divided by maximum points) 78.0
RHSP/DAP Score4-yr. graduationPercent RHSP/DAP
82.7% 76.4% 83.6% 83.0% 325.7 400
RHSP/DAP Score (best of total RHSP/DAP points divided by maximum points) 81.4
Postsecondary/College-Ready Graduates ScoreCollege-Ready Graduates subject (ELA & Math)
82.0% 72.0% 78.0% 89.0% 321.0 400
College-Ready Score (total points divided by maximum points) 80.2
Overall Index ScoreSTAAR Score 30.0
Multiply
byWeight
Graduation Score
78.0
RHSP/DAP Score
81.4
College-Ready Score
80.2
Index Score (sum of weighted index scores)
Index 4: Postsecondary Readiness
STAAR Level II Final Performance Percent Met Final Level II on Two or More Assessments
Weighting of Indicators: ALL FOUR components
Post-Secondary Indicator: Percent Met Criteria on ELA AND MATH
Indicator WeightSTAAR Component 25%Graduation 25%Graduation Plan 25%Post-Secondary Indicators 25%
32
Index 4 Targets
Elementary-12 Middle School-13 High School- 18
21(changed as of April 25th posting)*
District--13
Districts, high schools, and multi-grade campuses-56 57 (changed as of April 25th posting)*
STAAR Component All four components
55%
5th percentile 5th percentile
Rating Labels: AEA
2014 System Standard accountability labels:
Met Alternative StandardImprovement Required
30%5th percentileNA
Distinction Designations2013 Distinction Designation
Campus Top Twenty-Five Percent: Campuses in the top quartile of their campus comparisongroup earn a distinction designation.
Student Progressbased on Index 2
Academic Achievement in: Reading/ELA Mathematics
2014 Distinction Designation
Campus Top Twenty-Five Percent:Campuses in the top quartile of their campus comparison group
Student Progress (based on Index 2) Closing Performance Gaps (based on Index 3)
Academic Achievement in: Reading/English Language Arts Mathematics Science Social Studies
Districts and Campuses Postsecondary Readiness:House Bill 5 (83rd Texas Legislature, 2013) expanded distinctionsfor districts and campuses for attainment of postsecondary readiness
Criteria must include indicators based on percentages of students who: Achieve college-readiness standards on STAAR; Earn nationally/internationally recognized business/industry
certification; Complete a coherent sequence of CTE courses; Complete dual credit or a postsecondary course for local
credit; Achieve college readiness standards on SAT, ACT, PSAT, or
ACT-PLAN; Earn college credit based on AP/IB performance.
Accountability Ratings and Distinction Designations
2013 and 2014 Accountability Rating(Districts and Campuses) 2013 Distinction Designations 2014 Distinction Designations
Met Standard
Campuses Only
Student Progress
Academic Achievement: Reading/ELA Mathematics
Districts and CampusesPostsecondary Readiness
Campuses Only
Student Progress Closing Performance Gaps
Academic Achievement: Reading/ELAMathematics
ScienceSocial Studies
Improvement Required N/A N/A
System SafeguardsSafeguard Measures and Targets:
Reporting system disaggregates performance by student group, performance level, and subject area.
Performance rates are calculated from the assessment results used to calculate Index 1: Student Achievement.
2013 targets for the disaggregated system-safeguard results: STAAR performance target corresponds to Index 1 (50%); STAAR participation target required by federal accountability (95%); Federal graduation rate targets and improvement calculations for 4-year rate (78%) and 5-year rate (83%); and Federal limit on use of alternate assessments (1% and 2%).
40
Indicator Entity All Students
African Amer.
Amer. Indian Asian Hispanic Pacific
Islander White Two or More Races
Eco.Disadv. ELL Special Ed.
Performance Rates*
ReadingState 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% 55%
Federal 79% 79% n/a n/a 79% n/a 79% n/a 79% 79% 79%
MathematicsState 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% 55%
Federal 79% 79% n/a n/a 79% n/a 79% n/a 79% 79% 79%
Writing 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% 55%
Science 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% 55%
Social Studies 55% 55% 55% 55% 55% 55% 55% 55% 55% 55% 55%
Participation RatesReading 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95%
Mathematics 95% 95% 95% 95% 95% 95% 95% 95% 95% 95% 95%
Federal Graduation Rates (including improvement targets)
4-year 80% 80% 80% 80% 80% 80% 80% 80% 80% 80% 80%
5-year 85% 85% 85% 85% 85% 85% 85% 85% 85% 85% 85%
District Limits on Use of Alternative Assessment Results
Reading
Modified 2% Not Applicable
Alternate 1% Not Applicable
Mathematics
Modified 2% Not Applicable
Alternate 1% Not Applicable
Texas Education Agency | Office of Assessment and Accountability | Division of Performance Reporting
20
14 A
ccou
nta
bility
Syste
m S
afe
gu
ard
Measu
res a
nd
Targ
ets
* Targets for 2014 correspond to the performance target for Index 1: Student Achievement.