Accountability data overviewAugust 2014
Topics
Changes to 2014 accountability reporting
Overview of accountability measures
Progress & Performance Index (PPI)
School percentiles
Accountability & assistance levels
Reports
Resources & tools
Massachusetts Department of Elementary and Secondary Education
2
Massachusetts Department of Elementary and Secondary Education
3
Highlights of ESEA Flexibility in MA Goal: Reducing proficiency gaps by half by 2017 Accountability & assistance levels for schools &
districts (Levels 1-5) Progress & Performance Index (PPI) – a
performance measure that includes student growth, science, & other indicators
School percentiles – representing performance relative to other schools of the same school type
“High needs” subgroup data reported Low income students, students with disabilities,
current & former English language learners
Massachusetts Department of Elementary and Secondary Education
4
Description 2012 & 2013 reporting 2014 reporting
Extra credit for reengaging dropouts
N/A High schools that reengaged 2 or more dropouts in the 2012-13 school year will earn 25 extra credit PPI points (all students & high needs groups only)
Weighting of growth and achievement in school percentiles
Achievement – 80%Growth – 20%
Non-high schools:Achievement – 75%Growth – 25%
High schools:Achievement – 50%Growth – 25%High school indicators – 25%
Methodology for identifying Commendation Schools
Better alignment between Commendation School criteria and that of federal Blue Ribbon Schools program.
Commendation Schools will be identified when official MCAS & accountability data are released in mid-September.
Changes to 2014 accountability reporting
Massachusetts Department of Elementary and Secondary Education
5
Description2012 & 2013 reporting 2014 reporting
Accountability reporting for PARCC PBA field test schools with some students exempt from MCAS testing
N = 89
N/A 2014 PPI and school percentiles calculated using highest value for all MCAS results or MCAS results excluding PBA field test grades.
2014 accountability & assistance level based on 2014 cumulative PPI and school percentile.
Accountability reporting for PARCC PBA field test schools with all students exempt from MCAS testing
N = 13
N/A No 2014 PPI or school percentile.
2013 accountability & assistance level held constant.
Changes to 2014 accountability reporting
Massachusetts Department of Elementary and Secondary Education
6
Description2012, 2013, & 2014 reporting 2015 reporting
Persistently low graduation rates
Any school with a graduation rate of less than 60% for four consecutive years is automatically placed in Level 3
Any school with a graduation rate of less than 67% for the most recent four-year graduation rate & 70% for each of the three prior five-year rates will be placed in Level 3.
Implementation in 2015, but schools will be notified in 2014 if they would have been impacted by this change in 2014.
Participation rates Schools testing less than 95% of students in any group on any of the required statewide assessments are automatically ineligible for Level 1, & schools testing less than 90% of students in any group on any test are automatically ineligible for Levels 1 and 2.
Current school participation consequences will also be applied at the district level.
Implementation in 2015, but districts will be notified in 2014 if they would have been impacted by this change in 2014.
Preview of changes to 2015 accountability reporting
Massachusetts Department of Elementary and Secondary Education
7
Reducing proficiency gaps by half by 2016-17
Massachusetts Department of Elementary and Secondary Education
8
Reducing proficiency gaps by half by 2016-17
Massachusetts Department of Elementary and Secondary Education
9
The PPI is a measure of progress toward a group’s gap-narrowing goals Annual PPI shows progress over two years Cumulative PPI represents trend over time
Core indicators (up to 7) ELA, math, & science proficiency gap narrowing (CPI) ELA & math growth (SGP) Annual dropout rate Cohort graduation rate (4-and 5-year)
Extra credit Reducing percentage of students scoring Warning/Failing
&/or increasing percentage of students scoring Advanced (10 percent or more)
Reengaging dropouts (2 or more students)
What are some key PPI concepts?
Massachusetts Department of Elementary and Secondary Education
10
Annual PPI = total points / # core indicatorsCumulative PPI = (2011*1 + 2012*2 + 2013*3 + 2014*4)
/ 10
Core indicators Up to 700 points awarded
1. ELA proficiency gap narrowing
0, 25, 50, 75, or 100
2. Math proficiency gap narrowing
0, 25, 50, 75, or 100
3. Science proficiency gap narrowing
0, 25, 50, 75, or 100
4. ELA growth 0, 25, 50, 75, or 100
5. Math growth 0, 25, 50, 75, or 100
6. Annual dropout rate 0, 25, 50, 75, or 100
7. Cohort graduation rate 0, 25, 50, 75, or 100
Extra credit indicators Up to 175 additional points awarded
ELA, math, science W/F reduction
25 + 25 + 25
ELA, math, science ADV increase
25 + 25 + 25
Dropout reengagement 25
Massachusetts Department of Elementary and Secondary Education
11
The PPI and the school percentile PPI is a criterion-referenced measure of progress Percentiles are relative, & help the state &
districts focus supports on low-achieving students in low performing schools
Massachusetts uses school types (ES, ESMS, MS, MSHS/K-12, HS) to fairly compare the performance of schools serving the same or similar grades & distribute resources equitably
Every school’s percentile & PPI tells a different story Schools with lower percentiles but higher PPIs for all student
groups are showing improvement over time Schools with higher percentiles but lower PPIs are high
performing, but have more work to do to support student success
What are some key Level concepts?
Massachusetts Department of Elementary and Secondary Education
12
Schools & districts are classified into a level based on a four-year trend The cumulative PPI for all students & high needs
students is used to classify schools into Levels 1 & 2 School percentiles (1-99) represent performance
relative to other schools of the school type, & are used to determine Level 3 schools (lowest-performing 20 percent per state law)
Districts are classified based on the level of lowest-performing school (exception for Board action)
Massachusetts Department of Elementary and Secondary Education
13
How are schools classified?
Sample reports
Massachusetts Department of Elementary and Secondary Education
15
Accountability reports
Layer 1: Accountability & assistance level Reason(s) for level designation School percentile (schools only) Determination of need for Special Education technical
assistance or intervention (districts and single-school districts only)
Cumulative Progress & Performance Index (PPI) for all student groups
Summary of school accountability information (districts only)
Layer 2 (group-specific): Annual & cumulative PPI figures Points awarded for each indicator Assessment participation data
Layer 3: Detailed data for each indicator for all student groups
Level 1 school (first layer of report)
Massachusetts Department of Elementary and Secondary Education
16
Level 1 school (second layer of report)
Massachusetts Department of Elementary and Secondary Education
17
Level 1 school (third layer of report)
Massachusetts Department of Elementary and Secondary Education
18
Level 2 school (first layer of report)
Massachusetts Department of Elementary and Secondary Education
19
Level 3 school (first layer of report)
Massachusetts Department of Elementary and Secondary Education
20
Resources & tools
Resources and tools
Massachusetts Department of Elementary and Secondary Education
22
http://www.doe.mass.edu/apa/accountability
Massachusetts Department of Elementary and Secondary Education
23
Gap-halving calculators
Massachusetts Department of Elementary and Secondary Education
24
PPI calculator
Massachusetts Department of Elementary and Secondary Education
25
District analysis, review, & assistance tools
http://www.doe.mass.edu/apa/dart
Massachusetts Department of Elementary and Secondary Education
26
District analysis, review, & assistance tools
http://profiles.doe.mass.edu/analysis/
Questions?
Massachusetts Department of Elementary and Secondary Education
27
http://www.doe.mass.edu/apa/accountability