an empirical investigation of ohio’s educator evaluation system (nera)
DESCRIPTION
Presented at Northeastern Educational Research Association Annual Conference 2013 by Anirudh V.S. Ruhil, Marsha S. Lewis, Emily A. Price, and Suzanne FrancoTRANSCRIPT
![Page 1: An Empirical Investigation of Ohio’s Educator Evaluation System (NERA)](https://reader034.vdocument.in/reader034/viewer/2022052523/55630e51d8b42a5b498b4831/html5/thumbnails/1.jpg)
An Empirical Investigation of Ohio’s Educator Evaluation System
![Page 2: An Empirical Investigation of Ohio’s Educator Evaluation System (NERA)](https://reader034.vdocument.in/reader034/viewer/2022052523/55630e51d8b42a5b498b4831/html5/thumbnails/2.jpg)
Overview …
• Two question motivate our study:– What does Ohio’s educator evaluation system look like?– Any systematic patterns (conditional\unconditional)?
• OTES\OPES • eTPES Data• Analysis and Findings• Conclusions
10/24/13NERA Annual Meeting (Rocky Hill, CT) 2
![Page 3: An Empirical Investigation of Ohio’s Educator Evaluation System (NERA)](https://reader034.vdocument.in/reader034/viewer/2022052523/55630e51d8b42a5b498b4831/html5/thumbnails/3.jpg)
OTES (2014-2015)
10/24/13 3
(1) Performance Standards (50%)-- Developed by OH Educator Standards Board-- Seven components
-- Students-- Content-- Assessment-- Instruction-- Learning Environment-- Collaboration and Communication-- Professional Responsibility and Growth
(2) Student Growth Measures (50%)-- Value-Added-- Approved Vendor Assessments-- LEA Measures
NERA Annual Meeting (Rocky Hill, CT)
![Page 4: An Empirical Investigation of Ohio’s Educator Evaluation System (NERA)](https://reader034.vdocument.in/reader034/viewer/2022052523/55630e51d8b42a5b498b4831/html5/thumbnails/4.jpg)
Student Growth Measures in OTES
10/24/13NERA Annual Meeting (Rocky Hill, CT) 4
(A) Value-Added-- Grades 4th – 8th, ELA & Math -- Until June 30, 2014, majority (>25%) of SGM shall be based on Value-Added-- On or after July 1, 2014, all (50%) of SGM shall be based on Value-Added.
(B) Approved Vendor Assessments-- Terra Nova-- ACT End-of Course-- NWEA MAP -- STAR -- …
(C) LEA Measures -- Student Learning Objectives-- Shared Attribution
-- LEA\School-level Value-Added-- LEA\School-level SLO
![Page 5: An Empirical Investigation of Ohio’s Educator Evaluation System (NERA)](https://reader034.vdocument.in/reader034/viewer/2022052523/55630e51d8b42a5b498b4831/html5/thumbnails/5.jpg)
OPES (2014-2015)
10/24/13NERA Annual Meeting (Rocky Hill, CT) 5
(1) Performance Standards
-- Shared vision, establish goals, continuous improvement-- HQ instruction -> increased student achievement-- Manage resources\operations-- Establish collaborating learning, shared leadership-- Engage parents, community
(2) Student Growth Measures
-- Value-Added-- Approved Vendor Assessments-- LEA Measures
![Page 6: An Empirical Investigation of Ohio’s Educator Evaluation System (NERA)](https://reader034.vdocument.in/reader034/viewer/2022052523/55630e51d8b42a5b498b4831/html5/thumbnails/6.jpg)
Student Growth Measures in OPES
10/24/13NERA Annual Meeting (Rocky Hill, CT) 6
(A) Value-Added-- School-level Value-Added
(B) Approved Vendor Assessments-- School-level Composite Measure-- School level aggregate of AVA scores
(C) LEA Measures-- District SLOs-- District Value-Added-- Aggregate of Teachers’ Value-Added Scores-- Student Achievement trends-- Progress on Improvement Plans-- Student course-taking trend (e.g., AP)
![Page 7: An Empirical Investigation of Ohio’s Educator Evaluation System (NERA)](https://reader034.vdocument.in/reader034/viewer/2022052523/55630e51d8b42a5b498b4831/html5/thumbnails/7.jpg)
… OTES\OPES Final Rating Determination
10/24/13NERA Annual Meeting (Rocky Hill, CT) 7
![Page 8: An Empirical Investigation of Ohio’s Educator Evaluation System (NERA)](https://reader034.vdocument.in/reader034/viewer/2022052523/55630e51d8b42a5b498b4831/html5/thumbnails/8.jpg)
OTES\OPES Data for 2012-2013• OTES – 26 LEAs = 23 PSDs + 1 JVSDs + 2 CSs
• OPES – 27 LEAs = 24 PSDs + 1 JVSD + 2 CSs
• After exclusions for LEAs piloting OTES\OPES we have – 24 LEAs ~ 2,001 Teacher records – 15 LEAs ~ 62 Principal records– … These sub-sample sizes drop further once “Exempt” records are excluded
10/24/13NERA Annual Meeting (Rocky Hill, CT) 8
Ineffective Developing Skilled Accomplished Total
13 (0.6%) 298 (12.8%) 1,580 (67.8%) 441 (18.9%) 2,332 (100%)
Ineffective Developing Skilled Accomplished Total
0 (0%) 22 (12.9%) 98 (57.3%) 51 (29.8%) 171 (100%)
![Page 9: An Empirical Investigation of Ohio’s Educator Evaluation System (NERA)](https://reader034.vdocument.in/reader034/viewer/2022052523/55630e51d8b42a5b498b4831/html5/thumbnails/9.jpg)
10/24/13NERA Annual Meeting (Rocky Hill, CT) 9
OTES\OPES Final Summative Ratings
![Page 10: An Empirical Investigation of Ohio’s Educator Evaluation System (NERA)](https://reader034.vdocument.in/reader034/viewer/2022052523/55630e51d8b42a5b498b4831/html5/thumbnails/10.jpg)
OTES Final Rating by SGM Rating
10/24/13NERA Annual Meeting (Rocky Hill, CT) 10
![Page 11: An Empirical Investigation of Ohio’s Educator Evaluation System (NERA)](https://reader034.vdocument.in/reader034/viewer/2022052523/55630e51d8b42a5b498b4831/html5/thumbnails/11.jpg)
OTES SGM Ratings by SGM Type
10/24/13NERA Annual Meeting (Rocky Hill, CT) 11
![Page 12: An Empirical Investigation of Ohio’s Educator Evaluation System (NERA)](https://reader034.vdocument.in/reader034/viewer/2022052523/55630e51d8b42a5b498b4831/html5/thumbnails/12.jpg)
OTES Value-Added Ratings by Weight
10/24/13NERA Annual Meeting (Rocky Hill, CT) 12
![Page 13: An Empirical Investigation of Ohio’s Educator Evaluation System (NERA)](https://reader034.vdocument.in/reader034/viewer/2022052523/55630e51d8b42a5b498b4831/html5/thumbnails/13.jpg)
SLO Ratings by Weight
10/24/13NERA Annual Meeting (Rocky Hill, CT) 13
![Page 14: An Empirical Investigation of Ohio’s Educator Evaluation System (NERA)](https://reader034.vdocument.in/reader034/viewer/2022052523/55630e51d8b42a5b498b4831/html5/thumbnails/14.jpg)
Initial Conclusions
• Value-Added fairly congruent with other evaluation measures• Weight placed on Value-Added seems to be of no consequence for final
summative rating• Our early results in line with NYC (http://bit.ly/16qYVYg) … possibly other
states as well.
• Strong Caveats – Limited data at hand– Potentially biased set of LEAs studied here – Value-Added well studied but not so Vendor Assessments & SLOs– Questions of OTES\OPES reliability only answerable with multiple waves of data
10/24/13NERA Annual Meeting (Rocky Hill, CT) 14