aspects of appraisal - getting it right
TRANSCRIPT
![Page 1: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/1.jpg)
Setting the contextThe Importance of Getting Teacher Appraisal
Right
![Page 2: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/2.jpg)
2
An excellent teacher can raise
test scores by as much as 50% compared to the average teacher
![Page 3: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/3.jpg)
3
Average:
62%
A moderate or large change in their
teaching practices after they received
feedback
Source: OECD, 2013
![Page 4: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/4.jpg)
4
Average:
71%
A moderate or large change in their
confidence as a teacher after they received feedback
Source: OECD, 2013
![Page 5: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/5.jpg)
5
Average:
63%
A moderately or large change in their job satisfaction
Source: OECD, 2013
![Page 6: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/6.jpg)
6
Average:
47%
Feedback is provided to teachers based on
a thorough assessment of their
teaching
Source: OECD, 2013
![Page 7: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/7.jpg)
7
Average:
51%
Teacher appraisal and feedback are largely
done to fulfil administrative requirements
Source: OECD, 2013
![Page 8: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/8.jpg)
8
Average:
31%
If a teacher is consistently
underperforming, he/she would be
dismissed
Source: OECD, 2013
![Page 9: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/9.jpg)
9
Average:
38%
The best performing teachers in this school receive the greatest
recognition
Source: OECD, 2013
![Page 10: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/10.jpg)
10
Planning and Preparation
Classroom Environment
InstructionProfessional
Responsibilities
Teaching
Source: Danielson, Framework for Teaching (1996, 2007)
A consistent and objective set of measures
![Page 11: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/11.jpg)
11
Teacher’s professional development
Contribution to school development
Links to external partners or the
community
Contribution to extra-curricular activities
Professional Responsibiliti
es
Additional responsibilities
![Page 12: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/12.jpg)
12
Frequency of appraisal for performance management
Never <1 every 2 years
Once every 2 years
Once per year
Twice or more per
year
0
5
10
15
20
25
30
35
40
45
Frequency of formal appraisal by the school principal (%)
Never <1 every 2 years
Once every 2 years
Once per year
Twice or more per
year
0
5
10
15
20
25
30
35
40
45
Frequency of formal appraisal by the school management
team (%)
![Page 13: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/13.jpg)
13
76%Content
knowledge
79%Student Surveys
95%Test Scores
95%Classroom
observation
89%Parent
feedback
81%Self-Assessment
Commonly used information sources
![Page 14: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/14.jpg)
14
Appraisal Methods
Classroom Observatio
n
![Page 15: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/15.jpg)
15
Appraisal Methods
Classroom Observatio
n
Objective Setting
and Interviews
![Page 16: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/16.jpg)
16
Appraisal Methods
Classroom Observatio
n
Objective Setting
and Interviews
Teacher Self-
Appraisal
![Page 17: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/17.jpg)
17
Appraisal Methods
Classroom Observatio
n
Objective Setting
and Interviews
Teacher Self-
Appraisal
Teacher’s Portfolio
![Page 18: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/18.jpg)
18
Appraisal Methods
Classroom Observatio
n
Objective Setting
and Interviews
Teacher Self-
Appraisal
Teacher’s Portfolio
Pupil and Parent
Surveys
![Page 19: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/19.jpg)
19
Appraisal Methods
Classroom Observatio
n
Objective Setting
and Interviews
Teacher Self-
Appraisal
Teacher’s Portfolio
Pupil and Parent
Surveys
Gains in Student Results
![Page 20: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/20.jpg)
20
Appraisal Methods
Classroom Observatio
n
Objective Setting
and Interviews
Teacher Self-
Appraisal
Teacher’s Portfolio
Pupil and Parent
Surveys
Gains in Student Results
Correlation:
0.24
95%
source: MET (2012)
![Page 21: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/21.jpg)
21
Improving Classroom Observation
1. Set clear expectations
2. Require observers to demonstrate accuracy
3. Average over multiple lessons
4. Track system-level reliability
5. Regularly verify link to student achievement gains
Source: Measures of Effective Teaching (2012)
![Page 22: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/22.jpg)
22
Appraisal Methods
Classroom Observatio
n
Objective Setting
and Interviews
Teacher Self-
Appraisal
Teacher’s Portfolio
Pupil and Parent
Surveys
Gains in Student Results
Correlation:
0.3779%
source: MET (2012)
![Page 23: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/23.jpg)
23
Appraisal Methods
Classroom Observation
Objective Setting and Interviews
Teacher Self-Appraisal
Teacher’s Portfolio
Pupil and Parent Surveys
Gains in Student Results
Correlation:
0.69
95%
source: MET (2012)
![Page 24: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/24.jpg)
24
Assumptions needed:
• Teachers should be unaffected by their working environment
• Allocation of pupils needs to be random
• Value added is equal regardless of the baseline
• Teachers are equally effective with all pupils
Is VA a truly unbiased measure of teacher quality?
![Page 25: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/25.jpg)
25
Is VA a consistent measure over time?
Source: Based on 941 teachers, Koedel and Betts (2007)
![Page 26: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/26.jpg)
26
Percentage increase in the chance of an average teacher being misjudged as exceptionally good or bad when using a single year measure
25%
Source: Schochet and Chiang (2010)
Is VA a consistent measure over time?
![Page 27: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/27.jpg)
27
If VA test scores placed a teacher in the bottom 3% then there was an 80%
probability they would be classified in the bottom quartile on all measures
Is VA an accurate reflection of teacher quality?
![Page 28: Aspects of Appraisal - Getting it Right](https://reader034.vdocument.in/reader034/viewer/2022052509/55c68fe6bb61ebf4408b4614/html5/thumbnails/28.jpg)
28
Conclusions