building leaders evaluations in keep - logincommunity.ksde.org/portals/44/documents/manhattan...
TRANSCRIPT
Building Leaders Evaluations in KEEP
June 7, 2013 at Manhattan; Bill Bagshaw, KSDE; Kayeri Akweks, KSDE; Mick Lowe
Available online at http://www.ksde.org/Default.aspx?tabid=4400
WAIVER - Principle 3 Supporting Effective Instruction and Leadership
Implement teacher and principal evaluation and support systems that:
• Are used for continual improvement of instruction
• Use at least 3 performance levels
• Use multiple measures including student growth as significant factor
• Are used to evaluate on a regular basis
• Provide clear, timely, and useful feedback
• Are used to inform personnel decisions
As of June 3, 2013 –
278 districts have submitted their Assurances Form
267 districts have had their Assurances Form approved
93 districts will be using the KEEP Repository
146 districts will be using vendors
46 districts will be using locally created evaluation systems
Districts Have Chosen Their Evaluation Systems for 2013-2014
Evaluation Systems per Districts as of 6-4-2013
1. Multiple Measures
2. Inter-Rater Reliability
3. Evaluation Goal Selection
4. Evaluating the Building Leader
5. KEEP Repository
5 Topics to Prioritize
Multiple Measures
• Consider state assessments as expected
• Include assessment measures currently in use in your district
• Shared credit/responsibility for student growth
• Time for student growth 1-3 years
Sample Measures by KSDE from the Field
Academic Measures – State Assessments
Academic Measures – Not State Assessments
Other Student Knowledge and Skills Measures
• History and Government State Assessment
• ESOL State
Assessment • Reading State
Assessment • Mathematics State Assessment • Science State
Assessment • Writing State
Assessment
Common Academic Assessments • ACT/SAT scores • Aimsweb • AP scores • CETE Formative Assessments • DIBELS • District wide Common
Assessments • Fitness Grams • Lexile Scores • Measures of Academic Progress
(MAP)
Other Academic Assessments • Student constructed response
with rubric for assessment • KWIET portfolio • Performance based measures • Project Rubrics
College and Career Ready Measures • Industrial Certifications
assessments (Technical Skills) • Interpersonal communication
skills (Interpersonal Qualities) • WorkKeys (Career Interest
Development)
Other Non Academic Measures • Sportsmanship rubric • Life skills (nutrition, physical
activity) • Occupational therapy skills • 21st century skills • Library usage (using library tools
to find resources)
Sample Measures for Building Leaders Evaluation • Percent of growth of Program-
Enrollment/Participation • Amount of time engaged with data
material online products • Anecdotal Notes • Artifacts • Attendance Data • Awards and Accomplishments • PE Attendance • Career Readiness/Success Rates
past Graduation • Building test Scores • Report Card Data • Classroom Observations Preformed • Climate Surveys • Communication of Professional
Information
• Contact Log • Discipline Data • Dual Credit Course Enrollment • Engagement with families • Extended Learning Opportunities • Graduation Rates • Increased # of research-based
instructional practices implemented
• Instructional Coach - # of times in the classroom
• Involvement in professional organizations
• # of student involved in extra-curricular activities
• Number of students who went to college
• Parent Involvement
Multiple Measures Recent Developments
• Focus Groups provided a list of
possible measures
• KSDE collaborates with REL to modify list of measures - Collected
• KSDE will identify a “default list” of measures – See Measures Chart
• KSDE will identify a “default matrix” of significant – See Examples
• KSDE Flexibility Waiver work
Multiple Measures Currently Used Examples Should Coincide
Use Multiple Measures including student growth as significant factor.
State Assessments must be used.
Other Default Measures May Include:
Student Portfolio’s
Common Assessments
MAPS
Lexile Reading Scores
Other Multiple Measures
We are looking at data that measures more than just academic preparedness, such as 21st Century Skills
Critical Thinking
Employability
Technical Skills
SBoE has previously approved the College and Career Ready definition.
Builder Leaders and District Leaders Co-Construct the Educator Evaluation Multiple Measures
District Selections – from default list or KSDE other approved measures
Validation – REL, KSDE content area specialists, or LEA able to meet valid and reliable criteria
Significant Student Growth
Determining significant
– Matrix, Other Samples
Establishing timeline for growth
– Student Growth Percentile
Significance Definition
• The change in student achievement for an individual student between two points in time, determined using multiple measures
• To include gains and progress toward post-secondary and workforce readiness
• To include progress in academic and functional goals in an individualized education program or meeting academic student growth objectives
5th Grade Curriculum Standards 5.00
4.12 4.11
4.10 4.09 4.08
4.07 4.06
4.05 4.04
4.03 4.02 4.01
4.00 Aug Sept Oct Nov Dec Jan Feb March April May
85%
85%
Assuming 85% of students exiting 4th grade accomplished 4th grade curriculum, the expectation would be at least the same amount of growth would occur by completion of the 5th grade, or on any given measure used. Example: In a class of 24 students, 20 students would be above the Grade Level Expectation line by the end of the Academic Year. 24 x .85 = 20.2 This scenario would indicate significance. Reference: Blue Print for Reform
Graduation Rates/Attendance Rates
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
High School 1 High School 2 High School 3 High School 4 High School 5 State GraduationRates
2009
2010
2011
2012
2013
16
Suggestions for Using Multiple Measures Note: Multiple Measures are only part of the Educator Evaluation
17
Evaluation Goal Selection
• District Goals
• Building Goals
• Individual Goals
• It is recommended that each Educator selects two goals per evaluation cycle:
• A district or building level goal,
• A personal goal mutually agreed upon by the Evaluator and the Evaluatee.
Multiple Measures and Significance Summary
• Teachers and Leaders evaluations include multiple measures as evidence.
• Significance refers to the need to demonstrate student growth using MORE than one measure.
• Must consider state assessments
• May include assessment measures currently in use in your district
• Significance must be pre-determined for any appropriate measure
• Districts determine credit/responsibility for student growth (This was asked of the TIK II Group)
• Time for student growth 1-4 years
Multiple Measures Summary
Inter-Rater Reliability
DEFINITION:
Reliability refers to the consistency of an assessment.
VALIDITY vs. RELIABILITY:
Factual vs. Consistent
EXPECTATION:
School district evaluators attend professional learning activities that address the issue of reliability relative to using the KEEP Rubrics.
The same expectations apply to districts using an evaluation system other than KEEP.
Evaluating the Building Leader
• Thinking through and discussing the Process - readiness per year?
• Multiple Measures selected?
• Timeline for Evaluation?
• 1 Cycle
• 2 Cycles
Building Leader Process
• May 2013 Handbook, page 32
• Required Steps
• Implementation Ideas
Building Leader Constructs
Building Leader Rubric
Repository Processes A Repository is NOT ______________________________???
ANSWER: NOT entire KEEP process.
How is a Data Repository used?
USES –
Holds DATA
Generates Reports
Access for Educator Involvement
Unified System
Organizational Tools
Building Leaders Assessment Rubric
Assessment Rubric Comments, File, Save and Print
Assessment Rubric with 1 Goal Checked and “I have completed my self assessment” checked
Assessment Rubric with Comments Box filled and Artifact Uploaded
Goals – Select Goals, Write Text for Expected Outcome, Add
Goals – After Adding, then Complete and Save, can Print
Artifacts – Select Component and Source of Evidence
Artifacts – Ready to Upload
Artifact Uploaded – in table
Cycles of Conferences - Beginning, Mid, End
Sum
mar
y R
atin
g Sh
eet
– C
on
stru
ct #
1
Summary Rating Sheet – Construct #2
Summary Rating Sheet – Construct #3
Summary Rating Sheet – Construct #4
Summary Rating Sheet – Signatures
NEW !! KEEP Guided Practice
• New Online Training
• Individualized and Repeatable
• Will include multiple forms of Learning
• Will be available from a link on the KEEP Webpage
• To be Released in July 2013
The KEEP Webpage
http://www.ksde.org/Default.aspx?tabid=4400
1. News and Announcements
2. KEEP Repository Registration
3. KEEP Training Materials and Schedule
4. Assurances Information
5. Kansas Flexibility Waiver Materials
6. Archives with Materials of Previous Trainings and Meetings
Questions ?? Contacts: Bill Bagshaw, Assistant Director Teacher Licensure & Accreditation [email protected] 785.296.2198 Kayeri Akweks, Education Program Consultant Teacher Education and Licensure [email protected] 785.296.5140