michigan department of education office of education improvement and innovation one voice – one...
TRANSCRIPT
Michigan Department of EducationOffice of Education Improvement
and InnovationOne Voice – One Plan
Michigan Continuous School Improvement (MI-CSI)
DOImplement Plan
Monitor PlanEvaluate Plan
2
Continuous School Improvement Process
DoImplement Plan
Monitor PlanEvaluate Plan
PlanDevelop School
Improvement Plan
GatherGet Ready
Collect School DataBuild School Profile
StudentAchievement
StudyAnalyze Data
Set Goals Set Measurable Objectives
Research Best Practice
3
Guided Conversations
WHY: Why is it important to strategically implement, monitor, and evaluate the School Improvement Plan?
HOW: How will we communicate the plan to all stakeholders so that they clearly understand and own their roles in implementation?
How do we build ownership of the strategy and the plan?How will we ensure implementation with fidelity?How is the implementation of your plan monitored and evaluated?How is the impact of your plan monitored and evaluated?
WHAT: What will your school look like when this plan is implemented with fidelity?
What is the expected impact on student achievement?
DO
4
Do Vocabulary
Implementation
Monitor
Evaluation
Fidelity
Impact
5
Do: Plan Requirements
ESEA and PA 25 require annual evaluation of the following:
•Implementation of the plan•Student achievement results by subgroup using data from state assessments and other indicators•Modifications to plan as needed
ISDs/RESAs are required by PA25 to provide technical assistance to schools and districts to develop annual evaluations.
6
Where are we now?
Where do we want to go and how are we going to get there?
Comprehensive Needs Assessment
School Improvement Plan
Annual Education Report
leads to
MAKING CONNECTIONS - THE BIG PICTURE
How did we do?
leads to
7
Plan
Develop School Improvement PlanDOImplement Plan
Monitor PlanEvaluate Plan
8
Continuous School Improvement Process
Get ReadyCollect Data Build Profile
School Data Profile (SDP)School Process Rubrics (SPR)
Analyze Data School Data AnalysisSchool Process Analysis
Set GoalsSet Measureable ObjectivesResearch Best PracticeDevelop School Improvement PlanImplement PlanMonitor PlanEvaluate Plan
Comprehensive Needs Assessment
School Improvement Plan
Gather
Study
Plan
Do
9
Leaders
hip
Com
pete
ncy
Org
an
izati
on
Components of Effective Implementation
Vision Mission Beliefs
Student Achievement
10
Plan, Monitor, and Evaluate A Strategy/Initiative/Program
DEVELOP ACTION PLAN - to be done prior to implementation Question 1: What is the readiness for implementing the strategy/initiative/program?Question 2: Do participants have the knowledge and skills to implement the strategy/initiative/program?Question 3: Is there opportunity for high quality implementation?
Do
Plan
Gather
Student Achievement
Study
11
Questions to Reconsider Prior to Implementation
What is the readiness for implementing the strategies and/or activities?
To what extent can stakeholders articulate and do they believe the research behind the decision to implement the strategy/activity? (Competency) KC I.2.B.2
To what extent are stakeholder (staff, parent, student) concerns about the strategy/activity identified and addressed? (Leadership) KC I.1.B.3, KC IV.1.B.3
To what extent are staff able to integrate this strategy/activity with other existing initiatives? (Competency)
12
Questions to Reconsider Prior to Implementation
Do participants have the knowledge and skills to Implement the strategy/activity?
To what extent do participants share a vision of how practice will change as a result of the strategy/activity? (Leadership) KC II.2.B.1
To what extent do administrators demonstrate the knowledge and skills to assess the effectiveness of the strategy/activity? (Leadership) KC II.1.A.1
To what extent are opportunities sufficient for staff to learn the knowledge/skills/non-negotiable elements identified as essential to the strategy/activity? (Organization/Competency) KC III.2.C.1, KC III.2.C.2; AdvancEd Indicator 3.11
To what extent is staff able to apply the acquired knowledge and skills?(Competency) KC III.2.B.2
13
Questions to Reconsider Prior to Implementation
Is there Opportunity for Implementation?
To what extent is administrative support sufficient to get the results you intend? (Organization) KC II.1.A.1-7, KC II.1.B.1-5; AdvancEd Indicator 3.4
To what extent are the financial resources and allocated time sufficient to get the results you intend? (Organization) KC II.3.A.2-4; AdvancEd Indicator 4.1
To what extent is staff collaborating to support the program? (Organization) KC III.2.A.1; AdvancEd Indicator 3.5
To what extent are structures in place to collect and review formative implementation data? (Organization) KC II.1.A.2, KC V.1.A.4; AdvancEd Indicator 3.2, 5.1
14
Ultimately…..
To what extent are stakeholders committed with both hearts and minds to the strategy/activity/non-negotiable elements? KC I.2.B.2, KC II.2.B.3
15
Implementation is a Process!
Monitor Implementation Evaluate Implementation
Monitor Impact Evaluate Impact
Adult Focused
Student Focused
16
MONITOR ADULT IMPLEMENTATION AND IMPACT ON STUDENT ACHIEVEMENT
(Formative)
IS IT WORKING?
EVALUATE ADULT IMPLEMENTATION AND
IMPACT ON STUDENT ACHIEVEMENT
(Summative)
DID IT WORK?
ARE STRATEGIES AND ACTIVITIES BEING IMPLEMENTED AS INTENDED WITH
FIDELITY?
ARE WE COLLECTING & USING STUDENT AND
ADULT DATA TO MODIFY & ADJUST
ONGOING IMPLEMENTATION?
WAS THE PROGRAM IMPLEMENTED AS
INTENDED?
DID WE IMPLEMENT THE PLAN/STRATEGIES
CORRECTLY & CONSISTENTLY?
DID WE GIVE IT ENOUGH TIME? RESOURCES?
IS WHAT WE ARE DOING WORKING?
ARE WE SHOWING EVIDENCE OF STUDENT
GROWTH?
WHAT INTERIM ADJUSTMENTS ARE
SUGGESTED BY IMPLEMENTATION
DATA?
HOW MIGHT THESE ADJUSTMENTS AFFECT THE INTEGRITY OF THE
RESULTS?
Implementation: Adult Focused Impact: Student Focused
MONITOR EVALUATE EVALUATEMONITOR
DID OUR STRATEGIES RESULT IN INCREASED
STUDENT ACHIEVEMENT?
WHAT UNINTENDED CONSEQUENCES
(GOOD AND BAD) HAVE OCCURRED?
SHOULD THE STRATEGY/ACTIVITY BE CONTINUED? DISCONTINUED?
MODIFIED?
17
Plan
Develop School Improvement PlanDOImplement Plan
Monitor PlanEvaluate Plan
18
Continuous School Improvement Process
Get ReadyCollect Data Build Profile
School Data Profile (SDP)School Process Rubrics (SPR)
Analyze Data School Data AnalysisSchool Process Analysis
Set GoalsSet Measureable ObjectivesResearch Best PracticeDevelop School Improvement PlanImplement PlanMonitor PlanEvaluate Plan
Comprehensive Needs Assessment
School Improvement Plan
Gather
Study
Plan
Do
19
Implementation is a Process!
MonitorMonitor Implementation Evaluate Implementation
MonitorMonitor Impact Evaluate Impact
Adult Focused
Student Focused
20
Leadership and Learning Center 2010
21
Plan, Monitor, and Evaluate A Strategy/Initiative/Program
MONITOR - to be used on an on-going basis during implementation
Question 4: Is the strategy/initiative/program implemented as intended?
Question 5: What is the impact on students?
Do
Plan
Gather
Student Achievement
Study
22
MONITOR ADULT IMPLEMENTATION AND IMPACT ON STUDENT ACHIEVEMENT
(Formative)
IS IT WORKING?
ARE STRATEGIES AND ACTIVITIES BEING IMPLEMENTED AS INTENDED WITH
FIDELITY?
ARE WE COLLECTING & USING STUDENT AND
ADULT DATA TO MODIFY & ADJUST
ONGOING IMPLEMENTATION?
IS WHAT WE ARE DOING WORKING?
ARE WE SHOWING EVIDENCE OF STUDENT
GROWTH?
WHAT INTERIM ADJUSTMENTS ARE
SUGGESTED BY IMPLEMENTATION
DATA? HOW MIGHT THESE ADJUSTMENTS
AFFECT THE INTEGRITY OF THE RESULTS?
Implementation: Adult Focused Impact: Student Focused
MONITOR EVALUATE EVALUATEMONITOR
23
ActivitiesConnection to SPR
40/90, SA/ASSIST SA*Getting Ready to
ImplementImplement Monitoring Fidelity of
Implementation and Impact
How will you address the targeted areas in your Process Data (SPP)?
What areas in your process data have been identified as challenge areas during your comprehensive needs assessment process?
How will you ensure readiness for implementation?How will you ensure that participants have the knowledge and skills to implement?
POSSIBLE ACTIVITIESProfessional development around strategy Purchase materials Planning for implementation – Identify schedule for strategy use, personnel, mechanism for monitoring, rollout, etc.Communication vehicles
How will you ensure successful implementation for your selected activities?
POSSIBLE ACTIVITIESCommunication – to whom? How?Ongoing coaching?Observations?Instructional technology utilized? *Activities to support at-risk students (For Title One students)*•Parent Involvement *
*Required Components
How will you ensure the program/activity is implemented with fidelity?How will you monitor the programs impact on student achievement?
POSSIBLE ACTIVITIESWalkthroughsPLC/CASL meetingsDocumentation of effective implementationDocumentation of impactDemonstration classrooms, videos, self assessmentsGathering achievement data
24
MonitoringMonitoring Implementation and Impact
Are you meeting on a regular basis to monitor implementation of your plan?
What does the data say when you monitored implementation?
•What evidence have you collected to determine if adults are implementing with fidelity?•What evidence have you collected to determine the impact of implementation?
What adjustments are suggested by implementation and impact data? How might these adjustments affect the integrity of results?
How will you communicate progress with stakeholders?
25
26
Checking for Understanding
What are your questions about monitoringmonitoring
implementation and impact?
27
Plan
Develop School Improvement PlanDOImplement Plan
Monitor PlanEvaluate Plan
28
Continuous School Improvement Process
Get ReadyCollect Data Build Profile
School Data Profile (SDP)School Process Rubrics (SPR)
Analyze Data School Data AnalysisSchool Process Analysis
Set GoalsSet Measureable ObjectivesResearch Best PracticeDevelop School Improvement PlanImplement PlanMonitor PlanEvaluate Plan
Comprehensive Needs Assessment
School Improvement Plan
Gather
Study
Plan
Do
29
Implementation is a Process!
Monitor Implementation Evaluate Implementation
Monitor Impact Evaluate Impact
Adult Focused
Student Focused
30
Plan, Monitor, and EvaluatePlan, Monitor, and Evaluate A Strategy/Initiative/ProgramA Strategy/Initiative/Program
EVALUATE – to be used at the end of an implementation cycle
Question 5: What was the strategy/initiative/program’s impact on students?If objectives were met: Conclusion: Should the strategy/initiative/program be continued or institutionalized?
If objectives were not met: Question 1: What was the readiness for implementing the strategy/initiative/program?Question 2: Did participants have the knowledge and skills to implement the plan?Question 3: Was there opportunity for high quality implementation?Question 4: Was the strategy/initiative/program implemented as intended?Conclusion: Should the strategy/initiative/program be adjusted or discontinued?
Do
Plan
Gather
Student Achievement Study
31
MONITOR ADULT IMPLEMENTATION AND IMPACT ON STUDENT ACHIEVEMENT
(Formative)
IS IT WORKING?
EVALUATE ADULT IMPLEMENTATION AND
IMPACT ON STUDENT ACHIEVEMENT
(Summative)
DID IT WORK?
ARE STRATEGIES AND ACTIVITIES BEING IMPLEMENTED AS INTENDED WITH
FIDELITY?
ARE WE COLLECTING & USING STUDENT AND
ADULT DATA TO MODIFY & ADJUST
ONGOING IMPLEMENTATION?
WAS THE PROGRAM IMPLEMENTED AS
INTENDED?
DID WE IMPLEMENTTHE PLAN/STRATEGIES
CORRECTLY & CONSISTENTLY?
DID WE GIVE IT ENOUGH TIME? RESOURCES?
IS WHAT WE ARE DOING WORKING?
ARE WE SHOWING EVIDENCE OF STUDENT
GROWTH?
WHAT INTERIM ADJUSTMENTS ARE
SUGGESTED BY IMPLEMENTATION
DATA?
HOW MIGHT THESE ADJUSTMENTS AFFECT THE INTEGRITY OF THE
RESULTS?
Implementation: Adult Focused Impact: Student Focused
MONITOR EVALUATE EVALUATEMONITOR
DID OUR STRATEGIES RESULT IN INCREASED
STUDENT ACHIEVEMENT?
WHAT UNINTENDED CONSEQUENCES (GOOD
AND BAD) HAVE OCCURRED?
SHOULD THE STRATEGY/ACTIVITY BE
CONTINUED? DISCONTINUED?
MODIFIED?
32
IMPLEMENTATION
What evidence do you have that the strategy/activities were implemented with fidelity? KC II.2.B.4; AdvancED Indicator 3.6
What evidence do you have that implementation adhered to strategies, timelines, and responsibilities? KC II.2.B.4: AdvancED Indicator 3.6
IMPACT
What impact has the strategy/activity had on students and what is your evidence? KC I.3.B.3; AdvancED Indicators 3.2, 5.2
What impact has the strategy/activity had on your subgroups and what is the evidence? KC I.3.B.3; AdvancED Indicators 3.2, 5.2
Evaluating Implementation and Impact
33
34
Evaluate Plan
The process is cyclical, and evaluation data should inform the next cycle of planning.
The ultimate goal is to have improvement strategies take hold and become so internalized that they become part of the school culture.
35
Evaluate Plan - Conclusion
Given your evidence, what adjustments are needed to your School Improvement Plan, if any?
•What do we continue to do?•What do we stop doing?•What do we need to “tweak”?
36
Evaluate Plan - Digging Deeper
• To what extent was this the right strategy/activity to address your need?
• What is needed to maintain momentum and accelerate achievement gains?
• Are the benefits of the strategy/activity sufficient to justify the resources it requires?
• How might these results inform the School Improvement Plan?
37
• It is also critical that the School Improvement Team structure opportunities to celebrate successes, no matter how small.
• Celebrating successes reinforces valued performance and reminds the school community that however challenging, school improvement results in improved academic performance.
One Voice – One Plan
38
Checking for Understanding
What are your questions about evaluatingevaluating implementation and
impact?
39
One Voice – One Plan
• However noble, sophisticated, or enlightened proposals for changechange and improvementimprovement might be, they come to nothing if teachers don’t adopt them in their own classrooms and if they don’t translate them into effective classroom practiceseffective classroom practices..
40
Continuous School Improvement Process
DoImplement Plan
Monitor PlanEvaluate Plan
PlanDevelop School
Improvement Plan
GatherGet Ready
Collect School DataBuild School Profile
StudentAchievement
StudyAnalyze Data
Set Goals Set Measurable Objectives
Research Best Practice
41
Do Vocabulary
Implementation
Monitor
Evaluation
Fidelity
Impact
42
Guided Conversations
WHY: Why is it important to strategically implement, monitor, and evaluate the School Improvement Plan?
HOW: How will we communicate the plan to all stakeholders so that they clearly understand and own their roles in implementation?
How do we build ownership of the strategy and the plan?How will we ensure implementation with fidelity?How is the implementation of your plan monitored and evaluated?How is the impact of your plan monitored and evaluated?
WHAT: What will your school look like when this plan is implemented with fidelity?
What is the expected impact on student achievement?
DO
43
Questions/Comments?Please contact:
Renie Araoz ([email protected]) Diane Fleming ([email protected]) Diane Joslin-Gould ([email protected])
Or visit the MDE - School Improvement website
44
Renie Araoz – MDE/AdvancED MichiganDeb Asano - Marquette-Alger RESALisa Bannon - Wexford-Missaukee ISDBen Boerkoel - Kent ISDJudy Bonne - Wayne RESALeah Breen - MDEElizabeth Brophy - Calhoun ISDBetty Burke-Coduti - Marquette-Alger ISD (Retired)Henry Cade - MDEMark Coscarella - MDEPatti Dobias - MAISA Sharon Dodson - Kalamazoo RESADeb Dunbar - Bay-Arenac ISDScott Felkey - Oakland SchoolsDiane Fleming - MDELinda Forward - MDEGayle Greene - Macomb ISD (Retired)Lisa Guzzardo Asaro - Macomb ISDDonna Hamilton - MDECarrie Haubenstricker - Tuscola ISD
These training materials and resources were developed in collaboration with the following individuals and organizations. We deeply appreciate their time and support.
Robert Higgins - MDEFiona Hinds - AdvancED MichiganDiane Joslin-Gould - MDELinda Kent - MDEScott Koziol - Michigan Center Public Schools Teresita Long - MDEMargaret Madigan - MDEYvonne Mayfield-MDEKathleen Miller - Shiawassee RESDAl Monetta - AdvancED Michigan (Retired)Cheryl Oczepek - MDECarolyn Rakotz - Wayne RESADodie Raycraft - St Joseph County ISDKaren Ruple – MDEJennifer Sabsook - Charlevoix-Emmet ISDKathy Sergeant - AdvancED Michigan ConsultantsBeth SteenwyckBetty UnderwoodJan Urban-Lurain