introduction to improvement science: a learning-by-doing...
TRANSCRIPT
![Page 1: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/1.jpg)
Introduction to Improvement Science: A Learning-By-Doing Simulation
Sessions A1 & B1
Wednesday, April 4, 2018
@CarnegieFdn #CarnegieSummit
![Page 2: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/2.jpg)
Session Overview
2
Objectives: ▪ Understand on a basic level
what it feels like to apply improvement science techniques to solving educational problems
▪ Reflect on the skills and capacities required to do improvement work in educational contexts
Agenda:
1. Introduction
2. Mini-Lessons + Simulation Short break included
3. Reflection
![Page 3: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/3.jpg)
3
Session Overview
Agenda:
1. Introduction
2. Mini-Lessons + Simulation Short break included
3. Reflection
![Page 4: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/4.jpg)
Teaching Team
4
Brandon Bennett Principal Advisor, Improvement
Science Consulting Fellow, Improvement Science
Manuelito Biag Associate, Networked Improvement Science
Patrice Dawkins-Jackson Networked Improvement
Science Fellow
Anna Kawar Co-Founder & Chief
Growth Officer, Leading Through Connection
Amanda Meyer Director of Improvement,
Core Districts
Barbara Shreve Networked Improvement
Science Fellow
Ke Wu Associate, Networked Improvement Science
![Page 5: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/5.jpg)
5
Improvement Science
A formal approach to the analysis of performance & systematic efforts to improve it.
“Quality Improvement”
Management Theory
Skills and Tools
Habits of Mind
Dissatisfaction with the Status Quo
![Page 6: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/6.jpg)
The Carnegie Foundation
+ IMPROVEMENT SCIENCE
NETWORKED COMMUNITIES
Support the education field to get better at getting better
Why?
What?
Networked Improvement Communities (NICs)
6
![Page 7: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/7.jpg)
7
SIMULATION LAUNCH: Your Context
![Page 8: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/8.jpg)
8
District – 5 high schools – 4 middle schools – 4 elementary schools
![Page 9: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/9.jpg)
9
Your School: High School
550 students
School Demographics: Race/Ethnicity:
56% White 25% Hispanic 12% Asian 4% Black 3% Other
Socioeconomic Status: 23% Free & Reduced Price Lunch
The Year: Fall 2011
![Page 10: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/10.jpg)
10
Students seem to be ABSENT a lot
The ABSENCES disrupt the class
It seems to be worse lately
You (the administrative team)… decide to look into it.
Dissatisfaction with the Status Quo
![Page 11: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/11.jpg)
11
This is the first graph you create…
90.00%91.00%92.00%93.00%94.00%95.00%96.00%97.00%98.00%99.00%
100.00%
2009-2010 2010-2011
Average Daily Attendance (over the year)
Our Schools
HS average
![Page 12: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/12.jpg)
12
![Page 13: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/13.jpg)
13
(0) UNDERSTAND: Walk through the data (1) DESCRIBE: What do you notice? (2) INTERPRET: What hypotheses or explanations
do you have about what you see? What are alternative hypotheses?
(3) ACT: What will you do next?
Data Conversation Protocol Making meaning of data together
![Page 14: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/14.jpg)
Teams of 4-5
Identify the documents manager
Distribute new data display
14
![Page 15: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/15.jpg)
15
05
101520253035404550
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35+
Num
ber o
f stu
dent
s
Number of absences during the 2010-2011 school year
Number of Students by Absence (2010-2011 School Year)
(0) UNDERSTAND (1) DESCRIBE (2) INTERPRET (3) ACT
![Page 16: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/16.jpg)
16
05
101520253035404550
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35+
Num
ber o
f stu
dent
s
Number of absences during the 2010-2011 school year
Number of Students by Absence (2010-2011 School Year)
“Chronically Absent”= Misses more than 10%
16% 88 Students
![Page 17: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/17.jpg)
The Problem
Problem Statement: 88 students (16%) were chronically absent last year!
17
You decide to launch an improvement project focused on reducing chronic absenteeism
![Page 18: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/18.jpg)
Your Improvement Team
Your improvement team is composed of the following 4-5 members: – Principal – Dean of Students – Attendance Office Manager – 1-2 Teachers Your team has training and experience in improvement science.
18
![Page 19: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/19.jpg)
Your Improvement Team
19
INSTRUCTIONS:
1. Grab a label & put it on
2. Introduce yourself to your team: Your name & Simulation Role
Your improvement team is composed of the following 4-5 members: – Principal – Dean of Students – Attendance Office Manager – 1-2 Teachers Your team has training and experience in improvement science.
![Page 20: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/20.jpg)
20
![Page 21: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/21.jpg)
Spread and Scale
Understand the Problem and the
System that Produces It
Test and Build Evidence
Generate Ideas for Change
Focus Collective Efforts
Improvement Science Cheat Sheet
21
![Page 22: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/22.jpg)
Spread and Scale
Understand the Problem and the
System that Produces It
Test and Build Evidence
Generate ideas for change
Focus collective efforts
Improvement Science Cheat Sheet
22
An interdependent set of interactions among people, the tools, and materials they have at their disposal, and the processes through which they all join together to accomplish work.
![Page 23: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/23.jpg)
23
Aspirations
Current performance
Gap
Why are we getting the outcomes
we are currently getting?
Let’s go investigate.
![Page 24: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/24.jpg)
24
We can continue to turn the data…
…but we also must become
system detectives!
![Page 25: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/25.jpg)
25
![Page 26: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/26.jpg)
26
Divide up the work
Investigating a Problem as a Team
![Page 27: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/27.jpg)
27
Consolidate insights!
Learning as a Team
![Page 28: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/28.jpg)
1. How do users experience our problem?
28
Conduct an empathy interview focused on finding out as much as possible about a student’s experience. We want to understand emotions, thoughts, and needs.
Team Member Responsible:
DEAN OF STUDENTS
![Page 29: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/29.jpg)
2. What is our current practice?
29
Create a visual representation of the way work is currently done using a process map. Annotate the map with the major issues or barriers that arise in the work.
Team Member Responsible:
ATTENDANCE OFFICE MANAGER
![Page 30: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/30.jpg)
3. What are the most common reasons for our problem?
30
Collect and analyze data about the problem to identify key causes.
Team Member Responsible:
TEACHERS
![Page 31: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/31.jpg)
4. What does research & practice knowledge have to say about our problem?
31
Scan research and other relevant literature to find information about the problem or how it may be solved.
Team Member Responsible:
PRINCIPAL
![Page 32: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/32.jpg)
Strategies for Investigating the Problem
32
TEAM MEMBER WE WANT TO UNDERSTAND
Dean of Students The problem from the user’s perspective
Attendance Office Manager
Our current practice, by creating a shared picture of ”what is”
Teachers The types and frequency of causes
Principal What is research and practice knowledge say about our problem of interest
![Page 33: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/33.jpg)
SIMULATION: Investigating the Problem
1. Grab the packet for your assigned role.
2. Complete the problem investigation activity inside.
3. Identify your top 1-2 insights about the problem & write them on sticky notes. (1 per sticky note)
Time: 10 minutes
33
![Page 34: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/34.jpg)
SIMULATION: Learning Consolidation
34
Task: Run the Affinity Protocol Facilitator: Dean of Students
Affinity Protocol: 1. 1-by-1 Share: What did you learn about the problem of
chronic absenteeism AND where did it come from? [Read post-it aloud and stick on the 11x17 paper]
1. Cluster: After everyone has gone, move post-its into
clusters based on similar themes (if any). 1. Insights: Discuss and record major learning from looking
across the insights.
![Page 35: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/35.jpg)
35
![Page 36: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/36.jpg)
This work is messy!
36
![Page 37: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/37.jpg)
Spread and Scale
Understand the Problem and the
System that Produces It
Test and Build Evidence
Generate Ideas for Change
Focus Collective Efforts
Improvement Science Cheat Sheet
37
![Page 38: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/38.jpg)
Spread and Scale
Understand the Problem and the
System that Produces It
Test and Build Evidence
Generate Ideas for Change
Focus Collective Efforts
Improvement Science Cheat Sheet
38
![Page 39: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/39.jpg)
Examples of Improvement Aims
39
A. By June 2018, decrease the yearly number of our students who are chronically absent from 88 to 50.
B. By June 2018, decrease from 20% to 10% the percentage of 9th grade students who miss school more than 5 days per year due to health reasons.
![Page 40: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/40.jpg)
Tool: Aim Statement
40
What will be improved? (clear operational definitions)
How much? (measureable, specific, numerical goals)
By when? (time frame)
For what/whom? (target population/setting or system/process)
What specifically are we trying to
accomplish?
![Page 41: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/41.jpg)
41
Met with different
stakeholder groups
Investigated the problem
carefully and in a variety of
ways
Identified the target population
Determined priority areas
Identified resources and assets
![Page 42: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/42.jpg)
By June 2014, we will reduce chronic absenteeism at our school from 16% to 8%.
Our Simulation Aim
42
What specifically are we trying to
accomplish?
![Page 43: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/43.jpg)
Spread and Scale
Understand the Problem and the
System that Produces It
Test and Build Evidence
Generate Ideas for Change
Focus Collective Efforts
Improvement Science Cheat Sheet
43
AIM
![Page 44: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/44.jpg)
Spread and Scale
Understand the Problem and the
System that Produces it
Test and Build Evidence
Generate ideas for change
Focus collective efforts
Probably wrong, definitely incomplete
Improvement Science Cheat Sheet
44
![Page 45: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/45.jpg)
Change Ideas
45
By June 2014, we will reduce chronic absenteeism at our school from 16% to 8%.
What specifically are we trying to
accomplish?
What changes might we make
and why?
![Page 46: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/46.jpg)
Change Ideas
46
What changes might we make
and why?
By June 2014, we will reduce chronic absenteeism at our school from 16% to 8%.
What specifically are we trying to
accomplish?
![Page 47: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/47.jpg)
Specific work practices or interventions that represent an alteration to how work is currently done.
What is a “Change Idea”?
47
By June 2014, we will reduce chronic absenteeism at our school from 16% to 8%.
What specifically are we trying to
accomplish?
What changes might we make
and why?
![Page 48: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/48.jpg)
Where Do Change Ideas Come From?
48
1. Research knowledge: What does academic literature have to say about solving this problem?
2. Practice knowledge: What have other organizations in the field done to solve this problem?
3. Design/Creative Thinking: What new solutions might we design to address this problem?
4. Analysis of the problem: What does our analysis of the problem indicate may be a helpful solution?
![Page 49: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/49.jpg)
Where Do Change Ideas Come From?
49
1. Research knowledge: What does academic literature have to say about solving this problem?
2. Practice knowledge: What have other organizations in the field done to solve this problem?
3. Design/Creative Thinking: What new solutions might we design to address this problem?
4. Analysis of the problem: What does our analysis of the problem indicate may be a helpful solution?
![Page 50: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/50.jpg)
SIMULATION: Develop Changes
50
PART I: Individually Refer back to your baseline performance and your problem analysis.
Generate at least one specific change you might make in your school that you have reason to believe would contribute towards reaching your aim.
Task: Develop change idea(s) Facilitator: Principal
![Page 51: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/51.jpg)
51
![Page 52: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/52.jpg)
AIM
What specifically are we trying to accomplish?
What changes might we introduce?
Change Idea Change Idea
Change Idea
Change Idea
Change Idea
Change Idea Change Idea
Change Idea
![Page 53: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/53.jpg)
53
AIM
What specifically are we trying to accomplish?
What changes might we introduce?
Change Idea Change Idea
Change Idea
Change Idea
Change Idea
Change Idea Change Idea
Change Idea
Theory of Practice Improvement
Driver
Driver
Driver
Key leverage points in the system
![Page 54: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/54.jpg)
54
AIM
Driver
If I do… …that will impact… …which in turn will…
Key leverage point in the system
![Page 55: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/55.jpg)
55
Convened experts
Analyzed data
Reviewed research literature
Examined variations
Created system maps
Identified high-leverage
areas
![Page 56: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/56.jpg)
By June 2014, we will reduce chronic absenteeism at our school from 16% to 8%.
Parent Awareness & Engagement
Drivers
Students’ Basic Needs
Attendance Data Tracking & Use Weekly attendance data review for detecting students on path to
chronic absence
Family meeting protocol for discussing and addressing chronic absences
Send home handouts at start of year with information and tips about attendance
Change Ideas
Aim
Theory of Improvement
Version 1.0
Provide transportation vouchers
Assign adult mentor to check-in regularly with student
In-School Relationships
If we [change idea] , that will impact [driver/key leverage point] , which in turn will lead to [aim] .
![Page 57: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/57.jpg)
SIMULATION: Develop Changes
57
PART II: As a team Refer to your first draft of a theory of improvement for improving chronic absenteeism. Select one of the change ideas that you generated and articulate it as a hypothesis on your driver diagram.
Go around and share your hypotheses with your team.
If we [change idea] , that will impact [driver] , which in turn will lead to [aim] .
Task: Develop change idea(s) Facilitator: Principal
![Page 58: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/58.jpg)
By June 2014, we will reduce chronic absenteeism at our school from 16% to 8%.
Parent Awareness & Engagement
Drivers
Students’ Basic Needs
Attendance Data Tracking & Use Weekly attendance data review for detecting students on path to
chronic absence
Family meeting protocol for discussing and addressing chronic absences
Send home handouts at start of year with information and tips about attendance
Change Ideas
Aim
Theory of Improvement
Version 1.0
Provide transportation vouchers
Assign adult mentor to check-in regularly with student
In-School Relationships
![Page 59: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/59.jpg)
Possibly wrong, definitely incomplete…
![Page 60: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/60.jpg)
AIM
• Change
AIM
• Change
• Change
Version 1.0
![Page 61: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/61.jpg)
AIM
• Change
AIM
• Change
• Change
• Change • Change • Change
Version 2.0
![Page 62: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/62.jpg)
AIM
• Change
AIM
• Change
• Change
• Change • Change • Change
• Change • Change • Change
Version 3.0
![Page 63: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/63.jpg)
AIM
• Change • Change
AIM
• Change • Change • Change
• Change • Change • Change
• Change • Change
Version 4.0
![Page 64: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/64.jpg)
AIM
• Change • Change
AIM
• Change • Change • Change
• Change • Change
• Change • Change • Change
Version 5.0
![Page 65: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/65.jpg)
65
Team consensus on a shared aim
Identified measures and documentation of
progress, as well as measures for improvement
Identified system elements (the
what and where)
Brainstorm change ideas
Theorized cause-and-
effect relationships
![Page 66: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/66.jpg)
By June 2014, we will reduce chronic absenteeism at our school from 16% to 8%.
Parent Awareness & Engagement
Drivers
Students’ Basic Needs
Attendance Data Tracking & Use Weekly attendance data review for detecting students on path to
chronic absence
Family meeting protocol for discussing and addressing chronic absences
Send home handouts at start of year with information and tips about attendance
Change Ideas
Aim
Theory of Improvement
Version 1.0
Provide transportation vouchers
Assign adult mentor to check-in regularly with student
In-School Relationships
![Page 67: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/67.jpg)
SIMULATION: Your change idea!
67
Family Meeting Protocol
Use to structure the meeting held with absent students and their families.
Inspired by School Attendance Review Board (SARB) meeting process AND your best knowledge of parent conversations
![Page 68: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/68.jpg)
Family Meeting Protocol
v. 1
Welcome and thank parent & student for coming
Explain the purpose of the meeting: Student has been absent X times
Ask why the student has been absent
Explain the importance of attendance in high school
Explain consequences of additional absences
Ask if the student or parent have any questions or concerns
Plus/Deltas
![Page 69: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/69.jpg)
SIMULATION: An opportunity to test
69
You have a parent meeting scheduled for today with a
student who has been absent quite a bit lately.
Your team decides this would be a great opportunity to test out
your new protocol…
![Page 70: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/70.jpg)
Spread and Scale
Understand the Problem and the
System that Produces it
Test and Build Evidence
Generate ideas for change
Focus collective efforts
Improvement Science Cheat Sheet
70
![Page 71: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/71.jpg)
Spread and Scale
Understand the Problem and the
System that Produces it
Test and Build Evidence
Generate ideas for change
Focus collective efforts
Improvement Science Cheat Sheet
71
![Page 72: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/72.jpg)
The Plan-Do-Study-Act (PDSA) Cycle
PLAN • What’s your change? • What’s your prediction?
• Plan to conduct test
DO • Execute test • Collect data, document observations
STUDY • Compare results
to prediction • What did you
learn?
ACT • Next steps: Adapt, adopt, abandon
@2009 API
@2009 API
![Page 73: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/73.jpg)
@2009 API
PLAN • What’s your change? • What’s your prediction?
• Plan to conduct test
DO • Execute test • Collect data, document observations
STUDY • Compare results
to prediction • What did you
learn?
ACT • Next steps: Adapt, adopt, abandon
Making your theories,
assumptions and hypotheses
explicit
Revealing gaps in our
understanding
The Plan-Do-Study-Act (PDSA) Cycle
![Page 74: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/74.jpg)
SIMULATION: Run your first PDSA
74
PLAN
1. Read the family meeting protocol
2. Review the Plan section of your PDSA form
3. Generate predictions for each of the items in the Plan Section.
What do you think will happen when you test this protocol in a family meeting?
PLAN • What’s your change? • What’s your prediction?
• Plan to conduct test
Task: Complete an entire PDSA cycle Facilitator: Attendance Office Manager
![Page 75: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/75.jpg)
75
Debrief
What are some differences we notice in our aims?
![Page 76: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/76.jpg)
SIMULATION: Run the test
76
DO 1. Watch the family meeting unfold
2. Record observations in the “Do” section of your form
DO • Execute test • Collect data, document observations
Observe from the perspective of your “role”!
![Page 77: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/77.jpg)
SIMULATION: Study the results
77
STUDY 1. Collaboratively review your
observations from the “Do” section
2. Record the results relevant to each prediction you made
3. Summarize your team’s major learnings from the test
STUDY • Compare results
to prediction • What did you
learn?
![Page 78: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/78.jpg)
![Page 79: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/79.jpg)
SIMULATION: Decide how to act
79
ACT Based on what you learned, decide what you plan to do next with this change idea:
ADOPT – Make this change a permanent part of our practice ADAPT – Revise this change and test it again ABANDON – Discard this idea entirely
ACT • Next steps: Adapt, adopt, abandon
![Page 80: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/80.jpg)
Family Meeting Protocol
V. 6 Welcome and thank parent and student for coming
Review attendance record with family & explain how to interpret report
Review social & academic consequences of absenteeism
Discuss possible interventions school may undertake to support student
Answer any additional questions & review next steps
Thank parent again and adjourn the meeting
![Page 81: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/81.jpg)
Spread and Scale
Understand the Problem and the
System that Produces it
Test and Build Evidence
Generate ideas for change
Focus collective efforts
Improvement Science Cheat Sheet
82
![Page 82: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/82.jpg)
Spread and Scale
Understand the Problem and the
System that Produces it
Test and Build Evidence
Generate ideas for change
Focus collective efforts
Improvement Science Cheat Sheet
P D
S A
P D
S A
![Page 83: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/83.jpg)
Spread and Scale
Understand the Problem and the
System that Produces it
Test and Build Evidence
Generate ideas for change
Focus collective efforts
Improvement Science Cheat Sheet
P D
S A
P D
S A
Evidence in Improvement Science
![Page 84: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/84.jpg)
Building Evidence for a Change
85
Initial Hunches &
Ideas
Changes that produce quality
with reliability at scale A P
S D
A P S D
Very Small Scale Tests
Follow-up Tests
Wide-Scale Tests of Change
Implementation of Changes
How will we know this change is actually an
improvement?
![Page 85: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/85.jpg)
Managing multiple ramps of PDSAs
Adapted from @2009 API
Reduced Chronic Absenteeism
Change Idea
Change Idea
Change Idea
Change Idea
Supportive Family
Meeting
![Page 86: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/86.jpg)
87
What’s are the “End” Goals?
Measureable improvement
Specified changes that led to the improvement
Improvement capacity to apply to future work
![Page 87: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/87.jpg)
88
Chronic Absenteeism Bundle
Note: primary strategy is engaging coursework
10 absences = supportive family conversation
5 absences = letter home
Regular routine for reviewing attendance data
![Page 88: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/88.jpg)
Participants’ Will
Resistant Indifference Ready
LOW confidence
that the change will lead to an
improvement
Cost of failure large
Very Small Scale
Very Small Scale
Very Small Scale
Cost of failure small
Small Scale Test
Small Scale Test
Moderate Scale Test
HIGH confidence
that the change will lead to an
improvement
Cost of failure large
Small Scale Test
Moderate Scale Test
Large Scale Test
Cost of failure small
Moderate Scale Test
Large Scale Test
System-wide Implementation!
Key Dimensions to Consider When Testing
89
Adapted from API, 2009
![Page 89: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/89.jpg)
Participants’ Will
Resistant Indifference Ready
LOW confidence
that the change will lead to an
improvement
Cost of failure large
Very Small Scale
Very Small Scale
Very Small Scale
Cost of failure small
Small Scale Test
Small Scale Test
Moderate Scale Test
HIGH confidence
that the change will lead to an
improvement
Cost of failure large
Small Scale Test
Moderate Scale Test
Large Scale Test
Cost of failure small
Moderate Scale Test
Large Scale Test
System-wide Implementation!
Key Dimensions to Consider When Testing
90
Adapted from API, 2009
![Page 90: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/90.jpg)
Participants’ Will
Resistant Indifference Ready
LOW confidence
that the change will lead to an
improvement
Cost of failure large
Very Small Scale
Very Small Scale
Very Small Scale
Cost of failure small
Small Scale Test
Small Scale Test
Moderate Scale Test
HIGH confidence
that the change will lead to an
improvement
Cost of failure large
Small Scale Test
Moderate Scale Test
Large Scale Test
Cost of failure small
Moderate Scale Test
Large Scale Test
System-wide Implementation!
Key Dimensions to Consider When Testing
91
Adapted from API, 2009
![Page 91: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/91.jpg)
Participants’ Will
Resistant Indifference Ready
LOW confidence
that the change will lead to an
improvement
Cost of failure large
Very Small Scale
Very Small Scale
Very Small Scale
Cost of failure small
Small Scale Test
Small Scale Test
Moderate Scale Test
HIGH confidence
that the change will lead to an
improvement
Cost of failure large
Small Scale Test
Moderate Scale Test
Large Scale Test
Cost of failure small
Moderate Scale Test
Large Scale Test
System-wide Implementation!
Adapted from API, 2009
Key Dimensions to Consider When Testing
92
![Page 92: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/92.jpg)
SIMULATION: Assessing your confidence in the change bundle
LOW confidence
HIGH confidence
SOME confidence
Right now, how confident are you in the
change bundle? 93
Should we IMPLEMENT the
chronic absenteeism bundle in our school?
![Page 93: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/93.jpg)
Your team has generated the following data display. Use this display to assess your level of confidence in the change bundle.
1. Individual Task: Rate your confidence on the scale
2. Team Discussion: (The 2nd teacher facilitates) – Why did you rate it where you did? – What could you do to increase your confidence in the bundle?
94
SIMULATION: Assessing your confidence in the change bundle
![Page 94: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/94.jpg)
95
Low confidence
High Confidence
Some Confidence
STARTS BUNDLE
0.00
2.00
4.00
6.00
8.00
10.00
12.00
14.00
16.00
18.00
20.00
2010 2011 2012 2013 2014 2015
% o
f Stu
dent
s Abs
ent 1
0% o
r mor
e
High School #1: Our School
![Page 95: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/95.jpg)
96
![Page 96: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/96.jpg)
SIMULATION: Assessing your confidence in the change bundle:
Now you are the leaders of the whole network.
Based on these new data, are you ready to implement the change bundle network-wide?
1. Individual Task: Rate your confidence on the scale
2. Team Discussion: (The 2nd teacher facilitates) – Why did you rate it where you did? – What would you do next?
97
![Page 97: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/97.jpg)
98
High School #1 (Our School) High School #2
Middle School #1
Low confidence
High Confidence
Some Confidence
![Page 98: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/98.jpg)
![Page 99: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/99.jpg)
Theory of improvement
Increase the 4yr college
going rate from 66.1% (2012) to
90% by June 2017
Primary Drivers Changes
Pathway to College
Chronic Absenteeism Bundle
Family Engagement
Academic Preparation &
Eligibility
Learning mindsets and
skills to succeed post graduation
Personal statements as junior English assignment
FAFSA completion workshops
Equitable group work
Conferences with students that miss 2 HW assignments in a row
Support groups for men of color
Aim
100
![Page 100: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/100.jpg)
101
![Page 101: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/101.jpg)
Spread and Scale
Understand the Problem and the
System that Produces it
Test and Build Evidence
Generate Ideas for Change
Focus Collective Efforts
Improvement Science Cheat Sheet
102
P D
S A
AIM Step Step Step Step Step
Problem
![Page 102: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/102.jpg)
Reflections & Closing Remarks
![Page 103: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/103.jpg)
Improvement Science
Social learning
Nonlinear
Systems-focused
Disciplined
![Page 104: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/104.jpg)
105
Building Your Improvement Toolkit
Data Conversation Protocol
Empathy Interview
Scanning
Process Map Analysis
Cause Analysis
Affinity Protocol
Aim Statement
PDSA Cycle
Chart of Data Over Time
Driver Diagram
![Page 105: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/105.jpg)
Spread and Scale
Understand the Problem and the
System that Produces it
Test and Build Evidence
Generate ideas for change
Focus collective efforts
Improvement Science Cheat Sheet
P D
S A
AIM
Step Step Step Step Step
106
![Page 106: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/106.jpg)
Reflections
From your perspective, how is improvement science
different from other approaches in tackling problems? What would enable or constrain the work of improvement in your context?
Where do you want to learn more in the remaining
time at the Summit?
![Page 107: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/107.jpg)
Top 7 Ways to Get Started
108
7. Ask other people at the Summit how they got started!
6. Next time someone wants to make a change, run it as a PDSA!
5. Use a problem investigation tool to understand a problem.
4. Next time you are setting a goal, ask, “How will we know?”
3. Read Learning to Improve and start a book club with colleagues.
2. Run a personal improvement project on your own life!
1. Start before you’re ready.
![Page 108: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/108.jpg)
Evaluation
Thank you for your feedback!
109
![Page 109: Introduction to Improvement Science: A Learning-By-Doing ...summit.carnegiefoundation.org/session_materials/A1-B1...efforts Improvement Science Cheat Sheet 22 An interdependent set](https://reader033.vdocument.in/reader033/viewer/2022042612/5f779b1608c8fd43557c5481/html5/thumbnails/109.jpg)