How to Manage Your Improvement Metrics More Efficiently and
Effectively
@MarkGraban (Presenter)VP of Improvement & Innovation Services
@Jeff_Roussel (Host)VP of Sales
Agenda & Logistics
• Presentation(45minutes)• Q&A(10minutes)– UsetheGoToWebinarMeetingPaneltosubmitaquestionatanytime
• Recordinglink&slideswillbesentviaemail– Also– seethe“Handouts”featureandChatbox
About Mark Graban• 20+yearspracticingLean– 10yearsinmanufacturing– 11+yearsinhealthcare
• Books:– LeanHospitals– HealthcareKaizen
(co-authorJoeSwartz)
• www.MarkGraban.comNew3rd Edition!
Why Measure?
Are We Improving?
My Most Favorite Book Ever
http://www.spcpress.com/http://amzn.to/2jJ4fiN
DonaldJ.Wheeler,PhD
Are We Improving?
Daily Lean Management
Source:ThinkingLeanatThedaCare (DVD)
How Are We Doing Compared
to Our Goal?
"Bowling Chart"
Are We Improving?
Can We Tell From This?
A Better Dashboard
Limitedinformationyouneedtomakedecisions
Easier to Tell From This?
400
450
500
550
600
650Au
g-05
Sep-05
Oct-05
Nov-05
Dec-05
Jan-06
Feb-06
Mar-06
Apr-0
6
May-06
Jun-06
Jul-0
6
Aug-06
TotalCases
In KaiNexus…
Are We Improving?
Need to Avoid Bad Conclusions
“Theaveragepatientsatisfactionincreasedfrom87.2to89%”
86%
87%
88%
89%
90%
Before After
Need to Avoid Bad Conclusions
“Theaveragepatientsatisfactionincreasedfrom87.2to89%”
0% 10% 20% 30% 40% 50% 60% 70% 80% 90%
100%
Before After
Need to Avoid Bad Conclusions
“Theaveragepatientsatisfactionincreasedfrom87.2to89%”
Need to Avoid Bad Conclusions
“TheaveragepatientsatisfactionDECREASEDfrom87.2to85%”??
Are We Improving?
76
78
80
82
84
86
88
90
92PatientSatisfaction(DifferentDataSet)
Linear Trendlines are Easy
Can Linear Trends Be Misleading?
76
78
80
82
84
86
88
90
92PatientSatisfaction
Same Chart Different Timeframe
78
80
82
84
86
88
90
92PatientSatisfaction
Are We Improving?
How Can We Tell?
How Should We React?
0
10
20
30
40
50
60
3/1/07
3/2/07
3/3/07
3/4/07
3/5/07
3/6/07
3/7/07
3/8/07
3/9/07
3/10/07
3/11/07
3/12/07
Responding to Daily Changes
KB
GOAL
DailyProductionAveragePraiseTeam
PT PT
Arewehelping?Isthisprocessstable?
KBKickButt
Isn’titalwaysthesystem?
It’s(almost)alwaysthesystem.
Signal vs. Noise?
"Whileeverydatasetcontainsnoise,somedatasetsmaycontainsignals.
Therefore,beforeyoucandetectasignalwithinanygivendataset,
youmustfirstfilteroutthenoise.
“X” Control Chart(Chart for Individual Values)
Goal=25minutes
UpperControlLimit
LowerControlLimit
In KaiNexus…
Surgical Cases Table
Surgical Control Chart
0
100
200
300
400
500
600
700
800
Aug-05 Sep-05 Oct-05 Nov-05 Dec-05 Jan-06 Feb-06 Mar-06 Apr-06 May-06 Jun-06 Jul-06 Aug-06
TotalCases
NOISE
Patient Satisfaction Run Chart“Theaveragepatientsatisfactionincreasedfrom87.2to89%”
Patient Sat. Control Chart
78
80
82
84
86
88
90
92
Nov-08 Dec-08 Jan-09 Feb-09 Mar-09 Apr-09 May-09 Jun-09 Jul-09 Aug-09 Sep-09 Oct-09
PatientSatisfaction
NOISE
Lab Turnaround TimeWhat
Happened?
SIGNAL
Another "Special Cause"
What Happened?SIGNAL
X and MR Chart Combo
Does This Small Business Have Predictable Revenue?
Xchart
MRchart
SIGNAL
Is My BlogTraffic
Increasing?
Evaluate Over Time
0
500
1000
1500
2000
2500
3000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51
LeanBlog.orgDailyPageLoads
“Western Electric” Rules• Anysinglepointaboveorbelow3-sigmaLCLorUCL
• 8consecutivepointsonsamesideofmean
• 6consecutivepointsmovingsamedirection
• 14alternatingup/downpointsinarowFullrulesà http://bit.ly/WErules
Evaluate Over Time
0
500
1000
1500
2000
2500
3000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51
LeanBlog.orgDailyPageLoads
Shift the Limits as Indicated
0
500
1000
1500
2000
2500
3000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51
LeanBlog.org DailyPageLoads
Example of Process Shift
• Ifyoumadeachangethatyouexpectedtoimprovethesystem,useacontrolcharttotestthehypothesis
0
5
10
15
20
25
30
35
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52
0
5
10
15
20
25
30
35
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52
0
5
10
15
20
25
30
35
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52
0
5
10
15
20
25
30
35
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 520
5
10
15
20
25
30
35
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52
ProcessShift
DailyTAT
Example of Process Shift
• IfyoudidNOTmakeachange,youneedtoinvestigatetodeterminethecauseofthissignal
0
5
10
15
20
25
30
35
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52
0
5
10
15
20
25
30
35
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52
0
5
10
15
20
25
30
35
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52
0
5
10
15
20
25
30
35
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 520
5
10
15
20
25
30
35
1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52
ProcessShift
DailyTAT
Are We Hitting Our Goals?
Performance vs. Goals
System View vs. Reactive
Control Chart View
Another Example
Goal
Control Chart View
Goal
So We Should Do Nothing?
Improve the System!
NOT Understanding Variation Leads To…
• Pressuringpeopletogetbetterresultsbyworkingharderwithinthesamesystem
• Wastingtimelookingforexplanationsofaperceivedtrendwhennothinghaschanged
• Notfocusingonsystemicimprovementsthatwouldshiftthemean
Our Next Webinar"TheIntersectionofCultureandTechnology:CapturingImprovementWhereitHappens"– MatthewCannistraro– ThursdayFebruary23,1PMET
• KaiNexus.com/webinars
Ask Us Anything!• MarkGraban&Dr.GregJacobson• NextEpisodeFeb14,1pmET• Register&submitquestionsviahttp://kainexus.com/webinars
• PastepisodesavailableonYouTube
Other Resources
www.KaiNexus.com
Podcasts
• www.KaiNexus.com/podcasts
• Subscribevia:– iTunes– GooglePlay– Stitcher
Thanks!• Web:
– www.kainexus.com– blog.kainexus.com– www.MarkGraban.com
• WebinarsonDemand:– www.kainexus.com/webinars
• SocialMedia:– www.twitter.com/kainexus– www.linkedin.com/company/kainexus– www.facebook.com/kainexus
@MarkGrabanVP of Services
@Jeff_RousselVP of Sales
BONUSRECORDINGWILLBESENT:HOWTOCREATECONTROLCHARTS