evidence based innovation, 3pm, pop up uni, 2 september 2015
TRANSCRIPT
![Page 1: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/1.jpg)
Evidence based innovation
John Taylor Assistant head of primary care policy (access), NHS England
Dr Robert Varnam Head of general practice development, NHS England
[email protected] @robertvarnam
![Page 2: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/2.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
The founding principles of UK primary care are admired the world over, and rightly so.
General practice is a jewel in the crown of this country. Right now, general practice feels in a bad place. Constrained, hemmed-in and, to
some, marginalised.
Whatever the state of things in your part of the country, in general, I think it’s fair to say
that, at the very least, general practice is currently constrained from delivering its full potential.
We need to see increases in funding, a growth in the workforce, and improvements to
premises. Without those, existing services may not be sustainable.
Overview
Common pitfalls
The GP Access Fund experience
Five top tips
![Page 3: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/3.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam #Expo15NHS @robertvarnam
1. Common pitfalls
![Page 4: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/4.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
Call to Action on General Practice
“What needs to be done to promote, support and sustain the adoption of effective
innovations?”
a) Finding innovation
b) Implementing change
c) Unease about innovators & innovations
d) Concern about causality
bit.ly/c2aGP
![Page 5: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/5.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
Call to Action on General Practice
“What needs to be done to promote, support and sustain the adoption of effective
innovations?”
a) Finding innovation
b) Implementing change
c) Unease about innovators & innovations
d) Concern about causality
bit.ly/c2aGP
![Page 6: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/6.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
Call to Action on General Practice
“What needs to be done to promote, support and sustain the adoption of effective
innovations?”
a) Finding innovation
b) Implementing change
c) Unease about innovators & innovations
d) Concern about causality
NHS Change Model
bit.ly/c2aGP
![Page 7: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/7.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
Call to Action on General Practice
“What needs to be done to promote, support and sustain the adoption of effective
innovations?”
a) Finding innovation
b) Implementing change
c) Unease about innovators & innovations
d) Concern about causality
bit.ly/c2aGP
![Page 8: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/8.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
Unease about innovators & innovations
The innovators
• Whacky / unappealing
• Too brainy
• Too creative
• Too hard working
Admirable but not me
![Page 9: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/9.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
Unease about innovators & innovations
The innovations
• Experimental / unfinished / risky
• Too niche
• Too context-specific
Interesting but not for me
![Page 10: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/10.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
Call to Action on General Practice
“What needs to be done to promote, support and sustain the adoption of effective
innovations?”
a) Finding innovation
b) Implementing change
c) Unease about innovators & innovations
d) Concern about causality
bit.ly/c2aGP
![Page 11: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/11.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam #Expo15NHS @robertvarnam
The innovation itself is not enough
![Page 12: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/12.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam #Expo15NHS @robertvarnam
2. GP Access Fund
![Page 13: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/13.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
About the GP Access Fund
Aim: “to help improve access to general practice and stimulate innovative ways of
providing primary care services”
• Wave one: Apr 2014
• £50m
• Wave two: Apr 2015
• £100m
Applications from practices covering nearly 2/3 of the population of England
![Page 14: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/14.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
About the GP Access Fund
57 schemes
~100 ‘federations’
2500 providers
18m patients
Wave one: Apr 2014
Wave two: Apr 2015
![Page 15: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/15.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
An example of this in practice at the
moment is the Prime Minister’s GP Access
Fund. Now covering a significant
proportion of the country, practices in this
are implementing quite wide-ranging
redesign of their services, acknowledging
that extended hours are only one part of
good access. The practices participating in
this programme are already beginning to
implement many of the transformational
changes envisaged by the Five Year
Forward View. This is generating valuable
learning about the specific changes
required, including the ways in which the
system can make progress easier and
more sustainable.
Innovations being tested
![Page 16: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/16.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
Schemes' initial plans for measurement
Three broad approaches:
a) External academic unit
b) Project manager time set aside
c) No detailed plan Wave one: 4/20 schemes had dedicated
budget for measurement
![Page 17: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/17.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
Inputs from innovation support programme
• Webinars
• Workshops
• Advice from evaluation team
• Coaching from NHS IQ
• Team reviews
• Direct conversations
… modest success
![Page 18: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/18.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
The biggest data challenge of all …
Wave one: 19/20 schemes required help. 4 had existing BI systems
Dec 14: guide published, application preparation webinars
Apr 15: welcome pack
Wave two: 37/37 have requested help
General practice
activity data
![Page 19: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/19.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam #Expo15NHS @robertvarnam
Some of the NHS is ill-prepared to
measure innovation in everyday care,
and some of our baselines are weak.
![Page 20: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/20.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam #Expo15NHS @robertvarnam
a) Budget & plan for measurement
b) Know your logic model
c) Measure to inspire and inform
d) Measure in realtime
e) Show it can work elsewhere
3. Five top tips
![Page 21: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/21.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam #Expo15NHS @robertvarnam
a) Budget & plan for measurement
b) Know your logic model
c) Measure to inspire and inform
d) Measure in realtime
e) Show it can work elsewhere
3. Five top tips
![Page 22: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/22.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
a) Budget & plan for measurement
It doesn’t just happen
![Page 23: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/23.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam #Expo15NHS @robertvarnam
a) Budget & plan for measurement
b) Know your logic model
c) Measure to inspire and inform
d) Measure in realtime
e) Show it can work elsewhere
3. Five top tips
![Page 24: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/24.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
Innovations’
efficacy
Schemes’
efficacy Funding
Cost-effectiveness
b) Know your logic model
Patient
satisfaction
Staff
assessment
OOH
attendance
A&E
attendance
New extended
hours
appointments
Additional
contact
modes
Other access
innovations
Changes in
care model
![Page 25: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/25.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam #Expo15NHS @robertvarnam
a) Budget & plan for measurement
b) Know your logic model
c) Measure to inspire and inform
d) Measure in realtime
e) Show it can work elsewhere
3. Five top tips
![Page 26: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/26.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
Innovations’
efficacy
Schemes’
efficacy Funding
Cost-effectiveness
c) Measure to inspire and inform
Patient
satisfaction
Staff
assessment
OOH
attendance
A&E
attendance
New extended
hours
appointments
Additional
contact
modes
Other access
innovations
Changes in
care model
Why
should I
commit to
this?
How might
this work
for us?
![Page 27: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/27.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam #Expo15NHS @robertvarnam
a) Budget & plan for measurement
b) Know your logic model
c) Measure to inspire and inform
d) Measure in realtime
e) Show it can work elsewhere
3. Five top tips
![Page 28: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/28.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
d) Measure in realtime
If you’re moving forward, why only look backwards?
![Page 29: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/29.jpg)
#Expo15NHS @robertvarnam
Using periodic averages
105
55
0
20
40
60
80
100
120
Sample A Sample B1st three
month
period
2nd three
month
period
Start Data
vacuum
This is our traditional approach. It is familiar but serves innovation
leaders very poorly.
How do you keep people motivated in
this period? Averages prevent you
learning from variation
![Page 30: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/30.jpg)
Statistical Process Control charts allow you to measure very frequently,
and draw statistically sound conclusions about any change.
97
.3%
C
.I.
Change introduced here
Rapid confirmation that the change was a statistically significant improvement
This kind of analysis can be produced by a wide variety of software.
![Page 31: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/31.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
d) Measure in realtime
Benefits for innovators:
Keep staff motivated & curious
Refine the innovation more rapidly
Gather convincing evidence for others in shorter timescale
Test multiple changes (eg phasing / multiple sites)
1 2 3 4
1
2
3
![Page 32: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/32.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam #Expo15NHS @robertvarnam
a) Budget & plan for measurement
b) Know your logic model
c) Measure to inspire and inform
d) Measure in realtime
e) Show it can work elsewhere
3. Five top tips
![Page 33: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/33.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam
e) Show it can work elsewhere
• Describe and measure your context (well enough for others to understand
& compare)
• Test in multiple different contexts
• Yourself
• First followers
![Page 34: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/34.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam #Expo15NHS @robertvarnam
a) Budget & plan for measurement
b) Know your logic model
c) Measure to inspire and inform
d) Measure in realtime
e) Show it can work elsewhere
3. Five top tips
![Page 35: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/35.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam #Expo15NHS @robertvarnam
a) Budget & plan for measurement
b) Know your logic model
c) Measure to inspire and inform
d) Measure in realtime
e) Show it can work elsewhere
![Page 36: Evidence based innovation, 3pm, pop up uni, 2 september 2015](https://reader031.vdocument.in/reader031/viewer/2022030221/588484cd1a28ab6d1a8b4de3/html5/thumbnails/36.jpg)
w ww.england.nhs.uk #Expo15NHS @robertvarnam #Expo15NHS @robertvarnam
Using data as part of a change strategy
bit.ly/PMCFlessons1
Choosing metrics for innovation
vimeo.com/111923411
Using retrospective case control
bit.ly/NuffieldRetroCaseControl
Logic models
wikipedia.org/wiki/Logic_model
Scaling up innovation
ow.ly/RBxYt
SPC guides
bit.ly/SPCguide1 & bit.ly/SPCguide2
#Expo15NHS @robertvarnam
a) Budget & plan for measurement
b) Know your logic model
c) Measure to inspire and inform
d) Measure in realtime
e) Show it can work elsewhere