measure..but do it really intelligently...•promote equity between the people who provide and use...
TRANSCRIPT
![Page 1: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/1.jpg)
12 June 2014
Measure..but do it really intelligently
Presenter: Mary Dixon-Woods
![Page 2: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/2.jpg)
The Prudent Principles
• Minimise avoidable harm.
• Carry out the minimum appropriate intervention.
• Promote equity between the people who provide and use services.
![Page 3: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/3.jpg)
Applying the Principles
• Minimise avoidable harm.
• Carry out the minimum appropriate intervention.
• Promote equity between the people who provide and use services.
![Page 4: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/4.jpg)
• Most health care organisations at present have very little capacity to analyse, monitor, or learn from safety and quality information. This gap is costly and should be closed.
![Page 5: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/5.jpg)
Why measure?
![Page 6: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/6.jpg)
Why measure?
– Signal priority
– Create mission
– Detect variation
– Assess improvement and deterioration
– Provide feedback so staff know how’re they’re doing
– Identify weaknesses, strengths and areas for intervention
– Improve transparency and accountability to patients
![Page 7: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/7.jpg)
Performance management by numbers
• Whether performance is enhanced or obstructed depends on the purpose to which numbers are put: – Targets
– Rankings
– Intelligence
![Page 8: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/8.jpg)
Intelligence
• If you’re not measuring, you’re not managing
![Page 9: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/9.jpg)
Intelligence
• If you’re not measuring, you’re not managing
![Page 10: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/10.jpg)
Intelligence
• If you’re not measuring, you’re not managing
• If you’re measuring stupidly, you’re not managing
![Page 11: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/11.jpg)
Intelligence
• If you’re not measuring, you’re not managing
• If you’re measuring stupidly, you’re not managing
• If you’re only measuring, you’re not managing
![Page 12: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/12.jpg)
What methods might you use as ways of gaining intelligence?
![Page 13: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/13.jpg)
Some ways of knowing
• Internal and external measures • Incident reports • ‘High reliability’ techniques • ‘Culture’ surveys • Walking the process • Direct observations • Role-swapping and shadowing • Glitch reports and hassle boxes • Analysis of complaints and incidents • Authentic listening to patients and staff
![Page 14: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/14.jpg)
![Page 15: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/15.jpg)
Vincent et al’s fundamental questions
• Has patient care been safe in the past?
• Are our clinical systems and processes reliable?
• Is care safe today?
• Will care be safe in the future?
• Are we responding and improving?
![Page 16: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/16.jpg)
Vincent et al’s fundamental questions
• Has patient care been safe in the past?
• Are our clinical systems and processes reliable?
• Is care safe today?
• Will care be safe in the future?
• Are we responding and improving?
![Page 17: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/17.jpg)
Harm and reliability
• Incidents of harm are an important but imperfect guide to safety in the past
• Measures of reliability assess the extent to which a system is performing against its intended specification
![Page 18: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/18.jpg)
External measures
• What are the advantages of using external measures of harm and reliability?
![Page 19: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/19.jpg)
External measures
• Standardisation of measures reduces burden of measure design
• Can allow detection of unwarranted variations
• Can identify high and low performers
• Can identify good practice
• Can stimulate improvement
• But prone to iatrogenic effects
![Page 20: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/20.jpg)
Measuring too much
• In the US, National Quality Forum measures went from 200 in 2005 to over 700 in 2011
• US CMS has introduced 65 new measures in last year alone
• At MGH, measuring consumes 1% of net patient service revenue
![Page 21: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/21.jpg)
Targets and terror
• People become adept at working out what they need to do to survive performance management
![Page 22: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/22.jpg)
https://www.flickr.com/photos/benleto/
![Page 23: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/23.jpg)
![Page 24: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/24.jpg)
Eroding the denominator
• Exclusions for reporting [may be] …obscuring the current drivers of in-hospital mortality instead of helping focus attention on them. A key consideration for the future will be to dissociate these measures of performance from reimbursement, so as to allow for comprehensive reporting and data collection without the threat of punishment.
![Page 25: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/25.jpg)
• Risk that emphasis on “gaming” conceals technical problems of measurement
![Page 26: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/26.jpg)
Technical problems
• In setting up data collection systems are formidable
• Frequently under-estimated and challenges to comparability poorly understood
![Page 27: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/27.jpg)
Measuring harm
• Design a system to collect data on the rate of infections in invasive devices in children (under 16) living mainly in the community.
![Page 28: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/28.jpg)
Measuring harm
• Does it make a difference if you have to report your rates externally?
![Page 29: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/29.jpg)
![Page 30: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/30.jpg)
The Health Foundation’s Lining Up Research project
• An ethnographic study of interventions to reduce central line infections
• What happens when organisations are asked to interpret data definitions, collect data and report on CVC-BSIs?
![Page 31: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/31.jpg)
Measurement
31
![Page 32: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/32.jpg)
![Page 33: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/33.jpg)
33
![Page 34: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/34.jpg)
Data collection systems Controller centered Track-trigger Track Patrol
11 3 3
Highly fallible Highly reliable Reasonable reliability
Variable local credibility
High local credibility
Low local credibility
![Page 35: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/35.jpg)
Denominators
• Staff perceived that patients with different risk profiles were lumped together
• Sometimes excluded patients thought to be “low risk” or “high risk”
• Perceptions of fairness were very important
![Page 36: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/36.jpg)
Numerators
36
![Page 37: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/37.jpg)
Clinical practices
• Some physicians started antimicrobial therapy without a blood sample
• What ICUs sent to the lab varied enormously
• Organisational systems meant samples were not always matched up
![Page 38: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/38.jpg)
Differences in microbiology support
• Many could not support catheter-related definition
• Microbiology involvement in rounds varied
• Contribution to decision-making about what counted varied
![Page 39: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/39.jpg)
Link between measurement and improvement
• High rates could motivate action – but only if credible • Low rates sometimes induced unjustified complacency • Credible data is a must
If I’m honest right before we started, we didn’t think we were that bad. […] We thought, you know, [we] don’t really have a problem with central line infections. But nobody ever looked to see whether we were any good […] and when we compared our infection rates, actually they were far worse than any of us ever realised.
39
![Page 40: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/40.jpg)
Emphasis on gaming obscures technical problems
• Much practice in relation to counting central line infections was artless, not artful
• Technical components of measurement inescapably linked to social practices
• Fairness an important influence on those practices
![Page 41: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/41.jpg)
Adding sanctions does change the game
![Page 42: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/42.jpg)
Counting counts
• CDC definitions aimed at maximising sensitivity
• Financial and reputational penalties changing rules of game
• But accuracy of reported rates in question – one study found external validation raised reported rates by 27%
![Page 43: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/43.jpg)
Past harm
• Is not necessarily a good guide to current safety
• Risk of “no harm no foul” mentality
• Failure of pro-active risk seeking in healthcare
https://www.flickr.com/photos/tsuda/
![Page 44: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/44.jpg)
Sound rationale for testing use of safety management systems in healthcare
• Need to move from simplistic compliance-focused approach
• Need to be much more proactive about identifying local hazards
• Need risk management systems that are bespoke to contexts
44
![Page 45: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/45.jpg)
Findings of the diagnostics across the 8 sites
• Highly complex systems with multiple unreliable sub-components
• Many systems are improvisatory – never been purposefully designed
• Knowledge of systems and functioning often informal and idiosyncratic
![Page 46: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/46.jpg)
Reliability
![Page 47: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/47.jpg)
Process weaknesses
• Absence of certainty that things would happen as they were supposed to happen
• Especially if
– No one person could oversee process
– Coordination needed across time, departmental, team, and shift boundaries
![Page 48: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/48.jpg)
Process weaknesses
• Often unclear who was able, ought to, or was entitled to change the process
• Staff reported constantly rescuing processes that had gone wrong
• The patient was handed over in the morning as a diabetic on tablets and that the nurse only found out during the day that the patient should be on injections.
![Page 49: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/49.jpg)
Site Total ops
Ops with equipment problems
Equipment problems
% ops with one or more
problems
A 258 50 56 19% D 67 25 28 37% F 165 19 19 12%
Total 490 94 103 19%
![Page 50: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/50.jpg)
‘We always need a colposcope with that list and time and time again it isn’t there or it’s broken or it isn’t back or nobody knows where it is’
![Page 51: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/51.jpg)
Reliability in your organisation
• Which are the most reliable processes?
• Which are the least reliable?
• How would you know?
![Page 52: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/52.jpg)
Many QI projects
• Focus on improving reliability
• Use PDSA cycles
• Use locally developed internal measures
![Page 53: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/53.jpg)
Internal measures
• Invaluable for identifying and characterising local problems
• Assessing change
• Identifying opportunities for further intervention
![Page 54: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/54.jpg)
Internal/locally developed measures
• What problems do you expect to see?
![Page 55: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/55.jpg)
• Insufficient data points
• Lack of sufficient baseline periods
• Changing samples and sampling strategies
• Inadequate annotations of changes
“Data for improvement”
![Page 56: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/56.jpg)
Common problems with local measures
• Insufficiently focused on what is important to staff and patients
• Operational definitions unclear • Terms (e.g. “delay”) not explicit • Burdensome or difficult to put into practice • Duplicates information already being produced for
another purpose • Method of analysis not defined in advance • Baseline periods not defined • Inappropriate sampling strategies • Impossible to compare
![Page 57: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/57.jpg)
Magical thinking in improvement
![Page 58: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/58.jpg)
Conspiracy of enthusiasm
• Specific reforms are advocated as though they were certain to be successful…We must be able to advocate without that excess of commitment that blinds us to reality testing” (Donald Campbell, 1969: 72)
![Page 59: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/59.jpg)
Your tips for getting measurement right?
![Page 60: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/60.jpg)
Measurement
• You MUST have a protocol. • Use validated measures where you can. • Get a data analyst involved from the beginning and
design a database. • Sound definitions of denominator and numerator. • Define frequency and intervals. • Clear sampling strategy. • PDSA the data collection system and train people. • Only collect what you need to collect. • Quality assure data entry. • Proper plan for the analysis and choose the right tests.
![Page 61: Measure..but do it really intelligently...•Promote equity between the people who provide and use services. Applying the Principles ... •Analysis of complaints and incidents •Authentic](https://reader033.vdocument.in/reader033/viewer/2022041912/5e681e6510757d67b80f38e5/html5/thumbnails/61.jpg)
Conclusions
• Vincent et al provide very useful framework
• No single indicator will tell you whether care is safe
• More use of pro-active diagnostic tools
• Better measurement of harm and reliability