performance assessment tool for quality improvement in
TRANSCRIPT
![Page 1: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/1.jpg)
1
Performance assessment tool for quality improvement in hospitals
- Results from the pilot implementation -
Oliver Gröne
Quality of Health Systems and Services
WHO Regional Office for Europe
![Page 2: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/2.jpg)
2
Content
Background of the project
Experience with pilot implementation
Future directions
![Page 3: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/3.jpg)
3
Background of the project
![Page 4: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/4.jpg)
4
Basic orientations
Tool for internal quality improvement to support hospitals in:
- Assessing their performance- Question their results- Translate them into actions for quality
improvement.
No ranking of providers or countries, no disclosure of data to purchasers or public.
Comparative data based on peer groups of providers.
![Page 5: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/5.jpg)
5
PatientPatient--centerednesscenteredness
SafetySafety
Clin
ical
C
linic
al
Effe
ctiv
enes
sEf
fect
iven
ess
Effic
ienc
yEf
ficie
ncy
Staf
f St
aff
Orie
ntat
ion
Orie
ntat
ion
Res
pons
ive
Res
pons
ive
Gov
erna
nce
Gov
erna
nce
The PATH model
Key message: performance dimensions and indicators are interrelated.
![Page 6: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/6.jpg)
6
Clinical effectivenessPrimary Caesarean section delivery rateAppropriateness of prophylactic antibiotic useRate of readmission for selected tracer conditionsRate of admission after day surgeryReturn to ICU for selected procedures/conditions
SafetyMortality rates for selected tracers and proceduresFormal procedure to report and analyze sentinel eventsWork-related injuries (percutaneous injuries)
EfficiencyAmbulatory surgery useMedian length of stay for specific proceduresAverage inventory in stock for pharmaceuticalsWastage of blood productsOperating rooms unused sessions
Set of performance indicators
Tracer conditions depend onindicator, e.g. for mortality:
stroke, AMI, communityacquired pneumonia, coronaryartery bypass graft, total hipreplacement
![Page 7: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/7.jpg)
7
Patient centerednessCancelled surgical proceduresScore on patient perception/satisfaction surveyScore on interpersonal apectsScore on client orientation: information and empowerment
Responsive governancePerceived continuity through patient surveyWomen breastfeeding at discharge
Staff orientationTraining expenditures on average number of FTE staffBudget dedicated to staff health promotion activitiesShort and long term absenteeismPercutaneous injuries on average number of FTE staffStaff excessive weekly working hours
Set of performance indicators
![Page 8: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/8.jpg)
8
Descriptive sheets for indicators
Definition- Numerator and denominator- Inclusion criteria- Definition (ICD and content)- Data collection sources and timeframe
Rationale- Burden of data collection- Importance (prevalence, potential for
improvement, hospital impact)- Validity (face validity, construct validity)
Guide for interpretation- Stratification- Related performance indicators
![Page 9: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/9.jpg)
9
Experience with pilot implementation
![Page 10: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/10.jpg)
10
Objectives of the pilot
Assess model- Burden- Benefit
Revise model- Include / exclude indicators- Refine definitions- Propose strategy for implementation on a
larger scale- Disseminate the project
![Page 11: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/11.jpg)
11
Calendar for pilot
Deadline Tasks
02/2004 Participating hospitals identified andcoordinators (national/local) appointed
04/2004 Check data availability + select tailoredindicators + set up data collectionmechanisms
10/2004 Data collection between October 2004 andAugust 2005
08/2005 August to November 2005: Analysis
11/2005 International workshop: review of experience + PATH amendment
03/2006 PATH amended version ready to be expandedCreation of the international network
![Page 12: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/12.jpg)
12
1. 51 hospitals from 6 countries (Belgium, Canada, Denmark, France, Slovakia, South Africa),
2. Timeliness and comprehensiveness of data submission depended highly on organizational context,
3. Insufficient control for local adaptations of indicator definition,
4. Lack of data to adjust for case-mix (SES, severity, co-morbidity),
5. Lack of standardized patient assessment measure affect four indicators.
Experience from the pilot implementation
![Page 13: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/13.jpg)
13
Construction of peer groups
Distribution of questionnaire on hospital (quality) management systems and functions.
Cluster analysis to group hospitals:- Comprehensive analysis: hospital structures and
quality systems- Limited analysis: size, catchment area
Three clusters/peer groups emerged:- smaller community hospitals, mixed catchment (9),- community and large multispecialty, all teaching
(25),- large, multisite teaching hospitals in urban areas
(13).
![Page 14: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/14.jpg)
14
Summary of results
1. Indicator specific dashboard
2. Relative performance index
3. Overall performance index
![Page 15: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/15.jpg)
15
Indicator specific dashboard- Example -
for each hospital for each indicator and tracer
![Page 16: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/16.jpg)
16
Indicator specific dashboard- Absenteeism -
![Page 17: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/17.jpg)
17
Indicator specific dashboard- Readmission <4 days CAP -
![Page 18: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/18.jpg)
18
Indicator specific dashboard- LOS AMI -
![Page 19: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/19.jpg)
19
Relative performance index- Clinical Effectiveness -
![Page 20: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/20.jpg)
20
Relative performance index- Safety -
![Page 21: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/21.jpg)
21
Relative performance index- Efficiency -
![Page 22: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/22.jpg)
22
Relative performance index- Patient centeredness -
![Page 23: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/23.jpg)
23
Relative performance index- Staff orientation -
![Page 24: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/24.jpg)
24
Relative performance index-Responsive governance-
![Page 25: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/25.jpg)
25
Overall performance index- For each hospital -
![Page 26: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/26.jpg)
26
Future directions
![Page 27: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/27.jpg)
27
Results and way forward
A fully revised framework after pilot implementation including:- a refined core set of performance indicators +
experience in use of tailored indicators- a consolidated indicator manual to all participating
hospitals consisting of:- Indicator definitions- Exclusion & inclusion criteria- ICD-10 and CCI codes- Desired length of time for data collection
- tools and strategies for interpretation and quality improvement.
![Page 28: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/28.jpg)
28
1. WHO CC Ancona, Italy: Establishing Internet platform to collect, analyze and report data.
2. WHO Kracow, Poland: Administration and training on implementation and interpretation of performance measures in hospitals.
3. Steering group and academic centres of excellence to advance reporting of results.
4. WHO Regional Office for Europe: research and support.
Results and way forward
![Page 29: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/29.jpg)
29
International pilot implementationyielded problems around data collectionand interpretation.Quality improvement starts with data collection.Clear strategy required to guide furtherprocess of data collection to learn fromresults and link with other qualityimprovement strategies.Many possibilities to present data; however, main question is how data isused.
Conclusion
![Page 30: Performance assessment tool for quality improvement in](https://reader033.vdocument.in/reader033/viewer/2022053104/6291a12163db5051d560c6ec/html5/thumbnails/30.jpg)
30
Contact
Oliver Gröne, Technical OfficerQuality of Health Systems & Services
WHO Regional Office for Europe
Phone +34 93 241 82 70Fax +34 93 241 82 71
Email [email protected]