![Page 1: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/1.jpg)
1
A Costing Framework for QMS
Implementation
Wendy Kitson-Piggott Caribbean Med Labs Foundation
2nd CHART-CCAS-CMLF Joint Meeting 2013
![Page 2: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/2.jpg)
2
Why this study?
Context & Rationale
![Page 3: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/3.jpg)
3
Why this study?
• Considerations
– The global economic circumstance and impact on regional budgets
– Survival of medical and PH labs in the current economic environment
–Dilemma of decision-making for CMOs, PSs & Lab Managers – need informed advice
![Page 4: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/4.jpg)
4
Current Concerns
• Laboratory error
• Implementing the ISO 15189 standard
• Stepwise approach to QMS implementation
• Lack of dedicated budgets for many labs
• Lack of annual budgeting, planning & accountability
• Lack of data on the true costs of lab operations
• Lack of data to inform QMS projections and planning
• Lack of costing frameworks for QMS strengthening and/or accreditation
![Page 5: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/5.jpg)
5
Reminder that….
Laboratory tests trigger 85% of medical decisions
And undoubtedly a significant % of public health decision-making
![Page 6: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/6.jpg)
6
Reminder that…
• A new study of 120 clinical pathology labs, where blood, urine and other fluid tests are done, estimates that each year in the United States, more than 2.9 million of these errors occur, and more than 160,000 patients are harmed in some way as a result.
Ref: Gallin & Vetter 2006
![Page 8: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/8.jpg)
8
Reminder that we need a PRACTICAL approach ….
8
![Page 9: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/9.jpg)
9
Reminder that Change is inevitable
![Page 10: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/10.jpg)
10
A new priority – The Lab QMS
• Provides a framework for continuous improvement
• Maximises the outputs of the medical laboratory
• Underpins reliability, relevance and timeliness of lab information
![Page 11: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/11.jpg)
11
A new priority - Lab Budgeting
![Page 12: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/12.jpg)
12
Study: to collect evidence to…
• Guide new lab priorities: quality improvement, planning, costing & budgeting
• Develop a comprehensive framework that outlines major areas of lab quality expenditures
• Explore whether spending on specific quality elements result in greater impact on lab quality improvement
• To explore what other factors may significantly impact lab quality outcomes
![Page 13: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/13.jpg)
13
Study Methodology
• Data collected from 9 labs in 6 countries
• Data collection
– Self-administered QMS data collection tool
– Tool for collection of data on lab quality expenditures
– On-site validation of information
– Key informant interviews
– Document Reviews
![Page 14: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/14.jpg)
14
Profile of Study Participants
• English & non-English-speaking countries
• Island & non-island territories
• Populations: <100,000 to >9 million
• Private and public sector laboratories
• Status – 2 labs accredited (neither to ISO 15189)
– 1 lab certified to ISO 9001
– 5 labs initiated QMS implementation
– 1 lab QMS implementation not initiated
![Page 15: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/15.jpg)
15
1. Self-administered QMS tool
• Questionnaire patterned on the proposed tiered or stepwise approach to accreditation
• Based on ISO 15189 (3 Tiers)
• Collected information on QMS before & after the formal initiation of QMS implementation
• Disseminated to the 9 labs for completion
• Data validated in follow-up visits by CMLF research staff
• Data collated and analysed using ‘microsoft excel’
![Page 16: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/16.jpg)
16
2. QMS Data Collection Costing Tool
• Stratified by ISO 15189 requirements & by:
– Capital costs
– Materials & consumable costs
– Infrastructural costs
– Labour costs
– Administrative costs & fees
![Page 17: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/17.jpg)
17
3. Key informant Interview Tool
• Info sought included feedback on factors impeding or helping the quality improvement effort post formal initiation
• Specific lab staff identified for interviews – Laboratory Managers – Laboratory Directors – Quality Managers/Officers (current & recent past) – Senior Technologists
• 1-2hr interviews conducted face-to-face or by phone
![Page 18: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/18.jpg)
18
Document Reviews
• Laboratory documents were reviewed to collect data on quality performance before & after QMS implementation initiative: – Turnaround Time & Sample Rejection – QC Failures – HIV Repeat Testing & Reproducibility – Down Time (e.g stock outs, shortages- staff, reagents) – Proficiency Testing (PT) Performance – Litigation – Error Logs
![Page 19: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/19.jpg)
19
Major Limitation
• Lack of documentation and records in labs with respect to: – Quality indicators (TAT, PT, downtime, stockouts etc.) – Training events & associated funding sources – Cost of reagents, supplies, equipment, staffing, training
etc.
• Lack of documentation and records in the finance departments of MOH
• Thus costs are not absolute – dependent to some extent on recall and estimates
NB: Private lab financial records much better kept
![Page 20: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/20.jpg)
20
PRELIMINARY OUTCOMES
![Page 21: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/21.jpg)
21
Preliminary Outcomes
• Seven labs had an opportunity to initiate QMS implementation in 2003
• Progress of labs before & after formal initiation of QMS implementation: ISO 15189 Requirements
– Range of 0% to 46% overall progress in meeting the ISO requirements
• Accredited and certified labs had made the most progress and had the least # gaps across all Tiers
![Page 22: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/22.jpg)
22
1%
6%
12%
29%
18%
18%
16%
Analysis of Tier 1 PROGRESS - BEFORE & AFTER QMS IMPLEMENTATION
>50
>40
>30
>20
>10
0
Decline
Preliminary Outcomes
![Page 23: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/23.jpg)
23
Tier 1: from ‘No’ to ‘Yes’ n=80
# (%) Tier 1 Requirements % Labs moving from ‘no’ to ‘yes’
1 (1%) (quality coordinator) > 50 %
5 (6%) (e.g quality policy statement)
> 40 -50 %
10 (12%) (organogram & document ID) > 30-40 %
23 (29%) (EQA, IQC, audits)
> 20-30%
14 (18%) (SOPs, PM programme) > 10 -20%
14 (18%) (QMS plan, mgt review)
No change
13 (16%) (staffing, waste disposal) Decline
![Page 24: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/24.jpg)
24
Summary of Gaps in Tiers 1-3 in individual labs (n= 165)
TIER EXISTING GAPS BY LABORATORIES
Minimum Maximum Mean Median
Tier 1
17% 56% 39% 39%
Tier 2
13% 81% 40% 36%
Tier 3
2% 85% 46% 32%
Tiers 1, 2 & 3 Collectively
15% 67% 41% 40%
![Page 25: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/25.jpg)
25
Final Cost Categories
• Human Resources – salaries, training, meetings, retreats supporting lab quality
improvement
• Furniture, equipment & supplies – Computers, lab equipment, storage, refrigerators etc.
obtained to support improved quality
• Infrastructure – Plant renovations to support improved quality
• Quality control & safety • Administration
– application & licensing fees etc. to support improved quality
![Page 26: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/26.jpg)
26
Expenditure
• Ranged from >$US 300,000 to >$US 5 million
• Higher expenditures included significant upgrades to plant and infrastructure – (improved safety and testing facilities)
• There was seemingly no direct correlation between expenditure and QMS progress
![Page 27: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/27.jpg)
27
Observations
• Main expenditure categories
– HR; Equipment & supplies & Infrastructure
• Very varied expenditure patterns
![Page 28: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/28.jpg)
28
HUMAN RESOURCES FURNITURE, EQUIPMENT
AND SUPPLIES INFRASTRUCTURE
QUALITY CONTROL AND SAFETY
ADMINSTRATION
Costs 100,284 1,510,100 65,000 426,075 12,000
-
200,000
400,000
600,000
800,000
1,000,000
1,200,000
1,400,000
1,600,000
Co
sts
EXAMPLE OF INDIVIDUAL LAB EXPENDITURE
![Page 29: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/29.jpg)
29
HUMAN RESOURCES FURNITURE, EQUIPMENT AND
SUPPLIES INFRASTRUCTURE QUALITY CONTROL AND SAFETY ADMINSTRATION
Costs 225,612 260,866 5,240,499 8,200 153,000
-
500,000
1,000,000
1,500,000
2,000,000
2,500,000
3,000,000
3,500,000
4,000,000
4,500,000
5,000,000
5,500,000
Co
sts
EXAMPLE OF INDIVIDUAL LAB EXPENDITURE
![Page 30: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/30.jpg)
30
HUMAN RESOURCES FURNITURE, EQUIPMENT AND
SUPPLIES INFRASTRUCTURE QUALITY CONTROL AND SAFETY ADMINSTRATION
Costs 464,647 7,435 - 33,333 9,436
-
50,000
100,000
150,000
200,000
250,000
300,000
350,000
400,000
450,000
500,000
Co
sts
EXAMPLE OF INDIVIDUAL LAB EXPENDITURE
![Page 31: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/31.jpg)
31
Comparison of Expenditures by Cost Category
![Page 32: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/32.jpg)
32
QMS COSTING FRAMEWORK
• Organised according to the ISO 15189:2007 management and technical clauses
• Sub-components define the cost elements for each requirement
![Page 33: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/33.jpg)
33
Framework example
• Document Control
– Filing cabinets
– Office furniture
– Materials & supplies
– Maintenance
– Other capital costs
– Technologist time
– Clerical staff time
![Page 34: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/34.jpg)
34
Framework example
• Quality Management
– Quality Coordinator
– Consultant support
– Retreats
– Meetings
– Miscellaneous printing
![Page 35: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/35.jpg)
35
Framework example
• Facilities & Safety
– Plant & Infrastructure
– Driver
– Vehicle/transport
– Cleaners
– Storage
– Safety coordinator
– Shipping
![Page 36: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/36.jpg)
36
Other impacting Factors (variables)
Plus/Supports • Strong Leadership at the MOH, hospital and lab level –
seriousness of purpose • Supportive administrators • Staff enthusiasm, buy-in & teamwork • Really wanting to become accredited & get recognition • A dedicated quality manager/coordinator • Access to adequate resources • Sustained technical assistance • Sustained QMS training • Making certification mandatory
![Page 37: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/37.jpg)
37
Other impacting Factors (variables)
Minus/Hindrances • Lack of leadership or interest at MOH, hospital & lab level • Non-supportive political agendas • Failure to designate a dedicated focal point at the MOH and
in the lab • Staff changes within the MOH, hospital and lab • Turf protection & external jealousies • Demotivated staff • Underestimating the QMS effort • Lack of funding (austerity measures) • Lack of planning
![Page 38: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/38.jpg)
38
Benefits of QMS Costing Framework
• Provides guidance for administrative projections & budgeting
• Allows for detailed planning and a phased approach to implementation
• Ensures that all key stakeholders are on the same wavelength re QMS cost implications and minimum needs
• Limits the perception that lab is always asking for ‘something’ else
• Can be used to advocate for resources – linked to quality indicators & standard requirements
![Page 39: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/39.jpg)
39
Major Challenges to
QMS Implementation • Sustainability of effort
• Sustained leadership
• Holding gains & building on them
• Staff compliance and ownership
• Resourcing as funding gets tighter
• Proving value and avoiding cuts
![Page 40: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/40.jpg)
40
Next Steps
• Converting the QMS Costing framework into an electronic tool that would more easily summarise data
![Page 41: A Costing Framework for QMS Implementation · 2014-12-01 · 38 Benefits of QMS Costing Framework •Provides guidance for administrative projections & budgeting •Allows for detailed](https://reader033.vdocument.in/reader033/viewer/2022042101/5e7e437c27ae7161bc3fe61f/html5/thumbnails/41.jpg)
Thank-you