![Page 1: Quality Assessment and Improvement Methods in Statistics – What works?](https://reader035.vdocument.in/reader035/viewer/2022070420/56815eed550346895dcdaa5c/html5/thumbnails/1.jpg)
Quality Assessment and Improvement Methods in Statistics – What works?
Hans Viggo Sæbø, Statistics Norway
• Quality frameworks• Tools
![Page 2: Quality Assessment and Improvement Methods in Statistics – What works?](https://reader035.vdocument.in/reader035/viewer/2022070420/56815eed550346895dcdaa5c/html5/thumbnails/2.jpg)
Quality frameworks• Definitions, principles and model• General quality frameworks with common elements
(Total Quality Management, Six Sigma, EFQM, ISO, Lean…)
• Frameworks developed for official statistics (European Statistics Code of Practice, UN National Quality Assurance Framework)
• Constancy of purpose
2
![Page 3: Quality Assessment and Improvement Methods in Statistics – What works?](https://reader035.vdocument.in/reader035/viewer/2022070420/56815eed550346895dcdaa5c/html5/thumbnails/3.jpg)
Code of Practice is a common European quality framework
Institutional environment
Statisticalprocesses Statistical output Users
3
![Page 4: Quality Assessment and Improvement Methods in Statistics – What works?](https://reader035.vdocument.in/reader035/viewer/2022070420/56815eed550346895dcdaa5c/html5/thumbnails/4.jpg)
Tools for quality assurance
• Quality reports and indicators• Measurements and analyses of process variables• User satisfaction surveys• Self assessments• Reviews/audits• Labelling and certification
Tools can be linked to the business process model where relevant
4
![Page 5: Quality Assessment and Improvement Methods in Statistics – What works?](https://reader035.vdocument.in/reader035/viewer/2022070420/56815eed550346895dcdaa5c/html5/thumbnails/5.jpg)
Quality reports - communicating quality
• Structured information for users, based on quality indicators
• Information beyond pure quality characteristics• Adapt to user groups• Updating• Indicators have to be used with some care
5
![Page 6: Quality Assessment and Improvement Methods in Statistics – What works?](https://reader035.vdocument.in/reader035/viewer/2022070420/56815eed550346895dcdaa5c/html5/thumbnails/6.jpg)
Tools for quality assurance
• Quality reports and indicators• Measurements and analyses of process variables• User satisfaction surveys• Self assessments• Reviews/audits• Labelling and certification
6
![Page 7: Quality Assessment and Improvement Methods in Statistics – What works?](https://reader035.vdocument.in/reader035/viewer/2022070420/56815eed550346895dcdaa5c/html5/thumbnails/7.jpg)
User satisfaction surveys
• Different types• Supplement to other user dialogue• Known users are often satisfied• Satisfying current user needs is not enough
7
![Page 8: Quality Assessment and Improvement Methods in Statistics – What works?](https://reader035.vdocument.in/reader035/viewer/2022070420/56815eed550346895dcdaa5c/html5/thumbnails/8.jpg)
Tools for quality assurance
• Quality reports and indicators• Measurements and analyses of process variables• User satisfaction surveys• Self assessments• Reviews/audits• Labelling and certification
8
![Page 9: Quality Assessment and Improvement Methods in Statistics – What works?](https://reader035.vdocument.in/reader035/viewer/2022070420/56815eed550346895dcdaa5c/html5/thumbnails/9.jpg)
Self-assessments• Are often not enough• But can be a good start for a systematic quality work• DESAP• CoP and CAF• Basis for reviews and audits
9
![Page 10: Quality Assessment and Improvement Methods in Statistics – What works?](https://reader035.vdocument.in/reader035/viewer/2022070420/56815eed550346895dcdaa5c/html5/thumbnails/10.jpg)
Audits based on Code of practice in Statistics Norway
• Team of 4 persons • Self assessment (CoP
as basis)• Process mapping
(Lean) • Focus groups• Report• Action list
• 21 statistics or themes 2011 - 2013
10
![Page 11: Quality Assessment and Improvement Methods in Statistics – What works?](https://reader035.vdocument.in/reader035/viewer/2022070420/56815eed550346895dcdaa5c/html5/thumbnails/11.jpg)
Following up is crucial
• Assessments and reviews are not enough
• Management responsibility• But a central unit can
monitor
Type of review actions followed up in Statistics Norway:• Improved user dialogue
and dissemination• Documentation• Processes, more
standardised solutions• Statistical methods, e.g.
macro editing• Legal formalities
11
![Page 12: Quality Assessment and Improvement Methods in Statistics – What works?](https://reader035.vdocument.in/reader035/viewer/2022070420/56815eed550346895dcdaa5c/html5/thumbnails/12.jpg)
Tools for quality assurance
• Quality reports and indicators• Measurements and analyses of process variables• User satisfaction surveys• Self assessments• Reviews/audits• Labelling and certification
12
![Page 13: Quality Assessment and Improvement Methods in Statistics – What works?](https://reader035.vdocument.in/reader035/viewer/2022070420/56815eed550346895dcdaa5c/html5/thumbnails/13.jpg)
Labelling and certification• Characteristics of official (and European) statistics:
• Common good serving the whole society• Based on quality criteria (CoP)• Not pilots and not analyses
• Quality is subject to qualitative judgements• Minimum requirements?
• Labelling:+ Improve trust and quality, prevent misuse- Bureaucracy, delimitation, will the users care?
• Certification• Assessments and reviews are a prerequisite
13
![Page 14: Quality Assessment and Improvement Methods in Statistics – What works?](https://reader035.vdocument.in/reader035/viewer/2022070420/56815eed550346895dcdaa5c/html5/thumbnails/14.jpg)
Concluding remarks• Basis for quality work:
– Quality framework: European Statistics Code of Practice – Business Process Model– Organisation
• Stepwise procedure– From simple to more advanced tools– Self-assessments are a good start but reviews make a difference
• Constancy of purpose• Quality thinking integrated in all activities• Following up is crucial• Quality is more than doing things right – we also have
to do the right things
14