a maturity model for quality assurance* dr. alan wu hong kong council for accreditation of academic...

A Maturity Model for Quality Assurance*

Dr. Alan WuHong Kong Council for Accreditation of

Academic and Vocational Qualifications

Sub-theme: Different approaches to QA and their impact on efficiency, effectiveness and sustainability

*Disclaimer: The views expressed in this paper are those of the author and do not reflect the official views and policy of the Hong Kong Council for Accreditation of Academic and Vocational Qualifications.

The ContextThe Hong Kong Qualifications Framework

(HKQF)

Hong Kong Council for Accreditation ofAcademic and Vocational Qualifications

(HKCAAVQ)

Accreditation of Academic and Vocational Qualifications Ordinance

(AAVQO)

The HKQF

Knowledge & Intellectual Skills

Processes Application,

Autonomy &

Accountability

Communication, IT and Numeracy

Generic Level

Descriptors

Qualifications from the academic, vocational and

continuing education sectors.

The HKQF is defined by levels

AAVQO

• “operator” means a person, school, institution, organization or other body, the whole or part of the business of which includes the operation of any learning programme or any part of a learning programme;

• learning programme” means a programme of studies or training defined by a curriculum (which may consist of one or more modules, units, subjects or courses or any combination of those elements) and includes, where the context permits, any proposed programme of such studies or training;

The HKCAAVQ

Qualifications

RegisterOperators/programmes

What is Quality?

• Excellence

• Zero errors

• Fitness for purpose

• Transformation

• Threshold

• Enhancement

Source: http://www.leidykla.eu/fileadmin/Vadyba/11/Janne_Parri.pdf

Key Concepts in Quality

Quality Control (QC)

Quality Assurance (QA)

Total Quality Management (TQM)

Education/Training as a Process

Mission, values and objectives

Education/Training Provider

Learning/Training programme

Learning/Training Outcomes

Achievements

drive

drive

drive

drive

Quality check

Fitness of purpose

Institutional Evaluation

Programme Validation

Open Assessmente.g. external degree, RPL

Fitness for purpose

Quality in Education/Training

Mission, values and objectives

Education/Training Provider

Learning/Training programme

Learning/Training Outcomes

Achievements

drive

drive

drive

drive

Quality check

Fitness of purpose

Institutional Evaluation

Programme Validation

Open Assessmente.g. external degree, RPL

Fitness for purpose

QC

QA

TQM

Quality Indicators• In general, a mixture selected from the Input-Process-Output model.

EUROPEAN REPORT ON THE QUALITY OF SCHOOL EDUCATIONhttp://ec.europa.eu/education/policies/educ/indic/rapinen.pdf

ABET Engineering Accreditation Criteria

http://www.abet.org/forms.shtml

Indicators on attainment

1. Mathematics 2. Reading

3. Science

4. Information and communication

technologies (ICT)

5. Foreign languages 6. Learning to learn

7. Civics

Indicators on success and transition

8. Drop-out rates

9. Completion of upper secondary education

10. Participation in tertiary education

Indicators on monitoring of education

11. Evaluation and steering of school education

12. Parent participation

Indicators on resources and structures

13. Education and training of teachers

14. Participation in pre-primary education

15. Number of students per computer

16. Educational expenditure per student

GENERAL CRITERIA FOR BACCALAUREATE LEVEL PROGRAMS

Criterion 1. Students

Criterion 2. Program Educational Objectives

Criterion 3. Program Outcomes

Criterion 4. Continuous Improvement

Criterion 5. Curriculum

Criterion 6. Faculty

Criterion 7. Facilities

Criterion 8. Support

Criterion 9. Program Criteria

PhilosophiesIdeologies

PhilosophiesIdeologies Context

Objectives

ContextObjectives

Maturity

QC QA TQM

Quality Indicators (QI)?

QIs vs Maturity

7

6

5

4

3

2

1

HKQF

Learning outcomes

The HKQF is primarily an outcome-based framework

Learning/Training Programme

• Staffing• Assessment• Programme content and structure• Equipment/facilities• Admission requirements

Financing

Staff Development

QA Mechanism

Governance

A Maturity Model

Level of maturity

Key characteristics

Initial Few processes are defined, and success depends on individual heroics.

Repeatable The basic processes are in place to repeat earlier success.

Defined The processes are documented, standardized and integrated.

Managed Detailed measures of the process and product quality are collected. Both processes and products are quantitatively understood and controlled.

Optimising Continuous process improvement is enabled by quantitative feedback from the process and from piloting innovative ideas and technologies.

More evidenceMore trust

QC

QA

TQM

Based on the Capability Maturity Model (CMM) from the software industry

Conclusion

PLAN

AC

T

CHECK

DO

PLAN

AC

T

CHECK

DOHKCAAVQ

Gate-keeper and Enabler

Questions