comparing qa&a systems, roles and criteriapeer learning on quality assurance and accreditation...
TRANSCRIPT
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Comparing QAampA systems roles and criteria
bullQAA system characteristics and criteria
bullLegal and normative setting
bullActors in QAA systems their roles and responsibilities
bullMulti-stakeholder approach
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Comparing QAampA systems roles and criteria
QAA system characteristics and criteria
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Comparing QAampA systems roles and criteria
Policy options
A specific Law on Quality of education (No8710042006)
National autonomous responsible institutions
Accreditation is part of the quality management systems and procedures
National standards used for internal and external evaluation (approved in
2007 and 2008)
National specialized institutions for quality evaluation (for pre-university
and higher education)
Involving school administration (ie School Inspectorates and Ministry) in
schoolsrsquo quality control and employers in HErsquo s quality control
The results of internal and external evaluation are public
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Comparing QAampA systems roles and criteria
The quality assurance methodology in the field of
education shall include the following components
a) criteria
b) standards and reference standards
c) performance indicators
d) qualifications
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Comparing QAampA systems roles and criteria
The education quality assurance refers to the following processes
a) planning and effectively achieving the expected training output
b) monitoring the results
c) internally reviewing the results
d) externally reviewing the results
-
National Center for Development of TVET
Romanian Agency for Quality Assurance in
Pre-University Education (ARACIP)
-
Educational Units
-
School Inspectorates
Romanian GovernmentRomanian Parliament
Ministry of Education
- approves laws in the field of vocational education and training
- approved the budget for Education as part of the State Budget
- adopts the Report on the current situation of the national educational system
- approves policies and strategies in the field of vocational education and training
- submits to the Parliament for approval the budget for Education as part of the national State Budget
- approves through Government Decision the standards the reference standards and the performance
indicators for quality assurance and assessment in pre-university education and the methodology for
institutional appraisal and accreditation
- designs substantiates and applies the overall educational strategy
- designs coordinates and applies national policy on education
- submits on an annual basis to the Parliament the Report on the current situation of the national educational system and it simultaneously presents directions and priorities
for the development of pre-university and higher education
- designs specific methodologies and tools for quality assurance in TVET complementing
ARACIPrsquos activity
- collects and disseminates best practice examples in quality assurance in TVET
complementing ARACIPrsquos activity
- designs recommendation for quality improvement in TVET
- designs standards reference standards and performance indicators for assessment and quality
assurance in pre-university education and the methodology for institutional appraisal and accreditation
- performs contract-based on request from the Ministry of Education Research and Innovation the
assessment for quality in pre-university education
- publishes handbooks guidelines summaries for best practice in the field
- designs on a regular basis at least once every 4 years system analysis on the quality of pre-
university education
- designs recommendations for quality improvement in pre-university education
- deliver the monitoring and quality control activity
- develop on an annual basise the Report regarding the current situation of education at county level
- develop and apply assessment and quality assurance procedures at organizational level
- develop proposals for quality improvement in education
Quality assurance in Technical and Vocational Education and Training (TVET) at system level
Sets up and accredits pre-university educational units for each educational level study program and vocational qualification as applicable
Ministry of Education
- supports capacity building for TVET units and for School
Inspectorates for TVET-related specific issues in
complementarity with ARACIP
National Center for Development of
TVET
- draft Regional Educational Action Plans (PRAI)
- monitor the implementation of the Local Educational Action Plans (PLAI)
Regional Consortia
-organize external quality monitoring visits in TVET
-- validate the Self-assessment Reports for quality in TVET
developed by the educational units
School Inspectorates
- draft PLAI
- monitor the implementation of School Action Plans (PAS)
Local Committees for Social Partnership
Development
N
A
T
I
O
N
A
L
L
E
V
E
L
R
E
G
I
O
N
A
L
C
O
U
N
T
Y
- submits the proposal for setting-up and accreditation of pre-university
educational units for each educational level study program and vocational
qualification as applicable
- delivers on a regular basis every 5 years the assessment of the
accredited pre-university educational units
Romanian Agency for Quality Assurance in Pre-University
Education (ARACIP)
Quality assurance in Technical and Vocational Education and Training TVET) at educational unit level
Quality SELF-ASSESSMENT
Draft Self-assessment Report
-
School Inspectorates Local Committees for Social
Partnership Development
METHODOLOGY
(policies regarding quality
assurance procedures internal regulations assessment tools)
PLANNING
Develop School Action Plan
(PAS)
REVIEW
Draft Quality Improvement
Plan in TVET
IMPLEMENTATION of
educational and training
process
INTERNAL MONITORING
S
C
H
O
O
L
U
N
I
T
L
E
V
E
L
Quality assurance in Technical and Vocational Education and Training TVET) at educational unit level
Users ndash Actors and rolesresponsabilities in HE
Government bullTo define higher education country-wide
bullTo assure quality higher education for citizenry
bullTo assure quality labour force
bullTo determine which institutions and programmes receive public funding
bullTo accept into civil service only those graduated from accredited institutions
bullTo generally use quality assurance as a means of consumer protection
Students bullTo assist in selecting an institution for study
bullTo ensure transfer between accredited institutions
bullTo ensure admission at the graduate level a different institution from undergraduate
degree
bullTo assist in employment particularly in civil service and in the professions
Employers bullTo assure qualified employees
Funding organizations bullTo determine eligible institutions for funding
Higher education institutionsbullTo improve institutional information and data
bullTo enhance institutional planning
bullTo determine membership in certain organizations
bullTo facilitate transfer schemes
bullTo assure a qualified student body
bull Legislative framework
Government Ordinance no 752005 on QA in education
approved through Law no 872006
Order of the Ministry of Education no 63082007 for the
approval of the instruments used in QA
Government Ordinance nr 15342008 approving the
reference standards and performance indicators in QA at
pre-university level
The accord on the establishment of GNAC (National
Group for QA-inter-institutional entity comprised of the Ministry of Education
Ministry of Labour National Adult Training Board ARACIP CNDIPT National Centre
for Teacher Training) and its rules of conduct
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
bullReasoning for and benefits of independent QAA Agencies
bullExisting approaches and models for independent QAA Agencies
bullLegal and normative frameworks and settings
bullSetting-up of independent QAA Agencies
bullAchieving mutual acceptance from involved stakeholders
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
Why ldquoexternal evaluationrdquo and independent QAA Agencies
bullImpartial eye - objectivity
bullCommon standards reference framework ndash comparability
bullFree from political influence - autonomy independence
bullMade by specialized staff - professionalism
bullTake into account the stakeholdersrsquo views - accountability
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Education institutions usually overestimate their level of
performance (fearing possible reactions from parents and students
and sanctions from local and national authorities )
Independent QAA Agencies act in order to
Certify the capacity of the education providers to meet the
customers expectations as well as the quality standards
Ensure the protection of the key and the consequent customers of
the study programs by producing and disseminating information
about quality education
Play a role in the development of a culture of quality in education
organizations
Recommend to the Ministry of Education and Research policies
and strategies in order to improve the quality of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
Public institution of national interest subordinated to the
Ministry of National Education with legal personality
established by Government Emergency Ordinance no
752005 regarding the quality assurance of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
ARACIS officially established by Government Emergency Ordinance No 75 for
Quality Assurance in Education of July 12th 2005 modified and approved by
Law 872006 Published in the Romanian Official Journal Part I No 334 of April
13th 2006 ndash modified by government emergency ordinance 752011
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP)
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
GNAC was set up in 2006 based on inter-institutional Agreement between
the Ministry of Education Ministry of Labour Romanian Agency for
Quality Assurance in Preuniversity Education National Authority for
Qualifications National Centre for TVET Development and with the
participation of social partners
What does actually an QAA Agency
Elaborates the standards the reference standards and the performance indicators the
regulations for the institutional evaluation and accreditation the manual of internal quality
evaluation the guides of good practices the annual report considering its own activity the
system analyses concerning quality on Romanian education recommendations for improving
the quality of education the professional code of conduct for the experts in evaluation and
accreditation
Accomplishes the evaluation for authorization and accreditation for all educational
organizations
Accomplishes every three years the recurrent evaluation of the accredited educational
organizations
Recommend to The Ministry of Education the authorization and the accreditation of
educational institutions for each level of education study program or professional
qualification
Accomplishes on a contractual bases at the Ministry of Education request the evaluation of
the quality of education system
Accomplishes the quality monitoring and control together with the School Inspectorates
(ARACIP) and the departments of the Ministry of Education
Publishes the results of the external evaluation
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Comparing QAampA systems roles and criteria
QAA system characteristics and criteria
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Comparing QAampA systems roles and criteria
Policy options
A specific Law on Quality of education (No8710042006)
National autonomous responsible institutions
Accreditation is part of the quality management systems and procedures
National standards used for internal and external evaluation (approved in
2007 and 2008)
National specialized institutions for quality evaluation (for pre-university
and higher education)
Involving school administration (ie School Inspectorates and Ministry) in
schoolsrsquo quality control and employers in HErsquo s quality control
The results of internal and external evaluation are public
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Comparing QAampA systems roles and criteria
The quality assurance methodology in the field of
education shall include the following components
a) criteria
b) standards and reference standards
c) performance indicators
d) qualifications
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Comparing QAampA systems roles and criteria
The education quality assurance refers to the following processes
a) planning and effectively achieving the expected training output
b) monitoring the results
c) internally reviewing the results
d) externally reviewing the results
-
National Center for Development of TVET
Romanian Agency for Quality Assurance in
Pre-University Education (ARACIP)
-
Educational Units
-
School Inspectorates
Romanian GovernmentRomanian Parliament
Ministry of Education
- approves laws in the field of vocational education and training
- approved the budget for Education as part of the State Budget
- adopts the Report on the current situation of the national educational system
- approves policies and strategies in the field of vocational education and training
- submits to the Parliament for approval the budget for Education as part of the national State Budget
- approves through Government Decision the standards the reference standards and the performance
indicators for quality assurance and assessment in pre-university education and the methodology for
institutional appraisal and accreditation
- designs substantiates and applies the overall educational strategy
- designs coordinates and applies national policy on education
- submits on an annual basis to the Parliament the Report on the current situation of the national educational system and it simultaneously presents directions and priorities
for the development of pre-university and higher education
- designs specific methodologies and tools for quality assurance in TVET complementing
ARACIPrsquos activity
- collects and disseminates best practice examples in quality assurance in TVET
complementing ARACIPrsquos activity
- designs recommendation for quality improvement in TVET
- designs standards reference standards and performance indicators for assessment and quality
assurance in pre-university education and the methodology for institutional appraisal and accreditation
- performs contract-based on request from the Ministry of Education Research and Innovation the
assessment for quality in pre-university education
- publishes handbooks guidelines summaries for best practice in the field
- designs on a regular basis at least once every 4 years system analysis on the quality of pre-
university education
- designs recommendations for quality improvement in pre-university education
- deliver the monitoring and quality control activity
- develop on an annual basise the Report regarding the current situation of education at county level
- develop and apply assessment and quality assurance procedures at organizational level
- develop proposals for quality improvement in education
Quality assurance in Technical and Vocational Education and Training (TVET) at system level
Sets up and accredits pre-university educational units for each educational level study program and vocational qualification as applicable
Ministry of Education
- supports capacity building for TVET units and for School
Inspectorates for TVET-related specific issues in
complementarity with ARACIP
National Center for Development of
TVET
- draft Regional Educational Action Plans (PRAI)
- monitor the implementation of the Local Educational Action Plans (PLAI)
Regional Consortia
-organize external quality monitoring visits in TVET
-- validate the Self-assessment Reports for quality in TVET
developed by the educational units
School Inspectorates
- draft PLAI
- monitor the implementation of School Action Plans (PAS)
Local Committees for Social Partnership
Development
N
A
T
I
O
N
A
L
L
E
V
E
L
R
E
G
I
O
N
A
L
C
O
U
N
T
Y
- submits the proposal for setting-up and accreditation of pre-university
educational units for each educational level study program and vocational
qualification as applicable
- delivers on a regular basis every 5 years the assessment of the
accredited pre-university educational units
Romanian Agency for Quality Assurance in Pre-University
Education (ARACIP)
Quality assurance in Technical and Vocational Education and Training TVET) at educational unit level
Quality SELF-ASSESSMENT
Draft Self-assessment Report
-
School Inspectorates Local Committees for Social
Partnership Development
METHODOLOGY
(policies regarding quality
assurance procedures internal regulations assessment tools)
PLANNING
Develop School Action Plan
(PAS)
REVIEW
Draft Quality Improvement
Plan in TVET
IMPLEMENTATION of
educational and training
process
INTERNAL MONITORING
S
C
H
O
O
L
U
N
I
T
L
E
V
E
L
Quality assurance in Technical and Vocational Education and Training TVET) at educational unit level
Users ndash Actors and rolesresponsabilities in HE
Government bullTo define higher education country-wide
bullTo assure quality higher education for citizenry
bullTo assure quality labour force
bullTo determine which institutions and programmes receive public funding
bullTo accept into civil service only those graduated from accredited institutions
bullTo generally use quality assurance as a means of consumer protection
Students bullTo assist in selecting an institution for study
bullTo ensure transfer between accredited institutions
bullTo ensure admission at the graduate level a different institution from undergraduate
degree
bullTo assist in employment particularly in civil service and in the professions
Employers bullTo assure qualified employees
Funding organizations bullTo determine eligible institutions for funding
Higher education institutionsbullTo improve institutional information and data
bullTo enhance institutional planning
bullTo determine membership in certain organizations
bullTo facilitate transfer schemes
bullTo assure a qualified student body
bull Legislative framework
Government Ordinance no 752005 on QA in education
approved through Law no 872006
Order of the Ministry of Education no 63082007 for the
approval of the instruments used in QA
Government Ordinance nr 15342008 approving the
reference standards and performance indicators in QA at
pre-university level
The accord on the establishment of GNAC (National
Group for QA-inter-institutional entity comprised of the Ministry of Education
Ministry of Labour National Adult Training Board ARACIP CNDIPT National Centre
for Teacher Training) and its rules of conduct
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
bullReasoning for and benefits of independent QAA Agencies
bullExisting approaches and models for independent QAA Agencies
bullLegal and normative frameworks and settings
bullSetting-up of independent QAA Agencies
bullAchieving mutual acceptance from involved stakeholders
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
Why ldquoexternal evaluationrdquo and independent QAA Agencies
bullImpartial eye - objectivity
bullCommon standards reference framework ndash comparability
bullFree from political influence - autonomy independence
bullMade by specialized staff - professionalism
bullTake into account the stakeholdersrsquo views - accountability
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Education institutions usually overestimate their level of
performance (fearing possible reactions from parents and students
and sanctions from local and national authorities )
Independent QAA Agencies act in order to
Certify the capacity of the education providers to meet the
customers expectations as well as the quality standards
Ensure the protection of the key and the consequent customers of
the study programs by producing and disseminating information
about quality education
Play a role in the development of a culture of quality in education
organizations
Recommend to the Ministry of Education and Research policies
and strategies in order to improve the quality of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
Public institution of national interest subordinated to the
Ministry of National Education with legal personality
established by Government Emergency Ordinance no
752005 regarding the quality assurance of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
ARACIS officially established by Government Emergency Ordinance No 75 for
Quality Assurance in Education of July 12th 2005 modified and approved by
Law 872006 Published in the Romanian Official Journal Part I No 334 of April
13th 2006 ndash modified by government emergency ordinance 752011
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP)
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
GNAC was set up in 2006 based on inter-institutional Agreement between
the Ministry of Education Ministry of Labour Romanian Agency for
Quality Assurance in Preuniversity Education National Authority for
Qualifications National Centre for TVET Development and with the
participation of social partners
What does actually an QAA Agency
Elaborates the standards the reference standards and the performance indicators the
regulations for the institutional evaluation and accreditation the manual of internal quality
evaluation the guides of good practices the annual report considering its own activity the
system analyses concerning quality on Romanian education recommendations for improving
the quality of education the professional code of conduct for the experts in evaluation and
accreditation
Accomplishes the evaluation for authorization and accreditation for all educational
organizations
Accomplishes every three years the recurrent evaluation of the accredited educational
organizations
Recommend to The Ministry of Education the authorization and the accreditation of
educational institutions for each level of education study program or professional
qualification
Accomplishes on a contractual bases at the Ministry of Education request the evaluation of
the quality of education system
Accomplishes the quality monitoring and control together with the School Inspectorates
(ARACIP) and the departments of the Ministry of Education
Publishes the results of the external evaluation
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Comparing QAampA systems roles and criteria
Policy options
A specific Law on Quality of education (No8710042006)
National autonomous responsible institutions
Accreditation is part of the quality management systems and procedures
National standards used for internal and external evaluation (approved in
2007 and 2008)
National specialized institutions for quality evaluation (for pre-university
and higher education)
Involving school administration (ie School Inspectorates and Ministry) in
schoolsrsquo quality control and employers in HErsquo s quality control
The results of internal and external evaluation are public
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Comparing QAampA systems roles and criteria
The quality assurance methodology in the field of
education shall include the following components
a) criteria
b) standards and reference standards
c) performance indicators
d) qualifications
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Comparing QAampA systems roles and criteria
The education quality assurance refers to the following processes
a) planning and effectively achieving the expected training output
b) monitoring the results
c) internally reviewing the results
d) externally reviewing the results
-
National Center for Development of TVET
Romanian Agency for Quality Assurance in
Pre-University Education (ARACIP)
-
Educational Units
-
School Inspectorates
Romanian GovernmentRomanian Parliament
Ministry of Education
- approves laws in the field of vocational education and training
- approved the budget for Education as part of the State Budget
- adopts the Report on the current situation of the national educational system
- approves policies and strategies in the field of vocational education and training
- submits to the Parliament for approval the budget for Education as part of the national State Budget
- approves through Government Decision the standards the reference standards and the performance
indicators for quality assurance and assessment in pre-university education and the methodology for
institutional appraisal and accreditation
- designs substantiates and applies the overall educational strategy
- designs coordinates and applies national policy on education
- submits on an annual basis to the Parliament the Report on the current situation of the national educational system and it simultaneously presents directions and priorities
for the development of pre-university and higher education
- designs specific methodologies and tools for quality assurance in TVET complementing
ARACIPrsquos activity
- collects and disseminates best practice examples in quality assurance in TVET
complementing ARACIPrsquos activity
- designs recommendation for quality improvement in TVET
- designs standards reference standards and performance indicators for assessment and quality
assurance in pre-university education and the methodology for institutional appraisal and accreditation
- performs contract-based on request from the Ministry of Education Research and Innovation the
assessment for quality in pre-university education
- publishes handbooks guidelines summaries for best practice in the field
- designs on a regular basis at least once every 4 years system analysis on the quality of pre-
university education
- designs recommendations for quality improvement in pre-university education
- deliver the monitoring and quality control activity
- develop on an annual basise the Report regarding the current situation of education at county level
- develop and apply assessment and quality assurance procedures at organizational level
- develop proposals for quality improvement in education
Quality assurance in Technical and Vocational Education and Training (TVET) at system level
Sets up and accredits pre-university educational units for each educational level study program and vocational qualification as applicable
Ministry of Education
- supports capacity building for TVET units and for School
Inspectorates for TVET-related specific issues in
complementarity with ARACIP
National Center for Development of
TVET
- draft Regional Educational Action Plans (PRAI)
- monitor the implementation of the Local Educational Action Plans (PLAI)
Regional Consortia
-organize external quality monitoring visits in TVET
-- validate the Self-assessment Reports for quality in TVET
developed by the educational units
School Inspectorates
- draft PLAI
- monitor the implementation of School Action Plans (PAS)
Local Committees for Social Partnership
Development
N
A
T
I
O
N
A
L
L
E
V
E
L
R
E
G
I
O
N
A
L
C
O
U
N
T
Y
- submits the proposal for setting-up and accreditation of pre-university
educational units for each educational level study program and vocational
qualification as applicable
- delivers on a regular basis every 5 years the assessment of the
accredited pre-university educational units
Romanian Agency for Quality Assurance in Pre-University
Education (ARACIP)
Quality assurance in Technical and Vocational Education and Training TVET) at educational unit level
Quality SELF-ASSESSMENT
Draft Self-assessment Report
-
School Inspectorates Local Committees for Social
Partnership Development
METHODOLOGY
(policies regarding quality
assurance procedures internal regulations assessment tools)
PLANNING
Develop School Action Plan
(PAS)
REVIEW
Draft Quality Improvement
Plan in TVET
IMPLEMENTATION of
educational and training
process
INTERNAL MONITORING
S
C
H
O
O
L
U
N
I
T
L
E
V
E
L
Quality assurance in Technical and Vocational Education and Training TVET) at educational unit level
Users ndash Actors and rolesresponsabilities in HE
Government bullTo define higher education country-wide
bullTo assure quality higher education for citizenry
bullTo assure quality labour force
bullTo determine which institutions and programmes receive public funding
bullTo accept into civil service only those graduated from accredited institutions
bullTo generally use quality assurance as a means of consumer protection
Students bullTo assist in selecting an institution for study
bullTo ensure transfer between accredited institutions
bullTo ensure admission at the graduate level a different institution from undergraduate
degree
bullTo assist in employment particularly in civil service and in the professions
Employers bullTo assure qualified employees
Funding organizations bullTo determine eligible institutions for funding
Higher education institutionsbullTo improve institutional information and data
bullTo enhance institutional planning
bullTo determine membership in certain organizations
bullTo facilitate transfer schemes
bullTo assure a qualified student body
bull Legislative framework
Government Ordinance no 752005 on QA in education
approved through Law no 872006
Order of the Ministry of Education no 63082007 for the
approval of the instruments used in QA
Government Ordinance nr 15342008 approving the
reference standards and performance indicators in QA at
pre-university level
The accord on the establishment of GNAC (National
Group for QA-inter-institutional entity comprised of the Ministry of Education
Ministry of Labour National Adult Training Board ARACIP CNDIPT National Centre
for Teacher Training) and its rules of conduct
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
bullReasoning for and benefits of independent QAA Agencies
bullExisting approaches and models for independent QAA Agencies
bullLegal and normative frameworks and settings
bullSetting-up of independent QAA Agencies
bullAchieving mutual acceptance from involved stakeholders
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
Why ldquoexternal evaluationrdquo and independent QAA Agencies
bullImpartial eye - objectivity
bullCommon standards reference framework ndash comparability
bullFree from political influence - autonomy independence
bullMade by specialized staff - professionalism
bullTake into account the stakeholdersrsquo views - accountability
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Education institutions usually overestimate their level of
performance (fearing possible reactions from parents and students
and sanctions from local and national authorities )
Independent QAA Agencies act in order to
Certify the capacity of the education providers to meet the
customers expectations as well as the quality standards
Ensure the protection of the key and the consequent customers of
the study programs by producing and disseminating information
about quality education
Play a role in the development of a culture of quality in education
organizations
Recommend to the Ministry of Education and Research policies
and strategies in order to improve the quality of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
Public institution of national interest subordinated to the
Ministry of National Education with legal personality
established by Government Emergency Ordinance no
752005 regarding the quality assurance of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
ARACIS officially established by Government Emergency Ordinance No 75 for
Quality Assurance in Education of July 12th 2005 modified and approved by
Law 872006 Published in the Romanian Official Journal Part I No 334 of April
13th 2006 ndash modified by government emergency ordinance 752011
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP)
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
GNAC was set up in 2006 based on inter-institutional Agreement between
the Ministry of Education Ministry of Labour Romanian Agency for
Quality Assurance in Preuniversity Education National Authority for
Qualifications National Centre for TVET Development and with the
participation of social partners
What does actually an QAA Agency
Elaborates the standards the reference standards and the performance indicators the
regulations for the institutional evaluation and accreditation the manual of internal quality
evaluation the guides of good practices the annual report considering its own activity the
system analyses concerning quality on Romanian education recommendations for improving
the quality of education the professional code of conduct for the experts in evaluation and
accreditation
Accomplishes the evaluation for authorization and accreditation for all educational
organizations
Accomplishes every three years the recurrent evaluation of the accredited educational
organizations
Recommend to The Ministry of Education the authorization and the accreditation of
educational institutions for each level of education study program or professional
qualification
Accomplishes on a contractual bases at the Ministry of Education request the evaluation of
the quality of education system
Accomplishes the quality monitoring and control together with the School Inspectorates
(ARACIP) and the departments of the Ministry of Education
Publishes the results of the external evaluation
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Comparing QAampA systems roles and criteria
The quality assurance methodology in the field of
education shall include the following components
a) criteria
b) standards and reference standards
c) performance indicators
d) qualifications
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Comparing QAampA systems roles and criteria
The education quality assurance refers to the following processes
a) planning and effectively achieving the expected training output
b) monitoring the results
c) internally reviewing the results
d) externally reviewing the results
-
National Center for Development of TVET
Romanian Agency for Quality Assurance in
Pre-University Education (ARACIP)
-
Educational Units
-
School Inspectorates
Romanian GovernmentRomanian Parliament
Ministry of Education
- approves laws in the field of vocational education and training
- approved the budget for Education as part of the State Budget
- adopts the Report on the current situation of the national educational system
- approves policies and strategies in the field of vocational education and training
- submits to the Parliament for approval the budget for Education as part of the national State Budget
- approves through Government Decision the standards the reference standards and the performance
indicators for quality assurance and assessment in pre-university education and the methodology for
institutional appraisal and accreditation
- designs substantiates and applies the overall educational strategy
- designs coordinates and applies national policy on education
- submits on an annual basis to the Parliament the Report on the current situation of the national educational system and it simultaneously presents directions and priorities
for the development of pre-university and higher education
- designs specific methodologies and tools for quality assurance in TVET complementing
ARACIPrsquos activity
- collects and disseminates best practice examples in quality assurance in TVET
complementing ARACIPrsquos activity
- designs recommendation for quality improvement in TVET
- designs standards reference standards and performance indicators for assessment and quality
assurance in pre-university education and the methodology for institutional appraisal and accreditation
- performs contract-based on request from the Ministry of Education Research and Innovation the
assessment for quality in pre-university education
- publishes handbooks guidelines summaries for best practice in the field
- designs on a regular basis at least once every 4 years system analysis on the quality of pre-
university education
- designs recommendations for quality improvement in pre-university education
- deliver the monitoring and quality control activity
- develop on an annual basise the Report regarding the current situation of education at county level
- develop and apply assessment and quality assurance procedures at organizational level
- develop proposals for quality improvement in education
Quality assurance in Technical and Vocational Education and Training (TVET) at system level
Sets up and accredits pre-university educational units for each educational level study program and vocational qualification as applicable
Ministry of Education
- supports capacity building for TVET units and for School
Inspectorates for TVET-related specific issues in
complementarity with ARACIP
National Center for Development of
TVET
- draft Regional Educational Action Plans (PRAI)
- monitor the implementation of the Local Educational Action Plans (PLAI)
Regional Consortia
-organize external quality monitoring visits in TVET
-- validate the Self-assessment Reports for quality in TVET
developed by the educational units
School Inspectorates
- draft PLAI
- monitor the implementation of School Action Plans (PAS)
Local Committees for Social Partnership
Development
N
A
T
I
O
N
A
L
L
E
V
E
L
R
E
G
I
O
N
A
L
C
O
U
N
T
Y
- submits the proposal for setting-up and accreditation of pre-university
educational units for each educational level study program and vocational
qualification as applicable
- delivers on a regular basis every 5 years the assessment of the
accredited pre-university educational units
Romanian Agency for Quality Assurance in Pre-University
Education (ARACIP)
Quality assurance in Technical and Vocational Education and Training TVET) at educational unit level
Quality SELF-ASSESSMENT
Draft Self-assessment Report
-
School Inspectorates Local Committees for Social
Partnership Development
METHODOLOGY
(policies regarding quality
assurance procedures internal regulations assessment tools)
PLANNING
Develop School Action Plan
(PAS)
REVIEW
Draft Quality Improvement
Plan in TVET
IMPLEMENTATION of
educational and training
process
INTERNAL MONITORING
S
C
H
O
O
L
U
N
I
T
L
E
V
E
L
Quality assurance in Technical and Vocational Education and Training TVET) at educational unit level
Users ndash Actors and rolesresponsabilities in HE
Government bullTo define higher education country-wide
bullTo assure quality higher education for citizenry
bullTo assure quality labour force
bullTo determine which institutions and programmes receive public funding
bullTo accept into civil service only those graduated from accredited institutions
bullTo generally use quality assurance as a means of consumer protection
Students bullTo assist in selecting an institution for study
bullTo ensure transfer between accredited institutions
bullTo ensure admission at the graduate level a different institution from undergraduate
degree
bullTo assist in employment particularly in civil service and in the professions
Employers bullTo assure qualified employees
Funding organizations bullTo determine eligible institutions for funding
Higher education institutionsbullTo improve institutional information and data
bullTo enhance institutional planning
bullTo determine membership in certain organizations
bullTo facilitate transfer schemes
bullTo assure a qualified student body
bull Legislative framework
Government Ordinance no 752005 on QA in education
approved through Law no 872006
Order of the Ministry of Education no 63082007 for the
approval of the instruments used in QA
Government Ordinance nr 15342008 approving the
reference standards and performance indicators in QA at
pre-university level
The accord on the establishment of GNAC (National
Group for QA-inter-institutional entity comprised of the Ministry of Education
Ministry of Labour National Adult Training Board ARACIP CNDIPT National Centre
for Teacher Training) and its rules of conduct
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
bullReasoning for and benefits of independent QAA Agencies
bullExisting approaches and models for independent QAA Agencies
bullLegal and normative frameworks and settings
bullSetting-up of independent QAA Agencies
bullAchieving mutual acceptance from involved stakeholders
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
Why ldquoexternal evaluationrdquo and independent QAA Agencies
bullImpartial eye - objectivity
bullCommon standards reference framework ndash comparability
bullFree from political influence - autonomy independence
bullMade by specialized staff - professionalism
bullTake into account the stakeholdersrsquo views - accountability
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Education institutions usually overestimate their level of
performance (fearing possible reactions from parents and students
and sanctions from local and national authorities )
Independent QAA Agencies act in order to
Certify the capacity of the education providers to meet the
customers expectations as well as the quality standards
Ensure the protection of the key and the consequent customers of
the study programs by producing and disseminating information
about quality education
Play a role in the development of a culture of quality in education
organizations
Recommend to the Ministry of Education and Research policies
and strategies in order to improve the quality of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
Public institution of national interest subordinated to the
Ministry of National Education with legal personality
established by Government Emergency Ordinance no
752005 regarding the quality assurance of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
ARACIS officially established by Government Emergency Ordinance No 75 for
Quality Assurance in Education of July 12th 2005 modified and approved by
Law 872006 Published in the Romanian Official Journal Part I No 334 of April
13th 2006 ndash modified by government emergency ordinance 752011
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP)
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
GNAC was set up in 2006 based on inter-institutional Agreement between
the Ministry of Education Ministry of Labour Romanian Agency for
Quality Assurance in Preuniversity Education National Authority for
Qualifications National Centre for TVET Development and with the
participation of social partners
What does actually an QAA Agency
Elaborates the standards the reference standards and the performance indicators the
regulations for the institutional evaluation and accreditation the manual of internal quality
evaluation the guides of good practices the annual report considering its own activity the
system analyses concerning quality on Romanian education recommendations for improving
the quality of education the professional code of conduct for the experts in evaluation and
accreditation
Accomplishes the evaluation for authorization and accreditation for all educational
organizations
Accomplishes every three years the recurrent evaluation of the accredited educational
organizations
Recommend to The Ministry of Education the authorization and the accreditation of
educational institutions for each level of education study program or professional
qualification
Accomplishes on a contractual bases at the Ministry of Education request the evaluation of
the quality of education system
Accomplishes the quality monitoring and control together with the School Inspectorates
(ARACIP) and the departments of the Ministry of Education
Publishes the results of the external evaluation
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Comparing QAampA systems roles and criteria
The education quality assurance refers to the following processes
a) planning and effectively achieving the expected training output
b) monitoring the results
c) internally reviewing the results
d) externally reviewing the results
-
National Center for Development of TVET
Romanian Agency for Quality Assurance in
Pre-University Education (ARACIP)
-
Educational Units
-
School Inspectorates
Romanian GovernmentRomanian Parliament
Ministry of Education
- approves laws in the field of vocational education and training
- approved the budget for Education as part of the State Budget
- adopts the Report on the current situation of the national educational system
- approves policies and strategies in the field of vocational education and training
- submits to the Parliament for approval the budget for Education as part of the national State Budget
- approves through Government Decision the standards the reference standards and the performance
indicators for quality assurance and assessment in pre-university education and the methodology for
institutional appraisal and accreditation
- designs substantiates and applies the overall educational strategy
- designs coordinates and applies national policy on education
- submits on an annual basis to the Parliament the Report on the current situation of the national educational system and it simultaneously presents directions and priorities
for the development of pre-university and higher education
- designs specific methodologies and tools for quality assurance in TVET complementing
ARACIPrsquos activity
- collects and disseminates best practice examples in quality assurance in TVET
complementing ARACIPrsquos activity
- designs recommendation for quality improvement in TVET
- designs standards reference standards and performance indicators for assessment and quality
assurance in pre-university education and the methodology for institutional appraisal and accreditation
- performs contract-based on request from the Ministry of Education Research and Innovation the
assessment for quality in pre-university education
- publishes handbooks guidelines summaries for best practice in the field
- designs on a regular basis at least once every 4 years system analysis on the quality of pre-
university education
- designs recommendations for quality improvement in pre-university education
- deliver the monitoring and quality control activity
- develop on an annual basise the Report regarding the current situation of education at county level
- develop and apply assessment and quality assurance procedures at organizational level
- develop proposals for quality improvement in education
Quality assurance in Technical and Vocational Education and Training (TVET) at system level
Sets up and accredits pre-university educational units for each educational level study program and vocational qualification as applicable
Ministry of Education
- supports capacity building for TVET units and for School
Inspectorates for TVET-related specific issues in
complementarity with ARACIP
National Center for Development of
TVET
- draft Regional Educational Action Plans (PRAI)
- monitor the implementation of the Local Educational Action Plans (PLAI)
Regional Consortia
-organize external quality monitoring visits in TVET
-- validate the Self-assessment Reports for quality in TVET
developed by the educational units
School Inspectorates
- draft PLAI
- monitor the implementation of School Action Plans (PAS)
Local Committees for Social Partnership
Development
N
A
T
I
O
N
A
L
L
E
V
E
L
R
E
G
I
O
N
A
L
C
O
U
N
T
Y
- submits the proposal for setting-up and accreditation of pre-university
educational units for each educational level study program and vocational
qualification as applicable
- delivers on a regular basis every 5 years the assessment of the
accredited pre-university educational units
Romanian Agency for Quality Assurance in Pre-University
Education (ARACIP)
Quality assurance in Technical and Vocational Education and Training TVET) at educational unit level
Quality SELF-ASSESSMENT
Draft Self-assessment Report
-
School Inspectorates Local Committees for Social
Partnership Development
METHODOLOGY
(policies regarding quality
assurance procedures internal regulations assessment tools)
PLANNING
Develop School Action Plan
(PAS)
REVIEW
Draft Quality Improvement
Plan in TVET
IMPLEMENTATION of
educational and training
process
INTERNAL MONITORING
S
C
H
O
O
L
U
N
I
T
L
E
V
E
L
Quality assurance in Technical and Vocational Education and Training TVET) at educational unit level
Users ndash Actors and rolesresponsabilities in HE
Government bullTo define higher education country-wide
bullTo assure quality higher education for citizenry
bullTo assure quality labour force
bullTo determine which institutions and programmes receive public funding
bullTo accept into civil service only those graduated from accredited institutions
bullTo generally use quality assurance as a means of consumer protection
Students bullTo assist in selecting an institution for study
bullTo ensure transfer between accredited institutions
bullTo ensure admission at the graduate level a different institution from undergraduate
degree
bullTo assist in employment particularly in civil service and in the professions
Employers bullTo assure qualified employees
Funding organizations bullTo determine eligible institutions for funding
Higher education institutionsbullTo improve institutional information and data
bullTo enhance institutional planning
bullTo determine membership in certain organizations
bullTo facilitate transfer schemes
bullTo assure a qualified student body
bull Legislative framework
Government Ordinance no 752005 on QA in education
approved through Law no 872006
Order of the Ministry of Education no 63082007 for the
approval of the instruments used in QA
Government Ordinance nr 15342008 approving the
reference standards and performance indicators in QA at
pre-university level
The accord on the establishment of GNAC (National
Group for QA-inter-institutional entity comprised of the Ministry of Education
Ministry of Labour National Adult Training Board ARACIP CNDIPT National Centre
for Teacher Training) and its rules of conduct
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
bullReasoning for and benefits of independent QAA Agencies
bullExisting approaches and models for independent QAA Agencies
bullLegal and normative frameworks and settings
bullSetting-up of independent QAA Agencies
bullAchieving mutual acceptance from involved stakeholders
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
Why ldquoexternal evaluationrdquo and independent QAA Agencies
bullImpartial eye - objectivity
bullCommon standards reference framework ndash comparability
bullFree from political influence - autonomy independence
bullMade by specialized staff - professionalism
bullTake into account the stakeholdersrsquo views - accountability
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Education institutions usually overestimate their level of
performance (fearing possible reactions from parents and students
and sanctions from local and national authorities )
Independent QAA Agencies act in order to
Certify the capacity of the education providers to meet the
customers expectations as well as the quality standards
Ensure the protection of the key and the consequent customers of
the study programs by producing and disseminating information
about quality education
Play a role in the development of a culture of quality in education
organizations
Recommend to the Ministry of Education and Research policies
and strategies in order to improve the quality of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
Public institution of national interest subordinated to the
Ministry of National Education with legal personality
established by Government Emergency Ordinance no
752005 regarding the quality assurance of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
ARACIS officially established by Government Emergency Ordinance No 75 for
Quality Assurance in Education of July 12th 2005 modified and approved by
Law 872006 Published in the Romanian Official Journal Part I No 334 of April
13th 2006 ndash modified by government emergency ordinance 752011
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP)
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
GNAC was set up in 2006 based on inter-institutional Agreement between
the Ministry of Education Ministry of Labour Romanian Agency for
Quality Assurance in Preuniversity Education National Authority for
Qualifications National Centre for TVET Development and with the
participation of social partners
What does actually an QAA Agency
Elaborates the standards the reference standards and the performance indicators the
regulations for the institutional evaluation and accreditation the manual of internal quality
evaluation the guides of good practices the annual report considering its own activity the
system analyses concerning quality on Romanian education recommendations for improving
the quality of education the professional code of conduct for the experts in evaluation and
accreditation
Accomplishes the evaluation for authorization and accreditation for all educational
organizations
Accomplishes every three years the recurrent evaluation of the accredited educational
organizations
Recommend to The Ministry of Education the authorization and the accreditation of
educational institutions for each level of education study program or professional
qualification
Accomplishes on a contractual bases at the Ministry of Education request the evaluation of
the quality of education system
Accomplishes the quality monitoring and control together with the School Inspectorates
(ARACIP) and the departments of the Ministry of Education
Publishes the results of the external evaluation
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
-
National Center for Development of TVET
Romanian Agency for Quality Assurance in
Pre-University Education (ARACIP)
-
Educational Units
-
School Inspectorates
Romanian GovernmentRomanian Parliament
Ministry of Education
- approves laws in the field of vocational education and training
- approved the budget for Education as part of the State Budget
- adopts the Report on the current situation of the national educational system
- approves policies and strategies in the field of vocational education and training
- submits to the Parliament for approval the budget for Education as part of the national State Budget
- approves through Government Decision the standards the reference standards and the performance
indicators for quality assurance and assessment in pre-university education and the methodology for
institutional appraisal and accreditation
- designs substantiates and applies the overall educational strategy
- designs coordinates and applies national policy on education
- submits on an annual basis to the Parliament the Report on the current situation of the national educational system and it simultaneously presents directions and priorities
for the development of pre-university and higher education
- designs specific methodologies and tools for quality assurance in TVET complementing
ARACIPrsquos activity
- collects and disseminates best practice examples in quality assurance in TVET
complementing ARACIPrsquos activity
- designs recommendation for quality improvement in TVET
- designs standards reference standards and performance indicators for assessment and quality
assurance in pre-university education and the methodology for institutional appraisal and accreditation
- performs contract-based on request from the Ministry of Education Research and Innovation the
assessment for quality in pre-university education
- publishes handbooks guidelines summaries for best practice in the field
- designs on a regular basis at least once every 4 years system analysis on the quality of pre-
university education
- designs recommendations for quality improvement in pre-university education
- deliver the monitoring and quality control activity
- develop on an annual basise the Report regarding the current situation of education at county level
- develop and apply assessment and quality assurance procedures at organizational level
- develop proposals for quality improvement in education
Quality assurance in Technical and Vocational Education and Training (TVET) at system level
Sets up and accredits pre-university educational units for each educational level study program and vocational qualification as applicable
Ministry of Education
- supports capacity building for TVET units and for School
Inspectorates for TVET-related specific issues in
complementarity with ARACIP
National Center for Development of
TVET
- draft Regional Educational Action Plans (PRAI)
- monitor the implementation of the Local Educational Action Plans (PLAI)
Regional Consortia
-organize external quality monitoring visits in TVET
-- validate the Self-assessment Reports for quality in TVET
developed by the educational units
School Inspectorates
- draft PLAI
- monitor the implementation of School Action Plans (PAS)
Local Committees for Social Partnership
Development
N
A
T
I
O
N
A
L
L
E
V
E
L
R
E
G
I
O
N
A
L
C
O
U
N
T
Y
- submits the proposal for setting-up and accreditation of pre-university
educational units for each educational level study program and vocational
qualification as applicable
- delivers on a regular basis every 5 years the assessment of the
accredited pre-university educational units
Romanian Agency for Quality Assurance in Pre-University
Education (ARACIP)
Quality assurance in Technical and Vocational Education and Training TVET) at educational unit level
Quality SELF-ASSESSMENT
Draft Self-assessment Report
-
School Inspectorates Local Committees for Social
Partnership Development
METHODOLOGY
(policies regarding quality
assurance procedures internal regulations assessment tools)
PLANNING
Develop School Action Plan
(PAS)
REVIEW
Draft Quality Improvement
Plan in TVET
IMPLEMENTATION of
educational and training
process
INTERNAL MONITORING
S
C
H
O
O
L
U
N
I
T
L
E
V
E
L
Quality assurance in Technical and Vocational Education and Training TVET) at educational unit level
Users ndash Actors and rolesresponsabilities in HE
Government bullTo define higher education country-wide
bullTo assure quality higher education for citizenry
bullTo assure quality labour force
bullTo determine which institutions and programmes receive public funding
bullTo accept into civil service only those graduated from accredited institutions
bullTo generally use quality assurance as a means of consumer protection
Students bullTo assist in selecting an institution for study
bullTo ensure transfer between accredited institutions
bullTo ensure admission at the graduate level a different institution from undergraduate
degree
bullTo assist in employment particularly in civil service and in the professions
Employers bullTo assure qualified employees
Funding organizations bullTo determine eligible institutions for funding
Higher education institutionsbullTo improve institutional information and data
bullTo enhance institutional planning
bullTo determine membership in certain organizations
bullTo facilitate transfer schemes
bullTo assure a qualified student body
bull Legislative framework
Government Ordinance no 752005 on QA in education
approved through Law no 872006
Order of the Ministry of Education no 63082007 for the
approval of the instruments used in QA
Government Ordinance nr 15342008 approving the
reference standards and performance indicators in QA at
pre-university level
The accord on the establishment of GNAC (National
Group for QA-inter-institutional entity comprised of the Ministry of Education
Ministry of Labour National Adult Training Board ARACIP CNDIPT National Centre
for Teacher Training) and its rules of conduct
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
bullReasoning for and benefits of independent QAA Agencies
bullExisting approaches and models for independent QAA Agencies
bullLegal and normative frameworks and settings
bullSetting-up of independent QAA Agencies
bullAchieving mutual acceptance from involved stakeholders
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
Why ldquoexternal evaluationrdquo and independent QAA Agencies
bullImpartial eye - objectivity
bullCommon standards reference framework ndash comparability
bullFree from political influence - autonomy independence
bullMade by specialized staff - professionalism
bullTake into account the stakeholdersrsquo views - accountability
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Education institutions usually overestimate their level of
performance (fearing possible reactions from parents and students
and sanctions from local and national authorities )
Independent QAA Agencies act in order to
Certify the capacity of the education providers to meet the
customers expectations as well as the quality standards
Ensure the protection of the key and the consequent customers of
the study programs by producing and disseminating information
about quality education
Play a role in the development of a culture of quality in education
organizations
Recommend to the Ministry of Education and Research policies
and strategies in order to improve the quality of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
Public institution of national interest subordinated to the
Ministry of National Education with legal personality
established by Government Emergency Ordinance no
752005 regarding the quality assurance of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
ARACIS officially established by Government Emergency Ordinance No 75 for
Quality Assurance in Education of July 12th 2005 modified and approved by
Law 872006 Published in the Romanian Official Journal Part I No 334 of April
13th 2006 ndash modified by government emergency ordinance 752011
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP)
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
GNAC was set up in 2006 based on inter-institutional Agreement between
the Ministry of Education Ministry of Labour Romanian Agency for
Quality Assurance in Preuniversity Education National Authority for
Qualifications National Centre for TVET Development and with the
participation of social partners
What does actually an QAA Agency
Elaborates the standards the reference standards and the performance indicators the
regulations for the institutional evaluation and accreditation the manual of internal quality
evaluation the guides of good practices the annual report considering its own activity the
system analyses concerning quality on Romanian education recommendations for improving
the quality of education the professional code of conduct for the experts in evaluation and
accreditation
Accomplishes the evaluation for authorization and accreditation for all educational
organizations
Accomplishes every three years the recurrent evaluation of the accredited educational
organizations
Recommend to The Ministry of Education the authorization and the accreditation of
educational institutions for each level of education study program or professional
qualification
Accomplishes on a contractual bases at the Ministry of Education request the evaluation of
the quality of education system
Accomplishes the quality monitoring and control together with the School Inspectorates
(ARACIP) and the departments of the Ministry of Education
Publishes the results of the external evaluation
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Sets up and accredits pre-university educational units for each educational level study program and vocational qualification as applicable
Ministry of Education
- supports capacity building for TVET units and for School
Inspectorates for TVET-related specific issues in
complementarity with ARACIP
National Center for Development of
TVET
- draft Regional Educational Action Plans (PRAI)
- monitor the implementation of the Local Educational Action Plans (PLAI)
Regional Consortia
-organize external quality monitoring visits in TVET
-- validate the Self-assessment Reports for quality in TVET
developed by the educational units
School Inspectorates
- draft PLAI
- monitor the implementation of School Action Plans (PAS)
Local Committees for Social Partnership
Development
N
A
T
I
O
N
A
L
L
E
V
E
L
R
E
G
I
O
N
A
L
C
O
U
N
T
Y
- submits the proposal for setting-up and accreditation of pre-university
educational units for each educational level study program and vocational
qualification as applicable
- delivers on a regular basis every 5 years the assessment of the
accredited pre-university educational units
Romanian Agency for Quality Assurance in Pre-University
Education (ARACIP)
Quality assurance in Technical and Vocational Education and Training TVET) at educational unit level
Quality SELF-ASSESSMENT
Draft Self-assessment Report
-
School Inspectorates Local Committees for Social
Partnership Development
METHODOLOGY
(policies regarding quality
assurance procedures internal regulations assessment tools)
PLANNING
Develop School Action Plan
(PAS)
REVIEW
Draft Quality Improvement
Plan in TVET
IMPLEMENTATION of
educational and training
process
INTERNAL MONITORING
S
C
H
O
O
L
U
N
I
T
L
E
V
E
L
Quality assurance in Technical and Vocational Education and Training TVET) at educational unit level
Users ndash Actors and rolesresponsabilities in HE
Government bullTo define higher education country-wide
bullTo assure quality higher education for citizenry
bullTo assure quality labour force
bullTo determine which institutions and programmes receive public funding
bullTo accept into civil service only those graduated from accredited institutions
bullTo generally use quality assurance as a means of consumer protection
Students bullTo assist in selecting an institution for study
bullTo ensure transfer between accredited institutions
bullTo ensure admission at the graduate level a different institution from undergraduate
degree
bullTo assist in employment particularly in civil service and in the professions
Employers bullTo assure qualified employees
Funding organizations bullTo determine eligible institutions for funding
Higher education institutionsbullTo improve institutional information and data
bullTo enhance institutional planning
bullTo determine membership in certain organizations
bullTo facilitate transfer schemes
bullTo assure a qualified student body
bull Legislative framework
Government Ordinance no 752005 on QA in education
approved through Law no 872006
Order of the Ministry of Education no 63082007 for the
approval of the instruments used in QA
Government Ordinance nr 15342008 approving the
reference standards and performance indicators in QA at
pre-university level
The accord on the establishment of GNAC (National
Group for QA-inter-institutional entity comprised of the Ministry of Education
Ministry of Labour National Adult Training Board ARACIP CNDIPT National Centre
for Teacher Training) and its rules of conduct
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
bullReasoning for and benefits of independent QAA Agencies
bullExisting approaches and models for independent QAA Agencies
bullLegal and normative frameworks and settings
bullSetting-up of independent QAA Agencies
bullAchieving mutual acceptance from involved stakeholders
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
Why ldquoexternal evaluationrdquo and independent QAA Agencies
bullImpartial eye - objectivity
bullCommon standards reference framework ndash comparability
bullFree from political influence - autonomy independence
bullMade by specialized staff - professionalism
bullTake into account the stakeholdersrsquo views - accountability
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Education institutions usually overestimate their level of
performance (fearing possible reactions from parents and students
and sanctions from local and national authorities )
Independent QAA Agencies act in order to
Certify the capacity of the education providers to meet the
customers expectations as well as the quality standards
Ensure the protection of the key and the consequent customers of
the study programs by producing and disseminating information
about quality education
Play a role in the development of a culture of quality in education
organizations
Recommend to the Ministry of Education and Research policies
and strategies in order to improve the quality of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
Public institution of national interest subordinated to the
Ministry of National Education with legal personality
established by Government Emergency Ordinance no
752005 regarding the quality assurance of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
ARACIS officially established by Government Emergency Ordinance No 75 for
Quality Assurance in Education of July 12th 2005 modified and approved by
Law 872006 Published in the Romanian Official Journal Part I No 334 of April
13th 2006 ndash modified by government emergency ordinance 752011
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP)
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
GNAC was set up in 2006 based on inter-institutional Agreement between
the Ministry of Education Ministry of Labour Romanian Agency for
Quality Assurance in Preuniversity Education National Authority for
Qualifications National Centre for TVET Development and with the
participation of social partners
What does actually an QAA Agency
Elaborates the standards the reference standards and the performance indicators the
regulations for the institutional evaluation and accreditation the manual of internal quality
evaluation the guides of good practices the annual report considering its own activity the
system analyses concerning quality on Romanian education recommendations for improving
the quality of education the professional code of conduct for the experts in evaluation and
accreditation
Accomplishes the evaluation for authorization and accreditation for all educational
organizations
Accomplishes every three years the recurrent evaluation of the accredited educational
organizations
Recommend to The Ministry of Education the authorization and the accreditation of
educational institutions for each level of education study program or professional
qualification
Accomplishes on a contractual bases at the Ministry of Education request the evaluation of
the quality of education system
Accomplishes the quality monitoring and control together with the School Inspectorates
(ARACIP) and the departments of the Ministry of Education
Publishes the results of the external evaluation
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Quality SELF-ASSESSMENT
Draft Self-assessment Report
-
School Inspectorates Local Committees for Social
Partnership Development
METHODOLOGY
(policies regarding quality
assurance procedures internal regulations assessment tools)
PLANNING
Develop School Action Plan
(PAS)
REVIEW
Draft Quality Improvement
Plan in TVET
IMPLEMENTATION of
educational and training
process
INTERNAL MONITORING
S
C
H
O
O
L
U
N
I
T
L
E
V
E
L
Quality assurance in Technical and Vocational Education and Training TVET) at educational unit level
Users ndash Actors and rolesresponsabilities in HE
Government bullTo define higher education country-wide
bullTo assure quality higher education for citizenry
bullTo assure quality labour force
bullTo determine which institutions and programmes receive public funding
bullTo accept into civil service only those graduated from accredited institutions
bullTo generally use quality assurance as a means of consumer protection
Students bullTo assist in selecting an institution for study
bullTo ensure transfer between accredited institutions
bullTo ensure admission at the graduate level a different institution from undergraduate
degree
bullTo assist in employment particularly in civil service and in the professions
Employers bullTo assure qualified employees
Funding organizations bullTo determine eligible institutions for funding
Higher education institutionsbullTo improve institutional information and data
bullTo enhance institutional planning
bullTo determine membership in certain organizations
bullTo facilitate transfer schemes
bullTo assure a qualified student body
bull Legislative framework
Government Ordinance no 752005 on QA in education
approved through Law no 872006
Order of the Ministry of Education no 63082007 for the
approval of the instruments used in QA
Government Ordinance nr 15342008 approving the
reference standards and performance indicators in QA at
pre-university level
The accord on the establishment of GNAC (National
Group for QA-inter-institutional entity comprised of the Ministry of Education
Ministry of Labour National Adult Training Board ARACIP CNDIPT National Centre
for Teacher Training) and its rules of conduct
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
bullReasoning for and benefits of independent QAA Agencies
bullExisting approaches and models for independent QAA Agencies
bullLegal and normative frameworks and settings
bullSetting-up of independent QAA Agencies
bullAchieving mutual acceptance from involved stakeholders
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
Why ldquoexternal evaluationrdquo and independent QAA Agencies
bullImpartial eye - objectivity
bullCommon standards reference framework ndash comparability
bullFree from political influence - autonomy independence
bullMade by specialized staff - professionalism
bullTake into account the stakeholdersrsquo views - accountability
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Education institutions usually overestimate their level of
performance (fearing possible reactions from parents and students
and sanctions from local and national authorities )
Independent QAA Agencies act in order to
Certify the capacity of the education providers to meet the
customers expectations as well as the quality standards
Ensure the protection of the key and the consequent customers of
the study programs by producing and disseminating information
about quality education
Play a role in the development of a culture of quality in education
organizations
Recommend to the Ministry of Education and Research policies
and strategies in order to improve the quality of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
Public institution of national interest subordinated to the
Ministry of National Education with legal personality
established by Government Emergency Ordinance no
752005 regarding the quality assurance of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
ARACIS officially established by Government Emergency Ordinance No 75 for
Quality Assurance in Education of July 12th 2005 modified and approved by
Law 872006 Published in the Romanian Official Journal Part I No 334 of April
13th 2006 ndash modified by government emergency ordinance 752011
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP)
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
GNAC was set up in 2006 based on inter-institutional Agreement between
the Ministry of Education Ministry of Labour Romanian Agency for
Quality Assurance in Preuniversity Education National Authority for
Qualifications National Centre for TVET Development and with the
participation of social partners
What does actually an QAA Agency
Elaborates the standards the reference standards and the performance indicators the
regulations for the institutional evaluation and accreditation the manual of internal quality
evaluation the guides of good practices the annual report considering its own activity the
system analyses concerning quality on Romanian education recommendations for improving
the quality of education the professional code of conduct for the experts in evaluation and
accreditation
Accomplishes the evaluation for authorization and accreditation for all educational
organizations
Accomplishes every three years the recurrent evaluation of the accredited educational
organizations
Recommend to The Ministry of Education the authorization and the accreditation of
educational institutions for each level of education study program or professional
qualification
Accomplishes on a contractual bases at the Ministry of Education request the evaluation of
the quality of education system
Accomplishes the quality monitoring and control together with the School Inspectorates
(ARACIP) and the departments of the Ministry of Education
Publishes the results of the external evaluation
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Users ndash Actors and rolesresponsabilities in HE
Government bullTo define higher education country-wide
bullTo assure quality higher education for citizenry
bullTo assure quality labour force
bullTo determine which institutions and programmes receive public funding
bullTo accept into civil service only those graduated from accredited institutions
bullTo generally use quality assurance as a means of consumer protection
Students bullTo assist in selecting an institution for study
bullTo ensure transfer between accredited institutions
bullTo ensure admission at the graduate level a different institution from undergraduate
degree
bullTo assist in employment particularly in civil service and in the professions
Employers bullTo assure qualified employees
Funding organizations bullTo determine eligible institutions for funding
Higher education institutionsbullTo improve institutional information and data
bullTo enhance institutional planning
bullTo determine membership in certain organizations
bullTo facilitate transfer schemes
bullTo assure a qualified student body
bull Legislative framework
Government Ordinance no 752005 on QA in education
approved through Law no 872006
Order of the Ministry of Education no 63082007 for the
approval of the instruments used in QA
Government Ordinance nr 15342008 approving the
reference standards and performance indicators in QA at
pre-university level
The accord on the establishment of GNAC (National
Group for QA-inter-institutional entity comprised of the Ministry of Education
Ministry of Labour National Adult Training Board ARACIP CNDIPT National Centre
for Teacher Training) and its rules of conduct
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
bullReasoning for and benefits of independent QAA Agencies
bullExisting approaches and models for independent QAA Agencies
bullLegal and normative frameworks and settings
bullSetting-up of independent QAA Agencies
bullAchieving mutual acceptance from involved stakeholders
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
Why ldquoexternal evaluationrdquo and independent QAA Agencies
bullImpartial eye - objectivity
bullCommon standards reference framework ndash comparability
bullFree from political influence - autonomy independence
bullMade by specialized staff - professionalism
bullTake into account the stakeholdersrsquo views - accountability
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Education institutions usually overestimate their level of
performance (fearing possible reactions from parents and students
and sanctions from local and national authorities )
Independent QAA Agencies act in order to
Certify the capacity of the education providers to meet the
customers expectations as well as the quality standards
Ensure the protection of the key and the consequent customers of
the study programs by producing and disseminating information
about quality education
Play a role in the development of a culture of quality in education
organizations
Recommend to the Ministry of Education and Research policies
and strategies in order to improve the quality of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
Public institution of national interest subordinated to the
Ministry of National Education with legal personality
established by Government Emergency Ordinance no
752005 regarding the quality assurance of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
ARACIS officially established by Government Emergency Ordinance No 75 for
Quality Assurance in Education of July 12th 2005 modified and approved by
Law 872006 Published in the Romanian Official Journal Part I No 334 of April
13th 2006 ndash modified by government emergency ordinance 752011
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP)
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
GNAC was set up in 2006 based on inter-institutional Agreement between
the Ministry of Education Ministry of Labour Romanian Agency for
Quality Assurance in Preuniversity Education National Authority for
Qualifications National Centre for TVET Development and with the
participation of social partners
What does actually an QAA Agency
Elaborates the standards the reference standards and the performance indicators the
regulations for the institutional evaluation and accreditation the manual of internal quality
evaluation the guides of good practices the annual report considering its own activity the
system analyses concerning quality on Romanian education recommendations for improving
the quality of education the professional code of conduct for the experts in evaluation and
accreditation
Accomplishes the evaluation for authorization and accreditation for all educational
organizations
Accomplishes every three years the recurrent evaluation of the accredited educational
organizations
Recommend to The Ministry of Education the authorization and the accreditation of
educational institutions for each level of education study program or professional
qualification
Accomplishes on a contractual bases at the Ministry of Education request the evaluation of
the quality of education system
Accomplishes the quality monitoring and control together with the School Inspectorates
(ARACIP) and the departments of the Ministry of Education
Publishes the results of the external evaluation
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
bull Legislative framework
Government Ordinance no 752005 on QA in education
approved through Law no 872006
Order of the Ministry of Education no 63082007 for the
approval of the instruments used in QA
Government Ordinance nr 15342008 approving the
reference standards and performance indicators in QA at
pre-university level
The accord on the establishment of GNAC (National
Group for QA-inter-institutional entity comprised of the Ministry of Education
Ministry of Labour National Adult Training Board ARACIP CNDIPT National Centre
for Teacher Training) and its rules of conduct
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
bullReasoning for and benefits of independent QAA Agencies
bullExisting approaches and models for independent QAA Agencies
bullLegal and normative frameworks and settings
bullSetting-up of independent QAA Agencies
bullAchieving mutual acceptance from involved stakeholders
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
Why ldquoexternal evaluationrdquo and independent QAA Agencies
bullImpartial eye - objectivity
bullCommon standards reference framework ndash comparability
bullFree from political influence - autonomy independence
bullMade by specialized staff - professionalism
bullTake into account the stakeholdersrsquo views - accountability
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Education institutions usually overestimate their level of
performance (fearing possible reactions from parents and students
and sanctions from local and national authorities )
Independent QAA Agencies act in order to
Certify the capacity of the education providers to meet the
customers expectations as well as the quality standards
Ensure the protection of the key and the consequent customers of
the study programs by producing and disseminating information
about quality education
Play a role in the development of a culture of quality in education
organizations
Recommend to the Ministry of Education and Research policies
and strategies in order to improve the quality of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
Public institution of national interest subordinated to the
Ministry of National Education with legal personality
established by Government Emergency Ordinance no
752005 regarding the quality assurance of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
ARACIS officially established by Government Emergency Ordinance No 75 for
Quality Assurance in Education of July 12th 2005 modified and approved by
Law 872006 Published in the Romanian Official Journal Part I No 334 of April
13th 2006 ndash modified by government emergency ordinance 752011
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP)
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
GNAC was set up in 2006 based on inter-institutional Agreement between
the Ministry of Education Ministry of Labour Romanian Agency for
Quality Assurance in Preuniversity Education National Authority for
Qualifications National Centre for TVET Development and with the
participation of social partners
What does actually an QAA Agency
Elaborates the standards the reference standards and the performance indicators the
regulations for the institutional evaluation and accreditation the manual of internal quality
evaluation the guides of good practices the annual report considering its own activity the
system analyses concerning quality on Romanian education recommendations for improving
the quality of education the professional code of conduct for the experts in evaluation and
accreditation
Accomplishes the evaluation for authorization and accreditation for all educational
organizations
Accomplishes every three years the recurrent evaluation of the accredited educational
organizations
Recommend to The Ministry of Education the authorization and the accreditation of
educational institutions for each level of education study program or professional
qualification
Accomplishes on a contractual bases at the Ministry of Education request the evaluation of
the quality of education system
Accomplishes the quality monitoring and control together with the School Inspectorates
(ARACIP) and the departments of the Ministry of Education
Publishes the results of the external evaluation
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
bullReasoning for and benefits of independent QAA Agencies
bullExisting approaches and models for independent QAA Agencies
bullLegal and normative frameworks and settings
bullSetting-up of independent QAA Agencies
bullAchieving mutual acceptance from involved stakeholders
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
Why ldquoexternal evaluationrdquo and independent QAA Agencies
bullImpartial eye - objectivity
bullCommon standards reference framework ndash comparability
bullFree from political influence - autonomy independence
bullMade by specialized staff - professionalism
bullTake into account the stakeholdersrsquo views - accountability
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Education institutions usually overestimate their level of
performance (fearing possible reactions from parents and students
and sanctions from local and national authorities )
Independent QAA Agencies act in order to
Certify the capacity of the education providers to meet the
customers expectations as well as the quality standards
Ensure the protection of the key and the consequent customers of
the study programs by producing and disseminating information
about quality education
Play a role in the development of a culture of quality in education
organizations
Recommend to the Ministry of Education and Research policies
and strategies in order to improve the quality of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
Public institution of national interest subordinated to the
Ministry of National Education with legal personality
established by Government Emergency Ordinance no
752005 regarding the quality assurance of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
ARACIS officially established by Government Emergency Ordinance No 75 for
Quality Assurance in Education of July 12th 2005 modified and approved by
Law 872006 Published in the Romanian Official Journal Part I No 334 of April
13th 2006 ndash modified by government emergency ordinance 752011
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP)
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
GNAC was set up in 2006 based on inter-institutional Agreement between
the Ministry of Education Ministry of Labour Romanian Agency for
Quality Assurance in Preuniversity Education National Authority for
Qualifications National Centre for TVET Development and with the
participation of social partners
What does actually an QAA Agency
Elaborates the standards the reference standards and the performance indicators the
regulations for the institutional evaluation and accreditation the manual of internal quality
evaluation the guides of good practices the annual report considering its own activity the
system analyses concerning quality on Romanian education recommendations for improving
the quality of education the professional code of conduct for the experts in evaluation and
accreditation
Accomplishes the evaluation for authorization and accreditation for all educational
organizations
Accomplishes every three years the recurrent evaluation of the accredited educational
organizations
Recommend to The Ministry of Education the authorization and the accreditation of
educational institutions for each level of education study program or professional
qualification
Accomplishes on a contractual bases at the Ministry of Education request the evaluation of
the quality of education system
Accomplishes the quality monitoring and control together with the School Inspectorates
(ARACIP) and the departments of the Ministry of Education
Publishes the results of the external evaluation
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
Why ldquoexternal evaluationrdquo and independent QAA Agencies
bullImpartial eye - objectivity
bullCommon standards reference framework ndash comparability
bullFree from political influence - autonomy independence
bullMade by specialized staff - professionalism
bullTake into account the stakeholdersrsquo views - accountability
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Education institutions usually overestimate their level of
performance (fearing possible reactions from parents and students
and sanctions from local and national authorities )
Independent QAA Agencies act in order to
Certify the capacity of the education providers to meet the
customers expectations as well as the quality standards
Ensure the protection of the key and the consequent customers of
the study programs by producing and disseminating information
about quality education
Play a role in the development of a culture of quality in education
organizations
Recommend to the Ministry of Education and Research policies
and strategies in order to improve the quality of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
Public institution of national interest subordinated to the
Ministry of National Education with legal personality
established by Government Emergency Ordinance no
752005 regarding the quality assurance of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
ARACIS officially established by Government Emergency Ordinance No 75 for
Quality Assurance in Education of July 12th 2005 modified and approved by
Law 872006 Published in the Romanian Official Journal Part I No 334 of April
13th 2006 ndash modified by government emergency ordinance 752011
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP)
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
GNAC was set up in 2006 based on inter-institutional Agreement between
the Ministry of Education Ministry of Labour Romanian Agency for
Quality Assurance in Preuniversity Education National Authority for
Qualifications National Centre for TVET Development and with the
participation of social partners
What does actually an QAA Agency
Elaborates the standards the reference standards and the performance indicators the
regulations for the institutional evaluation and accreditation the manual of internal quality
evaluation the guides of good practices the annual report considering its own activity the
system analyses concerning quality on Romanian education recommendations for improving
the quality of education the professional code of conduct for the experts in evaluation and
accreditation
Accomplishes the evaluation for authorization and accreditation for all educational
organizations
Accomplishes every three years the recurrent evaluation of the accredited educational
organizations
Recommend to The Ministry of Education the authorization and the accreditation of
educational institutions for each level of education study program or professional
qualification
Accomplishes on a contractual bases at the Ministry of Education request the evaluation of
the quality of education system
Accomplishes the quality monitoring and control together with the School Inspectorates
(ARACIP) and the departments of the Ministry of Education
Publishes the results of the external evaluation
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Education institutions usually overestimate their level of
performance (fearing possible reactions from parents and students
and sanctions from local and national authorities )
Independent QAA Agencies act in order to
Certify the capacity of the education providers to meet the
customers expectations as well as the quality standards
Ensure the protection of the key and the consequent customers of
the study programs by producing and disseminating information
about quality education
Play a role in the development of a culture of quality in education
organizations
Recommend to the Ministry of Education and Research policies
and strategies in order to improve the quality of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
Public institution of national interest subordinated to the
Ministry of National Education with legal personality
established by Government Emergency Ordinance no
752005 regarding the quality assurance of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
ARACIS officially established by Government Emergency Ordinance No 75 for
Quality Assurance in Education of July 12th 2005 modified and approved by
Law 872006 Published in the Romanian Official Journal Part I No 334 of April
13th 2006 ndash modified by government emergency ordinance 752011
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP)
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
GNAC was set up in 2006 based on inter-institutional Agreement between
the Ministry of Education Ministry of Labour Romanian Agency for
Quality Assurance in Preuniversity Education National Authority for
Qualifications National Centre for TVET Development and with the
participation of social partners
What does actually an QAA Agency
Elaborates the standards the reference standards and the performance indicators the
regulations for the institutional evaluation and accreditation the manual of internal quality
evaluation the guides of good practices the annual report considering its own activity the
system analyses concerning quality on Romanian education recommendations for improving
the quality of education the professional code of conduct for the experts in evaluation and
accreditation
Accomplishes the evaluation for authorization and accreditation for all educational
organizations
Accomplishes every three years the recurrent evaluation of the accredited educational
organizations
Recommend to The Ministry of Education the authorization and the accreditation of
educational institutions for each level of education study program or professional
qualification
Accomplishes on a contractual bases at the Ministry of Education request the evaluation of
the quality of education system
Accomplishes the quality monitoring and control together with the School Inspectorates
(ARACIP) and the departments of the Ministry of Education
Publishes the results of the external evaluation
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
Public institution of national interest subordinated to the
Ministry of National Education with legal personality
established by Government Emergency Ordinance no
752005 regarding the quality assurance of education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
ARACIS officially established by Government Emergency Ordinance No 75 for
Quality Assurance in Education of July 12th 2005 modified and approved by
Law 872006 Published in the Romanian Official Journal Part I No 334 of April
13th 2006 ndash modified by government emergency ordinance 752011
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP)
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
GNAC was set up in 2006 based on inter-institutional Agreement between
the Ministry of Education Ministry of Labour Romanian Agency for
Quality Assurance in Preuniversity Education National Authority for
Qualifications National Centre for TVET Development and with the
participation of social partners
What does actually an QAA Agency
Elaborates the standards the reference standards and the performance indicators the
regulations for the institutional evaluation and accreditation the manual of internal quality
evaluation the guides of good practices the annual report considering its own activity the
system analyses concerning quality on Romanian education recommendations for improving
the quality of education the professional code of conduct for the experts in evaluation and
accreditation
Accomplishes the evaluation for authorization and accreditation for all educational
organizations
Accomplishes every three years the recurrent evaluation of the accredited educational
organizations
Recommend to The Ministry of Education the authorization and the accreditation of
educational institutions for each level of education study program or professional
qualification
Accomplishes on a contractual bases at the Ministry of Education request the evaluation of
the quality of education system
Accomplishes the quality monitoring and control together with the School Inspectorates
(ARACIP) and the departments of the Ministry of Education
Publishes the results of the external evaluation
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP) -
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
ARACIS officially established by Government Emergency Ordinance No 75 for
Quality Assurance in Education of July 12th 2005 modified and approved by
Law 872006 Published in the Romanian Official Journal Part I No 334 of April
13th 2006 ndash modified by government emergency ordinance 752011
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP)
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
GNAC was set up in 2006 based on inter-institutional Agreement between
the Ministry of Education Ministry of Labour Romanian Agency for
Quality Assurance in Preuniversity Education National Authority for
Qualifications National Centre for TVET Development and with the
participation of social partners
What does actually an QAA Agency
Elaborates the standards the reference standards and the performance indicators the
regulations for the institutional evaluation and accreditation the manual of internal quality
evaluation the guides of good practices the annual report considering its own activity the
system analyses concerning quality on Romanian education recommendations for improving
the quality of education the professional code of conduct for the experts in evaluation and
accreditation
Accomplishes the evaluation for authorization and accreditation for all educational
organizations
Accomplishes every three years the recurrent evaluation of the accredited educational
organizations
Recommend to The Ministry of Education the authorization and the accreditation of
educational institutions for each level of education study program or professional
qualification
Accomplishes on a contractual bases at the Ministry of Education request the evaluation of
the quality of education system
Accomplishes the quality monitoring and control together with the School Inspectorates
(ARACIP) and the departments of the Ministry of Education
Publishes the results of the external evaluation
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Setting up an independent QA and Accreditation Agency
The external evaluation and Quality assurance in Romanian education
and training is coordinated through
The Romanian Agency for Quality Assurance in Preuniversitary
Education (ARACIP)
The Romanian Agency for Quality Assurance in Higher Education
(ARACIS)
The National Group for Quality Assurance is an additional informal
structure that ensures the coordination of quality assurance in all
education and training subsystems and functions as a national
reference point for quality assurance in education and training (GNAC)
GNAC was set up in 2006 based on inter-institutional Agreement between
the Ministry of Education Ministry of Labour Romanian Agency for
Quality Assurance in Preuniversity Education National Authority for
Qualifications National Centre for TVET Development and with the
participation of social partners
What does actually an QAA Agency
Elaborates the standards the reference standards and the performance indicators the
regulations for the institutional evaluation and accreditation the manual of internal quality
evaluation the guides of good practices the annual report considering its own activity the
system analyses concerning quality on Romanian education recommendations for improving
the quality of education the professional code of conduct for the experts in evaluation and
accreditation
Accomplishes the evaluation for authorization and accreditation for all educational
organizations
Accomplishes every three years the recurrent evaluation of the accredited educational
organizations
Recommend to The Ministry of Education the authorization and the accreditation of
educational institutions for each level of education study program or professional
qualification
Accomplishes on a contractual bases at the Ministry of Education request the evaluation of
the quality of education system
Accomplishes the quality monitoring and control together with the School Inspectorates
(ARACIP) and the departments of the Ministry of Education
Publishes the results of the external evaluation
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
What does actually an QAA Agency
Elaborates the standards the reference standards and the performance indicators the
regulations for the institutional evaluation and accreditation the manual of internal quality
evaluation the guides of good practices the annual report considering its own activity the
system analyses concerning quality on Romanian education recommendations for improving
the quality of education the professional code of conduct for the experts in evaluation and
accreditation
Accomplishes the evaluation for authorization and accreditation for all educational
organizations
Accomplishes every three years the recurrent evaluation of the accredited educational
organizations
Recommend to The Ministry of Education the authorization and the accreditation of
educational institutions for each level of education study program or professional
qualification
Accomplishes on a contractual bases at the Ministry of Education request the evaluation of
the quality of education system
Accomplishes the quality monitoring and control together with the School Inspectorates
(ARACIP) and the departments of the Ministry of Education
Publishes the results of the external evaluation
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The organizational structure of ARACIP
Management structures
The Council (15 members)
The President
The Vice-president
The two Heads of departments(accreditation and quality evaluation)
The Head of the economic and administrative Office
A legal counselor
9 experts
Executive Board (5 members)
The President
The Vice- president
The two Heads of the departments
The Headship of the economic and administrative Office
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
bullForms of ranking at national and international level
bullCommercial versus state-run ldquointernalrdquo rankings
bullRanking of teaching and research activities
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
HE level
An international body - the Association of European Universities -
hierarchized for the first time the study programs ( for academical year
2011-2012) offered by the accredited universities in Romania
Assessment for ranking universities was based on some of the following
criteria
a) teaching and learning
b) scientific research
c) artistic creation in the case of art universities
d) the relationship of the university with the external environment
e) institutional capacity
Each criterion was associated with a set of reference standards and each
set of standards is associated with a set of indicators
Standards and indicators used for the classification of universities can be
distinguished from those used for the purpose of ranking study
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
University curricula have been classified into five categories A B
C D and E Category A the best performing program and E the
least performing
Classification of universities in 3 categories according to art 193
of the National Education Law no 12011 was made on the basis
of GD 7892011
According to the law universities are classified in
bulluniversities centered on education
bulluniversities of education and scientific research or arts
education
bulladvanced research universities and education
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions
in order to find references for their managerial practices and for
comparing their performance The first direction is international
thus international rankings are considered relevant frameworks for
analysing the performance of a university
In 2016 a national Meta-ranking was published by a High-Level
Expert Group appointed the Ministry of Education(Romanian
Ministry of Education and Scientific Research 2016)
This ranking used 9 rankings selected based on the analysis of
IREG - Observatory on Academic Ranking and Excellence (IREG
Observatory on Academic Ranking and Excellence n d) and
UNESCO (UNESCO 2016)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Traditionally the Romanian universities are looking in two directions in
order to find references for their managerial practices and for comparing
their performance The first direction is international thus international
rankings are considered relevant frameworks for analysing the
performance of a university
In 2016 a national Meta-ranking was published by a High-Level Expert
Group appointed the Ministry of Education(Romanian Ministry of
Education and Scientific Research 2016) This ranking used 9 rankings
selected based on the analysis of IREG - Observatory on Academic
Ranking and Excellence (IREG Observatory on Academic Ranking and
Excellence n d) and UNESCO (UNESCO 2016)
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and
research)
(2) Center for World University RankingsCWUR (education and
research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World
UniversitiesPRSPWU (research)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The 9 rankings used are the following
(1) Academic Ranking of World UniversitiesARWU (education and research)
(2) Center for World University RankingsCWUR (education and research)
(3) Leiden RankingCWTS (research)
(4) Performance Ranking of Scientific Papers of World UniversitiesPRSPWU
(research)
(5) QS-Top Universities RankingQS(education and research)
(6) Scimago Institutions RankingScimago (mostly research)
(7) Times Higher Education - World University RankingsTHE (education and
research)
(8) University Ranking by Academic PerformanceURAP (research)
(9) Worlds Best Universities RankingsUS-News (research)
The second direction is national The reference is provided in this case by
ARACIS in the Methodology for external evaluation of universities and
programs
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
The practice of Rating and Ranking Models and criteria
VET level (pre-university level)
For the school ranking the Ministry of Education and County
School Inspectorates use the results of the pupils to the
national testing and the baccalaureate
In 2009 ARACIP began developing a contextualised attainment
model to take account of the factors that may have a strong
influence on strudentsrsquo learning outcomes ndash the efficiency
index This index measures a schoolrsquos actual results with the
schoolrsquos expected or predicted resultds based on its
characteristics and its students and teaching body
Since 2009 the index was tested in more than 2000 schools
and the Ministry of Education confirmed the intention to
extend the index to all schools
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
bullQualification requirements ndash training needs analysis
bullTraining providers for enhancing QA skills
bullRecruiting and staffing (internal and external)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and QAampA
Agency staff get competent for the job
Recruitment criteria
In compliance with the legal regulations on quality assurance in higher
education the ARACIS Council sets up the National Register of Evaluators
(NRE)
The evaluators are university professors and associate professors from
Romania and from abroad with recognized professional activity and moral
integrity with competence and experience quality assurance in education at
national and international level
For a more relevant evaluation of the link between higher education and
labor market from this year the NRE includes also representatives of
employers
NRE is structured in specialized commissions and within these ones in
study domains There are 14 academic commissions and a commission of
employers
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
The ARACIPrsquos external evaluators must
1048696 be qualified and experienced teachers
1048696 have expertise in evaluation (evaluation of institutions projects and staff)
1048696 provide evidence of professional competence (through personal achievement)
1048696 in the three years prior to selection participate in in-service education training
programmes (minimum of 40 hours)
A desirable but not essential attribute is management experience as a school head or
county inspector
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
Competences for QAampA development through
bullTraining courses
bullPeer learning
bullInternational cooperation
bullUsing guides and procedures
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
For example
After selection the future ARACIP evaluator takes a special compulsory training
course which is accredited and approved by ministerial order
The training lasts 89 hours with 60 hoursrsquo face to face training (theory and
exercises) 24 hoursrsquo work experience (shadowing an evaluator and filling in
evaluation reports) and five hoursrsquo assessment (presentation of a portfolio and an
interview)
The training course focuses on evaluating educational processes the school
development plan and school management and human and financial resources The
course also covers quality evaluation models (ISO and EFQM) system evaluation
and management skills
Since 2005 there were trained nearly 17000 people - of which more than 700
evaluators 600 trainers in quality over 900 school inspectors (with the role of quality
control) the remaining of about 15000 people being from schools - directors and
members in the evaluation and quality assurance committees (which by law must be
in place in each school)
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order
Peer Learning on Quality Assurance and Accreditation in HE and VET
26th - 28th February 2018
Almaty Kazakhstan
Competences for QAampA How Education Institutions and
QAampA Agency staff get competent for the job
After successfully completing the course the evaluator is
added to the National Register of Experts in Evaluation and
Accreditation
The evaluators are not ARACIPARACIS employees they work
under contract (lsquocivil contractrsquo) and are paid for each evaluation
report delivered
Evaluators are not allowed to evaluate schoolsuniversities in
their own county and their activities are regulated by a code of
conduct approved by ministerial order