Slide 1

Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City ESG & current issues in Italy in the field of QA Muzio M. Gola vice-rector for Quality, Evaluation and Accreditation Politecnico di Torino Italy Slide 2 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City Creation and role of the new agency ANVUR (Agenzia Nazionale Valutazione del sistema Universitario e della Ricerca) est. by Law (n. 286) on 24/11/2006 it will supersede the present CIVR (eval. of research) and CNVSU (eval. of universities) will evaluate the quality of activities of universities and of public or private research institutions when publicly financed the efficiency and effectiveness of state grant & incentive programs for research and innovation Slide 3 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City mandate: - external evaluation of (as above) on the basis of yearly programs approved by the Ministry of University and Research - directing, coordinating and supervising evaluation activities assigned to the individual Evaluation Boards of universities and research institutions The results of ANVUR evaluation will be the benchmark for state financing of Us & R.I.s Operational rules were to be established through a later enacted Operation rules, then drafted in april 2007, parliamentary scrutiny completed in sept. 2007 Slide 4 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City ANVUR and its operation rules concern: - all italian universities, state or private, anyhow named, including special higher education institutions - all non-university research public organisations and research bodies under ministerial control, and those private research bodies recipient of public funds, as far as ministerial funds are concerned Slide 5 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City Operation rules Art. 2.2: The Agency has the task of promoting the quality of the italian system of universities and research Art. 2.4: (ANVUR) takes into account criteria and methods for evaluation recognised at international level, with particular reference to the objectives indicated by the European Council in Lisbon, march 24-24 2000, to the directives and recommendations of the European Union, to the actions within Bologna Process towards the EHEA (European Higher Education Area), specially to those contained in the communiqu of the Bergen inter-ministerial conference, may 19-20 2005 Slide 6 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City Operation rules Art. 2.6: (ANVUR) has the functions of national agency for quality assurance, as provided by the european accords it co-operates with international and European Union bodies, moreover with agencies and administrations of other EU countries or of anyway other states, with international scientific bodies active in the fields of evaluation of higher education and research Slide 7 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City Operation rules Art. 4.4: The Agency determines those qualitative and qualitative criteria in terms of stable human infra-structural and financial resources, adequacy of teaching Programmes and of research capability, which are binding when setting up new universities as well as putting into effect all university Programmes, including research Doctoral studies Slide 8 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City Operation rules Art. 4.5: In order to guarantee continuing quality of activities, the Agency defines criteria and parameters for the periodic accreditation of university educational structures and of research organisations, however envisaging the contribution of self- evaluation and to make sure, by means of inspections, that all set requisites be permanent fulfilled Slide 9 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City Operation rules (Organisation): President and Directorate in office for a duration of five years - President elected within and by the Directorate - Directorate composed of seven members with high qualification either in higher education, research, be it pure or applied / industrial, or in the evaluation of such activities Directorate members if public servants or employees of Italian research organisations and universities will be put on-leave for the whole duration of the appointment, and can neither be part of any selection committee nor recipients of public funds Slide 10 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City Operation rules (Organisation): Directorate members - are appointed by decree of the Premier on nomination by the Minister ( of university and research ) - must include at least two men and two women - two members are selected by the Minister from a list submitted by European Research Council and European University Association, containing 3+3 persons not belonging to italian universities and research organisations Slide 11 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City Operation rules (Organisation): Directorate members -the remaining five members are picked from a list of 15 to 20 persons indicated by a selection committee appointed by the Minister; the s.c. receives nominations from institutions, academies, scientific societies, individual experts, student organisations Slide 12 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City Time to action Start of activities is expected (call for nominations by the selection committee) by january 2008 selection, proposals to the Minister, appointments will require presumably additional six months ANVUR is expected to start operations in mid 2008, first effective impact at the earliest during first semester 2009 Slide 13 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City The background - 1 Theory and practice of Quality Assurance (and evaluation) of Programmes have been evolved mainly by: - the Standing Conference of Italian Rectors (CRUI), through the two experimental projects 1 - CAMPUS (1995-2000): 32 universities, 94 university diploma courses (mainly engineering and economics) and Slide 14 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City The background - 2 2 - CampusOne (2002-2004): around 300 Programmes in a wide variety of disciplines, developed and run in co-operation with Confindustria (Confederation of Industries), Unioncamere (Union of Chambers of Commerce), Trade Unions plus, in 2004-07, additional 200 Campus-like (volunteer or regional initiatives) and about 100 evolved CRUI model Slide 15 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City Core Principles CRUI Campus One 2002 Five Dimensions 1: Organisation Management system, Responsibilities, Review 2: Requirements and objectives Stakeholders requirements, Teaching aims and policies, Learning Outcomes 3: Resources Human resources, Infrastructures 4: Educational process Design, Implementation and learning, Support services 5: Results, Analysis, Improvement 2003 version at http://www.crui.it//data/allegati/links/902/GuiValimp.pdf http://www.crui.it//data/allegati/links/902/GuiValimp.pdf Slide 16 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City The background - 3 Other approaches have been pursued by CNVSU (National Commitee for the Evaluation of the University System), the former, leading to conclusions very near to those of CRUI CampusOne: Accreditamento dei Corsi di Studio (proposta di Modello Informativo per la Gestione in Qualit dei Corsi di Studio Universitari di I livello), RdR 1-01 June 2001 http://www.vsu.it/_library/downloadfile.asp?id=10680 http://www.vsu.it/_library/downloadfile.asp?id=10680 and the latter, containing an application framework: Modello informativo per laccreditamento dei Corsi di Studio, Rapporto finale del gruppo di ricerca Valutazione della didattica e accreditamento, RdR 01-04 February 2004 http://www.vsu.it/_library/downloadfile.asp?id=11141 available in english at: http://www.swas.polito.it/services/quafor/documentazione.asphttp://www.swas.polito.it/services/quafor/documentazione.asp Slide 17 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City The background - 4 which is now applied to Programmes (bachelor level) in four universities: 142 at Alma Mater University of Bologna 20 at University of Ferrara 154 at University of Roma1 La Sapienza 17 at Politecnico di Torino 233 Slide 18 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City CNVSU Q.A. Information Model Core Principles jan 2004 The Programme must be designed around professional roles and related Competencies which are in agreement with the needs of the employers and the labour market The Programme must be clearly deployed with up-to-date earning Outcomes, which are in agreement (content, amount, level) with the target competencies The Programme must expose the students to an appropriate learning environment, with up-to-date equipment The Programme appropriately certifies that Learning Outcomes have been reached, the exams have a certifying value Slide 19 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City CNVSU Q.A. Information Model The Framework jan 2004 The ( Q.A. ) Information Model is organised in Tables meant to give a clear and concise picture of the educational Programme on offer The ( Q.A. ) Information Model is structured in a modular manner, making it possible to be effectively used in a web medium, therefore allowing access by the public at large, making it an instrument for transparency and control. The ( Q.A. ) Information Model captures the critical information which is required by stakeholders such as employers, the labour market, students, educational policy makers, educational establishments Slide 20 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City The background - 5 Overall, pilot initiatives oriented towards quality assurance - number more than 800 (in great majority I cycle) - spanning the last 6 years - over a total number of Programmes in Italy approx. 3300 I cycle and 2200 II cycle Finally, an ISO inspired document has recently been developed: Applicare la norma UNI EN ISO 9001:2000 allattivit formativa universitaria, UNI Milano, june 2006 available through: http://www.uni.com/uni/controller/it/prodotti_servizi/libri_cdrom/qualita http://www.uni.com/uni/controller/it/prodotti_servizi/libri_cdrom/qualita Slide 21 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City The background - 6 In recent times (december 2006) CRUI-CampusOne and CNVSU-Information Model have converged to a common and agreed format, stabilised in a document edited by the CRUI Foundation: Requisiti per lAssicurazione della Qualit dei Corsi di Studio universitari http://www.fondazionecrui.it/HomePage.aspx?ref=739# The original CRUI and CNVSU models were largely inspired by the same criteria which drive ENQA Standards for internal quality assurance; this is confirmed and enhanced in the agreed december 2006 model, were explicit commitment to ENQA standards is made clear. Slide 22 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City Core Principles CRUI Foundation, dec. 2006 Requisites for Quality Assurance of Programmes A Programme imparts a quality education only if: it specifies worthwhile learning goals enables students to achieve them and guarantees a correct assessment of results it avails itself of human resources, infrastructures, services adequate to the achievement of learning goals performs monitoring of resources and activities and promotes continuous improvements it avails itself of an organisation committed to Quality and to warrant public information on the Programme Slide 23 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City Quality Areas(n.) Quality Requir.sENQA standards A Needs & objectives (n. 3) profession, competencies, learning outcomes 1.2 Approval, monitoring & periodic review of Programmes and awards B Educational process (n. 5) contents, methods, pre- requisites, planning, assessment 1.3 Assessment of students C Resources (n 4) faculty, staff, equipment & infrastructure, services & student support 1.4 Quality assurance of teaching staff 1.5 Learning resources & student support D Monitoring, Analysis & Improvement (n. 3) resources & processes, student progression and results, continuous improvement 1.6 Information systems E Organisation system (n. 5) management, processes, review, public information 1.1 Policy & procedures for quality assurance 1.7 Public information The framework CRUI Foundation, dec. 2006 Slide 24 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City Perhaps yes The recent Ministerial Decree (31.10.07) sets (Art. 1) requisites for Programmes: a) correct and complete communication of features of Programmes to students and all interested parties b) Quality Assurance of educational processes c) infrastructural and human resources which must be available in order to support Programmes related faculty qualifications d) min and max number of students enrolled in a Programme Quality Assurance at a compulsory national level: stands it within the prospects of belief? - 1 Slide 25 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City In Art. 3 requisites for Quality Assurance are defined: 1.Universities yearly define their educational offer assuring quality, efficiency and efficacy of Programmes 2. To this aim evaluation boards check satisfaction of requirements by means of indicators defined in a separate Annex A Quality Assurance prospects of belief? - 2 Slide 26 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City Annex A lists: Efficiency indicators - faculty commitment, credits and student progression, number of students enrolled and attending classes, adoption of a Quality System through a specific university body endorsed by CNVSU (later by ANVUR??) Efficacy indicators - assessment of previous knowledge at enrolment, student satisfaction on teaching modules, degree holders satisfaction on Programmes, job placement 1,3,5 years after degree Quality Assurance prospects of belief? - 3 Slide 27 Current trends in the European Quality Assurance and the Situation in Southern Europe Wednesday, 14 November 2007 Pontifical Academy of Sciences, Vatican City self evaluation of a quality barber bravo bravissimo Thank you