pro-east workshop, may 9-11, 2007, rome, italy1 self-assessment report & on-campus evaluation...
TRANSCRIPT
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 1
Self-Assessment Report &
On-Campus Evaluation
How to plan & how to run
Professor Sergey Gerasimov
Siberian Transport University, RussiaAccreditation Board Member, RAEE
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 2
Outline
1. Self-Assessment Report
2. On-Campus Evaluation
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 3
Self-Assessment Report
CRITERIA AND PROCEDUREFOR ACCREDITING PROGRAMMES IN ENGINEERING
AND TECHNOLOGY
These criteria correspond with the Bologna follow-up activities and distinguish between programmes of the First and Second Cycles. The term "Cycle" is used to describe a study programme leading to an academic degree. In Russia the first cycle refers to bachelorbachelor programmes, while the second cycle encompasses both mastermaster and diplomadiploma specialistspecialist programmes.
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 4
Self-Assessment Report
CRITERION 1. PROGRAMME OBJECTIVESCRITERION 2. PROGRAMME CONTENTCRITERION 3. STUDENTS AND STUDY PROCESSCRITERION 4. FACULTYCRITERION 5. PROFESSIONAL QUALIFICATIONSCRITERION 6. FACILITIESCRITERION 7. INFORMATION INFRASTRUCTURESCRITERION 8. FINANCE AND MANAGEMENTCRITERION 9. GRADUATES
Common criteria
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 5
Self-Assessment Report
Criterion 1. Programme objectives
1.1 Each engineering programme must have:1.1.1 clearly stated and documented objectives that are in full
correspondence with the State Educational Standard, the institution mission and the needs of the programme constituencies;
1.1.2. a system for achievement of programme objectives and their improvement.
1.2 Programme objectives must be published and available for all the constituencies as well as shared by each faculty member participating in programme delivery.
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 6
Criterion 1. Programme objectives. FC EEE.
i) A solid mathematical and scientific background necessary to comprehend the fundamentals of engineering and to successfully obtain graduate degrees in engineering as well as in other professions.ii) A strong foundation in engineering areas relevant to current industry needs to allow them to compete for quality jobs.iii) An ability to apply design processes discipline, which will allow them to provide resourceful and innovative engineering solutions.iv) An ability to communicate effectively and to act with social, ethical and professional responsibility in their encounter with those inside and outside the engineering profession.v) An ability to use computers as a tool for analysis, design, simulation and control.vi) Strong laboratory skills that will allow them to design and conduct experiments with systems and instruments of various complexity.vii) An understanding of a need for lifelong learning and critical thinking required for entrepreneurship, competitiveness, leadership and adaptation to new challenges.viii) An understanding of social, business, industrial and human aspects as a complement to their engineering background.
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 7
Criterion 1. Programme objectives. SC EEE.
i). Creatively use their background in basic sciences and mathematics in solving engineering problems.ii). Use their expertise in certain areas of electrical engineering in solving engineering problems.iii). Innovatively apply design process to complex engineering problems.iv). Communicate effectively and to act with social and professional responsibility in their encounter with those inside and outside the engineering profession in an international level.v). Innovatively use computers as a tool for simulation, analysis, design, computing and control.vi). Design and carry out experiments with systems and instruments of various complexities and analyse their findings.vii). Creative, critical and model-based thinking and problem solving.viii). Ability to do research on important scientific and technical problems.ix). Ability to disseminate knowledge and publish research findings.x). Ability to function effectively in multidisciplinary research and development teams.
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 8
Criterion 1. Objectives vs. Curriculum. FC EEE.
Program Educational Objective Courses and/or Evaluation Processes
team work EEE 299, …. , 474; EEE 491, 492; GE 401-402; IEEE Student Activities; Robotics Club
basic sciences and mathematics MATH, 101, … 250; PHYS 101, 102; Math/Science/Basic Eng. Elective Sequence
electrical engineering areas All EEE Courses
apply design processes to engineering problems
EEE 102, 211, 212, 313, 314, 342, 352; EEE 299, 399; EEE 411,424, 428, 443, 451, 452, 474; EEE 491, 492;
communication skills ENG 101, 102; RUSSIAN 101, 102; EEE 299, 399, EEE 491, 492; GE 401-402
act with social, ethical and professional responsibility
GE 301, 304, 401-402; EEE 299, 399; Disciplinary Rules; Attitude of Faculty Members
computer skills CS 111, 112; All 3rd, 4th year EEE courses; MATH Courses
laboratory skills All 4 credit-hour EEE courses
Lifelong learning and critical thinking
HUM 111, 112; GE 304; EEE 211,299, 399; Attitude of Faculty Members
social, business, industrial and human aspects
GE 301, 304, GE 401-402; EEE 491, 492; Humanities and Social Sciences Electives
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 9
Self-Assessment Report
Criterion 2. Programme content
2.1. The programme must meet requirements of the State Educational Standard of the Russian Federation.2.2. The programme must have clearly stated and documented learning outcomes that correspond with the programme objectives.
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 10
Criterion 2. Programme outcomes. FC EEE.
a). an ability to apply knowledge of mathematics, science and engineeringb). an ability to design and conduct experiments, as well as analyze and interpret datac). an ability to design a system, component, or process to meet desired endsd). an ability to function on multi-disciplinary teamse). an ability to identify, formulate and solve engineering problemsf). an understanding of professional and ethical responsibilityg). an ability to communicate effectivelyh). the broad education necessary to understand the impact of engineering solutions in a global and societal contexti). a recognition of the need for and an ability to engage in life-long learning j). a knowledge of contemporary issuesk). an ability to use the techniques, skills and modern engineering tools necessary for engineering practice
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 11
Criterion 2. Programme outcomes. SC EEE.
a). an in-depth knowledge and understanding of the principles and recent trends of some branches of electrical and electronics engineering;b). an innovative ability to formulate and solve incompletely defined engineering problems in their area of expertise;c). an ability to apply design processes creatively to problems even having interdisciplinary features;d). an ability to identify, locate, obtain and evaluate required data in their investigations by way of designing and conducting observations, modelling, simulation, or experiments;e). a knowledge of the ethical, environmental and commercial constraints on engineering practice together with an understanding of applicable methods and techniques in interdisciplinary and complex engineering problems;f). function and communicate effectively as leader of a team that may be composed of different disciplines and demonstrate awareness of project management and business as well as the impact of engineering solutions in a societal and environmental context.
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 12
Correspondence between EUR-ACE & Program Outcomes
PROGRAM EUR-ACE
a b c d e f g h i j k
1. Knowledge and Understanding
2. Engineering Analysis
3. Engineering Design
4. Investigations
5. Engineering Practice
6. Transferable Skills.
FC EEE
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 13
Program Objectives vs. Outcomes
FC EEE
Program Objectives
i ii iii iv v vi vii viii
Program Outcomes
a a,e c f,g k a,b h,i j
SC EEE
ProgramObjectives
i ii iii iv v vi vii viii ix x
Program Outcomes
a a c e,f d d a,b,c a-e e, f c,e,f
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 14
Curriculum Characteristics vs. Program Outcomes. FC EEE.
0: None L: Low M: Medium H: HighEEE
Courses a b c d e f g h i j k
EEE 101 M M M 0 L M M L M L M
EEE 102 H H H 0 H 0 L L M L H
EEE 202 H M M 0 H 0 L L M L H
EEE 211 H H M L H H M H H M H
EEE 212 H H H L H 0 M L M L H
EEE 299 M M H H H H H H H H H
EEE 313 H H H M H 0 M 0 L M M
EEE 314 M H H L M 0 L M M M H
- - - - - - - - - - - -
EEE 424 H H M M H 0 0 L L H M
EEE 428 H H M 0 L 0 0 0 0 L L
EEE 429 H L M H H 0 L 0 M M M
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 15
Intended Learning Outcomes; Teaching and Learning Strategies and Methods; Assessment Strategies and Methods
A. Knowledge and Understanding (FC MEng)Learning Outcomes:A1 An advanced knowledge of a broad range of modelling methodologies…A2 Knowledge of fundamental design issues relevant to mechanical …A3, A4, A5, A6, A7…Teaching Strategy/MethodsThe main mechanism for imparting the above knowledge and understanding in A1-A6 is lectures, combined with tutorials, examples classes, activities and coursework. Design labs and CAD sessions are used for A2, whilst computer labs form part of the teaching methods for some of the numerically orientated option modules (A4)….Learning Strategy/MethodsStudents are required to support and reinforce lecture based knowledge transfer through private study, making use of recommended texts and web-based material. Tutorials allow lecture material to be discussed and supplemented…Assessment Strategy/MethodsFormative assessment of student progress on taught modules is affected through the use tutorial exercises and coursework in the form of written answers to set exercises and/or case-study reports…
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 16
On-Campus Evaluation. How to plan & how to run
«The place and time cannot be changed»
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 17
1. To assess in qualitative and quantitative terms those factors that can not be documented in a written questionnaire;
2. To scrutinize documentation presented by the University for accreditation;
3. To provide the University with the assessment of its strong points and shortcomings.
On-Campus Evaluation. Objectives of the examination team
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 19
17.00-19.00 Private Meeting of Panel and Academic Staff
19.00-20.00 Dinner at University Hotel
Day 0
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 20
8.30-9.30 Breakfast
10.00-10.30 Meeting with the administration of the University and the persons responsible for accreditation arrangements
10.30-11.00 Overview Presentation by Faculty of Engineering
11.00-13.30 Evidence of Achievement of the Programme Outcomes (Review of course work, examination questions and answers, laboratory reports and project work)
13.30-15.00 Lunch
15.00-16.30 Tour of University and related facilities (Library)
16.30-18.30 Tour of University and related facilities (Laboratories and
Departments of Mathematics and Natural Sciences) 18.30-19.00 Dinner at Hotel
19.00-20.00 Private meeting of Panel at Hotel
Day 1
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 21
8.00-9.00 Breakfast
9.00-10.30 Achievement of Programme Outcomes for Engineering Programme (Discussion between Panel and Academic Staff to cover all aspects of the programme)
10.30-13.30 Tour of University and related facilities (Departments of Engineering)
13.30-15.00 Lunch
15.00-16.00 Meeting/discussion with students on the programme
16.00-17.00 Meeting/discussion with graduates from the programme
17.00-18.00 Meeting/discussion with employers from programme being reviewed
18.00-19.00 Dinner at Hotel
19.00-20.00 Private meeting of Panel at Hotel
Day 2
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 22
8.00-9.00 Breakfast
9.00-12.00 Visit on the base enterprise
12.00-13.30 Evidence of Achievement of the Programme Outcomes (Review of course work, examination questions and answers, laboratory reports and project work)
13.30-14.30 Lunch
14.30-15.30
Evidence of Achievement of the Programme Outcomes (Review of course work, examination questions and answers, laboratory reports and project work). Private meeting of Panel to agree findings on Engineering Programme
15.30-16.30 Panel explains finding for the programme with Academic Staff
16.30-17.30 Conclusion of visit
18.00-19.00 Dinner
Day 3
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 25
Private Meeting of Panel and Academic Staff
17.00-19.00
Day 0
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 27
10.00-10.30
Day 1
Meeting with the administration of the University and the persons responsible for accreditation arrangements
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 28
Overview Presentation by Faculty of Engineering
10.30-11.00
Day 1
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 29
Evidence of Achievement of the Programme Outcomes (Review of course work, examination questions and answers,
laboratory reports and project work)
11.00-13.30
Day 1
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 30
15.00-16.30
Day 1
Tour of University and related facilities (Library)
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 31
16.30-18.30
Day 1
Tour of University and related facilities (Laboratories and Departments of Mathematics and Natural Sciences)
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 32
19.00-20.00
Day 1
Private meeting of Panel at Hotel
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 33
9.00-10.30
Day 2
Achievement of Programme Outcomes for Engineering Programme (Discussion between Panel and Academic Staff to cover all aspects of
the programme)
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 34
10.30-13.30
Day 2
Tour of University and related facilities (Departments of Engineering)
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 35
15.00-16.00
Day 2
Meeting/discussion with students on the programme
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 36
16.00-17.00
Day 2
Meeting/discussion with graduates from the programme(~ 10 graduates)
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 37
17.00-18.00
Day 2
Meeting/discussion with employers (~ 7) from programme
being reviewed
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 38
19.00-20.00
Day 2
Private meeting of Panel at Hotel
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 40
12.00-13.30 13.30-14.30 – обед 14.30-15.30
Day 3
Evidence of Achievement of the Programme Outcomes (Review of course work, examination questions and answers, laboratory reports and project work). Private meeting of Panel to agree findings on Engineering Programme
PRO-EAST Workshop, May 9-11, 2007, Rome, Italy 41
Panel explains finding for the programme with Academic Staff
15.30-16.30
Conclusion of visit
16.30-17.30
Day 3