evaluation of civil engineering student attainment
TRANSCRIPT
EVALUATION OF CIVIL ENGINEERING
STUDENT ATTAINMENT MEASUREMENT
SYSTEM - A SATISFACTION SURVEY
M Mazlina, Oh Chai Lian, Mohd Raizamzamani Md Zain, Balqis Md Yunus, Norbaya Hj. Sidek
Faculty of Civil Engineering, Universiti Teknologi MARA (UiTM),
40450 Shah Alam, Selangor, Malaysia
PRESENTATIONOUTLINE
INTRODUCTION
MyCOPO POs
ATTAINMENT MODEL
METHODOLOGY
RESULTS AND
DISCUSSION
CONCLUSIONS
INTRODUCTION
The Outcome-Based Education (OBE) is designed to focus and organize the
process of learning and its final outcome in which reflecting the achievement of
students at the end of their learning experiences.
FCE, UiTM
implemented
OBE since
2004
Qualifying requirement
in the accreditation of
engineering
programme by EAC,
Malaysia.
CHALLENGES:
Data complexity โ too many data and
variables
The accuracy of data - that certain
measurement or data might be left
out that might be equally important
The teaching, learning and assessment methods
shall be performed consistently in accordance to
the appropriate graduate attributes as listed in the
Programme Educational Objectives (PEO),
Program Outcome (PO) and Course Outcome
(CO) of the education content.
EAC (2020)
SOLUTION:
Develop assessment tool โ a
computerized assessment tools
to accurately measure the
student PO attainmentMyCOPO โ developed by
FCE, UiTM in 2014
Figure 1. PO linking to PEOs and the Vision and Mission of UiTM
PO1
PO2
PO3
PO4
PO5
PO6
PO7
PO8
PO9
PO10
PO11
PO12
Figure 2. Sample of MyCOPO output
PO1 PO12
MyCOPOPOs ATTAINMENT
MODEL
Estimation of Individual Student PO Attainment
Table 1. Assessment in Dynamics Course ECS429 addressing PO1 (Example)
Assessment Assigment/
Project
Common Test Final Exam
Question (Q) Assignment 1 Q1(a) Q2(a) Q1(a), Q2(a)
Marks Obtained 10 8 12 38
Full Marks 15 15 15 50
Weightage 10% 15% 15% 60%
Based on this assessment (see, Table 1), the attainment of PO1 by student X
evaluated from Dynamics course ECS429 are given as in Equation (1).
PO1 =10
1510% +
8
1515% +
12
1515% +
38
5060% = 72.3% (1)
Average PO =ฯ ๐๐ ๐๐ ๐๐๐๐๐๐ก๐ ร ๐๐1 ๐๐๐๐๐
ฯ ๐๐ ๐๐ ๐๐๐๐๐๐ก(2)
Cumulative PO =ฯ ๐๐ ๐๐ ๐๐๐๐๐๐ก๐ ร ๐๐ ๐๐๐๐๐ + โฏ+ฯ ๐๐ ๐๐ ๐๐๐๐๐๐ก๐ ร ๐๐ ๐๐๐๐๐
ฯ ๐๐ ๐๐ ๐ก๐๐ก๐๐ ๐๐๐๐๐๐ก(3)
PO1 from Dynamic Course ECS429 Semester Y1
PO1 for Semester Y1
PO1 for Semester Y1, Y2, Y3โฆโฆ.Yn
PO performance indicators
Table 2. Key Performance Indicator
(KPI) for attainment of PO
PO score
(%)
Category Indicator
80-100 Excellent
PASS60-79 Good
50-59 Satisfactory
0-49 Fail FAIL
METHODOLOGY
A Quantitative Survey
Set A (Staff)47 out of 105
(44.8%) academic staff
Set B (Student)
227 out of 1730 (13.12%)
Year 1 to Year 4 undergraduate
students
between 23rd-29th October 2019
Survey link provided by
google form was announced
through chat media, circulated
among staff and students in the
faculty.
Participation in the survey was
solely voluntary.
Figure 3. Main characteristics in questionnaires
approximately 15 questions
preceded by few demographic
questions and the remaining
with specific questions on
MyCOPO system.
RESULTS AND
DISCUSSION
RESULTS AND
DISCUSSION
01
02
03
IMPACT OF
MyCOPO
DELIVERY AND
QUALITY OF THE SYSTEM
USERโSโ HAPPINESS INDEX RATING
IMPACT OF MyCOPO
Staff Survey
(47 Respondents)
Student Survey
(227 Respondents)
How do you rate MyCOPO?
94% 86%
Figure 4. Staff and students rating on MyCOPO system
IMPACT OF MyCOPO Staff Survey
(47 Respondents)
Before the implementation of MyCOPO: How
long would you think the analysis of the
cumulative and averaged POs attainment for
each student can be done once you have
submitted the POs data for your own
groups/courses?
49% 98%
After the implementation of MyCOPO: How
long would you think the analysis of the
cumulative and averaged POs attainment for
each student can be done once you have
submitted the POs data for your own
groups/courses?
Figure 5. Comparison of time allocation for analysis before and after MyCOPO implementation
DELIVERY AND QUALITY OF THE SYSTEMMyCOPO is easily accessible.
Staff Survey
(47 Respondents)
The process of uploading POs data
in MyCOPO is fast, easy and user
friendly.
98%
MyCOPO is flexible and can adopt
changes made in curriculum review
(i.e. change in POs, new courses).
96%
85%
Figure 6. Data from academic staff survey on delivery and quality of the system
DELIVERY AND QUALITY OF THE SYSTEM
Student Survey
(227 Respondents)MyCOPO is easily accessible.
62%
I can easily understand my
POs attainment from the data
presentation of MyCOPO.
66%
Figure 7. Data from studentsโ survey on delivery and quality
Usersโ Happiness Index Rating
Student Survey(227 Respondents)
Are you happy to have MyCOPO in the faculty?
Figure 4. Staff and students rating on MyCOPO system
Staff Survey (47 Respondents)
0
10
20
30
40
50
60
70
80
1 2 3 4 5 6 7 8 9 10
Staff
Student 8.2
7.2
81%
69%
< 5 Unhappy
5 โ 6 Satisfactory
7 โ 8 Happy
9 โ 10 Strongly Happy
Happy Strongly Happy
RECOGNITION โ COPYRIGHT
RECOGNITION โ INNOVATION (IIDEX & ITEX & OE)
CONCLUSIONS
Reduction in term of time consumption by the academic staff for POs analysis as well as cost of material and workforce.
DELIVERY AND QUALITY OF THE SYSTEM
USERโSโ HAPPINESS INDEX RATING
IMPACT OF MyCOPO1
Easily accessible, user friendly and has the ability to cope with revised curriculum and POs mapping.
Helps student to monitor academic achievement.
Staff โ 8.2 (81%)Student โ 7.2 (69%)
2
3
THANK YOU
16-18 OCT 2020
MAZLINA MOHAMAD
SENIOR LECTURER
Faculty of Civil Engineering, Universiti Teknologi MARA (UiTM),
40450 Shah Alam, Selangor, Malaysia03-55435244012-9623873