evaluation of electronic mcq/emq examinations 2008/9

Evaluation of Electronic MCQ/EMQ Examinations

2008/9

Using the computer to record answers is easier

53

11

25

19

0

10

20

30

40

SD D NSF A SA

Reading and understanding questions is easier

8

12

20

12 11

0

10

20

30

40

SD D NSF A SA

I need the scrap paper provided

1 24

17

39

0

10

20

30

40

SD D NSF A SA

Easier to concentrate

1316

19

10

5

0

10

20

30

40

SD D NSF A SA

Uses less paper, which is important to me

6

1

31

19

6

0

10

20

30

40

SD D NSF A SA

Paper-based exams are more reliable

68

23

16

10

0

10

20

30

40

SD D NSF A SA

I prefer electronic format

9 9

14

18

13

0

10

20

30

40

SD D NSF A SA

I prefer paper-based format

5

2119

9 9

0

10

20

30

40

SD D NSF A SA

Student Comments

“It was easier to correct mistakes, but easier to make mistakes”

“Was simple and easy but the crashes were worrying”

“Inactivate the ‘Close Window’ icon which closes the paper if possible”

“It was easier to change answers electronically”

“Environment was more comfortable to work”

“Would be nice if the results were given after the exam”

“Sometimes it felt like the answers I recorded changed”

“Very difficult to constantly stare at the computer screen for long periods of time”

“Didn't feel like exam!”

“I got distracted when I noticed people have finished their exam”

“I think it was beneficial using the computers for examinations”

“Go back to paper examinations please”

“Computer is better as you don't need to rub out answers. It would be better if the text was in bold”

“A good system, with a few dramas”

“Much prefer the paper-based exams. Less distraction, easier to concentrate”

“Electronic format is easier to answer because questions and answers are done on the same page making it more efficient”

“Due to my dyslexia, the words jump around on the screen, but it was easier to correct mistakes made due to reading the question incorrectly”

“I find it hard not being able to highlight parts of the question. The text on the screen was quite small and I found myself straining to read the questions”

“I feel that I am more comfortable and used to using a paper-based exam. I prefer using paper. Computers are difficult to concentrate on for a long time”

“Computer is good because it ensures that you don't miss an answer resulting in every following answer being correct. Paper is better in that you don't worry about it crashing”

“It is possible to see other people's choices for EMQs! This is not an issue with paper-based exams. Perhaps a solution to this problem would be to randomize the 5 questions within the EMQ itself?”

“I much prefer the paper format, using the computers hurts my eyes and is uncomfortable. The advantage of them being marked straight away is not passed on as we still receive the results a month later”

“Looking at the computer strained my eyes and the computer crashed causing me to have to write out my answers from the beginning which was an inconvenience. I also did not like the fact that people could easily see your answers - not because of copying, it was just intimidating”

“It took time to get used to the electronic format and answer checking system, however once this happened I was confident using the e-system. I prefer to annotate my exam question paper rather than use scrap paper however this did not prove any real detriment to me overall (hopefully!)”

“My eyes often strained whilst doing the exams, as I find looking at a bright screen for long periods of time tiring. This is certainly inferior to written work where no such problem occurs. Displaying answers for others to see can also be uncomfortable in practice. In short, I do not rate this method”

“I definitely did not find using an electronic answer sheet difficult. However, it was a little distracting and there was a constant doubt if it gets lost or my selection did not go through appropriately. Having said that, I would prefer to do electronic exams instead of paper exams”