tests that are administered at computer terminals, or on personal computers, are called computer-...

25

Upload: louise-sherman

Post on 17-Dec-2015

217 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests
Page 2: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Tests that are administered at computer terminals, or on personal computers, are called computer-assisted tests.

Page 3: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

The literature on computer-assisted language learning indicates that language learners have generally positive attitudes toward using computers in the classroom.

Page 4: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Receptive-response items-including multiple-choice, true-false, and matching items-are fairly easy to adapt to the computer-assisted testing medium. Relatively cheap authoring software like Testmaster (1988) can be used to create such tests. Even productive-response item types-including fill-in and cloze-can be created using authoring software like Testmaster. Unfortunately, the more interesting types of language tasks (e.g., role plays, interviews, compositions, oral presentations) prove much more difficult to develop for computer-assisted testing.

Page 5: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Why should we bother to create computer-assisted language tests at all? Aren't they really just a sophisticated version of the paper-and-pencil tests that they will probably be modeled on?

Page 6: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Two primary benefits can be gained from computer-assisted language testing:

Computer-assisted language tests can be individually administered, even on a walk-in basis. Thus group-administered tests and all of the organizational constraints that they impose will no longer be necessary.

Traditional time limits are not necessary. Students can be given as much time as they need to finish a given test because no human proctor needs to wait around for them to finish the test.

Page 7: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Advantages of CAT

The advantages of using computers in language testing can be further subdivided into two categories: testing considerations and human considerations.

Page 8: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Testing considerations

Computers are much more accurate at scoring selected-response tests than human beings are.

Computers are more accurate at reporting scores.

Computers can give immediate feedback in the form of a report of test scores, complete with a printout of basic testing statistics.

Page 9: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Some tests like (Computer Adaptive Testing) allows testers to target the specific ability levels of individual students and can therefore provide more precise estimates of those abilities.

The use of different tests for each student should minimize any practice effects, studying for the test, and cheating

Page 10: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Test security may be increased because hard copy test booklets are never compromised.

Computerized testing offers a number of options for timing and formatting. Therefore it has the potential to accommodate a wider range of item types.

These can include moving images, sounds

Page 11: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Human considerations

The use of computers allows students to work at their own pace.

CALTs generally take less time to finish than traditional paper-and-pencil tests and are therefore more efficient.

Page 12: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Students may find that CATs are less overwhelming (as compared to equivalent paper-and-pencil tests) because the questions are presented one at a time on the screen rather than in an intimidating test booklet with hundreds of test items.

Many students like computers and even enjoy the testing process

Page 13: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Neither answer sheets nor trained

test administrators are needed. Test

administrator differences are

eliminated as a factor in

measurement error.

Page 14: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Disadvantages of CAT

The disadvantages of using

computers in language testing can

be subdivided into two categories:

physical considerations and

performance considerations.

Page 15: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Physical considerations

Computer equipments may not

always be available, or in working

order.

Page 16: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Performance consideration

The presentation of a test on a computer may lead to different results from those that would be obtained if the same test were administered in a paper-and-pencil format.

Differences in the degree to which students are familiar with using computers or typewriter keyboards may lead to discrepancies in their performances on computer-assisted. (Computer anxiety )

Page 17: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Web-Based Testing (WBT)

A web-based test (WBT) is an

assessment instrument that is

written in the “language” of the web,

HTML.

Page 18: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Advantages of WBT

flexibility in time and space.

A WBT is very inexpensive for all parties concerned.

Immediate feedback.

Page 19: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Disadvantages of WBT

Lack of security with respect to cheating and item confidentiality.

Item confidentiality is also impossible to maintain, since test takers are not taking the test under controlled conditions, that is, they could just copy items off the screen. Also, items are downloaded into the web browser’s cache on the test taker’s computer.

Page 20: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

There are specific validity issues introduced by WBT that deserve attention.

Computer familiarity Roever (2001) found no significant correlation between self-assessments of Web browser familiarity and scores on a Web-based test of second language pragmatics taken by 61 intermediate-level English as a second language (ESL) learners in the English Language Institute at the University of Hawai'i: Browser familiarity only accounted for 1%-3% of the variance in scores.)

Page 21: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Typing speed.

Differences in test takers' typing

speed are potentially more serious

sources of error variance and are not

amenable to quick training.

(Although a simple time increase for

brief response items seems like an

obvious option)

Page 22: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Delivery failures and

speededness.

One issue in the development phase

of a Web-based test is to ensure that

the test does not "skip" items during

delivery due to technical problems.

Page 23: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Loading time and timer.

It is therefore important for timed

tests to stop the timer during

downloads and restart it when the

page is fully displayed.

Page 24: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Suggested softwares

http://www.freedownloadscenter.com/Best/free-quiz-maker.html

http://www.articulate.com/products/quizmaker.php

http://www.sameshow.com/quiz-creator.html http://www.teach-nology.com/downloads/test/ http://www.testmaker.com/ http://www.atrixware.com/site/subsites/main/

pages/downloads__software.php http://hotpot.uvic.ca/ http://wordwizard.scholastic.com/quizmaker/ http://www.easytestmaker.com/default.aspx http://www.testshop.com/

Page 25: Tests that are administered at computer terminals, or on personal computers, are called computer- assisted tests

Suggested online testing sites

http://a4esl.org/c/qw.html http://www.classmarker.com/ http://www.easytestmaker.com/ http://www.clickandlearn.cc/

folders.asp?action=display&record=18