marking systems, test evaluation, and test

21
MARKING SYSTEMS, TEST EVALUATION, AND TEST ADMINISTRATION Carolina Salazar 28.04.2014

Upload: maury-martinez

Post on 18-Dec-2014

68 views

Category:

Education


2 download

DESCRIPTION

Marking Systems, Test Evaluation and Test Administration

TRANSCRIPT

  • 1. Carolina Salazar 28.04.2014
  • 2. OBJECTIVE TEST TYPES Easy to mark Only one marker is needed High reliability E.g. multiple choice SUBJECTIVE TEST TYPES More difficult to mark More than one marker is advisable Low reliability E.g. oral tests, essays RIGHTWRONGRight Wrong
  • 3. AVOID SUBJECTIVE TESTS ALTOGETHER FACE INCONSISTENCIES OF HUMAN JUDGEMENT
  • 4. ASSESSOR ASSESSOR ASSESSOR HIGHER RELIABILITYBUT
  • 5. BUT TOO MANY COOKS SPOIL THE BROTH
  • 6. TOO MANY COOKS SPOIL THE BROTHSOLUTION FEWER ASSESSORS DIFFERENT ROLES AGREED SCORE SOLVED DISCREPANCIES
  • 7. BETTER ASSESSORS MORE CONSISTENT PROGRAMS EXERCISES MORE RELIABLE STANDARDS
  • 8. SPECIFY APPROACH IN ADVANCE SAVE UNCERTAINTY SAVE TIME SAVE MONEY
  • 9. ANTICIPATE PROBLEMS AND SUGGEST HOW TO COPE WITH THEM MAINTAIN THE AIMS OF THE TEST GIVE GENERAL GUIDELINES FOR DEALING WITH UNCOMMON RESPONSES DESCRIBE THE PURPOSE OF EACH QUESTION
  • 10. HOLLISTIC TEST OVERALL PROFICIENCY ATOMISTIC ASSESS SPECIFIC SKILLS Least reliable Most reliable
  • 11. NOT ALL CATEGORIES IN A TEST ARE EQUALLY IMPORTANT LESS IMPORTANT MORE IMPORTANT
  • 12. DESCRIPTION OF LEVELS LANGUAGE ABILITY TYPICAL LEARNERBUT
  • 13. BUT FEW LEARNERS ARE TYPICAL CREATE PROFILES AND CATEGORIES
  • 14. CONTINUITY!
  • 15. OVERALL PERFORMANCE NO SYSTEM FOR COUNTING ERRORS SINGLE SCALE FOR ENTIRE TEST QUICK PROCEDURE SUBJECTIVE JUDGEMENT ADVISABLE TO COMBINE IT WITH OTHER MARKING SYSTEM
  • 16. PREPARED LIST OF FEATURES 1 MARK FOR EACH FEATURE STARTS WITH ZERO INCREMENTAL MARKING SYSTEM
  • 17. PREPARED LIST OF FEATURES SUBSTRACTION OF 1 MARK FOR EACH MISTAKE ENDS WITH A MINIMUM OF ZERO UNSUITABLE FOR CERTAIN CATEGORIES (STYLE, CONTENT) ADVISABLE TO COMBINE IT WITH OTHER TECHNIQUES