designing classroom tests: 6 critical questions

39
Designing Classroom Language Tests: 6 Cri&cal Ques&ons Eddy White, Ph.D. Assessment Coordinator Center for English as a Second Language University of Arizona

Upload: eddy-white-phd

Post on 05-Dec-2014

5.024 views

Category:

Education


3 download

DESCRIPTION

This slide show was used for classroom based assessment teacher training at Universidad del Norte in Barranquilla, Colombia (April, 2012).

TRANSCRIPT

Page 1: Designing Classroom Tests: 6 Critical Questions

DesigningClassroom

LanguageTests:6Cri&calQues&ons

EddyWhite,Ph.D.AssessmentCoordinator

CenterforEnglishasaSecondLanguage

UniversityofArizona

Page 2: Designing Classroom Tests: 6 Critical Questions
Page 3: Designing Classroom Tests: 6 Critical Questions

Thegoalofassessmentisto...

Page 4: Designing Classroom Tests: 6 Critical Questions

The goal of assessment has to be, above all, to support the improvement of

learning and teaching.

(Fredrickson&Collins,1989)

Page 5: Designing Classroom Tests: 6 Critical Questions

2010

Bestresourceforclassroom‐basedassessmentfor

ESL/EFL

[Source]

Page 6: Designing Classroom Tests: 6 Critical Questions
Page 7: Designing Classroom Tests: 6 Critical Questions

Whatisatest?

Page 8: Designing Classroom Tests: 6 Critical Questions

:theword‘test’

•  canrefertotradiPonal‘paperandpencil’orcomputerbasedtests(e.g.mulPplechoice,fill‐ins,shortanswers,essays,etc.)

•  or‘performanceassessments’(presentaPons,projects,interviews,orotheralternaPveassessments)

Page 9: Designing Classroom Tests: 6 Critical Questions

Atest...•  isamethodofmeasuringaperson’sability,knowledge,orperformanceinagivendomain.

•  isaninstrument–asetoftechniques,procedures,oritems–thatrequiresperformanceonthepartofthetest‐taker.

Page 10: Designing Classroom Tests: 6 Critical Questions

Tests–measuringfunc&on

Page 11: Designing Classroom Tests: 6 Critical Questions

Atestmustmeasure•  Sometestsmeasuregeneralability,whileothersfocusonveryspecificcompetenciesorobjecPves.

•  Examples

•  AmulP‐skillproficiencytestmeasuresgeneralability;

•  aquizonrecognizingcorrectuseofdefinitearPclesmeasuresveryspecificknowledge.

Page 12: Designing Classroom Tests: 6 Critical Questions

•  Atestmeasuresperformance,...

• but,theresultsimplythetest‐takersability,orcompetence.

Page 13: Designing Classroom Tests: 6 Critical Questions

•  Performance‐basedtestssamplethetest‐takersactualuseoflanguage,

•  butfromthosesamplesthetestadministratorinfersgeneralcompetence.

Page 14: Designing Classroom Tests: 6 Critical Questions

•  Awell‐constructedtestisaninstrumentthatprovidesanaccuratemeasureofatest‐taker’sabilitywithinaparPculardomain.

•  Construc&ngagoodtestisacomplextask.

Page 15: Designing Classroom Tests: 6 Critical Questions

TestsareessenPalcomponentsofa

successfulcurriculum.

Page 16: Designing Classroom Tests: 6 Critical Questions
Page 17: Designing Classroom Tests: 6 Critical Questions

‘Assessmentneedstobe‘fitforpurpose’

Page 18: Designing Classroom Tests: 6 Critical Questions

Assessmentisanareawherecontextisofparamountimportance.

(Brown&Abeywickrama,2010)

 Assessmentthatisfitforpurposeusesthebestmethodsofassessmentappropriateto:

 ‐thecontext  ‐thestudents  ‐thelevel  ‐thesubject  ‐theinsPtuPon

Page 19: Designing Classroom Tests: 6 Critical Questions

DesigningClassroomLanguageTests:6CriPcalQuesPons

Page 20: Designing Classroom Tests: 6 Critical Questions

ThesesixquesPonsshouldformthebasisofyourapproachtodesigning,administering,andmakingmaximumuseoftestsinyourclassroom.

Page 21: Designing Classroom Tests: 6 Critical Questions

1.Whatisthepurposeofthetest?

Page 22: Designing Classroom Tests: 6 Critical Questions

1.TestPurpose?•  WhyareyoucreaPngthistest,orwhywasitcreatedbyatextbookwriter.

•  WhatisitssignificancerelaPvetoyourcourse(forexample,toevaluateoverallproficiencyorplaceastudentinacourse)?

•  Howimportantisthetestcomparedtootherstudentperformance?

•  Whatwillitsimpactbeonyouandyourstudentsbeforeanda`ertheassessment?

Page 23: Designing Classroom Tests: 6 Critical Questions

Onceyouhaveestablishedthemajorpurposeofatest,itthenbecomeseasier

tospecifyitsobjecPves.

Page 24: Designing Classroom Tests: 6 Critical Questions

2.Whatarethe

objecPvesofthetest?

Page 25: Designing Classroom Tests: 6 Critical Questions

2.Testobjec&ves?

• Whatexactlyareyoutryingtofindout?

• Whatlanguageknowledgeand/orskillsareyouassessing?

Page 26: Designing Classroom Tests: 6 Critical Questions

3.HowwillthetestspecificaPonsreflectboththepurposeandtheobjecPves?

Page 27: Designing Classroom Tests: 6 Critical Questions

3.Testspecifica&ons?•  Todesignorevaluateatest,youmustmakesurethatthetesthasastructurethatlogicallyfollowsfromtheunitorlessonitistesPng.

•  TheclassobjecPvesshouldbepresentinthetestthroughappropriatetasktypesandweights,alogicalsequence,andavarietyoftasks.

Page 28: Designing Classroom Tests: 6 Critical Questions

4.Howwillthetestitemtypes

(tasks)beselectedandtheseparate

itemsarranged?

Page 29: Designing Classroom Tests: 6 Critical Questions

4.Selec&on&ArrangementofTasks?

•  ThetesttasksneedtobepracPcal.•  Forthetesttobevalid,theyshouldalsomirrortasksofthecourse,lessonorsegment.

•  TheyshouldbeauthenPc(i.e.reflectreal‐worldlanguageuse).

•  Thetasksmustbeonesthatcanbeevaluatedreliablybytheteacher.

Page 30: Designing Classroom Tests: 6 Critical Questions

5.Inadministeringthetest,whatdetailsshouldI

ahendtoinordertohelpstudentsachievetheirbestperformance?

Page 31: Designing Classroom Tests: 6 Critical Questions

5.HelpingStudentsAchieveBestPerformance?

•  Oncethetesthasbeencreatedandisreadytoadminister,studentsneedtofeelwellpreparedfortheirperformance.

•  AnotherwiseeffecPve,validtestmightfailtoreachitsgoalifthecondiPonsfortesttakingareinadequatelyestablished.

•  Howwillyoureduceunnecessaryanxietyinstudents?

•  Howwillyouraisetheirconfidence?•  Howwillyouhelpthemviewthetestasanopportunitytolearn?

Page 32: Designing Classroom Tests: 6 Critical Questions

6.Whatkindofscoring,

grading,and/orfeedbackisexpected?

Page 33: Designing Classroom Tests: 6 Critical Questions

6.Scoring,Grading,Feedback?

•  Theappropriateformoffeedbackontestswillvary,dependingonthepurpose.

•  Foreverytest,thewayresultsarereportedisanimportantconsideraPon.

•  Undersomecircumstances,alehergradeorscoremaybeappropriate.

•  Othercircumstancesmayrequirethattheteacherprovidedetailedfeedbacktothestudents.

Page 34: Designing Classroom Tests: 6 Critical Questions

DesigningClassroomLanguageTests:6CriPcalQuesPons

Page 35: Designing Classroom Tests: 6 Critical Questions

ThesesixquesPonsshouldformthebasisofyourapproachtodesigning,administering,andmakingmaximumuseoftestsinyourclassroom.

Page 36: Designing Classroom Tests: 6 Critical Questions
Page 37: Designing Classroom Tests: 6 Critical Questions
Page 38: Designing Classroom Tests: 6 Critical Questions

2010[Source]

Page 39: Designing Classroom Tests: 6 Critical Questions

DesigningClassroom

LanguageTests:6Cri&calQues&ons

EddyWhite,Ph.D.AssessmentCoordinator

CenterforEnglishasaSecondLanguage

UniversityofArizona