stockholm 14-17 oct 2013 washback of bih stanag 6001 test major drazen malesevic bih stanag 6001...

Stockholm 14-17 Oct 2013Stockholm 14-17 Oct 2013

Washback of BiH Washback of BiH STANAG 6001 testSTANAG 6001 test

Major Drazen MalesevicBiH STANAG 6001 team


OutlineOutlineDefinition of washbackTerms in usageMicro and macro level of impactImpact on educational system

(Impact of BiH STANAG 6001 test on ELT in AF BiH)Micro level of washbackTypes of washbackHow to achieve beneficial washbackConclusion


PURPOSEPURPOSE

To refer to the theory of washback To present the case of BiHTo analyze how to achieve beneficial washback


Definition of washback

Different definitionsDifferent terms

washback, backwash, impact


WASHBACK:The effect of testing on instruction

From: Dictionary of Language Testing, 1999


IMPACT

“Any of the effects that a test may have on individuals, policies or practices, within the classroom, the school, the educational system or society as a whole”

Wall (1997)


Washback

“the effects of tests on teaching and learning”

(Wall, 1997, p. 291)


Macro and micro level of impact

Macro level impact Impact on society and educational system

Micro level impact Impact on individuals involved in teaching and learning process

((Bachman and Palmer)Bachman and Palmer)


IMPACT ON SOCIETY

University admission exam in Liberia - None of 25 thousand students passed

(BBC NEWS, 26 August 2013)


IMPACT ON EDUCATIONAL SYSTEM(Impact of BiH STANAG 6001 test on ELT in AF BiH)

ELT since 1998BiH STANAG 6001 since 2009The same objective (competent English language speaker properly assessed to operate effectively in the English language environment)


ELT in AF BiH

Introduced in 1998Two different programs in the beginningFour levels of the course (elementary, pre-intermediate, intermediate and upper-intermediate)The length of all courses was 12 weeksAfter introducing STANAG 6001 five levels of the course (advance level of the course introduced)


ELT in AF BiH

Curriculum was changed after introducing STANAG 6001The length of the course remained the same, 12 weeksMore exercises were added to the curriculum in order to improve certain skill (listening, speaking, reading, writing)


Week 3 Monday Tuesday Wednesday Thursday Friday

08,30 – 09,15

Book 20 Lesson 1

Book 20 Lesson 1

Book 20 lesson 2

Book 20 lesson 2

Book 20

lesson 3 09,25 – 10,10

10,10– 10,40 Coffee break

10,40 – 11,25

Book 20

lesson 1

Book 20 lesson 1

Book 20 lesson 2

Book 20 lesson 2

Lab, cassette 3A i

3B

11,35 – 12,20

Lab cassette 1A i

1B

Lab, cassette 1C

1D

Lab, cassette 2A

i 2B

Lab, cassette 2C i

2D

Wrap-up of the week

12,20 –13,20 Lunch break

13,20 – 14,05

Book 20 lesson 1

Book 20 lesson 1

Book 20 lesson 2

Book 20 lesson 2

14,15 – 15,00


Week 3 Monday Tuesday Wednesday Thursday Friday

08,30 – 09,15

Book 20, lesson 1 Book 20, lesson 1 Book 20, lesson 2

Book 20, lesson 2

Book 20, lesson 3

09,25 – 10,10

10,10– 10,40 Coffee break

10,40 – 11,25

Book 20, lesson 1

Book 20, lesson 1 Book 20, lesson 2 Book 20, lesson 2 Lab,

cassette 3A i 3B

11,35 – 12,20

Lab,

cassette 1A i 1B

Lab, cassette 1C 1D

Lab, cassette 2A i 2B

Lab, cassette 2C i 2D

Wrap-up of the week

12,20 –13,20 Lunch break

13,20 – 14,05

Reading L1: IELTS 5, test 4 L2: NHUI U3, The man who sold his wife L3: Current topics

Listening L1: Lecture ready Business ethics

L2: NHUI U3, Talking about books + Suffixes and prefixes L3: Current topics

Writing L1: Writing an opinion composition: “This is my favorite sport” L2: Cause and effect paragraph L3: NHUI U3, A review of a book

Speaking L1: Presentation on a given topic ‘’Sports and Money’’ L2: NHUI TRP U3, L3: Current topics

14,15 – 15,00


Micro level of washbacktest takers

Officers, NCOs, civilians, MoD officialsinstructors


The stakes of STANAG 6001 test

Selection of personnel for: promotion to higher rankhigher positions military diplomatic representativesPSO missionsUN observer missionsSchools and courses abroad

(Book of rules)


The stakes of STANAG 6001 test

Promotion to higher rank in Montenegro:

Officers must have SLP 2222NCOs must have SLP 1111

(Law of service)


Types of washback

HarmfulHarmful

Beneficial Beneficial


How to achieve beneficial washback

Test the abilities whose development we want to Test the abilities whose development we want to encourageencourageSample widely and unpredictablySample widely and unpredictably

Hughes, p. 53-57Hughes, p. 53-57



Use direct testingUse direct testingMake testing criterion referencedMake testing criterion referenced




Base achievement tests on objectivesBase achievement tests on objectivesEnsure the test is known and understood by students and Ensure the test is known and understood by students and teachersteachers

Documents related to testing on MoD siteDocuments related to testing on MoD site Seminars related to testing organized for teachersSeminars related to testing organized for teachers




Where necessary, provide assistance to teachersWhere necessary, provide assistance to teachersCounting the costCounting the cost

PracticalityPracticalityHughes, p. 53-57Hughes, p. 53-57


ConclusionSTANAG test has a huge impact on:

individuals in AF BiHELT system

After introducing STANAG 6001:New level of course introducedCurriculum changed


ConclusionIs STANAG test mandatory after course?

It is not, but usually students obtain better resultsIt is not dependent on any course content

Are they interwoven?In a way, they are. (They both have the same objective, a competent and properly assessed language user)

They both have to keep their independence (even though, they are in a way interwoven)


Table of references:Lyle F. Banchman and Adrian S. Palmer, Language Testing in Practice: Designing and Developing Useful Language Tests, Oxford University Press;Arthur Hughes, Language Testing in Practice, Cambridge University Press;Harold S. Madsen, Techniques in Testing;Liying Cheng and Yoshinori Watanble, Washback in Language Testing: Research Contexts and Methods, LAWRENCE ERLBAUM ASSOCIATES, PUBLISHERS 2004 Mahwah, New Jersey London;J. CHARLES ALDERSON and DIANNE WALL, Does Washback Exist? Lancaster UniversityBBC News, http://www.bbc.co.uk/news/world-africa-23843578 Book of rules in AF BiH (related to promotion, carrier, education etc.)


Questions?