assessing language for specific purposes - cambridge...
TRANSCRIPT
![Page 1: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/1.jpg)
Assessing language for specific purposes —
The role of background knowledge
Christian Krekeler Deutsch als Fremd- und Fachsprache
Konstanz University of Applied Sciences [email protected]
![Page 2: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/2.jpg)
Assessing language for specific purposes — The role of background knowledge
1. The validity argument 2. Strategies 3. Conclusion
Validity Strategies Conclusion
![Page 3: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/3.jpg)
The validity argument
![Page 4: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/4.jpg)
Validity of Language Tests Validity Strategies Conclusion
Language Competence
![Page 5: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/5.jpg)
Validity of Language Tests Validity Strategies Conclusion
Language Competence
Future Performance Language Use
![Page 6: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/6.jpg)
Language Competence
Future Performance Language Use
Test Performance
Test
Test Score
Validity of Language Tests Validity Strategies Conclusion
![Page 7: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/7.jpg)
Validity of Language Tests
Language Competence
Future Performance Language Use
Test
Validity Strategies Conclusion
![Page 8: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/8.jpg)
Validity of Language Tests
Language Competence
Future Performance Language Use
Test
Interpretation
Validity Strategies Conclusion
![Page 9: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/9.jpg)
Mechanical Engineering 1 (ME1) Validity Strategies Conclusion
![Page 10: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/10.jpg)
Future Performance Language Use
Validity of Language Tests
Language Competence Background Knowledge
Test
Validity Strategies Conclusion
![Page 11: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/11.jpg)
Future Performance Language Use
Validity of Language Tests
Language Competence Background Knowledge
Test
construct irrelevant variance
Validity Strategies Conclusion
![Page 12: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/12.jpg)
Specific Purpose Language Use
Validity of Specific Purpose Language Tests
Language Competence Background Knowledge
Validity Strategies Conclusion
![Page 13: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/13.jpg)
Specific Purpose Language Use
Specific Purpose Language Ability
Validity of Specific Purpose Language Tests
“Specific purpose language ability results from the interaction between specific purpose background knowledge and language ability.” (Douglas, 2000: 40)
Language Competence Background Knowledge
Validity Strategies Conclusion
![Page 14: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/14.jpg)
Specific Purpose Language Use
Specific Purpose Language Ability
Validity of Specific Purpose Language Tests
Specific Purpose Language Test
Validity Strategies Conclusion
![Page 15: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/15.jpg)
Specific Purpose Language Use
Specific Purpose Language Ability
Validity of Specific Purpose Language Tests
A specific purpose language test is one in which test content and methods are derived from an analysis of a specific purpose target language use situation, so that test tasks and content are authentically representative of tasks in the target situation […]. Such a test allows us to make inferences about a test taker's capacity to use language in the specific purpose domain (Douglas, 2000: 19).
Validity Strategies Conclusion
![Page 16: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/16.jpg)
Specific Purpose Language Use
Specific Purpose Language Ability
Validity of Specific Purpose Language Tests
Specific Purpose Language Test
Validity Strategies Conclusion
![Page 17: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/17.jpg)
Specific Purpose Language Use
Specific Purpose Language Ability
Validity of Specific Purpose Language Tests
Specific Purpose Language Test
Validity Strategies Conclusion
![Page 18: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/18.jpg)
background knowledge • contaminates the
validity argument • is regarded as
construct irrelevant variance
Validity of Specific Purpose Language Tests
background knowledge • is part of specific
purpose language ability
• the validity of specific purpose language tests is limited to a specific language use domain
Validity Strategies Conclusion
![Page 19: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/19.jpg)
Strategies for writing task design in language for specific purposes tests
![Page 20: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/20.jpg)
Language for specific purposes testing • general language tests • language for general academic purposes tests • language for business purposes tests
background knowledge =
contamination of construct = threat to validity
Validity
Conclusion Strategies
![Page 21: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/21.jpg)
IELTS
Validity
Conclusion Strategies
![Page 22: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/22.jpg)
• avoiding subject specificity altogether • minimise the role of background knowledge • using general tests • creating the atmosphere of specificity
Validity
Conclusion Strategies
Strategy: Avoid specificity
![Page 23: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/23.jpg)
Role of Background Knowledge
Validity
Conclusion Strategies
![Page 24: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/24.jpg)
Role of Background Knowledge IELTS
Validity
Conclusion Strategies
![Page 25: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/25.jpg)
Language for specific purposes testing • law • engineering • aviation
Validity
Conclusion Strategies
![Page 26: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/26.jpg)
Validity
Conclusion Strategies
• reading tasks • gap filling tasks • listening tasks
Strategy: Avoid writing tasks
![Page 27: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/27.jpg)
• instructions • prompts • charts • pictures • texts • video clips with subject specific information
Validity
Conclusion Strategies
Strategy: Provide subject specific input
![Page 28: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/28.jpg)
Mechanical Engineering 1 (ME1) Validity
Conclusion Strategies
![Page 29: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/29.jpg)
Mechanical Engineering 2 (ME2) Validity
Conclusion Strategies
![Page 30: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/30.jpg)
Mechanical Engineering 3 (ME3) Validity
Conclusion Strategies
![Page 31: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/31.jpg)
Role of Background Knowledge
Validity
Conclusion Strategies
![Page 32: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/32.jpg)
Role of Background Knowledge
ME1 ME2 ME3
Validity
Conclusion Strategies
![Page 33: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/33.jpg)
• Guided writing tasks
Validity
Conclusion Strategies
Strategy: Control expected response
![Page 34: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/34.jpg)
ILEC/Cambridge English: Legal (CL1) Validity
Conclusion Strategies
![Page 35: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/35.jpg)
Role of Background Knowledge
ME1 ME2 ME3 CL1
Validity
Conclusion Strategies
![Page 36: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/36.jpg)
ILEC/Cambridge English: Legal (CL2) Validity
Conclusion Strategies
![Page 37: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/37.jpg)
Cambridge English: Legal (LE2)
http://www.cambridgeenglish.org/exams-and-qualifications/legal/
Validity
Conclusion Strategies
![Page 38: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/38.jpg)
Role of Background Knowledge
ME1 ME2 ME3 CL1 CL2
Validity
Conclusion Strategies
![Page 39: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/39.jpg)
• "translations" into a more subject specific register
Validity
Conclusion Strategies
Strategy: Use different registers
![Page 40: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/40.jpg)
TOLES/Test of Legal English Skills (LE1) Validity
Conclusion Strategies
![Page 41: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/41.jpg)
TOLES/Test of Legal English Skills (LE1) Validity
Conclusion Strategies
![Page 42: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/42.jpg)
TOLES/Test of Legal English Skills (LE1) Validity
Conclusion Strategies
![Page 43: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/43.jpg)
Role of Background Knowledge
LE1
Validity
Conclusion Strategies
![Page 44: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/44.jpg)
Register
Role of Background Knowledge
LE1 Validity
Conclusion Strategies
![Page 45: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/45.jpg)
Register
Role of Background Knowledge
LE1 Validity
Conclusion Strategies ME3
![Page 46: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/46.jpg)
Register
Role of Background Knowledge
LE1 Validity
Conclusion Strategies ME3 CL2
![Page 47: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/47.jpg)
Register
Role of Background Knowledge
LE1 Validity
Conclusion Strategies ME3 CL2 ME1 ME2 CL1
![Page 48: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/48.jpg)
Strategies for task design in language for specific purposes tests Validity
Conclusion Strategies
1. Avoid specificity 2. Avoid writing tasks 3. Provide subject specific input 4. Control expected response 5. Use different registers
![Page 49: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/49.jpg)
Conclusion
![Page 50: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/50.jpg)
Conclusion • role of background knowledge
• strategies
Englisch Auswirkung Rettung
Validity Strategies Conclusion
![Page 51: Assessing language for specific purposes - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · Assessing language for specific purposes — The](https://reader034.vdocument.in/reader034/viewer/2022042606/5f878e0d76a3d40c8a0404e7/html5/thumbnails/51.jpg)
Assessing language for specific purposes —
The role of background knowledge
Christian Krekeler Deutsch als Fremd- und Fachsprache
Konstanz University of Applied Sciences [email protected]