cefr & certification –for study Î workcefr – take home messages : • 9new validated...

38
Back to the Future Looking back - forward Peter Brown Founder Chair, Eaquals Director British School FVG Certification Conference University of Udine, 7 th October 2016 CEFR & Certification – for Study Work :

Upload: others

Post on 16-Mar-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

Back to the FutureLooking back - forward

Peter BrownFounder Chair, Eaquals

Director British School FVG

Certification Conference University of Udine, 7 th October 2016

CEFR & Certification – for Study Work :

Page 2: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

Theory without practice has no feet

Practice without theory has no head

Prof Enzo TontiUniversità di Trieste

Raising Standards – Take home messages :

Page 3: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

• Certification refers to the confirmation of certain characteristics of an object, person, or organization. This confirmation is often, but not always, provided by some form of external review, education, assessment, or audit. Accreditation is a specific organization's process of certification.

Certification – what is it? :

Page 4: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,
Page 5: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

• Only if in the student’s interests• Only when needed• Tests vs Exams• Purposes, “exits and entrances”, spendability• Transitional | school university work• Avoid conflicts of interest e.g. Targets |

cf the banking scandal of Wells Fargo (US)• Teaching to the test vs teaching language• If in doubt, don’t jump in | ask the experts

Certification – criteria: who for, when, why? :

Page 6: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

• https://www.britishcouncil.it/enlist of UK ‘enti certificatori’

• http://www.gmc-uk.org/doctors/licensing.aspfor Medicine: IELTS 7.5 requirement

• http://www.aisli.itfor the Italian quality association

• http://www.Eaquals.orgfor the international quality accreditation system ‘Garante’ - Ombudsman

Certification – always check :

Page 7: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

• All boards are recognised by OFQUAL (Office for Qualifications and Examinations Regulation) that regulates qualifications, exams and tests in England and vocational qualifications in Northern Ireland.

• Cambridge English Language Assessment (formerly known as University of Cambridge ESOL)

• City and Guilds (Pitman)• Pearson LCCI• Pearson Edexcel• Pearson EDI• ESB English Speaking Board• IELTS• TCL Trinity College London• AIM Awards

Certification – Recognised UK Exam Boards :

Page 8: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,
Page 9: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,
Page 10: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,
Page 11: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

• Pre-A1 absent | A1 extremely limited• C2 descriptors extremely limited• ‘plus’ levels• Phonology• Mediation• Pluricultural• Plurilingual• Young Learners

CEFR – wip | descriptors absent in original

Page 12: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,
Page 13: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

Unequal jumps

Raising Standards – each CEFR level ‘doubled’:

B2

C1

C2

B1A2A1

Page 14: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

Ch a

nce

to p

e rfo

r m t a

sk

50%

100%

0%

80%

A1 A2 B1 B2 C1 C2<A1

A2

45% This person will have 80% probability of being able to perform these A2 tasks

And a person at a lower lever will have less chance on the A2 tasks: 45%

CEFR scaled on IRT model

Page 15: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

Ch a

nce

to p

e rfo

r m t a

sk

50%

100%

0%

80%

15%

5%

C2

A1 A2 B1 B2 C1 C2<A1

C1B2B1A2A1

We find 50%.Now look at some more levels

95 % At Level A1

But only 15% at level B2

95%

The chance at level C2 is negligible- but not 0

CEFR scaled on IRT model

Page 16: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,
Page 17: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

the number of ...domains (school, work, home, etc.)functions (ask, command, inquire, etc.)notions (north, south, table, mother, cat, eat, drink, etc.)situations (meeting, e-mail, telephone, etc.)locations (market, school, police station, etc.)topics (weather, study, holidays, etc.)roles (listener in audience, participant in discussion, etc)

QUANTITY refers to:

... that a language user can deal with.

Page 18: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,
Page 19: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

Language use is effectiveleading to degree of precision

1) in understanding what is meant2) in expressing one’s meaning

leading to communication with the least possible effort

Language use is efficient

the degree to whichQUALITY refers to:

Page 20: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

Unequal jumps

Raising Standards – each CEFR level ‘doubled’:

B2

C1

C2

B1A2A1

Quantity

Quality

Quality

Quantity

Page 21: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

Certification – The CEFR Spectrum :

CEFR Spectrum

Quantity

Quality

Page 22: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

Certification – The CEFR Spectrum :

Page 23: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

Interpreting Results – is my B1 your B1?:

Page 24: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,
Page 25: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

Certification :– Scales – uses & limitations

‘MestreEffect’

Marginof error

Compara-bility

Page 26: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,
Page 27: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,
Page 28: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

CommunicativeStrategies

CommunicativeLanguage Competencies

CEFR Hierarchy of Scales

Reception Production

Understandinga native speaker

Conversation

InformalDiscussion

FormalDiscussion

Obtaining Goodsand Services

Interviewing &being interviewed

Spoken Written

Interaction Mediation

Overall language ProficiencyGlobal Scale

CommunicativeActivities

Note: this branch of the hierarchy is part of the Quantitydimension: how much a language learner can do

Page 29: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

• Pre-A1 | A0• C2 descriptors – much larger sample• ‘plus’ levels | A2+ | B1+ | B2+• Phonology• Mediation• Pluricultural• Plurilingual• Literature• 22 new scales e.g. on-line conversation &

discussion• Young Learners: 7 – 10 | 11 - 15

CEFR revision – thematic areas | all calibrated

Page 30: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

Unequal jumps

Raising Standards – each CEFR level ‘doubled’:

B2

C1

C2

B1A2A1

Quantity

Quality

A2+B1+

B2+

Quality

QuantityA0

Page 31: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

• 16 institutions participated from Italy• 10 universities: Bologna, Bolzano, Calabria,

Milano – Univ Catt., Padova, Parma, Perugia, Pisa, Siena, Trieste

• 4 institutions: Alliance Française, Centro Ling. Carabinieri, Institut Français - Milan, Instituto Monti – Asti

• AISLi• British School FVG• + 56 experts reviewed initial findings

CEFR revision – the Italian contribution:

Page 32: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,
Page 33: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

• Only if in the student’s interests• Only when needed• Tests vs Exams• Purposes, spendability• Transitional | school university work• Avoid conflicts of interest e.g. targets• Teaching to the test vs teaching language• If in doubt, don’t | ask the experts

Certification – Take Home Messages :

Page 34: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

CEFR – Take Home Messages :

• new validated descriptors coming 2017-2018• Potential to transform – for the better – what

we teach, how we teach it, what learners do, and how it can be assessed and certificated

• facilitating formative summative assessment• Mediation is a key (e.g. Translation, CLIL)• for international co-operation• Transitional | school university work• Relevant, fit for purpose, spendable, worldwide

CEFR = Learning, Teaching, Assessment :

Page 35: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,
Page 36: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

Not everything that counts can be counted

Albert Einstein

… and – a propos:

Page 37: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

The British School FVG

Udine IT027 – vicolo Pulesi, 4 | 0432 50.71.71Trieste IT015 – via Torrebianca, 18 | 040 369.369

Gorizia IT300 – corso Italia, 17 | 0481 33.300Monfalcone IT666 – via Duca d’Aosta,16 | 0481 411.868

Thank you!

[email protected]

Page 38: CEFR & Certification –for Study Î WorkCEFR – Take Home Messages : • 9new validated descriptors coming 2017-2018 • 9Potential to transform – for the better –what we teach,

The British School FVG – TriesteVia Torrebianca, 18

Trieste – Italy

Thank you!

++39 040 [email protected]