application of an online diagnostic eng lang test

Upload: freeloadtailieu

Post on 28-Feb-2018

214 views

Category:

Documents


0 download

TRANSCRIPT

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    1/36

    Application of an On-Line

    Diagnostic English Language Test

    The 11th334 Symposium

    Advancing Teaching and Learning: Evidence, Outcomes and E-learning

    Lingnan niversity

    4 !arch "#11

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    2/36

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    3/36

    Overview of presentation

    Background

    The DELTA system Applications of DELTA

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    4/36

    Background

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    5/36

    DELTA Context Opportunity provided by planning for 4-year curriculum

    for English language centres to revie their curricula andprovision of learning! teaching and assessment

    Tertiary educations focus on outcomes-based learning!teaching and assessment

    "ncreased emphasis on learner autonomy and theindependent learner

    Bachman report to #$% on language enhancement

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    6/36

    &hile there may be a number of specific! research anddevelopment '()D* pro+ects involving inter-institutional collaboration among language center staff

    at different universities! one that is of particularimportance! in my vie! is the collaborative ()Dpro+ect involving ,"Ed! .oly#! and L#! on thedevelopment of a system for assessing English languageproficiency /// there is a need for much greatercollaboration in this area/

    The Bachman Report (1)

    Language Enhancement in Hong Kong Universities: Some Observationsand Recommendations (Annex A, p!"Lyle 0/ Bachman! 1uly 233

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    7/36

    The Bachman Report (2)2/ An overall plan for the development of language assessments could includethe folloing5

    Different tests developed for complementary purposes! some could be %(!ob+ectives-based! and some could be 6(! and independent of any

    particular learning ob+ectives/ Tests ith some components to be delivered face-to-face and some on-

    line/

    "ntegration ith a language 7learning8 management system that couldinclude E-portfolios for tracking students9 LE activities and progress in

    language proficiency/ A delivery platform that is fle:ible enough to be used for formative and

    summative course-based assessmentsby all eight institutions/ Thisfle:ibility ould make it usable for use in general foundational languagecourses! language for academic purpose courses! and discipline-specificlanguage courses! as ell as for certification/ 'Anne: A! p/;*

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    8/36

    Relevance an !i"nificance of DELTAThe DELTA pro+ect is relevant to the partner institutions andthis symposium for several reasons5

    "t is a genuinely collaborative! inter-university pro+ect in hich

    language centres share knoledge! e:perience and resources/

    "t provides additional data about students9 language proficiency/

    .artner universities ill be able to use DELTA resultsfor variouspurposes/

    "t ill feed into the teaching and learning processith forardperspective to 232/

    "t ill create the opportunity to engage in collaborative research/

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    9/36

    PolyU assessment outline for 4-year curriculum

    Entr# Exit

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    10/36

    #hat is DELTA$

    diagnosestudents9 strengths and eaknesses

    track and report on students9 language gains

    help students to plan their language learning informcurriculum development

    An English language proficiency assessment systemdesigned specifically for the ,ong ong academic conte:thich can

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    11/36

    Assessment %ormat 0our components - Listening! (eading! $rammar and

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    12/36

    DELTA Trac&

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    13/36

    DELTA Trac& an Component !&ills 'rofile

    $O!%O&E&T S'(LLS %)O*(LE

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    14/36

    Component Dia"nostic Report

    http://www2.elc.polyu.edu.hk/CILL/grammar.htm
  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    15/36

    The DELTA system

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    16/36

    The DELTA !stem

    ENROLMENT /

    REGISTRATION

    TEST DELIVERY

    REPORTING

    student-specific test selection

    automated scoring & test analysis

    Learning Management System (Moode! and/or e"Port#oio

    report generation & transmission

    tracking

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    17/36

    DELTA sstem (amin)

    %ustomi>able set up Test setup 'venue! sessions! enrolment period!

    etc/*

    "tem database 'active ? inactive items* Test difficulty level for groups of students

    @tudent report content

    =anagement Enrolment and attendance

    "tem database

    (esults 'E:port to &insteps for analysis*

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    18/36

    ew st*ent (1stattempt of DELTA)

    Re$ei%es

    emai

    reminder to

    register

    &om'etes

    a generi$

    test

    Re$ei%es an emai tat

    res)ts are a%aia*e

    Sets DELTA

    target (+it te

    ad%i$e o# a

    ang)age

    tea$er!

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    19/36

    2near st*ent (2n attempt of DELTA)

    Re$ei%es

    emai

    reminder to

    register

    &om'etes

    a targeted

    test

    (targeted to

    'ro#i$ien$ye%e!

    Re$ei%es an emai tat

    res)ts are a%aia*e

    (Re!sets

    DELTA target

    (+it te ad%i$e

    o# a ang)age

    tea$er!

    See,s ang)age s)''ort

    to a$ie%e target

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    20/36

    Applications of DELTA !"T#U

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    21/36

    Relevance to En"lish Lan"*a"e

    Teachin" an Learnin" at Cit+Students

    -Language support 'individualised*-Tracking information

    $roviders o%&anguage courses

    -.lacement 'students ith no,D@E?euivalent*

    -0ormative information

    $arentdepartments 'seniormanagement

    -6eeds report-Tracking information-Overall-.er college?school

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    22/36

    DELTA , En"lish s*pport for Cit+

    st*ents from 2-12

    ear)SE Eng Leve&

    !*+ at entr#)SE Eng Leve&

    at entr#

    4

    English

    2 English English

    English English

    )EL-A

    )EL-A

    )EL-A

    )EL-A

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    23/36

    $redicted number o% test ta.ers

    23 appro: 33 'selected Cear students*

    232

    23

    approx .2-- (all /ear 1 st*ents) 0

    approx .2-- (from 2-12) 0

    approx 2-- (all /ear 1 st*ents) 0

    approx 1-- (from 2-11)

    approx 1-- (from 2-11)

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    24/36

    http:++els"cityueduh.+(ndep

    endentLearning+riting"html

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    25/36

    http:++els"cityueduh.+(ndep

    endentLearning+riting"html

    "ndependent"ndependent

    learninglearning

    guidanceguidance

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    26/36

    LanguageLanguage

    learninglearning

    planplan

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    27/36

    $eeting$eeting

    %ith a%ith a

    LanguageLanguageLearningLearning

    Ad&isorAd&isor

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    28/36

    Applications of DELTA

    Lingnan

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    29/36

    Application of DELTA at Lin"nanThe DELTA system at Lingnan #niversity is informing and

    interacting ith the teaching-learning process by5

    .roviding additional information to help in curricu&um

    p&anning and decision ma.ing

    .romoting learner autonomy and guiding students inindependent &earning

    .roviding valuable input to both students and faculty foracademic advising

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    30/36

    C*rric*l*m 'lannin" an Decision 3a&in"

    .lanning and developing the 232 curriculum

    All ne courses in 232 ill contain significant/ndependent

    Learning (/L" component in hich students ill plan ande:ecute their individua&ised &earning path0a#sith helpfrom DELTA student reports

    %EAL illtrac. &anguage pro%icienc# deve&opment of all

    students by making the DELTA test mandator#once per year

    %EAL currently anticipating pro%icienc# targets and ho toork ith parent departments

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    31/36

    Promoting Learner Autonomy and "ndependent Learning

    DELTA student reports enable students and %EAL staff to identify5speci%ic &anguage subs.i&&s for "L orkresourcesthat need to be developed

    $O!%O&E&T S'(LLS %)O*(LE

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    32/36

    4np*t to provie information an help in Acaemic

    Avisin"

    Lingnan currently using )egree 1or.sas a tool foradvisors and students in academic advising

    @tudents and staff able to discuss English languageproficiency! development and targets

    %EAL hopes to ork ith academic advisors to enablebetter understanding and more effective use of DELTA

    student reports

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    33/36

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    34/36

    !ample st*ent report in De"ree#or&s

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    35/36

    The DELTA Team

    2entre %or Language in Education (HK/Ed"

    =ichelle (auel! $endoline $uan

    2entre %or Eng&ish and Additiona& Languages (LU"

    %hristine @hirley! 1erry $ray

    Eng&ish Language 2entre ($oU"

    Alan #rmston! %arrie Tsang! 0elicia 0ang! %herry 6g

    Eng&ish Language 2entre (2it#U"

    1ane Lockood! Eva Lui

    Externa& 2onsu&tant

    .rofessor Trevor Bond! 1ames %ook #niversity! Australia

  • 7/25/2019 Application of an Online Diagnostic Eng Lang Test

    36/36