designing evidence gathering tools and knowledge test

Upload: gideoncavida

Post on 04-Jun-2018

220 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    1/21

    Ethiopian TVET Reform

    MoE - ECBP

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    2/21

    Ethiopian TVET Reform

    MoE - ECBP

    vidence gathering methodsEvidence gathering methods

    describe the approach that isused by the assessor forcollecting the evidencerequired for assessment

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    3/21

    Ethiopian TVET Reform

    MoE - ECBP

    Types of evidence gathering methods

    Real work / real time observation

    third party reports

    Structured activities demonstration

    Questioning

    Oral / interview Written

    Portfolio

    candidate collection of evidence

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    4/21

    Ethiopian TVET Reform

    MoE - ECBP

    Evidence Gathering Tools

    Evidence gathering tools are the actualinstruments that the assessor uses to collectevidence. Such as:

    observation checklist (Practical)

    question list

    demonstration of a work activity (Practical)

    written test (Knowledge)

    interview

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    5/21

    Ethiopian TVET Reform

    MoE - ECBP

    Purpose of evidence gathering tools

    Help candidate understand what is expected

    Focus for the assessor in evidence

    gathering Record assessment outcome

    Identify what action is needed to address

    skill and knowledge gaps

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    6/21

    Ethiopian TVET Reform

    MoE - ECBP

    Observation

    Observation is a key form of evidencegathering

    Observation should collect evidence of allcomponents of competence, including thedimensions of competence

    Need evidence of everyday performance,not just performance carried out as partof the assessment process

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    7/21

    Ethiopian TVET Reform

    MoE - ECBP

    Observation Checklists

    Checklists are extremely usefultools for structuring observations.

    They can act as a:

    prompt for the assessor

    guide for the candidate.

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    8/21

    Ethiopian TVET Reform

    MoE - ECBP

    Preparing Checklists Read the unit of competence What evidence must be observed

    while the work activity is beingperformed?

    What dimensions of competence

    can be observed? Use a template and enter the

    observation points in the

    template

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    9/21

    Ethiopian TVET Reform

    MoE - ECBP

    Observation is not appropriate for ... activities that occur irregularly,

    take place over an extended periodof time or are difficult to observe

    activities that require privacy andconfidentiality situations where it may be culturally

    inappropriate to observe theactivity situations where workplace safety

    may be compromised.

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    10/21

    Ethiopian TVET Reform

    MoE - ECBP

    Questioning is appropriate for ...

    Times when observation cannot

    be used

    Verifying observations

    Underpinning knowledge

    Dimensions of competence

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    11/21

    Ethiopian TVET Reform

    MoE - ECBP

    Types of questions*

    Extension

    Contingency Safety

    Infrequent activities

    Regulations and procedures

    http://localhost/var/www/apps/conversion/tmp/scratch_2/Activity%203.dochttp://localhost/var/www/apps/conversion/tmp/scratch_2/Activity%203.doc
  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    12/21

    Ethiopian TVET Reform

    MoE - ECBP

    Extension Questions

    What would you do if ? (asimilar but different situation)

    What if you were using instead

    of ? (alternativeequipment/procedures etc)

    (preventative safety measure)

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    13/21

    Ethiopian TVET Reform

    MoE - ECBP

    Contingency Questions What would you do in the event of ?

    (accident or emergency)

    What would you do if ... ? (equipment

    broke down or somethingmalfunctioned)

    What would you do if (complaint

    was made or conflict occurred)

    How do you avoid ? (preventativesafety measure)

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    14/21

    Ethiopian TVET Reform

    MoE - ECBP

    Safety Questions What precautions must you take when ?

    What safety equipment and clothing should

    you use when ? Why shouldnt you ? (procedure or

    activity that is not permitted)

    What would you do if ? (dangeroussituation)

    How do you avoid ? (preventative safety

    measure)

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    15/21

    Ethiopian TVET Reform

    MoE - ECBP

    What would you do if ? (rarely

    occurring but critical situation) If happened, what action wouldyou take?

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    16/21

    Ethiopian TVET Reform

    MoE - ECBP

    Questions on Regulations and

    Procedures What are the regulations in respect of

    ?

    What are the specified procedures orsteps to ?

    What checks are required by themanufacturer to ?

    What is the regulation that covers ?(situation or activity)

    What are the organisational regulationsthat apply when happens?.

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    17/21

    Ethiopian TVET Reform

    MoE - ECBP

    Develop an evidence gathering tool

    Select the unitRead the unit

    Identify the required evidence

    Identify the evidence gathering methodComplete the Evidence Plan

    Select the appropriate template

    Complete the template

    Check the evidence gathering tools againstthe Evidence Plan and unit of competence

    Check the tool with another assessor

    E hi i TVET R f

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    18/21

    Ethiopian TVET Reform

    MoE - ECBP

    Knowledge Test

    Ethi i TVET R f

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    19/21

    Ethiopian TVET Reform

    MoE - ECBP

    Purpose of Knowledge Test

    A knowledge test is a set of questions or aseries of tasks that candidates answerorally or in writing

    Testing is conducted for a variety of purposes find out what the candidate has learned

    determine the candidates strengths and

    weaknesses in regards to the knowledge that

    underpins competent performance

    find out what the candidate needs to learn

    Testing is one method of gathering evidence about the candidates

    understanding of the knowledge that underpins competent performance

    Ethi i TVET R f

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    20/21

    Ethiopian TVET Reform

    MoE - ECBP

    Identifying the Knowledge that underpins

    competent performanceTest must focus on the knowledgespecified in the relevant unit ofcompetency

    Required information:

    key areas of knowledge required for competent

    performance

    depth and breadth of knowledge requiredIn gathering these information the assessor needs to read the

    entire unit and pay particular attention to the list of

    underpinning knowledge specified in the Evidence Guide

    Ethiopian TVET Reform

  • 8/13/2019 Designing Evidence Gathering Tools and Knowledge Test

    21/21

    Ethiopian TVET Reform

    MoE - ECBP