learning technologies evaluation mark jasper iatefl, aberdeen friday 20-april 2007
TRANSCRIPT
![Page 1: Learning Technologies Evaluation Mark Jasper IATEFL, Aberdeen Friday 20-April 2007](https://reader035.vdocument.in/reader035/viewer/2022062423/56649ebc5503460f94bc559d/html5/thumbnails/1.jpg)
Learning Technologies EvaluationMark Jasper
IATEFL, AberdeenFriday 20-April 2007
![Page 2: Learning Technologies Evaluation Mark Jasper IATEFL, Aberdeen Friday 20-April 2007](https://reader035.vdocument.in/reader035/viewer/2022062423/56649ebc5503460f94bc559d/html5/thumbnails/2.jpg)
Mark Jasper
Bio-data• British Council since 1996
• Global Product Development Consultant
• ICT Consultant & E-Learning Developer,in Manchester & Milan
• EFL Teacher, in Ho Chi Minh City, Istanbul & Tokyo
![Page 3: Learning Technologies Evaluation Mark Jasper IATEFL, Aberdeen Friday 20-April 2007](https://reader035.vdocument.in/reader035/viewer/2022062423/56649ebc5503460f94bc559d/html5/thumbnails/3.jpg)
Internet Research
• Evaluation v Research
Googlefight
• Evaluation & Reflection
http://www.askaninja.com/index.php
![Page 4: Learning Technologies Evaluation Mark Jasper IATEFL, Aberdeen Friday 20-April 2007](https://reader035.vdocument.in/reader035/viewer/2022062423/56649ebc5503460f94bc559d/html5/thumbnails/4.jpg)
Contents
• Internet Research
• Evaluation Definitions
• Need for Evaluation
• British Council Research
• Macmillan English Campus Evaluation
• Lessons Learned
• Towards a Generic Tool
![Page 5: Learning Technologies Evaluation Mark Jasper IATEFL, Aberdeen Friday 20-April 2007](https://reader035.vdocument.in/reader035/viewer/2022062423/56649ebc5503460f94bc559d/html5/thumbnails/5.jpg)
Evaluation Definitions
• Gubba & Shufflebeam 1970
“Evaluation is the process of obtaining and providing useful information for making educational decisions”
• Jasper 2007
“Is it any good?”
![Page 6: Learning Technologies Evaluation Mark Jasper IATEFL, Aberdeen Friday 20-April 2007](https://reader035.vdocument.in/reader035/viewer/2022062423/56649ebc5503460f94bc559d/html5/thumbnails/6.jpg)
Need for Evaluation
• Spend, spend, spend
• Product failures
• Impact Assessment 2005 - 2006
• Evaluation Evolution
![Page 7: Learning Technologies Evaluation Mark Jasper IATEFL, Aberdeen Friday 20-April 2007](https://reader035.vdocument.in/reader035/viewer/2022062423/56649ebc5503460f94bc559d/html5/thumbnails/7.jpg)
Learning Technology Research
• BC global network of approx 100 centres
• Supported in-house research
• Ipsos-Mori
• What to believe
![Page 8: Learning Technologies Evaluation Mark Jasper IATEFL, Aberdeen Friday 20-April 2007](https://reader035.vdocument.in/reader035/viewer/2022062423/56649ebc5503460f94bc559d/html5/thumbnails/8.jpg)
Macmillan English Campus
![Page 9: Learning Technologies Evaluation Mark Jasper IATEFL, Aberdeen Friday 20-April 2007](https://reader035.vdocument.in/reader035/viewer/2022062423/56649ebc5503460f94bc559d/html5/thumbnails/9.jpg)
MEC Project
• Supplementary ematerials resource• January 2006 – present• Hong Kong, Bratislava, Bangkok,
Prague, Warsaw• 1000 licences• Pre-intermediate to Upper Intermediate• Varied course lengths• Teacher & learner turnover
![Page 10: Learning Technologies Evaluation Mark Jasper IATEFL, Aberdeen Friday 20-April 2007](https://reader035.vdocument.in/reader035/viewer/2022062423/56649ebc5503460f94bc559d/html5/thumbnails/10.jpg)
MEC Evaluation
• Evaluation Brief
• Evaluation Plan
• Continuous Data Collection
• Qualitative & Quantitative data
![Page 11: Learning Technologies Evaluation Mark Jasper IATEFL, Aberdeen Friday 20-April 2007](https://reader035.vdocument.in/reader035/viewer/2022062423/56649ebc5503460f94bc559d/html5/thumbnails/11.jpg)
Evaluation Brief & Plan• Define problem
• State why evaluation is necessary
• Data type
• Data collection (who, how & when)
• How data will be used
• What we already know
• What we want to know
• KPIs or action statements
![Page 12: Learning Technologies Evaluation Mark Jasper IATEFL, Aberdeen Friday 20-April 2007](https://reader035.vdocument.in/reader035/viewer/2022062423/56649ebc5503460f94bc559d/html5/thumbnails/12.jpg)
Qualitative Data
• Focus groups
• Weekly reports
• Weekly meetings on VOIP
• Knowledge sharing forums
• Workshops
• Telephone interviews
• Consultancy reports
![Page 13: Learning Technologies Evaluation Mark Jasper IATEFL, Aberdeen Friday 20-April 2007](https://reader035.vdocument.in/reader035/viewer/2022062423/56649ebc5503460f94bc559d/html5/thumbnails/13.jpg)
Quantitative Data
• Online self-completion questionnaire
• System statistics
• Reregistration figures
![Page 14: Learning Technologies Evaluation Mark Jasper IATEFL, Aberdeen Friday 20-April 2007](https://reader035.vdocument.in/reader035/viewer/2022062423/56649ebc5503460f94bc559d/html5/thumbnails/14.jpg)
What Went Well
• Early planning
• Avoided evaluation as autopsy
• Evaluation as part of project
• Reasonable samples
• Mixing qualitative & quantitative
• 1 evaluation coordinator + support
![Page 15: Learning Technologies Evaluation Mark Jasper IATEFL, Aberdeen Friday 20-April 2007](https://reader035.vdocument.in/reader035/viewer/2022062423/56649ebc5503460f94bc559d/html5/thumbnails/15.jpg)
What Has Nae
• Getting equal commitment
• Technology
• Meshing in anecdotes
• Behavioural evidence
![Page 16: Learning Technologies Evaluation Mark Jasper IATEFL, Aberdeen Friday 20-April 2007](https://reader035.vdocument.in/reader035/viewer/2022062423/56649ebc5503460f94bc559d/html5/thumbnails/16.jpg)
Towards an Evaluation Toolkit
• Lessons Learned
• Keep a Central Resource
• Ask General Questions
![Page 17: Learning Technologies Evaluation Mark Jasper IATEFL, Aberdeen Friday 20-April 2007](https://reader035.vdocument.in/reader035/viewer/2022062423/56649ebc5503460f94bc559d/html5/thumbnails/17.jpg)
Suggested Resources
• Evaluating Learning Technology Resources:Workbook
• LTSS Guide to Evaluating Learning Technology ResourcesCookbook
![Page 18: Learning Technologies Evaluation Mark Jasper IATEFL, Aberdeen Friday 20-April 2007](https://reader035.vdocument.in/reader035/viewer/2022062423/56649ebc5503460f94bc559d/html5/thumbnails/18.jpg)
URLs from TalkEvaluating Learning Technologies Workbook• http://www.ltss.bris.ac.uk/publications/
guides/evalwkbk/evalwkbk.htm
Evaluation Cookbook• http://www.icbl.hw.ac.uk/ltdi/cookbook/recipes.
html
• http://www.googlefight.com• http://www.askaninja.com/