Evaluating a VLE: A Multi-Faceted Approach

Chris Rowell – TEL AdvisorRegent’s College, London.

11th Sept 2012

About Regent’s College

Regent’s College: ‘Private not for profit university’. Central London.7 Schools, Fees: £13,000 to £21,0004000 students350 academics

The VLE Team:VLE ManagerContent DeveloperTEL Advisor

Bb Project Team

Who is interested in the evaluation?

Methodology

Staff Evaluation

Statistical Reports

Behind the Bb

Google Analytics

Quantitative Qualitative

1. Statistical Reports

2. Behind the Bb

3. Google Analytics

1

2

3

3

Qualitative (3 parts):1. Online Questionnaire

2. Interviews - Interview questions for lecturers Starting Bb1.a) How easy was it for you to start adding content to your module area? b) What were the main difficulties you faced when creating a new module area in Bb (if any)2. Have you experienced any technical difficulties using Bb?

Staff/Student interaction 3. Do you think the students have an increased expectation of your availability since Bb was introduced? 4. Do you believe that Bb can replace a part of your face-to-face contact with your students?5. Do you think that Bb affects the attendance in your lessons?6. In your opinion, has Bb changed the quality of interaction with your students?7. Has the introduction of Bb affected your relationship with students?

Teaching8. Do you think that Bb enables you to become more or less student-centred in your teaching?9. Has Bb affected (or could affect) the way you teach in the classroom? 10. How effective is Bb at supporting collaborative activities on your course?

Assessment11. How has Bb affected the way you assess students work? 12. Have you changed the amount of feedback to students since the introduction of Bb?13. Do you use Bb to evaluate how much work the students are doing on your module? 14. Do you use Bb to identify any students who might be “at risk” on your module?

Workload15. Has the introduction of Bb changed your overall workload? Future needs16. Would you like more training or on-to-one support to develop your Bb module? If so, what areas of Bb would you like to develop?17. Would you like to make any other comments about Bb?

3. Analysis/report

Conclusion:

What I have got out of it:• Qualitative data - Ticks SM’s boxes• Justification of what I’m already doing• Influenced future direction of the VLE• Unintended consequences• Why is the qualitative side neglected?

More information:

Chris Rowell:

Email, rowellc@Regents.ac.uk Twitter, @chri5rowellBlog, http://totallyrewired.wordpress.com/