Evidence-informed Quality Enhancement of Institutional Moodle

AdoptionCatherine Wasiuk, Colin McAllister-Gibson, Kate Soper, Rod

Cullen and Neil Ringan

Learning InnovationManchester Metropolitan University

Background● EQAL - ‘step-change improvement in student

satisfaction’ (Stubbs, 2014)● MMU Moodle - wrapping the institution around the

learner● Learning Innovation team● Institutional approach to information, data

collection, management and analysis● ISS - Internal Student Survey● Automated Moodle audit data

44 million hits

40,000 unique

users

12,000 programmes and

units

Evidence based

discourse to

enhance the

student experience

Data Collection, Management and Analysis

1. ISS December 2014● 48,000 comments (best & in need of improvement)● 2072 comments – relating to Moodle and Learning Technologies● Thematic analysis

● 746 comments - 18 ‘Best’ themes ● 1326 comments - 25 ‘In need of improvement’ themes

2. Automatic Moodle audit data● Threshold standards for Moodle

● Reading lists● Assessment hand-in dates● Moodle content

Institutional: Best features

Content well organised

Provision of

audio/video Effective communications

Content up-to-date

Best: Hotspots AnalysisHollings Faculty

Institutional: Areas to improveBetter organisation

Better

communicationContent

uploaded

to Moodle

Improve: Hotspots AnalysisHollings Faculty

Moodle Audit Data by Faculty

Threshold Standards set by

the Student Experience

Committee (SEC)

Moodle Audit Data by Unit

Drill down by

Department and Unit

The Ongoing Quality Enhancement Process

● Institutionalo targeted cross-faculty staff developmento refine Moodle checklist template 2015/16o inform QAA HE Review 2016o iterative process – repeat for next ISS cross-referenced to

the automated audit data 2015/16● Faculty

o working with Deans and SLTFs to drive quality and consistency across department and programme areas

o targeted early intervention by unit using automated audit data

Evidence based discourse about the student experience

Powerful tool as an

agent of change!

List of referencesMMU (2014) Internal Student Survey December 2014Naveh, G., Tubin, D and Pliskin, N (2012) Student satisfaction with learning

management systems: a lens of critical success factors. Technology, Pedagogy and Education, 21(3), 337-350.

Stubbs, M. (2014) Transforming the Student Experience: Manchester Metropolitan University’s EQAL Project. EUNIS Conference.

This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence

Thematic analysis: Coding

Back

Thematic analysis: Codes

Back

Wrapping the institution around the learner

moodle.mmu.ac.ukmegamashup

my.mmu.ac.uk mymmu-mobileBack

Wrapping the institution around the learner

15

Student ID

Timetable

Sync to personal device

Back

Student ID (+ Unit code)

Deadlines / extensions / feedback return dates / provisional marks

Personalised submission sheet

Wrapping the institution around the learner

Back

Unit code

Resource list

Relevant resource

Wrapping the institution around the learner

Back

Unit code

Past exam papers

Past exam paper

11,000+ past

exams uploaded

Back

Wrapping the institution around the learner

Learning Innovation

(LI)

Manchester School of Art

Faculty of Education

Faculty of Health,

Psychology and Social

Care

Faculty of Science and Engineering

Faculty of Humanities, Languages and Social

Science

Cheshire Campus

Hollings Faculty

Faculty of Business and

Law

Technology Enhanced Learning Advisor (TELA)

in each faculty

4 Academics and 1 Teaching

Technology Professional

Back

Learning Innovation Hub and spoke

model:

Two-way process

Learning and Research

Technologies

Back