Transforming the Student Experience: Manchester Metropolitan University’s EQAL Project

Professor Mark StubbsHead of Learning & Research Technologies

http://twitter.com/thestubbs

http://slideshare.net/markstubbs

Umeå | Jun 2014#eunis14

Context | An interesting place to work!

• Large, popular, multi-campus university in North West of England– 36,000+ students | 1,000+ courses | consolidating from 7 sites to 2

• Pursuing an ambitious transformation initiative– New Buildings, New Curriculum, New Admin Processes & Systems,

New Learning & Mobile Tech, New Quality Processes…

Context | Strategic improvement imperative

Student RetentionSuccess & Satisfaction

Student Intake(Aspirations, Attitude

& Abilities)

Learning, Teaching, Assessment & Personal Development

Processes, Facilities& Resources

ReputationMarketing &RecruitmentProcesses

All Year Numbers

Resource allocation

League table rankingsA

A Recruit to target

B

B Improve satisfaction, retention & success

C

C Inform decision-makers

2009 NSS

Where to

intervene?

Understanding how best to make a difference

Careful diagnosis of (diverse) learning experiences• Recurrent messages

– NSS analysis: course organisation determines Q22– Mobile surveys: deadlines, timetables… (m-admin)– Focus groups: consistent, easy to find info

• Great (and not-so great) expectations– “engaging, well-organised courses”– “inspirational tutors who know me”

‘Hygiene

factors’Stimulating

pedagogies

Coordinating our response

B Improve satisfaction, retention & success

GreatOnline Experience

(Seamless, personalised)

GreatLearning Spaces

GreatTeaching

SimplifyUnwieldy

Curriculum

EQAL

€420M

Project: Enhancing Quality and

Assessment for Learning (EQAL)

Scope: University-wide, Undergraduate

Leadership: Deputy Vice-Chancellor

Timeline: Ambitious!

• A coordinated strike for step-change improvement

EQAL | Scope

New Curriculum• designing new modules, …

New Admin Systems & Processes• personal timetabling, …

New Virtual Learning Environment• Moodle & myMMU web/mobile, Talis Aspire…

New QA & QE Processes• facilitating curriculum transformation

In the current climate

Diminishing unit of resource

Everything depends on everything else

We are large and risk averse

but

but but

but but

Programme

Board chaired by

Deputy Vice-

Chancellor

MISSION:

2010 Q1: Plan Programme & Projects

2010 Q2: Approve UG curriculum rules

2010 Q3: Develop smart curriculum capture forms

2010 Q4: Enter 800+ new L3 + L4 modules

2011 Q1: Approve new modules

2011 Q2: Set up SRS, TT & VLE

2011 Q3: L4 curriculum & systems go live

2011 Q4: Enter new L5 modules…

2012 Q3: L5 goes live

2013 Q3: Entire new UG curriculum live

Smart forms

868L3+L4modules

Minimise

‘big ask’

Jul 2010

Jan 2011

EdTech BlueprintRecognised: watch & learn how staff use techRecommended: staff set up & we train to integrateArranged: we set up institutional accounts & train staff to useCore: we set up & train staff and tell students to expect a consistent ‘front door’ New ELSO

posts created,

1 per faculty

Design PartnerMoodle 1.9

Apr 2011

Wrapping the institution around the learner

This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence

moodle.mmu.ac.ukmegamashup

mws

my.mmu.ac.uk mymmu-mobile

13

Wrapping the institution around the learnerStudent ID

Timetable

This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence

Sync to personal device

Wrapping the institution around the learnerStudent ID (+ Unit code)

Deadlines / extensions / feedback return dates / provisional marks

Personalised submission sheet

This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence

Wrapping the institution around the learnerUnit code

Resource list

Relevant resource

This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence

Wrapping the institution around the learnerUnit code

Past exam papers

Past exam paper

This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence

11,000+ past

exams

uploaded

MyMMU App

m-admin

Engaging our students

Providing business

intelligence

Automating our

processes

Are we in a better place now?

10,000+ students post

40,000+ comments in

our biannual student

surveys

Submission tracking, Personal timetables, …

Quartile improvements

in course org &

learning resources in

2012 NSS

EQAL wins inaugural Guardian Student Experience Award!

30,000 regular users,

52m+ hits on Moodle,

26,000+ App

registrations!

Continuous Monitoring & Improvement

MDL SRS TT

Data Warehouse Analysis Cubes

Undergraduate Dental Technology Network (11209A)

Overview Students Success Satisfaction Engagement Standards Appl ications Employment

Head count [now] of [all] students for [all modes] [all enrolments]

Enrolled

268 (95%)

Withdrawn

0 (0%)

Suspended

0 (0%)

Repeat w/o attend 14 (5%)

#STUDENTS TOTAL L3 L4 L5 YO L6 L7 Undergraduate Dental Technology Network (11029A)

268 83 73 67 45

- BSc(Hons) Dental Technology (6266) 184 73 67 44 + BSc(Hons) Dental Technology (6266_1F) 73 73 + BSc(Hons) Dental Technology (6266_2F) 67 67 + BSc(Hons) Dental Technology (6266_3F) 44 44 + BSc(Hons) Dental Technology (6267) 1 1 + FDSc Dental Technology (621C) 62 62 + FDSc Dental Technology (6264) 21 21

How has my student cohort changed?

Higher than faculty average

Lower than last year

5%-5%

5%

-5%

PLP

Parents in HE

Mature

Live at home

Higher than last year

Lower than faculty average

Live at home 12% PLP 4% Mature 6% Disability 3% BME 8% Male 42% International 4%

In response to this information, I intend [to highlight the following good practice]

Previously, the Programme Leader committed to…

On 21/03/13 Done? On 22/02/13 raise with the Dean targets for the part-time courses Complete

CMI: Undergraduate Dental Technology Network (11209A)

Overview Students Success Satisfaction Engagement Standards Appl ications Employment

Satisfaction [on all ISS] of [all] students for [all modes] [all enrolments]

Course Satisfaction

Comments Show [all] comments for [all courses] that contain [Click here to enter text.] for [students who are satisfied with confidence building] [Go!] [Clear]

0% 100%50%25% 75%

69%

#Enr

olle

d

Resp

onse

Expl

anati

on

Feed

back

Advi

ce

Org

anis

ation

Reso

urce

s

Confi

denc

e

Ove

rall

Undergraduate Dental Technology Network (11029A) 268 30% 100% 93% 93% 87% 96% 95% 100% - BSc(Hons) Dental Technology (6266) 184 30% 100% 93% 93% 87% 96% 95% 100% - 6266_1F 73 27% 100% 95% 95% 95% 95% 100% 100% - 6266_2F 67 31% 100% 100% 95% 81% 100% 95% 100% - 6266_3F 44 32% 100% 79% 86% 86% 93% 86% 100% + BSc(Hons) Dental Technology (6267) 1 0%

60.0%

65.0%

70.0%

75.0%

80.0%

85.0%

90.0%

95.0%

100.0%

2011

2012

2013

2011

2012

2013

2011

2012

2013

2011

2012

2013

2011

2012

2013

2011

2012

2013

2011

2012

2013

EXPLANATION

FEEDBACK

ADVICE

ORGANISATION

RESOURCES

CONFIDENCE

OVERALL

CMI dashboard for all programme leaders

for Sep 2014

C

Learning

Analytics

Change management lessons1. Understand important dynamics

2. Be clear what needs to be done

3. Set high-level goals

4. Understand where change is required

5. Be bold and plan holistically

6. Ensure you’ve got the right team to drive

7. Make ‘big asks’ as small as possible

8. Make it stick with reinforcing change

http://tinyurl.com/jiscmmusrcCurriculum Design

Assessment & Feedback http://tinyurl.com/jiscmmutraffic

Find out

more!