june 10-15, 2012 growing community; growing possibilities robert sherratt patrick lynch university...

22
June 10-15, 2012 Growing Community; Growing Possibilities Analytics: where do we start and where do we want to go? Robert Sherratt Patrick Lynch University of Hull

Upload: austin-turner

Post on 25-Dec-2015

216 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

June 10-15, 2012

Growing Community; Growing Possibilities

Analytics: where do we start and

where do we want to go?

Robert SherrattPatrick Lynch

University of Hull

Page 2: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 3

First heard about this at last year’s conference

Undertaking work at Hull to map out the future (eCommons – tomorrow)

Analytics, or analytics-like, ideas kept occurring

Led us to collect these thoughts, start of a learning journey

About this presentation

Page 3: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 4

UK and local context

Page 4: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 5

Government creation of a mess Shift in cost to students

◦ Fees generally increased from £3,500 to £9,000 Change in student expectation

◦ More information to support choices Shift in providers

◦ Creation of pseudo-market conditions based on price and qualifications

◦ Entry of commercial providers – BPP, part of the Apollo group, Pearson

UK HE – dramatic changes

Page 5: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 6

Where is Hull?

Page 6: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 7

Average sized UK institution – c. 20,000 students and 2,500 faculty and staff

56th overall in the Complete University Guide league table (out of 116)

Continuing positive feedback from students. Joint 8th of mainstream english Higher Education Institutions in the National Student Survey

What’s the University like?

Page 7: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 8

Learning analytics

Page 8: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 9

The measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs.

(SoLAR: http://www.solaresearch.org/about/)

A definition of learning analytics

Page 9: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 10

What can analytics offer?

Page 10: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 11

Education as a black-box Knowing why students fail and why they

succeed – feedback on the course All educators claim to know their students Analytics offer an opportunity to personalise

the student’s experience Value from a student’s perspective –

guidance on what to considering Management – how is the course

performing?

What can analytics offer?

Page 11: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 12

Current UK activity

Page 12: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 13

UK picture◦ CETIS – Analytics Reconnoitre◦ http://blog.ouseful.info/2011/03/03/ongoing-jisc-pr

ojects-of-possible-interest-to-lak11-attendees/

◦ Ten or so examples, many library based◦ Includes Cambridge & Sakai data◦ Subsequently a number of retention and

progression projects

Activity in the UK

Page 13: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 14

Much progress seems to be relatively small scale

The level to which universities engage is varied, but mostly it appears to be small groups with specific remits rather than an institution wide approach

Activity still remains low Sustainability beyond projects appears

limited

But, growing interest

One analysis ...

Page 14: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 15

Activity at Hull

Page 15: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 16

Building the Digital University, 2001… …continues with eCommons – distinctive

digital platform for learning, teaching and communications

Part of an institutional conversation looking at implementation of learning, teaching and student experience strategy including◦ Retention◦ Development of the distinctive Hull graduate◦ Library resource utilisation

What is happening at Hull

Page 16: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 17

DATAdata

Page 17: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 18

Big data at Hull

Page 18: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 19

Chemistry – benchmark all 1st year students at entry – sets a trajectory for them

The focus, and evidence, for an ongoing conversation – looking for signs of underperformance

Increase retention rate by 25% and improved academic performance

A success for little data?

Little data at Hull

Page 19: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 20

Bid for internal funding – inspired by a teaching and learning conversation

Analyse Sakai activity data Focus on access to Resources and

participation in Forums Looking to create a dashboard for students An equivalent for faculty?

More little data

Page 20: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 21

Student Support Requirements – Prediction Tool app for Chemistry◦ Fowler, J. and Norrie, P. , British Journal of Nursing,

(2009), 18(19), p1194 Early warning systems Targeting support services Targeting resources

Little steps

Page 21: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 22

We are starting the learning journey Some initial questions:

◦ Where is the gold, is there any?◦ What is the predictive power? ◦ How robust can any model be? ◦ Ethics – is this big Brother watching?◦ Who needs to know what?◦ Complexity - Student performance versus teacher

performance versus what other factors? and ... so what (now)?

Some final thoughts

Page 22: June 10-15, 2012 Growing Community; Growing Possibilities Robert Sherratt Patrick Lynch University of Hull

2012 Jasig Sakai Conference 23

Robert Sherratt◦ [email protected]

Patrick Lynch◦ [email protected]

Thank you for contributing