introduction to learner analytics session at oslo open forum conferences prior to iso/iec jtc 1/sc36...

of 18 /18
Learning Analytics and Standardisation – projects and initiatives Tore Hoel Wilbert Kraan Oslo Open Forum 20 June 2014

Post on 19-Oct-2014




0 download

Embed Size (px)




Learning Analytics and Standardisation

projects and initiatives Tore Hoel

Wilbert Kraan

Oslo Open Forum 20 June 2014

Creative Commons Attribution-ShareAlike

This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.

What is Learning Analytics? The measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs

(Society for Learning Analytics Research SoLAR)

Not Theoretical Insights!

Not reporting!

Actionable intelligence!

Learning Analytics Community Exchange (LACE project)

European Union Support & Coordination project 24 more months to go 9 partners (Norway, Sweden, UK, Belgium,

Netherlands and Italy) Focus areas

o Schools o Higher Education o Industry o Interoperability & Data Sharing

ISO.. SC36 WG4 Study Period Studies: Korean report on Big Data & LA IMS Caliper Proposal: Should SC36 develop a multi-part standard? What would be the sources?

Possible parts in a new ISO standard Conceptual Framework System Requirements Privacy Protection Guidelines Accessibility Guidelines Quality Metrics Data Crawling Reference Software Implementation Guide

ADL et al.

xAPI Basic data model: o Learner created activity

High level property vocabulary An API for communicating activity Open source implementation

IMS Global Caliper: Vocabulary for student activities:

o metric profiles An API for communicating activity data

o Sensor API Designed to work with existing IMS specs:

LTI, QTI Implementation imminent

Open Learning Analytics (SoLAR) initiative

Summit April 2014 (after LAK 14) Identified OLA domains:

o open research (e.g. open datasets, open predictive models, etc.),

o institutional strategy and policy issues, and o learning sciences/learning design and open

standards/open-source software Open Learning Analytics Architecture

LACE Interoperability work so far... Started a series of Webinars Identified that 'soft issues' are extremely

important from an implementation perspective

Consensus needed on privacy issues, access to data, users control of their own data, stakeholder responsibilities, etc.

CETIS conference cultural issues How do we convince management of the return on investment of

analytics? Where do we start: the problem to be addressed or the data available? What information do we not want to know? (privacy law) How do we get out of the deficit model of student achievement? How do we overcome resistance to change? Where do we get statisticians / data scientists from? How do we make insights actionable? How do we deal with the US bias in the data structures of some of our


CETIS conference tech issues How do we distinguish correlation from causation? How do we get reliable data / avoid students gaming the system? How do we identify the useful data in the wealth of available data? How do we make sense of raw data; what does "student is in the

building mean? How do we get relevant data from outside the institution? How do we get data from multiple (legacy) systems to

interoperate? How do we deal with missing longitudinal data? How do we make data comparable between institutions?

Workshop on LA in Japan Nov/Dec 1st ICCE workshop on Learning Analytics (LA): Leveraging Educational Data for Adaptive Learning and Teaching ICCE 2014 conference in Nara (30 November - 4 December)

Submit your workshop paper!

And then we have MOOCs... This Monday we got the Norwegian MOOCs Commissions Report Suggests 2 mill yearly for Research,

Development and Community Exchange Activities the next few years

What more?


Hans Petter Rkholt, Connexus, Norway Rob Abel, IMS Global, USA Pierre-Julien Guay, GTN-Qubec / Vitrine technologie-

ducation, Canada Ingrid Melve, Uninett, Norway Steve Lay, Question Mark, UK Yasu Tamura, Sophia University, Japan