Learning Dashboards

Supervisory CommitteeProf. Erik Duval - Dr. Joris Klerkx - Prof. Bieke Zaman - Prof. Andrew Vande Moere

@svencharleer | 18.12.2013

Activities Research Plan !Courses !Contribution to Education

ADS

�2

Activities

�3

Start date 16/01/2013

“Learning Dashboards”

Learning Analytics for Inquiry-based Learning (weSPOT)

�4ActivitiesProject

�5ActivitiesBackground fitbit.com

�6ActivitiesBackground

Govaerts, S., Verbert, K., Duval, E., Pardo, A.: The student activity meter for awareness and self-reflection. In: Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems Extended Abstracts, ACM (2012) 869–884

Santos, J.L., Verbert, K., Govaerts, S., Duval, E.: Addressing learner issues with stepup!: an evaluation. In: Proceedings of the Third International Conference on Learning Analytics and Knowledge, ACM (2013) 14–22

�7ActivitiesBackground

awareness

(self) reflection

sense making

impact

data

questions

answers

behavior change or new meaning

Verbert, Katrien; Duval, Erik; Klerkx, Joris; Govaerts, Sten; Santos Odriozola, Jose Luis. Learning analytics dashboard applications, American Behavioral Scientist, volume 57, issue 10, pages 1500-1509, 2013

�8Activities

awareness

(self) reflection

sense making

impact

data

questions

answers

behavior change or new meaning

BackgroundVerbert, Katrien; Duval, Erik; Klerkx, Joris; Govaerts, Sten; Santos Odriozola, Jose Luis. Learning analytics dashboard applications, American Behavioral Scientist, volume 57, issue 10, pages 1500-1509, 2013

�9ActivitiesBackground

Design-based Research User-centered

Rapid Prototyping Iterative process

�10ActivitiesMethodology

�11Activities

Navi Badgeboardn=22 . chi13 . personal motivation

Navi Surfacen=14 . chi13 . group reflection

LARA.e03 n=6 . chi13 . course structure/intervention

Dashboards

LARA.emo n=16 . MUME13

�12ActivitiesDashboards

LARA.e

�13Activities

LA RA .e

earning

nvironmentwarenesseflection &nalytics

Dashboards

�14Activities

avi Badgeboard

Dashboards

�15Activities

Navi BadgeBoard navi-hci.appspot.comDashboards

�16Activities

Navi BadgeBoard navi-hci.appspot.comDashboards

�17Activities

avi Surface

Dashboards

�18Activities

Navi SurfaceDashboards

�19Activities

Navi SurfaceDashboards

�20ActivitiesDashboards

�21Activities

LARA.e03Dashboards

�22Activities

LARA.e03Dashboards

�23Activities

LARA.emo

Dashboards

�24Activities

LARA.emo ariadne.cs.kuleuven.be/emo/Dashboards

�25Activities

Results

�26ActivitiesPrototypes & EvaluationNavi BadgeBoard navi-hci.appspot.com

Navi Badgeboardn=22 . chi13 . sus 65

�27ActivitiesPrototypes & EvaluationNavi Badgeboard

A. Increases my motivation B. Promotes commenting on blogs of other students. C. Promotes reading blogs of other students. D. Promotes Twitter participation.

�28ActivitiesPrototypes & EvaluationNavi Badgeboard

A. Overview of other students’ badges B. Overview # badges achieved by the entire class C. Overview of all badges and descriptions D. Filter options for the Class Progression graph E. Class Statistic graph per badge F. Add to OpenBadge backpack

�29ActivitiesPrototypes & EvaluationNavi Surface

Navi Surfacen=14 . chi13 . sus 71/77

�30ActivitiesPrototypes & EvaluationNavi Surface

A. Improves my awareness of the class’s general progress B. Helps me understand the meaning of the badges C. Helps me see what badges someone earned in a given period D. Helps me compare badges of students E. I would like to use this tool with the teacher to evaluate my progress F. I would like to use this tool with other students to compare our progress

�31ActivitiesPrototypes & EvaluationLARA.e03

LARA.e03 n=6 . chi13 . sus 76

�32ActivitiesPrototypes & EvaluationLARA.e03

�33ActivitiesConclusion

Awareness

Reflection

Anonymity

Traces

�34Activities

Publications

�35ActivitiesPublications

J. L. Santos, S. Charleer, G. Parra, J. Klerkx, E. Duval, and K. Verbert. Evaluating the use of open badges in an open learning environment. In Scaling up Learning for Sustained Impact, pages 314–327. Springer, 2013.

Charleer, S., Klerkx, J., Santos, J. L., & Duval, E. Improving awareness and reflection through collaborative, interactive visualizations of badges. In Proceedings of the 3rd Workshop on Awareness and Reflection in Technology-Enhanced Learning, pages 69-81. CEUR Workshop Proceedings, 2013

Co-author

Main author

Research Plan

�36

iMinds !

weSPOT pilots

MOOCs CSEV / UNED

�37Research Plan2014

Workshop on Awareness and Reflection in TEL 14 !

European Conference on TEL 14 !

CHI Conference 15? !

Learning Analytics and Knowledge Conference 15

�38Research Plan2014

IEEE VIS 2015 !

Workshop on Awareness and Reflection in TEL15 !

European Conference on TEL 15 !

CHI Conference 16 !

Learning Analytics and Knowledge Conference 16

�39Research Plan2015-2016

@svencharleer svencharleer.com

?

Courses

�41

Onderwijsondersteuning voor Assistenten !

Academic Writing & Presentation Skills !

JTEL Summer School

Technicity (Coursera, Ohio State University)

�42

https://www.coursera.org/course/techcity

Courses

�43Courses

Contribution to Education

�44

User Interfaces 11h P&O 3 120h !

3.5 thesis students 105h !

�45Contribution to Education

Contribution to Education

http://thesisthomasdemoor.wordpress.comhttp://peno3cw1a3.wordpress.com

�46

Contribution to Education

http://oneironaut.be http://vrdatavis.wordpress.com

�47