exploring the relation between self-regulation online activities, and academic performance: a case...

Abelardo Pardo, Feifei Han, Robert A. EllisInstitute for Teaching and Learning, Faculty of Engineering and IT slideshare.net/abelardo_pardo

Ekso Bionics flickr.com

Exploring the relation between Self-regulation,Online Activities, and Academic Performance: A case study

International Conference on Learning Analytics and Knowledge University of Edinburgh 29 April 2016

hackNY.org flickr.com

https://slideshare.net/abelardo_pardo

https://www.flickr.com/photos/eksobionics/6261799519



https://www.flickr.com/photos/hackny/7036223605



Exploring the relation between Self-regulation, Online Activities, and Academic Performance: A case studyPardo, Han & Ellis 2

Suthers, D., & Vebert, K. (2013). Learning Analytics as a "Middle Space". In D. Suthers, K. Verbert, E. Duval & X. Ochoa (Eds.), Proceedings of the International Conference on Learning Analytics and Knowledge (pp. 2-5): ACM Press.

Learning analytics tools, methods and

algorithms

Theoretical and practical aspects of

understanding learning

MotivationThom

as J. Gretel flickr.com

https://www.flickr.com/photos/ph0t0s/24952534






Matheson Learning C

omm

ons flickr.com

Self regulation

• How motivated are your students?

• Are they metacognitively engaged?

• How do they react to the task in a course?

• Can they adjust their behaviour or strategy?

https://www.flickr.com/photos/matheson_learning_commons/8382882958






Self regulation model - 1

Winne, P. H., & Hadwin, A. F. (1998). Studying as self-regulated learning. In D. J. Hacker, J. Dunlosky & A. C. Graesser (Eds.), Metacognition in educational theory and practice (pp. 227-304): Routledge.

• Task Conditions: resources, cues, time, context

• Cognitive conditions: Beliefs, motivation, knowledge, tactics

• Standards, operations, products and cognitive evaluations

• Performance and external evaluations

Lawrence W

ong flickr.com

https://www.flickr.com/photos/wonglca/3482603290




Self regulation model - 2

Boekaerts, M. (1997). Self-regulated learning: A new concept embraced by researchers, policy makers, educators, teachers and students. Learning and Instruction, 7(2), 161-186.

• Content domain

• Cognitive strategies

• Cognitive regulatory strategies

• Meta-cognitive knowledge and motivational beliefs

• Motivation strategies

• Motivation regulatory strategies

University of D

enver Com

mons flickr.com

https://www.flickr.com/photos/uofdenver/3770483632






Matthias Ripp flickr.com

Observing student learning actions

• Technology mediation

• Detailed account of learning steps

• Quantitative information

• Potential connection with specific objectives, skills

https://www.flickr.com/photos/56218409@N03/15980295568




The problemD

avid Clow

flickr.com

Self-regulated learning: style of engaging with tasks that is correlated with effective learning

Digital footprints: Provide low-level information about events in a learning experience

Can they be combined? How?

https://www.flickr.com/photos/davidclow/2344233442




Steve Jurvetson flickr.com• First year engineering

course (semester)

• Computer Systems

• Blended Learning: online + 7h face-to-face per week

• Online participation accounted for 15% of course marks

• 145 students

https://www.flickr.com/photos/jurvetson/2765681389




Jacqui Brown flickr.com

SRL Instrument

Pintrich, P. R., & de Groot, E. V. (1990). Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology, 82, 33-40. doi:10.1037//0022-0663.82.1.33

Self-Regulation Section (9 items) of the Motivated Strategies for Learning Questionnaire (MSLQ)

First week of the semester

Example:

When work is hard I either give up or study only the easy parts

7 point Likert scale





Marcy Leigh flickr.com

Digital Footprint Instrument

• Access any course resource

• Engagement with text sections

• Engagement with video activities

• Engagement with Multiple-choice questions

• Access to awareness information

Event counts

https://www.flickr.com/photos/marcyleigh/23980511354




Thomas H

awk flickr.com

Academic performance

• Lecture preparation (online): 10%

• Tutorial: 10% (5% online)

• Laboratory written report: 5%

• Collaborative Project: 15%

• Midterm exam (MCQ): 20%

• Final exam (MCQ+open): 40%

https://www.flickr.com/photos/thomashawk/135625094




Data analysis step 1: Exploratory Factor Analysis

Positive self-regulation strategy

Negative self-regulation strategy

Two items removed


Data analysis step 2: Correlation Analysis

Access to resources Positive SR

PerformanceNegative SR

Performanceonline activity


Data analysis step 3: Clustering + ANOVA

Clusters clearly differentiated Some event counts consistent with clusters


Data analysis step 4: Structural Equation Model

• No direct negative influence of online activities in AP • Negative influence of NSRS • Positive influence of online activities in AP (strong) • Weak positive influence of PSRS on AP • Significant indirect influence through online activities


Discussion and Actions

• Different contribution of SRL in this environment

• Engagement with online material is an effective vehicle to channel improvements

• Consider strategies to reduce negative self-regulation strategies

• Include reflective tasks as part of the online activities

• Complement with feedback about self-reflection


Jose Oller flickr.com

Conclusions• Explored self-regulation relation with digital footprint • Three data sources: questionnaire, click stream,

academic performance • Lack of correlation PSRS and AP • Strong correlation online activity and AP • SEM provided relation among factors • Suggestions to improve design

https://www.flickr.com/photos/cheo70/2954221555



Abelardo Pardo, Feifei Han, Robert A. EllisInstitute for Teaching and Learning, Faculty of Engineering and IT slideshare.net/abelardo_pardo

Ekso Bionics flickr.com

Exploring the relation between Self-regulation,Online Activities, and Academic Performance: A case study

International Conference on Learning Analytics and Knowledge University of Edinburgh 29 April 2016

hackNY.org flickr.com

https://slideshare.net/abelardo_pardo





