analytics to understand learning environments
DESCRIPTION
Seminar for the CHAI Group at The University of Sydney. A summary of the initiatives I have worked on in the past years plus a brief account of my current work.TRANSCRIPT
![Page 1: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/1.jpg)
r2hoxFlickrAnalytics to understand learningenvironments
Chai Seminar, 14 April 2014
Dr Abelardo Pardo (@abelardopardo)School of Electrical and Information Engineering
slideshare.net/abelardo_pardo
![Page 2: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/2.jpg)
Abelardo Pardo Analytics to understand learning environments 2
![Page 3: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/3.jpg)
Abelardo Pardo Analytics to understand learning environments 3
State
Records
NS
WFlickr
Lecturer at School of EIE
Two coursesGrad/Undergrad
Active learning
Use of technology
Tech to empower individualsand communities
Behavioral analytics
User validation
![Page 4: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/4.jpg)
Abelardo Pardo Analytics to understand learning environments 4
dianetellFlickrPragmaticapproach
Dogfooding!
Maximize impact
![Page 5: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/5.jpg)
Abelardo Pardo Analytics to understand learning environments 5
VanessaOflickr.com
“Historically, humanity has made sense of the worldthrough discourse, dialogue, artifacts, myth, story,and metaphor. While those sensemaking approacheswon’t disappear, they will be augmented by data andanalytics.”
(Siemens, 2014 www.elearnspace.org/blog)
![Page 6: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/6.jpg)
Abelardo Pardo Analytics to understand learning environments 6
Quinn
Anya
flickr.com
LearningAnalytics
Observe andCollect
View and Act
Self-motivation
Flippedclassroom
![Page 7: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/7.jpg)
Abelardo Pardo Analytics to understand learning environments 7
Quinn
Anya
flickr.com
LearningAnalytics
![Page 8: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/8.jpg)
Abelardo Pardo Analytics to understand learning environments 8
Unhindered
byTalentflickr.com
Many colleges and universities have demonstratedthat analytics can help significantly advance aninstitution in such strategic areas as resourceallocation, student success, and finance
(Bichsel, 2012)
![Page 9: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/9.jpg)
WSJ 19/07/12
Abelardo Pardo Analytics to understand learning environments 9
How do you read?
![Page 10: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/10.jpg)
NY Times 24/11/12
Abelardo Pardo Analytics to understand learning environments 10
![Page 11: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/11.jpg)
Humans are Subjective
Abelardo Pardo Analytics to understand learning environments 11
Mind Sights: Original Visual Illusions, Ambiguities, and Other Anomalies, With a Commentary on the Play of Mind in Perception and Art, Roger N. Shepard, 1990
![Page 12: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/12.jpg)
Abelardo Pardo Analytics to understand learning environments 12
apasciutoflickr.com
Tools, technology,algorithms
Educational design,pedagogical strategies
![Page 13: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/13.jpg)
Abelardo Pardo Analytics to understand learning environments 13
Kurafire
flickr.com
Feedback as a dialogue
![Page 14: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/14.jpg)
Abelardo Pardo Analytics to understand learning environments 14
TanakaJuuyoh
flickr.com
Tight feedback loop
![Page 15: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/15.jpg)
“We need better evaluationto acknowledge and esteem
excellence when it occurs,as it does.”
Abelardo Pardo Analytics to understand learning environments 15
Bencrow
eFlickr
(Hattie, 2009)
![Page 16: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/16.jpg)
Abelardo Pardo Analytics to understand learning environments 16
Quinn
Anya
flickr.com
LearningAnalytics
Observe andCollect
![Page 17: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/17.jpg)
Abelardo Pardo Analytics to understand learning environments 17
ChefC
ookeFlickr.comObserve while
working oncourse
activities
![Page 18: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/18.jpg)
A clearly identifiedenvironment within
your computer
Abelardo Pardo Analytics to understand learning environments 18
Kevin
Davies
flickr.com
(Pardo & Delgado Kloos, 2011)
![Page 19: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/19.jpg)
InstrumentationPersonal Computer
ComputerTool 1
ComputerTool 2
ComputerTool 3
ComputerTool 4
Authenticated
Virtual Computer
ComputerTool
ComputerTool
ComputerTool
ComputerTool
ComputerTool
EventDataset
PersonalData
Encoding
Report
Infer
Act
InstructorStudent
Abelardo Pardo Analytics to understand learning environments 19
![Page 20: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/20.jpg)
Abelardo Pardo Analytics to understand learning environments 20
Horia
Varlanflickr.com
Tool usage vs academic performance
(Romero-Zaldívar et al., 2012)
![Page 21: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/21.jpg)
Abelardo Pardo Analytics to understand learning environments 21
Chiot’s
Run
Flickr.com
Collect URLs Compare withcourse notes
Detect newresources
(Romero-Zaldívar et al., 2011)
![Page 22: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/22.jpg)
Abelardo Pardo Analytics to understand learning environments 22
Adventures
inLibrarianship
flickr.com
Detect engagementwhile writing
(Calvo et al., 2011, Liu et al., 2013)
![Page 23: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/23.jpg)
Facial expressions
Detect emotions
Abelardo Pardo Analytics to understand learning environments 23
(Monkaresi et al., 2012)
![Page 24: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/24.jpg)
Abelardo Pardo Analytics to understand learning environments 24
Quinn
Anya
flickr.com
LearningAnalytics
Observe andCollect
View and Act
![Page 25: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/25.jpg)
Learning glass
Abelardo Pardo Analytics to understand learning environments 25
(Crespo et al. 2012, Leony et al., 2012)
![Page 26: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/26.jpg)
Abelardo Pardo Analytics to understand learning environments 26
![Page 27: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/27.jpg)
Showquestion
Showcorrect
Showincorrect
Showsolutions
again
again
Abelardo Pardo Analytics to understand learning environments 27
Transitions are recorded(Pardo et al., 2012)
![Page 28: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/28.jpg)
Abelardo Pardo Analytics to understand learning environments 28
Just in time teaching
![Page 29: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/29.jpg)
Abelardo Pardo Analytics to understand learning environments 29
Browser add-in
![Page 30: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/30.jpg)
Abelardo Pardo Analytics to understand learning environments 30
Quinn
Anya
flickr.com
LearningAnalytics
Observe andCollect
View and Act
Self-motivation
![Page 31: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/31.jpg)
“Transition” for patients with a chronic illness
Abelardo Pardo Analytics to understand learning environments 31
(Calvo et al., 2013)
![Page 32: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/32.jpg)
Self-determination theory and types ofmotivation
Abelardo Pardo Analytics to understand learning environments 32
(Ryan and Deci, 2000)
![Page 33: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/33.jpg)
Explore the most adequate channels to dialoguewith the patient.
Abelardo Pardo Analytics to understand learning environments 33
(Yu Zhao, ASWEC Doctoral Consortium 2014)
![Page 34: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/34.jpg)
Abelardo Pardo Analytics to understand learning environments 34
Matheson
LearningC
omm
onsflickr.com
First-year transition
![Page 35: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/35.jpg)
Abelardo Pardo Analytics to understand learning environments 35
KeoniC
abralflickr.com
Tech for high stakes finite time periods
![Page 36: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/36.jpg)
Abelardo Pardo Analytics to understand learning environments 36
Quinn
Anya
flickr.com
LearningAnalytics
Observe andCollect
View and Act
Self-motivation
Flippedclassroom
![Page 37: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/37.jpg)
Increasing use of videos
Abelardo Pardo Analytics to understand learning environments 37
![Page 38: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/38.jpg)
What is missing?
AnnotationHighlight areas of importanceCollaborationIntegration in learning environment
Abelardo Pardo Analytics to understand learning environments 38
![Page 39: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/39.jpg)
Students “comment” on video with someguidance
Abelardo Pardo Analytics to understand learning environments 39
(OLT Project, Using video annotation software to develop student self-regulated learning)
![Page 40: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/40.jpg)
Abelardo Pardo Analytics to understand learning environments 40
KreativeK
ewlflickr.com
Flipped Classroomdoes not exist!
(Bergmann & Sams, 2012)
![Page 41: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/41.jpg)
Abelardo Pardo Analytics to understand learning environments 41
MIT
CH
EL
Lflickr.com
Old idea, but revived due to two reasons
![Page 42: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/42.jpg)
Abelardo Pardo Analytics to understand learning environments 42
Krugazorflickr.com
(Mazur, 2009)
Simple transfer of information is not optimal!
![Page 43: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/43.jpg)
Abelardo Pardo Analytics to understand learning environments 43
Juantan
Kw
onflickr.com
Resourceseverywhere!
![Page 44: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/44.jpg)
Abelardo Pardo Analytics to understand learning environments 44
Fellmannia
flickr.com
Face-to-face timeis very valuable!
![Page 45: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/45.jpg)
Abelardo Pardo Analytics to understand learning environments 45
-NA
CH
-flickr.com
Remember
Understand
Apply
Analyze
Evaluate
Create
Incl
ass
Ass
ignm
ents
Can we do better?
![Page 46: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/46.jpg)
Abelardo Pardo Analytics to understand learning environments 46
-NA
CH
-flickr.com
Remember
Understand
Apply
Analyze
Evaluate
Create
Pre
-ass
ignm
ents
Incl
ass
![Page 47: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/47.jpg)
Abelardo Pardo Analytics to understand learning environments 47
p_a_hflickr.com
A) Previous activities (Be prepared!)
![Page 48: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/48.jpg)
Abelardo Pardo Analytics to understand learning environments 48
Hijukalflickr.com
B) Activities face-to-face
![Page 49: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/49.jpg)
Abelardo Pardo Analytics to understand learning environments 49
Flyinggflickr.com
Great case for datasupported decisions!
![Page 50: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/50.jpg)
Weekly activities
Abelardo Pardo Analytics to understand learning environments 50
![Page 51: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/51.jpg)
Previous andin-class activitiesfor each session
Abelardo Pardo Analytics to understand learning environments 51
![Page 52: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/52.jpg)
Detecting when blocks of text are visualized
Abelardo Pardo Analytics to understand learning environments 52
![Page 53: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/53.jpg)
Interactions with videos
Abelardo Pardo Analytics to understand learning environments 53
![Page 54: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/54.jpg)
Questions embedded in text
Abelardo Pardo Analytics to understand learning environments 54
![Page 55: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/55.jpg)
Problem Sequences
Abelardo Pardo Analytics to understand learning environments 55
![Page 56: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/56.jpg)
Data back to the students
Abelardo Pardo Analytics to understand learning environments 56
![Page 57: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/57.jpg)
Your activity with respect to the rest of the class
Abelardo Pardo Analytics to understand learning environments 57
![Page 58: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/58.jpg)
Abelardo Pardo Analytics to understand learning environments 58
Eleafflickr.com
• Will students use dataabout their events?
• Will they act on what theysee?
• Will the tips have anyeffect?
![Page 59: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/59.jpg)
Abelardo Pardo Analytics to understand learning environments 59
(OLT Project, Radical transformation: re-imagining engineeringeducation through flipping the classroom in a global learningpartnership)
![Page 60: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/60.jpg)
r2hoxFlickrAnalytics to understand learningenvironments
Chai Seminar, 14 April 2014
Dr Abelardo Pardo (@abelardopardo)School of Electrical and Information Engineering
slideshare.net/abelardo_pardo
![Page 61: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/61.jpg)
References
Bichsel, J. (2012).Analytics in Higher Education Benefits, Barriers, Progress, and Recommendations.EDUCAUSE Center for Applied Research
Hattie, J. A. C. (2009).Visible learning: A synthesis of over 800 meta-analyses related to achievement.New York: Routledge.
Pardo, A., Delgado Kloos, C., 2011,Stepping out of the box. Towards analytics outside the Learning Management SystemInternational Conference on Learning Analytics and Knowledge, pp, 163-167, ACM New York, USA
Romero-Zaldívar, V.A., Pardo, A., Burgos, D., Delgado Kloos, C., 2012Monitoring Student Progress Using Virtual Appliances: A Case StudyComputer & Education, 58(4):10580–1067, 2012
Romero-Zaldívar, V.A., Crespo García, R., Burgos, D., Delgado Kloos, C., Pardo, A., 2012Automatic Discovery of Complementary Learning ResourcesEuropean Conference on Technology Enhanced Learning, 2011
Abelardo Pardo Analytics to understand learning environments 61
![Page 62: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/62.jpg)
References II
Liu M., Calvo, R.; Pardo, A., 2013Visualizing the effect of actions in personal informatics systemsWorkshop on Personal Informatics, CHI’13
Calvo, R., O’Rourke, S.T., Jones, J., Yacef, K., Reimann, P., 2011Collaborative Writing Support Tools on the CloudIEEE Transactions on Learning Technologies, 4(1):88–97
Monkaresi, H., Hussain, M. S., Calvo, R., 2012A dynamic approach for detecting naturalistic affective states from facial videos during HCIAustralasian Joint Conference on Artificial Intelligence, Sydney, Australia. LNAI, Springer 2012, pp.170-181
Crespo García, R.M., Pardo, A., Delgado Kloos, C., Niemann, K., Scheffel, M., Wolpers, M., 2012Peeking into the black box: visualising learning activities.International Journal on Technology Enhanced Learning, 4(1/2), 2012
Leony, D., Pardo A., De la Fuente Valentín, L., Sánchez de Castro, D., Delgado Kloos, C. 2012GLASS : A Learning Analytics Visualization ToolInternational Conference on Learning Analytics and Knowledge, pp. 162-163, ACM Press.
Abelardo Pardo Analytics to understand learning environments 62
![Page 63: Analytics to understand learning environments](https://reader035.vdocument.in/reader035/viewer/2022081403/5549442cb4c905144d8b54ee/html5/thumbnails/63.jpg)
References III
Calvo, R. A., Pardo, A., Zhao, Y., Klineberg, E., Lam, M., and Steinbeck, K. 2013.TransitionMate: a mobile application for chronic illness transition support.In C. Röcker, M. Ziefle, A. Holzinger, K. McGee, S. Hansen, and J. Meyer (Eds.), Fifth InternationalWorkshop on Smart Healthcare and Wellness Applications (SmartHealth’13) - OzCHI 2013, Nov 25-26.Adelaide, South Australia: ACM.
Ryan, R., and Deci, E. (2000).Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being.American Psychologist, 55(1), 68–78.
Bergmann, J., Sams, A., (2012)Flip Your Classroom: Reach Every Student in Every Class Every DayHawker Brownlow Education
Mazur, E., (2009)Farewell, Lecture?Science, 323, pp. 50-51.
Abelardo Pardo Analytics to understand learning environments 63