what if we could observe all events in a learning environment?
DESCRIPTION
If we could observe all the events in a learning environment, even the most hidden ones, what kind of interventions would become feasible? The presentation finishes with a workshop to manipulate a dataset with R.TRANSCRIPT
![Page 1: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/1.jpg)
What if we could observeall events in alearning environment?
MUI-TIC, Valladolid, April 2012
Abelardo Pardo
www.slideshare.net/abelardo_pardo
@abelardopardo
Auntie
pflick
r.com
![Page 2: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/2.jpg)
Journey to 10 years from now
Abelardo Pardo What if we could observe all events in a learning environment? 2
libra
rym
an
flick
r.com
![Page 3: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/3.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 4
ribarn
ica
flick
r.com
Analyticstoday
![Page 4: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/4.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 5
http
://blo
g.s
tephenw
olfra
m.c
om
/2012/0
3/th
e-p
ers
onal-a
naly
tics-o
f-my-life
/
![Page 5: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/5.jpg)
Is she pregnant?
Abelardo Pardo What if we could observe all events in a learning environment? 6
![Page 6: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/6.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 7
http
://hdguru
.com
/is-yo
ur-n
ew
-hdtv
-watc
hin
g-yo
u/7
643
April
2012
![Page 7: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/7.jpg)
Analytics everywhere!
Abelardo Pardo What if we could observe all events in a learning environment? 8
The
Wall
Stre
etJourn
al,
Feb.
22nd
2012
![Page 8: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/8.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 9
lave
rrue
flick
r.com
![Page 9: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/9.jpg)
No (unwanted) surprises!
Abelardo Pardo What if we could observe all events in a learning environment? 10
http
://seth
godin
.typepad.c
om
/seth
s_blo
g/2
012/0
2/th
e-illu
sio
n-o
f-priva
cy-a
nd-w
hat-w
e-a
ctu
ally
-care
-about.h
tml
![Page 10: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/10.jpg)
Medicalrecords
Abelardo Pardo What if we could observe all events in a learning environment? 11
Reig
hLeB
lanc
flick
r.com
![Page 11: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/11.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 12
C.E
lleflick
r.com
(Campbell, De Blois, Oblinger 2007)
Collect
Report
Predict
Act
Refine
The five stepsof analytics
![Page 12: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/12.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 13
ribarn
ica
flick
r.com
Analyticstoday
Potentialinlearning
![Page 13: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/13.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 14
Shaylo
rflick
r.com
Did they learn?
![Page 14: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/14.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 15
Joshua
Rappeneke
rflick
r.com
![Page 15: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/15.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 16
Bik
ing
Niko
nS
FO
flick
r.com
If you can not measure it,you can not improve it.
![Page 16: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/16.jpg)
bencrowe flickr.com
“We need better evaluationto acknowledge and esteem
excellence when it occurs,as it does.”
John Hattie. Visible Learning: A Synthesis of Over 800Meta-Analyses Relating to Achievement.
Abelardo Pardo What if we could observe all events in a learning environment? 17
![Page 17: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/17.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 18
bodhith
ajflick
r.com
Learning analytics improvethe feedback loop
![Page 18: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/18.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 19
bodhith
ajflick
r.com
(Jones, 2011)
Administration Students
Teachers Researchers
![Page 19: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/19.jpg)
Marketingfacts flickr.com
Where is learning analytics?
Abelardo Pardo What if we could observe all events in a learning environment? 20
![Page 20: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/20.jpg)
PranceyDog flickr.com
LA as vertical market
Specialized objectives
Specialized audiences
Specialized topic
Abelardo Pardo What if we could observe all events in a learning environment? 21
![Page 21: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/21.jpg)
www.solaresearch.orgAbelardo Pardo What if we could observe all events in a learning environment? 22
![Page 22: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/22.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 23
ribarn
ica
flick
r.com
Analyticstoday
Potentialinlearning
Challenges
![Page 23: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/23.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 24
ljubar
flick
r.com
More detailed observations
Keep the tutor in the loop
![Page 24: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/24.jpg)
A clearly identifiedenvironment within
your computer
Abelardo Pardo What if we could observe all events in a learning environment? 25
Pepe
Ortu
ño
flick
r.com
![Page 25: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/25.jpg)
Automatic discoveryof complementarylearning resources
Abelardo Pardo What if we could observe all events in a learning environment? 26
Sean
Dre
ilinger
flick
r.com
![Page 26: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/26.jpg)
Measure engagement inout-of-class activities
Abelardo Pardo What if we could observe all events in a learning environment? 27
IAN
RA
NS
LE
YD
ES
IGN
+IL
LU
ST
RAT
ION
flick
r.com
![Page 27: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/27.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 28
Just in time teaching
![Page 28: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/28.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 29
em
mm
apeelflick
r.com
![Page 29: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/29.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 30
jfrave
lflick
r.com
Team dynamics
![Page 30: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/30.jpg)
Quick intuitivefeedback
Abelardo Pardo What if we could observe all events in a learning environment? 31
![Page 31: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/31.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 32
![Page 32: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/32.jpg)
Stakeholders observe, predict and act
Abelardo Pardo What if we could observe all events in a learning environment? 33
![Page 33: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/33.jpg)
How are you?
Abelardo Pardo What if we could observe all events in a learning environment? 34
Joe
Shalo
btn
ikflick
r.com
![Page 34: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/34.jpg)
Moodchanges
Abelardo Pardo What if we could observe all events in a learning environment? 35
![Page 35: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/35.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 36
::cala
vera
café
::flick
r.com
![Page 36: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/36.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 37
purp
leja
vatro
llflick
r.com
![Page 37: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/37.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 38
Dru
!flick
r.com
ScenarioData setmanipulation
Interventions!
![Page 38: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/38.jpg)
• 15 weeks. Sessions X, F 12-13:30
• 100 students
• 7 score tests per student
• Course notes with 30 “nodes” publishedgradually
• 5 events: forum_view, forum_post,visit_node, use_tool_1, use_tool_2
Make it your own course!
Abelardo Pardo What if we could observe all events in a learning environment? 39
net_
efe
ktflick
r.com
![Page 39: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/39.jpg)
Events (events.csv.gz): around 81,000 x 4 matrix
datetime,event_type,user,payload
2011-09-05 15:26:01,use_tool_1,7a869b4d9,block_1
...
Scores (scores.csv.gz): 100 x 7 matrix
user,score_1,score_2,score_3,score_4,...,score_7
7a869b4d9, 6.4, 9.0, 7.9, 7.6, 5.1, 5.5, 6.7
...
Abelardo Pardo What if we could observe all events in a learning environment? 40
jovike
flick
r.com
![Page 40: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/40.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 41
Let’s explore!
![Page 41: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/41.jpg)
Abelardo Pardo What if we could observe all events in a learning environment? 42
cesara
stu
dillo
flick
r.com
Analyze, propose, discuss
![Page 42: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/42.jpg)
theunquietlibrarian flickr.com
1 What did you observe?
2 Which data is missing?
3 What would you do?
4 What would the system do?
Which challenge for LA do you envision?
Abelardo Pardo What if we could observe all events in a learning environment? 43
![Page 43: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/43.jpg)
script.R
1 Load data into “data frames”
2 Show data summaries
3 Change type of column in data frame
4 View sample histogram
5 Add a column with the mean scores
6 Plot scores for one student
7 Separate events into types
8 Merge event counts with scores
Select command + CRTL-Return (Execute)
Abelardo Pardo What if we could observe all events in a learning environment? 44
para
l_la
xflick
r.com
![Page 44: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/44.jpg)
R cheat sheet
• Data frame: heterogeneous matrix,“events.csv”
• Data frame column: events.csv$event_type
• Arrays: c(’one’, ’two’, ’three’), c(1, 2, 3),c(2:8)
• Sequences: 1:5, seq(1, 6)
• Graphics: barplot(), boxplot(), hist(), plot()
• Functions: length(), rownames(),colnames(), mean()
• cor() (correlation), var() (variance)
• mean(), median(), min(), max(), sum()
Abelardo Pardo What if we could observe all events in a learning environment? 45
Cals
idyro
se
flick
r.com
![Page 45: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/45.jpg)
R tests
• cor.test(v1, v2)
• wilcox.test(v1, v2)
• shapiro.test(v1)
R help
• help(any function name)
• Various cheatsheets included in workspace(cheatsheet_*.pdf)
Abelardo Pardo What if we could observe all events in a learning environment? 46
Cals
idyro
se
flick
r.com
![Page 46: What if we could observe all events in a learning environment?](https://reader033.vdocument.in/reader033/viewer/2022052821/5549446db4c9050f4d8b5420/html5/thumbnails/46.jpg)
References
The personal analytics of my life
Stephen Wolframhttp://blog.stephenwolfram.com/2012/03/the-personal-analytics-of-my-life/
How waiters read your table
Sara NassauerThe Wall Street Journal, Feb. 22nd 2012
The illusion of privacy (and what we actually care about)
Seth Godinhttp://sethgodin.typepad.com/seths_blog/2012/02/the-illusion-of-privacy-and-what-we-actually-care-about.html
Academic Analytics
Campbell J., DeBlois P., Oblinger D.EDUCAUSE White paper, 2007
Visible learning: A synthesis of over 800 meta-analyses related to achievement
Hattie, J. A. C.Routledge, New York 2009
Learning analytics: Starvation and telling us what we already know?
David Joneshttp://davidtjones.wordpress.com/2012/04/01/learning-analytics-starvation-and-telling-us-what-we-already-know/
Abelardo Pardo What if we could observe all events in a learning environment? 47