entrada 2017 conference keynote
TRANSCRIPT
Entrada& Analytics
Janet Corral, PhD
University of Colorado School of Medicine
Academic Analytics is a Hot Topic
2011Journal of Learning Analytics
2012Georgia State Univlaunches student data system
20131st international learning analytics conference
2014Two analytics presentations at AAMC LSL
20151st AAMC GIR DATA Symposium
2016EDUCAUSE Horizon report: Learning analytics 1 yr or less to adoption
20171st Ed Tech Working Group presentation on data standards
2010Purdue University Signals
Higher Education Med Schools
Defining analytics
Learning Analytics
Education Data
Mining
Academic Analytics
What About ENTRADA?
Continuum of Options
Basic Visuals FeedbackNudging & Coaching
Need multiple data sources
To support quality learning outcomes, educational analytics…
Need multiple data sources Will impact the whole system of stakeholders
To support quality learning outcomes, educational analytics…
BASIC VISUALIZATION
Entrada + Google Analytics = ?
With gratitude to the Entrada Project: http://www.entrada-project.org/
With gratitude to NYU Educational Data Warehouse: [email protected]
Visualization Tips
White Space
Pick a palette
Make it meaningful
FEEDBACK
Impact
10.37%
100 Student Advisors or Coaches
increase in B or A awarded
“The students who get a red light almost all contact me immediately to ask how to raise their grades.”
-Tim Delworth, Mathematics
Vanderbilt VSTAR
https://vstar.mc.vanderbilt.edu/
Vanderbilt VSTAR
Action is outside the digital system
Impact
NEW faculty role ‘coach’
NEW curriculum
What did I get wrong? I’ll study
harder next time
Carnegie Mellon OLI project: http://oli.cmu.edu/get-to-know-oli/course-features/
Feedback specific to the answer selected
Math 101
Clinical Cases
Taken from: https://www.amboss.com
Highlight key info
Explanation
Visual cue
More Explanation
Does feedback
work?
Comparable learning outcomes for students in half the time1
1. Bowen, WG, Chingos, MM, Lack, KL & Nygren, T. (2012) Interactive Learning Online at Public Universities: Evidence from Randomized Trials. ITHAKA.
2. Cohen, Alon, Tamir Hazan, and Tomer Koren. "Online learning with feedback graphs without the graphs." International Conference on Machine Learning. 2016
Removing feedback graphs may make a problem unlearnable2X
Does feedback work?
Acrobatiq by Carnegie Mellon
Make Progress Transparent to Faculty
Analytics is more than
buildingdashboards
Learning analytics
impact our
systemsof Education
Community Discussion
How can the Entradacommunity engage
stakeholders in planning for analytics?
Nudging & Coaching
Nudging
NudgingIt’s been 7 days since you logged in. Students who access course discussion boards 3x/week are 15% more successful in the course.
Nudging/Coaching
Coaching
Community Discussion
Where could Entrada benefit
learners with nudging or coaching?
Other Points We Should Discuss
Correlation ≠ Causation
http://www.tylervigen.com/spurious-correlations
UC Denver 81 dentistry students184 medical students180 pharmacy students
Denver Public Schools81,438 students
Facebook1.71 billion monthly active users
University of Phoenix400,000 students per
year
Twitter14 Pedabytes of Data
Netflix40 Pedabytes of Data
MedEd Data ≠ not BIG Data
Need multiple data sources
To support quality learning outcomes, educational analytics…
Need multiple data sources Will impact the whole system of stakeholders
To support quality learning outcomes, educational analytics…
Community Discussion
What type(s) of analytics are most
effective for Entrada to engage?
