entrada 2017 conference keynote

Entrada& Analytics

Janet Corral, PhD

University of Colorado School of Medicine

Academic Analytics is a Hot Topic

2011Journal of Learning Analytics

2012Georgia State Univlaunches student data system

20131st international learning analytics conference

2014Two analytics presentations at AAMC LSL

20151st AAMC GIR DATA Symposium

2016EDUCAUSE Horizon report: Learning analytics 1 yr or less to adoption

20171st Ed Tech Working Group presentation on data standards

2010Purdue University Signals

Higher Education Med Schools

Defining analytics

Learning Analytics

Education Data

Mining

Academic Analytics

What About ENTRADA?

Continuum of Options

Basic Visuals FeedbackNudging & Coaching

Need multiple data sources

To support quality learning outcomes, educational analytics…

Need multiple data sources Will impact the whole system of stakeholders

To support quality learning outcomes, educational analytics…

BASIC VISUALIZATION

Entrada + Google Analytics = ?

With gratitude to the Entrada Project: http://www.entrada-project.org/

With gratitude to NYU Educational Data Warehouse: alex.support@med.nyu.edu

Visualization Tips

White Space

Pick a palette

Make it meaningful

FEEDBACK

Impact

10.37%

100 Student Advisors or Coaches

increase in B or A awarded

“The students who get a red light almost all contact me immediately to ask how to raise their grades.”

-Tim Delworth, Mathematics

Vanderbilt VSTAR

https://vstar.mc.vanderbilt.edu/

Vanderbilt VSTAR

Action is outside the digital system

Impact

NEW faculty role ‘coach’

NEW curriculum

What did I get wrong? I’ll study

harder next time

Carnegie Mellon OLI project: http://oli.cmu.edu/get-to-know-oli/course-features/

Feedback specific to the answer selected

Math 101

Clinical Cases

Taken from: https://www.amboss.com

Highlight key info

Explanation

Visual cue

More Explanation

Does feedback

work?

Comparable learning outcomes for students in half the time1

1. Bowen, WG, Chingos, MM, Lack, KL & Nygren, T. (2012) Interactive Learning Online at Public Universities: Evidence from Randomized Trials. ITHAKA.

2. Cohen, Alon, Tamir Hazan, and Tomer Koren. "Online learning with feedback graphs without the graphs." International Conference on Machine Learning. 2016

Removing feedback graphs may make a problem unlearnable2X

Does feedback work?

Acrobatiq by Carnegie Mellon

Make Progress Transparent to Faculty

Analytics is more than

buildingdashboards

Learning analytics

impact our

systemsof Education

Community Discussion

How can the Entradacommunity engage

stakeholders in planning for analytics?

Nudging & Coaching

Nudging

NudgingIt’s been 7 days since you logged in. Students who access course discussion boards 3x/week are 15% more successful in the course.

Nudging/Coaching

Coaching

Community Discussion

Where could Entrada benefit

learners with nudging or coaching?

Other Points We Should Discuss

Correlation ≠ Causation

http://www.tylervigen.com/spurious-correlations

UC Denver 81 dentistry students184 medical students180 pharmacy students

Denver Public Schools81,438 students

Facebook1.71 billion monthly active users

University of Phoenix400,000 students per

year

Twitter14 Pedabytes of Data

Netflix40 Pedabytes of Data

MedEd Data ≠ not BIG Data

Need multiple data sources

To support quality learning outcomes, educational analytics…

Need multiple data sources Will impact the whole system of stakeholders

To support quality learning outcomes, educational analytics…

Community Discussion

What type(s) of analytics are most

effective for Entrada to engage?

Janet Corral

Janet.Corral@ucdenver.edu

Thank you