progress on using adaptive learning technology for student college success (287903297)

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 1/20

Progress on Using AdaptiveLearning Technology for StudentCollege Success

Yvonne Belanger, Bill & Melinda Gates FoundationLouise Yarnall, SRI InternationalJo Jorgenson, Rio Salado CollegeDouglas Walcerz, Essex County College

EDUCAUSEOctober 30, 2015

Indianapolis, Indiana

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 2/20

Session Outline

Greetings and Introductions –

Yvonne Belanger & teamVision and Goals of The Adaptive Learning MarketAcceleration Project (ALMAP) - Yvonne Belanger

ALMAP Evaluation Portfolio Description – Louise Yarnall

Moderated Overview of Two Grantee Implementations – Louise Yarnall (Moderator), Jo Jorgenson & Douglas Walcerz

ALMAP Portfolio Evaluation Insights – Louise Yarnall

Moderated Reflection on Adaptive Learning Experience – Louise Yarnall (Moderator) Jo Jorgenson & Douglas Walcerz

Audience Q&A

EDUCAUSE 2

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 3/20

Introductions Yvonne Belanger – Sr. Program Officer, Measurement andEvaluation, The Bill & Melinda Gates Foundation, WA

Louise Yarnall – Sr. Researcher, SRI International; ALMAPPortfolio Evaluator, CA

Jo Jorgenson – Dean, Instruction & CommunityDevelopment, Rio Salado College, AZ; ALMAP Grantee

Douglas Walcerz – Vice President, Planning, Research, &Assessment, Essex County College, NJ; ALMAP Grantee

EDUCAUSE 3

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 4/20

© 2014 Bill & Melinda Gates Foundation | 4

14 Grants involving

17 colleges, universities

9 Adaptive Learning Platforms

22 Courses

21,644 Total Students Enrolled (across 3 terms)

44% Average % of Pell eligible students at grantees

4 yr.Institutions

2 yr.Institutions

4 yr. For Profit

Gen Ed

Dev Ed

Online Blended

Blended /Emporium

Discipline English

Math

Psychology

Biology

BusinessMicroeconomics

Astronomy

Marketing

Computer Science

ADAPTIVE LEARNING MARKET ACCELERATION GRANTPROGRAM (ALMAP)

699 instructors

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 5/20

ALMAP Institutions

© 2014 Bill & Melinda Gates Foundation | 5

SOLUTIONS

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 6/20

Adaptive technology personalizesinstruction & learning

Coursewareprovides customizedfeedback to students

on learning gaps

Courseware tracksprogress for

instructor support

EDUCAUSE 6

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 7/20

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 8/20

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 9/20

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 10/20

ALMAP Portfolio EvaluationResearch Questions

What student impacts are noted and in what HEcontexts/disciplines?

How does using adaptive courseware affect thecosts of instruction?

How are students and instructors experiencingadaptive courseware?

EDUCAUSE 10

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 11/20

ALMAP Evidence of Impacts

Significant positive course grade gains noted whenadaptivity was:

• Part of course redesign (lecture blended) OR

• Added to online courses BUT

• NOT when replacing another blended technology

EDUCAUSE 11

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 12/20

ALMAP Evidence of Impacts

Product features linked with learning gains:

• Progress dashboards

• Regular quizzes/feedback

• Referrals to remedial content and study tips

• Spaced memorization practice

• Vendor content− But 1 supported memorization of faculty content

EDUCAUSE 12

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 13/20

ALMAP Evidence of Impacts

Course disciplines showing more learning gains:

• 50% of psychology courses

• 42% of mathematics courses

• 25% of biology courses

• 16% of English courses

EDUCAUSE 13

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 14/20

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 15/20

Student Experience

Most students** reported positive learning gains• 77% of associate’s students• 51 % of bachelor’s students

Students reported different levels of engagement• 56% of associate’s students• 33 % of bachelor’s students

EDUCAUSE 15**22% of all student participants surveyed+ responded

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 16/20

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 17/20

ALMAP Recommendations forHigher Ed Evaluation Practice

HEIs can learn more via rigorous evaluation• Establish baseline equivalence by gathering data on student

characteristics (e.g., pretest, entry exam scores)• Use common learning assessments between comparison

conditions rather than just course grades• Ensure you have samples sizes > 10

To understand implementation, HEIs may also:• Study learner courseware usage data to measure engagement• Conduct classroom observations and interviews• Gather time logs from instructors for more precise cost data

EDUCAUSE 17

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 18/20

EDUCAUSE 18

How did you change your use ofadaptive learning products overtime and why?

"Memphis in Front of Me, Arkansas in Back of Me .” Gary Bridgman,

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 19/20

8/20/2019 Progress on Using Adaptive Learning Technology for Student College Success (287903297)

http://slidepdf.com/reader/full/progress-on-using-adaptive-learning-technology-for-student-college-success 20/20

Further Information

Bill & Melinda Gates Foundation ALMAP ReportRelease Information:November 2015: postsecondarysuccess.gatesfoundation.org

Essex Information:E-Literate TV YouTube Channel – Essex County College• Video 1: https://www.youtube.com/watch?v=_QajSjOGQsg• Video 2: https://www.youtube.com/watch?v=Wy5a68jgtnM

Rio Salado Information:Completing Assignments And Tracking Your Progress:https://www .youtube.com/watch?v=AB6A_u1WZjoOverviews and animations:

https://www .youtube.com/watch?v=HJIYoAkBtkY EDUCAUSE 20