swarm-based sequencing recommendations in e-learning colin tattersall, bert van den berg, rené van...

43
Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis Brouns, Wim Waterink, Catherine Bolman, Pierre Höppener, Rob Koper Onderwijstechnologisch Expertisecentrum

Upload: dorothy-hunt

Post on 13-Jan-2016

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Swarm-based sequencing

recommendations in

e-learning

Colin Tattersall, Bert van den Berg, René van Es, José

Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Brouns, Wim Waterink, Catherine Bolman, Pierre

Höppener, Rob Koper

Onderwijstechnologisch Expertisecentrum

Page 2: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Introduction

Life Long Learning Adult learners who work Learning takes mostly place in spare time Update knowledge

Online and Distance Education Flexibility Full learning programs Short programs

Learners guided by interest Shopping behavior

Page 3: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Learning Networks

Facilities for life long learners Support seamless, ubiquitous access Activity nodes:

Anything that supports learning Course Workshop Conference Web resource

Providers and learners can create new ANs

Page 4: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Learning Networks II

Self-organized, distributed e-learning systems, designed to facilitate lifelong learning.

Refers to the connection of a large number of actors and learning

artifacts into an organization, as well as to the physical ICT network

and facilities that are responsible for the technical connections.

Page 5: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Goal

Position

Learning Network

AN e

AN n

AN g

AN k

AN h

AN wAN s

AN x AN f

AN t

AN oAN v

AN uActors

Page 6: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Issues in a learning network:

Position: Where are you at this moment

Goal: What do you want to reach

To do list: Goal – Position

≈ A list of ANs that you still have to complete

Page 7: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Problem: How do we support life-long

learners to determine their learning path

We used the principles of self-organisation to provide Feedback

What feedback?

Page 8: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Principles of Self-organisation

Page 9: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

What feedback?

Last completed Best Next

Page 10: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Feedback tool

Navigation help for learners Advices best next AN Based on the behaviour of other learners Applied at an Internet course

Page 11: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Architecture for wayfinding support

Page 12: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Feedback mechanism

  A B C D E{} 1 3 2 4 5A   4 2 5 1B 2   2 1 3C 3 4   1 2D 4 2 4   5E 1 2 5 3  

E = {ABBCCCCCDDD}

Page 13: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Approach – different viewpoints:

1. Analysis of current situation: Case 1st year of Psychology

2. Simulating the effects of feedback/stigmergy in a Learning network

3. Feedback tool developed and tested in experimentHypotheses:

1. Increased efficiency in Experimental group2. Higher path conversions in Experimental group

Page 14: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Simulation of a Learning network

Why a simulation To save time To test techniques prior to tool development To make predictions

Page 15: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

The underlying model

Learner

GoalCompetenciesMotivationAvailable studytime

Activity node

Objective & LevelQualityStudyload

Studying of a AN by Learner

Matching errorSelect best alternativeTime learner spendsAttain or dropout

Page 16: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

De Roma simulation

The learning network consists of ANs Learners have to successfully complete all ANs

Various factors: With feedback/without feedback Amount of ANs Amount of learners AN quality Rate of feedback pursuit

Page 17: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Exemplary outcome

Without pheromones 67% successful 30% dropout

With pheromones 76% successful 22% dropout

Page 18: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Convergence of learning paths

Without pheromones Module-7,Module-8,Module-5,Module-9,Module-3,Module-11,Module-4,Module-2 Module-5,Module-7,Module-9,Module-3,Module-11,Module-2,Module-1,Module-6 Module-3,Module-5,Module-6,Module-4,Module-11,Module-1,Module-7,Module-10 Module-10,Module-11,Module-9,Module-2,Module-4,Module-5,Module-3,Module-6 Module-7,Module-5,Module-6,Module-1,Module-2,Module-3,Module-9,Module-4

With pheromones Module-1,Module-7,Module-5,Module-6,Module-2,Module-3,Module-8,Module-11 Module-4,Module-10,Module-7,Module-1,Module-8,Module-5,Module-3,Module-9 Module-1,Module-8,Module-4,Module-9,Module-11,Module-3,Module-5,Module-2 Module-7,Module-1,Module-8,Module-4,Module-9,Module-5,Module-10,Module-2 Module-1,Module-8,Module-4,Module-9,Module-11,Module-3,Module-2,Module-5

Page 19: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Internet course

Two Moodle sites Internetcursus.ou.nl (control group 505 learners) Minicursus.ou.nl (experimental group 507

learners) Per group 1 helpdesk 11 AN’s (modules)

Beginning internet surfers 2 hours studyload per AN Ended with 5 question test

Started March 17 Ended July 17

Page 20: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Cursusoverzicht

Page 21: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Control group

Page 22: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Experimental group

Page 23: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Content example

Page 24: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Learning paths

Page 25: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Learning Paths

a b c d e f g h i j k t

(Geen voorlaatste cursus) 39 112 15 15 12 3 4 8 7 19 15 249

A De vele wegen naar internet 13 14 22 5 3 3 7 22 17 14 120

B Haal meer uit Internet Explorer 21 1 1 10 21 48 1 5 29 137

C Het nuttige en het aangename 12 9 4 8 6 21 9 10 4 18 101

D Kijken en luisteren op internet 8 5 2 8 7 13 4 28 1 12 88

E Maatregelen tegen spam en 11 3 30 3 6 5 10 3 39 110

F Naar een persoonlijke webpagina 4 10 6 18 12 6 7 2 5 70

G Net chatten en Netsletten 13 1 1 17 9 10 2 9 9 1 72

H Omgaan met ongewenste inhoud 15 6 10 4 42 5 9 6 2 99

I Veilig betalen op internet 4 4 8 12 17 7 8 4 5 17 86

J Wormen en paarden 4 2 8 8 11 8 12 16 10 12 91

K Zoeken op het web 12 10 20 5 2 25 4 13 8 2 101

Eindtotaal 143 175 115 108 127 90 97 128 109 112 120 1324

Page 26: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Preliminary results

Base upon: Questionnaire in the course

Male/Female Age Preliminary training/experience Computer skills

Learning paths (logged) Questionnaire afterwards

Page 27: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Completion rate of AN’s

Page 28: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis
Page 29: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Summary of preliminary findings

Convergence Course completion

Experimental group 95 Control group 73

Non-starters Experimental group 114 Control group 128

No show 246

Page 30: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Period I

Final results I

Learner progress

Page 31: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Period I Period II

Final results I

Learner progress

Page 32: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Period I Period II Period III

Final results I

Learner progress

Page 33: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

?

Period I Period II Period III Period IV

Final results I

Learner progress

Page 34: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Period I Period II Period III Period IV

Final results I

Learner progress

Significant difference up to interference

Page 35: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Final results II (after correction)

Goal attainment

Completion of 11 ANs

Group Total

Control Experimental

No 26566,6%

24559,8%

51063,1

Yes 13333,4%

16540,2%

18336,9%

Total 398 410 808

100,0% 100,0% 100,0%Significant difference

Page 36: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Final results III

Efficiency Avarage time needed to complete all 11

modules

Control group: 38,9 days Experimental group: 36,5 days

Not significant

Page 37: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Roma results - products

Smiling Faces Articles en papers:

Simulation Swarm-based adaptation: wayfinding support

for lifelong learners 'Self Organising Wayfinding Support for

Lifelong Learners' published in 'Education and Information Technologies'.

Swarm-based sequencing recommendations in e-learning

http://dspace.learningnetworks.org

Page 38: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis
Page 39: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Leeftijd

01020304050607080

Onbek

end

0 - 2

5

26 -

35

36 -

45

46 -

55

56 -

65> 65

controle

experiment

back

Page 40: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Control group

Experimental

group 1-seq 9 11 2-seq 0 1 25%

3-seq 0 0 1-seq 11 11 2-seq 0 3 20%

3-seq 0 0 1-seq 11 11 2-seq 5 26 15%

3-seq 0 0 1-seq 11 11 2-seq 52 91 10%

3-seq 0 1 1-seq 11 11 2-seq 108 110 3-seq 22 210 5%

4-seq 0 1

Page 41: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

back

Page 42: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis
Page 43: Swarm-based sequencing recommendations in e-learning Colin Tattersall, Bert van den Berg, René van Es, José Janssen, Jocelyn Manderveld, Hub Kurvers, Francis

Male/Female

Vrouw

Man

Onbekend

back

FemaleMaleunknown