QTI and Learning DesignJoint CETIS/SURF SiX meeting, January 12th 2004

Colin Tattersall

Educational Technology Expertise Centre

X

Overview

­ When­might­we­want­to­use­LD+QTI­together?­ How­do­CP+LD+QTIv1.x­fit­together­today?­ Are­there­any­issues?­ LD­and­QTIv2­

When might we want to use LD+QTI together?

­ Quite­often­ IMS­Learning­Design­is­used­to­model­units­of­

learning­ A­unit­of­learning­(UoL)­is­any­delimited­piece­of­education­or­

training,­such­as­a­course,­a­module,­a­lesson,­etc.

­ more­than­just­a­collection­of­ordered­resources­to­learn

­ activities,­assessments,­services­and­support­facilities­provided­by­teachers,­trainers­and­other­staff­members.

­ Model­who­does­what,­when,­with­whom­and­using­which­learning­objects­and­services

play

Act 1 Act 2 Act 3 Act 4 Act 5

Role-part 1

Role-part 2

Role-part 4

Role-part 5

Role Activity Environment

Learning objects

Learning services

Activity-Description

Who­does­what,­when?

Using­LD+QTI­together

­ When­are­tests/assessments­used­in­learning­designs?

­ Formative­and­summative­assessment­ “summative­assessment­summarises­the­quality­and­

characteristics­of­the­student.­­ formative­assessment­relates­to­students’­learning­

processes,­helping­to­guide­them­in­their­studies,­providing­feedback­on­areas­of­learning­requiring­further­work,­….”From “The Handbook for Economics Lecturers”

Some­LD+QTI­learning­scenarios­(1)

­ Single­learner­scenarios:­ Want­to­check­the­learner’s­level­of­understanding­

before­sending­him/her­down­a­particular­learning­path­(intake­assessment);

­ Want­to­check­whether­a­concept­has­been­learned­before­allowing­the­learner­to­progress;

­ Want­to­provide­a­high­level­of­feedback­in­a­module­to­keep­motivation­high;

­ Want­to­end­a­course­with­an­examination;

Some­LD+QTI­learning­scenarios­(2)

­ Multi­learner­scenarios:­ Want­to­have­individuals’­answers­be­revealed­to­a­

group­to­promote­discussion­and­learning;­ Want­to­arrange­for­peer­assessment;­ Want­to­divide­a­set­of­students­into­several­groups­of­

more-or-less­equally­able­students;­ Want­to­divide­a­group­of­students­into­groups­with­

individuals­of­differing­levels­of­ability;­ Want­to­give­the­best/worst­performer­in­a­group­a­

particular­role­in­a­learning­design;

WebMCQ’s­“What­is­Greatness?”

How­was­this­type­of­thing­done­in­EML? The EML DTD provides interactions

An EML-aware player takes EML content perhaps including interactions and plays it. So ….

An­example­EML­question

Moving­from­EML­to­IMS­LD

­ EML­complete/monolithic­­ Moving­to­IMS­LD­meant­taking­other­IMS­specs­

into­account—integrating­LD­and­CP,­stripping­out­the­content­model,­interaction­types­etc

­ Moving­from­EML­to­IMS­LD­is­really­moving­from­EML­to­IMS­CP+MD+LD+QTI+….+XHTML

LD­and­CP­(1)

­ To­create­a­UoL,­IMS­Learning­Design­is­integrated­with­an­IMS­Content­Package­as­another­kind­of­organization­within­the­<organizations>­element.

­ An­IMS­content­package­is­called­a­'Unit­of­learning'­if­and­only­if­it­includes­a­valid­IMS­learning-design­element­in­the­organizations­part­of­the­package's­manifest.­

LD­and­CP­(2)

Orchestrating­learning­with­LD

­ Learning­Design­orchestratesthe­availability­of­variousactivities­&­their­resources,including­assessments;

­ In­certain­conditions,­particularactions­are­taken;

­ Properties­available­forgetting­and­setting;

­ Expression­language­usedto­express­conditions

Expression­language

Example­conditions

But­where­is­P-intake-score­set?

­ The­actual­intake­test­would­be­QTI­content­ Maybe­have­an­LD+QTI­aware­engine­ More­likely­an­LD-aware­engine­uses­a­QTI-

engine­ Need­QTI­and­LD­to­‘share’­P-intake-score

­ Declared­by­both­ Set­by­QTI­engine­ Read­by­LD­engine

QTI­intake­test

Where­does­the­QTI­go­in­the­UoL?

­ Either­in­the­environment/learning-object­as­a­separate­schema.­Tests­can­then­be­connected­to­learning-activities.

­ Or­in­IMS­Content­Package­(specific­resource­types?)­as­separate­files/links

Are­there­any­issues?

­ <imsqti:decvar varname="P-intake-score" … >

­ String,­256­chars­ Enumerated,­String,­Integer,­Decimal,­Scientific,­

Boolean,­Enumerated,­Set

­ <imsld:locpers-property identifier="P-intake-score">

­ XML­ID­ boolean,­integer,­real,­string,­datetime,­duration,­text,­

file,­uri­and­other.­

LD­and­QTIv2

­ OUNL­participating­in­QTIv2­ to­create­a­new­version­of­the­QTI­specification­to­address­

relevant­issues­deferred­from­v1.0,

­ to­describe­best­practice­for­putting­QTI­into­content­packages

­ to­describe­bindings­for­QTI­outcomes­to­Learning­Design­properties,­to­Simple­Sequencing­objectives,­and­into­the­CMI­datamodel.

­ Best­practices­ Using­LD­and­QTI­together­ Variable­naming­and­typing­ Pre-processing­error­checking­recommendations­for­

content­packages?

Any­questions?

Colin­Tattersall

Educational­Technology­Expertise­Centre

Open­University­of­the­Netherlands

colin.tattersall@ou.nl