jta education conference 2013a

Robert Kirkland PhilipsIntegrating Technology in Assessment

Background The e-Learning Jamaica Project is a collaboration

between the Ministry of Science Technology Energy and Mining and the Ministry of Education to systematically strengthen inputs to instruction in high schools.

Information and communications technologies and instructor capabilities are being enhanced, with a view to increasing success of students at the CSEC level

A Day in the Life

I read the news…

I saw a film…

I saw a photograph….

Having read the book Id love to turn you on

The Beatles 1966

http://www.youtube.com/watch?v=P-Q9D4dcYng

Our dilemma

Having turned you on…I’d love you to read the book

Project Components

Infrastructure Materials Assessment Remediation Training

Dichotomy

Formative Summative

originating in evaluation literature

Assessment for learning

vs

Assessment of performance

Assessment types

Formative

Identifies the learning and learning needs of each (learner) so that the teacher can organise future learning experiences and connect with the (learners) current knowledge and skills and the learner can plan and engage more meaningful work.

Summative

Provides evidence from which the (learners) achievement in a curriculum domain or the metacognitive domain or the real world domain can be inferred

Source :CXC CPEA Brochure

Characteristics of the Assessment Component

Person-oriented Technology-driven System-wide

Influence individual teacher and learner behavior Technology values of ease of use and change Classroom, school and administrative impact

Scope

Standard materials Standard assessments Remediation oriented assessments

Access

www.e-ljam.net/moodle

Access

Standard materials

English example Teacher detailed

lessons Strategy support Questions Self –assessment Peer assessment Multimedia Editable when dated

Standard materials

English example Teacher detailed

lessons Strategy support Questions Self –assessment Peer assessment Multimedia Editable when dated

Standard assessments

Multiple choice Mapped to MOE Grade 7-9

Curriculum

CXC Influence Internal assessment

Includes oral task

Year-end assessment

http://www.e-ljam.net/?page_id=908

CXC Influence Several subjects at the CSEC level have internal assessment

elements branded as School Based Assessments and the CPEA Caribbean Primary Exit Assessment has or will have this.

This is a teacher/labour intensive activity that has parallels with the IA in the Grade 9 Diagnostic Examination

Anecdotal evidence is that weaker students have lower persistence in completing SBAs although tasks can be repeated to improve final scores

Availability of computers has increased the completion rates according to student reports

Sources of formative assessments

Nelson Thornes Biology for You Chemistry for You Math

• http://www.fi.uu.nl/wisweb/isdde/applets/Blokkendoos.htm• http://www.fi.uu.nl/wisweb/isdde/applets/NabouwenAanzichten1.htm

Math• http://www.cimt.plymouth.ac.uk/projects/mepres/book7/bk7i21/bk7_21i2.htm

Lets go Learn• http://www.letsgolearn.com/lglsite/EDGE_prealgebra/educators/

Chemistry

Chemistry

Sources

Youtube--elearnja• Chemistry

• Biology

• English

• Math

• IT

Youtube------elearnja

Examples Qualitative Analysis 2

• 1.30• Tactical formative assessment

Genetic Diagram• 4.28• formal question

Self-Assessments

MOODLE Items by objective

• http://www.e-ljam.net/moodle/course/view.php?id=203

Practice tests • http://www.e-ljam.net/moodle/course/view.php?id=152

Explanations

Year end tests

Subjects English Math Integrated Science Social Studies

Grades 7 & 9

Grade 9 assessment features

Instant reporting Teacher participation MOE Dashboard Early practice on CSEC approaches Refuelling of Grade 7 to 9 curriculum

Social Studies

Science

EXAMVIEW

TWAIN compatible software MS-Windows computers Office scanners Office printers Capability for paperless operation Capability for web operation

EXAMVIEW

Score Percentage Student report Item Analysis Descriptive statistics Strand performance—learning focus Data import and export

Frequency distribution

Sample results

Descriptive statistics

Sample Item Analysis

Sample strand analysis

Selective strand performance 2012

0

20

40

60

80

100

120

Lis

ter

Ma

ir g

ilby

Ch

ap

leto

n

Pe

nw

oo

d

Fa

ir P

rosp

ect

Kin

gst

on

hig

h

Cla

ud

e M

cKa

y

Ew

art

on

Pe

ters

field

Gu

ys H

ill

Pa

pin

e

Ga

ynst

ea

d

St

Eliz

ab

eth

Te

ch

Yo

rk C

ast

le

Bis

ho

p G

ibso

n

Mu

nro

Eng-Infer-DrawingConclusions

Eng- Part of speech

Eng- Verb Tense

Math- Coordinate Grid

Math- Equations

Math-Integers

Sci- Forces & motion

Sci- Pregnancy & Health

Sci- Pure & impure Matter

SS- Consumer Affairs

SS- Earning a living

SS- nation building

SS- social & enviromentalissues

Three key strands 2012 Grade 9

selected strands Grade 9 2012

0102030405060708090

100

Liste

r Mai

r gilb

y

Denha

m T

own

Chapl

eton

Rober

t Lig

htbo

urne

Penwoo

d

Mal

don

Fair P

rosp

ect

Trenc

h Tow

n

Kings

ton

high

Troy

Claud

e M

cKay

bb c

oke

Ewarto

n

Gre

en Pon

d

Peter

sfiel

d

Mer

lene

Otte

y

Guy

s Hill

McG

rath

Papine

Hollan

d

Gay

nste

ad

From

e Tec

h

St Eliz

abeth

Tec

h

Mar

ymou

nt

York

Castle

Holy C

hildw

ood

Bishop

Gibso

n

Herbe

rt M

orris

on

Mun

ro

Wolm

ers

G

school

sc

ore Eng- Verb Tense

Math- Equations

Math-Integers

Three key strands 2012 Grade 9

selected strands Grade 9 2012

0102030405060708090

100

Liste

r Mai

r gilb

y

Denha

m T

own

Chapl

eton

Rober

t Lig

htbo

urne

Penwoo

d

Mal

don

Fair P

rosp

ect

Trenc

h Tow

n

Kings

ton

high

Troy

Claud

e M

cKay

bb c

oke

Ewarto

n

Gre

en Pon

d

Peter

sfiel

d

Mer

lene

Otte

y

Guy

s Hill

McG

rath

Papine

Hollan

d

Gay

nste

ad

From

e Tec

h

St Eliz

abeth

Tec

h

Mar

ymou

nt

York

Castle

Holy C

hildw

ood

Bishop

Gibso

n

Herbe

rt M

orris

on

Mun

ro

Wolm

ers

G

school

sc

ore Eng- Verb Tense

Math- Equations

Math-Integers

Extending the day

Photographs Films/Animations Songs

more…………………………….

RESEARCH ACTIVITY

FACTOR ANALYSIS

GAMING

ARTIFICIAL INTELLIGENCE

PSPP

Open source equivalent of SPSS Microsoft Excel doesn’t have factor

analysis Test taking overrides subject specific

performance

Gaming Assessments

username:guest > password:humbird2012 > > The link :

gamedevelopment.narchismultimedia.com

AI assessments

Marking structured questions in Social Studies

MOODLE does not perform fuzzy matching

A day in the life Making meaning..

• The worst thing about doing this like is that people get a bit suspicious….you know --what are you up to

• A Beatle speaking sotto voce at the end of the Studio version

Life and learning and testing is about photographs and film and music and ..technology of course