optimizing vocabulary learning with irt and online technology brent culligan ([email protected])...

23
Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan ([email protected]) Aoyama Gakuin Women’s Junior College Dr. Charles Browne ([email protected])

Upload: collin-domenic-hardy

Post on 16-Jan-2016

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

Optimizing Vocabulary Learning with IRT and Online Technology

Optimizing Vocabulary Learning with IRT and Online Technology

Brent Culligan ([email protected])Aoyama Gakuin Women’s Junior College

Dr. Charles Browne ([email protected])Professor of Linguistics, Meiji Gakuin University

Page 2: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

Why we are here - a quote…Why we are here - a quote…

“Tom and I planned this colloquium around the idea that vocabulary research has provided clear findings that can inform language teaching and learning in concrete and substantive ways, and the goal of the colloquium is to highlight successful implementations. As I see it, the take home message is: vocabulary research has direct implications for the practice of teaching and learning language…”

Email from Marlise Horst, 4/11/07

Page 3: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

Guiding Pedagogic PrinciplesGuiding Pedagogic Principles

1. Teaching HFV is an essential component of SLA

2. Flashcards are an extremely efficient way of quickly building up knowledge of new words

3. Time-intervalled learning can help move short term-memory to long term memory

4. Extensive graded reading is useful for both vocabulary development as well as developing overall English proficiency

Page 4: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

Role of TechnologyRole of Technology

1. CAT allows us to precisely target a student’s level and needs in ways that were until now, not possible

2. For today’s generation of students, cell phones and MP3 players are the devices of choice

3. Online graded reading and listening can help provide students with much needed input

4. Teachers are extremely busy - software needs to be intuitive, easy to use, and time efficient

Page 5: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

A Set of Free Vocabulary Testing & Teaching Tools Based on Current Research

(www.lexxica.com)

A Set of Free Vocabulary Testing & Teaching Tools Based on Current Research

(www.lexxica.com)

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

THE TOOLS:

1. Vocabulary Test

2. Flashcards

3. Games

4. Graded Readings

5. Graded Listenings

6. Administration Program

Page 6: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

Flashcards based on Time-Intervalled Learning

Flashcards based on Time-Intervalled Learning

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

Page 7: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

The Forgetting CurveThe Forgetting Curve

• If material is only reviewed once, it tends to stay in short term memory and is soon forgotten…

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

Page 8: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

The Forgetting CurveThe Forgetting Curve

• If material is reviewed several times at increasingly longer intervals, the material is remembered longer and longer until it eventually becomes part of long term memory…

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

Page 9: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

Time-Intervalled Vocabulary FlashcardsEbbinhaus (1885), Leitner (1972), Pimsleur (1967), Mondria, (1994)…

Time-Intervalled Vocabulary FlashcardsEbbinhaus (1885), Leitner (1972), Pimsleur (1967), Mondria, (1994)…

Learner gets flashcards

24 hours later 1 week later 1 month later

If incorrect, the new word returns to the first bin…

If correct, word moves to the next interval…

• The vocabulary test allows us to generate individualized word lists of the specific HFV unknown to each learner

• Computers allow us to automate the time-intervalled process

Page 10: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

Vocabulary Activities Integrated into the Time-Intervalled Learning System

Vocabulary Activities Integrated into the Time-Intervalled Learning System

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

Page 11: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

Vocabulary Test, Flashcards, Games & Graded Readings on Cell Phones

Vocabulary Test, Flashcards, Games & Graded Readings on Cell Phones

Cell phones are the device of choice among students in Japan - 100% penetration at most universities vs. 62% for PCs

(Browne, 2007, in press)

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

Page 12: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

Large Database of Short Graded Reading Materials

Large Database of Short Graded Reading Materials

Page 13: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

Large Database of Short Graded Reading Materials

Large Database of Short Graded Reading Materials

Page 14: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

Large Database of Short Graded Reading Materials

Large Database of Short Graded Reading Materials

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

Learner’s target vocabulary is highlighted and linked to online dictionary

Page 15: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

Graded Readings Also Recorded as Graded Listenings (podcasts)

Graded Readings Also Recorded as Graded Listenings (podcasts)

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

Page 16: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

Web-based Administration Account for Tracking Student Progress

Web-based Administration Account for Tracking Student Progress

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

Page 17: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

V-Check - the vocabulary test that makes all this possible…V-Check - the vocabulary test that makes all this possible…

• The starting point for us was trying to find an efficient way to identify which specific HFW a student knows, and which still need to be taught…

Page 18: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

The role of testingThe role of testing

• Assessing the ability of the students• Assessing the difficulties of the items• Item difficulty = word familiarity

Page 19: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

Item Response TheoryItem Response Theory

b

b

e

ebUP

1

),|1(

where is the ability level

e is the constant 2.1718

b is the difficulty parameter

Page 20: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

Item Response TheoryItem Response Theory

Page 21: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

Item Response TheoryItem Response TheoryBenefits

• Person abilities can be estimated regardless of which items are administered.

• Item difficulties can be estimated regardless of which persons take the test.

Assumptions

• Local independence

• Unidimensionality

Page 22: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

Why and How Can It Be Free?Why and How Can It Be Free?

WHY?• V-Check’s accuracy is related to it’s large scale

implementation in different populations• Because we want to help create a paradigm shift

among educators - for this to occur, teachers, administrators and students need to have easy ways to study and teach HFV

HOW?• Other services will be fee-based (TOEFL, TOEIC,

Business English, online conversation, etc.)

Page 23: Optimizing Vocabulary Learning with IRT and Online Technology Brent Culligan (culligan@din.or.jp) Aoyama Gakuin Women’s Junior College Dr. Charles Browne

Thank You!(and please contact us with any questions or feedback)

Thank You!(and please contact us with any questions or feedback)

Brent Culligan ([email protected])Aoyama Gakuin Women’s Junior College

Dr. Charles Browne ([email protected])Professor of Linguistics, Meiji Gakuin University