designing a handwriting recognition based writing environment j c read, s j macfarlane, c casey...
TRANSCRIPT
![Page 1: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/1.jpg)
Designing a Handwriting Recognition Based Writing Environment
J C Read, S J MacFarlane, C CaseyDepartment of Computing, University of
Central Lancashire, Preston, UK
![Page 2: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/2.jpg)
IntroductionBackground InformationDescription of the Observational StudyFindings from the study
General FindingsFindings relating to the Handwriting RecognitionSatisfaction measuring
Informing the designDescription of the PrototypeConclusions
![Page 3: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/3.jpg)
Who? Why? What? Where? How?Janet C Read, lecturer and mother!Elodie, PhD studySpeech, handwriting: - Human Language Technology, Free text not command.Lancs..UK; white rural primary – age 7 – 9Research, Observations, Usability studies
![Page 4: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/4.jpg)
Previous WorkQWERTY keyboard difficult (WES2000)HLT attractive to children, HR feasible (HCI2000, HCI2001)Measuring Fun (CandF2000, CandF2001)Participatory design (IDC2002)Errors in HR interfaces (NordiCHI2002)
![Page 5: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/5.jpg)
The Observational StudyChildren aged 7 and 8Normal classroom activitiesIn twosLaptop (HR), Desktop (QWERTY), Desk (Pencil)Different writing tasksDifficulties, Errors, Corrections
![Page 6: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/6.jpg)
Pen and Paper ErrorsErrors made – missing words, spelling, letters written backwardsError prevention – asked, avoided, lookedError discovery – reading back, self, teacher or another childError repair – rub out, scribble out, cross out, overwrite, re-write, squeeze in , change
![Page 7: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/7.jpg)
QWERTY - ErrorsErrors made – missing words, spelling, hit wrong keyError prevention – asked, avoided, lookedError discovery – reading back, self, teacher or another child, wiggly lines!Error repair – position and rub out, rub back to, rub all, retype, change
![Page 8: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/8.jpg)
Handwriting Recognition - OverviewHardware – Graphics tablet and penSoftware – Recognition software
Fuzzy computingDisobedient – ambiguousCharacter or word basedOn line – ‘t’ stroke problems
Demonstration
![Page 10: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/10.jpg)
Handwriting Recognition – Errors (1)Child
Errors made – miss words, spellings, letters backwards, pen up
ComputerErrors made – Bad recognition, hardware
ChildError prevention – ask, avoid, look
ComputerError prevention – spell checker (not used)
![Page 11: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/11.jpg)
Handwriting Recognition – Errors (2)Child
Error discovery Before Recognition – reading back, teacher, other child After Recognition – as above + wiggly lines!
Error repair Before recognition – scribble out, overwrite, insert letter After Recognition – rub back to, rub all, rewrite all or
some, use QWERTY
![Page 12: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/12.jpg)
Satisfaction MeasuringErrors do not imply dissatisfactionWHY?
Sticky – addictive vs. nothing betterFunny – humour with recognition – easy to use
![Page 13: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/13.jpg)
Designing a Prototype - methodUsers
Children, environment, characteristics, mental models
TasksGoal oriented – hierarchy
SystemStates – dangerous states
Interface UI design guidelines
![Page 14: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/14.jpg)
ChildClassroom based – standard equipment, needs to be easy to use, robust, minimal help neededChildren – varied pen control, different levels of expertise with technology, different reading skills, poor or very good letter formationMental model – see tablet as paper – want to scribble out and insert missed words
![Page 16: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/16.jpg)
User GoalTo produce good written work
PlanningTranslationReviewing and Editing
(Hayes and Flower)
![Page 17: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/17.jpg)
Supporting the writer (1)Ideas – pop up in clouds, can have many, child can re-order them and can put them away, use handwriting that is not recognisedTranslation – training supported, lines can be drawn on screen or on the tablet (or both!); recognition can be immediate or delayed;
![Page 18: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/18.jpg)
Supporting the writer (2)Reviewing – computer can read back recognised text, child can read recognised or script text; spellings may be highlighted in recognised text – teacher controlsEditing – child can edit with rubber and pen on script, or with keyboard on recognised text
![Page 19: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/19.jpg)
System StatesEntry stateRecognition stateEdit state
DANGEROUS STATES Pens that point Cursors that confound Spaces that stop
![Page 20: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/20.jpg)
Interface Design (1)Full writing screenAbility to place new pagesMenus at the bottomHaptic boundary preferredTablet matched to screenPen can be turned on and off
![Page 21: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/21.jpg)
Interface design (2)Video clip facilityTeachers screenAssistantCustomisableTraining activities
![Page 22: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/22.jpg)
And so……………The designs for a product for a small group of users, for a narrow applicationKeyboard interfaceError repairSpeech recognition
![Page 23: Designing a Handwriting Recognition Based Writing Environment J C Read, S J MacFarlane, C Casey Department of Computing, University of Central Lancashire,](https://reader034.vdocument.in/reader034/viewer/2022051401/5697bf8f1a28abf838c8d65a/html5/thumbnails/23.jpg)
Thank youJanet C Read
University of Central LancashirePreston
Up North!England