technologies to reduce the access barrier in human...
TRANSCRIPT
IP Roma 2013
Project 02Technologies to Reduce
the Access Barrierin Human Computer
InteractionErasmus Intensive
Programme
Rome, Italy, 5.5. – 17.5.2013http://www.trabhci.eu/
ChatUp
• Linh-LahtiUniversityofAppliedSciences(Finland)• Alexey-LahtiUniversityofAppliedSciences(Finland)• Lidia-UniversitatPolitecnicadeValencia(Spain)• Mirko-UniversityofAppliedSciencesDresden(Germany)• Jaime-UniversityofZaragoza(Spain)
ChatUp > IP Rome 2013
Initial task description shortly
Createanapplicationtohelppeopletosendemergencyandregularemailstotheirfriendsandrelativesbyusinggesturesandspeechrecognition.
Applicationmustbeeasytouseincomplicatedcondictions.
ChatUp > IP Rome 2013
Initial idea of the group shortly
Applicationallowstowritetextbytalkingusingspeechrecognition.
Thesenderisabletosendemergencymessagesjustbymakingasimplegesturewiththehand.
Byusingthistechnologypeoplecanextendtheirconnectionsandobtainadditionalcommunicationpossibilities.
ChatUp > IP Rome 2013
Focus group
PeoplewhoarenotabletowalkPeoplewhohaveproblemsofmovement:tremorandotherdisabilitiesfortyping
ChatUp > IP Rome 2013
Purpose and motivation
• Toimprovethequalityoflife• Tomakeiteasierforpeopletocommunicate• Tohelppeopletoaskforhelpincaseofemergency
ChatUp > IP Rome 2013
Functionalities, Technologies and architechture applied
• SendingemailsviaGMailbyusinggesturesandvoice
• Kinect,C#,WPF,internet
ChatUp > IP Rome 2013
Subtask Identified
ChatUp > IP Rome 2013
GraphicalInterface GraphicDesignSpeechRecognition
Difficulties
• ImplementingtheGoogleAPIspeechrecognition• Howtopressthebuttons,workingwiththeZaxe• Topositionthemousepointonthecenterofthehandaccurately
ChatUp > IP Rome 2013
What was learned?
• ImprovetheknowledgesaboutusingKinect• Usingspeechtotexttechnology• C#• Workinginaninternationalgroup• Shareandexplainideas• Understandingpossibledifficultiesdependingonvarioustypesofdisabilitiesorhandicaps
ChatUp > IP Rome 2013
What was left not done and can be done in the future?
• Translatewordsintopictogram• Sendingthemessagesbyotherways,asWhatsapp,SMS,Facebook...
• Addmorepeopletothelistofcontacts
ChatUp > IP Rome 2013
Where we succeed and why?
• Sendemail• Therecognitionspeechtotext• Selectbetweendifferentpeople• Holdsuccessfulcommunicationwithinateam• Toaccomplishthetaskinefficientway• Adjustthespeedofthepointer
ChatUp > IP Rome 2013
Where we failed and why
• Implementotherwaysofsendingmessages• Implementallfeatureswewouldliketohaveinourapplication
ChatUp > IP Rome 2013
Thank you!IP Roma 2013