blindaid: a virtual exploration tool for people who are blind
DESCRIPTION
BlindAid: a Virtual Exploration Tool for People who are Blind. O. Lahav, Ph.D., D. Schloerb, Ph.D., S. Kumar, and M. A. Srinivasan, Ph.D Touch Lab, RLE, MIT CT13, San Diego, June 2008. The Theory. Spatial cognitive map. Blinds’ exploration. Knowledge technology. The Theory. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/1.jpg)
BlindAid: a Virtual Exploration Tool for
People who are Blind
O. Lahav, Ph.D., D. Schloerb, Ph.D., O. Lahav, Ph.D., D. Schloerb, Ph.D., S. Kumar, and M. A. Srinivasan, Ph.DS. Kumar, and M. A. Srinivasan, Ph.D
Touch Lab, RLE, MITTouch Lab, RLE, MIT
CT13, San Diego, June 2008CT13, San Diego, June 2008
![Page 2: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/2.jpg)
The Theory
Blinds’ explorationSpatial cognitive map
Knowledge technology
![Page 3: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/3.jpg)
Spatial cognitive map
The Theory
Blinds’ cognitive map
Blinds’ exploration
Knowledge technology
O&M KT devices for blindKT devices for spatialcognitive mapping
![Page 4: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/4.jpg)
BlindAid System2004 - present (NEI - R21)NEI - R21)
![Page 5: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/5.jpg)
Research AimsResearch Aims
1. Design and develop a VE system for users who are blind
2. Conduct experiments on the usability of the VE system
![Page 6: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/6.jpg)
BlindAid System - Conclusion
Back to simple
Clear
Based on previous knowledgeIntuitive
Avoid overload processing
![Page 7: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/7.jpg)
The Learning Mode – User Interface
![Page 8: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/8.jpg)
The Learning Mode – Researcher Interface
![Page 9: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/9.jpg)
Methodology – Participants
The study included four total blind participants
41-53 years old; one participant was congenitally blind; one was female
![Page 10: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/10.jpg)
Methodology – Research Instruments
Implementation Instruments: Unknown simulated space (13 virtual environments) Exploration task
Collection of the Data Instruments: Observations Usability questionnaire Open interview Modeling kit Computer log
![Page 11: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/11.jpg)
Research Studies
First study - Haptic propertiesSecond study - Audio propertiesThird study - Exploration tools
![Page 12: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/12.jpg)
First Study – Haptic Properties
Which haptic feedback properties used in the VE strongly affected people who are blind?
The VE consisted of 20 objects of three types: Different stiffness properties ‘S’ (soft-hard) Different texture properties ‘T’ (smooth-rigid) Different stiffness+texture properties ‘S+T’
![Page 13: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/13.jpg)
First Study – Haptic Properties
Seven objects randomly chosen over six VEs
![Page 14: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/14.jpg)
First Study – Haptic Properties – Result
All participants preferred objects with ‘S’ properties then ‘T’ or ‘S+T’ propertiesAll seven ‘S’ objects were listed as preferableParticipants preferred objects with ‘T’ properties only with large height irrespective of the type of bump
![Page 15: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/15.jpg)
First Study – Haptic Properties – Result
All participants preferred a limited number of feedbacks:
Different haptic feedbacks (wall,window, and door) Hard objects and soft objects Designation of area or objects with safety issues
![Page 16: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/16.jpg)
Second Study - Audio Properties
Which audio feedback properties used in the VE strongly affected people who are blind?
Audio type: mono, stereo, or stereo with rotation
Component’s description: short or long Hearcon versa audio-labeled Background sound
![Page 17: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/17.jpg)
Six VEs
Second Study – Audio Properties
![Page 18: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/18.jpg)
Second Study – Audio Properties – Result
Three participants chose stereo. Stereo helped them determine which direction to go and provided more orientation to the overall space. The stereo-rotation was an additional variable that they needed to track.They continually needed to imagine their orientation at the time they heard the audio feedback.
![Page 19: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/19.jpg)
Second Study – Audio Properties – Result
The short component’s description and hearcon need to be clear, recognizable, and short, without the need to process it. The ability to have background sound (e.g., street noise) continuously with the stereo effect was effective and needed. The participants did not report feeling overloaded by the audio effect or try to avoid interaction with the VE components.
![Page 20: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/20.jpg)
Third Study – Exploration Tools
What are the exploration tools that maximized the participants’ exploration performance in the VE? Move the VE workspace:
Using the arrow keys Using the phantom buttonInstall and recall landmarks by: User ResearcherZoom in - Zoom out (eliminate objects)
![Page 21: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/21.jpg)
Third Study – Exploration Tools
![Page 22: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/22.jpg)
Third Study – Exploration Tools – Result
Each of the four participants chose to use the phantom button: Much more intuitive and a natural motion for the participants More immediately associated with the white cane Sense of having control over movements Did not have to take their hands off the Phantom Able to drag the workspace at an angleIn a complex VE the participants used mostly their own landmarks, and they usually installed two of their own.
![Page 23: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/23.jpg)
BlindAid System - Conclusion
Back to simple
Clear
Based on previous knowledgeIntuitive and a natural
Avoid overload processing
![Page 24: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/24.jpg)
BlindAid System - Future
To Collect spatial information in advance (Mapquest)
Integrating the system in traditional O&M trainee
![Page 25: BlindAid: a Virtual Exploration Tool for People who are Blind](https://reader035.vdocument.in/reader035/viewer/2022062811/56815f6d550346895dce74e4/html5/thumbnails/25.jpg)
BlindAid System – Acknowledgments
The participantsNIH / NEI - R21 Jay DeslogeCarroll Center for the Blind