head-mounted display v support sound awareness for …€¦ · “i almost always interact with...
TRANSCRIPT
![Page 1: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/1.jpg)
HumanComputerInteractionLaboratory
HEAD-MOUNTED DISPLAY VISUALIZATIONS TO SUPPORT
SOUND AWARENESS FOR THE DEAF AND HARD OF HEARING
Montgomery BlairHigh School
Gallaudet University
![Page 2: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/2.jpg)
DEAF AND HARD OF HEARING USE VISUAL SIGNALSBODY LANGUAGE, FACIAL EXPRESSIONS, LIP MOVEMENT (SPEECHREADING)
![Page 3: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/3.jpg)
DEAF AND HARD OF HEARING USE VISUAL SIGNALSBODY LANGUAGE, FACIAL EXPRESSIONS, LIP MOVEMENT (SPEECHREADING)
Knowing where to focus visual attention is a
prerequisite for effective speechreading
![Page 4: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/4.jpg)
HEARING AID
DO NOT IMPROVE SOUND LOCALIZATION
AND COCHLEAR IMPLANT
![Page 5: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/5.jpg)
COMMON PROBLEMS IN GROUP COMMUNICATION
![Page 6: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/6.jpg)
1. SPEAKER TRANSITION
COMMON PROBLEMS IN GROUP COMMUNICATION
Video from Study 1: Part 1 (Formative Interview)
(Please download the powerpoint version to view the video)
![Page 7: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/7.jpg)
2. INABILITY TO FOLLOW SIMULTANEOUS SPEAKERS
1. SPEAKER TRANSITION
COMMON PROBLEMS IN GROUP COMMUNICATION
Video from Study 1: Part 1 (Formative Interview)
(Please download the powerpoint version to view the video)
![Page 8: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/8.jpg)
“If one person finishes talking, I do not
know who to look at next—that is my
problem because hearing people can
hear who the next person is, and what
they are saying.” (P20)
“I usually avoid large groups” (P16)
“I almost always interact with Deaf people.
When I converse with hearing people it’s
usually 1:1 with interpreters.” (P4)
PARTICIPANTS RESPONSES FROM FORMATIVE STUDY
![Page 9: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/9.jpg)
Design and evaluate visualizations for spatially
locating sound on a head-mounted display (HMD)
OUR AIM
![Page 10: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/10.jpg)
Traditional
Techniques
![Page 11: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/11.jpg)
Talking pillow….
![Page 12: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/12.jpg)
Talking pillow….
![Page 13: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/13.jpg)
Talking pillow….
![Page 14: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/14.jpg)
Using interpreter….
![Page 15: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/15.jpg)
Prior work on visual aids for persons with hearing
loss has focused largely on non-speech sounds
(e.g., an alarm or doorbell)
![Page 16: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/16.jpg)
For example…
![Page 17: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/17.jpg)
Ho-Ching et al., CHI ‘03; Matthews et al., BIT ‘04; Matthews et al., ASSETS ‘05
Ripples showing the non-speech sounds
Phone ring
Door Knock
![Page 18: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/18.jpg)
These sounds are presented on external displays or
devices such as desktops or mobile devices
![Page 19: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/19.jpg)
![Page 20: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/20.jpg)
Moreover they require sophisticated algorithms to
identify sounds, which is an open area of research
![Page 21: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/21.jpg)
MOST RELEVANT WORKSOUND COMPASS - KANEKO ET AL., IEEE SMC ‘13
![Page 22: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/22.jpg)
MOST RELEVANT WORKSOUND COMPASS - KANEKO ET AL., IEEE SMC ‘13
Led lightN,S,E,W
![Page 23: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/23.jpg)
MOST RELEVANT WORKSOUND COMPASS - KANEKO ET AL., IEEE SMC ‘13
Emphasis on sensing, not visual feedback
![Page 24: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/24.jpg)
OUR APPROACH: SOUND VISUALIZATION ON HMD
(Please download the powerpoint version to view the video)
![Page 25: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/25.jpg)
OUR APPROACH: SOUND VISUALIZATION ON HMDIncreased
Glanceability
Privacy
Seamlessness
1
2
3
![Page 26: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/26.jpg)
Design Goals
and
Dimensions
OUTLINE
![Page 27: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/27.jpg)
Design Goals
and
Dimensions
PART 1:
Formative
Interview
PART 2:
Feedback on
HMD approach
PART 3:
Design
Probe
Study 1
OUTLINE
![Page 28: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/28.jpg)
Design Goals
and
Dimensions
Proof-of-Concept
PrototypeStudy 2
PART 1:
Formative
Interview
PART 2:
Feedback on
HMD approach
PART 3:
Design
Probe
Study 1
OUTLINE
![Page 29: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/29.jpg)
Design Goals
and
Dimensions
Proof-of-Concept
PrototypeStudy 2
PART 1:
Formative
Interview
PART 2:
Feedback on
HMD approach
PART 3:
Design
Probe
Study 1
OUTLINE
![Page 30: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/30.jpg)
Iterative Design Process
Design Goals Sketch Design Dimensions
![Page 31: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/31.jpg)
![Page 32: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/32.jpg)
DESIGN GOALS
1. Localize sound
2. Glanceable
![Page 33: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/33.jpg)
DESIGN GOALS
1. Localize sound
2. Glanceable
![Page 34: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/34.jpg)
DESIGN GOALS
1. Localize sound:
The visualizations should provide unobtrusive and
accurate indication of where the sound occurs
![Page 35: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/35.jpg)
DESIGN GOALS
1. Localize sound
2. Glanceable
![Page 36: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/36.jpg)
DESIGN GOALS
1. Localize sound
2. Glanceable
![Page 37: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/37.jpg)
DESIGN GOALS
2. Glanceable:
The directional information should be easy-to-
understand at a glance
![Page 38: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/38.jpg)
DESIGN GOALS
1. Localize sound
2. Glanceable
3. Responsive
4. Augment, not substitute
5. 360° sensing
6. Adaptable
![Page 39: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/39.jpg)
Designing the Sound Visualizations
![Page 40: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/40.jpg)
How does one go about the process of designing interfaces
for sound visualization for head-mounted display?
![Page 41: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/41.jpg)
Design Inspirations
![Page 42: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/42.jpg)
![Page 43: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/43.jpg)
![Page 44: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/44.jpg)
![Page 45: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/45.jpg)
![Page 46: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/46.jpg)
![Page 47: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/47.jpg)
DIRECTIONAL GRANULARITY
SCREEN LAYOUT
Recta
ngula
r
Cir
cula
rFro
m C
ente
rWEARER’S PERSPECTIVE
Egocentr
icE
xocentr
ic
MAXIMUM SIMULTANEOUS ICONS
Tw
oFour
Eig
ht
Outw
ard
Inw
ard
CONVEYING SOUND SOURCE
8 DESIGN DIMENSIONS
Example: CirclesExample: Arrows 1 Example: Arrows 2 Example: Arrows 3
LOUDNESS
Example: Speaker Identity
SARA
H
JOH
NMIKE
Example: Speech vs. Non-Speech Sounds
Example: GenderExample: Captions
JOH
N
AUTOMATIC SOUND RECOGNITION
2D VS. 3D
2D
3D
![Page 48: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/48.jpg)
Ear design dimensions
the
Automatic
sound
recognition
Conveying
sound
source
wearer’s
perspectivescreen
layout
direction
granularity
2D vs. 3D
loudnessmaximum
simultaneous
icons
![Page 49: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/49.jpg)
Automatic
sound
recognition
Conveying
sound
source
wearer’s
perspectivescreen
layout
direction
granularity
2D vs. 3D
loudnessmaximum
simultaneous
icons
narrative mode
used to render visual
information
Ear design dimensions
the
![Page 50: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/50.jpg)
Automatic
sound
recognition
Conveying
sound
source
wearer’s
perspectivescreen
layout
direction
granularity
2D vs. 3D
loudnessmaximum
simultaneous
icons
where sound
indicators are drawn
on the display
Ear design dimensions
the
![Page 51: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/51.jpg)
Automatic
sound
recognition
Conveying
sound
source
wearer’s
perspectivescreen
layout
direction
granularity
loudnessmaximum
simultaneous
icons
2D vs. 3D
how precisely sound is
shown on the display
Ear design dimensions
the
![Page 52: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/52.jpg)
Automatic
sound
recognition
Conveying
sound
source
wearer’s
perspectivescreen
layout
direction
granularity
2D vs. 3D
loudnessmaximum
simultaneous
icons
visual shapes used to
represent sound
Ear design dimensions
the
![Page 53: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/53.jpg)
Automatic
sound
recognition
Conveying
sound
source
wearer’s
perspectivescreen
layout
direction
granularity
loudnessmaximum
simultaneous
icons
2D vs. 3D
sound volume
Ear design dimensions
the
![Page 54: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/54.jpg)
Automatic
sound
recognition
Conveying
sound
source
wearer’s
perspectivescreen
layout
direction
granularity
loudnessmaximum
simultaneous
icons
2D vs. 3D
maximum number of
visual indicators to
show simultaneously
Ear design dimensions
the
![Page 55: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/55.jpg)
Automatic
sound
recognition
Conveying
sound
source
wearer’s
perspectivescreen
layout
direction
granularity
loudnessmaximum
simultaneous
icons
2D vs. 3D
point towards the
sound source or follow
the path of the sound
Ear design dimensions
the
![Page 56: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/56.jpg)
Automatic
sound
recognition
Conveying
sound
source
wearer’s
perspectivescreen
layout
direction
granularity
loudnessmaximum
simultaneous
icons
2D vs. 3D
advanced features like
speaker recognition,
captioning, gender
Ear design dimensions
the
![Page 57: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/57.jpg)
Automatic
sound
recognition
Conveying
sound
source
wearer’s
perspectivescreen
layout
direction
granularity
2D vs. 3D
loudnessmaximum
simultaneous
icons
Ear design dimensions
the
I would explain only two dimensions, given the short time
![Page 58: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/58.jpg)
Automatic
sound
recognition
Conveying
sound
source
wearer’s
perspectivescreen
layout
direction
granularity
loudnessmaximum
simultaneous
icons
Ear design dimensions
the
2D vs. 3D
![Page 59: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/59.jpg)
wearer’s
perspective
EGOCENTRIC
Pulses Arrows Fingers
EXOCENTRIC
People Arrows Circles
you you you
![Page 60: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/60.jpg)
Arrows Fingers
EXOCENTRIC
People Arrows Circles
you you you
wearer’s
perspective
EGOCENTRIC
Pulses
![Page 61: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/61.jpg)
![Page 62: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/62.jpg)
Arrows Fingers
EXOCENTRIC
People Arrows Circles
you you you
wearer’s
perspective
EGOCENTRIC
Pulses
![Page 63: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/63.jpg)
EGOCENTRIC
Pulses Arrows Fingers
Arrows Circles
you you
wearer’s
perspective
EXOCENTRIC
People
you
![Page 64: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/64.jpg)
![Page 65: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/65.jpg)
wearer’s
perspective
![Page 66: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/66.jpg)
wearer’s
perspective
![Page 67: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/67.jpg)
direction
granularity
Discrete: 4-Levels Discrete: 8-Levels ContinuousDiscrete: 1-Level
![Page 68: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/68.jpg)
direction
granularity
Pulses Arrows Fingers
8-LEVELS
CONTINUOUS
Pulses Arrows Fingers
1-LEVEL
Circle
4-LEVELS
Arrows Fingers
Pulses
![Page 69: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/69.jpg)
WEARER’S PERSPECTIVEE
gocentr
icE
xocentr
ic
DESIGN DIMENSIONS
DIRECTIONAL GRANULARITY
SCREEN LAYOUT
Recta
ngula
r
Cir
cula
rFro
m C
ente
r
MAXIMUM SIMULTANEOUS ICONS
Tw
oFour
Eig
ht
Outw
ard
Inw
ard
CONVEYING SOUND SOURCE
Example: CirclesExample: Arrows 1 Example: Arrows 2 Example: Arrows 3
LOUDNESS
Example: Speaker Identity
SARA
H
JOHNMIKE Example: Speech vs.
Non-Speech SoundsExample: GenderExample: Captions
JOHN
AUTOMATIC SOUND RECOGNITION
2D VS. 3D
2D
3D
![Page 70: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/70.jpg)
Design Goals
and
Dimensions
Proof-of-Concept
PrototypeStudy 2
PART 1:
Formative
Interview
PART 2:
Feedback on
HMD approach
PART 3:
Design
Probe
Study 1
OUTLINE
![Page 71: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/71.jpg)
Design Goals
and
Dimensions
Proof-of-Concept
PrototypeStudy 2
PART 1:
Formative
Interview
PART 2:
Feedback on
HMD approach
PART 3:
Design
Probe
Study 1
OUTLINE
![Page 72: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/72.jpg)
Study 1
Recruitmento Online postings and social media
o Received ~300 responses, recruited 24
Study Method o Semi-structured interview, feedback on HMD
approach and design probe
o Average 67 minutes
o Participated communicated verbally (N=9) or
by typing (N=15), according to preference
Participantso 12 female/12 male
o 20 with profound, the remaining 4 had at
least moderate hearing loss
o 19 employed lip-reading during conversations
![Page 73: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/73.jpg)
Design Goals
and
Dimensions
Proof-of-Concept
PrototypeStudy 2
PART 1:
Formative
Interview
PART 2:
Feedback on
HMD approach
PART 3:
Design
Probe
Study 1 (N=24)
OUTLINE
Semi-structured interview on
problems in group conversations
![Page 74: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/74.jpg)
Design Goals
and
Dimensions
Proof-of-Concept
PrototypeStudy 2
PART 1:
Formative
Interview
PART 2:
Feedback on
HMD approach
PART 3:
Design
Probe
Study 1 (N=24)
OUTLINE
Evaluation of HMD approach
for sound visualization
![Page 75: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/75.jpg)
Design Goals
and
Dimensions
Proof-of-Concept
PrototypeStudy 2
PART 1:
Formative
Interview
PART 2:
Feedback on
HMD approach
PART 3:
Design
Probe
Study 1 (N=24)
OUTLINE
Feedback on preference for
individual design dimensions
![Page 76: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/76.jpg)
Design Goals
and
Dimensions
Proof-of-Concept
PrototypeStudy 2
PART 1:
Formative
Interview
PART 2:
Feedback on
HMD approach
PART 3:
Design
Probe
Study 1 (N=24)
OUTLINE
![Page 77: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/77.jpg)
STUDY 1 PART 1: FORMATIVE INTERVIEW
• Problems encountered in group conversations
• How the participant accommodated those
problems
• Prior experience with computing or mobile
devices to support group conversation
• Ideas for future technology
![Page 78: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/78.jpg)
Design Goals
and
Dimensions
Proof-of-Concept
PrototypeStudy 2
PART 1:
Formative
Interview
PART 2:
Feedback on
HMD approach
PART 3:
Design
Probe
Study 1 (N=24)
OUTLINE
![Page 79: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/79.jpg)
YOU
SCENARIO ONE: AROUND A TABLE
GLASS
Initially, we described two scenarios to participants
Participants also viewed the corresponding designs on Glass
![Page 80: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/80.jpg)
YOU
SCENARIO ONE: AROUND A TABLE
GLASS
![Page 81: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/81.jpg)
SCENARIO TWO: IN A CLASSROOM
YOUGOOGLE
GLASS
A second example using arrows
![Page 82: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/82.jpg)
An example video shows a participant viewing the scenarios
![Page 83: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/83.jpg)
Participant: P13
Moderate hearing loss
(Please download the powerpoint version to view the video)
![Page 84: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/84.jpg)
Design Goals
and
Dimensions
Proof-of-Concept
PrototypeStudy 2
PART 1:
Formative
Interview
PART 2:
Feedback on
HMD approach
PART 3:
Design
Probe
Study 1 (N=24)
OUTLINE
![Page 85: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/85.jpg)
Design Probe
![Page 86: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/86.jpg)
Design Probe
IPAD
TWO VISUAL MEDIUMS
GLASS
![Page 87: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/87.jpg)
Design Probe
IPAD GLASS
3D
2D
![Page 88: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/88.jpg)
Design Probe
YOU YOU YOUYOU
YOU YOU YOU YOU
SCENARIO 1: AROUND A TABLE
SCENARIO 2: IN A CLASSROOM
![Page 89: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/89.jpg)
We evaluated the design dimensions by showing examples
We asked for open ended feedback and
specific preference with rationale
Two example videos demonstrate this
STUDY 1: PART 3 (DESIGN PROBE)
![Page 90: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/90.jpg)
2D vs. 3DParticipant: P8
Profound hearing loss
Sequence shown
on Google Glass
(Please download the powerpoint version to view the video)
![Page 91: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/91.jpg)
2D vs. 3DParticipant: P8
Profound hearing loss
Sequence shown
on Google Glass
Sequence shown on iPAD
2D
Rectangular layout From centerCircular layout
3D
Rectangular layout From centerCircular layout
Which one do you prefer: 3D or 2D? Why?
![Page 92: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/92.jpg)
When asked to sketch their own designs…
Participant: P14
Profound hearing loss
(Please download the powerpoint version to view the video)
![Page 93: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/93.jpg)
ResultsStudy 1: Evaluating Design Dimensions
![Page 94: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/94.jpg)
Design Goals
and
Dimensions
Proof-of-Concept
PrototypeStudy 2
PART 1:
Formative
Interview
PART 2:
Feedback on
HMD approach
PART 3:
Design
Probe
Study 1 RESULTS
OUTLINE
![Page 95: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/95.jpg)
Two researchers iteratively coded the formative interview
![Page 96: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/96.jpg)
All 24 participants agreed that communicating in a
group with hearing persons can be challenging
![Page 97: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/97.jpg)
If one person finishes talking, I do not know
who to look at next—that is my problem
because hearing people can hear who the
next person is, and what they are saying.”
-P20, profound hearing loss
![Page 98: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/98.jpg)
ADAPTIVE STRATEGIES FOR GROUP COMMUNICATION
Traditional techniquesInterpreters/Captioners
(14 Participants)
Low-fidelity adaptation Pen/Paper
(7 Participants)
Use of technologyiPhone/Computer
(16 Participants)
Participants mentioned various strategies for group communication
RESULTS OF STUDY 1: PART 1 (FORMATIVE INTERVIEW)
![Page 99: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/99.jpg)
7 participants mentioned maladaptive strategies,
i.e. distract or prevent communication
our approach (e.g., missing
speaker transitions, helping
![Page 100: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/100.jpg)
Design Goals
and
Dimensions
Proof-of-Concept
PrototypeStudy 2
PART 1:
Formative
Interview
PART 2:
Feedback on
HMD approach
PART 3:
Design
Probe
OUTLINE
Study 1 RESULTS
![Page 101: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/101.jpg)
All 24 participants thought the idea of head-mounted
visualizations for sound awareness was useful
our approach (e.g., missing
speaker transitions, helping
RESULTS OF STUDY 1: PART 2 (DESIGN PROBE)
![Page 102: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/102.jpg)
“I think it’s a great idea, especially for those that
can lip read at least above a functional level… It
would reduce the amount of time and effort to
find the individual speaking if I have information
where the sound is coming from, which would
lead to less content loss.”
-P17, profound hearing loss
![Page 103: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/103.jpg)
Design Goals
and
Dimensions
Proof-of-Concept
PrototypeStudy 2
PART 1:
Formative
Interview
PART 2:
Feedback on
HMD approach
PART 3:
Design
Probe
OUTLINE
Study 1 RESULTS
![Page 104: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/104.jpg)
2D
Rectangular layout From centerCircular layout
3D
Rectangular layout From centerCircular layout
Which one do you prefer: 3D or 2D? Why?
Recall that we asked participants about
their preferences for each design dimension
PREFERENCES FOR DESIGN DIMENSIONS
![Page 105: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/105.jpg)
2D
Rectangular layout From centerCircular layout
3D
Rectangular layout From centerCircular layout
Which one do you prefer: 3D or 2D? Why?
![Page 106: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/106.jpg)
One vote for “Yes”
Zero vote for “No”
0.5 vote each for “Maybe”, “I like both”
PREFERENCES FOR SOME DESIGN DIMENSIONS
Chi-Square Test on Distribution of Preference
![Page 107: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/107.jpg)
wearer’s
perspective
EGOCENTRIC
(11 VOTES)
Pulses Arrows Fingers
EXOCENTRIC
(13 VOTES)
People Arrows Circles
you you you
Χ2(1,N=24) = 0.04, p = ns
![Page 108: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/108.jpg)
wearer’s
perspective
EXOCENTRIC
(13 VOTES)
People Arrows Circles
you you you
EGOCENTRIC
(11 VOTES)
Pulses Arrows Fingers
Χ2(1,N=24) = 0.04, p = ns
![Page 109: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/109.jpg)
EGOCENTRIC PERSPECTIVE (11 VOTES)
Easier to interpret (4 Participants)
Less cluttered(3 Participants)
![Page 110: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/110.jpg)
wearer’s
perspective
EGOCENTRIC
(11 VOTES)
Pulses Arrows Fingers
EXOCENTRIC
(13 VOTES)
People Arrows Circles
you you you
Χ2(1,N=24) = 0.04, p = ns
![Page 111: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/111.jpg)
EXOCENTRIC PERSPECTIVE (13 VOTES)
Shows the location of the wearer (12 Participants)
![Page 112: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/112.jpg)
Participant P15
Moderate to severe hearing loss
Preferred exocentric perspective
“I can better judge the direction if I have
a [top-down] reference to myself
[exocentric]. Pointing to front and back
are difficult in egocentric.”
![Page 113: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/113.jpg)
Both egocentric and exocentric were
well received, so either could be used
![Page 114: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/114.jpg)
direction
granularity
Pulses Arrows Fingers
8-LEVELS
(5.5 VOTES)
CONTINUOUS
(14.5 VOTES)
Pulses Arrows Fingers
1-LEVEL
(1 VOTE)
Circle
4-LEVELS
(3 VOTES)
Arrows Fingers
Pulses
Χ2(3,N=24) = 17.75, p < .001
![Page 115: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/115.jpg)
direction
granularity
Pulses Arrows Fingers
8-LEVELS
(5.5 VOTES)
CONTINUOUS
(14.5 VOTES)
Pulses Arrows Fingers
1-LEVEL
(1 VOTE)
Circle
4-LEVELS
(3 VOTES)
Arrows Fingers
Pulses
Χ2(3,N=24) = 17.75, p < .001
![Page 116: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/116.jpg)
Precision is valued,
use high directional granularity
![Page 117: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/117.jpg)
PREFERENCES FOR SOME DESIGN DIMENSIONS
WEARER’S PERSPECTIVE
EGOCENTRIC
11 VOTESEXOCENTRIC
13 VOTES
DIRECTIONAL GRANULARITY
CONTINUOUS
14.5 VOTES
8-LEVEL
5.5 VOTES
4-LEVEL
3 VOTES
1-LEVEL
1 VOTE
2D VS. 3D
2D
12 VOTES
3D
12 VOTES
CONVEYING SOUND SOURCE
OUTWARD
19 VOTES
INWARD
5 VOTES
MAXIMUM SIMULTANEOUS ICONS
FOUR
10 VOTES
>FOUR
8.5 VOTES
<FOUR
5.5 VOTES
SCREEN LAYOUT
RECTANGULAR
11.5 VOTES
CIRCULAR
10.5 VOTES
FROM CENTER
2 VOTES
![Page 118: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/118.jpg)
PREFERENCES FOR SOME DESIGN DIMENSIONS
WEARER’S PERSPECTIVE
EGOCENTRIC
11 VOTESEXOCENTRIC
13 VOTES
DIRECTIONAL GRANULARITY
CONTINUOUS
14.5 VOTES
8-LEVEL
5.5 VOTES
4-LEVEL
3 VOTES
1-LEVEL
1 VOTE
2D VS. 3D
2D
12 VOTES
3D
12 VOTES
CONVEYING SOUND SOURCE
OUTWARD
19 VOTES
INWARD
5 VOTES
MAXIMUM SIMULTANEOUS ICONS
FOUR
10 VOTES
>FOUR
8.5 VOTES
<FOUR
5.5 VOTES
SCREEN LAYOUT
RECTANGULAR
11.5 VOTES
CIRCULAR
10.5 VOTES
FROM CENTER
2 VOTES
Please refer to the paper for more design results
![Page 119: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/119.jpg)
DESIGNS SKETCHED BY PARTICIPANTS
P19: Extended Egocentric Pulses
To show recent speaking order
P14: Extended Egocentric Design
Pulses represent recent speakers, 3D
arrow shows current speaker
P14: Different Exocentric Design
Visualize all potential speakers
P7: Different Exocentric Design
Room layout and people locations
RESULTS OF STUDY 1: PART 3 (DESIGN PROBE)
![Page 120: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/120.jpg)
Design Goals
and
Dimensions
Proof-of-Concept
PrototypeStudy 2
PART 1:
Formative
Interview
PART 2:
Feedback on
HMD approach
PART 3:
Design
Probe
Study 1
OUTLINE
![Page 121: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/121.jpg)
Design Goals
and
Dimensions
Proof-of-Concept
PrototypeStudy 2
PART 1:
Formative
Interview
PART 2:
Feedback on
HMD approach
PART 3:
Design
Probe
Study 1
OUTLINE
![Page 122: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/122.jpg)
Microphone array
Visualization that is
shown on Google Glass
Laptop for
interfacing
![Page 123: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/123.jpg)
Egocentric Pulses Exocentric Arrows
We implemented live versions of two popular designs:
![Page 124: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/124.jpg)
Design Goals
and
Dimensions
Proof-of-Concept
PrototypeStudy 2
PART 1:
Formative
Interview
PART 2:
Feedback on
HMD approach
PART 3:
Design
Probe
Study 1
OUTLINE
![Page 125: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/125.jpg)
Design Goals
and
Dimensions
Proof-of-Concept
PrototypeStudy 2
PART 1:
Formative
Interview
PART 2:
Feedback on
HMD approach
PART 3:
Design
Probe
Study 1
OUTLINE
![Page 126: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/126.jpg)
Egocentric Pulses Exocentric Arrows
We implemented live versions of two popular designs:
STUDY 2
4 new participants
Two scripted conversations for each design
One open ended conversation for each design
Qualitative interview after each design
![Page 127: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/127.jpg)
SCRIPTED CONVERSATIONSCRIPT: GHOSTBUSTERS
(Please download the powerpoint version to view the video)
![Page 128: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/128.jpg)
Preliminary
FeedbackStudy 2: Evaluating Proof-of-Concept Prototype
![Page 129: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/129.jpg)
“This approach would be helpful
because my sound processor is not able
to point where the sound was from”-R2, severe hearing loss
RESULTS OF STUDY 2
![Page 130: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/130.jpg)
Participant R4
Profound hearing loss
“I might not need it because they
(hearing friends) would want me to
understand better by real conversation
rather than expecting to read from
Google Glass.”
RESULTS OF STUDY 2
![Page 131: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/131.jpg)
Participant R4
Profound hearing loss
“I might not need it because they
(hearing friends) would want me to
understand better by real conversation
rather than expecting to read from
Google Glass.”
Please refer to the paper for more details on
real-time implementation and evaluation
RESULTS OF STUDY 2
![Page 132: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/132.jpg)
CLOSING THOUGHT FOR STUDY 2PARTICIPANT’S OVERALL EXPERIENCE WITH PROTOTYPE
(Please download the powerpoint version to view the video)
![Page 133: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/133.jpg)
Primary Contributions
First work to design and evaluate sound
visualizations on HMDs for the deaf and hard
of hearing
Explored a broad range of novel designs
Implemented a preliminary working
prototype
1
3
2
![Page 134: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/134.jpg)
Reflections
![Page 135: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/135.jpg)
PREFERENCES FOR SOME DESIGN DIMENSIONS
WEARER’S PERSPECTIVE
EGOCENTRIC
11 VOTESEXOCENTRIC
13 VOTES
DIRECTIONAL GRANULARITY
CONTINUOUS
14.5 VOTES
8-LEVEL
5.5 VOTES
4-LEVEL
3 VOTES
1-LEVEL
1 VOTE
2D VS. 3D
2D
12 VOTES
3D
12 VOTES
CONVEYING SOUND SOURCE
OUTWARD
19 VOTES
INWARD
5 VOTES
MAXIMUM SIMULTANEOUS ICONS
FOUR
10 VOTES
>FOUR
8.5 VOTES
<FOUR
5.5 VOTES
SCREEN LAYOUT
RECTANGULAR
11.5 VOTES
CIRCULAR
10.5 VOTES
FROM CENTER
2 VOTES
While strong preference existed for certain features,
others were mixed
Need for Customizability
![Page 136: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/136.jpg)
Interference
![Page 137: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/137.jpg)
Interference
accommodates existing hearing devices, is lightweight, comfortable, and
accurate, and contain a large transparent display superimposed over the eye
Ideal HMD for Sound Visualizations
![Page 138: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/138.jpg)
Example: Speaker Identity
SARAH
JOHN
MIKE
Example: Speech vs. Non-Speech Sounds
Example: GenderExample: Captions
JOHN
MORE SOPHISTICATED SOUND PROCESSING
Automatic sound recognition, real-time captioning, gender identification
More Sophisticated Sound Processing
![Page 139: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/139.jpg)
HMDs as glanceable displays
offer an interesting opportunity
to
transform the auditory sense
to the visual sense
leading to
new solutions for accessibility
![Page 140: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/140.jpg)
HumanComputerInteractionLaboratory
HEAD-MOUNTED DISPLAY VISUALIZATIONS TO SUPPORT
SOUND AWARENESS FOR THE DEAF AND HARD OF HEARING
Montgomery BlairHigh School
Gallaudet University
![Page 141: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/141.jpg)
HumanComputerInteractionLaboratory
HEAD-MOUNTED DISPLAY VISUALIZATIONS TO SUPPORT
SOUND AWARENESS FOR THE DEAF AND HARD OF HEARING
Jamie Gilkeson4 Benjamin Holland4
Montgomery BlairHigh School
Gallaudet University
![Page 142: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/142.jpg)
HumanComputerInteractionLaboratory
HEAD-MOUNTED DISPLAY VISUALIZATIONS TO SUPPORT
SOUND AWARENESS FOR THE DEAF AND HARD OF HEARING
Montgomery BlairHigh School
Gallaudet University
![Page 143: HEAD-MOUNTED DISPLAY V SUPPORT SOUND AWARENESS FOR …€¦ · “I almost always interact with Deaf people. When I converse with hearing people it’s usually 1:1 with interpreters.”](https://reader035.vdocument.in/reader035/viewer/2022071301/609e529cf311311b165740bb/html5/thumbnails/143.jpg)
Questions?
@higherdefender
HumanComputerInteractionLaboratory
Montgomery BlairHigh School
Gallaudet University