ccrma/yamaha mass project masking ambient speech soundsjcaceres/research/pdfs/... · atsuko ito. 3...
TRANSCRIPT
![Page 1: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/1.jpg)
CCRMA/YAMAHA MASS ProjectCCRMA/YAMAHA MASS ProjectMasking Ambient Speech SoundsMasking Ambient Speech Sounds
Juan-Pablo CáceresJuan-Pablo Cáceres
![Page 2: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/2.jpg)
2
MASS Project BackgroundMASS Project BackgroundCollaboration Summer 2006Collaboration Summer 2006
CCRMA
Chris ChafeJonathan BergerJonathan AbelJuan-Pablo CáceresHiroko TerasawaJason Sadural
Yamaha Center for Advanced Sound Technologies Innovative Technology Group
Yasushi ShimizuAtsuko Ito
![Page 3: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/3.jpg)
3
The ProblemThe Problem
Unwanted sounds
Quiet room
Unwanted sounds
Masking sound
speaker
Mask/Camouflage of Intruding Speech
![Page 4: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/4.jpg)
4
Some MaskersSome Maskers
Pink Noise Types, spectrally matchedEfficiency lost for speech spectrally unmatched
Amplitude Modulated NoiseToo distracting
Reversed SpeechToo distracting
Meeting room A Meeting room B
Masking sound
female+speech.wav
AM_max45dB.wav
reverse+2dB.wav
![Page 5: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/5.jpg)
5
Mass Project SummaryMass Project Summary
Tokyo Office Simulation for Experiment Setup
Masker Design: FM and Gurgle
Psychoacoustic Experiments
![Page 6: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/6.jpg)
6
upward
MR2 MR1
CorridorAW4416
MR3
1
2
3
4
10
678
59
Recording for Room ModelingRecording for Room Modeling
Tokyo Office
- Sine Sweeps- Voices- Calibration Noise
![Page 7: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/7.jpg)
7
Recording for Room ModelingRecording for Room Modeling
Tokyo Office
![Page 8: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/8.jpg)
8
Recording
Calibration (EQ)
Impulse Response Generation
Room Modeling and Room Modeling and DiffusionDiffusion
![Page 9: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/9.jpg)
9
Diffusion of Experiments
4
![Page 10: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/10.jpg)
10
Speech Sounds in the Tokyo OfficeSpeech Sounds in the Tokyo Office
MR2 MR1
Corridor
AW441
MR3
CONV_2people_e_adj_08dir1.wav CONV_2people_e_ins_08dir1.wav
Speech Inside the Room
Speech coming from the Adjacent Room
Modeled Room
Need to be masked
![Page 11: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/11.jpg)
11
Female Speech Analysis (Tokyo Office)Female Speech Analysis (Tokyo Office)
Roughly 3 main peaks bands
![Page 12: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/12.jpg)
12
Male Speech Analysis (Tokyo Office)Male Speech Analysis (Tokyo Office)
Main Peak
![Page 13: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/13.jpg)
13
Voice Comparison for One WordVoice Comparison for One Word
![Page 14: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/14.jpg)
14
Voice Analysis in the Tokyo OfficeVoice Analysis in the Tokyo Office
Wall: Low-Pass Filter=> Almost no energy above 1000 Hz
Male voice: strong component around 100 Hz
Female main band: ~200/300 HzStronger second band: ~400/600 Hz
This is the Energy that we need to mask
![Page 15: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/15.jpg)
15
Masking PhenomenonMasking Phenomenon
Loud sound & soft sound
Frequency Masking
Temporal Masking
![Page 16: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/16.jpg)
16
Critical BandsCritical Bands
Frequency difference at which 2 pure tones can be easily distinguished (“roughness” disappears).
Stimulate the same section of the basilar membrane
Masking Efficiency Increase up to 1 CB
![Page 17: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/17.jpg)
17
Noise is better masker than tones
Perceptual Loudness inside 1 CB
Perceptual Loudness spanning more than 1 CB
<less
![Page 18: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/18.jpg)
18
Why Using Noise as Masker?Why Using Noise as Masker?
Is LESS distracting
Is MORE efficient
Use bands of noise of 1 Critical Bandwidth
![Page 19: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/19.jpg)
19
Noise Bands as MaskerNoise Bands as Masker
ERB (Equivalent Rectangular Bandwidth) for each band
ERB=24.74.37fc
kHz1
![Page 20: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/20.jpg)
20
Cocktail Party EffectCocktail Party Effect
Focus in one conversation in the midst of other conversations and noise
Simple and intuitive:VASTLY complex (physiological & technically)
Acoustic task:Separate out a single talker's speech from a complex
spectrogram
Humans are extremely good at it
![Page 21: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/21.jpg)
21
Factors that make the task easierFactors that make the task easier
Directionality
Lip-Reading, gestures...
Voice quality (pitch, gender, ...)
Transition probabilities (i.e. MEANING)
![Page 22: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/22.jpg)
22
Opposite problemOpposite problem
Jams a sound: Absorption into a cocktail party texture
2 Approaches:
Energetic+Information Masker: FM Noise
Information Masker: “Gurgle”
![Page 23: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/23.jpg)
23
Speech Like Modulation of BandsSpeech Like Modulation of Bands
![Page 24: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/24.jpg)
24
““Gurgle” MaskerGurgle” Masker
Developed entirely by ear.
Highly-modulated information masker using FM-speech synthesis
mask_gurgle.wav
![Page 25: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/25.jpg)
25
Experiment 1: Masker RefinementExperiment 1: Masker Refinement
General protocol: best masker from a parametric masker
Genetic algorithm approach● Vary one parameter (all the others fixed)● Find 1 or 2 “sweet spots”, fix that parameter● Repeat the process for next parameter
Setup: Masker continuous stream, subject “reacts” when to intruding speech
![Page 26: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/26.jpg)
26
Parameters for the 3 Noise BandsParameters for the 3 Noise Bands● Center Frequency
● Relative Amplitude
● Modulation Rate
● Modulation Variance
![Page 27: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/27.jpg)
27
Result examples after 1Result examples after 1stst Stage (fc) Stage (fc)
![Page 28: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/28.jpg)
28
FM Evolved MaskerFM Evolved Masker
mask_fm.wav
Note Harmonic Relationship in fc
![Page 29: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/29.jpg)
29
Experiment 2: EfficiencyExperiment 2: Efficiency
Main Conclusions deal with directionality:
What if Intruding Speech & Masker come from the same direction?
speech+masker
![Page 30: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/30.jpg)
30
Masking Noise DirectionalityMasking Noise Directionality
Keep source outside the room, remove wall effect.
Identify direct path, inverse filter it.
CONV_2people_e_adj_08dir1.wav
CONV_2people_e_adj_08dir1NW.wav
![Page 31: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/31.jpg)
31
Gurgle Masker DirectionalityGurgle Masker Directionality
Informal testing:
Directionality (spatialization)
Higher efficiency
speech+masker
![Page 32: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/32.jpg)
32
Experiment 3: AnnoyanceExperiment 3: Annoyance
Effect on productivity tasks involving auditory/visual stimulation and response
Procedure:● Word-list presented to the subject● Masker is turned on (30 secs)● Subject answers to mental math questions● Subject try to recall the word-list (masker off)
![Page 33: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/33.jpg)
33
Some Results From Experiment 3Some Results From Experiment 3
mask_control.wavmask_fm.wavmask_gurgle.wavMaskMix.wavMask_Mix_a_lot.wav
![Page 34: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/34.jpg)
34
Conclusions and Future WorkConclusions and Future Work
1. We model real-world workplace
2.intruding speech representative of real-world situations
3.compare effectiveness & spatial arrangement
4.compare the annoyance & degradation of mental tasks
![Page 35: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/35.jpg)
35
Conclusions and Future WorkConclusions and Future Work
Two main type of maskers:
“Energy” Maskers & “Information” Maskers
Blend of both
Directionality (spatialization) seems to be of great importance
![Page 36: CCRMA/YAMAHA MASS Project Masking Ambient Speech Soundsjcaceres/research/PDFs/... · Atsuko Ito. 3 The Problem Unwanted sounds Quiet room Unwanted sounds Masking sound speaker Mask/Camouflage](https://reader034.vdocument.in/reader034/viewer/2022050218/5f639dfa42d8760fc540d6b4/html5/thumbnails/36.jpg)
36
Questions? Discussion?Questions? Discussion?