basic acoustics part 2 spectrograms, resonance, vowels
TRANSCRIPT
![Page 1: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/1.jpg)
Basic acoustics part 2Spectrograms, resonance, vowels
See Rogers chapter 7 8
![Page 2: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/2.jpg)
Spectrogram
• Spectrogram• Represents ‘spectrum varying over time’
– X-axis (horiz.) time (like waveform)– Y-axis Frequency (like spectrum)– Third dimension: pseudo-color or gray-scale
representing amplitude
![Page 3: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/3.jpg)
WaveSurfer….
• Allows us to see– Waveform– Spectrogram (color or gray)– Spectral section
• ‘short-time spectrum’• = spectrum of a brief stretch of speech
• Demonstration spectrograms– of whistle– of speech
![Page 4: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/4.jpg)
Narrow band spectrogram [aaa] pitch change
![Page 5: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/5.jpg)
Harmonics [aaa] pitch change
Harmonics-- Narrow stripes running left-right
![Page 6: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/6.jpg)
Narrow band spectrogram:changing pitch of [AAA]
• Spectrogram of [AAA] on varying pitches• Narrow band spectrogram
– Looks at fairly long stretch of time• 40 ms or so… sees several glottal pulses at once
– Each glottal pulse about 10 ms long or less so several areblurred
• Varying harmonic structure clear– Spectral sections at different times
![Page 7: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/7.jpg)
Measuring F0 from narrow bandspectrogram
• Measure F0 from k-th harmonic• Hk = x Hz then F0= x/k Hz
– 10th harmonic is convenient
• Expanding frequency scale makes this easier
![Page 8: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/8.jpg)
Harmonics [aaa] pitch change: Freq. Expanded
10-th Harmonic highlighted: F0 about 93 and 141 Hz at arrows
930 Hz
1410 Hz
![Page 9: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/9.jpg)
Wide band spectrogram [AAA] pitch change
F1
F3
F4
F2
![Page 10: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/10.jpg)
Wide band spectrogram [AAiiAA] No pitch change
F1
F3
F4
F2
F1
F3
F2
![Page 11: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/11.jpg)
Wide band spectrogram:changing pitch of [AAA]
• Spectrogram of [AAA] on varying pitches• Wideband spectrogram
– Looks at fairly long short of time• 2 to 3 ms only sees less than one full glottal period• Each glottal pulse about 10 ms long
– Varying harmonic structure no longer clear– Dark bars show approximate location ‘formant peaks’– Formants don’t change much with pitch changes– They change lots with VOWEL changes
![Page 12: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/12.jpg)
Wideband band spectrogram:[AAiiAA]
• Spectrogram of [AAiiAA] on SAME pitch• Wideband spectrogram
– Looks at fairly long short of time• 2 to 3 ms only sees less than one full glottal period• Each glottal pulse about 10 ms long
– Harmonic structure no longer clear– Dark bars show approximate location ‘formant peaks’– Formants change lots with VOWEL changes
![Page 13: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/13.jpg)
Wide and narrowbandspectrograms
• Narrowband spectrogram makes harmonicstructure clear– Associated with glottal source
• Wideband spectrogram makes formant structureclearer– Dark formant bands that change with vowel, not with
pitch)– Formants associated ‘filter properties’ of vocal tract
above the larynx
![Page 14: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/14.jpg)
Source + Filter = Vowel
• Source + Filter theory of speech• Consider vowel like sounds first
– Source = voicing in glottis– Filter = tube-resonator system of SLVT
• SLVT = supra-laryngeal vocal tract
![Page 15: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/15.jpg)
Principle of source + filter : Glottal source
Instant of glottal closure
10th harmonic at 1000 Hz f0 = 100 Hz
Period = 10 ms
![Page 16: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/16.jpg)
Principle of source + filter : Vowel
Harmonics(peaks)
![Page 17: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/17.jpg)
Compare last two slides
• Waveform and spectrum of glottal sourceare relatively simple compared to vowel
• SLVT filter imparts extra structure onvowel waveform– Oscillation between glottal pulses– Enhances (boosts) certain frequency regions
![Page 18: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/18.jpg)
Source + Filter = Vowel [Q]
Resonance (formant) peaksF1 F2 F3
![Page 19: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/19.jpg)
Source + Filter = Vowel [i]
Resonance (formant) peaksF1 F2 F3
![Page 20: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/20.jpg)
Artificial glottal source
• Transformer ® ‘robot voice’• Replace glottal source with a simple buzz• Use my SLVT as the filter
![Page 21: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/21.jpg)
Spectrum of the Robot source
• Robot source:– Lots of harmonics across the frequencies– Ideally each harmonic would be near same amplitude– Note we see little ‘pointed pickets’ in spectral section– Not narrow lines– Real time-limited spectra look like this
• As we increase time for a ‘steady’ signal we get more line-likeharmonic peaks
![Page 22: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/22.jpg)
What about filter?
• We’ve seen the robot source that can befiltered by real vocal tract
• Can we make a ‘robot filter’– Yes: Plastic tubes
• Slap them with palm of hand and get an‘impulse response’ of filter
![Page 23: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/23.jpg)
Robot vowels stage 1
• WaveSurfer analysis slapped tubes ofdifferent lengths– (ThreeTappedTubes)
• WaveSurfer … rapidly tapped mid-size tube– (TappedTubeEmpty.wav)
• WaveSurfer tapped tube with partial block– (TappedTubeBlock.wav)
![Page 24: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/24.jpg)
Robot vowels stage 2
• WaveSurfer analysis slapped tubes ofdifferent lengths– (ThreeTappedTubes)
• WaveSurfer … rapidly tapped mid-size tube– (TappedTubeEmpty.wav)
• WaveSurfer tapped tube with partial block– (TappedTubeBlock.wav)
![Page 25: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/25.jpg)
Robot vowels stage 3
• Add Robot source to tube• Move ‘robot tongue’ to change shape• WaveSurfer: robot /aaaiiiaaa/
![Page 26: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/26.jpg)
Review: Displays
• Waveform– Time x amplitude
• Spectrum or spectral section– Frequency by amplitude (dB)
• Spectrogram– Time by frequency by amplitude– (horiz.) (vert.) (color or darkness)
![Page 27: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/27.jpg)
Waveforms:
• Waveform– Time x amplitude
• Good for measuring durations of someevents (especially when displayed withspectrogram).– Period of a repetitive waveform (e.g. glottal
pulse duration of voiced speech)– VOT
![Page 28: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/28.jpg)
Spectral section
• Spectral section (spectrum)– Frequency by amplitude in a brief interval of time (a
section of a longer signal)• Narrow band spectra look at moderately long
chunks of speech (30-40 ms)– Show harmonics for voiced speech
• Broad band spectra look at shorter chunks ofspeech (less than glottal period)– can show formant structure
![Page 29: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/29.jpg)
Narrow band spectrogram
• Narrow band spectrogram is a way to display manynarrow-band spectral sections at once
• At each point in time, look at moderately long chunks ofspeech (30-40 ms) centered on that time point (‘windowed’sections)– Represent amplitude at each frequency for that center time by
darkness or color coding• Shows harmonics as horizontal bands that bend as
fundamental frequency changes• Formant patterns visible only indirectly by which
harmonics are strong
![Page 30: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/30.jpg)
Measuring F0 from waveforms
• Find duration of one period• Convert period duration to frequency
• 1 period in .005 seconds (= 5 ms) that means• = X periods in 1 second?• Answer 1/ .005 = 200 Hz
• Alternate method: count several periods (k)– x periods in x sec means frequency of k/x Hz– That is k/x periods occur in one second
![Page 31: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/31.jpg)
Measuring F0 from wide bandspectrogram
• Find duration of one period– Distance between vertical striations (stripes)
• Proceed as with waveform• “Ballpark” method for average F0:
– Count number of striations in 100 ms andmultiply by 10
![Page 32: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/32.jpg)
Measuring F0 from narrow bandspectrogram or spectral section
• Count up to the 10th harmonic• Measure its frequency against the frequency scale• Divide by 10
– Can be very accurate– Can use harmonic number k (instead of 10) if that’s
easier to find– Then divide by k
![Page 33: Basic acoustics part 2 Spectrograms, resonance, vowels](https://reader031.vdocument.in/reader031/viewer/2022020706/61fc8e6e8d33c02b785e8c8a/html5/thumbnails/33.jpg)
Measuring Formants
• Use wide band spectrogram• Try to identify wide bars that move a bit up and
down• Measure the center frequency of ‘darkest’ or
‘redest’ part.
Note: I will provide ‘formant tracks’ from WaveSurferwhich will put thin lines through the formants