week 2 sound and hearing mark huckvale · timbre “quality of sound” loudness, pitch and timbre...

51
Week 2 – Sound and Hearing Mark Huckvale 1

Upload: others

Post on 24-Jul-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Week 2 – Sound and Hearing

Mark Huckvale

1

Page 2: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Last Week

• Human spoken language re-uses mammalian anatomy and physiology for vocalisation and hearing to create a communication system of complexity beyond any other animal.

• The form of speech is thus contingent on the nature of our vocal apparatus, our hearing, our cognition and our social structures.

• Speech science seeks explanations for the form of spoken language through study of the processes of speaking, listening, language acquisition and language evolution.

• Speech Science is an experimental science that sits at the crossroads of many other disciplines; it has developed its own explanatory models which have in turn been developed into many practical technologies.

• The Speech Chain is a simple model of spoken communication that highlights the transformation of an intention in the mind of the speaker to an understanding of that intention in the mind of the listener through processes that involve the Grammatical Code, the Phonological Code, articulation, sound, hearing and perception.

2

Page 3: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Psychoacoustics

3

Page 4: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

4

Page 5: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

5

What you perceive depends on how your senses operate

Page 6: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Physical character of sound

6

Page 7: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Pressure variations in air

• Any moving or vibrating body affects local air pressure

• These fluctuations in pressure propagate away from the source (at high speed)

7

Page 8: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Pressure variations in air

•Pressure variations propagate through the air in all directions

•As they travel they diminish in size

•Note that the air itself does not move

8

Page 9: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

9

Page 10: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Perceptual character of sound

10

Page 11: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

11

Pitch

Page 12: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Terms to describe sound

Subjective terms for sound

Loudness “Quantity of sound”

Pitch “Melody of sound”

Timbre “Quality of sound”

Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds.

12

Page 13: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Loudness

13

Page 14: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Pressure (Pa)

Loudness

Loud

Quiet

14

Page 15: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Pressure (Pa)

Loudness

small change in pressure large change in loudness

large change in pressure small change in loudness

Loud

Quiet

15

Page 16: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Matching Pressure to Loudness

200Pa

150Pa

100Pa

50Pa

0Pa

Painful

Very Loud

Loud

Moderately Loud

Moderate

Quiet

Very Quiet

Just Audible

Silence 16

Page 17: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Weber’s Law

The increase in stimulus size necessary to produce a just noticeable difference is a constant fraction of the stimulus size:

∆𝑆 ∝ 𝑆 ∆𝑆 = 𝑘. 𝑆

k = “Weber fraction”

Ernst Heinrich Weber 1795 - 1878

17

Page 18: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

18

Page 19: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Linear vs. Exponential Series

2 3 4 5 6 7

2 4 8 16 32 64

19

Page 20: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Scale of JND

20

Add 5 Add 5% Powers of 1.05

100 100 1001.050

105 105 1001.051

110 110 1001.052

115 116 1001.053

120 122 1001.054

125 128 1001.055

130 134 1001.056

100+5*N 1001.05N

Linear Series

Exponential Series

Page 21: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Linear vs. Exponential Series

• In a linear series, each step is a constant size

0 2 4 6 8

(add 2)

• In an exponential series, each step is a constant multiplying factor

1 2 4 8 16

(multiply by 2)

• We can convert an exponential series back to a linear series using logarithms

21

Page 22: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Logarithms

• Logarithms are a way of saying – “Ten to the power of what is this number?”

• For example: log10(100) – Ten to the power of what is 100?

– Ten to the power of two is 100

– Therefore log10(100) is 2.

• Logarithms convert numbers into powers of 10

The logarithm of x

is some number y where

10y is equal to x 22

Page 23: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Practice with Logarithms

23

Page 24: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Logarithms Connect

• Logarithms convert an exponential series into a linear series:

x= 1 10 100 1000 10000

log(x)= 0 1 2 3 4

• So if the property we want to measure changes exponentially, the logarithm of that value will change linearly.

• Loudness is like this.

24

Page 25: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

decibels

• Decibels (dB) are a standard log-ratio scale dB = 20.log10(test/reference)

• Ideal for situations where we are interested in exponential change rather than linear

• Say we have a change from 100units to 150units

dB = 20.log10(150/100) = 3.52dB

• Same as change from 200units to 300units dB = 20.log10(300/200) = 3.52dB

25

Page 26: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

decibel Scale

• 1 decibel (1dB) = change of 1.12

• 6 decibels (6dB) = change of 2

• 20 decibels (20dB) = change of 10

• 1Pa increased by 6dB => 2Pa

• 10Pa increased by 20dB => 100Pa

26

Page 27: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Practice with decibels

27

Page 28: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Loudness vs. dB

Pressure (dB re 20Pa)

Loudness

28

Page 29: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Loudness vs. dB

Loudness

Smallest noticeable change ~ 1dB

More like a linear relationship

Pressure (dB re 20Pa) 29

Page 30: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Matching dB to Loudness

Painful

Very Loud

Loud

Moderately Loud

Moderate

Quiet

Very Quiet

Just Audible

Silence

200 Pa 140dB

20 Pa 120dB

2 Pa 100dB

0.2 Pa 80dB

0.02 Pa 60dB

0.002 Pa 40dB

0.0002 Pa 20dB

0.00002 Pa 0dB

<0.00002 Pa <0dB

decibels measured w.r.t. 20Pa 30

Page 31: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

31

Page 32: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Pitch

32

Page 33: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Repetition Frequency (Hz)

Pitch

High

Low

33

Page 34: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Repetition Frequency (Hz)

Pitch

High

Low

small change in frequency large change in pitch

large change in frequency small change in pitch

34

Page 35: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

• Concert pitch ‘A’ = 440Hz

• Middle ‘C’ = 262Hz

• One octave = 2 × frequency

• One semitone = 1.06 × frequency

699 587 494 392 330

‘A’ = 440Hz

‘C’ = 262Hz

35

Page 36: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Notice how the change in frequency from one note to the next (one semitone) is about ×1.06 (e.g. note 71 to 72 is 523.25/493.88 = 1.059).

36

Page 37: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Timbre

37

Page 38: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

38

Page 39: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

39

Page 40: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Auditory system

40

Page 41: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

41

Page 42: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

42

Page 43: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

43

Page 44: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

44

Page 45: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

45

Page 46: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

46

Page 47: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

KEMAR 47

Page 48: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Auditory Transduction

48

Page 49: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Conclusions

49

Page 50: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Big Ideas Today

• Sounds are tiny, rapid fluctuations in atmospheric pressure that propagate rapidly away from physical vibrations in air.

• The subjective dimensions of sound are loudness, pitch and timbre which are (non-linearly) related to the physical sound properties of amplitude, repetition frequency and spectrum

• Loudness perception is seen to follow Weber's law, in which perceptual responses are proportional to the logarithm of stimulus size.

• Our hearing is extremely sensitive to small sound pressure variations - and may easily be damaged by loud sounds.

• Auditory sensations are determined by how sound travels through the ear and how it is converted to nerve firing in the cochlea.

50

Page 51: Week 2 Sound and Hearing Mark Huckvale · Timbre “Quality of sound” Loudness, Pitch and Timbre are the three basic dimensions of our perception of sounds. 12 . Loudness 13 . Pressure

Lab Session

• Just Noticeable Differences. This is a listening experiment in which we will measure your sensitivity to small changes in loudness, pitch and timbre.

• Pitch & Repetition Frequency. You will use a program that measures the repetition frequency of sounds and reports the values in Hertz and in musical notation.

• Sound Localisation. You will hear some sounds recorded using a special binaural recording technique that preserves the features that help localise them in space.

51