acoustic continua and phonetic categories frequency - tones

71
Acoustic Continua and Phonetic Categories

Upload: barnaby-mcdaniel

Post on 14-Dec-2015

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Acoustic Continua and Phonetic Categories Frequency - Tones

Acoustic Continua andPhonetic Categories

Page 2: Acoustic Continua and Phonetic Categories Frequency - Tones

Frequency - Tones

Page 3: Acoustic Continua and Phonetic Categories Frequency - Tones

Frequency - Tones

Page 4: Acoustic Continua and Phonetic Categories Frequency - Tones

Frequency - Tones

Page 5: Acoustic Continua and Phonetic Categories Frequency - Tones

Frequency - Tones

Page 6: Acoustic Continua and Phonetic Categories Frequency - Tones

Frequency - Complex Sounds

Page 7: Acoustic Continua and Phonetic Categories Frequency - Tones

Frequency - Complex Sounds

Page 8: Acoustic Continua and Phonetic Categories Frequency - Tones

Frequency - Vowels

• Vowels combine acoustic energy at a number of different frequencies

• Different vowels ([a], [i], [u] etc.) contain acoustic energy at different frequencies

• Listeners must perform a ‘frequency analysis’ of vowels in order to identify them(Fourier Analysis)

Page 9: Acoustic Continua and Phonetic Categories Frequency - Tones

Frequency - Male Vowels

Page 10: Acoustic Continua and Phonetic Categories Frequency - Tones

Frequency - Male Vowels

Page 11: Acoustic Continua and Phonetic Categories Frequency - Tones

Frequency - Female Vowels

Page 12: Acoustic Continua and Phonetic Categories Frequency - Tones

Frequency - Female Vowels

Page 13: Acoustic Continua and Phonetic Categories Frequency - Tones

Synthesized Speech

•Allows for precise control of sounds•Valuable tool for investigating perception

Page 14: Acoustic Continua and Phonetic Categories Frequency - Tones

Timing - Voicing

Page 15: Acoustic Continua and Phonetic Categories Frequency - Tones

Voice Onset Time (VOT)

60 msec

Page 16: Acoustic Continua and Phonetic Categories Frequency - Tones

English VOT production

• Not uniform

• 2 categories

Page 17: Acoustic Continua and Phonetic Categories Frequency - Tones

Perceiving VOT

‘Categorical Perception’

Page 18: Acoustic Continua and Phonetic Categories Frequency - Tones

Discrimination

Same/Different

Page 19: Acoustic Continua and Phonetic Categories Frequency - Tones

Discrimination

Same/Different0ms 60ms

Page 20: Acoustic Continua and Phonetic Categories Frequency - Tones

Discrimination

Same/Different0ms 60ms

Same/Different

Page 21: Acoustic Continua and Phonetic Categories Frequency - Tones

Discrimination

Same/Different0ms 60ms

Same/Different0ms 10ms

Page 22: Acoustic Continua and Phonetic Categories Frequency - Tones

Discrimination

Same/Different0ms 60ms

Same/Different0ms 10ms

Same/Different

Page 23: Acoustic Continua and Phonetic Categories Frequency - Tones

Discrimination

Same/Different0ms 60ms

Same/Different0ms 10ms

Same/Different40ms 40ms

Page 24: Acoustic Continua and Phonetic Categories Frequency - Tones

Discrimination

Same/Different0ms 60ms

Same/Different0ms 10ms

Same/Different40ms 40ms

Why is this pair difficult?

Page 25: Acoustic Continua and Phonetic Categories Frequency - Tones

Discrimination

Same/Different0ms 60ms

Same/Different0ms 10ms

Same/Different40ms 40ms

Why is this pair difficult?

(i) Acoustically similar?

(ii) Same Category?

Page 26: Acoustic Continua and Phonetic Categories Frequency - Tones

Discrimination

Same/Different0ms 60ms

Same/Different0ms 10ms

Same/Different40ms 40ms

Why is this pair difficult?

(i) Acoustically similar?

(ii) Same Category?

A More Systematic Test

Page 27: Acoustic Continua and Phonetic Categories Frequency - Tones

Discrimination

Same/Different0ms 60ms

Same/Different0ms 10ms

Same/Different40ms 40ms

A More Systematic Test

0ms

20ms

40ms

20ms

40ms

60ms

Page 28: Acoustic Continua and Phonetic Categories Frequency - Tones

Discrimination

Same/Different0ms 60ms

Same/Different0ms 10ms

Same/Different40ms 40ms

A More Systematic Test

0ms

20ms

40ms

20ms

40ms

60ms

D T

D

T T

D

Within-Category Discrimination is Hard

Page 29: Acoustic Continua and Phonetic Categories Frequency - Tones

Cross-language Differences

R L

Page 30: Acoustic Continua and Phonetic Categories Frequency - Tones

Cross-language Differences

R L

R L

Page 31: Acoustic Continua and Phonetic Categories Frequency - Tones

Cross-Language Differences

English vs. Japanese R-L

Page 32: Acoustic Continua and Phonetic Categories Frequency - Tones

Cross-Language Differences

English vs. Hindi

alveolar [d]

retroflex [D] ?

Page 33: Acoustic Continua and Phonetic Categories Frequency - Tones

Russian-40ms

-30ms

-20ms

-10ms

0ms

10ms

Page 34: Acoustic Continua and Phonetic Categories Frequency - Tones

Development of Speech Perception3 Classics

Page 35: Acoustic Continua and Phonetic Categories Frequency - Tones

Development of Speech Perception

• Unusually well described in past 30 years

• Learning theories exist, and can be tested…

• Jakobson’s suggestion: children add feature contrasts to their phonological inventory during development

Roman Jakobson, 1896-1982Kindersprache, Aphasie und allgemeine Lautgesetze,

1941

Page 36: Acoustic Continua and Phonetic Categories Frequency - Tones

Developmental Differentiation

0 months 6 months 12 months 18 months

UniversalPhonetics

Native Lg.Phonetics

Native Lg.Phonology

Page 37: Acoustic Continua and Phonetic Categories Frequency - Tones

#1 - Infant Categorical Perception

Eimas, Siqueland, Jusczyk & Vigorito, 1971

Page 38: Acoustic Continua and Phonetic Categories Frequency - Tones

Discrimination

Same/Different0ms 60ms

Same/Different0ms 10ms

Same/Different40ms 40ms

A More Systematic Test

0ms

20ms

40ms

20ms

40ms

60ms

D T

D

T T

D

Within-Category Discrimination is Hard

Page 39: Acoustic Continua and Phonetic Categories Frequency - Tones

English VOT Perception

To Test 2-month olds

Not so easy!

High Amplitude Sucking

Eimas et al. 1971

Page 40: Acoustic Continua and Phonetic Categories Frequency - Tones

General Infant Abilities

• Infants’ show Categorical Perception of speech sounds - at 2 months and earlier

• Discriminate a wide range of speech contrasts (voicing, place, manner, etc.)

• Discriminate Non-Native speech contrastse.g., Japanese babies discriminate r-le.g., Canadian babies discriminate d-D

Page 41: Acoustic Continua and Phonetic Categories Frequency - Tones

Universal Listeners

• Infants may be able to discriminate all speech contrasts from the languages of the world!

Page 42: Acoustic Continua and Phonetic Categories Frequency - Tones

How can they do this?

• Innate speech-processing capacity?

• General properties of auditory system?

Page 43: Acoustic Continua and Phonetic Categories Frequency - Tones

What About Non-Humans?

• Chinchillas show categorical perception of voicing contrasts!

Page 44: Acoustic Continua and Phonetic Categories Frequency - Tones

#2 - Becoming a Native Listener

Werker & Tees, 1984

Page 45: Acoustic Continua and Phonetic Categories Frequency - Tones

When does Change Occur?

• About 10 months

Janet Werker

U. of British ColumbiaConditioned Headturn Procedure

Page 46: Acoustic Continua and Phonetic Categories Frequency - Tones

When does Change Occur?

• Hindi and Salishcontrasts testedon English kids

Janet Werker

U. of British ColumbiaConditioned Headturn Procedure

Page 47: Acoustic Continua and Phonetic Categories Frequency - Tones

What do Werker’s results show?

• Is this the beginning of efficient memory representations (phonological categories)?

• Are the infants learning words?

• Or something else?

Page 48: Acoustic Continua and Phonetic Categories Frequency - Tones

#3 - What, no minimal pairs?

Stager & Werker, 1997

Page 49: Acoustic Continua and Phonetic Categories Frequency - Tones

A Learning Theory…

• How do we find out the contrastive phonemes of a language?

• Minimal Pairs

Page 50: Acoustic Continua and Phonetic Categories Frequency - Tones
Page 51: Acoustic Continua and Phonetic Categories Frequency - Tones

Word Learning

• Stager &Werker 1997

‘bih’ vs. ‘dih’and‘lif’ vs. ‘neem’

Page 52: Acoustic Continua and Phonetic Categories Frequency - Tones

Word learning results

• Exp 2 vs 4

Page 53: Acoustic Continua and Phonetic Categories Frequency - Tones

Why Yearlings Fail on Minimal Pairs

• They fail specifically when the task requires word-learning

• They do know the sounds

• But they fail to use the detail needed for minimal pairs to store words in memory

• !!??

Page 54: Acoustic Continua and Phonetic Categories Frequency - Tones

One-Year Olds Again

• One-year olds know the surface sound patterns of the language

• One-year olds do not yet know which sounds are used contrastively in the language…

• …and which sounds simply reflect allophonic variation

• One-year olds need to learn contrasts

Page 55: Acoustic Continua and Phonetic Categories Frequency - Tones

Maybe not so bad after all...

• Children learn the feature contrasts of their language

• Children may learn gradually, adding features over the course of development

• Phonetic knowledge does not entailphonological knowledge

Roman Jakobson, 1896-1982

Page 56: Acoustic Continua and Phonetic Categories Frequency - Tones

Connecting Hearing & Speaking

Page 57: Acoustic Continua and Phonetic Categories Frequency - Tones

Connecting Hearing & Speaking

Auditory [ba] + Visual [ga] = Perceptual [da]

McGurk Effect

Page 58: Acoustic Continua and Phonetic Categories Frequency - Tones

Connecting Hearing & Speaking

Auditory [ba] + Visual [ga] = Perceptual [da]

Page 59: Acoustic Continua and Phonetic Categories Frequency - Tones

Evidence for connection

• Infants know connection between visual and auditory speech stimuli

• Mix and match[a] vs. [i]

Page 60: Acoustic Continua and Phonetic Categories Frequency - Tones

Questions about Development

Page 61: Acoustic Continua and Phonetic Categories Frequency - Tones

6-12 Months: What Changes?

Page 62: Acoustic Continua and Phonetic Categories Frequency - Tones

Structure Changing

Patricia KuhlU. of Washington

Page 63: Acoustic Continua and Phonetic Categories Frequency - Tones

Structure Adding

• Evidence for Structure Adding(i) Some discrimination retained when sounds presented close together (e.g. Hindi d-D contrast)(ii) Discrimination abilities better when people hear sounds as non-speech(iii) Adults do better than 1-year olds on some sound contrasts

• Evidence for Structure Changing(i) No evidence of preserved non-native category boundaries in vowel perception

Page 64: Acoustic Continua and Phonetic Categories Frequency - Tones

Sources of Evidence

• Structure-changing: mostly from vowels

• Structure-adding: mostly from consonants

• Conjecture: structure-adding is correct in domains where there are natural articulatory (or acoustic) boundaries

Page 65: Acoustic Continua and Phonetic Categories Frequency - Tones

So how do infants learn…?

• Surface phonetic patterns

Page 66: Acoustic Continua and Phonetic Categories Frequency - Tones
Page 67: Acoustic Continua and Phonetic Categories Frequency - Tones
Page 68: Acoustic Continua and Phonetic Categories Frequency - Tones

So how do infants learn…?

• Phoneme categories and alternations

– Perhaps more like a phonologist than like a LING101 student - look directly for systematic relations among phones

– Gradual articulation of contrastive information encoded in lexical entries

– Much remains to be understood

Page 69: Acoustic Continua and Phonetic Categories Frequency - Tones

Learning Sound Patterns

• Phonological learning problem– 1 year olds know distribution of surface categories– They behave as if they know conditioned allophones because the

critical tests involve phonotactic violations– The challenge is to learn relations among surface patterns - implies

some notion of phonological similarity, e.g. t-th are related, or evidence of morphophonological alternations

– Challenge: similarity space is not straightforward, e.g., flap is an allophone of /d,t/ in English, but of /r-l/ in Korean.

– Surface patterns can be learned without knowing meanings, i.e. without a lexicon; meanings shouldn’t be necessary even for learning conditioned allophony

• So what is the connection between lexical learning and phonological encoding?

Page 70: Acoustic Continua and Phonetic Categories Frequency - Tones

Learning the Lexicon

• Developmental change in lexical encoding– Prior to ‘vocabulary spurt’ (~50 words), lexical encoding is slow and labored -

fine detail only evident in highly familiar words

– Later, detailed lexical encoding can be handled much more efficiently

• Is this related to the learning of a phonological system?– Early difficulties in encoding could be attributed to the lack of an appropriate

phonological ‘alphabet’ for the native language

– But how can this be reconciled with the surface knowledge of sound patterns in 12-month olds?

• Do children gradually develop more efficient lexical representations as they accrue knowledge of what is predictable?

Page 71: Acoustic Continua and Phonetic Categories Frequency - Tones