computer-assisted pronunciation teaching - grupo de...
TRANSCRIPT
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Computer-assisted pronunciationteaching
Joaquim LlisterriUniversitat Autònoma de Barcelona
http://liceu.uab.cat/~joaquim
Informatique et enseignement-apprentissage des langues(Information, recherche et applications didactiques)
Stage de Formation à la Méthode Verbo-Tonale
13 July 2016
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
1 Computer-assisted pronunciation teaching
2 Speech recognition in CAPT systems
3 CAPT and the verbo-tonal approach
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
1 Computer-assisted pronunciation teaching
2 Speech recognition in CAPT systems
3 CAPT and the verbo-tonal approach
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
1 Computer-assisted pronunciation teachingArticulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
Articulatory approaches
Explicit description of the position of the articulators inthe production of a speech sound
May involve the use of anatomical metalanguage
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
Articulatory approaches
English Pronunciation. (2016).Hanoi: KEPHAM.
https://play.google.com/store/apps/details?id=com.study.english.pronunciation
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
Articulatory approaches
Pronunciation Power. (2014).Edmonton: English
Computerized Learning Inc.
https://play.google.com/store/apps/details?id=com.englishlearning.propower
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
Articulatory approaches
Imply a “mental mapping” between the image and thestudent’s articulators
Require good proprioceptive abilities
H Coarticulatory phenomena are neglected
H Articulatory compensation is neglected
H Assumption that the inability to articulate a sound is thesource of error
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
1 Computer-assisted pronunciation teachingArticulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
“Listen”
Pronunciation Power. (2014).Edmonton: English
Computerized Learning Inc.
https://play.google.com/store/apps/details?id=com.englishlearning.propower
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
“Listen”
Pronunciation Power. (2014).Edmonton: English
Computerized Learning Inc.
https://play.google.com/store/apps/details?id=com.englishlearning.propower
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
“Listen”
Nanu, I. (2015). JoJaParlo.Barcelona: Emphasis:
Integrated Language andCommunication Services.
https://itunes.apple.com/es/app/
jojaparlo/id953424917
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
“Listen”
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
1 Computer-assisted pronunciation teachingArticulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
“Listen and repeat”
Presentation of auditory stimuli (with or without theorthographic representation) to be repeated by thestudent
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
“Listen and repeat”
Learn Spanish with Babbel.(2015). Berlin: Babbel.
https://play.google.com/store/apps/details?id=com.babbel.mobile.android.es
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
“Listen” and “Listen and repeat”
H Stimuli often associated with spelling
H Isolated words
H The “phonological filter”
H Lack of feedback
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
1 Computer-assisted pronunciation teachingArticulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
“Listen and repeat” with feedback or scores
Presentation of auditory stimuli as native models to berepeated by the student
The student records his own pronunciation and receivesa prompt or a score based on the similarity between thenative and the non native productions
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
“Listen and repeat” with feedback
Spanish skills. (2016). Duolinguo. Pittsburgh PA: Duolinguohttps://www.duolingo.com/
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
“Listen and repeat” with feedback
Spanish skills. (2016). Duolinguo. Pittsburgh PA: Duolinguohttps://www.duolingo.com/
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
“Listen and repeat” with feedback
Spanish skills. (2016). Duolinguo. Pittsburgh PA: Duolinguohttps://www.duolingo.com/
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
“Listen and repeat” with feedback
Spanish skills. (2016). Duolinguo. Pittsburgh PA: Duolinguohttps://www.duolingo.com/
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
“Listen and repeat” with feedback
Spanish skills. (2016). Duolinguo. Pittsburgh PA: Duolinguohttps://www.duolingo.com/
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
“Listen and repeat” with scores
Italian Pronunciation: Listenand Repeat. (2012). GigiApps.
https://itunes.apple.com/us/app/italian-pronunciation-listen/
id497167931?mt=8
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
“Listen and repeat” with scores
Italian Pronunciation: Listenand Repeat. (2012). GigiApps.
https://itunes.apple.com/us/app/italian-pronunciation-listen/
id497167931?mt=8
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
“Listen and repeat” with scores
Tell Me More Spanish, Rosetta Stone.http://www.rosettastone.com
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Articulatory approaches“Listen”“Listen and repeat”“Listen and repeat” with feedback
“Listen and repeat” with feedback or scores
How effective is feedback based on prompts or scores?
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
1 Computer-assisted pronunciation teaching
2 Speech recognition in CAPT systems
3 CAPT and the verbo-tonal approach
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
A typical speech recognition system
Overview of a typical speech recognition system. (2010). Interactive Speech.http://interactive-speech.com/2010/01/26/
overview-of-a-typical-speech-recognition-system/
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Speech recognition in a CAPT system
Training withnon-native speech
ç Specific training foreach L2
ç Need for annotatedcorpora
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
An annotated corpus of L2 Spanish
Carranza, M. (2013). Intermediate phonetic realizations in a Japanese accented L2 Spanishcorpus. In SLaTE 2013. Speech and language technology in education. Grenoble, France.
August 30-31 & September 1st, 2013.https://uab.academia.edu/MarioCarranza
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Speech recognition in a CAPT system
The problem of the alignment between the actual andthe expected pronunciation
ç Typology of errors specific for each L2SubstitutionInsertionDeletion
ç Alignment rules specific for each L2
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
Speech recognition in a CAPT system
The problem ofvariability: morethan onepronunciationmight beacceptable for anative speaker
ç Thresholds ofacceptance
http://slideplayer.com/slide/1581510/
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
1 Computer-assisted pronunciation teaching
2 Speech recognition in CAPT systems
3 CAPT and the verbo-tonal approach
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
CAPT and the verbo-tonal approach
Billières, M. (20 avril 2016). « Technè »verbo-tonale et nouvelles technologiesinformatiques : deux approches compatibles ?Au son du fle. Toulouse.http://www.verbotonale-phonetique.com
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
CAPT and the verbo-tonal approach
“Or, ces mêmes critiques, formulées il y a plus de troisdécennies, s’adressent tout autant à l’EAO, dans la mesure où,sous le couvert d’un habillage informatif attractif, celui-civéhicule des pratiques et des contenus qui sont restés, audemeurant, fort traditionnels et peu innovants sur le planméthodologique”.
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
CAPT and the verbo-tonal approach
“Nous pensons aux aides informatiques visuelles pourl’enseignement de la prononciation telles que la visualisationde la configuration articulatoire à partir de diagrammesanimés, pour illustrer les mouvements des organesphonatoires ( qui se situe aux antipodes d’un travail derestructuration de la perception auditive), la visualisation descaractéristiques acoustiques des éléments segmentaux àl’aide de spectrogrammes ou d’oscillogrammes, lareprésentation visuelle des courbes mélodiques naturelles oustylisées, procédé intellectuel qui est à la correction de lamélodie ce que la méthode articulatoire est à la correctiondes sons et dont l’efficacité nous paraît pour le moinscontestable”.
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
CAPT and the verbo-tonal approach
“Les développements des outils informatiques peuvent ouvrirdes perspectives nouvelles à l’apprentissage de laprononciation, mais il serait regrettable de sacrifier laméthodologie des enseignants sur l’autel des technologiesnouvelles et de minimiser l’importance de la formation desmaîtres. Le risque est grand, en effet, que les enseignants nese retranchent derrière les NTICE pour s’exonérer d’unevéritable qualification professionnelle qui leur assure unetotale autonomie et les affranchisse de ce qui pourrait biendevenir une prothèse pédagogique”.
Joaquim Llisterri Computer-assisted pronunciation teaching
Computer-assisted pronunciation teachingSpeech recognition in CAPT systemsCAPT and the verbo-tonal approach
CAPT and the verbo-tonal approach
Billières, M. (20 avril 2016). « Technè »verbo-tonale et nouvelles technologiesinformatiques : deux approches compatibles ?Au son du fle. Toulouse.http://www.verbotonale-phonetique.com
Joaquim Llisterri Computer-assisted pronunciation teaching