effects of phoneme characteristics on teo feature-based automatic stress detection in speech
TRANSCRIPT
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
1/22
Efects o PhonemeCharacteristics on TEO Feature-Based Automatic Stress
Detection in SpeechBY –
VE!ATES" S"A#A D$%&
#AC"'T (AC"A)*A# D$+%
#,S"AB" BA#B"AYA D$+
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
2/22
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
3/22
Continued
#e/ia7/e speech processin4 not possi7/e 8compounded 7. the 1ariouscharacteristics o the speech samp/es used in reco4nition scheme
Vo3e/s used as to5en in such reco4nition s.stems
)DC9)in4uistics Data Consortium: phonemes 0
Consists ;$ diferent t.pes o 1o3e/s each ha1in4 diferent 4enera/characteristics
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
4/22
The Scheme
Since the duration8 scope and 7readth o detecta7/e t.pes o thespo5en 1o3e/s 1ar.6
These 1ariations can de4rade stress detection perormance
'n addition to this phoneme durations can 1ar. dependin4 upon thet.pe o speech 9'so/ated 3ord8 Spontaneous8 #ead:
"ence to ana/.The ans3er to that =uestion is ?no@
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
5/22
Cont.
eutra/ to Stress conditions 0
The mean heart rate increased 7. %6;
S.sto/ic 7/ood pressure increased 7. %%6$8
Diasto/ic 7/ood pressure increased 7. ;;6
*e decide the condition 9i6e6 stressed or not stressed:8 o the spea5er7. emp/o.in4 a 3ei4hted maorit. decision ru/e
This ru/e is 7ased upon the decisions o each 1o3e/ 3ithin the sentence The decisions are 3ei4hted 7. the a7so/ute diference 7et3een t3o"idden (ar5o1 (ode/ 9"((: scores6
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
6/22
Teager Energy Operator
(ost approaches to speech mode/in4 ha1e ta5en a /inear p/ane 3a1epoint-o-1ie36
Tea4er did etensi1e research on the non-/inear speech mode//in4
This 3as done 7. de1isin4 a simp/e non-/inear ener4. trac5in4 operato
The operator mode/s the airGo3 throu4h the 1oca/ tract8 sho3n ordiscrete-time si4na/s as o//o3s0
*here is the Tea4er Ener4. Operator 9TEO:
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
7/22
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
8/22
The Tea4er Ener4. Operator8 Critica/ Band8 Autocorre/ation En1e/ope9TEO-CB-Auto-En1: parameteri
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
9/22
The TEO-CB-Auto-En1 eature used in this stud. is etracted throu4h aprocess sho3n in the Go3 dia4ram and i//ustrated mathematica//. usin4critica/ 7andpass I/ters 9BPF: as
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
10/22
Study addresses two issues
Efecti1e stress c/assiIcation is possi7/e usin4 1oiced speech data rom1o3e/s 3ith the TEO-CB-AutoEn1 3here critica/ 7ands are 3ei4hted7ased on neutra/Jstress detection perormance rom a de1e/opment tesset6
Since the TEO-CB-AutoEn1 emp/o.s an autocorre/ation en1e/ope
ana/.sis on the input speech8 it shou/d 7e /ess sensiti1e to phonemespectra/ diferences in stress detection than spectra/ eatures such as(FCCs
Further ana/.sis done on/. on one phoneme JO*J
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
11/22
Etraction and Processin4
&5"< Di4ita/ data rom SO(
;; samp/es
"idden (ar5o1 (ode/ 9"((: used or etraction
(anua/ processin4 – ront and 7ac5 end
Croppin4 and remo1in4 JJ rom >no
(anua//. chec5in4 or JO*J
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
12/22
PDF o JO*J to5en
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
13/22
Truncation
The samp/es o K$$ are truncated to &$8 +$8 $ and ;$
TEO is etracted rame 7. rame6
Output o TEO is e=ua//. truncated6
Band 3ei4hin4 scheme is not used in this test6
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
14/22
Testin4
K$$ 1o3e/s 3hich 3ere used to train in "(( are used in round ro7intestin46
o + 1o3e/s to5en rom a// users are ta5en and used to train "((mode/s
eutra/ to5en in eutra/ and Stress trained "((s@
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
15/22
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
16/22
Error #eduction
K$$ samp/e rame
$ duration – %;J;K+ didnLt ha1e enou4h inormation6
;$ duration – K$J;K+
; samp/e rame
$ duration – A// to5ens made throu4h ;$ duration – K+J;K+ didnMt ha1e enou4h inormation
On/. N6 samp/es 3erenLt used
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
17/22
Efect on diferent 1o3e/s
'so/ate the 1o3e/
$ms duration
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
18/22
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
19/22
o1e/ scheme or impro1in4 stressdetection across 1o3e/ t.pes 3ithdecreased durations
Ep/oitation o mu/tip/e 1o3e/ t.pes per spea5er utterance is seen anda c/assiIcation is made upon a maorit. ru/e o1er indi1idua/ decisionson each 1o3e/6
The 7/oc5 dia4ram or the a7o1e procedure is sho3n in the net s/ide6
The test resu/ts usin4 the "(( trainin4 scheme emp/o.ed in the
pre1ious section8 3ith an o1era// decision 7ased on the composite3ei4hted maorit. decision ru/e scheme resu/ts in si4niIcantperormance 4ains6
The ta7/e or the a1era4e error rate is sho3n ahead6
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
20/22
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
21/22
Conc/usion
'n this paper8 the efects o phoneme duration and t.pe on automatic Tea4er Ener4.Operator eature-7ased stress detection perormance is seen6
't 3as sho3n that 7oth phoneme duration and t.pe mismatch afect the stress detectionperormance6
'n the case o 1o3e/ duration8 shortenin4 the 1o3e/ duration 3as sho3n to ad1erse/.afect stress detection perormance i the 1o3e/ duration is /ess than a thresho/d o a7out
$ o the ori4ina/ duration in the case o the 1o3e/ JO*J8 or at a7out &-K;& ms6 *hen a spea5er@s utterance contains mu/tip/e 1o3e/ t.pes8 usin4 a composite decision
process 7. app/.in4 a 3ei4hted maorit. decision ru/e to the indi1idua/ decisions 3ithe=ua/ 9i6e6 7ase/ine: 7and-3ei4htin4 pro1ides re/ati1e error rate reductions o ; and% in the neutra/ and stress conditions8 respecti1e/.6
The Ina/ composite stress detection scheme achie1es o1era// a1era4e error rates oapproimate/. ;N or neutra/Jstress detection8 3here the 1o3e/ durations are $ ms6
-
8/17/2019 Effects of Phoneme Characteristics on TEO Feature-Based Automatic Stress Detection in Speech
22/22
The error rates presented ma. 7e urther impro1ed 7.emp/o.in4 a sot decision ru/e a/4orithm8 7ased upon a criteriaassociated 3ith the characteristics o speciIc 1o3e/s8 such as3ei4htin4 decisions made on /on4er duration 1o3e/s morehea1i/. than those rom shorter duration 1o3e/s