Slide 1

1 of 39 World Computer Congress 2013-International Conference for Artificial Intelligence (ICAI2013) Arnel C. Fajardo and Yoon-Joong Kim, Ph.D Hanbat National University, Korea DEVELOPMENT OF FILIPINO PHONETICALLY-BALANCED WORDS AND TEST USING HIDDEN MARKOV MODEL

Slide 2

2 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Introduction Objectives: 1. To present the development of Filipino phonetically balanced words (PBW) 2. Test the recognition accuracy of the developed PBW using Hidden Markov Model.

Slide 3

3 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Related Studies In 2003, an ASR for Filipino alphabets was developed. This study reported to have achieved a recognition accuracy of 85.5%. However, this recognizer was used for phoneme utterances using discrete Hidden Markov Model (HMM) rather than continuous word recognition. Navaro, R. D., Recognition of Tagalog Alphabets Using The Hidden Markov Model

Slide 4

4 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Related Studies Dela Roca G., et.al (2003) attempted to recognize continuous speech using a developed Filipino Speech Corpus by Guevara R., et. al (2002) that reported to achieve only a 32% recognition accuracy. In 2010, an Indonesian speech corpus was incorporated for the recognizer as training sets to recognize Filipino utterances. contains 80 hours of recording v.s 4 hours of Filipino Speech corpus achieved 79.50% recognition accuracy. Note: None of these previous researches used a phonetically balanced set of words for the development of its speech corpus Sakti S., Isotani, R., Kawai H., and Nakamura, S., The Use of Indonesian Speech Corpora for Developing a Filipino Continuous Speech Recognition System, (2010). Guevara, R., Co, M., Espina, E., Gracia, I., Tan, E., Ensomo, R., and Sagum, R., Development of a Filipino speech corpus, (2002).

Slide 5

5 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM The Specifics of Filipino Language Filipino is the language used largely in the Philippines with 22 million native speakers. Consists of 20 Alphabets: 5 (a, e, I, o, u) vowels and 15 (b, k, d, g, h, l, m, n, ng, p, r, s, t, w, y) consonants Some words are spelled the same but with slight differences in pronunciation, which produces differences in meaning. bata /b:a - ta/ - a child bata /ba - ta/ - to bear or endure

Slide 6

6 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM The Filipino Phoneme System FILIPINO VOWEL SYSTEM frontcentralback upper /i/ /u/ high lower upper /e/ /o/ high lower upper /a/ high lower

Slide 7

7 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM The Filipino Phoneme System FILIPINO CONSONANT SYSTEM labialdentalalveolar palatalvelarglottal Stops voiced /p//t/ /k/ voiceless Nasals voiced /b//d/ /g/ Fricatives voiceless /n/ // Affricatives voiceless /s/ /h/ Lateral voiced /l/ Flap voiced /r/ Glide voiced /w/ /y/

Slide 8

8 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM The Filipino Phoneme System -The diphthongs /iw/ /ay/ /aw/ /oy/ /ey/ /uy/ were also included as part of the vowel phoneme list. -Phonemes such as /p:/ /b:/ /m:/ /t:/ /d:/ /n:/ /s:/ /l:/ /k:/ /g:/ were included

Slide 9

9 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Development of the Filipino Phonetically Balanced Word List WORD EXTRACTION Source 16 Articles from the Tagalog Textbook: Bagwis

Slide 10

10 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Development of the Filipino Phonetically Balanced Word List WORD EXTRACTION Source 16 Articles from the Tagalog Textbook: Bagwis 9768 Words Transcribed words

Slide 11

11 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Development of the Filipino Phonetically Balanced Word List WORD EXTRACTION Source 16 Articles from the Tagalog Textbook: Bagwis 2938 Words Unique Words

Slide 12

12 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Development of the Filipino Phonetically Balanced Word List WORD EXTRACTION Source 16 Articles from the Tagalog Textbook: Bagwis 2938 Words Unique Words Syllable CountFrequency 1 Syllable101 2 Syllable780 3 Syllable912 4 Syllable740 5 Syllable299 6 Syllable72 7 Syllable23 8 Syllable7 9 Syllable2 10 Syllable1 13 Syllable1

Slide 13

13 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Development of the Filipino Phonetically Balanced Word List WORD EXTRACTION Source 16 Articles from the Tagalog Textbook: Bagwis 2938 Words Unique Words 780 (2-Syllable Words) 912 (3-Syllable Words) Syllable Count

Slide 14

14 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Development of the Filipino Phonetically Balanced Word List 780 (2-Syllable Words) 912 (3-Syllable Words) Syllable Count

Slide 15

15 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Development of the Filipino Phonetically Balanced Word List 780 (2-Syllable Words) 912 (3-Syllable Words) Syllable Count WORD OCCURRENCE must be >1

Slide 16

16 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Development of the Filipino Phonetically Balanced Word List 780 (2-Syllable Words) 912 (3-Syllable Words) Syllable Count 323 (2-Syllable Words) 249 (3-Syllable Words) Word Occurrence

Slide 17

17 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Development of the Filipino Phonetically Balanced Word List 780 (2-Syllable Words) 912 (3-Syllable Words) Syllable Count 323 (2-Syllable Words) 249 (3-Syllable Words) Word Occurrence SYLLABIC STRUCTURE 80% of Frequency

Slide 18

18 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Development of the Filipino Phonetically Balanced Word List 780 (2-Syllable Words) 912 (3-Syllable Words) Syllable Count 323 (2-Syllable Words) 249 (3-Syllable Words) Word Occurrence 130 cv-cvc 43 v-cvc 27 cvc-cv 61 cv-cv 100 cv-cv-cvc 14 cvc-cv-cvc 11 V-cv-cvc 38 cv-cv-cv 9 cv-cv-vc 8 V-cv-cv 11 Cvc-cv-cv 15 Cv-cvc-cvc 8 Cv-cvc-cv

Slide 19

19 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Development of the Filipino Phonetically Balanced Word List 780 (2-Syllable Words) 912 (3-Syllable Words) Syllable Count 323 (2-Syllable Words) 249 (3-Syllable Words) Word Occurrence 261 (2-Syllable Words) 214 (3-Syllable Words) Syllabic Structure

Slide 20

20 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Development of the Filipino Phonetically Balanced Word List Ffrequency of phonemes represented in the word list pfwfrequency of phoneme in a word wffrequency of word occurrence ntotal number of phonemes in the word list

Slide 21

21 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Development of the Filipino Phonetically Balanced Word List

Slide 22

22 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Development of the Filipino Phonetically Balanced Word List 261 (2-Syllable Words) 214 (3-Syllable Words) Syllabic Structure Acceptance value: aV = 1 / (x*m) 2 SYLLABLE (VOWEL = 0.0023, CONSONANT = 0.0018) 3 SYLLABLE (VOWEL = 0.0015, CONSONANT = 0.0012) RESULTS F = frequency of phonemes Pfw = frequency of phonemes in a word Wf = frequency of word occurrence N = total number of phonemes

Slide 23

23 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Results Phonetically Balanced Word List Extracted Word-list: 257 2-syllable words, representing 32 phonemes 212 3-syllable words, representing 31 phonemes

Slide 24

24 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Results PBW LIST 2 Syllable PBW List abayagadakinakingakoyalamalonaminaming anakanongapatarawatinatingayawayon bagaybagobagong bahaybakabakitbanalbansabatabataybatasbatay batobawalbawatbayanbelenbesesbigatbigay biglabihisbilang bisabisigbombabuhaybukasbukidbukodbulsabunso buwandagatdahildahondakongdaladamitdapat datidatingdatu ditodiwadiyosdugongedadgabigabinggaling ganapgawagawingayagayongayonggitnagubat gurogustogutom habanghaloshaponharaphariharinghatidhawakhigit hindihiramhulihulinghuwagibatibangibig ibonikawilan ilangiloginayinanginayisangisipitoyitong iyayiyaniyoyiyoniyongkahitkalyekamay kamikaming kanyakapagkayakayatkayangkayokaysakitakulang kulaykundikuninkuyalabanlabaslabilabis

Slide 25

25 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Results PBW LIST 2 Syllable PBW List lagaylagilaging lahatlahilakaslalolalonglamanlamanglamiglangit lasalibinglihimlikodlimalimanglinggolobo luboslugarlupa lupitmagingmahalmalaymatamgamismomulamuli mulingmundonagingnamannamangnaminnasanatin ngalanngayoy ngayonngayongngunitnilanilangninaninyonitonitoy nitongniyaniyangniyonoraspagodpapelpara parangparipasko patayperaperangperopisngipisopugadpulispuno puntopusoputoritosabisagingsakasana sanaysanang sanaysanhisantasilasilaysinasinosiyasiyay siyangsumansunodtabitakbotangingtanongtapat tatlotatlo tawatawagtayngatayotayongtindatingintinigtiyak tugontuladtulaktunaytungotuwingulitunang upangutak walawalangwariwaringwikawikang

Slide 26

26 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Results PBW LIST 3 Syllable PBW List abalaagilaakalaalilaanimasanimoyanumangasawabahagi bakuran banayadbayanibihirangbinatabinigyanbituinbulaklakbulsikotbumili buwaya dahilangdakiladakilangdalangindalawadalawangdaliridalisaydaluyong damdamin damdamingdaratingdayuhangdebatedinatnandumatinggalaponggamitinganito ganitong gawaingawainggayundingayunmangilinganginawaglobalgumawahalaman halamang humingiibayoibigayihulogilaliminagawinutangkabilakabilang kahapon kakaninkalamnankanilakanilangkanlurankapatidkapilingkapilitkatulad katulong kawawakawawangkukuninkulturallalakilarawanlarawanglibanginlipunan lipunang liwanaglumabaslumikhalumipadlumitawlupainlupaingmabilangmabilis mabuhay mabutimabutingmadilimmagandamagbigaymagigingmagulangmahabangmahina

Slide 27

27 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Results PBW LIST 3 Syllable PBW List mahirap makitamakitidmalagkitmalakasmalakimalakingmalamanmalapitmalayo maliban maliitmalinawmalinismalungkotmaluwagmarahanmaramimaramingmarinig marunong masarapmatandamatandangmataposmateryalmatiyakmatulogmatutomayamang minana nabuhaynagawanagbaliknagulatnakitanamataynapagodnapansinnapulot narinig naritonariyannaroonnasaannasabinaturalnawalanilikhanobela pagdalaw pagigingpagitanpalakaspaligidpamilyapanahonpanahongpananawpangalan panlaban patuloypuhunanpumasokpuwestosabadosabungansalapisapagkatsapagkat sarilisariliysarilingsasagisimbahansinabisinisisubalitsumagot sumapit sumunodtagalogtagintingtagumpaytahanantalagangtanggihantawagintinapos tinawag trabahotumakbotumigiltumulongturistaulilangumagaumuwiunidos utusanyumaong

Slide 28

28 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Test of PBW 50 RESPONDENTS 25 Female 25 Male

Slide 29

29 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Test of PBW 50 RESPONDENTS 25 Female 25 Male } Tagalog Native Speakers Able to read and speak Has no speaking ailment At proper disposition

Slide 30

30 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Test of PBW 50 RESPONDENTS 25 Female 25 Male } Dependent SpeakersIndependent Speakers 20 Dependent Female Speakers 20 Dependent Male Speakers 5 Independent Female Speakers 5 Independent Male Speakers

Slide 31

31 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Test of PBW RECORDING SPECIFICATION Sampling Rate: 16kHz Mono Environment: Isolated Room Distance: 5-10 cm away from mouth Unidirectional Microphone

Slide 32

32 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Test of PBW SPEECH RECOGNITION Recorded Speech.wav file

Slide 33

33 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Test of PBW SPEECH RECOGNITION Hidden Markov Model Toolkit (HMM) Recorded Speech.wav file

Slide 34

34 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Test of PBW SPEECH RECOGNITION Hidden Markov Model Toolkit (HMM) MFCC Recorded Speech.wav file

Slide 35

35 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Test of PBW SPEECH RECOGNITION Hidden Markov Model Toolkit (HMM) MFCC Recorded Speech.wav file 20 Dependent Speakers (Training Data) 5 Independent Speakers (Testing Data)

Slide 36

36 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Test of PBW SPEECH RECOGNITION Hidden Markov Model Toolkit (HMM) MFCC Recorded Speech.wav file 40 Dependent Speakers (Training Data) 10 Independent Speakers (Testing Data) Results

Slide 37

37 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Results Test of Speech recognition The results from the independent speakers were less than the dependent speakers since these were not common to the training data. Dependent Speaker Independent Speaker PBW2 93.25 %88.67 % PBW3 99.53 %96.30 %

Slide 38

38 of 39 Arnel C. Fajardo & Yoon-Joong Kim, Ph.D | Hanbat National University, South Korea Development Of Filipino Phonetically-balanced Words And Test Using HMM Researchers Arnel C. Fajardo Hanbat National University, South Korea E-mail acfajardo2000@yahoo.com Yoon-Joong Kim, Ph.D. Hanbat National University, South Korea E-mail yjkim@hanbat.ac.kr

Slide 39

39 of 39 Thank you for Listening! ARNEL C. FAJARDO, YOON JOONG KIM, PH.D World Computer Congress 2013-International Conference for Artificial Intelligence (ICAI2013