![Page 1: Automatic Generation of Karaoke-Game Stage Presentation at NSC](https://reader035.vdocument.in/reader035/viewer/2022062618/54d9ad294a795959628b45f5/html5/thumbnails/1.jpg)
Automatic Generation of Karaoke-Game Stages from Audio Files
Natthawut KulnirundornProfessor Boonserm Kijsirikul
Department of Computer EngineeringChulalongkorn University
1/9/2009
1
![Page 2: Automatic Generation of Karaoke-Game Stage Presentation at NSC](https://reader035.vdocument.in/reader035/viewer/2022062618/54d9ad294a795959628b45f5/html5/thumbnails/2.jpg)
Project Background• Karaoke Game
▫ User try to sing at correct pitch for each note
▫ Can analyze how well you sing
• People enjoy playing karaoke game
▫ Existing commercial products: SingStar, Rockband
1/9/2009
2
![Page 3: Automatic Generation of Karaoke-Game Stage Presentation at NSC](https://reader035.vdocument.in/reader035/viewer/2022062618/54d9ad294a795959628b45f5/html5/thumbnails/3.jpg)
How to play karaoke game?
54100
1/9/2009
3
![Page 4: Automatic Generation of Karaoke-Game Stage Presentation at NSC](https://reader035.vdocument.in/reader035/viewer/2022062618/54d9ad294a795959628b45f5/html5/thumbnails/4.jpg)
Problems with current karaoke games• Limited number of stages
▫ Usually pre-packed with game
▫ Cannot add new song
• Available on limited platforms▫ Singstar on PS3▫ Rockband on XBOX360
Need to buy new game to play more songs!
1/9/2009
4
![Page 5: Automatic Generation of Karaoke-Game Stage Presentation at NSC](https://reader035.vdocument.in/reader035/viewer/2022062618/54d9ad294a795959628b45f5/html5/thumbnails/5.jpg)
Proposed Solution
1/9/2009
5
![Page 6: Automatic Generation of Karaoke-Game Stage Presentation at NSC](https://reader035.vdocument.in/reader035/viewer/2022062618/54d9ad294a795959628b45f5/html5/thumbnails/6.jpg)
Project Objectives
1/9/2009
6
![Page 7: Automatic Generation of Karaoke-Game Stage Presentation at NSC](https://reader035.vdocument.in/reader035/viewer/2022062618/54d9ad294a795959628b45f5/html5/thumbnails/7.jpg)
Vocal Pitch Detection in Polyphonic Audio• Still an open research
problem
• Cannot simply apply the same algorithms as pitch detection in single source
▫ Autocorrelation
▫ Harmonic Product Spectrum (HPS)
• Current approaches based on many different techniques
▫ Machine Learning
▫ Independent Component Analysis (ICA)
Detected frequency from HPS
Freq. from Human voice highlighted in red
1/9/2009
7
timefreq
![Page 8: Automatic Generation of Karaoke-Game Stage Presentation at NSC](https://reader035.vdocument.in/reader035/viewer/2022062618/54d9ad294a795959628b45f5/html5/thumbnails/8.jpg)
Demonstration – Stage Generation
1/9/2009
8
![Page 9: Automatic Generation of Karaoke-Game Stage Presentation at NSC](https://reader035.vdocument.in/reader035/viewer/2022062618/54d9ad294a795959628b45f5/html5/thumbnails/9.jpg)
Demonstration – Karaoke Game
1/9/2009
9
![Page 10: Automatic Generation of Karaoke-Game Stage Presentation at NSC](https://reader035.vdocument.in/reader035/viewer/2022062618/54d9ad294a795959628b45f5/html5/thumbnails/10.jpg)
Method Proposed
1/9/2009
10
![Page 11: Automatic Generation of Karaoke-Game Stage Presentation at NSC](https://reader035.vdocument.in/reader035/viewer/2022062618/54d9ad294a795959628b45f5/html5/thumbnails/11.jpg)
Spectrum Subtraction
1/9/2009
11
normal
voice-removed
result
time
freq
*Human singing frequency
![Page 12: Automatic Generation of Karaoke-Game Stage Presentation at NSC](https://reader035.vdocument.in/reader035/viewer/2022062618/54d9ad294a795959628b45f5/html5/thumbnails/12.jpg)
Conclusion
•Enable users to sing a song in native languages.
•The method proposed is easy to implement and can be applied to classes of application
•The prototypes can be developed further to be an entertainment application
1/9/2009
12
![Page 13: Automatic Generation of Karaoke-Game Stage Presentation at NSC](https://reader035.vdocument.in/reader035/viewer/2022062618/54d9ad294a795959628b45f5/html5/thumbnails/13.jpg)
Questions ?
1/9/2009
13
![Page 14: Automatic Generation of Karaoke-Game Stage Presentation at NSC](https://reader035.vdocument.in/reader035/viewer/2022062618/54d9ad294a795959628b45f5/html5/thumbnails/14.jpg)
References
1/9/2009
14
![Page 15: Automatic Generation of Karaoke-Game Stage Presentation at NSC](https://reader035.vdocument.in/reader035/viewer/2022062618/54d9ad294a795959628b45f5/html5/thumbnails/15.jpg)
Appendix1/9/2009
15
![Page 16: Automatic Generation of Karaoke-Game Stage Presentation at NSC](https://reader035.vdocument.in/reader035/viewer/2022062618/54d9ad294a795959628b45f5/html5/thumbnails/16.jpg)
Autocorrelation
1/9/2009
16
![Page 17: Automatic Generation of Karaoke-Game Stage Presentation at NSC](https://reader035.vdocument.in/reader035/viewer/2022062618/54d9ad294a795959628b45f5/html5/thumbnails/17.jpg)
Harmonic Product Spectrum
1/9/2009
17