proposal : the use of voice command in operating personal computer by : college of art & science...
TRANSCRIPT
PROPOSAL :The Use of Voice Command in Operating Personal Computer
By :
COLLEGE OF ART & SCIENCEUNIVERSITI UTARA MALAYSIA
STIW5023ADVANCED PROGRAMMING
Lecturer : Mazen S. H. Elsayed
Group Name : VINISKAZU
Virakwan A/P Hai Kelian (800355)Anis Eliani Binti Abd. Rahman (802329)Kamal Harmoni Kamal Ariff (801584)Mohd Fazudli Bin Saad (804213)
Group Members :
:: Abstract
• This study aims to develop an application that can execute command in operating system to allow user operate the personal computer through voice.
• It will provide a proved of concept on how user will be able to operate the personal computer using voice.
• This application will receive, analyzes, searches and matches an input voice with the set of grammar which is stored in the database and returns matching results to users.
• It is another solution for users to easy work with personal computer instead of using a graphical input device.
:: Introduction
• Application that will be developing in this study is the voice input command that use to operate the personal computer.
• According to Austin. J, (__), all communication with personal computers will someday be by voice alone. This means that keyboards will be obsolete. Therefore this study will provide a proved of concept how user able to operate the personal computer using voice.
• Java platform classes and compatible with Sphinx 4.0 will design to work in Windows and Linux operating system.
• According to (Meir and Zamir, 2007), Sphinx 4.0 able to greatly improve the speech recognition capabilities and Sphinx 4.0 platform proved very to be reliable, relatively easy to use and highly portable.
:: Problem Statement
• Users facing problem to interact with personal computer due to the inability of using hands or eyes and also handicap persons.
• New users facing problem to remember the command line that used to execute the application on personal computer.
• To provide a convenient and ability to use the personal computer, application that can execute command in operating system to allow user operate the personal computer through voice is to develop.
:: Objectives
• The aim of this study is to produce three (3) commands that able to understand by Windows and Linux operating system.
• Sub objective
• To understand and how to use Sphinx 4.0.
• To develop a Java class that can be interact with Sphinx 4.0 classes.
• To make the developed class able to convert voice command into command line.
• Main objective
:: Scope
• Java classes that able to use in Windows and Linux operating system by using Sphinx 4.0.
• Classes will be use to convert voice into command line.
• Only three (3) commands will introduce into this studies.
• The three (3) command that want personal computer execute in this studies are Run Paint, Run Calculator and List File command.
:: System Specification
:: VoiceCommand Package
// OVERVIEW : This package run the voice recognition application built using Sphinx 4.0
// Uses the Sphinx 4.0 and contains of two (2) main classes that will receive,
// analyzes, searches and matches an input voice with the set of dictionary and
// grammar.
// which is stored in the database and returns matching results to users by run and
// display the application on the personal computer screen monitor.
// REQUIRES : ConvertVoiceToText class to identify, analyze voice input and convert it //into text.
// RunCommand class to execute input and display application on the screen
// monitor.
// EFFECTS : If voice input is valid, will execute the command.
// If not valid, will wait until the valid input entered.
// Else allow user to terminate the application.
:: ConvertVoiceToText Class
// OVERVIEW : This class provides a number of procedures that are
// useful for voice recognition and convert it into text.
// REQUIRES : Valid voice input, dictionary and grammar.
// Voice input that matches with the set of dictionary and grammar
// database.
// EFFECTS : If voice input is valid, will convert it into text.
// Otherwise wait until the valid input entered or allow user to
// terminate the application.
:: RunCommand Class
// OVERVIEW : This class provides procedures for execute String
// input and display application on the screen monitor according the
// types of Operating System either Windows or Linux.
// REQUIRES : String to execute the command.
// Example command : Run Paint, to run on Windows platform.
// EFFECTS : Execute command to display on the screen based on
// types of Operating System.
:: Methodology ::
User0.0
VoiceCommand
Voice Signal
Display Application
:: Context Diagram
:: Flow Diagram
:: Use Case of the System
voice command dictionary
voice command grammar
Listen Voice
convertVoiceToText class
Analyze Voice
<<include>>
<<include>>
Match voicesphinx 4.0
Message return and display application
convert to text
<<include>>
Use Run class
:: Class Diagram of the System
Feature Execution Feature Classification
Convert voice to text
sphinx
/search and match
Recording
User
voice instruction
Voice Recognizer
/send speech record
Feature
:: Sequence Diagram
User Voice Command
Record Voice Recognizer
Feature sphinx Execution
1.Listen
2.Return Instruction
3.Record Voices
4.Analyze Voices5.Process Feature
6.Match Features
7. Convert to text
8. Message return
9. Message return
10. Message return
11. Message return
12. Proceed to next stage
13. Run Application
14.Display Text
:: Group Structure
Leader Task ResponsibilitiesVirakwan A/P Hai Kelian Tasks assignment for each members
Specify system requirements
Produce system specification
Team members Task ResponsibilitiesKamal Harmoni Bin Kamal Ariff Develop Coding
-Develop VoiceCommand class
Mohd Fazudli Bin Saad Expending acoustic model
-Dictionary class
-Grammar class
Anis Eliani Binti Abd. Rahman Develop Coding
-Develop RunCommand class
:: Conclusion
• Using the Sphinx 4.0 integrate with Java platform will able to develop the application that provide function for human to interact with personal computer via voice.
• In order to implement an application that can execute at least three (3) commands on Windows or Linux operating system, we identify two (2) main classes that will develop in this study which are ConvertVoiceToText class and RunCommand class.
• These two (2) classes proposed to identify the voice input from user and finally execute the command to run the application on the screen.
:: References
Austin. J, (__). The Computer Listens Up. Atariarchives.org. Retrieved : Mac 2, 2010, from :http://www.atariarchives.org/deli/computer_listens.php
Meir, D., & Zamir, Y. (2007). Mini Project : Saya Speech Recognition. Ben-Gurion University : Department of Computer Science.
Sphinx Technologies Inc. (2009). Sphinx. Retrieved : Mac 2, 2010,
from : http://www.sphinxsearch.com/about.html
..thank you