slides - by iit kanpur and col
TRANSCRIPT
Speech Technology in Mobile Phones
Part II : Voice based Agriculture Information Systems
Rajesh M. [email protected]
Associate Professor Dept. of EE
Indian Institute of Technology Kanpur
Several pictures used in this presentation have been collected from various sources available on the web and have been acknowledged in the slides.
Topics Covered
• A personalized voice based service on mobile phones in several Indian Languages : Digital Mandi for the Indian Kisan
• A Hindi speech recognition based system on the mobile phone for accessing agro-commodity prices for the Farmer.
Value Added Services (VAS)in the Agriculture Sector in India
• Computing is becoming human centered, and multi modal
• Information is available in various sources and various forms
• Personalized or Service based Information delivery systems are order of the day
• Important in Indian Context with huge population and cheap access to cell phone services
• Agricultural Information systems assume great significance
Network
PSTN
SMS Gateway
Web/Database Server
Asterisk Server
The use of Images, Video, Text, Audio, Voice and Natural dialogue will help use seemingly sophisticated technology in simple and efficient ways to provide information to the Indian Kisan
Multi modal Personalized VAS
Cell Phone based Agriculture Information Systems Digital Mandi for the Indian Kisan
Source : Digital Mandi for the Indian Kisan
Architecture
•Supports Multi modal Query and Retrieval
Digital Mandi for the Indian Kisan
Digital Mandi : Stake Holders
Digital Mandi for the Indian Kisan
• Cell phone based service for the Indian farmer.
• Provides easy access to the prices of desired crops in the mandis in which a farmer is interested.
• The service can run on low-end, GPRS enabled cell phones.
• Can be accessed in more than one way, the simplest being a one time registration process.
• The one time registration can be done directly from the phone.
Digital Mandi for the Indian Kisan
• A farmer can choose to listen or/and read the price. Both will be delivered in his/her native language.
• A farmer can also choose the frequency with which the prices be delivered to his/her phone.
• The registration process is made simpler by using features like auto-state detection.
• The service can be accessed even without registration.
• 15000 Farmers in Haryana and 23000 Farmers in Odisha currently using the System.
System Deployment Overview
•For both Savvy And the Common Farmer
FARMER REGISTRATION AT APMC /
VIA MOBILE PHONE
SMS and Voice calls directly placed to
The Farmers MobilePhone
Access via GPRS PHONE
REGISTRATION - HINDI
FARMER PROFILE
Version for Hindi Users
•Fusion of multi modal methods with Farmer Registration Profile in Hindi Version
GPRS MODE
•Fusion of multi modal methods with Farmer Registration Profile in English Version
GPRS MODE
Version for English Users
Sample SMS and Voice Call in Hindi
SMS/Voice Call Mode
SMS/Voice Call Mode Sample SMS and Voice Call in Odiya
Live Demo of Digital Mandi GPRS version
• Switch to Cell phone Screen at this pointAvailable at
http://digitalmandi.iitk.ac.in
Speech Recognition Based Access of Agrocommodity Prices in Hindi for Uttar Pradesh
Sponsored by DieTY Govt. Of India
Asterisk PBX(PC Debian GNU/Linux)
Database Server(PC Debian GNU/Linux)
SMS Gateway
Get PNR Status via SMS and Voice Call
Get Mandi Price and Store Call information
Make a call and follow instructions
Getting data from agmarknet.nic.in
AgmarknetWeb Server(PC Debian GNU/Linux)
Speech Based Access of Agrocommodity Prices in Hindi Sponsored by TDIL, DieTY Govt. Of India
System Call Flow1. Dial the tel no. +512-391-5353. Welcome message will play.
2. Prompt for district name.
3. Speak district name from the list.
4. Prompt for haan ya nahin.
5. Speak haan if recognized or nahin if failed. In case you say nahin you will be asked to repeat the district name. Ifyou say haan, then you will be asked to speak the commodity name.
6. Prompt for commodity name.
7. Speak commodity name from the list.
8. Speak haan if recognized or nahin if failed. In case you say nahin you will be asked to repeat the commodity name.
9. If you say haan, then the price of commodity will be played out.
10. Prompt for repeat the process. If you want to try the system again say haan else say nahin.
11. If you say haan you can try the overall system again.
12. If you say nahin the system will hangup after thank you prompt.
Live Demo
• Switch to Cell Phone Screen Now • Dial +91-512-391-5353/
+91-512-671-1453
