Web engineering meets natural language processing: a vocal interface generation practice

2006/12/11江文成

Reference

Hendrik Macedo, Jacques Robin, Roberto Barros Proceedings of the 11th Brazilian Symposium on Mult

imedia and the web WebMedia '05 ACM , December, 2005

Introduction

Overview VoiceXML Voice Portals

● TTS

● ASR Voice-Driven interface

● PBTG mediator

● MPC

● COLEC Related work Conclusions

Overview VoiceXML Voice Portals

● TTS

● ASR Voice-Driven interface

● PBTG mediator

● MPC

● COLEC Related work Conclusions

Overview

PSTN ︰公共交換電話網

Overview VoiceXML Voice Portals

● TTS

● ASR Voice-Driven interface

● PBTG mediator

● MPC

● COLEC Related work Conclusions

VoiceXML

1999 年 3 月，由 Motorola 、 Lucent 、 AT&T 和 IBM四家公司聯合發起成立了 VoiceXML論 (http://www.voicexml.org）

可擴展標記語言 (XML) 的一種擴展 為電話和移動設備提供一種便捷的訪問 Internet 網路，

獲取服務和資訊的手段。

VoiceXML(example)

Overview VoiceXML Voice Portals

● TTS

● ASR Voice-Driven interface

● PBTG mediator

● MPC

● COLEC Related work Conclusions

Voice Portals

TTS

■ Text-To-Speech: 文字轉語音 ASR

■ Automatic Speech Recognition: 自動語音識別

Voice Portal application architecture

Voice Portals

Overview VoiceXML Voice Portals

● TTS

● ASR Voice-Driven interface

● PBTG mediator

● MPC

● COLEC Related work Conclusions

Voice-Driven interface

PBTG mediator

■ a artificial intelligence system ■ To connect a Web application and a Voice Portal ■ consist of a MPC and a COLEC

MPC ■ Message Production Component

COLEC ■ Content Organization and Linquistic Expression Component ■ COLEC pipeline (10 stages)

Overview VoiceXML Voice Portals

● TTS

● ASR Voice-Driven interface

● PBTG mediator

● MPC

● COLEC Related work Conclusions

PBTG mediator

PBTG mediator

MPC

Recommendation Message

■ “The system recommends Matrix Reloaded to

you?” Feature Message

■ Matrix Reloaded stars Keanu Reeves?

■ Matrix Reloaded is a science-fiction moive? Feature Asking Message

■ Would you like more information about this movie?

COLEC ( pipeline )

COLEC ( pipeline ) - CLTT

CoganateLexicalizedThematicTree(CLTT) Example: Matrix Reloaded is a science-fiction movie?

COLEC ( pipeline ) - FLST

FullyLexicalizedSyntacticTree(FLST) Input source : form CLTT ( output of the last step)

Matrix Reloaded is a science-fiction movie?

Overview VoiceXML Voice Portals

● TTS

● ASR Voice-Driven interface

● PBTG mediator

● MPC

● COLEC Related work Conclusions

Related Work

DCIE

■ proxy-based interactive service

■ browse dynamically generated audio renditions of

both e-mail and WWW documents

■ In April,1997 WIRE voice browser

■ for car radio

■ to access e-mail and WWW

■ in Octobeer ,1998

Overview VoiceXML Voice Portals

● TTS

● ASR Voice-Driven interface

● PBTG mediator

● MPC

● COLEC Related work Conclusions

Conclusions

Thanks!!