natural language processing frank bergman mike gallagher jason firestone barcelona, october 19th,...

14
Natural Language Processing Frank Bergman Mike Gallagher Jason Firestone Barcelona, October 19th, 2001

Upload: laurel-stephens

Post on 14-Jan-2016

223 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Natural Language Processing Frank Bergman Mike Gallagher Jason Firestone Barcelona, October 19th, 2001

Natural Language ProcessingFrank BergmanMike GallagherJason Firestone

Barcelona, October 19th, 2001

Page 2: Natural Language Processing Frank Bergman Mike Gallagher Jason Firestone Barcelona, October 19th, 2001

Stacked Layers of Language

Pragmatics

Semantics

„Thoughts“

Syntax

Speech

Pragmatics

Semantics

„Thoughts“

Syntax

Speech

Person A Person B

Page 3: Natural Language Processing Frank Bergman Mike Gallagher Jason Firestone Barcelona, October 19th, 2001

Infrastructure

VoiceRecognition

SyntaxParsing

SemanticAnalysis

Translation/Processing

VoiceGeneration

Generation

Philips Genie

IBM Via Voice

SAM,AT&T Synthesizer

BabelFish, Systran, other translators

Verbmobil, Train Information Systems

Ramona

Page 4: Natural Language Processing Frank Bergman Mike Gallagher Jason Firestone Barcelona, October 19th, 2001

Verbmobil: Speech2Speech Translation

Page 5: Natural Language Processing Frank Bergman Mike Gallagher Jason Firestone Barcelona, October 19th, 2001

Verbmobil Video http://verbmobil.dfki.de/overview-us.html

Page 6: Natural Language Processing Frank Bergman Mike Gallagher Jason Firestone Barcelona, October 19th, 2001

Speech: Audio signals

Person A Person B

Pragmatics

Semantics

„Thoughts“

Syntax

Speech

Pragmatics

Semantics

„Thoughts“

Syntax

Speech

“I am hungry”

„I am hungry“

Audio Signals

Page 7: Natural Language Processing Frank Bergman Mike Gallagher Jason Firestone Barcelona, October 19th, 2001

Syntax: Sentence structure

Pragmatics

Semantics

„Thoughts“

Speech

Pragmatics

Semantics

„Thoughts“

Speech

Person A Person Btext=„I am hungry“type=noun_phrase;

verb=

text=„am“ type=verb;time=pres;pers=1st;infinitive=„be“;

subject =

adverb =

text=„hungry“type=adjective;case=nom;pers=1st;

text=„I“ type=pronoun;case=nom;pers=1st;

Syntax Syntax

Grammar Formalisms: DCG, HPSG, …

Page 8: Natural Language Processing Frank Bergman Mike Gallagher Jason Firestone Barcelona, October 19th, 2001

Semantics: „Meaning“ and Logics

Pragmatics

„Thoughts“

Syntax

Speech

Pragmatics

„Thoughts“

Syntax

Speech

Person A Person B

x.self(x) hungry(x)

Semantics Semantics

Logic Formalisms: FOL, Lambda Calculus, …

Page 9: Natural Language Processing Frank Bergman Mike Gallagher Jason Firestone Barcelona, October 19th, 2001

Pragmatics: The „world“ around us

Semantics

„Thoughts“

Syntax

Speech

Semantics

„Thoughts“

Syntax

Speech

Person A Person BI

State

FoodBody

Body

Person

empty

desire

has_value

has_property

State

has_valuehas_property

instance

instance

has_part

eatfullPragmatics Pragmatics

Frames, Semantic Networks, Description Logics, …

Page 10: Natural Language Processing Frank Bergman Mike Gallagher Jason Firestone Barcelona, October 19th, 2001

„Thoughts“: What we „feel“

Pragmatics

Semantics

„Thoughts“

Syntax

Speech

Pragmatics

Semantics

„Thoughts“

Syntax

Speech

Person A Person B

„I am hungry“

Page 11: Natural Language Processing Frank Bergman Mike Gallagher Jason Firestone Barcelona, October 19th, 2001

Markets

AutomaticTranslation

SpeechInput

DialogSystems

Players• Philips• IBM• Lernout & Hauspie• AT&T

Market Conditions• High entrance

barriers• Low margin products

Page 12: Natural Language Processing Frank Bergman Mike Gallagher Jason Firestone Barcelona, October 19th, 2001

Commercial Impact

The generated value is very lowThe technology doesn‘t work yet

Page 13: Natural Language Processing Frank Bergman Mike Gallagher Jason Firestone Barcelona, October 19th, 2001

The Future

Current:Low margin add-on to operating systemsAutomatic translations have bad quality

Next 5 Years:Low margin add-on for mobile devicesTranslation quality will slightly enhanceDialog systems becoming more common

Next 20 Years:Speech processing will become ubiquous in public life, but no „real intelligence“Translation quality will slightly enhance

Page 14: Natural Language Processing Frank Bergman Mike Gallagher Jason Firestone Barcelona, October 19th, 2001

Links

Verbmobil: http://verbmobil.dfki.de/AT&T Demo: http://www.naturalvoices.att.com/demos/Philips Speech Processing: http://www.philipsspeechprocessing.com/ Babelfish http://www.babelfish.com/ Lernout & Hauspie http://www.lhsl.com/ Ray Kurzweil AI Net: http://www.kurzweilai.net/ ALICE: http://www.alicebot.org