Download - Natural Language Processing
![Page 1: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/1.jpg)
Natural Language Natural Language ProcessingProcessing
Daniele QuerciaDaniele Quercia
Fall, 2000Fall, 2000
![Page 2: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/2.jpg)
Presentation Presentation Outline
• Introduction to the Natural Language Processing (NLP)
•Applications of NLP
•Discussion
![Page 3: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/3.jpg)
Introduction to Natural Introduction to Natural Language Processing Language Processing
(NLP)(NLP)
![Page 4: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/4.jpg)
NLPNLP
•What is Natural Language processing (NLP)?
•“The Natural Language Processing (NLP) is the engineering of systems that process or analyse written or spoken natural language.”
NLP System
(computational model)
Natural Language(English)
Representation
of the input meaning
![Page 5: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/5.jpg)
Related disciplinesRelated disciplines
Linguistics
Computer Science
Psychology Neuroscie
nce Natural Language Processing
![Page 6: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/6.jpg)
Knowledge of languageKnowledge of language
These language processing applications use knowledge of language
Unix wc program› total number of bytes, words, lines in a text file.
What is a word?
A possible file: PIPPO.TXT
Hallo Pippo. Ciao Pippo. Auf widersehen Pippo.
![Page 7: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/7.jpg)
Knowledge of language - 2Knowledge of language - 2
Types of knowledge used in NLP
Phonetics and Phonology Morphology Syntax Semantics Pragmatics Discourse
NLP can be viewed as resolving ambiguity at one of these levels.i
![Page 8: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/8.jpg)
Knowledge of language - 3Knowledge of language - 3
Example: HAL computer system.capable of interacting with humans
Stanley Kubrik’s film 2001: A Space Odissey
Conversation between HAL and Dave
![Page 9: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/9.jpg)
Knowledge of language - 4Knowledge of language - 4
Example(cont’d): HAL computer system.capable of interacting with humans
Stanley Kubrik’s film 2001: A Space Odissey
Dave: Open the pod bay doors, right now. HAL: I’m sorry Dave, I’m afraid I can’t do that.
![Page 10: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/10.jpg)
Knowledge of language - 5Knowledge of language - 5
Phonetics and Phonology
The study of linguistic soundsHow word are pronounced in colloquial speech
Syntax
The study of the structural relationship between wordsbut syntax don’t tell us much about the meaning …
e.g. :I saw the Grand Canyon flying to New YorkTime flies like an arrow
![Page 11: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/11.jpg)
Knowledge of language - 6Knowledge of language - 6
Semantics
The study of meaning
e.g. :
I work for J.F. Zich and he’s a good boss which is a good company
Pragmatics
The study of how language is used to accomplish goals
e.g.
Can youn tell me what time is it?Could I have the salt?
![Page 12: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/12.jpg)
Knowledge of language - 7Knowledge of language - 7
Morphology
The study of the meaningful components of words. e.g. :Kick, kicks, kicked, kicking Arm, army
Discourse
The study of linguistic linguistic units larger than a single utterance
![Page 13: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/13.jpg)
Applications of NLPApplications of NLP
![Page 14: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/14.jpg)
Applications of NLP Applications of NLP
· Text-based applications
· Dialogue based applications
Speech recognitio
n
Machine translatio
n
Information retrieval
![Page 15: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/15.jpg)
Applications of NLP Applications of NLP
Machine translationAutomatic machine translation
translates texts from one language to another
Windows 98 must be delivered either without Internet Explorer or in connection with the sailor of the competitor Netscape
Windows 98 deve essere distribuito senza Internet Explorer o insieme al navigatore del concorrente Netscape
Important constraint
The text needs to be restricted
to a limited range of subjects
![Page 16: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/16.jpg)
Applications of NLP Applications of NLP
Machine translation even the best system produces poor translation… … but Machine-assisted translation uses a computer to help a translator.
![Page 17: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/17.jpg)
Applications of NLP Applications of NLP
Information retrievial
concerns the retrieving of relevant information from databases.
![Page 18: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/18.jpg)
Applications of NLP Applications of NLP
Information retrievial (cont’d)
Inverted index
Retrieval depends only on how often each word appears in a document
Should we treat all words equally?
![Page 19: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/19.jpg)
Applications of NLP Applications of NLP
Information retrievial (cont’d)
Stop list: words to ignoreMany frequent words in English are function words, which are useless.
![Page 20: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/20.jpg)
Applications of NLP Applications of NLP
Speech recognition
Speech generation is comparatively easy, but recognition is hard !
The acoustic signal is highly ambigousDisambiguation using statistics
If …they buy… occurs more frequently than …they by …, it will chosen
![Page 21: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/21.jpg)
ConclusionsConclusions
![Page 22: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/22.jpg)
Conclusions Conclusions
Computers can process natural language in a variety of interesting ways
A computer can’t do anything close to “understanding” language …
NLP is almost never error-free
![Page 23: Natural Language Processing](https://reader036.vdocument.in/reader036/viewer/2022062323/56815928550346895dc65123/html5/thumbnails/23.jpg)
A very special thanks to …A very special thanks to …