Introduction to Artificial

Intelligence

By

Budditha Hettige

Sources:

Based on “An Introduction to Multi-agent Systems” by Michael Wooldridge, John Wiley & Sons, 2002

Artificial Intelligence A Modern Approach, Stuart J. Russell and Peter Norvig

Multi-agent System, Lecture notes, Prof. A. S. Karunananda, MSc in AI

1

Overview

• What is Artificial Intelligence?

• What’s involved in Intelligence?

• History of AI

• Success Stories

• Examples

• Can Computers beat Humans?

• AI Systems in Practice

2

What is Intelligence?

• Intelligence:– “the capacity to learn and solve problems”

– the ability to acquire and apply knowledge and skills.

– in particular,• the ability to solve novel problems

• the ability to act rationally

• the ability to act like humans

3

What is Artificial Intelligence?

• Build and understand intelligent entities or agents

• Studies and develops intelligent machines and software

4

Where does it fit in the CS taxonomy?

Computers

Artificial Intelligence AlgorithmsDatabases Networking

Robotics SearchNatural Language Processing

Information

Retrieval

Machine

TranslationLanguage

Analysis

Semantics Parsing

6

Influential areas for AI

• Philosophy (428BC (even before)–to date)

• Mathematics (800)

• Economics (1776-)

• Neuroscience (1861-)

• Psychology (1887-)

• Computer engineering (1940-)

• Control theory and Cybernetics (1984-)

• Linguistics (1957-)

• Education, Physics, Biology, etc.

7

Some Areas of AI

• Expert systems• Neural Networks• Fuzzy Logic• Genetic Algorithms• Case-base reasoning• Natural Language Processing• Computer Vision• Robotics• Agents and Multi agent systems

8

Four schools of thought

• Acting humanly

– Behave like humans. This is really the TT

• Thinking humanly

– Goes with John Searle’s argument

• Thinking Rationally

– This refers to logical thinking

• Acting rationally

– Doing the right thing. The new approach to AI

Turing Test

9

Acting humanly: Turing test

• Turing (1950) "Computing machinery and intelligence“

• "Can machines think?" � "Can machines behave intelligently?“

• Operational test for intelligent behavior: the Imitation Game

• Suggests major components required for AI:

- knowledge representation

- reasoning,

- language/image understanding,

- learning

10

11

Turing Test

• An approach to test machine intelligence• A man and a woman communicate with an

interrogator without seeing each other• Man is replaced with a machine without

knowing the interrogator and he continues questioning

• If interrogator cannot notice a difference between answers provided by the woman and the machine then woman and Machine are equally intelligent (Machine fools the interrogator)

12

Implications –Turing Test

• Intelligence is measured comparatively

• Can be used to prove that a machine is intelligent or machine is not intelligent

• Depends on the nature (easiness) of the questions asked

• Depends on the level of intelligence of the interrogator

• Depends on the level of intelligence with whom the machine is compared

13

Technological limitations for TT

• Natural language processing to improve inputs mechanisms

• Knowledge representation to store knowledge

• Automated reasoning to store knowledge and answer questions and to draw conclusion

• Machine learning to adapt to new scenario and to detect and extrapolate patterns

14

Total Turing Test

• New technology required – Natural language processing

– Image processing

– Computer vision

• Loebner Prize– The Loebner Prize is an annual competition

that awards prizes to the Chatterbotconsidered the most humanlike for that year.

– ALICE won it twice

15

John Searle’s argument

• A person who knows neither English nor Chinese is kept in room with a hug book containing the Chinese translation for any given an English phrase, in adjacent pages

• Yet person can find the correct translation just by manipulating symbols, without being aware what the symbols mean

• Due to the lack of consciousness about what it does, Searle says that machine is not intelligent

Chines Room Argument

7/11/2015 Budditha Hettige (budditha@yahoo.com) 16

17

Implications – Chinese room argument

• Machine can never be intelligent

• Should we really bother about whether a submarine can swim when it behaves as if it can swim

• Yet consciousness is an important theme to investigate in the context of intelligent machines

What’s involved in Intelligence?

• Ability to interact with the real world– to perceive, understand, and act– e.g., speech recognition and understanding and synthesis– e.g., image understanding– e.g., ability to take actions, have an effect

• Reasoning and Planning– modeling the external world, given input– solving new problems, planning, and making decisions– ability to deal with unexpected problems, uncertainties

• Learning and Adaptation– we are continuously learning and adapting– our internal models are always being “updated”

• e.g., a baby learning to categorize and recognize animals

18

History of AI

• 1943: early beginnings– McCulloch & Pitts: Boolean circuit model of brain

• 1950: Turing – Turing's "Computing Machinery and Intelligence“

• 1956: birth of AI– Dartmouth meeting: "Artificial Intelligence“ name adopted

• 1950s: initial promise– Early AI programs, including – Samuel's checkers program – Newell & Simon's Logic Theorist

• 1955-65: “great enthusiasm”– Newell and Simon: GPS, general problem solver– Gelertner: Geometry Theorem Prover– McCarthy: invention of LISP

19

History of AI• 1966—73: Reality dawns

– Realization that many AI problems are intractable– Limitations of existing neural network methods identified

• Neural network research almost disappears

• 1969—85: Adding domain knowledge– Development of knowledge-based systems– Success of rule-based expert systems,

• E.g., DENDRAL, MYCIN• But were brittle and did not scale well in practice

• 1986-- Rise of machine learning– Neural networks return to popularity– Major advances in machine learning algorithms and

applications

• 1990-- Role of uncertainty– Bayesian networks as a knowledge representation framework

• 1995-- AI as Science– Integration of learning, reasoning, knowledge representation– AI methods used in vision, language, data mining, etc

20

21

History of AI – Another view

• Classical era (Mid 1950- mid 1960)

– Early developments

• Romantic era (Mid 1960- mid 1970)

– Branching into many areas

• Modern era (Mid 1970- to date)

– Commercial exploitation

22

The state of the Art

• Autonomous planning and scheduling:NASA has developed several remote agent programs for on-board autonomous planning …. (Jonsson, et al 2000)

• Game playing: IBM Deep Blue, HITECH defeat the chess grand master

23

The state of the Art….

• Autonomous control: ALVINN computer vision system (by NAVLAB of CMU) to steer car to keep it to follow a lane

• Logistic Planning: DART by DARPA for logistic planning during Gulf war (DARPA got back all investments spent for AI research for 30 years)

24

The state of the Art…

• Robotics: HipNav Robot assistant used by surgeons to get 3D model of patient’s internal anatomy and insertion of a hip replacement

• Language understanding and problem solving: PROVERB (1999) solves cross word puzzles (better than most human) using large database of past puzzle, information sources of dictionaries, online database, movie, etc.

Success Stories

• Deep Blue defeated the reigning world chess

champion Garry Kasparov in 1997

• AI program proved a mathematical conjecture

(Robbins conjecture) unsolved for decades

• During the 1991 Gulf War, US forces deployed an

AI logistics planning and scheduling program that

involved up to 50,000 vehicles, cargo, and people

25

Success Stories

• NASA's on-board autonomous planning program

controlled the scheduling of operations for a

spacecraft

• Proverb solves crossword puzzles better than

most humans

• Robot driving: DARPA grand challenge 2003-

2007

• 2006: face recognition software available in

consumer cameras

26

Knight Rider

27

IRobot

28

HAL: from the movie 2001

• 2001: A Space Odyssey– classic science fiction movie from 1969

• Part of the story centers around an intelligent computer called HAL

• HAL is the “brains” of an intelligent spaceship

• in the movie, HAL can – speak easily with the crew

– see and understand the emotions of the crew

– navigate the ship automatically

– diagnose on-board problems

– make life-and-death decisions

– display emotions

29

Computer interact with Natural Languages

7/11/2015 Budditha Hettige (budditha@yahoo.com) 30

Computer interact with NL

7/11/2015 Budditha Hettige (budditha@yahoo.com) 31

Consider what might be involved in building a computer like Hal….• What are the components that might be

useful?– Fast hardware?– Chess-playing at grandmaster level?– Speech interaction?

• speech synthesis

• speech recognition

• speech understanding

– Image recognition and understanding ?– Learning?– Planning and decision-making?

32

Can we build hardware as complex as the brain?• How complicated is our brain?

– A neuron, or nerve cell, is the basic information processing unit– estimated to be on the order of 10 12 neurons in a human brain– many more synapses (10 14) connecting these neurons– cycle time: 10 -3 seconds (1 millisecond)

• How complex can we make computers?– 108 or more transistors per CPU – supercomputer: hundreds of CPUs, 1012 bits of RAM – cycle times: order of 10 - 9 seconds

• Conclusion– YES: in the near future we can have computers with as many

basic processing elements as our brain, but with• far fewer interconnections (wires or synapses) than the brain• much faster updates than the brain

– But building hardware is very different from making a computer behave like a brain!

33

Can Computers beat Humans at Chess?• Chess Playing is a classic AI problem

– well-defined problem

– very complex: difficult for humans to play well

–

• Conclusion: – YES: today’s computers can beat even the best human

1200

1400

1600

1800

2000

2200

2400

2600

2800

3000

1966 1971 1976 1981 1986 1991 1997

Ratings

Human World ChampionDeep Blue

Deep Thought

Po

ints

Ra

tin

gs

34

Can Computers Talk?• This is known as “speech synthesis”

– translate text to phonetic form• e.g., “fictitious” -> fik-tish-es

– use pronunciation rules to map phonemes to actual sound• e.g., “tish” -> sequence of basic audio sounds

• Difficulties– sounds made by this “lookup” approach sound unnatural

– sounds are not independent• e.g., “act” and “action”

• modern systems (e.g., at AT&T) can handle this pretty well

– a harder problem is emphasis, emotion, etc• humans understand what they are saying

• machines don’t: so they sound unnatural

• Conclusion: – NO, for complete sentences

– YES, for individual words

35

A.L.I.C.E

• The A.L.I.C.E. AI Foundation promotes the adoption of the A.L.I.C.E.

• Free open source software for

– chatrobots,

– chat robots

– Chatterbots

– Chatterboxes

• http://alice.pandorabots.com

36

Can Computers Recognize Speech?• Speech Recognition:

– mapping sounds from a microphone into a list of words

– classic problem in AI, very difficult• “Lets talk about how to wreck a nice beach”

• (I really said “________________________”)

• Recognizing single words from a small vocabulary• systems can do this with high accuracy (order of 99%)

• e.g., directory inquiries – limited vocabulary (area codes, city names)

– computer tries to recognize you first, if unsuccessful hands you over to a human operator

– saves millions of dollars a year for the phone companies 37

Can Computers Understand speech?

• Understanding is different to recognition:

– “Time flies like an arrow”

• assume the computer can recognize all the words

• how many different interpretations are there?

– 1. time passes quickly like an arrow?

– 2. command: time the flies the way an arrow times the flies

– 3. command: only time those flies which are like an arrow

– 4. “time-flies” are fond of arrows

38

Can Computers Understand speech?• Understanding is different to recognition:

– “Time flies like an arrow”• Assume the computer can recognize all the words

• how many different interpretations are there?– 1. time passes quickly like an arrow?

– 2. command: time the flies the way an arrow times the flies

– 3. command: only time those flies which are like an arrow

– 4. “time-flies” are fond of arrows

• only 1. makes any sense, – but how could a computer figure this out?

– clearly humans use a lot of implicit commonsense knowledge in communication

• Conclusion: NO, much of what we say is beyond the capabilities of a computer to understand at present

39

• Recognition v. Understanding (like Speech)– Recognition and Understanding of Objects in a scene

• look around this room

• you can effortlessly recognize objects

• human brain can map 2d visual image to 3d “map”

• Why is visual recognition a hard problem?

• Conclusion: – mostly NO: computers can only “see” certain types of objects under

limited circumstances

– YES for certain constrained problems (e.g., face recognition)

Can Computers “see”?

40

AI Applications: Machine Translation

• Language problems in international business

– E.g., at a meeting of Japanese, Korean, Vietnamese

and Swedish investors, no common language

– Or: you are shipping your software manuals to 127

countries

– Solution; hire translators to translate

– Would be much cheaper if a machine could do this

• How hard is automated translation

– Very difficult! e.g., English to Sinhala

– Not only must the words be translated, but their

meaning also!

– Is this problem “AI-complete”? 41

Example

42