national chiao tung university chun-jen tsai...

24
Artificial Intelligence National Chiao Tung University Chun-Jen Tsai 6/8/2012

Upload: phamdieu

Post on 24-Mar-2018

216 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

Artificial Intelligence

National Chiao Tung University

Chun-Jen Tsai

6/8/2012

Page 2: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

2/24

Intelligent Agent

� In AI, researchers try to build a device (an agent) that can sense-and-change its environment

sensor

robot

manipulator

Where is the brain?

Page 3: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

3/24

Levels of Intelligent Behaviors

� Reflex

� actions are predetermined responses to the input data

� Intelligent response

� actions affected by knowledge of the environment

� Goal seeking

� Learning

Page 4: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

4/24

Approaches in Artificial Intelligence

� Performance-oriented

� Researcher tries to maximize the performance of the agents; the techniques used may not be “intelligent” by nature, but are effective in producing “intelligent” results

� Simulation-oriented

� Researcher tries to derive theories about how a biological agent produce intelligent responses to the environment and try to build an artificial agent that use the theories to simulate the behaviors

Page 5: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

5/24

Turing Test

� Proposed by Alan Turing in 1950, a benchmark for progress in artificial intelligence

� Test setup: human interrogator communicates with test subject by typewriter.

� Test goal: can the human interrogator distinguish whether the test subject is human or machine?

� Examples

� The DOCTOR program created by Joseph Weizenbaum in 1960s may fool some naive human interrogator; similar to today’s MSN robots

� Today, CAPTCHA are used to stop web-bots

CAPTCHA – Completely Automated Public Turing test to tell Computer and Human Apart

Page 6: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

6/24

Perception – Understanding the Input

� Image Understanding

� Template matching

� Image processing techniques

� edge enhancement

� region finding

� smoothing

� Image analysis

� Language Processing

� Syntactic Analysis

� Semantic Analysis

� Contextual Analysis

Page 7: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

7/24

Example: A Semantic Net

Page 8: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

8/24

Reasoning Ability

� Some AI researchers think that the ability to reason can be isolated in an abstract entity known as a

production system:

� Collection of states

� Collection of productions (rules or actions)

� Control system:decides which production to apply next given current states

Page 9: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

9/24

Reasoning by Searching

� State graph

� a graph that representing all the states and productions

� Search tree

� a record of state transitions explored while searching for a goal state

� Breadth-first search

� Depth-first search

� Example: the 8-puzzle problem

Page 10: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

10/24

Partial State Graph of 8-Puzzle Problem

Page 11: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

11/24

8-Puzzle Problem Search Tree

Page 12: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

12/24

Deductive Reasoning

Page 13: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

13/24

Heuristic Strategies

� Heuristic

� A “quantitative estimate” of the distance to a goal

� Not all reasons can be quantified, but with heuristic, we can “compute” our goal

� Requirements for good heuristics

� Must be much easier to compute than a complete solution

� Must provide a reasonable estimate of proximity to a goal

Page 14: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

14/24

Eight-Puzzle Heuristic

� How do we quantify the distance to our goal in an 8-puzzle problem?

Page 15: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

15/24

Heuristic Search of 8-Puzzle Prob.

Page 16: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

16/24

Key Issues in Intelligent Behavior

� Representation and storage of knowledge

� How to access a piece of related information effectively?

� Meta-reasoning and closed-world assumption enable us to access not only related but also relevant information

� Frame problem: in a dynamic environment, how to update the stored knowledge due to the occurrence of some events?

� Learning

� Imitation

� Supervised training

� Reinforcement

Page 17: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

17/24

Artificial Neural Networks

� A biological neuron:

� Artificial neural network:

� Use electronic devices to simulate a biological neuron

� Connecting multiple neurons to form a computing system

inputoutput

Page 18: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

18/24

Artificial Neurons

� The activities within a processing unit (an artificial neuron)

Page 19: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

19/24

Artificial Neural Network Topology

� The topology describes how individual neurons are connected together; for example, a two-neuron

network:

� Question: can we compute the XOR function using

this artificial neural network?

Page 20: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

20/24

Training of an Artificial Neural Net.

� To compute XOR, we have to train it!

a. The network performs correctly for input 1, 1

b. The network performs incorrectly for input 1, 0

c. The upper weight in the 2nd processing unit is adjusted

d. But, the network no longer handles input 1, 1 correctly!

Page 21: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

21/24

Automatic Vehicle Navigation

� ALVINN†:Autonomous

Land Vehicle

In A Neural Network

† Pomerleau, D. A. Neural Network Perception for Mobile Robot Guidance. Ph.D. dissertation, Carnegie Mellon Univ., Feb. 1992.

Page 22: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

22/24

Associative Memory

� Associative memory

� The retrieval of information that is most relevant to the information at hand

� One direction of research seeks to build associative memory using neural networks that when given a

partial pattern, will transit it into a completed pattern

Page 23: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

23/24

Robotics

� Truly autonomous robots require progress in perception and reasoning.

� Major advances being made in mobility

� Plan development versus reactive responses

� Evolutionary robotics

Page 24: National Chiao Tung University Chun-Jen Tsai 6/8/2012people.cs.nctu.edu.tw/~cjtsai/courses/ics/classnotes/ics12_11... · National Chiao Tung University Chun-Jen Tsai 6/8/2012. 2/24

24/24

Issues with Artificial Intelligence

� When should a computer’s decision be trusted over a

human’s?

� If a computer can do a job better than a human, when should a human do the job anyway?

� What would be the social impact if computer

“intelligence” surpasses that of many humans?