new artificial intelligence 2. problem solving using search...
TRANSCRIPT
![Page 1: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/1.jpg)
Artificial Intelligence
2. PROBLEM SOLVING
USING SEARCH AND
KNOWLEDGE
REPRESENTATION
1
![Page 2: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/2.jpg)
Search techniques
SSR(state space representations) concerns machine recognizable
representations, and search techniques concerns how to reach goal
state.
SSR Rules DT ANN
Search FC/BC Tree Traversal
Propagation
How reasoning
What knowledge
(classical AI)
2
![Page 3: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/3.jpg)
Search techniques
Search techniques:
◦ A systemic manner to find a sequence of operators that transforms from
initial state to goal state.
◦ breadth-first search (BFS), depth-first search (DFS), Branch&Bound(B&B)
◦ Hill-climbing search (HCS), best-first search (BestFS), A* search
3
![Page 4: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/4.jpg)
Search techniques
Problem with search:
◦ Combinatorial explosion
Branching factor (b): number of operators available at a state.
Depth (d): distance between initial and desired state (may be very
high).
size of search space = bd (in 10 step 8-puzzle ~ 210 ~ 410).
◦ Example: In 8-puzzle, b is 2 – 4 (Chess?)
Two approaches to solve combinatorial explosion.
◦ Goal decomposition
bd ⇒ n*bd/n
◦ Heuristic search
b´d where b´<< b
4
![Page 5: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/5.jpg)
Heuristic search
Heuristics
◦ Useful information or rule of thumbs that guide search through a problem
space
◦ May not be totally correct, but in general helpful to reach goal.
◦ Example:
Never apply an operator that leads to a state that has already been visited.
In navigator, prefer the way to reduce linear distance most to destination.
In 8-puzzle, prefer to move a tile into its desired position (Number of tiles in
position).
Heuristic search
◦ Search techniques using heuristic knowledge.
◦ Examples:
hill-climbing search (HC), best-first search (BestFS), A* search(A*)
5
![Page 6: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/6.jpg)
Search techniques
No extra knowledge
◦ BFS: Breadth First Search
◦ DFS: Depth First Search
Accumulated cost (g)
◦ B&B: Branch and Bound
Heuristic estimates (h')
◦ BestFS: Best First Search
◦ Simple HCS: Simple Hill Climbing Search
◦ Steepest Ascent Hill Climbing Search
Combined evaluation (g + h'):
◦ A*: bestFS using g+h’
Which one will be best?
◦ Answer: under what conditions! 6
![Page 7: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/7.jpg)
A(10)
B(5) C(7)
D(20) E(4)
G(0)
F(0)
4 8
3 5
4
10
Problem
For the following search space, find exploration
sequences for various search techniques - bfs, dfs,
b&b, bestfs, simple HCS, Steepest-ascent HCS, A*,
etc.
7
![Page 8: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/8.jpg)
Knowledge Representation
Knowledge
In real world, objects, concepts and relations exist.
→ if we know these, we have knowledge
◦ Ex. A particular person (me), a particular room (this room), number two
◦ Ex. The relationship of "greater than", Three is greater than two (a fact)
8
<Example of a semantic network>
![Page 9: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/9.jpg)
From Knowledge
To Knowledge Representations
Traditional knowledge representations
(to describe objects, concepts and relations)
◦ Natural language Hong Kil Dong, 7-327, two, greater than, Three is greater than
two. Hong Kil Dong is brave.
Ambiguity problem, hard to make machine recognizable.
◦ Mathematics: 3. 2, 4, >, 5.3 > 2 => can't handle all
◦ Logic: Hong_Kil_Dong, 7_329, two, greater( , ), greater(three, two)
9
![Page 10: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/10.jpg)
From Knowledge
To Knowledge Representations
Traditional knowledge representations
(to describe objects, concepts and relations)
◦ Pictures, drawings, symbols, etc.
Allocation of Mental Space
10
![Page 11: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/11.jpg)
From Knowledge
To Knowledge Representations
Computational representation
◦ Declarative representations (what):
file or database,
easy to represent objects, concepts, and relations (easy to add,
delete, modify data)
Relational DB
◦ Procedural representations (how):
usual program, sequence of actions,
hard to construct procedures (hard to program)
C++, Java, VB, PHP, JavaScript, etc.
11
![Page 12: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/12.jpg)
From Knowledge
To Knowledge Representations
Symbolic computational representations languages
◦ Maps objects, concepts, relations into symbols.
◦ All representation methods need representations and reasoning.
◦ Representation:
symbol represents objects, concepts, their properties, relationships.
◦ Reasoning:
representations must facilitate particular types of reasoning (called
symbolic computations).
◦ Examples:
logic(first order predicate logic), decision trees, semantic network, script,
frame, etc. (But, not ANN)
◦ Use AI languages for implementation
Lisp, Prolog, etc.
12
![Page 13: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/13.jpg)
Symbolic Computational Representation
In Lisp
(setq *rules* '(
(if (animal ?x) then (add (mortal ?x)))
(if (human ?x) then (add (animal ?x)))
)
)
(setq *facts* ‘((human TOM)))
(infer *facts* *rules*)
In Prolog
mortal(X) :- animal(X).
animal(X) :- human(X).
human(tom).
13
![Page 14: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/14.jpg)
Real world
language
math
logic
Symbolic comp.
Declarative : file & db Procedural : programs
Knowledge : represents objects concepts, relations using symbols Reasoning : add, access, del, modify knowledge Ex) Logic, SN, Frame, Script etc.
Comp
From Knowledge
To Knowledge Representations
14
![Page 15: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/15.jpg)
Knowledge representations:
◦ Decision trees.
Reasoning:
◦ following trees from the root until leaf.
Learning:
◦ Constructing decision trees.
KR, Reasoning & Learning in
Decision Trees
15
![Page 16: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/16.jpg)
KR, Reasoning & Learning in
Artificial Neural Network Knowledge representations:
◦ Neural network
Reasoning:
◦ Provide inputs then observe output layer
Learning:
◦ Construct and change networks (network structure and weights
on connections)
16
![Page 17: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/17.jpg)
KR, Reasoning & Learning in
Case Based Reasoning
Knowledge representations: Case-base
Reasoning: Find the most similar source problem and
solution, then transform the solution to the target
problem
Learning: remembering new cases.
17
![Page 18: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/18.jpg)
Analogy and CBR
CBR (Russel): intra-domain access,
less transformation,
Analogy (Gentner): inter-domain access
active transformation,
Derivational Analogy (Carbonnel):
how to store/map derivation
rela
tional
sim
ilarities
attribute similarities
literally similar
CBR analogy
similar appearance
target prob
sol
source prob
sol
access
transform
CBR
Analogy
sol
target prob
source prob
sol
access
mapping
deriva
tion
18
![Page 19: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/19.jpg)
Building a Knowledge Base?
Knowledge acquisition bottleneck:
◦ knowledge acquisition is known to be the bottleneck to building
knowledge base.
Machine learning:
◦ Solves knowledge acquisition bottleneck.
Business Rule Engine:
◦ Avoids knowledge acquisition bottleneck by separating
declarative codes (knowledge) from procedural codes
(programs).
19
![Page 20: New Artificial Intelligence 2. PROBLEM SOLVING USING SEARCH …contents.kocw.net/KOCW/document/2014/koreasejong/... · 2016. 9. 9. · Knowledge Representation Knowledge In real world,](https://reader033.vdocument.in/reader033/viewer/2022060523/60521320ae9686275639b7f0/html5/thumbnails/20.jpg)
Summary
Search and Problem Solving
◦ Problem solving using search
◦ Heuristic search
Knowledge Representation
◦ Knowledge about world
◦ Traditional representation
◦ Computational representation
◦ Symbolic computational representation
Various knowledge representation for AI
◦ If/then Rules, DT, ANN, CBR
20