![Page 1: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/1.jpg)
Computer Science CPSC 322
Lecture 2
Representational Dimensions
1
![Page 2: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/2.jpg)
ANNOUNCEMENT
• You need to register your Clicker in Connect if you have never done so before
• Otherwise your answers won’t be recorded
• Assignment 0 due on Thurdsay
• People on the wait list can find the assignment in Piazza (post @10)
• You can send it to Vanessa via email by 4:30 on Th. if you want it to count, in case you get into the course
2
![Page 3: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/3.jpg)
Teaching Team
Instructor
• Cristina Conati ( [email protected];
office ICICS/CS 107)
Teaching Assistants• Borna Ghotbi ([email protected])
• Vanessa Putnam ([email protected])
• Michael Przystupa ([email protected])
• Wenyi Wang ([email protected])
OFFICE HOURS NOW AVAILABLE ON THE WEBSITE
![Page 4: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/4.jpg)
Today’s Lecture
4
• Recap from last lecture
• Representation and Reasoning: Dimensions
• An Overview of This Course
• Further Representational Dimensions
• Intro to search (time permitting)
![Page 5: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/5.jpg)
Course Essentials• Course website: CHECK IT OFTEN!
http://www.cs.ubc.ca/~conati/322/322-2017W1/course-page.html
• Syllabus, lecture slides, other material
• Textbook: Artificial Intelligence: Foundations of Computational Agents. by Poole and Mackworth. (P&M)
• Available electronically (free) http://artint.info/html/ArtInt.html
• We will cover at least Chapters: 1, 3, 4, 5, 6, 8, 9
• Connect for assignments and marks
• Piazza for Discussion board
• AIspace : online tools for learning Artificial Intelligence http://aispace.org/
5
![Page 6: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/6.jpg)
What is Artificial Intelligence?
Clicker Question: We use the following definition
• The study and design of
6
D. Systems that think like humans
A. Systems that think rationally
C. Systems that act rationally
B. Systems that act like humans
![Page 7: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/7.jpg)
What is Artificial Intelligence?
Clicker Question: We use the following definition
• The study and design of
7
D. Systems that think like humans
A. Systems that think rationally
C. Systems that act rationally
B. Systems that act like humans
![Page 8: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/8.jpg)
AI as Study and Design of Intelligent
Agents
• Intelligent agents: artifacts that act rationally in their
environment
• Their actions are appropriate for their goals and circumstances
• They are flexible to changing environments and goals
• They learn from experience
• They make appropriate choices given perceptual limitations and
limited resources
• This definition drops the constraint of cognitive plausibility
• Same as building flying machines by understanding general
principles of flying (aerodynamic) vs. by reproducing how birds fly
![Page 9: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/9.jpg)
Intelligent Agents in the World
9
Natural Language
Understanding
+
Computer Vision
Speech Recognition
+
Physiological Sensing
Mining of Interaction Logs
Knowledge Representation
Machine Learning
Reasoning +
Decision Theory
+
Robotics
+
Human Computer
/Robot
Interaction
Natural Language
Generation
abilities
Representation
& Reasoning
![Page 10: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/10.jpg)
Today’s Lecture
10
• Recap from last lecture
• Representation and Reasoning: Dimensions
• An Overview of This Course
• Further Representational Dimensions
• Intro to search (time permitting)
![Page 11: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/11.jpg)
Representation and Reasoning
To use these inputs an agent needs to represent them
knowledge
One of AI goals: specify how a system can
• Acquire and represent knowledge about a domain
(representation)
• Use the knowledge to solve problems in that domain
(reasoning)
Representation
& Reasoning
![Page 12: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/12.jpg)
problem ⟹ representation ⟹ computation⟹ representation ⟹ solution
Representation and Reasoning (R&R) System
• A representation language to describe
• The environment
• Problems (questions/tasks) to be solved
• Computational reasoning procedures to compute a solution to a problem
• E.g., an answer, sequence of actions
• Choice of an appropriate R&R system depends on various dimensions, e.g. properties of
• the environment, the type of problems, the agent, the computational resources, etc. 12
![Page 13: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/13.jpg)
Representational Dimensions
Environment
Problem TypeDeterministic Stochastic
Static
Sequential
Each cell will
include a R&R
system covered
in the course
We’ll start by describing
dimensions related to the
problem and
environment
Then we’ll include in
each cell R&R system
covered in the course
Then we’ll include in each
cell the various R&R
systems covered in the
course, and discuss some
more dimensions
![Page 14: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/14.jpg)
Problem Types
14
• Static: finding a solution does not involve reasoning
into the future (time is ignored)
• One-step solution
• Sequential: finding a solution requires looking for a
number of steps into the future, e.g.,
• Fixed horizon (fixed number of steps)
• Indefinite horizon (finite, but unknown number of steps)
![Page 15: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/15.jpg)
Problem Types
15
• Constraint Satisfaction – Find state that satisfies set
of constraints (static).
• e.g., what is a feasible schedule for final exams?
• Answering Query – Is a given proposition true/likely
given what is known? (static).
• e.g., does the patient suffers from viral hepatitis?
• Planning – Find sequence of actions to reach a goal
state / maximize outcome (sequential).
• e.g., Navigate through an environment to reach a particular location
![Page 16: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/16.jpg)
Representational Dimensions
Environment
16
Problem Type
Query
Planning
Deterministic Stochastic
Constraint Satisfaction
Static
Sequential
![Page 17: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/17.jpg)
Deterministic vs. Stochastic (Uncertain)
Environment
17
• Sensing Uncertainty: The agent cannot fully observe
the current state of the world when acting
• Effect Uncertainty: the agent does not know for sure
the immediate effects of its actions
Sensing Uncertainty?
Teacher’s explanation
Soccer Player Kick
![Page 18: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/18.jpg)
Deterministic vs. Stochastic (Uncertain)
Environment
18
• Sensing Uncertainty: The agent cannot fully
observe the current state of the world
• Effect Uncertainty: the agent does not know
for sure the effects of its actions
Sensing Uncertainty?
Teacher’s explanation YES
Soccer Player Kick NO
Effect Uncertainty?
Teacher’s explanation
Soccer Player Kick
![Page 19: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/19.jpg)
Deterministic vs. Stochastic (Uncertain)
Environment
19
• Sensing Uncertainty: The agent cannot fully
observe the current state of the world
• Effect Uncertainty: the agent does not know
for sure the effects of its actions
Sensing Uncertainty?
Teacher’s explanation YES
Soccer Player Kick NO
Effect Uncertainty?
Teacher’s explanation YES
Soccer Player Kick YES
![Page 20: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/20.jpg)
Clicker Question: Chess and Poker
A. Poker and Chess are both stochastic
B. Chess is stochastic and Poker is deterministic
C. Poker and Chess are both deterministic
D. Chess is deterministic and Poker is stochastic
20
An environment is stochastic if at least one of these is
true
• Sensing Uncertainty: the agent cannot fully observe
the current state of the world
• Effect Uncertainty: the agent does not know for sure
the immediate, direct effects of its actions
![Page 21: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/21.jpg)
Clicker Question: Chess and Poker
A. Poker and Chess are both stochastic
B. Chess is stochastic and Poker is deterministic
C. Poker and Chess are both stochastic
D. Chess is deterministic and Poker is stochastic
21
An environment is stochastic if at least one of these is
true
• Sensing Uncertainty: the agent cannot fully observe
the current state of the world
• Effect Uncertainty: the agent does not know for sure
the immediate, direct effects of its actions
![Page 22: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/22.jpg)
Deterministic vs. Stochastic Domains
22
• Historically, AI has been divided into two camps:
those who prefer representations based on logic
and those who prefer probability.
• In CPSC 322 we introduce both representational
families, and 422 goes into more detail
Note: Some of the most exciting current research in
AI is actually building bridges between these
camps.
![Page 23: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/23.jpg)
Representational Dimensions
Environment
23
Problem TypeDeterministic Stochastic
Static
Sequential
Each cell will
include a R&R
system covered
in the course
We described
dimensions
related to the
problem and
environment
Then we’ll include in
each cell R&R system
covered in the course
Now we include in each
cell the various R&R
systems covered in the
course, and discuss some
more dimensions
![Page 24: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/24.jpg)
Today’s Lecture
24
• Recap from last lecture
• Representation and Reasoning: Dimensions
• An Overview of This Course
• Further Representational Dimensions
• Intro to search (time permitting)
![Page 25: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/25.jpg)
Representational Dimensions
Environment
25
Problem Type
Query
Planning
Deterministic Stochastic
Constraint Satisfaction Search
Arc Consistency
Search
Search
Logics
STRIPS
Variables + Constraints
Value Iteration
Variable
Elimination
Bayesian Nets
Decision Nets
Markov Processes
Static
Sequential
Representation
Reasoning
Technique
Variable
Elimination
![Page 26: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/26.jpg)
Other Representational Dimensions
26
We've already discussed:
• Problem Types (Static vs. Sequential )
• Deterministic versus stochastic domains
Some other important dimensions
• Representation scheme: Explicit state or features or
relations
• Flat or hierarchical representation
• Knowledge given versus knowledge learned from
experience
• Goals versus complex preferences
• Single-agent vs. multi-agent
![Page 27: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/27.jpg)
Today’s Lecture
27
• Recap from last lecture
• Representation and Reasoning: Dimensions
• An Overview of This Course
• Further Representational Dimensions
• Intro to search (time permitting)
![Page 28: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/28.jpg)
Explicit State vs Features
28
How do we model the environment?
• You can enumerate the states of the world or
• A state can be described in terms of features
• Often a more natural description
• 30 binary features (also called propositions) can
represent
![Page 29: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/29.jpg)
Explicit State vs Features
29
How do we model the environment?
• You can enumerate the states of the world or
• A state can be described in terms of features
• Often a more natural description
• 30 binary features (also called propositions) can
represent
230=1,073,741,824 states
![Page 30: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/30.jpg)
Explicit State vs Features
30
Mars Explorer Example
Weather
Temperature
Longitude
Latitude
One possible state
Number of possible states (mutually exclusive)
{S, C}
[-40, 40]
[0, 359]
[0, 179]
![Page 31: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/31.jpg)
Explicit State vs Features
31
Mars Explorer Example
Weather
Temperature
Longitude
Latitude
One possible state
Number of possible states (mutually exclusive)
{S, -30, 320, 210}
2 x 81 x 360 x 180
{S, C}
[-40, 40]
[0, 359]
[0, 179]
![Page 32: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/32.jpg)
Explicit State vs. Features vs. Relations
• States can be described in terms of objects and relationships
• There is a proposition for each relationship on each tupleof objects
• University Example:
• Students (S) = {s1, s2, s3, …, s200)
• Courses (C) = {c1, c2, c3, …, c10}
• Registered (S, C)
• Number of Relations:
• Number of Propositions:
• Number of States: 32
![Page 33: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/33.jpg)
Explicit State vs. Features vs. Relations
• States can be described in terms of objects and relationships
• There is a proposition for each relationship on each tupleof objects
• University Example:
• Students (S) = {s1, s2, s3, …, s200)
• Courses (C) = {c1, c2, c3, …, c10}
• Registered (S, C)
• Number of Relations: 1
• Number of Propositions:
• Number of States:
33
22000
200*10
![Page 34: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/34.jpg)
Clicker Question
One binary relation (e.g., likes) and 9 individuals (e.g. people). How many states?
A. 812
B. 218
C. 281
D. 109
34
![Page 35: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/35.jpg)
Clicker Question
One binary relation (e.g., likes) and 9 individuals (e.g. people). How many states?
A. 812
B. 218
C. 281
D. 109
35
![Page 36: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/36.jpg)
Flat vs. hierarchical• Should we model the whole world on the same level of
abstraction?
• Single level of abstraction: flat
• Multiple levels of abstraction: hierarchical
• Example: Planning a trip from here to a resort in Cancun
Going to the airport
Take a cab
Call a cab
Lookup number
Dial number
Ride in the cab
Pay for the cab
Check in
….
• This course: mainly flat representations
• Hierarchical representations required for scaling up. 36
![Page 37: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/37.jpg)
Knowledge given vs. knowledge learned from
experience
37
• The agent is provided with a model of the world
once and for all or
• The agent can learn how the world works based
on experience
• in this case, the agent often still needs some prior
knowledge
• This course: mostly knowledge given
• Learning: CPSC 340 and CPSC 422
![Page 38: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/38.jpg)
Goals vs. (complex) preferences
• An agent may have a goal that it wants to achieve, e.g.,
• there is some state or set of states that the agent wants to be in
• there is some proposition or set of propositions that the agent wants to make true
• An agent may have preferences
• a preference/utility function describes how happy the agent is in each state of the world
• Agent's task is to reach a state which makes it as happy as possible
• Preferences can be complex
• This course: goals and simple preferences38
What beverage to order?• I am in a hurry so I need something quickly • I like Cappuccino better than Espresso, but it takes
longer to make…
![Page 39: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/39.jpg)
Single-agent vs. Multi-agent domains
• Does the environment include other agents?
• If there are other agents, it can be useful to explicitly model
• their goals and beliefs,
• how they react to our actions
• Other agents can be: cooperative, competitive, or a bit of both
• This course: only single agent scenario
39
![Page 40: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/40.jpg)
Summary
Would like most general agents possible, but in this course we need to restrict ourselves to:
• Flat representations (vs. hierarchical)
• Knowledge given (vs. knowledge learned)
• Goals and simple preferences (vs. complex preferences)
• Single-agent scenarios (vs. multi-agent scenarios)
We will look at
• Deterministic and stochastic domains
• Static and Sequential problems
And see examples of representations using
• Explicit state or features or relations
40
![Page 41: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/41.jpg)
AI Application
41
• At the beginning of next class, we will look at some AI
applications that you have found for your assignment 0
• You are asked to described them in terms of the elements
above and some more
![Page 42: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/42.jpg)
42
• What does the AI application do
• Goals
• prior knowledge needed
• past experiences that it does (or could) learn from
• Observations needed
• Actions performed
• AI technologies used
• Why is it intelligent?
• Evaluation?
![Page 43: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/43.jpg)
Today’s Lecture
43
• Recap from last lecture
• Representation and Reasoning: Dimensions
• An Overview of This Course
• Further Representational Dimensions
• Intro to Search (time permitting)
![Page 44: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/44.jpg)
Representational Dimensions
Environment
44
Problem Type
Query
Planning
Deterministic Stochastic
Constraint Satisfaction Search
Arc Consistency
Search
Search
Logics
STRIPS
Variables + Constraints
Value Iteration
Variable
Elimination
Bayesian Nets
Decision Nets
Markov Processes
Static
Sequential
Representation
Reasoning
Technique
Variable
Elimination
![Page 45: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/45.jpg)
Representational Dimensions
Environment
45
Problem Type
Query
Planning
Deterministic Stochastic
Constraint Satisfaction Search
Arc Consistency
Search
Search
Logics
STRIPS
Variables + Constraints
Value Iteration
Variable
Elimination
Bayesian Nets
Decision Nets
Markov Processes
Static
Sequential
Representation
Reasoning
Technique
Variable
Elimination
First Part of
the Course
![Page 46: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/46.jpg)
Representational Dimensions
Environment
46
Problem Type
Query
Planning
Deterministic Stochastic
Constraint Satisfaction Search
Arc Consistency
Search
Search
Logics
STRIPS
Variables + Constraints
Value Iteration
Variable
Elimination
Bayesian Nets
Decision Nets
Markov Processes
Static
Sequential
Representation
Reasoning
Technique
Variable
Elimination
We’ll focus
on Search
![Page 47: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/47.jpg)
(Adversarial) Search: Checkers
47
Source: IBM Research
• Early learning work in 1950s by
Arthur Samuel at IBM
• Chinook program by Jonathan
Schaeffer (UofA)
• Search explores the space of
possible moves and their
consequence
1994: world champion
2007: declared unbeatable
![Page 48: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/48.jpg)
(Adversarial) Search: ChessIn 1997, Gary Kasparov, the chess grandmaster and reigning world champion played against Deep Blue, a program written by researchers at IBM
Slide 48Source: IBM Research
![Page 49: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/49.jpg)
(Adversarial) Search: Chess
• Deep Blue’s won 3 games, lost 2, tied 1
Slide 49
• 30 CPUs + 480 chess processors
• Searched 126 million states per sec
• Generated 30 billion positions per move reaching
depth 14 routinely
![Page 50: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/50.jpg)
• Often we are not given an algorithm to solve a
problem, but only a specification of what a
solution is
we have to search for a solution.
– Enumerate a set of potential partial solutions
– Check to see if they are solutions or could lead to one
Search
50
![Page 51: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/51.jpg)
Simple Search Agent
51
Deterministic, goal-driven agent
• Agent is in a start state
• Agent is given a goal (subset of possible states)
• Environment changes only when the agent acts
• Agent perfectly knows:
• actions that can be applied in any given state
• the state it is going to end up in when an action is
applied in a given state
• The sequence of actions (and appropriate ordering) taking
the agent from the start state to a goal state is the solution
![Page 52: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/52.jpg)
Definition of a search problem
52
• Initial state(s)
• Set of actions (operators) available to the agent
• An action function that, given a state and an action,
returns a new state
• Goal state(s)
• Search space: set of states that will be searched for a
path from initial state to goal, given the available
actions
• states are nodes and actions are links between them.
• Not necessarily given explicitly (state space might be
infinite)
• Path Cost (we ignore this for now)
![Page 53: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/53.jpg)
Three examples
1. The delivery robot planning the route it will take in a building to get from one room to another (Ch1.6)
2. Vacuum cleaner world
3. Solving an 8-puzzle
Slide 53
![Page 54: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/54.jpg)
Environment for Delivery Robot (ch.1.6)
54
Simplified
• Consider only bold locations here
• Limits in direction of movement (e.g., can only move in the direction a door opens, can’t go back to previous location, etc.)
• Start: o103
• Goal: r123
![Page 55: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/55.jpg)
Search Space for the Delivery Robot
55
![Page 56: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/56.jpg)
Learning Goals for today’s class
• Define what is a representation and reasoning system
• Differentiate between single/static and sequential problems, as well as between deterministic and stochastic ones
![Page 57: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/57.jpg)
•Read Ch 3 (3.1-3.5.2, 3.7.3)
•Assignment 0
TODO for next class
57
•Review the definitions in the next three
slides. I won’t go over them next week
![Page 58: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/58.jpg)
• A directed graph consists of a set N of nodes
(vertices) and a set A of ordered pairs of nodes,
called edges (arcs).
• Node n2 is a neighbor of n1 if there is an arc from n1
to n2. That is, if n1, n2 A.
• A path is a sequence of nodes n0, n1,..,nk such that
ni-1, ni A.
• A cycle is a non-empty path such that the start node
is the same as the end node.
• A directed acyclic graph (DAG) is a graph with no
cycles
• Given a set of start nodes and goal nodes, a solution
is a path from a start node to a goal node
Graphs
58
![Page 59: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/59.jpg)
Graph specification for the Delivery Robot
59
N={mail, ts, o103, b3, o109,...}
A={
⟨ts,mail⟩, ⟨o103,ts⟩, ⟨o103,b3⟩,
⟨o103,o109⟩, ...}
One of several solution paths:
⟨o103, o109, o119, o123, r123⟩
![Page 60: Lecture 2 Representational Dimensionsconati/322/322-2017W1/slides... · Lecture 2 Representational Dimensions 1. ANNOUNCEMENT ... principles of flying (aerodynamic) vs. by reproducing](https://reader036.vdocument.in/reader036/viewer/2022062604/5fc04c02bb517b6d3444221d/html5/thumbnails/60.jpg)
• The forward branching factor of a node is the number of
arcs going out of the node
• The backward branching factor of a node is the number
of arcs going into the node
• If the forward branching factor of a node is b and the
graph is a tree, how many nodes are n steps away from
that node?
Branching Factor
60