cpe/csc 481: knowledge-based systems

58
© 2002 Franz J. Kurfess CLIPS 1 CPE/CSC 481: Knowledge-Based Systems Dr. Franz J. Kurfess Computer Science Department Cal Poly

Upload: kylemore-losty

Post on 30-Dec-2015

36 views

Category:

Documents


1 download

DESCRIPTION

CPE/CSC 481: Knowledge-Based Systems. Dr. Franz J. Kurfess Computer Science Department Cal Poly. Introduction CLIPS Overview Concepts, Notation, Usage Knowledge Representation Semantic Nets, Frames, Logic Reasoning and Inference Predicate Logic, Inference Methods, Resolution - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 1

CPE/CSC 481: Knowledge-Based Systems

CPE/CSC 481: Knowledge-Based Systems

Dr. Franz J. Kurfess

Computer Science Department

Cal Poly

Page 2: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 2

Course OverviewCourse Overview Introduction CLIPS Overview

Concepts, Notation, Usage

Knowledge Representation Semantic Nets, Frames, Logic

Reasoning and Inference Predicate Logic, Inference

Methods, Resolution

Reasoning with Uncertainty Probability, Bayesian Decision

Making

Pattern Matching Variables, Functions,

Expressions, Constraints

Expert System Design ES Life Cycle

Expert System Implementation Salience, Rete Algorithm

Expert System Examples Conclusions and Outlook

Page 3: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 3

Overview CLIPSOverview CLIPS

Motivation Objectives CLIPS Background

History Main ideas Terminology

Facts and Rules Formats Using Facts and Rules

Variables and Pattern Matching Variables Pattern Matching

Execution of Programs Invoking and leaving CLIPS Watching

Important Concepts and Terms

Chapter Summary

Page 4: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 4

LogisticsLogistics Introductions Course Materials

textbooks (see below) lecture notes

PowerPoint Slides will be available on my Web page handouts Web page

http://www.csc.calpoly.edu/~fkurfess

Term Project Lab and Homework Assignments Exams Grading

Page 5: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 5

Bridge-InBridge-In

Page 6: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 6

Pre-TestPre-Test

Page 7: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 7

MotivationMotivation

CLIPS is a decent example of an expert system shell rule-based, forward-chaining system

it illustrates many of the concepts and methods used in other ES shells

it allows the representation of knowledge, and its use for solving suitable problems

Page 8: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 8

ObjectivesObjectives be familiar with the important concepts and methods used in

rule-based ES shells facts, rules, pattern matching, agenda, working memory, forward

chaining understand the fundamental workings of an ES shell

knowledge representation reasoning

apply rule-based techniques to simple examples evaluate the suitability of rule-based systems for specific

tasks dealing with knowledge

Page 9: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 10

IntroductionIntroductionCLIPS stands for

C Language Implementation Production Systemforward-chaining

starting from the facts, a solution is developedpattern-matching

Rete matching algorithm: find ``fitting'' rules and factsknowledge-based system shell

empty tool, to be filled with knowledgemulti-paradigm programming language

rule-based, object-oriented (Cool) and procedural

Page 10: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 11

The CLIPS Programming Toolhistory of CLIPS

influenced by OPS5 and ART implemented in C for efficiency and portability developed by NASA, distributed & supported by COSMIC runs on PC, Mac, UNIX, VAX VMS

CLIPS provides mechanisms for expert systems a top-level interpreter production rule interpreter object oriented programming language LISP-like procedural language

[Jackson 1999]

Page 11: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 12

Components of CLIPS

rule-based language can create a fact list can create a rule set an inference engine matches facts against rules

object-oriented language (COOL) can define classes can create different sets of instances special forms allow you to interface rules and objects

[Jackson 1999]

Page 12: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 13

NotationNotation symbols, characters, keywords

entered exactly as shown: (example)

square brackets [...] contents are optional: (example [test])

pointed brackets (less than / greater than signs) < ... > replace contents by an instance of that type (example <char>)

star * replace with zero or more instances of the type <char>*

plus + replace with one or more instances of the type <char>+ (is equivalent to <char> <char>* )

vertical bar | choice among a set of items: true | false

Page 13: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 14

Tokens and FieldsTokens and Fields

tokens groups of characters with special meaning for CLIPS, e.g. ( ) \ separated by delimiters

(space, tab, Carriage Return, ...)

fields particularly important group of tokens CLIPS primitive data types

float, integer, symbol, string, external address, instance name, instance address

Page 14: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 15

CLIPS Primitive Data TypesCLIPS Primitive Data Types float: decimal point (1.5) or exponential notation (3.7e10) integer: [sign] <digit>+ symbol: <printable ASCII character>+

e.g. this-is-a-symbol, wrzlbrmft, !?@*+

string: delimited by double quotes e.g. "This is a string"

external address address of external data structure returned by user-defined functions

instance name (used with Cool) delimited by square brackets

instance address (used with Cool) return values from functions

Page 15: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 16

Invoke / Exit CLIPSInvoke / Exit CLIPS

entering CLIPS double-click on icon, or type program name(CLIPS)

system prompt appears:

CLIPS> exiting CLIPS

at the system prompt

CLIPS>

type (exit) Note: enclosing parentheses are important; they indicate a

command to be executed, not just a symbol

Page 16: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 17

FactsFacts elementary information items (“chunks”) relation name

symbolic field used to access the information often serves as identifier for the fact

slots (zero or more) symbolic fields with associated values

deftemplate construct used to define the structure of a fact

names and number of slots

deffacts used to define initial groups of facts

Page 17: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 18

Examples of FactsExamples of Facts

ordered fact(person-name Franz J. Kurfess)

deftemplate fact(deftemplate person "deftemplate example”

(slot name)

(slot age)

(slot eye-color)

(slot hair-color))

Page 18: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 19

Defining FactsFacts can be asserted

CLIPS> (assert (today is sunday))<Fact-0>

Facts can be listedCLIPS> (facts)f-0 (today is sunday)

Facts can be retractedCLIPS> (retract 0)CLIPS> (facts)

[Jackson 1999]

Page 19: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 20

Instances Instances

an instance of a fact is created by (assert (person (name "Franz J. Kurfess")

(age 46)

(eye-color brown)

(hair-color brown))

)

Page 20: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 21

Initial FactsInitial Facts

(deffacts kurfesses "some members of the Kurfess family"(person (name "Franz J. Kurfess") (age 46)

(eye-color brown) (hair-color brown))(person (name "Hubert Kurfess") (age 44)

(eye-color blue) (hair-color blond))(person (name "Bernhard Kurfess") (age 41)

(eye-color blue) (hair-color blond))(person (name "Heinrich Kurfess") (age 38)

(eye-color brown) (hair-color blond))(person (name "Irmgard Kurfess") (age 37)

(eye-color green) (hair-color blond)))

Page 21: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 22

Usage of FactsUsage of Facts adding facts

(assert <fact>+) deleting facts

(retract <fact-index>+) modifying facts

(modify <fact-index> (<slot-name> <slot-value>)+ ) retracts the original fact and asserts a new, modified fact

duplicating facts (duplicate <fact-index> (<slot-name> <slot-value>)+ )

adds a new, possibly modified fact inspection of facts

(facts) prints the list of facts

(watch facts) automatically displays changes to the fact list

Page 22: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 23

RulesRules

general format(defrule <rule name> ["comment"]

<patterns>* ; left-hand side (LHS)

; or antecedent of the rule

=>

<actions>*) ; right-hand side (RHS)

; or consequent of the rule

Page 23: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 24

Rule ComponentsRule Components

rule header defrule keyword, name of the rule, optional comment string

rule antecedent (LHS) patterns to be matched against facts

rule arrow separates antecedent and consequent

rule consequent (RHS) actions to be performed when the rule fires

Page 24: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 25

Examples of RulesExamples of Rulessimple rule

(defrule birthday-FJK (person (name "Franz J. Kurfess") (age 46) (eye-color brown) (hair-color brown)) (date-today April-13-02)=> (printout t "Happy birthday, Franz!") (modify 1 (age 47)))

Page 25: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 26

Properties of Simple Rules Properties of Simple Rules

very limited: LHS must match facts exactly facts must be accessed through their index number changes must be stated explicitly

can be enhanced through the use of variables

Page 26: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 27

Variables, Operators, FunctionsVariables, Operators, Functions

variables symbolic name beginning with a question mark "?" variable bindings

variables in a rule pattern (LHS) are bound to the corresponding values in the fact, and then can be used on the RHS

all occurrences of a variable in a rule have the same value the left-most occurrence in the LHS determines the value bindings are valid only within one rule

access to facts variables can be used to make access to facts more convenient:

?age <- (age harry 17)

Page 27: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 28

Wildcards Wildcards

question mark ? matches any single field within a fact

multi-field wildcard $? matches zero or more fields in a fact

Page 28: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 29

Field ConstraintsField Constraints

not constraint ~ the field can take any value except the one specified

or constraint | specifies alternative values, one of which must match

and constraint & the value of the field must match all specified values mostly used to place constraints on the binding of a

variable

Page 29: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 30

Mathematical Operators Mathematical Operators basic operators (+,-,*,/) and many functions

(trigonometric, logarithmic, exponential) are supported prefix notation no built-in precedence, only left-to-right and parentheses test feature

evaluates an expression in the LHS instead of matching a pattern against a fact

pattern connectives multiple patterns in the LHS are implicitly AND-connected patterns can also be explicitly connected via AND, OR, NOT

user-defined functions external functions written in C or other languages can be integrated Jess is tightly integrated with Java

Page 30: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 31

Examples of RulesExamples of Rules

more complex rule

(defrule find-blue-eyes

(person (name ?name)

(eye-color blue))

=>

(printout t ?name " has blue eyes."

crlf))

Page 31: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 32

Example Rule with Field Constraints

Example Rule with Field Constraints

(defrule silly-eye-hair-match(person (name ?name1)

(eye-color ?eyes1&blue|green)(hair-color ?hair1&~black))

(person (name ?name2&~?name1)(eye-color ?eyes2&~eyes1)(hair-color ?hair2&red|hair1))

=>(printout t ?name1 " has "?eyes1 " eyes and " ?hair1 " hair." crlf)

(printout t ?name2 " has "?eyes2 " eyes and " ?hair2 " hair." crlf))

Page 32: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 33

Using Templates

(deftemplate student “a student record”(slot name (type STRING))(slot age (type NUMBER) (default 18)))

CLIPS> (assert (student (name fred)))

(defrule print-a-student(student (name ?name) (age ?age))=>(printout t name? “ is “ ?age)

)

[Jackson 1999]

Page 33: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 34

An Example CLIPS Rule

(defrule sunday “Things to do on Sunday”(salience 0) ; salience in the interval [-10000, 10000]

(today is Sunday)

(weather is sunny)

=>

(assert (chore wash car))

(assert (chore chop wood))

)

[Jackson 1999]

Page 34: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 35[Jackson 1999]

Getting the Rules StartedGetting the Rules Started

The reset command creates a special factCLIPS> (load “today.clp”)

CLIPS> (facts)

CLIPS> (reset)

CLIPS> (facts)

f-0 (initial-fact) ...

(defrule start

(initial-fact)

=>

(printout t “hello”)

)

Page 35: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 36

Variables & Pattern MatchingVariables make rules more applicable

(defrule pick-a-chore(today is ?day)(chore is ?job)=>(assert (do ?job on ?day))

)

if conditions are matched, then bindings are used

[Jackson 1999]

Page 36: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 37

Retracting Facts from a Rule

(defrule do-a-chore(today is ?day) ; ?day must have a consistent binding?chore <- (do ?job on ?day)=>(printout t ?job “ done”)(retract ?chore)

)

a variable must be assigned to the item for retraction

[Jackson 1999]

Page 37: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 38

Pattern Matching Detailsone-to-one matching

(do ?job on ?day)(do washing on monday)

use of wild cards(do ? ? monday)(do ? on ?)(do ? ? ?day)(do $?)(do $? monday)(do ?chore $?when)

[Jackson 1999]

Page 38: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 39

Defining Functions in CLIPS Uses a LISP or Scheme-like syntax

(deffunction function-name (arg ... arg)action ... action)

(deffunction hypotenuse (?a ?b)(sqrt (+ (* ?a ?a) (* ?b ?b))))

(deffunction initialize ()(clear)(assert (today is sunday)))

[Jackson 1999]

Page 39: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 40

Defining Classes & Instances

defining the class CAR(defclass car

(is-a user)

(name)

(made-by))

defining an instance of CAR(make-instance corvette of car

(made-by chevrolet))

[Jackson 1999]

Page 40: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 41

Concrete & Abstract Classes

some classes only exist for inheritance purposes

Person

Man Woman

Jack Jill

[Jackson 1999]

Page 41: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 42

Managing InstancesCommands to display instances

CLIPS> (instances)[corvette] of carCLIPS> (send [corvette] print)[corvette] of car(made-by chevrolet)

Command to group instances (in a file)(definstances

(corvette of car (made-by chevrolet))(thunderbird of car (made-by ford)))

[Jackson 1999]

Page 42: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 43

Clearing & Resetting Instances

deleting an instanceCLIPS> (send [corvette] delete)

deleting all instancesCLIPS> (unmake-instance *)

resetting creates an initial objectCLIPS> (reset)

CLIPS> (instances)

[initial-object] of INITIAL-OBJECT

[Jackson 1999]

Page 43: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 44

Manipulation of ConstructsManipulation of Constructs show list of constructs

(list-defrules), (list-deftemplates), (list-deffacts) prints a list of the respective constructs

show text of constructs (ppdefrule <defrule-name>), (ppdeftemplate <deftemplate-name>), (ppdeffacts <deffacts-name>)

displays the text of the construct (``pretty print'')

deleting constructs (undefrule <defrule-name>), (undeftemplate <deftemplate-name>), (undeffacts <deffacts-name>)

deletes the construct (if it is not in use)

clearing the CLIPS environment(clear)

removes all constructs and adds the initial facts to the CLIPS environment

Page 44: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 45

Input / OutputInput / Output print information

(printout <logical-device> <print-items>*) logical device frequently is the standard output device t (terminal)

terminal input (read [<logical-device>]), (readline [<logical-device>])

read an atom or string from a logical device the logical device can be a file which must be open

open / close file (open <file-name> <file-ID> [<mode>]), (close [<file-ID>])

open /close file with <file-id> as internal name

load / save constructs from / to file (load <file-name>), (save <file-name>)

backslash \ is a special character and must be ``quoted'' (preceded by a backslash \) e.g. (load "B:\\clips\\example.clp")

Page 45: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 46

Program ExecutionProgram Execution

agenda if all patterns of a rule match with facts, it is put on the

agenda (agenda) displays all activated rules

salience indicates priority of rules

refraction rules fire only once for a specific set of facts

prevents infinite loops

(refresh <rule-name>) reactivates rules

Page 46: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 47

Execution of a Program Execution of a Program

(reset) prepares (re)start of a program: all previous facts are deleted initial facts are asserted rules matching these facts are put on the agenda

(run [<limit>]) starts the executionbreakpoints

(set-break [<rule-name>]) stops the execution before the rule fires, continue with (run)

(remove-break [<rule-name>]) (show-breaks)

Page 47: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 48

WatchingWatching

watching the execution (watch <watch-item>) prints messages about

activities concerning a <watch-item> (facts, rules, activations, statistics, compilation, focus, all)

(unwatch <watch-item>) turns the messages off

Page 48: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 49

Watching Facts, Rules and ActivationsWatching Facts, Rules and Activations

facts assertions (add) and retractions (delete) of facts

rules message for each rule that is fired

activations activated rules: matching antecedents these rules are on the agenda

Page 49: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 50

More Watching ...More Watching ...statistics

information about the program execution (number of rules fired, run time, ... )

compilation (default) shows information for constructs loaded by (load)

Defining deftemplate: ... Defining defrule: ... +j=j

+j, =j indicates the internal structure of the compiled rules» +j join added» =j join shared

important for the efficiency of the Rete pattern matching network

focus used with modules indicates which module is currently active

Page 50: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 51

User InterfaceUser Interface

menu-based version most relevant commands are available through windows

and menus

command-line interface all commands must be entered at the prompt (don’t forget enclosing parentheses)

Page 51: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 52

Limitations of CLIPS

single level rule sets in LOOPS, you could arrange rule sets in a hierarchy,

embedding one rule set inside another, etc

loose coupling of rules and objects rules can communicate with objects via message passing rules cannot easily be embedded in objects, as in Centaur

CLIPS has no explicit agenda mechanism the basic control flow is forward chaining to implement other kinds of reasoning you have to

manipulate tokens in working memory

[Jackson 1999]

Page 52: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 53

Alternatives to CLIPS JESS

see below Eclipse

has same syntax as CLIPS (both are based on ART) supports goal-driven (i.e., backwards) reasoning has a truth maintenance facility for checking consistency can be integrated with C++ and dBase new extension RETE++ can generate C++ header files

NEXPERT OBJECT another rule- and object-based system has facilities for designing graphical interfaces has a ‘script language’ for designing user front-end written in C, runs on many platforms, highly portable

[Jackson 1999]

Page 53: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 54

JESSJESS

JESS stands for Java Expert System Shellit uses the same syntax and a large majority of the

features of CLIPStight integration with Java

can be invoked easily from Java programs can utilize object-oriented aspects of Java

some incompatibilities with CLIPS COOL replaced by Java classes a few missing constructs

more and more added as new versions of JESS are released

Page 54: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 55

Post-TestPost-Test

Page 55: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 57

CLIPS SummaryCLIPS Summary notation

similar to Lisp, regular expressions facts

(deftemplate), (deffacts), assert / retract rules

(defrule ...), agenda variables, operators, functions

advanced pattern matching input/output

(printout ...), (read ...), (load ...) program execution

(reset), (run), breakpoints user interface

command line or GUI

Page 56: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 58

Important Concepts and TermsImportant Concepts and Terms agenda antecedent assert backward chaining consequent CLIPS expert system shell fact field forward chaining function inference inference mechanism instance If-Then rules JESS

knowledge base knowledge representation pattern matching refraction retract rule rule header salience template variable wild card

Page 57: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 59

Summary CLIPSSummary CLIPS

Page 58: CPE/CSC 481:  Knowledge-Based Systems

© 2002 Franz J. Kurfess CLIPS 60