csnb234 artificial intelligence
DESCRIPTION
CSNB234 ARTIFICIAL INTELLIGENCE. Chapter 8.2 Certainty Factors (CF). Instructor: Alicia Tang Y. C. Uncertainty: Introduction. In Expert Systems, we must often attempt to draw correct conclusions from poorly formed and uncertain evidence using unsound inference rules. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/1.jpg)
UNIVERSITI TENAGA NASIONAL 1
CSNB234ARTIFICIAL INTELLIGENCE
Chapter 8.2Certainty Factors (CF)
Chapter 8.2Certainty Factors (CF)
Instructor: Alicia Tang Y. C.
![Page 2: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/2.jpg)
UNIVERSITI TENAGA NASIONAL 2
Uncertainty: Introduction
In Expert Systems, we must often attempt to draw correct conclusions from poorly formed and uncertain evidence using unsound inference rules.
This is not an impossible task; we do it successfully in almost every aspect of our daily survival.
![Page 3: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/3.jpg)
UNIVERSITI TENAGA NASIONAL 3
Uncertainty: IntroductionDoctors deliver correct medical treatment
for ambiguous symptoms; we understand natural language statements that are incomplete or ambiguous and so on.
One of the characteristics of information available to human experts is its imperfection
Information can be incomplete, inconsistent, uncertain However, we are good at drawing valid
conclusion from such information
![Page 4: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/4.jpg)
So, how to define the term “Uncertainty”?
Uncertainty can be defined as the lack of the exact knowledge that would enable us to reach a perfectly reliable conclusion. This is because information available to us
can be in its imperfect, such as inconsistent, incomplete, or unsure, or all three.
An example: unknown data or imprecise language
UNIVERSITI TENAGA NASIONAL 4
![Page 5: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/5.jpg)
There are many approaches to
representing uncertainty in AI.
UNIVERSITI TENAGA NASIONAL 5
![Page 6: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/6.jpg)
UNIVERSITI TENAGA NASIONAL 6
Uncertainty Handling Methods
Abductive reasoningProperty inheritanceFuzzy logic Certainty Factor (CF)Bayes theoremDempster-Shafer theory
E.g. Suppose:If x is a bird then x flies
Abductive reasoning would say that“All fly things are birds”
By property inheritance “All birds can fly”
but, remember the case thatPenguin cannot fly?
![Page 7: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/7.jpg)
UNIVERSITI TENAGA NASIONAL 7
Evaluation Criteria for uncertainty handling methods
Expressive powerLogical correctnessComputational efficiency of inference
![Page 8: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/8.jpg)
UNIVERSITI TENAGA NASIONAL 8
Scheme used by expert system in Handling Uncertainty
MYCIN uses Certainty Factor The CF can be used to rank hypotheses in order of
importance. For example if a patient has certain symptoms that
suggest several possible diseases, then the disease with the higher CF would be the one that is first investigated.
REVEAL uses Fuzzy logicPROSPECTOR uses Bayes theorem
![Page 9: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/9.jpg)
9
Certainty Factors
PurposeDesign element semantics, and Formulas
![Page 10: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/10.jpg)
UNIVERSITI TENAGA NASIONAL 10
Certainty Factor (CF) When experts put together the rule
base they must agree on a CF to go with each rule. This CF reflects their confidence in the
rule’s reliability. Certainty measures may be adjusted to
tune the system’s overall performance, although slight variations in this confidence measure tend to have little effect on the overall running of the system.
![Page 11: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/11.jpg)
UNIVERSITI TENAGA NASIONAL 11
Certainty Factor
Certainty factors measure the confidence that is placed on a conclusion based on the evidence known so far.
A certainty factor is the difference between the following two components :
CF = MB[h:e] - MD[h:e]
A positive CF means the evidence supports the hypothesis since MB > MD.
![Page 12: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/12.jpg)
UNIVERSITI TENAGA NASIONAL 12
CF[h:e] = MB[h:e] - MD[h:e] …………………… (I)
CF[h:e] is the certainty of a hypothesis h given the evidence e.
MB[h:e] is the measure of belief in h given e.
MD[h:e] is the measure of disbelief in h given e.
CFs can range from -1 (completely false) to +1 (completely true) with fractional values in between, and zero representing ignorance.
MDs and MBs can range between 0 to 1 only.
0 - 1
1 - 0
Certainty Factor Computation
![Page 13: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/13.jpg)
UNIVERSITI TENAGA NASIONAL 13
MB(P1 AND P2) = MIN(MB(P1), MB(P2)) ……. (II)
MB(P1 OR P2) = MAX(MB(P1), MB(P2)) ……… (III)
the MB in the negation of a fact can be derived as:
MB(NOT P1) = 1 - MB(P1) ………………………. (IV)
More equations for CF computation use
![Page 14: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/14.jpg)
UNIVERSITI TENAGA NASIONAL 14
Each rule can have an credibility (attenuation)
A number from 0 to 1 which indicates its reliability. The credibility is then multiplied by the MB for the conclusion of the rule.
MB(Conclusion) = MB(conditions) * credibility ….. (V)
&
MB[h:e1,e2] = MB[h:e1] + MB[h:e2] * (1-MB[h:e1]) …….. (VI)
Credibility for each ruleThe goal of a rule
![Page 15: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/15.jpg)
UNIVERSITI TENAGA NASIONAL 15
A CF Calculation Example
Rule 1 IF X drives a Myvi AND X reads the Berita Harian THEN X will vote Barisan Nasional Rule 2 IF X loves the setia song OR X supports Vision 2020 THEN X will vote Barisan Nasional Rule 3 IF X uses unleaded petrol OR X does not support Vision 2020 THEN X will not vote Barisan Nasional
The set of 3 rules
For deducingThe chances of
“KLPeople will
vote for BN”
![Page 16: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/16.jpg)
UNIVERSITI TENAGA NASIONAL 16
Let us assume that the individual MBs for the Conditions are as follows:
X drives a Myvi car 0.9X reads the Utusan Malaysia 0.7X loves the 1Malaysia song 0.8X supports Vision 2020 0.6X uses unleaded petrol 0.7
![Page 17: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/17.jpg)
UNIVERSITI TENAGA NASIONAL 17
While the credibility of each ruleis as follows:
Rule 1 0.7Rule 2 0.8Rule 3 0.6
While the credibility of each ruleis as follows:
Rule 1 0.7Rule 2 0.8Rule 3 0.6
![Page 18: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/18.jpg)
UNIVERSITI TENAGA NASIONAL 18
To determine: CF[ X votes BN: Rule 1, Rule 2, Rule 3 ]
Rule1 and Rule2 give the MB in the proposition “X votes BN” :
MB[X votes BN: Rule 1] = MIN (0.9, 0.7) * 0.7 = 0.49-- using II and V
MB[X votes BN: Rule 2] = MAX (0.8, 0.6) * 0.8 = 0.64-- using III and V
MB[X votes BN: Rule 3] = MAX (0.7), (1-0.6)) * 0.6 = 0.42
-- using II, IV and V
The hypothesis (i.e. we want to test this)
![Page 19: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/19.jpg)
UNIVERSITI TENAGA NASIONAL 19
Combining the Rule 1 and Rule 2:
MB[X votes BN: Rule1, Rule2] = MB[X votes BN: Rule1] + MB[X votes BN: Rule2] * ( 1 - MB[X votes BN: Rule 1] )
---- using (VI) = 0.49 + 0.64 * (1 - 0.49) = 0.82
Combining the three rules:CF[ X votes BN: Rule 1, Rule 2, Rule 3 ] = MB[X votes BN: Rule 1, Rule 2] - MD[X votes BN: Rule 3] = 0.82 - 0.42 = 0.4
After we obtain the CF for the hypothesis, what do you think is the answer for the question:
“Will someone in KL vote for BN party”?
I disbelieve you will note
I believe you won’t vote
![Page 20: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/20.jpg)
UNIVERSITI TENAGA NASIONAL 20
In an expert system that implements “uncertainty handling”
The answer is “May be”(and not a “yes” or a “no”)
Isn’t it exactly the way you and I say it!
Certainty Factor has been criticised to be excessively ad-hoc.The semantic of the certainty value can be subjective and relative.
But the human expert’s confidence in his reasoning is also approximate, heuristic and informal
![Page 21: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/21.jpg)
UNIVERSITI TENAGA NASIONAL 21
Advantages of CF scheme:
- a simple computational model that permits experts to estimate their confidence in conclusion
- it permits the expressions of belief and disbelief in each hypothesis (expression of multiple sources of evidence is thus allowed)
- gathering the value of CF is easier than those in other methods
![Page 22: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/22.jpg)
UNIVERSITI TENAGA NASIONAL 22
Bayesian Approach (I)
Bayesian approach (or Bayes theorem) is based on formal probability theory.
It provides a way of computing the probability of a hypothesis (without sampling) following from a particular piece of evidence, given only the probabilities with which the evidence follows from actual cause.
To use this approach, reliable statistical data that define the prior probabilities for each hypothesis must be available As these requirements are rarely satisfied on
real-world problem, so only a few systems have been built based on bayesian reasoning
![Page 23: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/23.jpg)
UNIVERSITI TENAGA NASIONAL 23
Bayesian approach (II)
p(E | Hi) * p(Hi)
p(Hi | E) = ------------------------------
n p(E | Hk) * p(Hk)
k= 1Here, as you can see, a number of assumptions
(i.e. independence of evidence) which cannot be made for many applications (such as in medical cases).
evidence
hypothesis
![Page 24: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/24.jpg)
UNIVERSITI TENAGA NASIONAL 24
Bayes theorem (III)
where: p(Hi | E) is the probability that Hi is true given
evidence E. p(Hi) is the probability that Hi is true overall.
p(E | Hi) is the probability of observing evidence E when Hi is true.
n is the number of possible hypotheses.
If there are not many cases of success of people who obtained an ‘A’ by studying hard then your chances of getting an ‘A’ by ‘hardworking’ is also lower!
Those who obtained an ‘A’ and they indeed
studied every night before
exam
You will get an A if you study every night for one week before exam
![Page 25: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/25.jpg)
UNIVERSITI TENAGA NASIONAL 25
Advantages:
- Most significant is their sound theoretical foundation in probability theory.- Most mature uncertainty reasoning methods- Well defined semantics for decision making
Main disadvantage:
- They require a significant amount of probability data to construct a knowledge base.
![Page 26: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/26.jpg)
UNIVERSITI TENAGA NASIONAL 26
Dempster-Shafer theory (1967, Arthur Shafer)
This theory was designed as a mathematical theory of evidence where a value between 0 and 1 is assigned to some fact as its degree of support.
Similar to Bayesian method but is more general. As the belief in a fact and its negation need not sum
to one ‘1’. Both values can be zero (reflecting that no
information is available to make a judgment)
![Page 27: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/27.jpg)
UNIVERSITI TENAGA NASIONAL 27
Dempster-Shafer theory
It has a belief function, Bel(x)Belief function measures the likelihood
that the evidence support x. It is also used to compute the probability
that the evidence supports a proposition.
![Page 28: CSNB234 ARTIFICIAL INTELLIGENCE](https://reader035.vdocument.in/reader035/viewer/2022062322/5681493d550346895db688fd/html5/thumbnails/28.jpg)
Reasoning from first principles It is normally supported by having a
system’s structural and behavioral properties described declaratively. Model-based diagnosis is an example of system that reasons from first principle.
UNIVERSITI TENAGA NASIONAL 28