![Page 1: Effectiveness of Pair-wise Testing on Logical Expressions](https://reader035.vdocument.in/reader035/viewer/2022062410/56816128550346895dd081e3/html5/thumbnails/1.jpg)
Effectiveness of Pair-wise Testing on Logical Expressions
Presented byWilliam Ballance
![Page 2: Effectiveness of Pair-wise Testing on Logical Expressions](https://reader035.vdocument.in/reader035/viewer/2022062410/56816128550346895dd081e3/html5/thumbnails/2.jpg)
Overview
• Introduction• Fault Types• Fault Evaluator• Experiment Results
![Page 3: Effectiveness of Pair-wise Testing on Logical Expressions](https://reader035.vdocument.in/reader035/viewer/2022062410/56816128550346895dd081e3/html5/thumbnails/3.jpg)
Introduction
• Effectiveness of pair-wise testing to reveal fault in logical expressions
• Only one previous paper that investigate this Non-specification-based approaches to logic testing for software
![Page 4: Effectiveness of Pair-wise Testing on Logical Expressions](https://reader035.vdocument.in/reader035/viewer/2022062410/56816128550346895dd081e3/html5/thumbnails/4.jpg)
Fault Types
• VNF (Variable Negation Fault)• ORF (Operator Reference Fault)• VRF (Variable Reference Fault)• ENF (Expression Negation Fault)• ASF (Associative Shift Fault)
![Page 5: Effectiveness of Pair-wise Testing on Logical Expressions](https://reader035.vdocument.in/reader035/viewer/2022062410/56816128550346895dd081e3/html5/thumbnails/5.jpg)
VNF
• Fault type where Boolean variable x is replaced by !x.
Original expression:a ∧ (!b ∨ !c) ∧ d ∨ e
Expression with VNF:!a ∧ (!b ∨ !c) ∧ d ∨ e
![Page 6: Effectiveness of Pair-wise Testing on Logical Expressions](https://reader035.vdocument.in/reader035/viewer/2022062410/56816128550346895dd081e3/html5/thumbnails/6.jpg)
ORF
• Fault type where Boolean AND operator is incorrectly used instead of Boolean OR operator or vice versa.
Original expression:a ∧ (!b ∨ !c) ∧ d ∨ e
Expression with ORF:a ∨ (!b ∨ !c) ∧ d ∨ e
![Page 7: Effectiveness of Pair-wise Testing on Logical Expressions](https://reader035.vdocument.in/reader035/viewer/2022062410/56816128550346895dd081e3/html5/thumbnails/7.jpg)
VRF
• Fault type where Boolean variable x is replaced by another variable y.
Original expression:a ∧ (!b ∨ !c) ∧ d ∨ e
Expression with VRF:b ∧ (!b ∨ !c) ∧ d ∨ e
![Page 8: Effectiveness of Pair-wise Testing on Logical Expressions](https://reader035.vdocument.in/reader035/viewer/2022062410/56816128550346895dd081e3/html5/thumbnails/8.jpg)
ENF
• Fault type where Boolean expression p is replaced by !p.
Original expression:a ∧ (!b ∨ !c) ∧ d ∨ e
Expression with ENF:a ∧ !(!b ∨ !c) ∧ d ∨ e
![Page 9: Effectiveness of Pair-wise Testing on Logical Expressions](https://reader035.vdocument.in/reader035/viewer/2022062410/56816128550346895dd081e3/html5/thumbnails/9.jpg)
ASF
• Fault type where parentheses in Boolean expression is misused.
Original expression:a ∧ (!b ∨ !c) ∧ d ∨ e
Expression with ENF:a ∧ !(b ∨ !c) ∧ d ∨ e
![Page 10: Effectiveness of Pair-wise Testing on Logical Expressions](https://reader035.vdocument.in/reader035/viewer/2022062410/56816128550346895dd081e3/html5/thumbnails/10.jpg)
Fault Evaluator
• A software tool that can generate faulty Boolean expressions and evaluate those faulty expressions with test sets that are loaded in the software.
![Page 11: Effectiveness of Pair-wise Testing on Logical Expressions](https://reader035.vdocument.in/reader035/viewer/2022062410/56816128550346895dd081e3/html5/thumbnails/11.jpg)
Fault Evaluator Steps
1. Load in the correct Boolean expressions2. Load in the test cases3. Generate faults (specify which faults or all faults)4. Evaluate– Fault Evaluator applies the test sets to the original
expressions and the faulty expressions.– If the result from applying the test case to the faulty
expression was different from the result obtained from the original expression, then the fault was revealed.
![Page 12: Effectiveness of Pair-wise Testing on Logical Expressions](https://reader035.vdocument.in/reader035/viewer/2022062410/56816128550346895dd081e3/html5/thumbnails/12.jpg)
Comparison of Our Results and Kobayashi’s Results
![Page 13: Effectiveness of Pair-wise Testing on Logical Expressions](https://reader035.vdocument.in/reader035/viewer/2022062410/56816128550346895dd081e3/html5/thumbnails/13.jpg)
Number of Faults for each Expression Set
![Page 14: Effectiveness of Pair-wise Testing on Logical Expressions](https://reader035.vdocument.in/reader035/viewer/2022062410/56816128550346895dd081e3/html5/thumbnails/14.jpg)
Effectiveness of Pair-wise testing on 5 different sets of expressions
• Percentages of pair-wise testing to reveal faults for each expression set.
![Page 15: Effectiveness of Pair-wise Testing on Logical Expressions](https://reader035.vdocument.in/reader035/viewer/2022062410/56816128550346895dd081e3/html5/thumbnails/15.jpg)
Comparison of Pair-wise testing and random testing
• Percentages of Pair-wise and random testing
![Page 16: Effectiveness of Pair-wise Testing on Logical Expressions](https://reader035.vdocument.in/reader035/viewer/2022062410/56816128550346895dd081e3/html5/thumbnails/16.jpg)
Pair-wise testing depending on size of expression
• Effectiveness of Pair-wise testing for each expression set
![Page 17: Effectiveness of Pair-wise Testing on Logical Expressions](https://reader035.vdocument.in/reader035/viewer/2022062410/56816128550346895dd081e3/html5/thumbnails/17.jpg)
Pair-wise testing depending on size of expression
• Effectiveness of Pair-wise testing for each fault type