research seminar 1. dr. s. vilkomir, research directions in software testing
DESCRIPTION
Research seminar 1. Dr. S. Vilkomir, Research directions in software testing. 2. Brandi Amstutz, Combinatorial Approach to Testing Mobile Applications: An Experimental Investigation. Monday, October 28 2013 Room 232 S&T Bld. Research directions in software testing Dr. S. Vilkomir. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing](https://reader035.vdocument.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/1.jpg)
Research seminar
1. Dr. S. Vilkomir, Research directions in software testing.
2. Brandi Amstutz, Combinatorial Approach to Testing Mobile Applications: An Experimental Investigation.
Monday, October 28 2013
Room 232 S&T Bld. 1
![Page 2: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing](https://reader035.vdocument.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/2.jpg)
Research directions
in software testing
Dr. S. Vilkomir
![Page 3: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing](https://reader035.vdocument.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/3.jpg)
1. Effectiveness of combinatorial testing for logical expressions
2. Effectiveness of MC/DC
3. Testing mobile applications on different devices
![Page 4: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing](https://reader035.vdocument.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/4.jpg)
1. Effectiveness of combinatorial testing for logical expressions
Combinatorial testing:
• Each choice
• Base Choice
• Pair-wise
• t-way
![Page 5: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing](https://reader035.vdocument.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/5.jpg)
Pair-wise testing
–Dest: London, Paris, Chicago, NY
–M: 1000, 2000, 3000
–Direct: Y, N
Dest M Direct
t1 L 1 Y
t2 L 2 N
t3 L 3 -
t4 P 1 -
t5 P 2 Y
t6 P 3 N
t7 C 1 N
t8 C 2 -
t9 C 3 Y
t10 N 1 Y
t11 N 2 N
t12 N 3 -
Pair-WisePair-Wise: A value of each level for each factor must be combined : A value of each level for each factor must be combined with a value from every levels for each other factor.with a value from every levels for each other factor.
![Page 6: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing](https://reader035.vdocument.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/6.jpg)
Our results
• Fault Evaluator tool
http://core.ecu.edu/STRG/tools.html
• Four research papers:
• PSAM 10, Seattle, Washington, USA
• PIC-2010, Shanghai, China
• ICST 2012, Montreal, Canada
• ICSTW 2013,Luxembourg, Luxembourg
http://core.ecu.edu/STRG/publications.html
![Page 7: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing](https://reader035.vdocument.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/7.jpg)
New book
Introduction to Combinatorial Testing
by
D. Richard Kuhn,
Raghu N. Kacker, and
Yu Lei
![Page 8: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing](https://reader035.vdocument.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/8.jpg)
2. Effectiveness of MC/DC
• “Independent affect” is the main idea of Modified Condition/Decision Coverage (MC/DC)
• Suggested in 1992-1994 for avionic software
• DO-178B. Software Considerations in Airborne Systems and Equipment Certification. USA, 1992.
• Chilenski, J. and Miller, S. Software Engineering Journal, 1994
![Page 9: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing](https://reader035.vdocument.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/9.jpg)
Modified Condition/Decision Coverage
• Every point of entry and exit in the program has been invoked at least once, every condition in a decision in the program has taken on all possible outcomes at least once, every decision in the program has taken all possible outcomes at least once, and each condition in a decision has been shown to affect the decision's outcome independently.
A condition is shown to affect a decision's outcome independently by varying just that condition while holding fixed all other possible conditions.
From DO-178B.
9
3
1
2
![Page 10: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing](https://reader035.vdocument.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/10.jpg)
• Do these test cases satisfy MC/DC?– t1: <1, 0, 1> d= 1
– t2: <0, 1, 1> d= 1
– t3: <0, 1, 0> d= 0
– t4: <0, 0, 1> d= 0
• Holding conditions – OK• Affect the decision's outcome – OK• Answer: YES
d = A (B C)
Plans – to continue this research direction
![Page 11: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing](https://reader035.vdocument.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/11.jpg)
3. Testing mobile applications on different devices
Practical questions
![Page 12: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing](https://reader035.vdocument.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/12.jpg)
![Page 13: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing](https://reader035.vdocument.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/13.jpg)
• No scientific approaches
• No justification
• Optimal set of devices?
• Our approach – next presentation