![Page 1: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/1.jpg)
… … and after unit testing …and after unit testing …
Integration Testing, User Interface Testing, Validation, System Testing, …
![Page 2: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/2.jpg)
Testing, testing, …Testing, testing, …
Integration Testing
User Interface Testing
Validation
System Testing
![Page 3: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/3.jpg)
Integration Testing
Each of the following modules, shown below in the application's control flow chart, has finally passed unit testing standards. How do you plan to conduct integration testing?
A
GF
EDCB
L
H I
M
KJ
![Page 4: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/4.jpg)
Integration Methods
Top-Down using stubs
Bottom-Up using drivers
Depth-First
Sandwich
Regression Regression TestingTesting
![Page 5: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/5.jpg)
User Interface Testing
User Interface Validation paper prototypes made early are great
User Interface Evaluation Expert / Heuristic Evaluation Label Testing
is a "rose" still a rose by any other name?
![Page 6: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/6.jpg)
User Interface Testing
User Interface Testing
Cognitive Walkthroughs
Usability Testing hopefully the SRS specifically defines usability criteria
Random Testing automated random key/mouse presses
![Page 7: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/7.jpg)
What's the problem?
http://homepage.mac.com/bradster/iarchitect/color.htm
![Page 8: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/8.jpg)
Dialog Boxes
![Page 9: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/9.jpg)
Cognitive Walkthroughs
Participants real end user - sits at keyboard and performs tasks evaluator - takes notes and asks questions, mostly quiet developer - probably hidden or watches video
Results effectiveness
Will the user associate the next action with the appropriate interface control?
Will the user notice an action is available?
If the correct action is performed, will the user see that progress is being made toward solution of the task?
![Page 10: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/10.jpg)
Heuristics
Simple and natural dialogue Aesthetic and minimalist design
Speak the user's language
Minimize user memory load Recognition rather than recall
Consistency
Feedback Visibility of system status
User control and freedom Clearly marked exits Shortcuts and Flexibility
Good error messages Help users recognize, diagnose, and recover from errors
modified from http://en.wikipedia.org/wiki/Heuristic_evaluation
![Page 11: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/11.jpg)
Validation Testing
Alpha Testing
Beta Testing
![Page 12: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/12.jpg)
System Testing
Recovery Testing
Security Testing use software to analyze source code for stack
buffer overflow attacks, etc
Stress Testing
Performance Testing
Pressman : 5th Edition
![Page 13: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/13.jpg)
Object-Oriented Testing
Why is OOT more difficult than regular testing? inheritance of functions inheritance of data abstract classes
Testing the Design is much more important because the code level is very difficult to test.
Testing should be aimed at the "class" not the "module"
this is because the operation of a module probably depends on how its inherited
![Page 14: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/14.jpg)
And the Moral of the Story is...
Use Testing Tools
![Page 15: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/15.jpg)
And the glue that holds it all together…
The Test PlanThe Test Plan who what when where how
![Page 16: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/16.jpg)
Test Plan Considerations
What are the critical or most complex modules? make sure they get integration tested first probably deserve white-box attention
Where have you had problems in the past?
Third-Party delivered components?
What training is required? conducting formal reviews use of testing tools defect report logging
![Page 17: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/17.jpg)
IEEE 829 - Standard forSoftware Test Documentation
Recommends 8 types of testing documents:1. Test Plan
next slide2. Test Design Specification
expected results, pass criteria, ...3. Test Case Specification
test data for use in running the tests4. Test Procedure Specification
how to run each test5. Test Item Transmittal Report
reporting on when components have progressed from one stage of testing to the next
6. Test Log7. Test Incident Report
for any test that failed, the actual versus expected result8. Test Summary Report
management report http://en.wikipedia.org/wiki/IEEE_829
![Page 18: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/18.jpg)
Test Plan Contents (IEEE 829 format)
1. Test Plan Identifier
2. References
3. Introduction
4. Test Itemssee next slide
5. Software Risk Issues
6. Features to be Tested
7. Features not to be Tested
8. Approach
9. Item Pass/Fail Criteria
10. Suspension Criteria and Resumption Requirements
11. Test Deliverables
12. Remaining Test Tasks
13. Environmental Needs
14. Staffing and Training Needs
15. Responsibilities
16. Schedule
17. Planning Risks and Contingencies
18. Approvals
19. Glossary
http://en.wikipedia.org/wiki/Test_Plan
![Page 19: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/19.jpg)
4. Test Items
Requirements Specification Design Modules User/Operator Material
the user interface User Guide Operations Guide
Features response time, data accuracy, security, etc
System Validation alpha and beta testing
somewhat based on IEEE 829
![Page 20: … and after unit testing … Integration Testing, User Interface Testing, Validation, System Testing, …](https://reader036.vdocument.in/reader036/viewer/2022082422/56649e215503460f94b0cb29/html5/thumbnails/20.jpg)
Reality CheckReality Check
When is more testing not cost effective?When is more testing not cost effective?
Software Quality Assurance Activities
$ Cost of SQA
Cost of Failure
SQA+
Failure
Optimal Quality Level