test plans. test plans a test plan states: what the items to be tested are at what level they will...
TRANSCRIPT
Test plans
Test Plans
A test plan states: What the items to be tested areAt what level they will be tested What sequence they are to be tested inHow the test strategy will be applied to the
testing of each itemA description of the test environment.
What to consider for the Test Plan
From IEEE 829 Standard for Software Test Documentation:
1. Test Plan Identifier 2. References 3. Introduction 4. Test Items
What to consider for the Test Plan
5. Software Risk Issues 6. Features to be Tested 7. Features not to be Tested 8. Approach 9. Item Pass/Fail Criteria 10. Suspension Criteria and Resumption Requirements
What to consider for the Test Plan
11. Test Deliverables 12. Remaining Test Tasks 13. Environmental Needs 14. Staffing and Training Needs 15. Responsibilities
16. Schedule 17. Planning Risks and Contingencies 18. Approvals 19. Glossary
What I want included in the test plan
List of responsibilities (and who does them) Who runs the test Who approves the results
Unit tests to be run with expected results Objectives Approach Include a description of the type of data used for unit
testing and why that data is being used Pass/fail criteria When the tests are to be run (timeline)
What I want included in the test plan
Integration tests to be run with expected results Objectives Approach Include a description of the type of data used for
integration testing and why that data is being used Pass/fail criteria When the tests are to be run (timeline)
What I want included in the test plan
Systems/Acceptance tests to be run with expected results Objectives Approach Include a description of the type of data used for
systems/acceptance testing and why that data is being used
Pass/fail criteria When the tests are to be run (timeline)
What I want included in the test plan
Alpha testing to be done Objectives Approach Features to be tested Pass/fail criteria When the tests are to be run (timeline)
What I want included in the test plan
Beta testing Objectives Approach Who is participating in the beta testing Pass/fail criteria What I want included in the test plan
Deliverables
Test Design Specification: detailing test conditions and the expected results as well as test pass criteria.
Test Case Specification: specifying the test data for use in running the test conditions identified in the Test Design Specification
Deliverables
Test Procedure Specification: detailing how to run each test, including any set-up preconditions and the steps that need to be followed
Test Item Transmittal Report: reporting on when tested software components have progressed from one stage of testing to the next
Deliverables
Test Log: recording which tests cases were run, who ran them, in what order, and whether each test passed or failed
Deliverables
Test Incident Report: detailing, for any test that failed, the actual versus expected result, and other information intended to throw light on why a test has failed.
These include the expected results being wrong, the test being run wrongly, or inconsistency in the requirements meaning that more than one interpretation could be made.
Deliverables- Test Incident Report
The report consists of all details of the incident such as actual and expected results, when it failed, and any supporting evidence that will help in its resolution.
The report will also include, if possible, an assessment of the impact of an incident upon testing.
Deliverables- Test Summary Report
Test Summary Report: A management report providing any important information uncovered by the tests accomplished, and including:
Assessments of the quality of the testing effort
The quality of the software system under test, and statistics derived from Incident Reports.
Deliverables- Test Summary Report
The report also records:What testing was doneHow long it took in order to improve any
future test planning.
This final document is used to indicate whether the software system under test is fit for purpose according to whether or not it has met acceptance criteria defined by project stakeholders
IEEE Standards
829-1983 IEEE Standard for Software Test Documentation
1008-1987 IEEE Standard for Software Unit Testing 1012-1986 IEEE Standard for Software Verification & Validation Plans
1059-1993 IEEE Guide for Software Verification & Validation Plans
Sample Test Plans
http://it.toolbox.com/blogs/enterprise-solutions/testing-a-sample-test-plan-3283