04 test controlling and tracking
DESCRIPTION
Testing with Visual Studio 2012 Agile TMapTRANSCRIPT
Module 03Test Controlling
and Tracking
Topics
Providing the client with sufficient insight into, and the opportunity to influence, the following:
• The progress of the test process
• The quality and risks of the test object
• The quality of the test process
Manage the test process, the infrastructure and the test products. Using the data thus obtained as a basis, and the analyses of possible trends.
http://www.tmap.net/en/tmap/4-essentials/structured-test-process/acceptance-and-system/control-phase
The Control Phase
Software Testing with Visual Studio
Reporting on Software Quality
Monitoring Quality Metrics
Available Test Reports
Rich Information
Rich Visualization
Harder to Customize
SQL Server Reports
Out of the Box
Easy to create your own
Easy to Customize
Excel Reports
All information inone place – the browser
Based on Excel Services
Customizable
Ideal for “Self-Service BI”
SharePoint/Web Access Dashboards
Manual/FunctionalTest Results
Microsoft Test Manager Results
Filters allow you to control
which builds you see
View the test and code coverage
results for each build to
determine quality
Line-by-line highlighting illustrates
which code is covered, uncovered,
or partially covered by test
Results show which methods are
covered by test and total coverage is
indicated by a percentage
Track total percentage hours
completed by user story
View real-time status of
each user story
Test results quickly display
quality status of each user story
Track active and resolved
bugs by user story
Demo
Quality Reports
Bugs and Defects
Manual Testing
Catching and Tracking Bugs
Rich Information
Customizable
Collect rich Information with Data Diagnostic Adapters
Customizable bug flow, states and reporting
Organize testing in multiple
configurations
Playback a prior recording to save
time with frequently-repeated
setup steps and prerequisites
Bind data to controls, to
support multiple iterations
and future automation
Pause, save, close, return, and
pick up where you left off
Filing Bugs
Rich Information
Customizable
Microsoft Test Runner
Microsoft Test Manager
TFS Web Access
Visual Studio
Feedback Manager*
3rd party tools*
IntelliTrace Logs
System logs & configurationDetailed status and history
visible to all team members
Audio & Video recordings
Action Recording
Video
Intellitrace
Test Impact
“Create your own”
Data Diagnostic Adapters
Get an overview of the test run
with summary pie charts, or drill
into the details for each test.
Analyze code coverage for manual
tests to determine which specific
parts of your code were tested .
Associate manual test runs
with builds and environments.
Demo
Creating and Resolving a Bug
The Bug Backlog
Put Bugs on theBacklog
Create your ownBug Workflow
Custom Reports
Relational Databases(TFS)
Data Warehouse(Reporting Services)
Creating Customized Reports
Creating Excel Reports for Test
Quality Status Reports“What is the status of testing of specific user stories or product areas?”
“What is the quality of builds based on the number of failed and passed tests?”
“How many test cases have never been run?”
“Which test cases have never been run?”
Quality Trend Reports“How many tests are blocked, passing, or failing over time?”
“How many tests are regressing?”
“How consistent is the manual test activity over time?”
Test Results - Data Points
Demo
Creating an Excel Pivot Table