the good, the bad, and the metrics webinar hosted by xbo soft
DESCRIPTION
In this webinar, industry experts, Rex Black, Mike Lyles, and Jay Philips participate in a discussion on the sometimes controversial issue of Software Test Metrics. Multiple viewpoints of metrics are reviewed and many of the questions that organizations have today regarding metrics are addressed. Testers of all levels can benefit.TRANSCRIPT
![Page 1: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/1.jpg)
Mike Lyles , Jay Philips and Rex Black
The Good, The Bad and The Metrics
![Page 2: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/2.jpg)
About XBOSoft
• Founded in 2006
• Dedicated to software quality• Software QA consulting• Software testing services
• Offices in San Francisco, Beijing, Oslo and Amsterdam
![Page 3: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/3.jpg)
From XBOSoft
• Amy • Jan
![Page 4: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/4.jpg)
Housekeeping• Everyone except the speakers is muted
• Questions via the gotowebinar control on the right side of your screen
• Questions can be asked throughout the webinar, we’ll try to fit them in when appropriate
• General Q & A at the end of the webinar
• You will receive info on recording after the webinar
![Page 5: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/5.jpg)
THE GOOD, THE BAD, AND THE METRICS
An XBOSoft Webinarwith
Mike Lyles, Jay Philips, & Rex BlackDecember 17, 2013
11am-12pm EST
![Page 6: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/6.jpg)
About the Speakers
Rex Black - President of RBCS. His popular first book, Managing the Testing Process, has sold over 50,000 copies around the world, and is now in its third edition. His ten other books on testing have also sold tens of thousands of copies. Rex is the past President of the International Software Testing Qualifications Board and of the American Software Testing Qualifications Board.
Jay Philips - CEO & President of Project Realms, Inc. an IT consulting firm focusing on software quality. Jay is also the CEO & President of TeamQualityPro, which is a real-time integrated dashboard platform used to evaluate the entire ecosystem of application projects and resources. TeamQualityPro is code agnostic so all organizations can implement a real-time executive dashboard system.
Mike Lyles - Sr. QA Manager with 20+ years of IT experience. His current role is over Performance testing, Automation testing, and Service Virtualization for all business communities within his organization. Mike enjoys teaching others in the testing profession. He has spoken at multiple conferences on testing, and has written multiple published articles.
![Page 7: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/7.jpg)
What is Your Story?
Has your organization ever considered replacing a tester that did not write, for example, 15 test cases per day?
Is the testing team blamed if defect leakage is greater than 5% into production?
What drives decisions like these? The common thread in these examples is “Test Metrics”
![Page 8: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/8.jpg)
What is Your Opinion?
Everyone has an opinion… Some believe they are the most valuable way to
communicate the results of testing
Some think that they are useless, misleading, and damaging to the communication of test results
Some believe that without measurement you are not managing the effort. And some believe that bad metrics are worse than no metrics at all.
![Page 9: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/9.jpg)
Where Does Your Organization Fit in the Metrics Debates?
Is your team aligned? Do you agree with the team?
Do you use a reporting process for test results?
Are you forced to report on metrics you don't believe are valuable?
Do you have dozens of metrics that you are reporting periodically that no one looks at, and when they do look at them, there is room for misinterpretation?
![Page 10: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/10.jpg)
Topics for the Panel
1. Top metrics that are misused or misunderstood
2. Best metrics that everyone should use
3. Worst metrics that you should avoid or remove
4. Tools and processes that can help your organization better measure your testing
![Page 11: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/11.jpg)
Discussion Topic #1
What metrics do you see in the industry that are
predominantly being misused or misunderstood by
organizations?
![Page 12: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/12.jpg)
EXAMPLE – Misused/Misunderstood
![Page 13: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/13.jpg)
Discussion Topic #2
What are the top metrics that you would suggest for any
organization to use? What are the most common?
![Page 14: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/14.jpg)
EXAMPLE – Suggested Metrics
![Page 15: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/15.jpg)
Discussion Topic #3
What are metrics that organizations should avoid and/or discontinue using?
![Page 16: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/16.jpg)
EXAMPLE – Metrics to Avoid
![Page 17: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/17.jpg)
Discussion Topic #4
What tools and/or processes can best assist organizations
in delivering meaningful, accurate, and quality metrics?
![Page 18: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/18.jpg)
EXAMPLE – Dashboard 1
![Page 19: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/19.jpg)
EXAMPLE – Dashboard 2
![Page 20: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/20.jpg)
Closing Thoughts
![Page 21: The good, the bad, and the metrics webinar hosted by xbo soft](https://reader031.vdocument.in/reader031/viewer/2022022402/544fa21aaf7959070a8b5e9b/html5/thumbnails/21.jpg)
Visit our Sites!Scan The Codes!
Rex Blackhttp://www.rbcs-us.com@RBCS
Jay Philipshttp://www.projectrealms.comhttp://teamqualitypro.com@jayphilips, @ProjectRealms,@TeamQualityPro
Mike Lyleshttp://www.mikewlyles.com@mikelyles