how tobuildthebestbusinesscaseforagiletestautomation
TRANSCRIPT
@BBEERSMA
Building
The Best Businesscase
For (Agile) Test Automation
@BBEERSMA
@BBEERSMA
e: [email protected] m: +31 6-11010659 tw: @bbeersma
Expertise Manager Test Automation
10+ years of experience in TA & PT
Senior Automation Specialist
Board Member TestNet & ATI Europe
Initiator Test Automation Day
@BBEERSMA @BBEERSMA
@BBEERSMA @BBEERSMA What is Test Automation?
@BBEERSMA A small selection of testtools @BBEERSMA
@BBEERSMA Benefits of Test Automation Benefits of Test Automation
@BBEERSMA
Process and test data in sight-> Auto-Magic Audit Trail
Faster and more often deploy->Decrease Time to Market
Continues Quality monitoring ->Increase Quality to Market
Testruns 24/7 -> Increase Test coverage
TestBasedMaintenance -> Less maintenance documentation
Future Reuse testcases / testdata -> Increase Efficiency
Free Humans from Checking -> Motivation growth
@BBEERSMA Waterfall
@BBEERSMA
@BBEERSMA Agile and Scrum
@BBEERSMA
Individuals and interactions
Over
Working software
Over
Over Customer
collaboration
Responding to change
Over
Process and tools
Comprehensive documentation
Contract negotiation
Following a plan
@BBEERSMA Why do we need Test automation (in Agile)? @BBEERSMA
@BBEERSMA
9126
Maintainability
Portability
Efficiency
Functionality
Reliability
Usability
ISO 9126 ISO 25010
@BBEERSMA
25010 Maintainability
Portability
Performance Efficiency
Security
Compatibility
Functional Suitability
Reliability
Usability
ISO 9126 ISO 25010 @BBEERSMA
@BBEERSMA Benefits of Agile Benefits of Agile
@BBEERSMA
More Enjoyable!
Boundaries between test & development vanish
Joint quality awareness
Flexibility / Agility
Risk Management
Effective cost spreading
Right Product
@BBEERSMA @BBEERSMA Building the best Businesscase
@BBEERSMA
IST Risks +/+ Costs
Soll Risks +/+ Costs -/- Opportunities
< IST -/- Soll
----------------- IST
1
IST Test (TTC)
= Soll Test (TTC)
Return on Investment (ROI)
@BBEERSMA
IST
Risks
Soll
Costs
Risk Value (RV) =
Chance *
Damage
Test (TTC) Production Losses (PDC)
Projects (PTC) Regression (RTC)
(25% AT / 75% MT) (10% AT / 90% MT)
Businesscase (1/2)
@BBEERSMA
IST
Risks
Soll
Costs
Risk Value (RV) =
Chance *
Damage
Test (TTC) Production Losses (PDC)
Projects (PTC) Regression (RTC)
Opportunities
Implementation & maintenance (IMC)
(70% AT / 30% MT) (95% AT / 5% MT)
Businesscase (2/2)
@BBEERSMA
Risk Value (RV) = Chance (%) * Damage (€)
Risk Chance Damage Risk Value Soll +/- Loss of data 15% 100.000 15,000 -/- 40% 6.000
+
> 0
…….
Risk Value (RV)
IST / Soll
@BBEERSMA
Projects
(10% AT / 90% MT)
Testtime (develop / build) # Testruns (CPU time) ST / IAT / FT Business / Development / Testers (Tooling costs) Projectstops Testdata(management) ……….
# Testcases # Issues (Blocking / Serious) # Interfaces # Screens / fields # Databases ……….
Objects ProjectTestCosts (PTC)
+ Total ProjectTestCosts TestCosts / Testcase
………..
(70% AT / 30% MT)
Costs – Test (TTC)
IST / Soll
@BBEERSMA
Regression (RTC)
(25% AT / 75% MT)
Testtime (maintenance) # Testruns (CPU time) Business / Testers / Maintenance (Tooling costs) Testdata(management) # Releases ……….
# Testcases # Issues (Blocking / Serious) # Interfaces # Screens / fields # Databases ……….
Objects Costs
+ Total TestCosts (TTC) TestCosts / Testcase
………..
(95% AT / 5% MT)
Costs – Test (TTC)
IST / Soll
@BBEERSMA
Restore Time Waiting Time Solutions Bugs Fixing
Objects Costs
Production Losses (PDC)
User motivation Legacy Dependency Maintenance documentation
PDC (year) # Avg Time (days) Cost (day) Total Soll +/- Bugs fix 8 8 1.000 64.000 -/- 40% 25.600
+
> 0
…….
Production Losses (PDC)
IST / Soll
@BBEERSMA
Licenses Maintenance fee / year (15%) Education Design and implement structured testenvironment Migrate / convert Regressiontests Proof of concept(s) Installation Pilot Consultancy ………….
Objects Costs
Implementation and maintenance (IMC)
+
> 0
…….
Implementation and maintenance (IMC)
Soll
@BBEERSMA
Faster and more often deploy Continuous monitoring Motivation growth Better use Agile Less dependency (suppliers) Less maintenance documentation TestBasedMaintenance Testcoverage Future Reuse testcases / testdata Testruns 24/7 – unattended Processdata in sight ………….
Objects Business Test Development Maintenance
Opportunities (OPP)
Opportunities (OPP)
Soll
@BBEERSMA
Building the best business case