cultural change of testing
TRANSCRIPT
Brijesh Prabhakar 2 December 2015, Bangalore
Testing as a Cultural Change
in the Brave New World of DevOps
1
What is Brave about the New World
“By 2016, 40% of App Dev organizations will have joint initiatives with
operations in support of continuous delivery and simplified release
management.” — Gartner 2
Source: Forrester on DevOps, 2014
DevOps – (New) Ways of working
Make Agile Iterative way of working based on business
priorities and continuous improvement
Collaborate Empowered, Cross Functional, stable and
knowledgeable teams
Automate Automation of manual tasks
(Build, Deploy, Test, Release & Monitor)
Simplify & Standardize
Integrated solution stack and use of standardized proven services & tools
Traditional “Audit” based testing approaches will not work in the future
3
A Tester’s mindset in a DevOps World
User Empathy
Technology Savvy
Testing Skills
• Develop end user perspective
• Cultural understanding
• Domain / Functional Expertise
• Beyond application features / UI
• Understand underlying platform
• Understand errors
• BDD, Service Virtualization, Triage
• Ability to automate tests
• Preserve application value 4
Challenges in Automation
Source: WQR 2015
• Automation is at the heart of Agile (and DevOps) methodologies
• Level of automation is an indication of maturity of testing processes used
• Levels of Automation is increasing and often going beyond Functional Automation
In spite of these challenges…
5
Traditional Test Automation (& why it fails)
• Late start of automation activities in the lifecycle
• Low utilization of automated scripts resulting in low RoI
• Progress measured by number of scripts rather than application coverage 6
Future of Automated Testing
Regression Focused
Focused on existing, working functions; ROI and repetitive tests
Progressive Feature Tests
Enabled by TDD & BDD frameworks and increasingly mature tools
Beyond UI Functions
Batch Jobs, Services, ETL jobs, Test Data Management, Service Virtualization
Code Quality Reviews
Integrate Automated Code Quality as part of Sanity Tests for new builds
Today
7
Future
Automation is not just a testing initiative…
8
• Cost of Testing
• Faster Time to Market
• BDD driven approach
• Less loss in translation
• Early detection of bugs
• Test for code quality
• Increased test coverage
• Efficiency gains
9
Brijesh Prabhakar Director and, Head of Testing, India GDC, Atos [email protected]