Agile Testing - Concepts & Techniques
Date: 2nd Dec 2015
Presented by –
Kingshuk Chatterjee & Amol Sande
Confidential www.synerzip.com
Agenda
www.synerzip.comConfidential
What is Agile Testing
What is Quality in Agile
Principles for Agile Testers
Agile Testing Quadrants
Agile Testing Challenges
Agile Testing Approach
Session Based Testing
Test Reporting Techniques
Principles for Agile Testers:
www.synerzip.comConfidential
Provide continuous feedback
Deliver value to the customer
Enable Face to Face Communication
Practice Continuous improvement
Respond to Change
Self Organize
Focus on People
Typical Processes:
www.synerzip.comConfidential
Seeking lightweight process
Test planning
Defect Tracking
Metrics
Agile Testing Quadrants
www.synerzip.comConfidential
Business Facing
Technology Facing
Supp
ortin
g th
e Te
amCritique Product
Agile Testing Challenges
www.synerzip.comConfidential
Team may not value testers or vice versa.
Unclear role of testers.
Testing often squeezed as deadlines approach.
Developers and testers are often in different operation silos.
Team may not have the skills or domain expertise to test effectively.
Agile Testing Approach
www.synerzip.comConfidential
Testers are first class citizens of agile teams and part of “Whole Team” supporting customers, business stake holders, dev and other team members.
Testers support quality infusion through entire team and product cycle.
Test tasks and stories are planned and executed like development stories and task.
Automate where possible and use creative approaches for testing.
Communicate through information radiators.
Session Based Testing
www.synerzip.comConfidential
• A method specifically designed to make exploratory testing auditable and measurable on a wider scale.
Session Based Testing
www.synerzip.comConfidential
• Charter:
• Session:
• Charter:
• Session:
1. Goal or agenda for test session in 1 to 3 sentences.2. Created by test team prior to start of testing but may
be changed at any time.3. Created from specifications, test plan or from
previous test session results.
1. Testing for uninterrupted period of time (1 or 2 hours) 2. Session focused on charter but allows new
opportunities or issues.3. Test cases created on the fly and progress is
recorded.
Session Based Testing
www.synerzip.comConfidential
• Report:
• Debrief:
• Parsing Result:
- Charter- Areas tested - Notes on how testing conducted- List of new bugs found- List of issues- Input Data used- % time spent- Session start time and duration- Tester Name
Short discussion between manager (PO) & tester(s) about session and session reports.
Standardized session report used to parse and store the result as aggregate data for reporting and metrics.Allows reporting on number of sessions per area, breakdown of time spent on testing, bug investigation, setup and other activities.
A Low Tech Testing Dashboard
www.synerzip.comConfidential
• Problem is:
Questions
• what is the status of testing?• What are you doing today?• When will be you finished?• Why is it taking so long?• Have you tested ____ this?
Management thinking
• Testing is assumed to be continuous.• Testing is considered a linear,
independent task.• Test results are assumed to stay valid.• Test Metrics are hard to interpret• Impatient for detailed test status
reporting
A Low Tech Testing Dashboard
www.synerzip.comConfidential
• Solution is: Report test cycle progress in a simple, structured way … shows progress towards goal. … manages expectations … and inspires support …. for an effective test process.
Product
Areas
Test EffortTest
CoverageQuality
Assessment
Time
A Low Tech Testing Dashboard
www.synerzip.comConfidential
1. High level areas of equal values, no sub areas.
2. Minimize overlap.3. Must “make sense”4. Inclusive of everything
reasonably testable
• None• Start• Low• High• Pause• Blocked• Go Live
011+22+3
1. Red2. Green3. Gold
References and Further Reading
www.synerzip.comConfidential
1) Agile Testing: A Practical Guide for Testers and Agile Teams By Lisa Crispin and Janet Gregory
2) www.satisfice.com/
3) http://www.teatimewithtesters.com/
Confidential www.synerzip.com