your team’s not agile if you’re not doing agile testing
TRANSCRIPT
W16
Agile Testing
10/15/2014 3:00:00 PM
Your Team’s Not Agile If You’re
Not Doing Agile Testing
Presented by:
Jeanne Schmidt
Rural Sourcing, Inc.
Brought to you by:
340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ [email protected] ∙ www.sqe.com
Jeanne Schmidt
Rural Sourcing, Inc. With more than thirty years of experience working with software development, Jeanne Schmidt has held roles of tester, QA manager, business systems analyst, product manager, and technical trainer. For many years, Jeanne managed the PeopleTools QA team for PeopleSoft. Currently the QA tech lead for the Quality Assurance Practice at Rural Sourcing, Inc., Jeanne leads a team of software testers who help customers deliver quality software and advises customers on test strategies. Rural Sourcing, Inc., is the leader in domestic sourcing and a cost-effective, onshore alternative to the traditional model for IT outsourcing.
Click to edit Master title style
10/1/2014 1 Changing the IT Outsourcing Experience
Your Team’s Not Agile If You’re Not Doing Agile Testing
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
Jeanne Reynolds Schmidt QA Tech Lead, Rural Sourcing Inc.
Augusta, GA
QA Experience:
• Rural Sourcing, Inc. • PeopleSoft,
PeopleTools Development
Other Roles:
• Business Analyst • Product Manager • Technical Writer • Technical Trainer • Account
Manager
Industries Served:
• Pharmaceutical • Nonprofit • Higher Education • Software
Development • Financial Services • Consumer Packaged
Goods
Introduction
10/1/2014 2
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
About
Differentiators Impact
Domestic Outsourcing pioneer in the areas of:
• Application Management • Custom Application Development • Testing • Business Intelligence
Three US-Based Development Centers:
• Augusta, Georgia • Jonesboro, Arkansas • Mobile, Alabama
Serving clients in various Industries:
• CPG • Health Care • Hi-Tech • Life Sciences
Alternative Onshore source for cost-effective IT services
We improve the experience through:
• Ease of communications • Ease of collaboration • Time zone compatibility • Responsiveness • Reduced risk
• Changing the IT Outsourcing Experience
• Helping IT Leaders think domestically
• Creating Jobs
Who We Are
10/1/2014 3
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
• Java
• .NET
• Industry
specific
home-grown
applications
• Web
development
• Mobile
• Cloud-Based
Applications
• Level 1, 2 & 3
Support
• Database & OS
Support
• Functional
support
• Enterprise and
home-grown
applications
• SAP
• Oracle
• CAS
• LIMS
• Web Services/
Interfaces
• Quality
Systems
RSI Practice Areas
Application
Support
Enterprise
Applications
Custom
Development
Business
Intelligence
Quality
Assurance
• Business
Intelligence
• Data
Warehousing
• Reporting and
Analytics
• Dashboards
• ETL
• Functional
Testing
• Mobile Testing
• Test
Automation
• FDA Validation
• Agile,
Exploratory,
Content-driven
Testing
• Test Strategy
Project Management
Business Analysis
Testing, Validation and Quality Assurance Services
10/1/2014 4
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
Sample Clients
10/1/2014 5
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
The Challenge
10/1/2014 6
What we often hear:
“We aspire to be
agile.”
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
A Tale of Two Projects
10/1/2014 7
It was the best of
times, it was the
worst of times.
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
The Challenge
10/1/2014 8
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
What they mean is:
10/1/2014 9
Our release cycles are called sprints. We have a project manager called a scrum master. Our status meetings are called standups. We have testers who test code when we are done coding.
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
Throwing code over the wall
10/1/2014 10
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
The result is:
10/1/2014 11
Mini-waterfall release cycles. Testing seen as a separate team, phase, body of work. Work is not “done” at end of sprint.
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
QA Can Lead You to Agile
10/1/2014 12
Your Team’s Not Agile
If You’re Not Doing
Agile Testing
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
What do I mean by Agile?
Manifesto for Agile Development
Individuals and interactions over processes
and tools
Working software over comprehensive
documentation
Customer collaboration over contract
negotiation
Responding to change over following a plan
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
What do I mean by agile testing?
• Entire team responsible for quality
• Testing drives development
• Testers involved early and always
• Working software over comprehensive
documentation
• Early automation
• Responding to change over following a plan
• Exploratory testing vs. “checking”
• Roles merge
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
QA Can Lead the Way
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
How Agile Testing Can Help
Get to
“done”
Bridge the Gap
Prevent Bugs
Clarify Requirements
• Sprint Zero
• Choose Tools
• Determine Standards, Styles,
• Define Build Processes
• Integrations
• Regressions
• Communications Expectations
• Talk About QA Estimates
• Test Data
• Test Environments
• Define Positive & Negative Acceptance Criteria
• What is your definition of done?
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
What is your Definition?
10/1/2014 19
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
During Each Sprint
10/1/2014 20
• Running Tested Features
• Test Data
• Test Alongside Developers
• Test Positive & Negative Acceptance Criteria
• Build Regression Tests
• Constant Communication
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
Test Driven Development
10/1/2014 21
BDD TDD
ATDD
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
Test Driven Development
10/1/2014 22
Given
When
Then
Cucumber cukes.info
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
Entire team responsible for quality
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
Exploratory Testing
Learning
Test Design Test Execution
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
10/1/2014 25
Test Data Requirements
Testability Test Cases
Usability Environments
Early Automation Question
Risks Integrations
Limits Acceptance Tests
What Does an Agile Tester Do?
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
What Tools Will You Use?
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
What Tools Will You Use?
• Avoid excel
• Team visibility
• Dashboards
• Don’t substitute tools for communication
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
Reporting Test Results
Working software over comprehensive
documentation
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
Reporting Test Results
http://blogs.atlassian.com/2013/11/7-steps-to-a-beautiful-and-useful-agile-dashboard/
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
Reporting Test Results
• Where will you track bugs?
• Will you track all bugs?
• How do you log all testing?
• Do you log all testing?
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
Developers QA Client Consultant
Scrum Master
Team Communication
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
Team Communication
• QA Runs Demo
• Practice Demo Day Before
• Retrospectives
• Were Estimates realistic
• Were you done?
• What will you do if you were not done
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
Which Metrics
Customer Satisfaction Velocity
Issues Found in Field Test Cases
# of Features Delivered Value Delivered
Running Tested Features Earned Value Management
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
Old Metrics
Earned Value Management
• Number of test cases
• Number of bugs
• Number of bugs fixed
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
How do you start?
Define Done
Training
Tools
Processes
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
Agile Testing Can Get You to Done
If your code has not fully met
requirements, has not been unit tested,
regression tested by the end of the
sprint,
you are not done!
Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.
References
Crispin, Lisa, & Gregory, Janet (2009). Agile Testing. Addison-Wesley Professional. Hendrickson, Elisabeth (2013). Explore It! Reduce Risk and Increase Confidence with Exploratory Testing. The Pragmatic Programmers, LLC. Hanselman, S., & Schwaber, K. (2008, May 6). What is Done? - A Conversation with Scrum Co-Creator Ken Schwaber The Hanselminutes Podcast. Podcast retrieved from http://www.hanselminutes.com/119/what-is-done-a-conversation-with-scrum-co-creator-ken-schwaber
Click to edit Master title style
10/1/2014 39 Changing the IT Outsourcing Experience
Thank You
[email protected] www.linkedin.com/in/jeanneschmidt @Jeanne_Schmidt