your team’s not agile if you’re not doing agile testing

41
W16 Agile Testing 10/15/2014 3:00:00 PM Your Teams Not Agile If Youre Not Doing Agile Testing Presented by: Jeanne Schmidt Rural Sourcing, Inc. Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ [email protected] www.sqe.com

Upload: techwellpresentations

Post on 15-Jul-2015

133 views

Category:

Technology


4 download

TRANSCRIPT

W16

Agile Testing

10/15/2014 3:00:00 PM

Your Team’s Not Agile If You’re

Not Doing Agile Testing

Presented by:

Jeanne Schmidt

Rural Sourcing, Inc.

Brought to you by:

340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ [email protected] ∙ www.sqe.com

Jeanne Schmidt

Rural Sourcing, Inc. With more than thirty years of experience working with software development, Jeanne Schmidt has held roles of tester, QA manager, business systems analyst, product manager, and technical trainer. For many years, Jeanne managed the PeopleTools QA team for PeopleSoft. Currently the QA tech lead for the Quality Assurance Practice at Rural Sourcing, Inc., Jeanne leads a team of software testers who help customers deliver quality software and advises customers on test strategies. Rural Sourcing, Inc., is the leader in domestic sourcing and a cost-effective, onshore alternative to the traditional model for IT outsourcing.

Click to edit Master title style

10/1/2014 1 Changing the IT Outsourcing Experience

Your Team’s Not Agile If You’re Not Doing Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Jeanne Reynolds Schmidt QA Tech Lead, Rural Sourcing Inc.

Augusta, GA

QA Experience:

• Rural Sourcing, Inc. • PeopleSoft,

PeopleTools Development

Other Roles:

• Business Analyst • Product Manager • Technical Writer • Technical Trainer • Account

Manager

Industries Served:

• Pharmaceutical • Nonprofit • Higher Education • Software

Development • Financial Services • Consumer Packaged

Goods

Introduction

10/1/2014 2

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

About

Differentiators Impact

Domestic Outsourcing pioneer in the areas of:

• Application Management • Custom Application Development • Testing • Business Intelligence

Three US-Based Development Centers:

• Augusta, Georgia • Jonesboro, Arkansas • Mobile, Alabama

Serving clients in various Industries:

• CPG • Health Care • Hi-Tech • Life Sciences

Alternative Onshore source for cost-effective IT services

We improve the experience through:

• Ease of communications • Ease of collaboration • Time zone compatibility • Responsiveness • Reduced risk

• Changing the IT Outsourcing Experience

• Helping IT Leaders think domestically

• Creating Jobs

Who We Are

10/1/2014 3

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

• Java

• .NET

• Industry

specific

home-grown

applications

• Web

development

• Mobile

• Cloud-Based

Applications

• Level 1, 2 & 3

Support

• Database & OS

Support

• Functional

support

• Enterprise and

home-grown

applications

• SAP

• Oracle

• CAS

• LIMS

• Web Services/

Interfaces

• Quality

Systems

RSI Practice Areas

Application

Support

Enterprise

Applications

Custom

Development

Business

Intelligence

Quality

Assurance

• Business

Intelligence

• Data

Warehousing

• Reporting and

Analytics

• Dashboards

• ETL

• Functional

Testing

• Mobile Testing

• Test

Automation

• FDA Validation

• Agile,

Exploratory,

Content-driven

Testing

• Test Strategy

Project Management

Business Analysis

Testing, Validation and Quality Assurance Services

10/1/2014 4

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Sample Clients

10/1/2014 5

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

The Challenge

10/1/2014 6

What we often hear:

“We aspire to be

agile.”

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

A Tale of Two Projects

10/1/2014 7

It was the best of

times, it was the

worst of times.

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

The Challenge

10/1/2014 8

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

What they mean is:

10/1/2014 9

Our release cycles are called sprints. We have a project manager called a scrum master. Our status meetings are called standups. We have testers who test code when we are done coding.

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Throwing code over the wall

10/1/2014 10

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

The result is:

10/1/2014 11

Mini-waterfall release cycles. Testing seen as a separate team, phase, body of work. Work is not “done” at end of sprint.

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

QA Can Lead You to Agile

10/1/2014 12

Your Team’s Not Agile

If You’re Not Doing

Agile Testing

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

What do I mean by Agile?

Manifesto for Agile Development

Individuals and interactions over processes

and tools

Working software over comprehensive

documentation

Customer collaboration over contract

negotiation

Responding to change over following a plan

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

What do I mean by agile testing?

• Entire team responsible for quality

• Testing drives development

• Testers involved early and always

• Working software over comprehensive

documentation

• Early automation

• Responding to change over following a plan

• Exploratory testing vs. “checking”

• Roles merge

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

QA Can Lead the Way

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

How Agile Testing Can Help

Get to

“done”

Bridge the Gap

Prevent Bugs

Clarify Requirements

• Sprint Zero

• Choose Tools

• Determine Standards, Styles,

• Define Build Processes

• Integrations

• Regressions

• Communications Expectations

• Talk About QA Estimates

• Test Data

• Test Environments

• Define Positive & Negative Acceptance Criteria

• What is your definition of done?

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

What is your Definition?

10/1/2014 19

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

During Each Sprint

10/1/2014 20

• Running Tested Features

• Test Data

• Test Alongside Developers

• Test Positive & Negative Acceptance Criteria

• Build Regression Tests

• Constant Communication

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Test Driven Development

10/1/2014 21

BDD TDD

ATDD

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Test Driven Development

10/1/2014 22

Given

When

Then

Cucumber cukes.info

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Entire team responsible for quality

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Exploratory Testing

Learning

Test Design Test Execution

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

10/1/2014 25

Test Data Requirements

Testability Test Cases

Usability Environments

Early Automation Question

Risks Integrations

Limits Acceptance Tests

What Does an Agile Tester Do?

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

What Tools Will You Use?

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

What Tools Will You Use?

• Avoid excel

• Team visibility

• Dashboards

• Don’t substitute tools for communication

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Reporting Test Results

Working software over comprehensive

documentation

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Reporting Test Results

http://blogs.atlassian.com/2013/11/7-steps-to-a-beautiful-and-useful-agile-dashboard/

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Reporting Test Results

• Where will you track bugs?

• Will you track all bugs?

• How do you log all testing?

• Do you log all testing?

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Developers QA Client Consultant

Scrum Master

Team Communication

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Team Communication

• QA Runs Demo

• Practice Demo Day Before

• Retrospectives

• Were Estimates realistic

• Were you done?

• What will you do if you were not done

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Which Metrics

Customer Satisfaction Velocity

Issues Found in Field Test Cases

# of Features Delivered Value Delivered

Running Tested Features Earned Value Management

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Old Metrics

Earned Value Management

• Number of test cases

• Number of bugs

• Number of bugs fixed

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

How do you start?

Define Done

Training

Tools

Processes

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

Agile Testing Can Get You to Done

If your code has not fully met

requirements, has not been unit tested,

regression tested by the end of the

sprint,

you are not done!

Rural Sourcing Inc. Confidential & Proprietary. Reproduction by any method or unauthorized circulation is prohibited without prior approval. Copyright ©. All rights reserved.

References

Crispin, Lisa, & Gregory, Janet (2009). Agile Testing. Addison-Wesley Professional. Hendrickson, Elisabeth (2013). Explore It! Reduce Risk and Increase Confidence with Exploratory Testing. The Pragmatic Programmers, LLC. Hanselman, S., & Schwaber, K. (2008, May 6). What is Done? - A Conversation with Scrum Co-Creator Ken Schwaber The Hanselminutes Podcast. Podcast retrieved from http://www.hanselminutes.com/119/what-is-done-a-conversation-with-scrum-co-creator-ken-schwaber

Click to edit Master title style

10/1/2014 39 Changing the IT Outsourcing Experience

Thank You

[email protected] www.linkedin.com/in/jeanneschmidt @Jeanne_Schmidt