a qa transformation story

30
A QA Transformation Story

Upload: yazid

Post on 25-Feb-2016

93 views

Category:

Documents


3 download

DESCRIPTION

A QA Transformation Story. History. Fall 2011. Is this your developer/tester relationship?. Fixing The Problem. The 3 Amigos. Acceptance Criteria. Given I am a logged in user When I go to the final checkout page - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: A QA Transformation Story

A QA Transformation Story

Page 2: A QA Transformation Story

History

Page 3: A QA Transformation Story

Fall 2011

Page 4: A QA Transformation Story

Is this your developer/tester relationship?

Page 5: A QA Transformation Story

Fixing The Problem

Page 6: A QA Transformation Story

The 3 Amigos

Page 7: A QA Transformation Story

Acceptance CriteriaGiven I am a logged in user

When I go to the final checkout page

Then I should see the total cost of the order broken down by product cost, tax, and shipping charges

And I should see the total cost of the order

Page 8: A QA Transformation Story

Feature: Process an orderGiven I am a logged in userWhen I go to the final checkout pageThen I should see the order broken down by product cost, tax, and shipping chargesAnd I should see the total cost of the order

• Order total = total cost of products on the order + tax + shipping charges

• Tax (only charged on the cost of the products, not the shipping):– Ohio = 7%– Michigan = 6.5%– Other states = 0%

• Shipping:– If total cost of products (before tax >= $25), shipping is free, otherwise

$5

Page 9: A QA Transformation Story

Testing points

Page 10: A QA Transformation Story

Feature: Process an order – Testing Notes

Products Tax ShippingOrder with one product

Ship to Ohio (7% tax) Cost of product = $24.99 (shipping is $5)

Order with one product

Ship to Michigan (6.5% tax)

Cost of product = $25 (shipping is free)

Order with multiple products

Ship to DC, billing address is Ohio (0% tax)

Cost of products = $25.01 (shipping is free)

VerificationsTotal cost = sum of cost of products + tax + shipping

Page 11: A QA Transformation Story

Feature: Process an order – Acceptance Criteria

Scenario: Order with one product, ship to OH, total product cost < $25 Given I am a logged in userAnd the shopping cart is emptyAnd I add a product costing $24.99 to the cartAnd my shipping state is OHAnd my billing state is OHWhen I go to the final checkout pageThen the tax amount should be $1.75And the shipping amount should be $5.00And the order total should be $31.74

Page 12: A QA Transformation Story

3 Amigos Tips and Tricks• Break things into small chunks• Insist on acceptance criteria being

complete before development begins• “3 Amigos” is not just a meeting• Remember the end goal – defined

acceptance criteria and shared knowledge

Page 13: A QA Transformation Story

Automated Acceptance Testing

Page 14: A QA Transformation Story

File Builders

Page 15: A QA Transformation Story

Restructuring Requirements

Page 16: A QA Transformation Story

A New Definition of Done

Page 17: A QA Transformation Story

What happens when testing isn’t included in your definition of done

“Before”

Page 18: A QA Transformation Story

What happens when testing IS included in your definition of done

“After”

Page 19: A QA Transformation Story

Better Iteration Planning

Page 20: A QA Transformation Story

Co-location

Page 21: A QA Transformation Story

“The Pod”

Page 22: A QA Transformation Story

Open workspace

Page 23: A QA Transformation Story

GOAL Over Role

Page 24: A QA Transformation Story

Where We’re At Now

Page 25: A QA Transformation Story

This is where our developer/tester relationship is now…

Page 26: A QA Transformation Story

Manual vs. Automated Testing

• Analysis – 1.5-2x vs. manual testing• Development – 2-2.5x vs. manual

testing• QA – 1/8thx vs. manual testing• Churn – 1/8thx vs. manual testing

36% increase in productivity + Quality + Confidence – Technical

Debt =

Page 27: A QA Transformation Story

“What’s It Gonna Cost Me”

Page 28: A QA Transformation Story

We’re not there yet…• Continuous improvement across

teams• Better involvement with business

sponsors• More visibility of continuous

integration build• 75% of test cases automated in 2012

Page 29: A QA Transformation Story

?

Page 30: A QA Transformation Story

Thanks!• Brandon Childers

[email protected]

– @brandonchilders• Chris Hoover

[email protected]

– @AgileSixSigma• Lan Bloch

[email protected]

• Laurel Odronic– [email protected]

om– @LOdronic

• Jon Kruger – [email protected]– @JonKruger

• Slides– http://

jonkruger.com/presentations/qa