testing and beyond at startups

25
PROPRIETARY Testing at Startups Mona Soni QA Engineer Dec 5, 2012

Upload: mona-soni

Post on 18-Jul-2015

549 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Testing and beyond at startups

PROPRIETARY

Testing at StartupsMona SoniQA Engineer

Dec 5, 2012

Page 2: Testing and beyond at startups

PROPRIETARY

Page 3: Testing and beyond at startups

PROPRIETARY

What happens when you discover an issue in production?

......Quickfix!

Page 4: Testing and beyond at startups

PROPRIETARY

Page 5: Testing and beyond at startups

PROPRIETARY

End Product!!!

Page 6: Testing and beyond at startups

PROPRIETARY

why startups don’t test??

Page 7: Testing and beyond at startups

PROPRIETARY

didn't have enough time to write unit tests for my code

Cost of hiring a tester

cost of setting up a test environment

pressure to get project up and running

time to market

Page 8: Testing and beyond at startups

PROPRIETARY

Drawbacks of this approach?

Page 9: Testing and beyond at startups

PROPRIETARY

Hiring

training and on boarding

Higher risk Growth

Page 10: Testing and beyond at startups

PROPRIETARY

How do we roll at Intent Media........?

Page 11: Testing and beyond at startups

PROPRIETARY

Page 12: Testing and beyond at startups

PROPRIETARY

What do we use to make this effective

Page 13: Testing and beyond at startups

PROPRIETARY

BDD

Page 14: Testing and beyond at startups

PROPRIETARY

Page 15: Testing and beyond at startups

PROPRIETARY

Junit tests: 4278

Rspec tests: 3871

Cucumber tests: 631

Test Coverage

Page 16: Testing and beyond at startups

PROPRIETARY

Intent Media Ads

Page 17: Testing and beyond at startups

PROPRIETARY

Cross Browser Testing

Page 18: Testing and beyond at startups

PROPRIETARY

Our code network graph

Page 19: Testing and beyond at startups

PROPRIETARY

Capybara

Celerity

Capybara-webkit

WebDriver

Automation suite

Page 20: Testing and beyond at startups

PROPRIETARY

Page 21: Testing and beyond at startups

PROPRIETARY

Does BDD really work???

Page 22: Testing and beyond at startups

PROPRIETARY

Conventional project team

BDD project team

Only testers write the automation tests

developers and testers (sometimes product managers)

together own the tests

need to document test cases separately

BDD features are the test documentation

updating test cases and requirements with ever changing

scope is a huge task

BDD features serve the purpose of requirements as tests are written in business language

hiring and on boarding is difficulthelps both developers and testers in understanding

functionality

Page 23: Testing and beyond at startups

PROPRIETARY

we don’t have time to write code without tests

less issues in production

we use developer machines for testing

we have been writing tests since day one and thats our strength

we do daily releases

Page 24: Testing and beyond at startups

PROPRIETARY

challenges

HiringBuild flakiness

UI tests

Page 25: Testing and beyond at startups

PROPRIETARY