future of testing automation and qa - anand bagmar, thoughtworks

80
Future of Tes+ng, Test Automa+on & The Quality Analyst Anand Bagmar So#ware Quality Evangelist Principal Consultant,

Upload: thoughtworks

Post on 20-Aug-2015

1.396 views

Category:

Technology


1 download

TRANSCRIPT

Page 1: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Future&of&&Tes+ng,&Test&Automa+on&&&The&Quality&Analyst&

Anand&Bagmar&So#ware(Quality(Evangelist(

((((((Principal(Consultant,(((

Page 2: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

!!!!!@BagmarAnand!!

about.me/anand.bagmar!

About!me!

Page 3: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

What!do!you!expect!from!this!session?!

Page 4: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Evolu+on&

Page 5: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

One!thing!that!is!THE!SAME!

Page 6: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

OrganizaCon!ObjecCve!

Time!

Quality&

Money!/!Value!

Page 7: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Media!

Page 8: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Past&

Page 9: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Present&

Page 10: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Future?&

Page 11: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

User!Interface!

Page 12: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Past&

Page 13: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Present&

Page 14: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Present&

Page 15: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Future?&

Page 16: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Future?&

Page 17: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Future?&

Page 18: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Future?&

Page 19: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Graphics!

Page 20: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Past&

Page 21: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Present&

Page 22: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Present&

Page 23: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Future?&

Page 24: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Games!

Page 25: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Past&

Page 26: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Present&

Page 27: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Present&

Page 28: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Portable!Devices!

Page 29: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Past&

Page 30: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Past&

Page 31: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Past&

Page 32: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Present&

Page 33: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Present&

Page 34: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Present&

Page 35: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Present&

Page 36: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Future?&

Page 37: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Content!

Page 38: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Past&

Page 39: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Past&

Page 40: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Present&

Page 41: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Future?&

Page 42: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

SpaCal!operaCng!environment!SpaCal!OperaCng!Environment!(((Professor(John(Underkoffler(@(MIT(

Page 43: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Pranav(Mistry(

Sixth(Sense(Technology(

hEp://www.pranavmistry.com/projects/sixthsense/(

Page 44: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks
Page 45: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks
Page 46: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Seamless!IntegraCon!

Page 47: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks
Page 48: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Which!life!are!we!living?!

Page 49: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

What&does&this&mean&from&a&Tes+ng&Perspec+ve?&

Page 50: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

What&do&we&need&to&do&next?&

Page 51: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Think&big!!&

Page 52: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Test!AutomaCon!A&Safety&Net&

Page 53: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Con+nuous&Integra+on&(CI)&and&Con+nuous&Design&and&Delivery&is&

NOT&Op+onal&

Page 54: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Test!Frameworks!

Page 55: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

What&is&next?&

Behavior(Driven(

Development((BDD)(

Custom(

Frameworks(

Record(&(

Playback((

Core(

Framework(

Page 56: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

FuncConal!Tests!(GUI)!

Web!Service!Tests!

View!Tests!

JavaScript!Tests!

IntegraCon!tests!

Unit!Tests ! !!

Test(AutomaTon(Pyramid(Manual(/(

Exploratory(

TesTng(

Impact!on!Product!under!test!

Ideal!Test!Pyramid!

BusinessTfacing!Tests!

TechnologyTfacing!Tests!

•  Cost!•  Effort!•  Time!

Page 57: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

1st!candidate!•  Automate!&•  High&Value,&Low&Cost&

2nd!candidate&•  Automate!&•  High&Value,&High&Cost&

Can!Automate?&•  Manual&Regression?&

•  Low&Value,&Low&Cost&

Do!Not!Automate(•  Manual&Regression!&

•  Low&Value,&High&Cost&

High!Value!

High!!Cost!

Low!Value!

Low!Cost!

Page 58: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Principles!of!Test!AutomaCon!Framework!

Page 59: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Test&Automa+on&Code&should&be&treated&with&same&‘respect’&as&

Product&Code&

Page 60: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Principles&for&building&an&Automa+on&Framework(

Code&Quality&

Design&PaUerns&

Abstrac+on&Layers&

Refactor&Pairing&

Evolve&

Extend&

Page 61: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Guidelines&for&building&an&Automa+on&Framework(

Easy&to&Use&&&Reuse&

Maintainable&

Scalable&

Browser&/&DB&/&OS&/&??&support&

Known&Restric+ons&/&Constraints&

Local&Vs&Remote&

Parallel&Execu+on&

Page 62: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Prac+ces&for&building&an&Automa+on&Framework(

Configurable&

Con+nuous&Integra+on&(CI)&

Screenshots,&Video&

Recording&

Logging&Tools&&&U+li+es&

Test&Data&

No&Copy[Paste&

Page 63: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Context!is!KING!&

Domain!

ProductTunderTtest!

Tech!Stack! Team!DistribuCon!

Skills!

Capability!

Process! Test!Tech!Stack!

Tools!

Page 64: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Automate&tests&that&are&valuable,&not&because&you&can&or&like&to&

automate!(

Page 65: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Different!Roles!&!AcCviCes!of!a!Quality!Analyst!

Page 66: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks
Page 67: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

QA!Role!

Product! Services!

Page 68: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

QA!Role!in!Product!OrganizaCons!

CoTlocated! Distributed!

Page 69: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

QA!Role!in!Services!OrganizaCons!

Coaching! OffTShore!Delivery!

ConsulCng! DevOps!

OnTSite!Delivery!

Page 70: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

What&is&the&Future&of&a&Quality&Analyst?&

Page 71: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks
Page 72: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks
Page 73: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks
Page 74: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks
Page 75: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Be&Crea+ve&

Page 76: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks
Page 77: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks
Page 78: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Making!an!Idea!a!Reality!

Innovators(

Early(Adopters(

Early(Majority(

Late(Majority(

Laggards(

Page 79: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

Who&are&you?&&&&

Where&do&you&want&to&be?&

Page 80: Future of Testing Automation and QA - Anand Bagmar, ThoughtWorks

[email protected]((

[email protected](

(

(((((@BagmarAnand(

(

about.me/anand.bagmar(

Thank(you(