test process improvement asking the big questions? graham thomas softtest belfast, dublin, galway 30...

23
Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

Upload: victor-smith

Post on 13-Dec-2015

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

Test Process Improvement

Asking the BIG questions?

Graham ThomasSOFTTESTBelfast, Dublin, Galway30th Nov – 2nd Dec 2011

Page 2: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

Photo: R. Marselis 2011 2

Page 3: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

Abstract

We all need to improve the testing process, but very few people actually answer the BIG questions, such as:

Why? Is it just to save money, or do it quicker?

How? Do we follow an accepted method – TPI, TMMi? What change methodologies are there that we can use?

What? Is it just automating test execution. What about planning, preparation, measurement and metrics, etc.?

Where and When? So where in our organisations, large and small, do we do this, and when is the best time?

And Who? Is this just a testing team initiative? Do we need help? Who else is involved?

It is easy to ask the BIG questions but what we really want to know are the BIG answers! This session will work through these questions to draw useful conclusions from the group’s collective experience.

3© Graham Thomas 2011

Page 4: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

“To find fault is easy; to do better may be difficult”

Plutarch (c.46AD – c.120AD)Greek / Roman - historian, biographer, essayist

What did they know 2000 years ago that we don’t know now?

4© Graham Thomas 2011

Page 5: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

Why ?

To save money To do testing quicker (take less time)

More Efficient More Effective Achieve Best organisational benefit Speed to Market

Improve our skills And our market value

More satisfying More rewarding

5© Graham Thomas 2011

Page 6: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

Necker Cube

© Graham Thomas 2011 6

Page 7: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

Necker Cube

So what did you see ?

Up and down ?

Left to Right ?

Switched from one to the other ?

When did the switch happen ?

It is a simple 4 frame animation.

There is no switch !

It is all in your brain !

© Graham Thomas 2011 7

Page 8: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

© Graham Thomas 2011 8

Perspective:- The view will be different depending upon where you stand

Page 9: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

How ?

TPI and TMMi Central Improvement team

Change Program

Change Models Kübler-Ross Gartner Hype Cycle There are others . . . William Bridges ,

Virginia Satir, Strickland

Continuous improvement vs. Capability Levels

Where does it end?9© Graham Thomas 2011

Page 10: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

How to Implement

There are 3 Basic Types of Implementation Approach

Incremental

Step Change

Thin Threads

© Graham Thomas 2011 10

Page 11: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

What?

You have Quality Centre . . . What more can you want?

Tools, Process, Metrics, Investment, Training . . . To start with

Specific improvement measures, e.g.

Capability Assessment11© Graham Thomas 2011

Page 12: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

Test Automation Load & Performance Test Code Quality Debuggers Sniffers / Scanners Analysers Process and Performance Monitors Data Generators Data Fuzzers. . . Test Process Management

Defects Test Cases Traceability

Shopping List

Tools & Process People Skills Training

Tools Processes Capability (Techniques)

Knowledge Domain Context

Development Conferences Seminars

Give Back Program Internally Externally

© Graham Thomas 2011 12

Page 13: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

But what improvement is right for me?

© Graham Thomas 2011 13

Page 14: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

Where ?

© Graham Thomas 2011 14

Mercator Projection Gall-Peters Projection

Where:- Central Improvement Team

(Centre of Excellence) Top Down – Imposition Team by Team Everywhere

Where you can have greatest effect With the team effecting the change With your; Testers, Business Users

and Developers

Avoid Head Office The Management Floor Your desk – Do you even need one?

Everything you do will be in the public eye

Page 15: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

Where ?

Wherever you need to be

Go to them, don’t ask them to come to you

It is only be meeting people that you will: See their body language Share their problems Begin to see things from their perspective Help them quickly and more easily

And they will be able to: Share in your enthusiasm Understand your passion Begin to share your mind-set Be influenced by you !

© Graham Thomas 2011 15

Page 16: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

When ?

© Graham Thomas 2011 16

Doomsday Clock – 11:54pm

When thinking about timing you also need to know your approach Big Bang timing is critical Incremental timing no so much Thin Threads can be timed for best chance of success

Quick wins maintain momentum Select projects that want to change Start small and build big

Communicate, communicate, communicate Regularly Publicise your successes Be open about your failures Use measures to show benefits

Page 17: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

When ?

© Graham Thomas 2011 17

Page 18: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

Who ?

“You must be the change you wish to see in the world”

Mahatma Ghandi (1869 – 1948)

An Agent of Change

Leadership

Skilled & Experienced

Understand the process of change

Understand and deal with how people are affected by change

18© Graham Thomas 2011

Page 19: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

© Graham Thomas 2011 19

Q: How many change managers does it take to change a light bulb?

A: Just One. But, the light bulb has got to want to change !

Page 20: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

Some thoughts to Ponder So you have improved Testing, but where do you

stop?

There is an argument that Change Programs should never end

But you run out of budget You reach a point of diminishing returns You run out of time

What you are doing now is Good Enough

Or worse still, you either realise:- Improving Testing will actually make things worse

because of all of the other problemsOr It would make sense in the first place to fix;

Requirements, Analysis, Development, and maybe Project & Program Management, before Testing Change will be really effective

© Graham Thomas 2011 20

Page 21: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

Lessons Learnt Don’t forget to change the people as well as

the processes Change can be difficult and painful Just because people say they want to

change doesn’t mean they do There are many ways to avoid change Change is often uncomfortable We look back fondly on the old ways,

remembering them as better than they actually were!

Understand your capacity for change and don’t exceed it

Remember it is often the case that the processes you are changing were designed and built by the people you are changing!

© Graham Thomas 2011 21

Manual Automatic

Road Rail

Laptop Netbook

Electric ?

WAH ?

Tablet ?

My personal change journey

Page 22: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

Conclusion

Understand how others see the world and the change they are faced with

Remember your Context is Everything

The time to start is NOW !

© Graham Thomas 2011 22

The time to be scared is before you enter the cage!

Page 23: Test Process Improvement Asking the BIG questions? Graham Thomas SOFTTEST Belfast, Dublin, Galway 30 th Nov – 2 nd Dec 2011

Contact Details

Graham Thomas

Independent SoftwareTesting Consultant

[email protected]@GrahamNThomas

+44 7973 387 853 www.badgerscroft.com

23© Graham Thomas 2011