to improve or not improve that is the question by geoff ... improve or not improve that is...

To improve or not to improve, that is the question?

Presented by:Geoff Thompson

Listen | Challenge | Understand | Interpret | Create

Private & Confidential Experimentus Ltd 17a Dorset Square London NW1 6QB T: +44 (0)207 871 2300 www.experimentus.com

Geoff Thompson

ANZTB Test 2012 – Wellington7th March 2012

An IT services company that provides organisations with software quality management expertise

Four key solutions aimed at optimising our clients approach to Software Quality

Management

Consultancy Solutions

Experimentus is…

Copyright © 2012 Experimentus Ltd

The world’s leading provider of TMMi Assessments and Certifications, TMMi Licensing and a TMMi Compliant Industrialised Testing Methodology

Solutions

TransformationTMMi

CertificationAdvisory &

DeliveryLicencing

2

Experimentus…

Was one of the first companies to be accredited by the TMMi Foundation

Has undertaken over 50 formal accredited TMMi assessments

Has 9 accredited TMMI assessors

Has formally TMMi certified two companies:

Copyright © 2012 Experimentus Ltd 3

Has formally TMMi certified two companies:

MTP – Level 2 and 3

UK Home Office – Level 2

Has a TMMi compliant test method to aid client implementations

Licences its accredited TMMi assessment method

Is working with most large System Integrators who are on the TMMi certification journey

“To find fault is easy; to do better may be difficult”

Plutarch

“Companies invest significant amounts in maintaining

processes that don’t work, particularly in the areas of Software

Why change?


processes that don’t work, particularly in the areas of Software

Quality, but will invest little in getting it right”

Martin Adcock

“Those who don’t learn from history are doomed to repeat it”

George Santayana

We all want processes like this?


However reality is….


When and What to improve

When:-Does timing even matter?

Once you have a business case


A bit at a time

Use a model to help understand what's needed

Only what you have a business case for

What:-

To model or not to model that is the question?

Non-model based approach

involves process

improvements by adapting

Model based process improvement incorporates

process improvement with

international standards and frameworks such as the SEI’s

CMMI frameworks, ISO


improvements by adapting what already exists and

augmenting with process

components picked up at

conferences/training.

These processes typically tend

to be home grown untried and

untested

CMMI frameworks, ISO

frameworks, ITIL, TMMi, PCMM and various others.

Using such models allows

organisations to compare their practices with internationally

recognized industry good

practices.

What is TMMi…


TMMi structure


Growth in the use of TMMi model

Independent model – non commercial

Freely available – download from www.tmmifoundation.org

No defined test process – it defines process components allowing the implementation to be flexible for adapted for each customer

Accredited assessment methods are as applicable for Structured as well as


Accredited assessment methods are as applicable for Structured as well as Agile methods

Accredited Assessments are repeatable by any

accredited company

51 countries involved – a truly international model

5 levels of maturity

Aligns with CMMi

Easy to recognise levels of maturity

0

10

20

30

40

50

60

70

80

90

1 2 3 4 5 6 7 8 9 10 11 12

The CMMi challenge!

“We are CMMi certified we don’t need TMMi”

TMMi stands alone and so does cover some CMMi process areas for completeness

Peer Reviews


75% of TMMi is not covered at all in CMMi

They compliment each other – they are not in competition

How!

Measure

Prioritise & Plan

Evolve

Initiate

OrganisationOrganisation

• Action Planning• Target Setting

• Evolution of programme approach & targets

• Assess Process/monitor against plan

• Obtain agreement to progress


Define / Re-define

Operate

Validate

ProcessProcess TechnologyTechnology

• New process definition/refinement

• Training• Pilot• Full deployment

• Monitoring of results against targets

What have we found out about the industry?

Background

The need to understand the industry

Survey data updated during last quarter 2010


Over 100 respondents together with the results from Experimentus formal assessments

Many industry sectors represented

Respondents based in 4 different continents

14

Overall results


By industry sector

Industry Sectors

TMMi Level 2

Copyright © 2012 Experimentus Ltd16

TMMi Level 2

TMMi Level 1

16

Some detail ☺☺☺☺


Some more ��


Inward looking – need to be more outward facing


Benefits of Test Process Improvement with TMMi

40% savings made after changes made to ensure certification to Level 2, for a UK Government dept

A UK bank saved 8% of their entire IT budget and improved development output by 12%

An insurer saved £440,000 on a £2m project


An insurer saved £440,000 on a £2m project

A retailer saves at least 12% on every project after

the improvements

A test services company has increased their efficiency by 8%

Retailer reversed their decision to outsource, when recommendations including an ROI showed them it will be a lot cheaper if they improved the internal processes

2020

But this success is not just process….E

nth

us

ias

m

MaximumHype

Disillusionment

Practical Benefit


Assess and develop Improvements

ImplementationBAU,

review

En

thu

sia

sm

Actual UseDisillusionment

RIP

Communicate


But…..


Remember….

� Never start an improvement program without measuring your start position

� Always ensure you understand and get


� Always ensure you understand and get agreement to the benefits of the changes

� Communicate, communicate, and then communicate some more (Bob Nelson Ph.D)

Contribute to the survey yourself…

WWW.EXPERIMENTUS.COM


WWW.EXPERIMENTUS.COM

26

Thank you


www.experimentus.com

+44 (0)207 871 2300

[email protected]

to improve or not improve that is the question by geoff ... improve or not improve that is...

Documents