to improve or not improve that is the question by geoff ... improve or not improve that is...
Post on 25-May-2018
216 Views
Preview:
TRANSCRIPT
To improve or not to improve, that is the question?
Presented by:Geoff Thompson
Listen | Challenge | Understand | Interpret | Create
Private & Confidential Experimentus Ltd 17a Dorset Square London NW1 6QB T: +44 (0)207 871 2300 www.experimentus.com
Geoff Thompson
ANZTB Test 2012 – Wellington7th March 2012
An IT services company that provides organisations with software quality management expertise
Four key solutions aimed at optimising our clients approach to Software Quality
Management
Consultancy Solutions
Experimentus is…
Copyright © 2012 Experimentus Ltd
The world’s leading provider of TMMi Assessments and Certifications, TMMi Licensing and a TMMi Compliant Industrialised Testing Methodology
Solutions
TransformationTMMi
CertificationAdvisory &
DeliveryLicencing
2
Experimentus…
Was one of the first companies to be accredited by the TMMi Foundation
Has undertaken over 50 formal accredited TMMi assessments
Has 9 accredited TMMI assessors
Has formally TMMi certified two companies:
Copyright © 2012 Experimentus Ltd 3
Has formally TMMi certified two companies:
MTP – Level 2 and 3
UK Home Office – Level 2
Has a TMMi compliant test method to aid client implementations
Licences its accredited TMMi assessment method
Is working with most large System Integrators who are on the TMMi certification journey
“To find fault is easy; to do better may be difficult”
Plutarch
“Companies invest significant amounts in maintaining
processes that don’t work, particularly in the areas of Software
Why change?
Copyright © 2012 Experimentus Ltd 4
processes that don’t work, particularly in the areas of Software
Quality, but will invest little in getting it right”
Martin Adcock
“Those who don’t learn from history are doomed to repeat it”
George Santayana
We all want processes like this?
Copyright © 2012 Experimentus Ltd 5
However reality is….
Copyright © 2012 Experimentus Ltd 6
When and What to improve
When:-Does timing even matter?
Once you have a business case
Copyright © 2012 Experimentus Ltd 7
A bit at a time
Use a model to help understand what's needed
Only what you have a business case for
What:-
To model or not to model that is the question?
Non-model based approach
involves process
improvements by adapting
Model based process improvement incorporates
process improvement with
international standards and frameworks such as the SEI’s
CMMI frameworks, ISO
Copyright © 2012 Experimentus Ltd 8
improvements by adapting what already exists and
augmenting with process
components picked up at
conferences/training.
These processes typically tend
to be home grown untried and
untested
CMMI frameworks, ISO
frameworks, ITIL, TMMi, PCMM and various others.
Using such models allows
organisations to compare their practices with internationally
recognized industry good
practices.
What is TMMi…
Copyright © 2012 Experimentus Ltd 9
TMMi structure
Copyright © 2012 Experimentus Ltd 10
Growth in the use of TMMi model
Independent model – non commercial
Freely available – download from www.tmmifoundation.org
No defined test process – it defines process components allowing the implementation to be flexible for adapted for each customer
Accredited assessment methods are as applicable for Structured as well as
Copyright © 2012 Experimentus Ltd 11
Accredited assessment methods are as applicable for Structured as well as Agile methods
Accredited Assessments are repeatable by any
accredited company
51 countries involved – a truly international model
5 levels of maturity
Aligns with CMMi
Easy to recognise levels of maturity
0
10
20
30
40
50
60
70
80
90
1 2 3 4 5 6 7 8 9 10 11 12
The CMMi challenge!
“We are CMMi certified we don’t need TMMi”
TMMi stands alone and so does cover some CMMi process areas for completeness
Peer Reviews
Copyright © 2012 Experimentus Ltd 12
75% of TMMi is not covered at all in CMMi
They compliment each other – they are not in competition
How!
Measure
Prioritise & Plan
Evolve
Initiate
OrganisationOrganisation
• Action Planning• Target Setting
• Evolution of programme approach & targets
• Assess Process/monitor against plan
• Obtain agreement to progress
Copyright © 2012 Experimentus Ltd 13
Define / Re-define
Operate
Validate
ProcessProcess TechnologyTechnology
• New process definition/refinement
• Training• Pilot• Full deployment
• Monitoring of results against targets
What have we found out about the industry?
Background
The need to understand the industry
Survey data updated during last quarter 2010
Copyright © 2012 Experimentus Ltd
Over 100 respondents together with the results from Experimentus formal assessments
Many industry sectors represented
Respondents based in 4 different continents
14
Overall results
Copyright © 2012 Experimentus Ltd 15
By industry sector
Industry Sectors
TMMi Level 2
Copyright © 2012 Experimentus Ltd16
TMMi Level 2
TMMi Level 1
16
Some detail ☺☺☺☺
Copyright © 2012 Experimentus Ltd1717
Some more ����
Copyright © 2012 Experimentus Ltd1818
Inward looking – need to be more outward facing
Copyright © 2012 Experimentus Ltd 19
Benefits of Test Process Improvement with TMMi
40% savings made after changes made to ensure certification to Level 2, for a UK Government dept
A UK bank saved 8% of their entire IT budget and improved development output by 12%
An insurer saved £440,000 on a £2m project
Copyright © 2012 Experimentus Ltd
An insurer saved £440,000 on a £2m project
A retailer saves at least 12% on every project after
the improvements
A test services company has increased their efficiency by 8%
Retailer reversed their decision to outsource, when recommendations including an ROI showed them it will be a lot cheaper if they improved the internal processes
2020
But this success is not just process….E
nth
us
ias
m
MaximumHype
Disillusionment
Practical Benefit
Copyright © 2012 Experimentus Ltd 21
Assess and develop Improvements
ImplementationBAU,
review
En
thu
sia
sm
Actual UseDisillusionment
RIP
Communicate
Copyright © 2012 Experimentus Ltd 22
But…..
Copyright © 2012 Experimentus Ltd 23
Remember….
� Never start an improvement program without measuring your start position
� Always ensure you understand and get
Copyright © 2012 Experimentus Ltd 24
� Always ensure you understand and get agreement to the benefits of the changes
� Communicate, communicate, and then communicate some more (Bob Nelson Ph.D)
Test Process Improvement
That’s one small step for a tester,
Copyright © 2012 Experimentus Ltd 25Neil Armstrong 1969
That’s one small step for a tester, one giant step for all testers
Contribute to the survey yourself…
WWW.EXPERIMENTUS.COM
Copyright © 2012 Experimentus Ltd
WWW.EXPERIMENTUS.COM
26
Thank you
Copyright © 2012 Experimentus Ltd
www.experimentus.com
+44 (0)207 871 2300
info@experimentus.com
top related