andrew goslin - tmmi, what is not in the text book - eurostar 2010

28
©2010 TMMi Foundation 1 TMMi What is not in the text book… Andrew Goslin TMMi Foundation EuroSTAR December 2010 www.tmmifoundation.org

Upload: eurostar-software-testing-conference

Post on 01-Jul-2015

146 views

Category:

Technology


1 download

DESCRIPTION

EuroSTAR Software Testing Conference 2010 presentation on TMMi, What is Not in the Text Book by Andrew Goslin. See more at: http://conference.eurostarsoftwaretesting.com/past-presentations/

TRANSCRIPT

Page 1: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

©2010 TMMi Foundation 1

TMMiWhat is not in the text book…

Andrew Goslin

TMMi Foundation

EuroSTAR – December 2010

www.tmmifoundation.org

Page 2: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

Agenda

What is TMMi?

Where does TMMi add value?

Tips for using TMMi

Benefits of using TMMi

2©2010 TMMi Foundation

Page 3: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

A “non-technical” overview

What is TMMi?

3©2010 TMMi Foundation

Page 4: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

Why improve processes?

Is your process good enough?

Can your organisation save money?

Software failures are expensive!

Testing is ineffective in many

organisations!

What do your customers think of your

software?

4©2010 TMMi Foundation

Page 5: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

“Good Practice”

Is there such a thing as “good practice”?

Many examples, in many contexts

Government, Health, Education, Management,

Employment, Project Delivery, etc

Codes of Practice, Good Practice Guidelines

Often include legal and ethical basis

What about your context?

No such thing as “good practice”?

Re-engineering the wheel?

5©2010 TMMi Foundation

Page 6: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

TMMi “Good Practice”

Good practice is established on

Hard won lessons

Research – scientific experimentation

TMMi is a model of “good practice”

Based on practical experience

Based on research and industry knowledge

Is subject to “open” peer review

6©2010 TMMi Foundation

Page 7: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

Structural overview

7©2010 TMMi Foundation

Levels

Process Areas

Goals

Practices

Page 8: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

Structure - Levels

8©2010 TMMi Foundation

Level 1 – Initial

No process areas

Level 2 – Managed

5 process areas

Level 3 – Defined

5 process areas

Level 4 – Management &

Measurement

3 process areas

Level 5 – Optimization

3 process areas

Page 9: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

Structure – Level 2 Processes

9©2010 TMMi Foundation

Level 2 – Managed

2.1 Test Policy & Strategy

2.2 Test Planning

2.3 Test Monitoring & Control

2.4 Test Design & Execution

2.5 Test Environment

Page 10: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

Structure – Test Planning

Specific Goals

Perform a product risk assessment

Establish a test approach

Establish test estimates

Develop a test plan

Obtain commitment to the test plan

Generic Goal

Institutionalize a Managed Process

10©2010 TMMi Foundation

Page 11: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

Reasons for structure?

Levels

Built-in structure for improvement

Focus “externally” on stakeholders

Simple model to explain to management

Process Areas & Goals

Detail requirements to achieve maturity level

Focus on “internally” on practitioners

Detail for implementation

©2010 TMMi Foundation 11

Page 12: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

Where and how to exploit TMMi

Where does TMMi add value?

©2010 TMMi Foundation 12

Page 13: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

Context

Organisation

Business objectives – products & services

Project Delivery

Suppliers

Methodology

Type of systems

Tools

People

©2010 TMMi Foundation 13

Page 14: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

Implementation Approach 1

Tactical project focused

Address project issues, only

Answer questions like

What is working well? Keep doing!

What is not working? What action is needed?

Eg: Testing too broad, defects missed

Product risk workshop?

Test prioritized – depth and breadth?

©2010 TMMi Foundation 14

Page 15: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

Implementation Approach 2

Strategic organisation wide

Answer questions like

How to deliver consistently? Predictable cost!

How to integrate testing into delivery process?

Eg: Variable quality, inconsistent approach

Assess Level 2 strengths & weaknesses

Establish prioritized plan to consolidate

strengths and improve weaknesses

©2010 TMMi Foundation 15

Page 16: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

Implementing TMMi-based change

Tips for using TMMi

16©2010 TMMi Foundation

Page 17: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

1: Identify Goals

What are you trying to achieve?

Organisation level

What are your business drivers?

What is your IT strategy?

What is the state of health?

Project level

What problems are you trying to address?

Symptoms? Root causes?

©2010 TMMi Foundation 17

Page 18: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

©2010 TMMi Foundation

2: Business Case & Plan

Where are we now?

Plan a TMMi-based assessment

Where do we want to be?

Align TMMi implementation with goals

What do we need to get there?

What resources do we need? Costs?

What benefits will be achieved?

Consider financial and “soft” benefits

18

Page 19: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

©2010 TMMi Foundation

3: Identify Stakeholders

Who does this impact?

Change is painful

Whose support is required?

Funding & change champion

Are the goals aligned?

Own and stakeholders needs?

19

Page 20: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

©2010 TMMi Foundation

4: Establish Priorities

Complete an informal assessment

Sample actual projects

Report strengths and weaknesses

Establish priorities

Aligned with goals

Consolidate strengths & address weaknesses

Identify quick wins and longer term actions

Create plan with task owners, deadlines, etc

20

Page 21: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

©2010 TMMi Foundation

5: Implement & Monitor Plan

Agree the plan: sponsor & stakeholders

Ensure you have support for change

Implement the plan

Monitor progress

Celebrate successes – encourages change

Take corrective action for issues

Monitor “earned value”

Build ongoing support current & future change

21

Page 22: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

Managing Change - Negative

22©2010 TMMi Foundation

Page 23: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

Managing Change - Positive

23©2010 TMMi Foundation

Page 24: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

Example: Test Planning

24©2010 TMMi Foundation

Page 25: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

Why TMMi makes business sense

Benefits of using TMMi

©2010 TMMi Foundation 25

Page 26: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

©2010 TMMi Foundation 26

Benefits of using TMMi

Open independent standard

Focus on good practice in context

Applies regardless of delivery methods

Applies in most industry contexts

Designed for ease of implementation

Engaging sponsors & stakeholders

Establishing scope & business case

Implementing prioritised change

Page 27: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

Business benefits

Benefits indicated by field experience

Ability to plan and estimate costs consistently

Reduced cost of delivery

Ability to reduce cost of supplier contracts

Improved productivity

Improved quality of delivery

Improved customer satisfaction

Ability to plan further targeted improvements

©2010 TMMi Foundation 27

Page 28: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010

Questions?

Information? www.tmmifoundation.org

[email protected]

Resources? www.tmmifoundation.org/resources

[email protected]

©2010 TMMi Foundation 28