tmmi e-survey guidance

Listen | Challenge | Understand | Interpret | Create

Private & Confidential Experimentus Ltd 17a Dorset Square London NW1 6QB T: +44 (0)207 871 2300 www.experimentus.com

Test Maturity Model integration (TMMi) e-Survey

v0.4

Copyright © 2012 Experimentus Ltd

Content

About TMMi

TMMi Structure

TMMi Levels

e-Survey guidance

2


Test Maturity Model Integration

Developed by the TMMi Foundation (http://www.tmmifoundation.org/)

Based on a wide variety of public domain industry sources

– including the TMM framework originally developed by Illinois Institute of Technology

5 levels of test maturity (staged model)

– Complements the existing CMMI framework

Empirically validated

The worlds only independent test process measurement method

Describes the processes needed to ensure a well planned and controlled test organisation

3


TMMi Structure

4

MaturityLevel

ProcessAreas

containsindicates

Testing Processcapability

Goals

achieves

Implementation

describes

Specific &Generic Practices

contains

Copyright © 2012 Experimentus Ltd5

1 – Initial

2 – Managed•Test Policy & Strategy•Test Planning•Test Monitoring & Control

•Test Design & Execution•Test Environment

3 – Defined•Test Organisation•Test Training Programme•Test Life Cycle & Integration

•Non-Functional Testing•Peer Reviews

4 – Management and Measurement•Test Measurement•Product Quality Evaluation

•Advanced Reviews

5 - Optimisation•Defect Prevention•Test Process Optimisation

•Quality Control1 – Initial

2 – Managed

3 – Defined

4 – Quantitatively Managed

5 - Optimizing

TMMi Maturity Levels


Level 2 - Managed

The status of the work products and the delivery of testing services are visible to management, however testing may still start relatively late in the development life cycle

Testing is multileveled, i.e. there are unit, integration, system and acceptance test levels

The main objective of testing in a TMMi level 2 organisation is to verify that the product satisfies the specified requirements

Process Areas

2.1 Test Policy & Strategy

2.2 Test Planning

2.3 Test Monitoring & Control

2.4 Test Design & Execution

2.5 Test Environments

6


Level 3 - Defined

Testing is fully integrated into the development life cycle

The organisations test standards are established and improved over time and test process improvement is fully institutionalised

A specific organisation test training programme exists and testing is perceived as being a profession and test professionals are involved with reviews of requirements

Process Areas

3.1 Test Organisation

3.2 Test Training Program

3.3 Test Lifecycle & Integration

3.4 Non Functional Testing

3.5 Peer Reviews

7


TMMi Reference Material

For more information on TMMi, visit the TMMi foundation website

www.tmmifoundation.org

8

http://www.tmmifoundation.org/


The TMMi e-Survey

9


Browser based

Sections:

1. Testing trends & non-TMMi

2. TMMi Process Area rating

3. Optional Comments

Features

– Simple scoring method

– Focuses on areas pertinent to your role

– “Save & Continue Survey Later”

The e-Survey


Completing the e-Survey

Should take between 30 mins and 1 hour to complete

Process areas presented based on your role in the organisation

– You can select to complete all process areas if you like

For each process area there are two elements:

1. Statement scores against the model

2. Process implementation effectiveness



Statement scores against the model

– Review each statement, then select a score between 0 and 10 based on how much you agree that the statement is true for your organisation

– If you don’t have an opinion, please leave the score blank



Process implementation effectiveness

– For each process area, select a star ranking for:

How well you feel the organisation has approached the definition of the process area

How well you feel the organisation has deployed changes in the process area

How good you think the results of deployed process changes for the process area are



Testing Trends and non-TMMi section

– Obtains a personal view of testing progress in your organisation over the last 2 years

– Contains statements on areas outside of TMMi that may still impact your organisations test process effectiveness



Your views are important: please answer honestly

No preparation is required

Do not use reference material to help you answer questions

Your first answer is most often the right answer

Please make time to complete the survey!


“Save and continue survey later”

Use this if you can’t complete the e-Survey in one session

Allows you to save what you have entered and return later

Only saves data entered on submitted pages


Things to note

Responses are completely confidential

Assessment Team only will see individual data

Important: this should be a personal perspective:

– Please do not collaborate with colleagues or management

– Responses should be based on experience, not research

– Do not spend too much time trying find the “right” response

– Your first answer is generally the best answer


Next steps

18


Wrap-up and Next steps

The survey must be completed within the requested time frame

Results will be consolidated, analysed and summarised

The final findings analysis is presented back to the sponsor

19


Questions & Concerns

For queries, please contact the Assessment Team Lead

Alternatively, contact your TMMi assessment contact

Details for both are provided in the invitation email


Thank you

www.experimentus.com

+44 (0) 207 871 2300

[email protected] : @experimentus

tmmi e-survey guidance

Technology

test planningmay

initial test measurement

test policy strategyservices

test training programstandards

test design execution

tmmi process area rating3

experimentus ltd4

experimentus ltd3