cmmi maturity profile 2010sepcmmi

Software Engineering InstituteCarnegie Mellon

CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal ResultsSoftware Engineering InstituteCarnegie Mellon

Process Maturity Profile

CMMI® For DevelopmentSCAMPISM Class A Appraisal Results 2010 Mid-Year Update

September 2010

September 2010 Process Maturity Profile - © 2010 by Carnegie Mellon University

September 2010

We could not produce this report

without the support of the organizations

and lead appraisers who reported their

appraisal results to the SEISM.

Our many thanks for their continuing

cooperation with our data collection

and analysis efforts.

CMMI Appraisal Program

The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Defense and operated by Carnegie Mellon® University

® CMMI, Capability Maturity Model and Carnegie Mellon are registered in the U.S. Patent and Trademark Office by Carnegie Mellon University

SM SCAMPI and SEI are service marks of Carnegie Mellon University

© 2010 by Carnegie Mellon University


CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results

Outline

Introduction

Current Status

Community Trends

Organizational Trends


Organizational Trends

Summary And Terms used in this Briefing

How to Report your Appraisal Results to the SEI

This briefing is based solely on the appraisals reported to the SEI. It cannot be used as a source for an exact indicator of all organizations in the world using CMMI models or appraisal methods nor can it be used for certification or verification purposes.

The SEI does not certify appraisal results or organizations. The SEI licenses SEI Partners, authorizes/certifies lead appraisers, team leaders and high maturity lead appraisers to conduct appraisals. Neither the SEI nor any other organization is a “certifying authority” of the results from a SCAMPI appraisal. Therefore requests to the SEI to provide information to be used for this purpose can not be fulfilled. Information provided by the SEI, such as this briefing, is to demonstrate reported results of the use of CMMI products and services only.

Organizations performing source selection or verification should consider performing an evaluation appraisal. For more information on appraisal methods and for a directory of authorized lead appraisers who can perform them, visit: http://www.sei.cmu.edu/cmmi/casestudies/profiles/cmmi.cfm



Introduction: Purpose

Characterize the adoption of CMMI® - DEV®

Describe results from Standard CMMI Appraisal Method for Process Improvement (SCAMPISM) v1.1/v1.2 Class A appraisals using Capability Maturity Model® Integration(CMMI-SE/SW/IPPD/SS v1.1 or CMMI - DEV v1.2) *

Encourage continued reporting of results


Encourage continued reporting of results

* Organizations previously appraised against CMMI v1.0 and which have not reappraised against v1.1 or v1.2 are not included in this report

Please visit: http://www.sei.cmu.edu/cmmi/casestudies/profiles/cmmi.cfm for additional information or questions you may have about this briefing before contacting the SEI directly



This briefing includes three primary sections:

1. Current Status- Snapshot of the software community based on the most

recent appraisal, since 2002, of reporting organizations

2. Community Trends- Global distribution of appraisals

Introduction - 2: Briefing Contents


- Global distribution of appraisals

- Growth in the number of appraisals performed - Shifts in the maturity profile over time

3. Organizational Trends- Time to move up in maturity based on change in maturity

level and time between appraisals



Current Status

SCAMPI v1.1/v1.2 Class A appraisals conducted from the SCAMPI V1.1 April 2002 release through and reported to the SEI by

• appraisals• organizations

July 2010

6,126

June 2010

4909


• organizations• participating companies• reappraised organizations• projects• Non-USA organizations

Please refer to: Terms Used in this Report on page 27

Additional charts providing different views and break down of this information will be added to this briefing

as more appraisal data is reported to the SEI over time.

3,857

957

34,291

75.3%

4909


CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal ResultsN

um

ber

Of

Org

an

izati

on

s

2000

2200

2400

2600

2800

3000

3200

3400

3600

Process Maturity Profile by All Reporting Organizations

55.3%


Based on most recent appraisal of organizations

Nu

mb

er

Of

Org

an

izati

on

s

0

200

400

600

800

1000

1200

1400

1600

1800

2000

Not Given Initial Managed Defined Quantitatively Managed

Optimizing

4909

6.5%

0.8%

27.5%

2.5%

7.3%



1600

1800

2000

2200

2400

2600

2800

Nu

mb

er

Of

Org

an

izati

on

s

Process Maturity Profile (V1.2 Only)by All Reporting Organizations

63.9%


Based on most recent appraisal of organizations3284

0

200

400

600

800

1000

1200

1400


Optimizing

Nu

mb

er

Of

Org

an

izati

on

s

4.5%

0.4%

24.5%

1.7%

5.0%



Reporting Organization Categories

Contractor for

Commercial/In-house

18.0%

77.8%


Based on organizations reporting an organization category

0 1000 2000 3000 4000 5000

Military/Government Agency

Contractor for Military/Government

Number of Organizations

18.0%

4.2%

4909


CMMI®- DEV v1.1/v1.2 – SCAMPI v1.1/V1.2 Class A Appraisal Results%

Of

Org

an

izati

on

s W

ith

in C

ate

go

ry

Process Maturity Profile by Reporting Organization Categories

58.1%60%

70%

80%

90%

100%

Commercial/In-house = 3779

Contractor for Military/Government = 874

Military/Government Agency = 206


Based on most recent appraisal of organizations reporting an organization category

% O

f O

rgan

izati

on

s W

ith

in C

ate

go

ry

5.3%

0.6%

25.8%

2.9%

7.2%8.0%

1.4%

31.5%

49.3%

1.0%

8.8%

22.3%

1.0%

45.6%

26.7%

1.5%2.9%

0%

10%

20%

30%

40%

50%


Optimizing

4859



Retail Trade0.2%

Wholesale Trade0.1%

Transportation, Communication, Electric, Gas

and Sanitary Services3.4%

Finance, Insurance and Real Estate5.4%

Public Administration (Including Defense)

3.1%

Fabricated Metal Products0.1%

Primary Metal Industries0.3%

Industrial Machinery And Equipment

Organization TypeBased on Primary Standard Industrial Classification (SIC) Code


Equipment0.7%

Electronic & Other Electric Equipment

10.1%

Instruments And Related Products

0.9%

Transportation Equipment2.2%

Other Manufacturing Industries

1.3%Health Services

1.3%

Other Services10.9%

Engineering & Management Services24.2%

Business Services35.7%

Based on organizations reporting SIC code. For more information visit: http://www.osha.gov/oshstats/sicser.html4222

Manufacturing

15.7%

Services

72.1%



25 or fewer17.3%

301 to 5006.1%

501 to 10005.0%

1001 to 20002.4%

2000+1.6%

Organization SizeBased on the total number of employees within the area of the organization that was appraised

201 to 2000+

22.6%


26 to 5022.0%

51 to 7512.6%

76 to 1008.3%

101 to 20017.3%

201 to 3007.3%

Based on organizations reporting size data4863

1 to 100

60.2%

22.6%



Maturity Profile by Organization Size Based on the total number of employees within the area of the organization that was appraised

% o

f O

rgan

izati

on

s b

y S

ize

49

.4%

62

.6%

61

.2%

61

.7%

56

.6%

52

.4%

54

.2%

52

.1%60%

70%

80%

90%

100%


Based on organizations reporting size data

% o

f O

rgan

izati

on

s b

y S

ize

5.6

%

5.0

%

5.5

%

6.5

%

8.3

%

8.1

%

5.7

% 8.2

%

12

.6%

6.3

%

0.7

%

0.6

%

0.8

%

1.0

%

1.7

%

0.3

%

0.8

%

2.5

%

49

.4%

29

.5%

26

.9%

21

.6%

21

.3%

22

.1%

17

.7%

12

.8%

4.2

%

3.8

%

43

.5%

52

.4%

54

.2%

47

.3% 5

2.1

%

48

.8%

0.2

%

1.0

%

2.1

% 4.2

%

3.5

%

5.3

%

5.4

%

5.3

%

1.7

%

1.3

%

0.6

%

1.3

% 3.4

% 6.0

% 9.3

%

10

.4%

16

.7%

25

.5%

26

.9%

40

.0%

0%

10%

20%

30%

40%

50%

25 or fewer 26 to 50 51 to 75 76 to 100 101 to 200 201 to 300 301 to 500 501 to 1000 1001 to 2000 2000+

Not Given Initial Managed Defined Quantitatively Managed Optimizing

4863



Contractor for

Commercial/In-house

USA and Non-USAReporting Organization Categories

425

3354

651


Based on USA organizations and Non-USA organizations reporting an organization category

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Military/Government Agency

Contractor for Military/Government

% of Organizations

USA: 100% = 1206

Non-USA: 100% = 3653

3653

651

223

130

76

1206



60%

70%

80%

90%

100%

% o

f O

rgan

izati

on

s

Maturity Profile by All Reporting USA Organizations


0%

10%

20%

30%

40%

50%


Optimizing

Based on USA organizations

% o

f O

rgan

izati

on

s

1213

148

13

457

507

7

81



60%

70%

80%

90%

100%

% o

f O

rgan

izati

on

s

Maturity Profile by All Reporting Non-USA Organizations

2207


0%

10%

20%

30%

40%

50%


Optimizing

Based on Non-USA organizations

% o

f O

rgan

izati

on

s

3696

173

25

895

117

279



Appraisals conducted through and reported to

the SEI by

• 71 Countries reported appraisals- most of the appraisals are from Asia and North America

• Appraisals posted on PARS

June 2010

Section 2: Community Trends

5207

July 2010


• Appraisals posted on PARS- expired appraisals are removed from PARS and replaced

with the newest reappraisal result

Please refer to: Terms Used in this Report on page 27

5207



Countries where Appraisals have been Performed and Reported to the SEI


* Red/Italic country name: New additions with this reporting since March 2010

Argentina Australia Austria Bahrain Bangladesh Belarus Belgium Brazil

Bulgaria Canada Chile China Colombia Costa Rica Czech Republic Denmark

Dominican Republic Egypt Finland France Germany Greece Guatemala Hong Kong

Hungary India Indonesia Ireland Israel Italy Japan Korea, Republic Of

Latvia Lithuania Luxembourg Macedonia Malaysia Mauritius Mexico Morocco

Nepal Netherlands New Zealand Norway Pakistan Panama Paraguay Peru

Philippines Poland Portugal Romania Russia Saudi Arabia Singapore Slovakia

South Africa Spain Sri Lanka Sweden Switzerland Taiwan Thailand Tunisia

Turkey Ukraine United Arab Emirates United Kingdom United States Uruguay Viet Nam



3012

18852000

2200

2400

2600

2800

3000

3200

3400

3600

Number of Appraisals Reported to the SEI by Continent

Nu

mb

er

of

Ap

pra

isals


72 42

760

355

0

200

400

600

800

1000

1200

1400

1600

1800

Africa Asia Australia Europe North America South America

Based on appraisals

Nu

mb

er

of

Ap

pra

isals

* North America includes Canada, the USA, and Mexico; South America includes Central America and the Caribbean ; Australia includes New Zealand

6126



Number of Appraisals and Maturity LevelsReported to the SEI by Country

Country

Number of

Appraisals

Maturity

Level 1

Reported

Maturity

Level 2

Reported

Maturity

Level 3

Reported

Maturity

Level 4

Reported

Maturity

Level 5

Reported Country

Number of

Appraisals

Maturity

Level 1

Reported

Maturity

Level 2

Reported

Maturity

Level 3

Reported

Maturity

Level 4

Reported

Maturity

Level 5

Reported

Argentina 79 50 20 2 4 Malaysia 74 22 46 6

Australia 39 1 10 7 2 4 Mauritius 10 or fewer

Austria 10 or fewer Mexico 104 43 47 4 8

Bahrain 10 or fewer Morocco 10 or fewer

Bangladesh 10 or fewer Nepal 10 or fewer

Belarus 10 or fewer Netherlands 15 5 7 1

Belgium 10 or fewer New Zealand 10 or fewer

Brazil 167 1 89 62 1 11 Norway 10 or fewer

Bulgaria 10 or fewer Pakistan 29 1 22 4 1

Canada 62 1 17 25 5 4 Panama 10 or fewer

Chile 43 25 15 2 Paraguay 10 or fewer

China 1475 1 142 1213 44 51 Peru 11 5 6

Colombia 43 14 15 4 4 Philippines 26 3 12 1 8

Costa Rica 10 or fewer Poland 10 or fewer


Costa Rica 10 or fewer Poland 10 or fewer

Czech Republic 10 or fewer Portugal 14 5 7 1

Denmark 10 or fewer Romania 10 or fewer

Dominican Republic 10 or fewer Russia 11 3 3 4

Egypt 52 1 25 18 2 3 Saudi Arabia 10 or fewer

Finland 10 or fewer Singapore 22 4 12 1 4

France 183 4 108 56 1 2 Slovakia 10 or fewer

Germany 80 9 40 15 1 1 South Africa 10 or fewer

Greece 10 or fewer Spain 198 1 117 61 3 5

Guatemala 10 or fewer Sri Lanka 14 2 12

Hong Kong 20 4 11 5 Sweden 10 or fewer

Hungary 10 or fewer Switzerland 10 or fewer

India 576 19 320 25 197 Taiwan 147 1 81 58 3 2

Indonesia 10 or fewer Thailand 41 13 25 2

Ireland 11 2 4 Tunisia 10 or fewer

Israel 21 3 11 4 Turkey 19 16 3

Italy 46 19 23 Ukraine 10 or fewer

Japan 324 19 88 146 16 17 United Arab Emirates10 or fewer

Korea, Republic Of 176 1 59 78 19 8 United Kingdom 118 3 52 36 1 4

Latvia 10 or fewer United States 1719 30 611 683 23 149

Lithuania 10 or fewer Uruguay 10 or fewer

Luxembourg 10 or fewer Viet Nam 18 13 2 3

Macedonia 10 or fewer



1300

1000

1200

1400

1600

TOTAL

POSTED ON PARs

Number of SCAMPI A Appraisals Reported to SEI by Year

Nu

mb

er

of

Ap

pra

isals

10291001

1352


85

230

425

692

943 938

588

0

200

400

600

800

2002 2003 2004 2005 2006 2007 2008 2009 2010

Based on appraisals

Nu

mb

er

of

Ap

pra

isals

52

186

437

600

842

6126

615



Number of SCAMPI A Appraisals Reported to SEI by Year

Nu

mb

er

of

Ap

pra

isals 834

1006

1021180241

343

1000

1200

1400

1600

First Appraisal

Reappraisal


Based on appraisals

Nu

mb

er

of

Ap

pra

isals

52

186

437

598

51

163

394

504

733

849

760

435

1

23

43

96

109

180

0

200

400

600

800

2002 2003 2004 2005 2006 2007 2008 2009 2010

6126



1112

1845

2694

3454

4,474

4,909

48.3

%

55.3

%

55.3

%

60%

70%

80%

90%

100%

2002-2005

2006

2007

2008

2009

2010

Trends in the Community Maturity Profile

% o

f O

rgan

izati

on

s

Year Orgs


9.1

%

2.2

%

32.9

%

33.0

%

4.4

%

18.3

%

9.1

%

1.5

%

32.0

%

37.2

%

4.5

%

15.8

%

8.9

%

1.3

%

32.3

%

41.6

%

3.4

%

12.5

%

7.8

%

1.1

%

30.1

%

48.3

%

2.8

%

9.8

%

6.5

%

0.8

%

27.5

%

2.5

%

7.3

%

6.5

%

0.8

%

27.5

%

2.5

%

7.3

%

0%

10%

20%

30%

40%

50%

Not Given Initial Managed Defined Quantitatively ManagedOptimizing

Based on a cumulative view of the most recent appraisals of organizations up through the year indicated

% o

f O

rgan

izati

on

s



56.7

%

60%

70%

80%

90%

100%

First

Latest

Maturity Level ofFirst and Latest CMMI Appraisal

Org

an

izati

on

s


9.8

%

3.9

%

38.1

%

34.8

%

2.9

%

10.3

%

6.2

%

0.1

%

10.1

%

6.1

%

20.8

%

0%

10%

20%

30%

40%

50%


Optimizing

Based on reappraised organizations using their first and latest appraisal

% o

f O

rgan

izati

on

s

957



Time to Move Up

Number of months to move tonext maturity level

50

40

60


28

21

56

75th Percentile

25th Percentile

Median

20

10

0

30

All (2002 to Present)

1 to 2 2 to 3 3 to 4 3 to 5

20 302 67 96

2006 to Present

1 to 2 2 to 3 3 to 4 3 to 5

7 184 39 37

24

Time Period of InitialAppraisal

Level

Orgs

19

25

2002 to 2005

1 to 2 2 to 3 3 to 4 3 to 5

13 118 28 59

5

18.518

28

23



Summary

6126 appraisals have been reported to the SEI Since 2002

Brazil, Mexico, Chile, Colombia, Egypt, Taiwan reported appraisals are increasing at a rapid rate

More than 60% of appraised organizational units have 100 or fewer employees


fewer employees

The percentage of appraised organizations with a unit size 100 or fewer employees is increasing steadily

The majority of reported appraisals are Maturity level 2 and 3 organizations



Summary - 2

For organizations that began their CMMI-based SCAMPI effort in

2002 or later, the median time to move from:

• maturity level 1 to 2 is 5 months






Note:

Since the March 2009 report, the median time to move from maturity level 1to 2 increased from 4.5 months to 5 months. The median time to move frommaturity level 3 to 4 increased from 24 months to 25 months , the median time to move from maturity level 3 to 5 increased from 19 months to 23 months



Terms Used in this Report

Company - Parent of the appraised entity

A company can be a commercial or non-commercial firm, for-profit

or not for-profit business, a research and development unit, a higher

education unit, a government agency, or branch of service, etc.

Organization - a.k.a. Appraised entity

The organization unit to which the appraisal results apply. An

appraised entity can be the entire company, a selected business


appraised entity can be the entire company, a selected business

unit, units supporting a particular product line or service, etc.

Non-USA - Appraised entity whose geographic location is not within the United

States. The parent of the appraised entity may or may not be based

within the United States.

PARS - Published Appraisal Results webpage contains CMMI® appraisals

published at the request of the appraisal sponsor.

The link is: http://sas.sei.cmu.edu/pars/



Report your Appraisal Results to the SEI

The briefing is only possible due to the cooperation of organizations and individuals sending in their appraisal results to the SEI

In order to provide this information and service in the future, it will depend on this continued cooperation


Please visit:

http://www.sei.cmu.edu/cmmi/casestudies/profiles/cmmi.cfm

for forms, information, and instructions on how to report appraisals to the SEI



Contact Information

Please visit:

http://www.sei.cmu.edu/cmmi/casestudies/profiles/cmmi.cfm

and review the information provided before contacting:

SEI Customer Relations (412) 268-5800SEI FAX number (412) 268-5758


SEI FAX number (412) 268-5758

Internet [email protected]

Mailing AddressCustomer RelationsSoftware Engineering InstituteCarnegie Mellon UniversityPittsburgh, PA 15213-3890

cmmi maturity profile 2010sepcmmi

Documents

software engineering

process maturity

carnegie mellon

maturity profile

carnegie mellon

maturity level

maturity level

maturity level