carnegie mellon software engineering institute process ... · the software engineering institute is...
TRANSCRIPT
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 1© 2007 by Carnegie Mellon University
Software Engineering InstituteCarnegie Mellon
Process Maturity Profile
CMMI® v1.1SCAMPISM v1.1 Class A Appraisal Results 2006 End-Year Update
March 2007
We could not produce this report without the support of the organizations and lead appraisers who reported their appraisal results to the SEISM.
Our many thanks for their continuing cooperation with our data collection and analysis efforts.
CMMI Appraisal Program
The Software Engineering Institute is a federally funded research and development center sponsored by the U.S. Department of Def ense and operated by Carnegie Mellon® University
® CMMI, Capability Maturity Model and Carnegie Mellon are registered in the U.S. Patent and Trademark Office by Carnegie Mellon UniversitySM SCAMPI and SEI are service marks of Carnegie Mellon University
© 2007 by Carnegie Mellon University
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 2© 2007 by Carnegie Mellon University
Outline
Introduction
Current Status
Summary
Terms used in this Briefing
How to Report your Appraisal Results to the SEI
This briefing is based solely on the appraisals reported to the SEI. It cannot be used as a source for an exact indicator of all organizations in the world using CMMI models or appraisal methods nor can it be used for certification or verification purposes.
The SEI does not certify appraisal results or organizations. The SEI licenses SEI Partners, authorizes lead appraisers, team leaders and certified high maturity lead appraisers to conduct appraisals. Neither the SEI nor any other organization is a “certifying authority”of the results from a SCAMPI appraisal. Therefore requests to the SEI to provide information to be used for this purpose can not be fulfilled. Information provided by the SEI, such as this briefing, is to demonstrate reported results of the use of CMMI products and services only.
Organizations performing source selection or verification should consider performing an evaluation appraisal. For more information on appraisal methods and for a directory of authorized lead appraisers who can perform them, visit: http://www.sei.cmu.edu/appraisal-program/
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 3© 2007 by Carnegie Mellon University
Introduction: Purpose
Characterize the adoption of CMMI® ®
Describe results from Standard CMMI Appraisal Method for Process Improvement (SCAMPISM) v1.1 Class A appraisals using Capability Maturity Model® Integration(CMMI) v1.1 *
Encourage continued reporting of results
* Organizations previously appraised against CMMI v1.0 and which have not reappraised against v 1.1 are not included in this report
Please visit: http://www.sei.cmu.edu/appraisal-program/profile/about.html for additional information or questions you may have about this briefing before contacting the SEI directly
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 4© 2007 by Carnegie Mellon University
Current Status
SCAMPI v1.1 Class A appraisals conducted from its April 2002 release through and reported to the SEI by
• appraisals• organizations• participating companies• reappraised organizations• projects• Non-USA organizations
Please refer to: Terms Used in this Report on page 19
Additional charts providing different views and break down of this information will be added to this briefing as more appraisal data is reported to the SEI over time.
January 2007
1,964
1,084208
6,71365.5%
1,712
December 2006
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 5© 2007 by Carnegie Mellon University
Based on most recent appraisal of organizations
Num
ber
Of O
rgan
izat
ions
0
50
100
150
200
250
300
350
400
450
500
550
600
650
700
750
800
Not Given Initial Managed Defined QuantitativelyManaged
Optimizing
Process Maturity Profile by All Reporting Organizations
1712
9.0%
1.7%
32.7%
36.1%
4.2%
16.4%
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 6© 2007 by Carnegie Mellon University
Based on organizations reporting an organization category
Reporting Organization Categories
0 200 400 600 800 1000 1200 1400
Military/GovernmentAgency
Contractor forMilitary/Government
Commercial/In-house
Number of Organizations
26.8%
69.1%
1710
4.0%
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 7© 2007 by Carnegie Mellon University
6.9%
1.3%
32.0%
38.0%
4.9%
16.9%
10.5%
2.6%
32.5%
37.6%
2.6%
14.2%
33.3%
50.7%
8.7%
1.4%
5.8%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Not Given Initial Managed Defined QuantitativelyManaged
Optimizing
Commercial/In-house = 1183
Contractor for Military/Government = 458
Military/Government Agency = 69
Based on most recent appraisal of organizations reporting an organization category
% O
f Org
aniz
atio
ns W
ithin
Cat
egor
y
Process Maturity Profile by Reporting Organization Categories
1710
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 8© 2007 by Carnegie Mellon University
Business Services37.9%
Engineering & Management Services15.6%
Other Services4.1%
Health Services0.8%
Mining0.1%
Wholesale Trade0.7%
Transportation, Communication, Electric, Gas
and Sanitary Services4.1%
Retail Trade0.4%
Finance, Insurance and Real Estate6.0%
Public Administration (Including Defense)
8.5%
Fabricated Metal Products0.5%
Primary Metal Industries1.0%
Industrial Machinery And Equipment
2.2%
Instruments And Related Products
4.2%
Electronic & Other Electric Equipment
6.6%
Transportation Equipment6.8%
Other Manufacturing Industries0.3%
Based on organizations reporting SIC code. For more information visit: http://www.osha.gov/oshstats/sicser.html
Organization TypeBased on Primary Standard Industrial Classification (SIC) Code
Manufacturing21.6%
Services58.5%
730
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 9© 2007 by Carnegie Mellon University
Based on organizations reporting size data
25 or fewer10.8%
101 to 20019.6%
201 to 30010.2%
76 to 1008.8%
51 to 7512.9%
26 to 5013.5%
301 to 5009.6%
501 to 10007.4%
1001 to 20004.8% 2000+
2.5%
Organization SizeBased on the total number of employees within the area of the organization that was appraised
1 to 10045.9%
201 to 2000+34.5%
1680
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 10© 2007 by Carnegie Mellon University
Maturity Profile by Organization Size Based on the total number of employees within the area of the organization that was appraised
7.7%
11.0
%
6.9% 9.
5% 10.9
%
9.4%
4.3%
8.8%
8.6%
7.1%
2.8%
0.9%
1.4%
0.7% 1.2% 2.3%
1.2% 1.6% 3.
7%
67.4
%
45.8
%
37.0
%
27.9
%
28.9
%
28.7
%
22.4
%
15.2
%
3.7%
7.1%
20.4
%
38.8
% 43.1
%
44.2
%
38.9
%
38.6
%
40.4
%
27.2
%
34.6
% 38.1
%
0.6%
0.4% 3.
2% 4.8%
4.9% 5.3% 7.
5% 9.6%
2.5%
1.1% 3.
1%
8.3%
12.9
%
15.2
%
15.8
%
24.2
%
37.6
%
46.9
%
42.9
%4.
8%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
25 or fewer 26 to 50 51 to 75 76 to 100 101 to 200 201 to 300 301 to 500 501 to 1000 1001 to 2000 2000+
Not Given Initial Managed Defined Quantitatively Managed Optimizing
Based on organizations reporting size data1680
% o
f Org
aniz
atio
ns b
y S
ize
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 11© 2007 by Carnegie Mellon University
Disciplines Selected for Appraisals
0
100
200
300
400
500
600
700
800
900
1000
1100
1200
SE
/SW
SW
SE
/SW
/SS
SE
/SW
/IPP
D/S
S
SE
SE
/SW
/IPP
D
SW
/IPP
D
SW
/SS
SE
/SS
SW
/IPP
D/S
S
SE
/IPP
D/S
S
46.5%
Based on appraisals1,964
SE = System Engineering SW = Software EngineeringIPPD = Integrated Product and
Process Development SS = Supplier Sourcing
Num
ber
of A
ppra
isal
s
For more information about Allowable Models & Combinations, visit: http://www.sei.cmu.edu/cmmi/background/aspec.html
50.9%
37.4%
3.4% 3.3% 2.0%1.3% 0.9% 0.7% 0.2% 0.1% 0.1%
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 12© 2007 by Carnegie Mellon University
Countries where Appraisals have been Performed and Reported to the SEI
Argentina Australia Austria Bahrain Belarus Belgium Brazil CanadaChile China Colombia Czech Republic Denmark Dominican RepublicEgypt FinlandFrance Germany Hong Kong India Indonesia Ireland Israel ItalyJapan Korea, Republic ofLatvia Malaysia Mauritius Mexico Morocco NetherlandsNew Zealand Pakistan Peru Philippines Portugal Russia Singapore SlovakiaSouth Africa Spain Sweden Switzerland Taiwan Thailand Turkey United KingdomUnited States Vietnam
Red country name: New additions with this reporting
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 13© 2007 by Carnegie Mellon University
Based on USA organizations and Non-USA organizations reporting an organization category
USA and Non-USAReporting Organization Categories
12
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Military/GovernmentAgency
Contractor forMilitary/Government
Commercial/In-house
% of Organizations
USA: 100% = 590
Non-USA: 100% = 1120
1120
99
1009
57
359
174
590
12
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 14© 2007 by Carnegie Mellon University
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Not Given Initial Managed Defined QuantitativelyManaged
Optimizing
USA: 100 % = 590
Non-USA: 100 % = 1122
Based on USA organizations and Non-USA organizations
% o
f Org
aniz
atio
ns
Maturity Profile by All Reporting USA and Non-USA Organizations
93
1122
189
9
70
6016
346
439
62
199
218
11
590
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 15© 2007 by Carnegie Mellon University
Number of Appraisals and Maturity LevelsReported to the SEI by Country
CountryNumber of Appraisals
Maturity Level 1
Reported
Maturity Level 2
Reported
Maturity Level 3
Reported
Maturity Level 4
Reported
Maturity Level 5
Reported CountryNumber of Appraisals
Maturity Level 1
Reported
Maturity Level 2
Reported
Maturity Level 3
Reported
Maturity Level 4
Reported
Maturity Level 5
Reported
Argentina 19 No Yes Yes Yes Yes Korea, Republic Of78 Yes Yes Yes Yes YesAustralia 23 Yes Yes Yes Yes Yes Latvia 10 or fewerAustria 10 or fewer Malaysia 19 No Yes Yes No YesBahrain 10 or fewer Mauritius 10 or fewerBelarus 10 or fewer Mexico 15 No Yes Yes Yes YesBelgium 10 or fewer Morocco 10 or fewerBrazil 48 No Yes Yes Yes Yes Netherlands 10 or fewerCanada 26 No Yes Yes Yes Yes New Zealand 10 or fewerChile 15 No Yes Yes No Yes Pakistan 10 or fewerChina 240 Yes Yes Yes Yes Yes Peru 10 or fewerColombia 10 or fewer Philippines 16 No Yes Yes No YesCzech Republic 10 or fewer Portugal 10 or fewerDenmark 10 or fewer Russia 10 or fewerDominican Republic 10 or fewer Singapore 10 or fewerEgypt 17 No Yes Yes Yes Yes Slovakia 10 or fewerFinland 10 or fewer South Africa 10 or fewerFrance 75 Yes Yes Yes Yes Yes Spain 31 No Yes Yes No YesGermany 35 Yes Yes Yes Yes Yes Sweden 10 or fewerHong Kong 10 Switzerland 10 or fewerIndia 204 No Yes Yes Yes Yes Taiwan 46 No Yes Yes No YesIndonesia 10 or fewer Thailand 10 or fewerIreland 10 or fewer Turkey 10 or fewerIsrael 10 United Kingdom 48 Yes Yes Yes Yes NoItaly 10 or fewer United States 718 Yes Yes Yes Yes YesJapan 172 Yes Yes Yes Yes Yes Viet Nam 10 or fewer
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 16© 2007 by Carnegie Mellon University
Based on appraisals reporting a maturity level 1 rating
Process Area Profiles - 1Organizations Appraised at Maturity Level 1
% of Appraisals
52
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
REQM
PP
PMC
SAM
MA
PPQA
CM
RD
TS
PI
VER
VAL
OPF
OPD
OT
IPM
RSKM
ISM
DAR
OPP
QPM
OID
CAR
Fully Satisfied
Rated
Managed
Defined
QuantitativelyManaged
Optimizing
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 17© 2007 by Carnegie Mellon University
Optimizing
Quantitatively Managed
Defined
Based on appraisals reporting a maturity level 2 rating
Process Area Profiles - 2Organizations Appraised at Maturity Level 2
636
% of Appraisals
0% 5% 10% 15% 20%
RD
TS
PI
Ver
Val
OPF
OPD
OT
IPM
RSKM
IT
ISM
DAR
OEI
OPP
QPM
OID
CAR
Fully Satisfied
Rated
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 18© 2007 by Carnegie Mellon University
Summary
1964 appraisals have been reported to the SEI in 58 months
Organization Category Commercial/In-house reports most of the appraisals
The highest percentage of Commercial/In-house reporting appraisals is from outside the USA
The highest percentage of Military/Government Agency /reporting appraisals is from the USA
Outside the USA, China, India, Japan, and Korea reporting appraisals are increasing at a rapid rate
Comparing early reports of the SW-CMM maturity profile with early CMMI data reflects a more mature CMMI® profile
Additional information and charts will be added to this briefing as more appraisals are reported and more data is available to support the breakdowns
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 19© 2007 by Carnegie Mellon University
Terms Used in this Report
Company - Parent of the appraised entityA company can be a commercial or non-commercial firm, for-profit or not for-profit business, a research and development unit, a higher education unit, a government agency, or branch of service, etc.
Organization - a.k.a. Appraised entity The organization unit to which the appraisal results apply. An appraised entity can be the entire company, a selected business unit, units supporting a particular product line or service, etc.
Non-USA - Appraised entity whose geographic location is not within the United States. The parent of the appraised entity may or may not be based within the United States.
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 20© 2007 by Carnegie Mellon University
Report your Appraisal Results to the SEI
The briefing is only possible due to the cooperation of organizations and individuals sending in their appraisal results to the SEI
In order to provide this information and service in the future, it will depend on this continued cooperation
Please visit:
http://www.sei.cmu.edu/appraisal-program/profile/about.html
for forms, information, and instructions on how to report appraisals to the SEI
Software Engineering InstituteCarnegie Mellon
CMMI® v1.1 – SCAMPI v1.1 Class A Appraisal Results
March 2007 Process Maturity Profile - Page 21© 2007 by Carnegie Mellon University
Contact InformationPlease visit:
http://www.sei.cmu.edu/appraisal-program/profile/about.html
and review the information provided before contacting:
SEI Customer Relations (412) 268-5800SEI FAX number (412) 268-5758
Internet [email protected]
Mailing AddressCustomer RelationsSoftware Engineering InstituteCarnegie Mellon UniversityPittsburgh, PA 15213-3890