©2010 rolls-royce plc the information in this document is the property of rolls-royce plc and may...

13
©2010 Rolls-Royce plc The information in this document is the property of Rolls-Royce plc and may not be copied or communicated to a third party, or used for any purpose other than that for which it is supplied without the express written consent of Rolls-Royce plc. This information is given in good faith based upon the latest information available to Rolls-Royce plc, no warranty or representation is given concerning such information, which must not be taken as establishing any contractual or other commitment binding upon Rolls-Royce plc or any of its subsidiary or associated companies. Size isn’t everything! Andy Nolan BSc Hons, CEng, FBCS, CITP Chief of Software improvement – The Software Centre of Excellence Satpaul Sall BSc Hons Software Technologist – The Software Centre of Excellence

Post on 19-Dec-2015

217 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: ©2010 Rolls-Royce plc The information in this document is the property of Rolls-Royce plc and may not be copied or communicated to a third party, or used

©2010 Rolls-Royce plcThe information in this document is the property of Rolls-Royce plc and may not be copied or communicated to a third party, or used for any purpose other than that for which it is supplied without the express written consent of Rolls-Royce plc.

This information is given in good faith based upon the latest information available to Rolls-Royce plc, no warranty or representation is given concerning such information, which must not be taken as establishing any contractual or other commitment binding upon Rolls-Royce plc or any of its subsidiary or associated companies.

Size isn’t everything!Size isn’t everything!

Andy Nolan BSc Hons, CEng, FBCS, CITPChief of Software improvement – The Software Centre of Excellence

Satpaul Sall BSc HonsSoftware Technologist – The Software Centre of Excellence

Andy Nolan BSc Hons, CEng, FBCS, CITPChief of Software improvement – The Software Centre of Excellence

Satpaul Sall BSc HonsSoftware Technologist – The Software Centre of Excellence

Page 2: ©2010 Rolls-Royce plc The information in this document is the property of Rolls-Royce plc and may not be copied or communicated to a third party, or used

Rolls-Royce data – strictly private

2Developing Control Systems since 1990

Certification evidence cannot be easily generated centrally but must be gathered on each project instance, during system integration and integration with the hardware.

Gathering this evidence, which can be over 50% of the Control Systems project’s total cost, has to be incurred on each configured project instance.

Projects are typically low volume and are individually configured for their application.

Electronic Engine Controller

The control system is fundamental to the certification of the engine and airframe. The Control System software is classed as safety critical.

Page 3: ©2010 Rolls-Royce plc The information in this document is the property of Rolls-Royce plc and may not be copied or communicated to a third party, or used

Rolls-Royce data – strictly private

3The accuracy of our estimates in 2004

Page 4: ©2010 Rolls-Royce plc The information in this document is the property of Rolls-Royce plc and may not be copied or communicated to a third party, or used

Rolls-Royce data – strictly private

2004: The estimation life-cycle 4

Almost all estimates fail here

Customer Approved

Estimate & Agreed Budget

1: Produce & Approve Estimate

2: Monitor & Control Project

3: Improve Estimation Capability

Estimate updates

Estimate & Actual

Estimation method, Tools, Historic Data & Lessons Learnt

Product & Business

Requirement Document

Page 5: ©2010 Rolls-Royce plc The information in this document is the property of Rolls-Royce plc and may not be copied or communicated to a third party, or used

Rolls-Royce data – strictly private

Estimation Process 37%

Producing, reviewing and approving estimates. Monitoring and managing

estimates. Managing change.

Behaviour 44%

Not complying to the process. Over zealous estimates,

bullying into low estimates, rushing

estimates, low respect for

estimates, not managing change, not monitoring key

assumptions....

E.g. COCOMO II

Estimation Tools – 19%

% Contribution

2004: The root cause for estimation inaccuracy5

Page 6: ©2010 Rolls-Royce plc The information in this document is the property of Rolls-Royce plc and may not be copied or communicated to a third party, or used

Rolls-Royce data – strictly private

6

COCOMOA unifying language

SoftwareSupplier

COCOMO

Challenging our supplier

costs

HardwareCOCOMO

HardwareSupplier

COCOMO

Using many of the same factors to estimate hardware

engineering costs

CO-Imp-MO Improvement

COCOMO

Using the model to identify & validate

improvements

CO-RISK-MORisk

Management

Using the model to

identify and quantify

risk

CO-Bus-MOEnterprise business

performanceBenchmarking the business

Estimation & eliciting key

assumptions & negotiation

2005

Page 7: ©2010 Rolls-Royce plc The information in this document is the property of Rolls-Royce plc and may not be copied or communicated to a third party, or used

Rolls-Royce data – strictly private

72005: before and after

Page 8: ©2010 Rolls-Royce plc The information in this document is the property of Rolls-Royce plc and may not be copied or communicated to a third party, or used

Rolls-Royce data – strictly private

8COCOMO is at the heart of our business

Monitor& Control Project

Improvecapability

Set ProjectGoals & Targets

Business Goals

Understand Capability

Benchmark Capability

Estimate& Plan Project

Page 9: ©2010 Rolls-Royce plc The information in this document is the property of Rolls-Royce plc and may not be copied or communicated to a third party, or used

Rolls-Royce data – strictly private

History Major estimation failure,

estimates in error by up to a factor of 5

Departmental estimation capability stabilised.

Hardware estimation brought under control

COCOMO used for key business decisions and improvement initiatives

Six sigma Black Belt launched into estimation COCOMO II introduced. 300+ people trained

Hardware COCOMO developed

Other COCOMO based tools (risk and improvements)

Product Line COCOMO developed

Global COCOMO development and roll-out

9

2004

2005

2006

2008

2007

2009

2010

2011

Page 10: ©2010 Rolls-Royce plc The information in this document is the property of Rolls-Royce plc and may not be copied or communicated to a third party, or used

Rolls-Royce data – strictly private

We have reached only half of the business so far10

We need to migrate the capability into other areas of

the business

Page 11: ©2010 Rolls-Royce plc The information in this document is the property of Rolls-Royce plc and may not be copied or communicated to a third party, or used

Rolls-Royce data – strictly private

Global Estimation Capability

Aim is to replicate the benefits gained by Aerospace. Applying the same principles Globally i.e. The deployment of proven... Estimation process Guidelines Training Tools

Tools need to meet the needs of a far wider range of developers e.g. Methodologies: Agile, Waterfall, Formal

Methods Standards: DO-178, Non-safety critical Domains: Aero, Nuclear, Defence, Marine

11

Page 12: ©2010 Rolls-Royce plc The information in this document is the property of Rolls-Royce plc and may not be copied or communicated to a third party, or used

Rolls-Royce data – strictly private

Further Opportunities from tools

Tools that can help us benchmark ourselves e.g. Process: Cost for testing, architecture... Products: Number of requirements, test

cases....

Other Through life cost models (including

maintenance and refresh) Hardware and Electronics engineering Schedule estimation and life-cycle phases Multi user estimation Cost of product features

12

Page 13: ©2010 Rolls-Royce plc The information in this document is the property of Rolls-Royce plc and may not be copied or communicated to a third party, or used

Rolls-Royce data – strictly private

Some benefitsThere are few things more compelling to the

business than a well constructed business case and a rational defendable estimate

The tool taught the business what was important, what to manage, what to monitor, where the risks lay and where opportunities would come from

Despite initial reservations, the tool was calibrated and in use in only 1 month. The benefits have been on 10,000 times this effort

Since we introduced COCOMO II we have seen improvements in both project stability and performance (11% cost saving on average)

13