Annual Report 2013

Accelerating use throughout the world

The year 2013 has shown further great progress in the acceptance and development of the COSMIC method. If 2012 was the year in which acceptance of the method ‘took off’, then 2013 was the year in which its acceptance continued to climb steeply – see the statistics in this report.

We also made substantial progress in the development of 4.0 version of the method, which was published in 2014, and in the creation of new guides.

The progress we see in the acceptance and use of the COSMIC method varies from country to country. Therefore we have asked our International Advisory Council representatives to share some of the highlights of COSMIC use and acceptance in their country. (The 25 countries which have a IAC representative or where there is known use of the COSMIC method are shown coloured blue on the map on the front of this Annual Report.)

Frank Vogelezang, President

Executive Summary

• Rate of increase of downloads of the Measurement Manaul increases (see graph on page 4)

• Turkish translation of the MM published, bringing the total to 12 languages (see page 5 for downloads by language)

• A promotional flyer for project managers was published in English, Italian, Portuguese and Russian

• After a re-start in May 2012, the number of members of the Linkedin COSMIC User Group reached over 400 by end 2013

• Number of COSMIC-related research papers on www.comsicon.com almost doubled to 79. The cumulative number of downloads approached 25,000

• Number of people who passed the Foundation-level exam exceeds 400 • New representative appointed to the IAC for the United States (Devid Herron)

2013 Highlights

2013 Highlights*(2)

0

2000

4000

6000

8000

10000

12000

14000

16000

18000

20000

<- 2012 2013->

Cumulative number of downloads of Measurement Manual -2012 and 2013 (all languages)

* The totals do not include all downloads for the Japanese & Dutch translations. These are available respectively from the NESMA and JFPUG sites. Both have been downloaded in large numbers

2013 Highlights* (3)

0 1000 2000 3000 4000 5000 6000 7000 8000

Turkish

Japanese**

German v3.0.1

Dutch v3.0.1*

Russian (Method Overview)

Polish

Chinese v3.0.1 (Simplified)

Portuguese

Italian v3.0.1

Chinese

Spanish v3.0.1

French v3.0.1

Arabic

English v3.0.1

Cumulative number of downloads of the Measurement Manual by Language

* The totals do not include all downloads for the Japanese & Dutch translations. These are available respectively from the NESMA and JFPUG sites. Both have been downloaded in large numbers

• one COSMIC publication in 2013: dedicated section of the CETIC annual report (available on www.cetic.be)

• one COSMIC training in 2013 (1 day of lecture + 2 days of coaching)

• #companies using COSMIC: • no global data but a majority of large companies • 2 extra companies were introduced to COSMIC and are now using it

• institutions teaching COSMIC:

• for companies, CETIC is the only organization promoting and training/coaching on COSMIC in the French speaking part of BELGIUM.

• University of Namur is introducing COSMIC to its students in the scope of its Computer Science curriculum

Belgium

Belgium Actions to promote COSMIC • CETIC is planning to organize a survey during 2014

• to have an idea of whom is using COSMIC (or other function-point based methods)

• to collect needs and interests of companies (especially smaller companies) on functional size measurements and especially COSMIC

• CETIC has identified a few research subjects (to be confirmed after the survey) with a focus on its adoption by SMEs

• Method adaptation to the SME context (e.g. Agile context, tool support) • Better integration with the requirements elaboration process and tooling

• CETIC is planning to issue at least one publication in 2014, possibly in an

international conference and reporting about its experience in the industrial application of COSMIC

• 2 COSMIC trainings in 2013 • 1 COSMIC exam in 2013 • 4 COSMIC new entry-level certificates in 2013 (total to date: 24) • 1 COSMIC-related event in 2013 (IT Confidence by the ISBSG)

• 2 measurement companies teaching COSMIC

Brazil Summary

• Meetings and discussions with FP power users (big companies) • Co-locating ISMA 8 and ISBSG IT Confidence in Rio in order to bring the whole

measurement community together – Dr. Alain Abran invited to keynote IT Confidence

• COSMIC Promotional Flyer translated to Portuguese • 2 measurement companies teaching COSMIC in Brazil

Brazil Actions to Promote COSMIC

Obstacles • Both private companies and the government have spent a lot of resources on

making IFPUG FP its main metric • C-level executives are not very sensitive to COSMIC advantages and prefer to

maintain the status quo • Change may happen but it may also be slow • SNAP has recently drawn the attention of the Brazilian market

• Dr. Desharnais has managed the COSMIC certification process : in 2013, 101 people took the certification exams. Dr. Desharnais will submit a full certification report at the COSMIC annual meeting in October. In 2013 two participants from Canada passed their certification exam.

• Dr. Trudel from UQAM is providing support to a small organization implementing COSMIC – 15 projects are being measured with COSMIC

• Dr. Abran: • a PhD thesis completed on COSMIC approximation sizing and their

performance with respect to actual size measurements. • A master degree project completed comparing the estimation performance of

Agile projects measured with both User Stories and COSMIC. • A PhD project on teaching of software measurement, including training

material on COSMIC. • For the past few years, the focus had been on research and individual support to

industry. No industry picture is available: to address this issue, a specific COSMIC-SIG is being set up in 2014 to facilitate sharing by industry users.

Canada

• 1 COSMIC exam in 2013 • 3 COSMIC entry-level certificates in 2013 • Workshops for the COSMIC method

• Feb.,Measures company,Shanghai • March, PYC company,Beijing • March , DFITC company, Dalian • April, ZKJN company, Beijing • Apri, DFE ,Yantai • July, Yihe company,Suzhou • July, CSLJC company,Beijing • Sept., NMC company, Beijing

China

IAC representative in China: - Dylan Ren, renjialin@measures.net.cn

• 1 COSMIC publication in 2013 • Villavicencio, M.; Abran, A., "Towards the Development of a Framework for

Education in Software Measurement," IWSM-MENSURA 2013, pp.113,119, 23-26 Oct. 2013

• 2 COSMIC trainings in 2013

• 2 COSMIC events in 2013 • Carlos Monsalve´s presentation as keynote speaker @ CACIED 2013

conference, a regional conference on Computing & Education sistemas.udenar.edu.co/?page_id=252

• Carlos Monsalve´s presentation @ REDU 2013 conference, a national conference for REDU members (ecuadorian universities) www.calendario.espol.edu.ec/eventos/show/id_calendario/1259

Ecuador

• 1 company using COSMIC

• 1 institution teaching COSMIC (Escuela Superior Politécnica del Ecuador ESPOL)

• IAC representatives in Ecuador:

Ecuador

Mónica Villavicencio Carlos Monsalve

mvillavi@espol.edu.ec monsalve@espol.edu.ec

• Measuring Software Tests with COSMIC (MetriKon) • Measuring Test Coverage and Fault Density with

COSMIC (COSMIC News) • Defect Density by Six Sigma Metrics (Vienna) • Using Transfer Functions (EuroSPI Dundalk)

– You can use COSMIC to measure functional coverage against FURs

• Scheduled for 2014: – COSMIC versus IFPUG for measuring Mobile Apps (GUFPI-ISMA) – Using COSMIC in the Buglione-Trudel Matrix to predict project cost

with regards to functional and non-functional requirements (XP2014 Rome) – Requirements Elicitation measurements based on COSMIC (RE’14 Karlskrona) – Managing Projects based on COSMIC measurements (SharePoint Conference Düsseldorf) – More to come…

European Union

An important development was the publication at the ERTS conference in Toulouse of the automation of COSMIC by Renault and the use of the results of the COSMIC measurements in their contracts with software suppliers of ECU software. Renault will give a keynote presentation about this development at the IWSM Mensura 2014 conference in Rotterdam.

France

COSMIC Adoption: • A top 10 Indian IT services company adopted COSMIC for measuring

data warehousing and business intelligence software after an evaluation of other FSM methods.

• A leading US software product company chose COSMIC, after an evaluation of IFPUG FPA, for measuring its own business applications which are maintained by its Bangalore centre.

• A major power producer decided on COSMIC as best practice for sizing & estimation for their CMMI process maturity efforts .

• Two major Indian outsourcing companies engaged in embedded software development for global automobile companies found COSMIC as the best choice.

• A multinational company selling products with embedded software components with one of its centers in India is keen to standardize on COSMIC.

• A global IT services company is exploring usage of COSMIC for agile projects. • An organization developing real-time applications for railways has evaluated COSMIC

for measurements to help resolve disputes with their customer on deliveries made.

India

India

Promotion of COSMIC through Conferences/ events: • ICSEMA – 2012, India International conference on Software Engineering • and Mobile Application Modelling and Development • BSPIN Annual Conference 2013, Bangalore, India on ‘Outcome based business

models’. • Capgemini – Communiquer 2013, India – ‘Synergizing Business Practices to achieve • Organizational Excellence’. • IT Confidence 2013, Rio, Brazil, Presented on ‘Analysis of ISBSG Data to understand

software testing efforts’. ISBSG has shown interest in publishing a report on testing after improving upon this analysis further.

• COSMIC was also promoted through awareness sessions at corporate houses. COSMIC Training: 50 - 60 professionals got trained in COSMIC FP. IAC Representative in India: Jayakumar K R (“Jay”) jayakumar@cosmicon.com

• 1 COSMIC publication in 2013 • 1 COSMIC exam in 2013 • 4 COSMIC entry-level certificates in 2013 • Technology and Investment Journal

• Using the ISO 19761 COSMIC Measurement Standard to Reduce "Information Asymmetry" in Software Development Contracts and Enable Greater Competitiveness”, Technology and Investment, 2013, ISSN Print: 2150-4059,ISSN Online:2150-4067, http://www.scirp.org/journal/ti, Francisco Valdés, Alain Abran.

Mexico

IAC representatives in Mexico: - Francisco Valdés Souto, fv @ cosmicon.com - Blanca Gil

• Special Interest Group on COSMIC / Mexico , main topics: • Plan to publish a COSMIC article in Software Guru,

the main IT magazine in the Country. • Organize 1 COSMIC entry level exam • Organize a Software Measurement and Estimation Conference in Mexico • Organize a COSMIC courses • Finishing the EXAM translation to Spanish.

• Realize a COSMIC Method Implementation in a governmental entities trough the authorized vendor in Mexico

• Attempt to publish a COSMIC article in Project Management Journal • Paper on Approximation Approach already submitted for IWSM 2014

Mexico Actions to promote COSMIC

• 3 COSMIC publications in 2013 • 1 COSMIC exam in 2013 • 7 COSMIC entry-level certificates in 2013 • ICEAA 2013 (New Orleans)

• Estimating Realtime projects with the COSMIC FSMM and the ISBSG data repository – Harold van Heeringen

• Introduction to the COSMIC FSMM – Harold van Heeringen

• IWSM Mensura 2013 (Ankara) • Approximate COSMIC Functional Size : Guideline for approximate COSMIC

Functional Size Measurement – Frank Vogelezang, Charles Symons, Arlan Lesterhuis, Maya Daneva and Roberto Meli

the Netherlands

• NESMA working group COSMIC meetings, main topics: • Plan to target High tech software companies in NL • Plan to draw up requirements for COSMIC practitioner certification • Organized 1 COSMIC entry level exam

• Visit High Tech conference 2013 • Work on the COSMIC case study Web Advice Module (published in 2014) • Paper on Mobile Apps already submitted for IWSM 2014

the Netherlands, Actions to promote COSMIC

IAC representatives in the Netherlands: - Harold van Heeringen, hvh@cosmicon.com - Ton Dekkers

• 2 COSMIC publications/presentations in 2013 Beata Czarnacka-Chrobot, Rationalization of Business Software Systems Development and Enhancement Projects

Investment Decisions on the basis of Functional Size Measurement, “International Journal of Software Engineering and

Knowledge Engineering”, vol. 23, no. 06, World Scientific Publishing, USA, 2013, pp. 839-868 (JCR); DOI:

10.1142/S0218194013500228.

Beata Czarnacka-Chrobot, Analysis of Software Development and Enhancement Projects Work Effort per Unit based on

the COSMIC Method with regard to Technological Factors – Case Study, “Journal of Software Engineering and

Applications”, vol. 6, no. 11, Scientific Research Publishing, Irvine, CA, USA, 2013, pp. 597-609; DOI:

10.4236/jsea.2013.611072.

• A lot of COSMIC trainings in 2013 • A lot of COSMIC exams in 2013 • A lot of COSMIC entry-level certificates in 2013

• 4 large IT companies using COSMIC • 3 public institutions using COSMIC in their contracts for IT services • 5 large IT projects in public sector using COSMIC • 2 companies teaching COSMIC • 1 COSMIC lecture at postgraduate

Poland

• COSMIC publications in 2013 • Intelligent Enterprise, september 2013

Измерения в единицах функциональности www.iemag.ru/numbers/index_swf.php?YEAR_ID=1554&ID=29003#/20

• COSMIC events in 2013 • 3 master-classes. Live demonstration how COSMIC works and what it gives. • 1 short course for MBA students in RANEPA (Russian Presidential Academy

for National Economy and Public Administration) • 1 – presentation in conference, organized by the Russian Managers

Association

Russia

Sweden

• 1 COSMIC publication in 2013 Lind, K, “Model-Based Analysis of Critical Resources in Automotive System Architectures”, ISBN 978-91-7385-809-0 (PhD thesis)

• 1 COSMIC event in 2013 Software Measurement seminar by Software Metrics Network (Dataföreningen Sverige), with COSMIC-related presentations by Harold van Heeringen and Kenneth Lind

IAC representative in Sweden: Kenneth Lind kenneth.lind@viktoria.se

• 4 SwiSMA Meeting in 2013 • 6 ICTscope.ch Meetings planned for 2014 • 1 COSMIC related meeting per year • 2 more positioning COSMIC for Scope Management and Testing • Swiss Railways evaluates the possibility of automatic COSMIC measurements

based on UML Use Case analysis for the full project live cycle

• COSMIC Presentations • ICT Services with Lean Six Sigma (Zurich) • Measurements of Test Intensity and Defect Density with COSMIC (SwiSMA) • Mobile Testing as a Game (iqnite Zurich) • Scope Management (DEC Cluster, Zurich) • Scope Management (iT Magazine, swissICT)

Switzerland

IWSM MENSURA 2013 was conducted in October 23-25, 2013, in Middle East Technical University, Ankara, Turkey. Besides the leadership of the Middle East Technical University, it was organized by a group of Turkish universities and the large scale research industry companies. These are; Hacettepe University, Ankara University, Cankaya University, Ege University, Atılım University, Dokuz Eylül Univesity, Bilkent University, Aslesan, Havelsan, Turkcell, Microsoft, Tübitak Uzay, Vodafone, Bilgi Grubu and Prime Ministry. COSMIC is taught in public courses in Turkish Universities: • SM 511 Software Management, METU, Instructor: Onur Demirors • IS 502 Software Project Management, METU, Instructor: Onur Demirors In addition to these activities, a number of COSMIC / Functional Size Measurement related research results are published based on Turkish industrial data.

Turkey

Turkish publications on COSMIC Mensura 2013: • Gokcen Yilmaz, Seckin Tunalilar and Onur Demirors. Towards the Development of a

Defect Detection Tool for COSMIC Functional Size Measurement • Ahmet Ata Akca and Ayça Tarhan. Run-time measurement of COSMIC functional size

for Java business applications: Is it worth the cost? • Burak Keser, Baris Ozkan and Taylan İyidoğan ASSIST: An Integrated Measurement Tool

UYSM 2013: (National Software Engineering Conference) • Volkan Halil Bagci, Ali Çiltik, Recep Özçelik: IFPUG İşlev Puan Metriği ile Yazılım Üretim

Hattı Ölçümü. • Gökçen Yilmaz, Seçkin Tunalilar, Onur Demirörs: R-COVER: Yazılım Büyüklük Ölçümü

Hata Tespit Aracı. • Baris Arman Tabak, Onur Demirörs: Efor Kestirim Doğruluğu İçin Tasarım Büyüklüğü ve

Problem Büyüklüğü Karşılaştırılması. • Tuncay Sentürk, Ismail Aydemir, Baris Eker: Ölçümlemeli Test Platformu.

Turkey

United Kingdom

• Interest in software metrics is low in the UK in general. The MkII FP method (a pre-cursor to the COSMIC method) is still used in some parts of the UK Central Government to control price/performance in long-term outsource contracts. Marketing efforts in 2013 have therefore focussed on persuading senior management, especially in Central Government, of the need for measurement

• A first COSMIC certification exam was held in the UK. Six people passed the exam.

• Two consultancies are able to offer COSMIC training. • A presentation was given to a conference of the European Association of Cost

Engineers on software measurement, comparing all methods. • UK measurement specialists have made many important contributions to the

development of COSMIC measurement standards and Guidelines.

Individual use of COSMIC to estimate a workflow solution because using the IFPUG method would have made the estimate much more optimistic than it really is. It took a while to build the sub functional process matrix, but it was worth it. David Herron became IAC representative for US

United States of America

Vietnam

• 3 - COSMIC events in 2013 • COSMIC is introduced in Master course (Project Management)

at Vietnam National University • 1 Master’s Thesis on the use of COSMIC. The student works for

a big telecom company. Look forward to introduce COSMIC to the company

• 1 Master’s project

• Difficulty: COSMIC is presented at many events in Vietnam since years, but it is not yet recognized as an official measurement method by the government (Use Case Points is required by the government)