practical steps in using multiple software quality models in a synergic way dr. katalin balla sqi...

Practical steps in using multiple software quality models in a

synergic way Dr. Katalin Balla

SQI Hungarian Software Quality Consulting Institute Ltd.

CEE-SPI , 2008November 4-5, 2008Budapest, Hungary

4-5 November 2008Practical steps in using multiple quality

models in a synergic way2 / 24

ContentsIntroductionActual needs of software developersA vision / framework to use multiple quality

models in a synergic wayPractical steps in using multiple quality models in

a synergic wayConclusion, further possibilities



Introduction – About us

Founded in March 2004 (www.sqi.hu, www.sqi.ro)

•Devoted to •support software quality management and development, dealing with this subject in its complexity •connect software specialists working in the commercial world with those working in the academic and research areas.




models in a synergic wayPractical steps in using multiple quality models

in a synergic wayConclusion, further possibilities



Actual needs of (Hungarian) software developers

Software companies experience more and more the requirement of producing provably good - quality software, “certified software”, as a condition for staying in the market.



Actual needs of (Hungarian) software developers

What to certify Product, process, resources…

According to what standard / model? ISO 9001, AQAP, CMMI, A-

SPICE, ISO 9126, CC…How to get efficient results

(from certification and SPI)? Do SPI

by using more quality models ---- in a synergic way!!!!

ISO 9126CC

Process

Produc

t Resour

ce

Def

QA

Metric

Objects

Attributes

PM methodologiesPeople CMM

GQM

ISO 9001:2000SPICECMMI

ISO 15504Automotive

SPICETSP, PSP



The QMIM frameworkScope: give a solution to the problems mentioned beforeFramework (not the n+1-th approach!)Was developed during a case study Helps identifying the important elements of software

quality Helps finding one’s way among the existing software

quality models, standards, approachesSupports software process improvement by following

small steps



Elements of the QMIM framework

Product

Process

Resourc

e

Definition

Quality attribute

Metric



Elements of the QMIM framework

Product

Technical

Process

Resourc

e

Definition

Quality attribute

Metric

PM

P

rocess



The way of using QMIM in different organisations

Describe actual situation QMS-i

QMS-i+1

Assess QMS-i

Decide onimprovement

Implementimprovement

Readiness oforganisation

QMIM

Body ofliterature

Business goals

Start



Practical steps in using multiple quality models in a synergic way

Main goal: Common vision of Q-issues One QMS…

…containing all elements of Q, important at a certain moment for the company

…having „parts” compliant to the standards / approaches important at a certain moment for the company

…completed systematically with new elements / standards / approaches that become important for the company




PM TP

Pro

duct

Definition

Quality attribute

Metric

PM TP

Pro

duct

Defiinition

Quality attribute

Metric

Our recommendation:



Practical steps in using multiple quality models in a synergic wayDevelop a PM system!

Use elements of a PM methodology! (PRINCE, PMBOK, elements of RUP etc.)Put in place an ISO 9001:2000 conform QMS!

Take into account ISO 90003:2004 recommendations!X (Complete the QMS with elements from CMMI (DEV, ACQ and / or

SVC))…X (Complete the QMS with elements from Automotive SPICE)…X (Use ISO 9126 to define product quality attributes and metrics)

ISO 14598 , ISO 25000 Define your product types

Use GQM for metrics! ... Continue by using elements of further models, as business drives

you!!!




One example: Completing and ISO 9001:2000-based QMS for CMMI compliance

(We assume that a PM system exists – possibly as part of the QMS) Practical steps:

Understand and compare ISO 9001:2000 and CMMI Both are process-oriented approaches… Understand similarities and differences in scope, structure,

terminology… CMMI: what is the scope? (certain PA’s, certain CL’s, certain ML?) Look to your business goals when defining scope!

Gap-analysis Missing elements SPI plan

Make sure you keep ISO 9001:2000 compliance!!!



ISO 9001 – CMMI: basic differences - examples

Using results of Zádor Dániel Kelemen: Comparing ISO 9001:2000 to CMMI (2007)

ISO 9001:2000 CMMI

Structure, elements…

Standard Model (set of best practices)

Applicable for any business domain Applicable for the IT sector

All requirements must be fulfilled for compliance Step-by-step approach (staged, continuous…)

Brief (concise) descriptions Detailed description, informative components

No guidelines for implementation (use: ISO 9004) Gives guidance in implementation and insitutionalization

Only very high level guidelines for process improvement Detailed guidelines on process improvement

Terminology

Top management Higher-level management; senior management)

Quality Management System (QMS) (Organizational) Set of Standard Processes

Quality Plan (Project Plan, Software Development Plan, System Engineering Management Plan, Data Management Plan)

Record Work product, record, evidence of implementation



S REQM PP PMC SAM MA PPQA CM OPF OPD OT IPM RSKM RD TS PI VER VAL DAR OPP QPM OID CAR

SG 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 11.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.11.2 1.2 1.2 1.2 1.2 1.2 1.2 1.2 1.2 1.2 1.2 1.2 1.2 1.2 1.2 1.2 1.2 1.2 1.2 1.2 1.2 1.21.3 1.3 1.3 1.3 1.3 1.3 1.3 1.3 1.3 1.3 1.3 1.3 1.3 1.3 1.3 1.3 1.3 1.31.4 1.4 1.4 1.4 1.4 1.4 1.4 1.4 1.4 1.4 1.41.5 1.5 1.5 1.5 1.5 1.5

1.6 1.6 1.6 1.61.7

SG 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 22.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.12.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.22.3 2.3 2.3 2.3 2.3 2.3 2.3 2.3 2.3 2.3 2.3 2.32.4 2.4 2.4 2.4 2.42.5 2.52.62.7

SG 3 3 3 3 3 3 3 3 33.1 3.1 3.1 3.1 3.1 3.1 3.1 3.1 3.13.2 3.2 3.2 3.2 3.2 3.2 3.2 3.2 3.23.3 3.3 3.3 3.3

3.4 3.4 3.43.5

G REQM PP PMC SAM MA PPQA CM OPF OPD OT IPM RSKM RD TS PI VER VAL DAR OPP QPM OID CAR

GG 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1GP 1.x 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1

GG 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 22.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.1 2.12.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.2 2.22.3 2.3 2.3 2.3 2.3 2.3 2.3 2.3 2.3 2.3 2.3 2.3 2.3 2.3 2.3 2.3 2.3 2.3 2.3 2.3 2.3 2.32.4 2.4 2.4 2.4 2.4 2.4 2.4 2.4 2.4 2.4 2.4 2.4 2.4 2.4 2.4 2.4 2.4 2.4 2.4 2.4 2.4 2.42.5 2.5 2.5 2.5 2.5 2.5 2.5 2.5 2.5 2.5 2.5 2.5 2.5 2.5 2.5 2.5 2.5 2.5 2.5 2.5 2.5 2.52.6 2.6 2.6 2.6 2.6 2.6 2.6 2.6 2.6 2.6 2.6 2.6 2.6 2.6 2.6 2.6 2.6 2.6 2.6 2.6 2.6 2.62.7 2.7 2.7 2.7 2.7 2.7 2.7 2.7 2.7 2.7 2.7 2.7 2.7 2.7 2.7 2.7 2.7 2.7 2.7 2.7 2.7 2.72.8 2.8 2.8 2.8 2.8 2.8 2.8 2.8 2.8 2.8 2.8 2.8 2.8 2.8 2.8 2.8 2.8 2.8 2.8 2.8 2.8 2.82.9 2.9 2.9 2.9 2.9 2.9 2.9 2.9 2.9 2.9 2.9 2.9 2.9 2.9 2.9 2.9 2.9 2.9 2.9 2.9 2.9 2.9

2.10 2.10 2.10 2.10 2.10 2.10 2.10 2.10 2.10 2.10 2.10 2.10 2.10 2.10 2.10 2.10 2.10 2.10 2.10 2.10 2.10 2.10GG 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3

3.1 3.1 3.1 3.1 3.1 3.1 3.1 3.1 3.1 3.1 3.1 3.1 3.1 3.1 3.1 3.1 3.1 3.1 3.1 3.1 3.1 3.13.2 3.2 3.2 3.2 3.2 3.2 3.2 3.2 3.2 3.2 3.2 3.2 3.2 3.2 3.2 3.2 3.2 3.2 3.2 3.2 3.2 3.2

GG 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 44.1 4.1 4.1 4.1 4.1 4.1 4.1 4.1 4.1 4.1 4.1 4.1 4.1 4.1 4.1 4.1 4.1 4.1 4.1 4.1 4.1 4.14.2 4.2 4.2 4.2 4.2 4.2 4.2 4.2 4.2 4.2 4.2 4.2 4.2 4.2 4.2 4.2 4.2 4.2 4.2 4.2 4.2 4.2

GG 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 55.1 5.1 5.1 5.1 5.1 5.1 5.1 5.1 5.1 5.1 5.1 5.1 5.1 5.1 5.1 5.1 5.1 5.1 5.1 5.1 5.1 5.15.2 5.2 5.2 5.2 5.2 5.2 5.2 5.2 5.2 5.2 5.2 5.2 5.2 5.2 5.2 5.2 5.2 5.2 5.2 5.2 5.2 5.2

GP 2.x

GP 3.x

GP 4.x

GP 5.x

SP 3.x

SP1.x

SP 2.x

SP and GP-s not connected to ISO9001:2000

SP-s and GP-s connected to ISO9001:2000

ISO 9001 requirements in CMMI

Using results of SQI and Zádor Dániel Kelemen: Comparing ISO 9001:2000 to

CMMI (2007)



From ISO 9001 to CMMI

Process capability profile according to CMMI

found in 8 ISO 9001:2000-certified companies, where no previous CMMI-based SPI was conducted

(IKKK-GVOP-2004-3.2.2)



Some basic ideas Transform the way of doing Quality Management

Continuous QM, phased to projects (already at ML2 / CL2)

Product quality management (recommends ISO 9126) Measurement

Make use of existing quality goals and metricsBuild context-dependent quality profiles (eg. by

product type)Use GQM (Goal-Question-Metric paradigm)Do continuous measurement for important quality

attributes of products, processes, resources Do not forget: all PA’s need an attached

measurement already at CL2!

Moving from an ISO 9001-conform QMS towards CMMI



Some basic ideas (cont.) Define and implement „baselines” and configuration audits Describe estimation and risk management process (first at

project level) Plan, monitor, control all PA’s in scope ! Define a system to ensure bidirectional traceability of

requirements! ML/CL3:

Technical processes Define technical processes (possibility: make use of

product types defined – probably, each is connected to one technology!)

Standard processes and tailoring guidelines

Moving from an ISO 9001-conform QMS towards CMMI



ConclusionOne vision for QM – one QMS!Start by using the elements / standards /

models important for your business!Having QMIM framework in mind…

… the existing, solid QMS can be enhanced with new elements, required by the actual business goals

… there will be no (or very few) overlaps and redundancies



[email protected]

practical steps in using multiple software quality models in a synergic way dr. katalin balla sqi...

Documents

multiple quality models

synergic way practical

good quality software

synergic way conclusion

ones way

software specialists

certified software

small steps