standards of quality and quality of standards for ... › presentation › 6338 ›...

27
SIIT 2005 Geneva 21-23 October 1 Standards of quality and quality of standards for Telecommunications and Information Technologies (ICTs) M. H. Sherif, AT&T, U.S.A. T. M. Egyedi, Delft University of Technology, The Netherlands K. Jakobs, Aachen University, Germany

Upload: others

Post on 28-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 1

Standards of quality and quality of standards forTelecommunications and Information Technologies

(ICTs)

M. H. Sherif, AT&T, U.S.A.T. M. Egyedi, Delft University of Technology, The

NetherlandsK. Jakobs, Aachen University, Germany

Page 2: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 2

Central Thesis

• Standards development is a project• Quality of standardization can be evaluated using project

management methodology• Stakeholders have different interests and time scales• Current standardization process does not encourage quality

management• Risk management is done on a case-by-casel basis

Page 3: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 3

Outline

• How to define quality of standards?• Standards and TQM• Standards as projects• Risk indicators using project methodology• Conclusions and Perspectives

Page 4: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 4

Sponsors

Delegates

(Suppliers)

TechnicalCommittee(Producer)

Standard DevelopmentOrganisation (Owner)

Consumers(Developers)

Standard(Product)

Embodiment of thestandard

(Product within a product)

ContributionsEnd-users

Stakeholders

Page 5: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 5

Infrastructure Provider (s)

Content ProviderEnd-user

or Customer

Content Manager(Retailer,

broker, etc..)

Service Provider 2

Service Provider{virtualoperators,ISP,Storage AreaNetwork (SAN)provider}

Content Provider (Call center,catalogues, digital certificationauthority, news, movies, weatherreport, stock quotations)

Content Manager (CustomerRelationship Manager, contentpackaging, payment platform)

Network

Provider 1

Network

Provider 2

Service Provider 1

Interfaces to be Standardized in ICT

Page 6: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 6

Evolution of Equipment and Services

MarketPenetration

Time

4-10 years

Equipment

Services

• There is a difference in the timescale between equipment vendorsand service providers.

• For platform innovations, sales ofnetwork equipment constitute aleading indicator for serviceevolution

Page 7: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 7

Standardization for ICT Services• Internal standards

– increase operational efficiency– improve response to emergencies

• External standards– Reduce uncertainties concerning equipment compatibility– Establish framework for negotiation with other carriers and virtual operators– Ensure continuity of supply– Avoid monopoly of a single source– Reduce dependence on technical expertise– Standards for performance and quality– Communication of OSSs

Page 8: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 8

Cost of Deficient Standards

• Link State protocols– Loss of topology databases– Congestion of routing updates

• MPLS and LDP– No methods for operations, administration and maintenance of the

network– No methods for fault localization– No mechanism for end-to-end trouble shooting

Page 9: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 9

Highlights of the ICT Standardization Process

• Multiple interfaces• Time scale of interest is different

– It takes 3-4 years on average (range 1 -10 years) for an external standardto be developed and successfully implemented in commercial products

• Standardization is part of the process of knowledge management– Various approaches to standardization

• Follow the dominant trend• Passive participation• Technical contribution• Influence market expectations• Start a new consortium

• None of the stakeholders have direct control over the standardizationprocess

• Difference in perspective between each stakeholder

Page 10: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 10

Standards and TQM

• Crosby (1979): conformance to requirements– In standards, the commercial and strategic goals of the participants

are not part of the standard• Deming (1986): uniformity and predictability

– Standards are unique• Juran (1992): Fitness for use - ISO 9000

– User’s requirements are not available

Page 11: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 11

Standards as Projects

• Rapporteur or convener is the project manager• Weak control• What is a successful project?

– Meet the project requirements?– Financial success of the project output?

• “Successful” standards are widely implemented but– Deficiencies in the standards affect the quality, reliability and cost

of the product or service– Quality of the standardization process does not address the quality

of products or service and their financial success

Page 12: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 12

Standard Body

Company NCompany 1

Representative

Development Team

Inventing Team

Technical Group

Rapporteur

Company a

Secretariat of the Standard Body

Representative

Representative

Development TeamDevelopment Team

Inventing Team

Company 2

Page 13: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 13

Project Management Methodology

• Scope management• Time Management• Quality Management• Cost Management• Resource Management• Documentation Management

Page 14: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 14

Indicators that Scope is not well managed

• No or superficial terms of reference• Scope is not consistent with the lifecycle of the technology• Too many options for emerging technologies• Changes in the terms of reference without considering

impact on schedule• No formal process to re-evaluate the need for the standard

of change• Existing of other standard groups with similar or

overlapping activities• Frustrated stakeholders leave and form their own group

Page 15: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 15

Time Management

• ICT Stakeholders have different time horizons• Service vs. Equipment• Marketing vs. Technical• Speed of standardization should be commensurate with the

goals• Speed of standardization depends on the type of

standardization body

Page 16: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 16

Need

Anticipatory standards

Enabling standards

Product or service

Marketing Aspect of Standardization

Responsive Standards

Page 17: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 17

Examples• Anticipatory standards

– ISDN, WAP or GSM (partly), X.25, TCP/IP, UMTS, G3 and G4 facsimile,etc.

• Enabling (participatory) standards– GSM

• Responsive standards– GPRS, SMS (for service providers, but anticipatory for equipment

manufacturers)– HDLC

• Architectural innovations tend to avoid standards (minitel, i-mode, smartcards, etc.). Exceptions: Bluetooth and WAP

Page 18: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 18

The Technological Dimension:Technology Life Cycle

Mar

ket

Pen

etra

tion

Em

erge

nce

Impr

ovem

ent

Mat

urity

Subs

titut

ion

Obs

oles

cenc

e

Time

Page 19: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 19

Technology View of Standardization Timing

Time

Perf

orm

ance

Anticipatorystandards

Enablingstandards

Responsivestandards

Technology transition

New technology

Existingtechnology

Page 20: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 20

Quality Management

• Internal consistency• Formal description vs. human language description• Reviews (walk-throughs)• Automatic verification• Conformance testing and reference implementation• Interoperability Testing• Translation to other languages

Page 21: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 21

Cost Management

• Principle: benefits of development should exceed the cost• Application is difficult• Direct costs (travel, salaries, etc.)• Indirect costs (revealing proprietary information, royalties,

etc.)• Cost of deficient standards• Costs of incompatibilities, of conformance and

interoperability testing, etc.

Page 22: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 22

Difficulties of Cost Management

• Historical data are not available• Standard development is a shared exercise and the

expenditure is not centralized• Collecting real cost data is expensive• Alternatively, tracking the effort in terms of man-hours

may be a first step (the objective is not to meet someaccounting standards or regulation but to provide a projectplanning and decision tool)

Page 23: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 23

Resource Management

• Resources are borrowed and not dedicated full-time• Signs of trouble

– Some participants take over– Competing interests lead to a deadlock– Group think and rejection of new ideas

• Decision criteria including escalation procedures should bedefined in the scope

Page 24: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 24

Documentation Management

• More than just a basic form and style for the publisheddocuments

• Must be readable by outsiders• Contributions that justify the final text should be available• Web-centered document maintenance may offer some

remedies

Page 25: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 25

Stakeholders Interest in Standards Quality

Quality ofspecifications,documentation

Legitimacy due processRegulators

Quality of theimplementation

TechnologyEnd-Users

Quality of specs anddocumentation

TechnologyImplementors

Resource, quality,cost, time

Financial, marketing,technology

Companies

Quality of specs,resource, time

Technology, due processTechnicalCommittee

ResourceLegitimacy, due processStandards Body

PM AspectArea of InterestStakeholders

Process

Processandoutput

Output

Page 26: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 26

Can the standardization process be improved?

• Standardization process is distributed• There is a time lag between a standard and its embodiment

in a product or a service• There is no clear profit/loss responsibility• Cost of deficiencies in standards are deflected to other

parties than those that have defined the constraints ofscope, cost and time

• Market mechanisms do not offer incentives to improve thestandard process

Page 27: Standards of quality and quality of standards for ... › presentation › 6338 › 4982752ddb2… · SIIT 2005 Geneva 21-23 October 8 Cost of Deficient Standards •Link State protocols

SIIT 2005 Geneva 21-23 October 27

Conclusions and Perspectives

• Project management provides a check list of potentialtroublesome signs in the standardization process

• This list can be used for risk identification andmanagement at an individual level (rapporteur, standardbody or participant company)

• There is a need for wide scale education to encourage allstakeholders to use this list of risk management at theirlevels.