focus group 2 network reliability pj aduskevicz, at&t ross callon, juniper wayne hall, comcast

Network Reliability and Interoperability Council

Focus Group 2Network Reliability

PJ Aduskevicz, AT&T

Ross Callon, Juniper

Wayne Hall, Comcast


Focus Group Membership• PJ Aduskevicz, AT&T• Ken Buckley, Federal Reserve Board• Ross Callon, Juniper• Rick Canaday, AT&T• Kevin Cavanagh, AT&T Wireless• Wayne Chiles, Verizon• Joe Craig, Qwest• Victor Devito, AT&T• Sean Donelan, SBC• Bernie Farrell, NCS• David Fears, Cox Communications• Lee Fitzsimmons, Nextel• Brian Goemmer, Western Wireless• Garnet Goins, Nextel• Jeff Goldthorp, FCC• Chris Gunner, Avici Systems• Wayne Hall, Comcast• Bruce Harrod, C&W• John Healy, FCC• Dean Henderson, Nortel Networks• Bob Holley, Cisco• Bruce Johnson, Verisign• Rick Kemper, CTIA• Bill Klein, ATIS• Bernie Ku, WorldCom

• Greg Larson, Exodus/CWUSA• Mike Lecocke, SBC • Chris MacFarland, Allegiance• Spilios Makris, Telcordia• Archie McCain, BellSouth• Dave McDysan, WorldCom• Brian Micene, AT&T Wireless• Denny Miller, Nortel• Erick Mogelgaard, Cox• Chris Oberg, Verizon Wireless• Bonnie Petti, Verizon Wireless• Tom Purcell, Nextel• Karl Rauscher, Lucent• Arthur Reilly, Cisco Systems• Ira Richer, The Telesis Group• Jim Runyon, Lucent• Andy Scott, NCTA• Don Smith, NCS• Ron Stear, C&W• Sandy Stephens, Focal• Jeff Swinton, Conexion Corp.• Whitey Thayer, FCC• Robert Vogel, PanAmSat Corp.• Doug Williams, Comcast Cable


Focus Group Mission Statement

• Define reliability measurements (units) for commercial communications networks (i.e., wireline and wireless transport networks, including satellite and cable) and for the Internet by March 22, 2003.

• Define reasonable, measurable customer-affecting outage reporting thresholds for commercial communications networks (i.e., wireline and wireless transport networks, including satellite and cable) and for the Internet by March 22, 2003.

• Conduct voluntary outage reporting trial, collect data, analyze results, and report on the validity, usefulness, and timeliness of the process and information obtained, and make recommendations for improvement.

• Based on trial results (including information on services affected by an outage), evaluate and report on the reliability of public communications network services in the United States.

• Should the Commission initiate an inquiry or rulemaking with respect to any of the above-mentioned issues, the Focus Group will provide input to the NRIC, which may make formal recommendations as a part of such proceeding(s).

• Evaluate, and report on, the reliability of public telecommunications network services in the United States.


Measurements and Thresholds Teams

Team Leader

Cable Wayne Hall

Wireless Dean Henderson

Internet Ross Callon (data) /Dean Henderson (voice)

Wireline Wayne Chiles /PJ Aduskevicz


Outage Occurs

Determine if Outage Meets Vol.

Trial Criteria

Fax to NCS/NCCOn (703/607-4998 )

Create Initial Report within 3 Days –Mark Company

Proprietary

ConductRoot Cause

Analysis

IdentifyBest Practices

Fax Final Reportwithin 30 DaysMark Company

Proprietary

NCS/NCC Logs Report

Scrub Data per Criteria Established

by FG 2

Scrubbeddata received by FG 2

Analyze ScrubbedData:•By Type/Segment•Impact•Frequency•Root cause for

CommonalityReview BP coverage

Provide status at NRIC VI Council

meetings

Make Recommendations

Monitor Progress

Concur or Provide Input on

Recommendations

Develop Final Report to Include Recommendations

Service Provider NCS/NCC Focus Group 2 NRIC VI andIndustry

If yes

If noLocal Root

Cause Analysis

Initial Final

Collect, Validate, And

Send Data

Initial Final

File Final Report

NRIC VI Voluntary Outage Reporting Trial Process

Approve Scrubbed Report


Voluntary Trial Confidentiality Process Flow protects confidentiality and security

concerns of the source data• Outage reports will be handed off to the NCC• The NCC has earned the trust of the industry in

protecting proprietary information• Company Proprietary marking on submitted outage

reports • Only scrubbed data will be handed off to team for

analysis• Non-Disclosure Agreement


Voluntary Trial Implementation

• Cable, Wireless, and Internet Service Providers

• Data Collection from January 1, 2003 through December 31, 2003

• Initial and Final Report Templates with Field Descriptions Provided

Inter-Domain Routers

PSTN

DSL

Wireless

Cable

Dial-Up

DNS RADIUSDHCP

Core Backbone

Distribution

Service Aggregation

XYZ Corp


Internet/IP ServiceProvider


Outage Reporting Units and ThresholdsTechnology Unit Threshold % Market

RepresentedPositive

Reporting

Cable Cable Modem > 30,000 Customers

> 30 Minutes

64% YES

Wireless Blocked Calls > 90,000 Blocked Calls

> 30 Minutes

82% YES

Internet

Cable Access

DSL Access

Satellite Access

Wireless Access

Dial-Up

Household

Household

Household

Devices

Modem Port

> 30,000 Customers

> 30 Minutes

52% YES


Wireline Measurements and Thresholds

• Charter: “The Committee will prepare and provide recommended requirements for network reliability and network reliability measurements for wireline … networks”

• Review is scheduled to start January of 2003 (Possible recommended Guidelines for current requirements, Changes to current requirements, “Fresh Look”)

• Fire Reporting

• Overall look at the rules

Network Reliability Steering Committee

NRSC

Third Quarter Report


Reliability Reporting – NRSC 3Q02 ReportFCC Reportable Service Outages

(by number of events)

38

54

3229

33

40 41

48

38

35

4240

45

4240

47 4844

4744

35

4852

4844

4341

34

46 47

52 55 52

43

38 39

292832

15

25

35

45

55

65

1Q

93

3Q

93

1Q

94

3Q

94

1Q

95

3Q

95

1Q

96

3Q

96

1Q

97

3Q

97

1Q

98

3Q

98

1Q

99

3Q

99

1Q

00

3Q

00

1Q

01

3Q

01

1Q

02

3Q

02

Quarter

Nu

mb

er

of

Ou

tag

es

Total outages were at the lowest level (126) of any four consecutive quarters since the start of the Baseline Period.


Reliability Reporting – NRSC 3Q02 ReportFCC Reportable Service Outages

(by outage index)

430

265300

318

622

299

618

427

470 555

364

305

481

345

414422

326223

519510

362

411

287

458

246

249

401

376376

440

331

412

300301 286

346

553

675

439

0

100

200

300

400

500

600

700

800

1Q93

3Q93

1Q94

3Q94

1Q95

3Q95

1Q96

3Q96

1Q97

3Q97

1Q98

3Q98

1Q99

3Q99

1Q00

3Q00

1Q01

3Q01

1Q02

3Q02

Quarter

Ou

tag

e In

de

x

The aggregate outage index was at the lowest level (1315) of any four consecutive quarters since the start of the Baseline Period.


Reliability Reporting – NRSC 3Q02 Report

Analysis of the outages for 3Q02 indicates: • Total outages were at the lowest level (126) of any four consecutive

quarters since the start of the Baseline Period. • The aggregated outage index was at the lowest level (1315) of any four

consecutive quarters since the start of the Baseline Period. Based upon analysis of all outages reported from 1Q93

through 3Q02, the NRSC notes that: • There is an increasing trend in the number of CO Power and CCS

outages. • There is an increasing trend in the frequency and aggregated outage

index of Procedural Errors as the root cause of outages. • There is a decreasing trend in the number of Local Switch outages.


Reliability Reporting – NRSC Reports

The NRSC urges all service providers and equipment vendors to review all best practices for application in their operations.

These Best Practices may be found at: http://www.nric.org/


Back Up


Voluntary Trial Process Definitions• Service Provider – Companies who provide Wireless, Satellite,

Cable, Internet and Wireline Services• NCS/NCC (National Communication System/National Coordinating

Center) - Joint industry-government organization and mechanism by which the federal government and telecommunications industry respond to national security and emergency preparedness (NS/EP) telecommunications service requirements.

• Focus Group 2 – A subcommittee of the NRIC VI Network comprised of representatives of industry associations, consultants, and providers for wireline and non-wireline services and equipment.

• NRIC VI – A federal advisory committee that is chartered to evaluate and report on the reliability of public telecomm network services in the US including the reliability of packet switched networks.


Outage Report Data CriteriaFinal Report field Scrub Action

Reporting Carrier/Service Provider

Delete and create outage tag (Service Provider identifier, i.e., Cable,

Wireless, Internet, plus a unique numerical identifier)

Contact Person Delete

Start Date Unchanged

Start Time of Impact Unchanged

Geographic area affected Delete

Estimated number of customers affected Unchanged

Types of Services Affected (if applicable) Unchanged

Duration of Outage (hours and minutes) Unchanged

Apparent or known cause Unchanged

Name of Equipment Involved [OPTIONAL] Delete

Type of Equipment Involved [OPTIONAL] Delete

Specific Part of Network Involved Unchanged

Methods Used to Restore Service [OPTIONAL] Unchanged

Steps Taken to Prevent Recurrence Unchanged

Root Cause and Trouble Found [OPTIONAL] Unchanged

Applicable Best Practice [OPTIONAL] Unchanged


Internet Measurements and ThresholdsType of Internet

AccessCustomer Definition Comments

Cable Household Whether or not actively using it at the time of the incident

DSL Household Whether or not actively using it at the time of the incident

Satellite Household Whether or not actively using it at the time of the incident

Wireless Devices Historical trends will be used

Dial-Up Modem Port Whether or not actively using it at the time of the incident


Reliability Reporting – NRSC 3Q02 ReportIncidents by Failure Category

(CO Power)

2

5

9

1

6

4

3

0

2

13 1

23

55

4

3

5 5

32

12

0

2

87 7 7

4 4

7 7 78

6

3

4

0

2

4

6

8

10

12

1Q

93

3Q

93

1Q

94

3Q

94

1Q

95

3Q

95

1Q

96

3Q

96

1Q

97

3Q

97

1Q

98

3Q

98

1Q

99

3Q

99

1Q

00

3Q

00

1Q

01

3Q

01

1Q

02

3Q

02

Quarter

Nu

mb

er

of

Ou

tag

es

There is an increasing trend in the number of CO Power outages.


Reliability Reporting – NRSC 3Q02 ReportIncidents by Failure Category(Common Channel Signaling)

8

5

7 7

3

7

2 2

5 52

32

5

1

45

12

1

544

54

77

667

10

14

88

9

77

8 10

0

2

4

6

8

10

12

14

16

1Q

93

3Q

93

1Q

94

3Q

94

1Q

95

3Q

95

1Q

96

3Q

96

1Q

97

3Q

97

1Q

98

3Q

98

1Q

99

3Q

99

1Q

00

3Q

00

1Q

01

3Q

01

1Q

02

3Q

02

Quarter

Nu

mb

er

of

Ou

tag

es

There is an increasing trend in the number of CCS outages.


Reliability Reporting – NRSC 3Q02 ReportProcedural Error Attributed Outages

(by number of events)

10111113

14

2019

19

15

29

1617

11

15

18

25

16

1510

26

20

19

13

18

1213

1213

11

13

911

6

16

1413 13

9

20

0

5

10

15

20

25

30

35

1Q

93

3Q

93

1Q

94

3Q

94

1Q

95

3Q

95

1Q

96

3Q

96

1Q

97

3Q

97

1Q

98

3Q

98

1Q

99

3Q

99

1Q

00

3Q

00

1Q

01

3Q

01

1Q

02

3Q

02

Quarter

Nu

mb

er

of

Ou

tag

es

There is an increasing trend in the frequency of Procedural Errors as the root cause of outages.


Reliability Reporting – NRSC 3Q02 ReportProcedural Error Attributed Outages

(by outage index) There is an increasing trend in the aggregated outage index of Procedural Errors as the root cause of outages.

349

155

186

59

166

96

170

150

172

143133

94 565670

206207198

130

82

126

171

119

5354

184

129122

107112

229

132

82

9893

9067

29

55

0

50

100

150

200

250

300

350

400

1Q93

3Q93

1Q94

3Q94

1Q95

3Q95

1Q96

3Q96

1Q97

3Q97

1Q98

3Q98

1Q99

3Q99

1Q00

3Q00

1Q01

3Q01

1Q02

3Q02

Quarter

Ou

tag

e In

dex


Reliability Reporting – NRSC 3Q02 ReportIncidents by Failure Category

(Local Switch)

32

4

0

2

4

899

14 14

10

12

10

88

1110

12

2

446665

45

4665

32

7 7 5

2

6

0

2

4

6

8

10

12

14

16

1Q

93

3Q

93

1Q

94

3Q

94

1Q

95

3Q

95

1Q

96

3Q

96

1Q

97

3Q

97

1Q

98

3Q

98

1Q

99

3Q

99

1Q

00

3Q

00

1Q

01

3Q

01

1Q

02

3Q

02

Quarter

Nu

mb

er

of

Ou

tag

es

There is a decreasing trend in thenumber of Local Switch outages.

focus group 2 network reliability pj aduskevicz, at&t ross callon, juniper wayne hall, comcast

Documents

wireless transport networks

comcast slide

att wireless wayne chiles

comcast cable slide

att wireless denny miller

att ross callon

verizon wireless bonnie

verizon wireless tom