cleo carris and jim feenan 12 th december, 2007 wbc leadership review slides
TRANSCRIPT
![Page 1: Cleo Carris and Jim Feenan 12 th December, 2007 WBC Leadership Review Slides](https://reader035.vdocument.in/reader035/viewer/2022062417/551bc5d7550346be588b4d7d/html5/thumbnails/1.jpg)
WBC Leadership Review Slides
![Page 2: Cleo Carris and Jim Feenan 12 th December, 2007 WBC Leadership Review Slides](https://reader035.vdocument.in/reader035/viewer/2022062417/551bc5d7550346be588b4d7d/html5/thumbnails/2.jpg)
WBC Collaboration
“We want to engage with customers to help us all understand what will be delivered at each stage, capture any missing, changed or delayed requirements and ensure a positive Customer Experience”
To do this we:
• Hold frequent bilaterals
• Encourage direct customer involvement
• Provide “War Room” Support
• Flexibly reprioritise each 90 day development cycle
• Add and amend requirements with our customers
We need to take this approach forward into the End to End testing world.
![Page 3: Cleo Carris and Jim Feenan 12 th December, 2007 WBC Leadership Review Slides](https://reader035.vdocument.in/reader035/viewer/2022062417/551bc5d7550346be588b4d7d/html5/thumbnails/3.jpg)
WBC – Providing a Positive Customer Experience
“We are aiming for a Smooth and Seamless CE delivered through joint testing & collaborative development and communications”
We do this with:
• A CE roadmap planned and measured throughout the trial, launch and in-life stages of WBC.
• Use measurable CE targets to share underlying test results with customers, rather than getting bogged down in reams of test results.
• We focus on delivering a positive E2E CE for BTW, the CP and their EU customers.
• We help customers deliver a marketing and sales message based on the CE delivered by the product.
![Page 4: Cleo Carris and Jim Feenan 12 th December, 2007 WBC Leadership Review Slides](https://reader035.vdocument.in/reader035/viewer/2022062417/551bc5d7550346be588b4d7d/html5/thumbnails/4.jpg)
WBC CE Roadmap - High Level View Milestones
High Level Measures POCService
TrialCustomer Trial (1)
Launch(Apr 08)
Customer Trial (2)
In Life(Q3)
Mar-09Commit
QoS & CE Provide to ODD L2C AP/EP NA NA 96% 96% 96% 96% 96%
ELFs L2C AP/EP NA NA 7% 7% 7% 7% 4%(1)
RFT L2C EUA 80% 80% 85% 85% 87% 87% 95%
ELF EUA N/A 8% 8% 8% 8% 7% 4%(1)
RFT T2R EUA 50% 50% 60% 60% 65% As 20C 95% (6)
Repeat Reports N/A 20% 20% 20% As 20C As 20C As 20C (7)
Cleared in objective time T2R AP/EP NA NA 86% 86% 86% 86% 86%
Repeats T2R AP/EP NA NA 18% 18% 18% 18% 18%
Provisioning exceptions Migrations NA NA 3% 2% 2% 1% 1%
ELFs Migrations NA NA 8% 8% 8% 7% 4%(1)
CT L2C EUA 8WD 6.5WD 5WD 5WD 5WD 5WD
SelectableLead time(2)1 Hr (3)
CT L2C AP/EP N/A 23WD 10WD 10WD 10WD 10WD 5WD(4)
CT T2R EUA <96Hrs <72Hrs <50Hrs <40Hrs <40Hrs <40Hrs 2-24 (5)
CT T2R AP/EP N/A 7Hrs 7Hrs 6Hrs 6Hrs 6Hrs 5Hrs
In-life Fault Rate N/A N/A N/A 0.1 0.1 0.1 0.08
Billing Accuracy N/A N/A 100% 100% 100% 100% 100%
CP satisfaction with WBC service. NA 60% 80% 90% 80% 90% 90% (8)
![Page 5: Cleo Carris and Jim Feenan 12 th December, 2007 WBC Leadership Review Slides](https://reader035.vdocument.in/reader035/viewer/2022062417/551bc5d7550346be588b4d7d/html5/thumbnails/5.jpg)
WBC CE Roadmap – Consolidates underlying CE criteria and test results
Division/Author/OwnerMay 9, 2006www.btwholesale.com
WBC CE Roadmap - High Level View
NA
N/A
N/A
N/A
<96Hrs
N/A
8WD
NA
NA
NA
NA
N/A
50%
N/A
80%
NA
NA
POC
1%1%2%2%3%NAProvisioning exceptions Migrations
As 20C (7)As 20CAs 20C20%20%20%Repeat Reports
95%87%87%85%85%80%RFT L2C EUA
90% (8)90%80%90%80%60%CP satisfaction with WBC service.
100%100%100%100%100%N/ABilling Accuracy
0.080.10.10.1N/AN/AIn-life Fault Rate
5Hrs6Hrs6Hrs6Hrs7Hrs7HrsCT T2R AP/EP
2-24 (5)<40Hrs<40Hrs<40Hrs<50Hrs<72HrsCT T2R EUA
5WD(4)10WD10WD10WD10WD23WDCT L2C AP/EP
SelectableLead time(2)1 Hr (3)5WD5WD5WD5WD6.5WDCT L2C EUA
4%(1)7%8%8%8%NAELFs Migrations
18%18%18%18%18%NARepeats T2R AP/EP
86%86%86%86%86%NACleared in objective time T2R AP/EP
95% (6)As 20C65%60%60%50%RFT T2R EUA
4%(1)7%8%8%8%8%ELF EUA
4%(1)7%7%7%7%NAELFs L2C AP/EP
96%96%96%96%96%NAProvide to ODD L2C AP/EPQoS & CE
Mar-09Commit
In Life(Q3)
Customer Trial (2)
Launch(Apr 08)
CustomerTrial (1)
Service TrialHigh Level Measures
Milestones
Trial & launch success criteria – customer service requirements
As 20CAs 20CAs 20CAs 20C20%60%NAMaximum % CP manual handlingSupport/ Resource
100%100%99%99%95%90%NAEUA & AP/EP Product Compliance with Handbook, STINs etc
100%100%99%99%95%90%TBDEUA & AP/EP availability of product functionality
Product Functionality
99.995%TBDTBDTBDTBDTBDTBDNetwork service availability (including planned outages)
6.1.46.1.46.1.45.0.35.0.35.0.35.0.3Network releases availabilityNetwork
Same as IPstream
16%18% total order types
15% provide, cease, modify
20% simprovide
20% provide, cease & modify
50% simprovide
60% provide, cease & modify
100%Maximum % Customer Service manual handling
99%99%99%99%90%50%NASuccess rate of T2R transactions
99%99%99%99%90%50%NASuccess rate of L2C transactions
5000OSS live test environment requirement volume dependency
TBDTBDTBDTBDTBDTBDTBDBB E2E system response time (L2C & T2R) - latency
99%99%99%99%90%50%NABB E2E system & OSS network availability (inc planned outages)
TBDCycle 8Cycle 8Cycle 7Cycle 6Cycle 5ManualDevelopment cycle availabilityOSS
2mTBD200003000300025015EUA volume ramp-up profile (up to)Volume Profiles
Mar-09CommitIn Life
Customer Trial (2)Launch
Customer Trial (1)
Service TrialPOCHigh Level Measures
Milestones
Trial & launch success criteria – CP & EU requirements
TBDTBDTBDTBDTBDTBDTBDEtc – to be determined
90%90%80%90%80%60%NAEU Perception of WBC Service
40%40%40%40%40%NANA% on higher line rate than Max
5%5%5%5%10%NANA% on lower line rate than Max
0.005%0.005%0.005%0.005%0.05%0.5%NA% flappers
5 days5 days5 days8 days10 daysNANATime to stabiliseQoS & CE
Mar-09CommitIn Life
Customer Trial (2)Launch
CustomerTrial (1)
Service TrialPOCHigh Level Measures
Milestones
Trial & launch success criteria – customer migration additional requirements
TBDTBDTBDTBDTBDTBDTBDEtc – to be determined
TBDTBDTBDTBDTBDTBDTBDVolume supported
TBDTBDTBDTBDTBDTBDTBDNo of single line regressions
TBDTBDTBDTBDTBDTBDTBDAve time out of service
TBDTBDTBDTBDTBDTBDTBDNo of outagesQoS & CE
Mar-09CommitIn Life
Customer Trial (2)Launch
CustomerTrial (1)
Service TrialPOCHigh Level Measures
Milestones
1-Urgent2-High
Defects - Age Graph
Times: D-Days, W-Weeks, M-Months, Y-Years
0D
1D
2D
3D
4D
5D
6D
1W
2W
3W
4W 1M
2M
3M
4M
5M
6M
7M
8M
Nu
mber
of D
efe
cts
40
35
30
25
20
15
10
5
0
27
9
2
14
10
13
10
23
12
5
2
38
10
31 1
3 21
4.081.473.2Test run rate4.080.943.2Pass run rate
19/11/2007
12/11/2007UAT Start date - duration 30 days
RequiredActualPlanned
8No. of tests in flight2No. of tests descoped
32%% Tests possible complete10%% Inflight25Total number of tests run1%% Failed79%% of initial no. possible
21%% Passed77No. of tests possible
1Failed19No. of tests blocked16Passed98Initial no. of tests
wBc Q2/Cycle 6 L2C IVVT High level progress
4.081.473.2Test run rate4.080.943.2Pass run rate
19/11/2007
12/11/2007UAT Start date - duration 30 days
RequiredActualPlanned
8No. of tests in flight2No. of tests descoped
32%% Tests possible complete10%% Inflight25Total number of tests run1%% Failed79%% of initial no. possible
21%% Passed77No. of tests possible
1Failed19No. of tests blocked16Passed98Initial no. of tests
wBc Q2/Cycle 6 L2C IVVT High level progress
High Level View
Lower Level CE Support Requirements Detailed network &
IVV&T results
![Page 6: Cleo Carris and Jim Feenan 12 th December, 2007 WBC Leadership Review Slides](https://reader035.vdocument.in/reader035/viewer/2022062417/551bc5d7550346be588b4d7d/html5/thumbnails/6.jpg)
WBC product overview
CP
CMSANs
Aggregation Point 1
Metros
BRAS
Aggregation Point 20
*
*
*EU
*
*
*EU
MSIL
MSIL Downstream Network
WBC – three main components
EUA Aggregation Point & Extension Path
Customer Network & Interconnect
123
What Does End to End Testing Mean for WBC? ->
![Page 7: Cleo Carris and Jim Feenan 12 th December, 2007 WBC Leadership Review Slides](https://reader035.vdocument.in/reader035/viewer/2022062417/551bc5d7550346be588b4d7d/html5/thumbnails/7.jpg)
WBC End to End Testing overview
CP
CMSANs
AggregationPoint 1
Metros
BRAS
AggregationPoint 20
*
*
*EU
*
*
*EU
MSIL
MSIL Downstream Network
CP
CMSANs
AggregationPoint 1
Metros
BRAS
AggregationPoint 20
AggregationPoint 1
Metros
BRAS
AggregationPoint 20
*
*
*EU
**
**
**EU
*
*
*EU
**
**
**EU
MSIL
MSIL Downstream Network
123Internet
End Users CP Help Desks Web Portals
CPE
B2B GatewaysBTW SMC
VOIP
VAD/ IPTV
WBC ProductCP Servers &
Interface
People OSS
Support Systems
![Page 8: Cleo Carris and Jim Feenan 12 th December, 2007 WBC Leadership Review Slides](https://reader035.vdocument.in/reader035/viewer/2022062417/551bc5d7550346be588b4d7d/html5/thumbnails/8.jpg)
CPE Compatibility Testing is also a key component of the E2E testing story for Customers