umts network kpi
TRANSCRIPT
-
8/11/2019 Umts Network Kpi
1/42
Appendix U12
UMTS Network KPI
This Appendix is incorporated into the Original Agreement between Seller and Purchaser asprovided in the UMTS (i!th" Amendment to the Original Agreement#
A$$ MAT%&'A$S ')$U*%* +%&%' A&% )O'*%T'A$ U$%SS OT+%&,'S% '*')AT%*# Thein!ormation contained herein is intended onl- !or the person or entit- to which it is addressed and ma- containcon!idential and.or privileged material# An- review/ retransmission/ dissemination/ or other use or reliance uponthis in!ormation b- persons or entities other than the intended recipient is prohibited# The in!ormation providedherein is sub0ect to protection !rom disclosure/ reproduction and use as set !orth in the Mutual ondisclosure
Agreement entered in to b- Seller and TMobile USA/ 'nc#
TMobile USA/ 'nc# 1 o! 2Strictl- )on!idential and Proprietar- 3.24.241UMTS etwor5 6P'/ Appendix U12
-
8/11/2019 Umts Network Kpi
2/42
-
8/11/2019 Umts Network Kpi
3/42
Table o Contents
UMTS NETWORK KPI..........................................................................................................................................................1
1 INTRODUCTION..........................................................................................................................................................5
1.1 SUMMARYOFLEVEL-1 KPI ANDTARGETS.............................................................................................................5
2 PERFORMANCE COMMITMENTS AND REQUIREMENTS...............................................................................8
2.1 MILESTONEDEFINITION..........................................................................................................................................82.2 SCOPE......................................................................................................................................................................8
2.3 GENERALREQUIREMENTS.......................................................................................................................................82.4 CONTRACTUALKPI COMMITMENTS.......................................................................................................................9
3 UTRAN LEVEL-1 KEY PERFORMANCE INDICATORS......................................................................................9
3.1 CIRCUITSWITCEDLEVEL-1 KEYPERFORMANCEINDICATORS.............................................................................9
3.1.1 Circuit Switched Call Setup.............................................................................................................................10
3.1.2 RRC Establishment Causes..............................................................................................................................113.1.3 CSV Access Failure..........................................................................................................................................11
3.1.4 CSV Drop.........................................................................................................................................................13
3.1.5 CSV Qualit......................................................................................................................................................1!
3.1.6 CSV Cell Capacit............................................................................................................................................1"
3.1.7 CSV So#t$So#ter %ando&er '&erhead...............................................................................................................1(3.1.8 CSV )nter*Radio Access +echnolo, %ando&er Failure..................................................................................1-
3.1.9 CSV Call Setup +ime........................................................................................................................................0
3.1.10 CSD Access Failure.....................................................................................................................................13.1.11 CSD Drop....................................................................................................................................................
3.1.12 CSD Qualit................................................................................................................................................3
3.1.13 CSD Call Setup time....................................................................................................................................!
3.2 PACKETSWITCEDLEVEL-1 KEYPERFORMANCEINDICATORS............................................................................253.2.1 /acet Switched Call Setup..............................................................................................................................
3.2.2 /SD Access Failure.........................................................................................................................................."
3.2.3 /SD Drop.........................................................................................................................................................-
3.2.4 /SD 2atenc.....................................................................................................................................................3.2.5 /SD +hrou,hput...............................................................................................................................................
3.2.6 /SD Call Setup +ime........................................................................................................................................313.2.7 /SD )nter*Radio Access +echnolo, %ando&er Failure..................................................................................31
3.2.8 /SD )RA+ )nterruption time.............................................................................................................................333.2.9 %SD/A Access Failure.....................................................................................................................................3!
3.2.10 %SD/A Drop................................................................................................................................ ............ ...3
3.2.11 %SD/A 2atenc............................................................................................................................... ............3"
3.2.12 %SD/A +hrou,hput.....................................................................................................................................3(3.2.13 %S4/A +hrou,hput.....................................................................................................................................3
3.2.14 %SD/A Data Session Setup +ime.................................................................................................... ............!0
3.3 SYSTEMAVAILA!ILITY..........................................................................................................................................4"
3.3.1 A&era,e Cell A&ailabilit..................................................................................................................................!13.3.2 A&era,e Cell 5on*6aintenance A&ailabilit....................................................................................................!1
3.4 COMPARISONOFUMTS ANDGSM NETWORKPERFORMANCE............................................................................42
3.5 IMPACTOFUMTS ONGSM NETWORKPERFORMANCE........................................................................................42
4 UTRAN LEVEL-2 KEY PERFORMANCE INDICATORS....................................................................................43
TMobile USA/ 'nc# ; o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
4/42
! Intro"uction
The purpose o! this Appendix U12 is to de!ine etwor5 6e- Per!ormance 'ndicators (6P'" !or the UMTS
drive test/ UT&A counter based measurements and per!ormance targets and !ormulas !or each o! the
6P'# All capitalied terms/ acron-ms/ and de!initions used in this Appendix U12 are listed in either the
UMTS Acron-ms and *e!initions (Appendix U13"/ or in the Original Agreement#
The UT&A 6P' de!inition and development e!!ort is per!ormed at the two levels as de!ined belowB
$evel1 6P'B are the highlevel metrics used !or overall service Cualit- measurement and monitoring
the health o! Purchaser@s UT&A etwor5# These metric de!initions shall be agreed to b- Seller/
and SellerDs implementation o! the $evel1 metrics shall be in compliance with PurchaserDs
de!initions de!ined in this Appendix U12#
$evel2 6P'B are the detailed engineering level metrics that shall be used !or engineering/
dimensioning the etwor5/ the investigation and troubleshooting o! problem areas in the UMTS
etwor5#
Summar# o $e%el&! KPI an" Tar'ets
KPI Parameter Table
(eerence
Pre&$aunch
)Milestone !*
$aunch
)Milestone +*
Post $aunch
)Milestone ,*
)SE Access ailure &ate Table ; F 2#4 G F 2#4 G F 2#4 G
)SE *rop &ate Table : F 2#4 G F 2#4 G F 2#4 G
)SE Hualit- (*$" Table 3 ?:thpercentile
o! samples F
2#4 G >$%&
?:thpercentile o!
samples F 2#4 G
>$%&
?:thpercentile
o! samples F
2#4 G >$%&
)SE Hualit- (U$" Table 3 ?:thpercentile
o! samples F
2#4 G >$%&
?:thpercentile o!
samples F 2#4 G
>$%&
?:thpercentile
o! samples F
2#4 G >$%&
)ell )apacit- Table 14 I 4 U- AM(
!+.+k
(provided it is
achieved in &
design"
I 4 U- AM(
!+.+k (provided it
is achieved in &
design"
Measure and
report
So!t.So!ter +andover
Overhead
Table 12 F 1#9 F 1#9 F 1#=
)SE '&AT ailure &ate Table 1 .A F :#4 G F :#4 G
JEoice )all Setup time
(Mobile to PST"
Table 1: ?:thpercentile
F 9 seconds
?:thpercentile F 9
seconds
?:thpercentile F
9 seconds
JEoice )all Setup time Table 1: ?:thpercentile ?:thpercentile F ?:thpercentile
TMobile USA/ 'nc# o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
5/42
(Mobile to Mobile" F ? seconds ? seconds F ? seconds
)S* Access ailure &ate Table 1= F ;#4 G F 2#4 G F 2#4 G
)S* *rop &ate Table 1? F 2#: G F 2#: G F ;#4 G
()ounter"
F 2#: G (*rive
Test"
)S* Hualit- (*$" Table 21 ?:thpercentile
o! samples F
1#4 G >$%&
?:thpercentile o!
samples F 1#4 G
>$%&
?:thpercentile
o! samples F
1#4 G >$%&
)S* Hualit- (U$" Table 21 ?:thpercentile
o! samples F
1#4 G >$%&
?:thpercentile o!
samples F 1#4 G
>$%&
?:thpercentile
o! samples F
1#4 G>$%&
J)S* )all Setup time Table 22 #A ?:thpercentile F ?seconds
#A
PS* Access ailure &ate Table 2 F 2#4 G F 2#4 G F 2#4 G
PS* *rop &ate Table 29 F 2#: G F 2#4 G F 2#4 G
JPS* $atenc- (an- &??
&A>"
Table 23 #A ?:thpercentile
F 244ms
#A
PS* &?? Average *$throughput (5bps"
(Unloaded"
Table ;1 I 24 I 24 I 1:4 ()ounter"
I 24 (*rive
Test"
PS* &?? Average *$
throughput (5bps"
($oaded"
Table ;1 I 214 I 214 I 1:4 ()ounter"
I 214 (*rive
Test"
PS* &?? Average U$
throughput (5bps"
(Unloaded"
Table ;2 I 244 I 244 I 1:4 ()ounter"
I 244 (*rive
Test"
PS* &?? Average U$
throughput (5bps"
($oaded"
Table ;2 I 134 I 134 I 1:4 ()ounter"
I 134 (*rive
Test"
JPS* )all Setup time Table ; #A ?:thpercentile
sessions F :
#A
TMobile USA/ 'nc# : o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
6/42
seconds
PS* '&AT ailure &ate Table ;9 .A F :#4 G F :#4 G
PS* '&AT 'nterruption time Table ;? #A ?:th percentile
F 12 seconds
#A
PS* '&AT User *ata
'nterruption time
Table ;? #A Measure and&eport
#A
+S*PA Access ailure
&ate
Table 1 F 2#4 G F 2#4 G F 2#4 G
+S*PA *rop &ate Table ; F ;#4 G F 2#4 G F 2#4 G
J+S*PA $atenc- Table : #A ?:thpercentile
sessions F 144
ms
#A
Stationar- Maximum *$
+S*PA >it &ate (5bps"
under no load (U%
)ategor- 12"
Table = I 1;44 I 1;44 I1;44
(at &$) $a-er
using counter"
Stationar- Maximum *$
+S*PA >it &ate (5bps" with
:4G *$ loading (U%
)ategor- 12"
Table = I 1144 I 1144 #A
+S*PA Average *$Throughput (5bps" !or U%
categor- 12 under no load
Table 3 I =44 I =44 I =44
(at o!! pea5"
+S*PA Average *$
Throughput (5bps" !or U%
categor- 12 under :4G *$
loading
Table 3 I 944 I 944 #A
+SUPA Stationar- Pea5
throughput (5bps" !or U%
)ategor- ; (1#: Mbps"
Table :4 I 1144 I 1144 Measure and
&eport
+SUPA Stationar- Average
throughput (5bps" !or U%
)ategor- ; (1#: Mbps"
Table :4 I :44 I :44 Measure and
&eport
J+S*PA Session Activation
time
Table :1 #A ?:thpercentile
sessions F :
seconds
#A
TMobile USA/ 'nc# 9 o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
7/42
JAverage )ell Availabilit-
6P'
Table :; #A #A #AJJ
JAverage )ell on
Maintenance Availabilit-
6P'
Table :: #A #A #AJJ
-
8/11/2019 Umts Network Kpi
8/42
S-stem Acceptance (Appendix U19"# As terminal per!ormance ma- also have an impact on theper!ormance/ the brand and model o! terminal to be used !or the tests shall be mutuall- agreed to b-Seller and Purchaser#
)ounter based statistics !or $evel1 6P' shall cover all tra!!ic classes and include all causes o!
!ailures.successes to indicate end to end per!ormance as viewed b- UT&A#
Contractual KPI Commitments
The !ollowing 6P's and targets shall be valid !or the li!etime o! the etwor5/ provided that there is a Support
Agreement in place !or the Seller provided S-stems#
Table +1 KPI Parameter Commitment or the lietime o the UMTS Network
SN KPI Parameter Tar'et
1 )SE )all Setup Time (Mobile to PST" F 9 seconds
2 )SE )all Setup Time (Mobile to Mobile" F ? seconds
; )S* )all Setup time (Mobile to Mobile" F ? seconds
PS* $atenc- an- &?? &A> F 244 ms
: PS* )all Setup Time F : seconds
9 +S*PA $atenc- F 144ms
= +S*PA *ata Session Setup Time F : seconds
3 )ell Availabilit- As per Table :;
? )ell Availabilit- (onMaintenance" As per Table ::
The UMTS etwor5 is expected to meet or exceed the 6P' targets speci!ied in this Appendix U12 within the
UMTS Service Area with or without loading the UMTS etwor5#
Seller commitment applies to $evel1 6P' !or achieving target values at the milestone applicable to 6P'#
6P' counter metrics shall be based on UT&A view o! etwor5 Per!ormance# Seller shall provide all$evel1 6P' counters used in the !ormulas de!ined in this Appendix U12 at Milestone2 with theexception o! S&> counters !or Access ailure# Seller shall provide all $evel1 6P' reports !or 6P'
Acceptance#
Purchaser shall de!ine 6P' $evel2 reCuirements as outlined in Section #
3 UT(AN $e%el&! Ke# Perormance In"icators
This Section describes the UT&A $evel1 6P'/ or high level service metrics# $evel1 6P' is subdivided into two basic service domainsB the )ircuit Switched ()S" domain that includes Eoice and Eideocalls/ and the Pac5et Switched (PS" domain that includes &?? Pac5et *ata and +S*PA.+SUPA *ataSessions#
Circuit Switche" $e%el&! Ke# Perormance In"icators
The two (2" t-pes o! services in the )S domain are )ircuit Switched Eoice ()SE" and )ircuit Switched*ata ()S*"#
TMobile USA/ 'nc# 3 o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
9/42
,.!.! )ircuit Switched )all Setup
The setup o! a )S service is comprised o! three basic steps (see igure 1"# irst/ U% must accessthe UT&A and establish an &&) connection# Once this connection is completed the on AccessStratum (AS" messages are exchanged between the U% and the )ore etwor5 ()" e#g# )MService &eCuest/ Authentication/ Securit-/ etc# The last step o! the call setup is the establishment o!a &adio Access >earer (&A>" between the ) and the U%#
2i'ure !1 Call Setup 3lock Dia'ram
igure 2 illustrates a call setup !low diagram !or a )S mobile originated call# '! a problem occursbetween &&) )onnection &eCuest (step 1"/ and &AAPB &A> Assignment &esponse (step 2="/
Alerting.)onnect (step 2?" in case o! drive test/ it is considered an Access ailure# An- &A>abnormal release a!ter &A> Assignment &esponse (in case o! )ounter ormula"/ Alerting.)onnect
message (in case o! *rive Test ormula" is considered a dropped call#
TMobile USA/ 'nc# ? o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
%stablish&&)
)onnection
on AccessStratum
Messaging
&adioAccess>earer(&A>"Setup
-
8/11/2019 Umts Network Kpi
10/42
2i'ure +1 Circuit Switche" Call Setup 2low Dia'ram
,.!.+ &&) %stablishment )auses
Table 1 provides a list o! &&) establishment causes# ,hen the U% attempts to setup a &&))onnection with the UT&A/ the U% sends a &&) )onnection &eCuest message# %mbedded within
this message is an in!ormation element that communicates the establishment cause !or theconnection reCuest# This establishment cause shall be utilied to di!!erentiate )S and PS call 6P'related to Access ailure# Separate counters !or each tra!!ic classes !or ever- &&) )onnection&eCuest and &&) )onnection )omplete (as per ;ac5ground )all
? %mergenc- )all
14 'nter&AT )ell reselection11 'nter&AT )ell change order
12 &egistration
1; *etach
1 Originating +igh Priorit- Signaling
1: Originating $ow Priorit- Signaling
19 )all reestablishment
1= Terminating +igh Priorit- Signaling
13 Terminating $ow Priorit- Signaling
1? Terminating K cause un5nown
,.!., )SE Access ailure
Access !ailure is the product o! the &&) )onnection ailure/ AS Setup ailure and the &A>%stablishment ailure# &&) )onnection Success is counted when the &) receives a &&) Setup)omplete !rom the U%# AS Setup is considered success!ul when the signaling messages in thecall !low during call setup !low is success!ull- completed b- relevant etwor5 %lements# A &A> is
TMobile USA/ 'nc# 14 o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
11/42
considered success!ull- established when the &A> Assignment &esponse is sent b- &) to the)#
-uation !1 CSV Access 2ailure (ate )Counter 2ormula*
144J
#$R%&
#$R%&'
&
&'
&
&1
CSV7uestAssi,nmentRA8
CSVsponseAssi,nmentRA8
SR8Attempt
SR8Success
AttemptConnectionRRC
SuccessConnectionRRC
The above !ormula de!inition shall be met with the !ollowing Seller@s counters#
144J
U()*+C-(S%%/0$*,0A((%-N4R*E(
U()*+C%S%%/0$*,0S//-N4R*E('
,,#C$U()*+C%C4++%/(R%6-T4(N4R)/
*+C%,,#CS//$U()C4++%/(R%6-T4(N4R)/1
Seller shall develop S&> counters b- &A &elease P3# Seller and Purchaser agreed to use ??#?;GS&> success rate until S&> counters per )S and PS domain are made available at P3#
As an interim solution/ it shall be de!ined as a drop rate o! 2G over an average call length o! ?4seconds/ the probabilit- o! dropping the S&> during the direct trans!er phase is ;s.?4sJ2GL 4#4=G#'! during the deplo-ment/ !ault rates higher than 4#1G are observed/ seller shall develop counters inP=#
Measurement Con"ition1
'n case o! multiple &&) connection reCuests onl- the !irst &&) connection reCuest shall be ta5eninto consideration !or 6P' calculation#
Table +1 CSV Access Term Deinition
Ke# Perormance In"icator Term Deinition
#RRC Connection Success (CSV) The number o! success!ul &&) )onnection )ompletewith an- establishment cause that lead to )SE &A>#
#RRC Connection Attempt (CSV) The number &&) )onnection &eCuest Messagesreceived with an- establishment cause that leads to a)SE &A>#
#RAB Assignment Response (CSV) The number o! &AAPB &A> Assignment &esponsemessages sent !rom the &) to the MS) !or a voicecall#
#RAB Assignment Request (CSV) The number o! &AAPB &A> Assignment &eCuestmessages sent !rom the MS) to the &) to establish a
voice call#
# SRB Attempt The number o! &&) )onnection )ompletes that willlead to an 'nitial *irect Trans!er to the )S domain andwill also lead to a )SE &A> Assignment &eCuest#
# SRB Success The number o! )SE &A> Assignment &eCuests
-uation +1 CSV Access 2ailure (ate )Dri%e Test 2ormula*
TMobile USA/ 'nc# 11 o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
12/42
=
CallsCSV
CallsCSV
7uestConnectionRRC
ConnectAlertin,CC
ailureRateCSVAccessF
7
7
R%7
87
1'1""
Measurement Con"ition1
'n the event that there are several consecutive &&) )onnection &eCuest onl- the !irst &&) connection
reCuest shall be ta5en into account !or the 6P' calculation#
)alls are considered as !ailed during access when a connection is attempted and the U% does not receive
Alerting.)onnect message in case o! drive test measurement# or OSS &AAPB &A> Assignment
&esponse message !rom the &) to core etwor5 is considered as a call success!ul setup#
Table ,1 CSV Access 2ailure (ate KPI
Pre&$aunch $aunch Post&$aunch
4 +.5 6 4 +.5 6 4 +.5 6
,.!.7 )SE *rop
)ircuit Switched Eoice *rop measures the etwor5@s inabilit- to maintain a call# )SE *rop isde!ined as the ratio o! abnormal speech disconnects/ relative to all speech disconnects (both normaland abnormal"#
A normal disconnect is initiated b- a &A> *isconnect &AAP message !rom the MS) at thecompletion o! the call# An abnormal &A> disconnect includes &adio $in5 ailures/ U$ or *$inter!erence or other reason and can be initiated b- either UT&A or )#
-uation ,1 CSV Drop (ate )Counter 2ormula*
144J
+
#$R%$R%&
#$R%&1
CSVleaselRA8AbnormaCSVleaseRA85ormal
CSVlease5ormalRA8
144J
+
*+C%,S%%/0$U()R*R%,%*%-N4S(%-*+C%,,#S%%/0$U()R*R%,%*%-N4N4)-*,
*+C%,,#S%%/0$U()R*R%,%*%-N4N4)-*,1
)ounter *escription
pmNoS#stem(ab(eleaseSpeech umber o! s-stem &A> releases (Speech 12#25 and
AM& arrow >and" !or the best cell in the Active Set#pmNoNormal(ab(eleaseSpeech umber o! normal &A> releases (Speech 12#25 andAM& arrow >and" !or the best cell in the Active Set#
Table 71 CSV Drop Term Deinition
6e- Per!ormance 'ndicator Term *e!inition
#RABNormalRelease(CSV) umber o! voice &A> normall- released
#RABAbnormalRelease(CSV) umber o! voice &A> abnormall- released
TMobile USA/ 'nc# 12 o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
13/42
-uation 71 CSV Drop (ate )Dri%e Test 2ormula*
=
CallsCSV
CallsCSV
uccessCallSetupS
dCallDroppe
eCSVDropRat
7
7'1""
Measurement Con"ition1
An- )SE call success!ull- handed over !rom ;< to 2< networ5 within the )SE Service Area shall beconsidered as drop call !or Milestone 2#
Table 81 CSV Drop (ate KPI
Pre&$aunch $aunch Post&$aunch
4 +.5 6 4 +.5 6 4 +.56
3.1.5 )SE Hualit-
Eoice Cualit- shall be measured b- >$%&
-uation 81 CSV U$ 9ualit# )Counter 2ormula*
144J#$&
#$&
Speechombinin,SelectionCA#ter4plin0)n8loc0sport+otal+rans
Speechombinin,SelectionCA#ter4plin0)n8loc0s+ransportFault
U$ >$%& is also available as average over the whole &eporting period (1: minutes" as a counterdescribed in the !ollowing !ormula using &) based countersB
144J:,;U%R/(!,4/$%& measurements willresult in low accurac- !or each sample#
Table :1 CSV U$ 9ualit# Terms Deinition
TMobile USA/ 'nc# 1; o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
14/42
Ke# Perormance In"icator Term Deinition
#Faulty Transport Blocks in plink a!terSelectionCombining (Speec")
umber o! !ault- Uplin5 *)+ transport bloc5s !orspeech a!ter selection and combining# Samplingperiod shall be ever- ten (14" seconds#
#Total Transport Blocks in plink a!terSelectionCombining (Speec")
Total number o! Uplin5 *)+ transport bloc5s !orspeech a!ter selection and combining# Sampling
period shall be ever- ten (14" seconds#
-uation :1 CSV D$ 9ualit# )Dri%e Test 2ormula*
144J#$&
#$&
Speechnin,A#terCombiDownlin0)n8loc0sport+otal+rans
Speechnin,A#terCombiDownlin0)n8loc0s+ransportFault
)P' !or &%S is !ound under &A Per!ormance Management radio %nvironment StatisticsBUS%& *%S)&'PT'O 149.1::;+S* 141 42.: Uen >
Measurement Con"ition1
*$ Cualit- shall be measured in all three (;" Milestones (Pre$aunch/ $aunch and Post $aunch"
This 6P' shall be measured at 1G >$%& operating point set in UT&A !or voice call#
>$%& shall be available using counters with )ell $evel granularit-# 6P' !or MS; shall be calculatedat Mar5et $evel# or MS;/ *$ >$%& shall be measured using &%S counters or drive test asreCuired#
*$ >$%& is reported b- the mobile according to ;
-
8/11/2019 Umts Network Kpi
15/42
This 6P' shall be measured at 1G >$%& operating point set in UT&A !or voice call# The downlin5 >$%&
value shall be collected !rom the U% having reporting period o! 2 seconds and aggregated over a period
o! 14 seconds in Post Processing Tool !or calculation o! 6P'# An- !raction o! 14 seconds shall also be
included in this 6P' calculation# The >$%& calculation shall be made !rom the time when )onnect
message is received#
Table
-
8/11/2019 Umts Network Kpi
16/42
-uation =1 Cell Capacit# )Dri%e Test 2ormula*
llA&,R2/erCarR2A&,/ower/e
c/owerCell+ra##iacitCSVCellCap
''1""=
Table !51 Cell Capacit# KPI
Pre&$aunch $aunch Post&$aunch Units
> 75 )pro%i"e" it isachie%e" in (2
"esi'n*
> 75 )pro%i"e" it isachie%e" in (2
"esi'n*
> Measure an"report
? o AM(!+.+ U-@s
Measurement Con"ition1
)SE )ell )apacit- shall be calculated based on average *$ power allocated to AM& 12#2 &> !or this 6P'#
The whole o! )luster.Mar5et drive data shall be used to calculate this 6P'#
3.1. )SE So!t.So!ter +andover Overhead
So!t.So!ter +andover Overhead 6P' provides an indication o! how man- )ells or Sectors were in the
active set during the call on an average basis#
-uation !51 Sot/Soter an"o%er B%erhea" )Counter 2ormula*
=
== 6
AS
6
AS
ASDuration
ASDurationAS
erhead%ando&er'&So#tSo#ter
1
1
#$
#$'
(.-S5-U%W+A/(S%((03R,4R,I.-S5-U%W+A/(S%((03R,3R,I.-S5-U%W
(.-S5-U%W+A/(S%((02R,3R,I.-S5-U%W+A/(S%((02R,2R,I.-S5-U%W
(0.-S5-U%W+A/(S%((01R,2R,I.-S5-U%WI+A/(S%((01R,1R,$.-S5-U%W
.-S5-U%W+A/(S%((03R,4R,I.-S5-U%WI+A/(S%((02R,4R,$.-S5-U%W'4
.-S5-U%W+A/(S%((02R,3R,I.-S5-U%WI+A/(S%((01R,3R,$.-S5-U%W'3
(.-S5-U%WI+A/(S%((01R,2R,$.-S5-U%W'2I+A/(S%((01R,1R,$.-S5-U%W
+++
+++
++
+++
+++
++
=erhead%ando&er'&So#tSo#ter
The counters !or this 6P' measures not onl- )SE So!t.So!ter +andover Overhead !or all )Sconnections but also !or PS connections#
Measurement Con"ition1
The counters have a sampling rate o! 1 minute and the counters should be aggregated over a su!!icientl-
long period !or statistical validit-#
Table !!1 Sot/Soter an"o%er B%erhea" "einition
Ke# Perormance In"icator Term Deinition
Maximum Active Set sie as de!ined in &)
AS Active Set sie
TMobile USA/ 'nc# 19 o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
17/42
Ke# Perormance In"icator Term Deinition
uration(AS) *uration o! the call in Active Set sie o! AS (ASL1 to M"
-uation !!1 Sot/Soter an"o%er B%erhea" )Dri%e Test 2ormula*
=
== 6
AS
6
AS
ASDuration
ASDurationAS
%ando&erSo#tSo#ter
1
1
#$
#$'
Table !+1 Sot/Soter an"o%er B%erhea" KPI
Pre&$aunch $aunch Post&$aunch
4 !.: 4 !.: 4 !.;
3.1.8 )SE 'nter&adio Access Technolog- +andover ailure
'nter&adio Access Technolog- ('&AT" +ard +andover ailure rate !rom UMTS and
-
8/11/2019 Umts Network Kpi
18/42
pmoSuccessOut'rat+oSpeech(oth ;< and 2< etwor5s shall have '&AT neighbors de!ined#
The
-
8/11/2019 Umts Network Kpi
19/42
(with the latest available So!tware/ irmware and %Cuipment" shall be used !or the '&AT 6P' veri!ication#
The 2< and ;< etwor5s shall be properl- con!igured in accordance with Purchaser@s etwor5 design
including the de!inition o! the routing tables through the )ore etwor5# PU&)+AS%& shall in!orm Seller
about ma0or changes in the con!iguration o! the
-
8/11/2019 Umts Network Kpi
20/42
Table !81 CSV Call Setup time KPI
KPI Pre&$aunch $aunch Post $aunch
Voice Call Setup time)Mobile to PSTN*
=8thpercentile 4 :secon"s
=8thpercentile 4 :secon"s
=8thpercentile4 : secon"s
Voice Call Setup time)Mobile to Mobile*
=8thpercentile 4 =secon"s
=8thpercentile 4 =secon"s
=8thpercentile4 = secon"s
Seller agrees to the ?:thpercentile provided the impact o! non UT&A %Cuipment is within the industr-
t-pical value range#
,.!.!5 )S* Access ailure
Access !ailure is the product o! the &&) )onnection ailure/ AS setup !ailure and the &A>%stablishment ailure# &&) )onnection Success is counted when the &) receives a &&) Setup)omplete !rom the U%# AS Setup is considered success!ul when the signaling messages in thecall !low during call setup !low is success!ull- completed b- relevant etwor5 elements# A &A> isconsidered success!ull- established when the &A> Assignment &esponse is sent b- &) to the)#
-uation !81 CSD Access 2ailure (ate )Counter 2ormula*
144J
#$R%&
#$R%&'
&
&'
&
&1
CSD7uestAssi,nmentRA8
CSDsponseentRA8Assi,nm
SR8Attempt
SR8Success
AttemptConnectionRRC
SuccessConnectionRRC
The !ollowing !ormula includes both )onventional )S 9.9 5bps and Streaming )S :=#9.:=#9 5bpsB
144J
+
+
)*+C%,,#-.(C35?$U(*,230A((%.-NR*E3(
)*+C%,,#-.(C3@4$U(*,230A((%.-NR*E3(
)*+C%,,#%33C35?$U(*,230S//.-NR*E3(
)*+C%,,#%33C3@4$U(*,230S//.-NR*E3(
',,#C3$U()*+C%C++%/(R%6.-T(NR)/
*+C%,,#C3S//$U()C++%/(R%6.-T(NR)/
1
Seller shall develop S&> counters b- &A &elease P3# Seller and Purchaser agreed to use ??#?;GS&> success rate until S&> counters per )S and PS domain are made available at P3#
or an interim solution/ it shall be de!ined as a drop rate o! 2G over an average call length o! ?4seconds/ the probabilit- o! dropping the S&> during the direct trans!er phase is ;s.?4sJ2GL 4#4=G#'! during the deplo-ment/ !ault rates higher than 4#1G are observed/ seller shall develop counters inP=#
Table !:1 CSD Access Term Deinition
Ke# Perormance In"icator Term Deinition
#RRCConnectionSuccess The number o! success!ul &&) )onnectionSetups with )onversational and Streaming)all %stablishment )auses (both originatingand terminating"#
TMobile USA/ 'nc# 24 o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
21/42
Ke# Perormance In"icator Term Deinition
#RRCConnectionAttempt The number o! &&) )onnection &eCuestMessages received with )onversational andStreaming )all %stablishment )auses (bothoriginating and terminating"#
#RABAssignmentResponse (CS) The number o! &AAPB &A> Assignment
&esponse messages sent !rom the &) tothe MS) !or )S*#
#RABAssignmentRequest(CS) The number o! &AAPB &A> Assignment&eCuest messages sent !rom the MS) to the&) to establish a )S* call#
# SRBAttempt The number o! &&) )onnection )ompletethat will lead to an 'nitial *irect Trans!er tothe )S domain and will also lead to a )S*&A> Assignment &eCuest#
# SRBSuccess The number o! )S* &A> Assignment&eCuests
-uation !:1 CSD Access 2ailure (ate )Dri%e Test 2ormula*
=
CallsCSD
CallsCSD
7uestConnectionRRC
ConnectAlertin,CC
ateFailure RCSD Access
7
7
R%
7
1'1""
Measurement Con"ition1
'n case there are several consecutive &&) )onnection &eCuests onl- the !irst &&) connection reCuest
will be ta5en into account !or the 6P' calculation#
Table !;1 CSD Access 2ailure (ate KPI
Pre&$aunch $aunch Post&$aunch
4 ,.56 4 +.5 6 4 +.5 6
,.!.!! )S* *rop
-uation !;1 CSD Drop )Counter 2ormula*
144J
+
#$R%$R%&
#$R%&1
CSDleaselRA8AbnormaCSDleaseRA85ormal
CSDlease5ormalRA8
The !ollowing !ormula includes both )onventional )S 9.9 5bps and Streaming )S :=#9.:=#9 5bps#144J
+
+++
()*+C%,,#CS()%*-$UR*R%,%*%.-NS9(%-()*+C%,,#CS()%*-$UR*R%,%*%.-NN)-*,
C%,,#C@4$U()*+R*R%,%*%.-NS9(%-C%,,#C@4$U()*+R*R%,%*%.-NN)-*,
()*+C%,,#CS()%*-$UR*R%,%*%.-NN)-*,C%,,#C@4$U()*+R*R%,%*%.-NN)-*,1
TMobile USA/ 'nc# 21 o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
22/42
Table !s ()onversational andstreaming" abnormall- released
-uation !#
-uation !=1 CSD 9ualit# )U$*
144J#$&
#$&
CSD4plin0in,)ntionCombinA#terSelec8loc0sport+otal+rans
CSD4plin0in,)ntionCombinA#terSelec8loc0s+ransportFault
144J:,;U%R/(!,4/$%& shall be available using counters with )ell $evel granularit-#
U$ >$%& is collected and presented in the M&&, (Measurement &esults &ecording ,)*MA"!eature in OSS&)# &eporting period can be set to between 2 to 9 seconds according to standard#)ounters are presented in a P* !ormat in M&&,# 'n 2 seconds there are 144 bloc5s# &esolution!or the P* is 4#:G# ote that using ver- short sampling intervals !or >$%& measurements willresult in low accurac- !or each sample#
%Cuation 24B )S* *$ Hualit- ()ounter ormula"
TMobile USA/ 'nc# 22 o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
23/42
144J#$&
#$&
CSDnin,A#terCombi)nDownlin0port8loc0s+otal+rans
CSDinin,0A#terCombs)nDownlinsport8loc0Fault+ran
*$ >$%& is reported b- the mobile according to ;$%& measurement"
>$%& shall be available using counters with )ell $evel granularit-# 6P's at MS; shall be calculated
at Mar5et $evel#
Table +51 CSD 9ualit# Terms Deinition
Ke# Perormance In"icator Term Deinition
#FaultyTransportBlocks2nplinkA!terSelectionCombining(CS)
umber o! !ault- Uplin5 *)+ transport bloc5s !or )S*a!ter selection and combining# Sampling period shall beever- ten (14" seconds
#TotalTransportBlocks2nplinkA!terSelectionCombining(CS)
Total number o! Uplin5 *)+ transport bloc5s !or )S*a!ter selection and combining# Sampling period shall beever- ten (14" seconds #
#FaultyTransportBlocks2no$nlinkA!terCombining(CS)
umber o! !ault- *ownlin5 *)+ transport bloc5s !or)S* a!ter combining# Sampling period shall be ever-ten (14" seconds
#TotalTransportBlocks2no$nlinkA!terCombining(CS)
Total number o! *ownlin5 *)+ transport bloc5s !or)S* a!ter combining# Sampling period shall be ever-ten (14" seconds
-uation +!1 CSD 9ualit# D$ )Dri%e Test 2ormula*
=
CallsCSD
CallsCSD
plesAll82ERSam
etow82ER+Samples8el
D2CSDQualit
7
7
*)=
'1""
Measurement Con"ition1
*$ Cualit- shall be measured in all three (;" Milestones (Pre$aunch/ $aunch and Post $aunch"
Table +!1 CSD 9ualit# KPI
KPI Pre&$aunch $aunch Post $aunch
CSD 9ualit#)D$*
=8thpercentile osamples 4 !6 3$-(
=8thpercentile osamples 4!6 3$-(
=8thpercentile osamples 4 !6 3$-(
CSD 9ualit#)U$*
=8thpercentile osamples 4 !6 3$-(
=8thpercentile osamples 4 !63$-(
=8thpercentile osamples 4 !63$-(
This 6P' will be measured at 4#; G >$%& operating point set in UT&A !or )S Eideo )all#
TMobile USA/ 'nc# 2; o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
24/42
,.!.!, )S* )all Setup time
)ircuit Switched *ata call set up time indicates etwor5 response time to a user reCuest !or a videoservice# The test shall be initiated b- ma5ing a video call !rom one UMTS U% to another UMTS U%#'n case o! multiple &&) connection reCuests the !irst &&) connection reCuest will be ta5en intoaccount !or 6P' calculation#
-uation ++1 Mobile to Mobile Vi"eo call )Dri%e Test 2ormula*
Vi-eo Call setup time . CC/Alerting (0C) 1 RRC Connection Request (0C)
Table ++1 CSD Call Setup time KPI
Parameter Pre&$aunch $aunch
Vi"eo Call Setup time N.A =8thpercentile 4 = secon"s
Seller agrees to the ?:thpercentile and ? seconds provided the impact o! non UT&A %Cuipment is within
the industr- t-pical value range#
Packet Switche" $e%el&! Ke# Perormance In"icators
&?? *$ &A> allowedB ;3 5bps/123 5bps/ and 9 5bps/ onl-
&?? U$ &A> allowedB ;3 5bps/ 9 5bps onl-
+S*PA *$ +S*S)+ allowedB U% )at 12 (1344 5bps"+SUPA U$ allowedB U% )at ; (1#:4 Mbps"
,.!.!7 Pac5et Switched )all Setup
igure is a !low diagram !or a PS call# '! a problem occurs between &&) )onnection &eCuest(step 1" and the &A> Assignment &esponse (step 2="/ the result is considered Access ailure# An-&A> abnormal release a!ter the &A> Assignment &esponse is considered a call *rop#
TMobile USA/ 'nc# 2 o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
25/42
2i'ure 71 Packet Switche" Setup 2low Dia'ram
,.!.!8 PS* Access ailure
The aim is to measure Pac5et Switch *ata access !ailure !rom a user perspective#
-uation +,1 PSD Access 2ailure (ate )Counter 2ormula*
144J
#$R%&
#$R%&'
&
&'
R%&
&1
/SD7uestentRA8Assi,nm
/SDsponseentRA8Assi,nm
SR8Attempt
SR8Success
7uestConnectionRRC
CompleteConnectionRRC
The !ollowing !ormula includes Pac5et 'nteractive and Pac5et >ac5ground# Please re!er to Section 9o! the )P' document User *escription )onnection +andling .1::;+S* 141 42.: Uen#
TMobile USA/ 'nc# 2: o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
26/42
144J
ishSucceRA8Establ)nteracti&R99'9993."'
,,#P$U()*+C%C4++%/(R%6-T4(N4R)/
*+C%,,#PS//$U()C4++%/(R%6-T4(N4R)/1
R99I+(%)*/(B%RA!E(*,0S//%R*(% %6*,
+C%,,#7F,4$U()*S27*)O-
+.(P*/ during the direct trans!er phase is ;s.?4sJ2GL 4#4=G#'! during the deplo-ment !ault rates higher than 4#1G are observed/ seller shall develop counters inP=#
Measurement Con"ition1
>oth 'nteractive and >ac5ground tra!!ic are included in the counter based !ormula above#
Table +,1 PSD Access 2ailure Term Deinition
Ke# Perormance In"icator Term Deinition
#RRCConnectionComplete The number o! success!ul &&) )onnectionSetups with PS* %stablishment )auses (bothoriginating and terminating"#
#RRCConnectionRequest The number &&) )onnection &eCuestMessages received with PS* %stablishment)auses (both originating and terminating"#
#RABAssignmentResponse (%S) The number o! &AAPB &A> Assignment&esponse messages sent !rom the &) tothe S Assignment&eCuest messages sent !rom the S
-
8/11/2019 Umts Network Kpi
27/42
=
Calls/SD
Calls/SD
7uestConnectionRRC
/D/
ateFailure R/SD Access
7
7
R%
A//%.(C+(%>(A/(B*(%
1'1""
Measurement Con"ition1
Access ailure &ate shall be measured b- data session activation (PS" !ollowed b- download# 'n case o!multiple &&) connection reCuests the !irst &&) connection reCuest will be considered !or 6P' calculation#
Table +71 PSD Access 2ailure (ate KPI
Pre&$aunch $aunch Post&$aunch
4 +.5 6 4 +.5 6 4 +.5 6
3.1.16 PS* *rop
Pac5et session is considered as dropped when associated &A> has been released abnormall- b-either UT&A or )# An- drop a!ter &AAPB &A> Assignment &esponse is considered as PS dropcall#
-uation +81 PSD Drop (ate )Counter 2ormula*
144J#$&
#$&
/SDmpleteRA8SetupCo
/SDRA8Drop
144J
+(%)*/(B%%P*/ setup phase!or PS *ata/ when the &) sends &AAPB&A> Assignment &esponses to )ore etwor5a!ter a success!ul &A> establishment
#RABrop The number o! &A> *rop !or PS data calls
-uation +:1 PSD Drop (ate )Dri%e Test 2ormula*
=
#tpSession
#tpSession
uccessCallSetupS
dSuccess#tpDownloa
pRate/SDCallDro 1'1""
Measurement Con"ition1
TMobile USA/ 'nc# 2= o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
28/42
PS* drop &ate shall be measured a!ter start o! !tp download # PS* call is considered as droppedwhen !tp session is manuall-.abnormall- disconnected without completing !ile trans!er due to an-reason#
Table +:1 1 PSD Drop (ate KPI
Pre&$aunch $aunch Post&$aunch
4 +.8 6 4 +.56 4 +.5 6
,.!.!; PS* $atenc-
The !ollowing is extracted !rom ;
-
8/11/2019 Umts Network Kpi
29/42
#$U()*+C%,,)P*/
-
8/11/2019 Umts Network Kpi
30/42
Table ,+1 PSD A%era'e U$ Throu'hput KPI
KPI Pre&$aunch $aunch Post $aunch
A%era'e U$ throu'hput
)Unloa"e"* kbps
> +55 > +55 > !85 )Counter*
> +55 )Dri%e Test*
A%era'e U$ Throu'hput
)$oa"e"* kbps
> ! ! !85 )Counter*
> !$%& operating
point !or both U$ and *$# Throughput shall be calculated using data !rom the entire )luster. Mar5et
drive test !or Milestone 1 and Milestone 2 using all available &?? &adio >earer#
Table ,,1 PSD A%era'e Throu'hput Deinition
Ke# Perormance In"icator Term Deinition
serataTrans!erre-(kb) Total !tp sie download in 5ilobit in one sessionSessionuration(sec) Total time (seconds" duration to download single
!ileSession*uration(sec" L (time stamp o! Session %nd orSession %rror K time stamp o! Session Start"
%SA&gT"roug"put Pac5et Switched *ata average throughput using &?? &A>measured at application la-er
,.!.!= PS* )all Setup Time
PS* call setup time indicates etwor5 response time to a user reCuest !or a pac5et data service# 'ncase o! multiple &&) connection reCuests the !irst &&) connection reCuest will be considered !or6P' calculation#
-uation +=1 PSD Call Setup Time )Dri%e Test 2ormula*
%S Call setup time . %% Conte3t Acti&ation accept (0C) 4 RRC Connection Request (0C)
Measurement Con"ition1
The U% is alread- attached to the UT&A networ5#
Table ,71 PSD Call Setup time KPI
KPI Pre&$aunch At $aunch Post $aunch
PSD SessionActi%ation time
N.A =8thpercentilesessions 4 8
secon"s
N.A
Seller agrees to the ?:thpercentile and the : seconds provided the impact o! nonUT&A %Cuipment iswithin the industr- t-pical value range#
3.1.2! PS* 'nter&adio Access Technolog- +andover ailure
'nter&adio Access Technolog- ('&AT" is a hard handover between UMTS and
-
8/11/2019 Umts Network Kpi
31/42
d+RA5Comman'rderFrom4CellChan,e
e+RA5Failur'rderFrom4CellChan,eterFailureRa9/S%ando&e9
&
&'1""23 =
pmoOut'rat)c&eturnOld)h is increased when the )%$$ )+A
-
8/11/2019 Umts Network Kpi
32/42
Pre&$aunch $aunch Post&$aunch
N/A 4 8.5 6 4 8.5 6
3.1.21 PS* '&AT 'nterruption time
This 6P' is an indicator o! interruption time !or the pac5et switch data during 'nter&adio Access
Technolog- hard handover#
-uation ,+1 PSD I(AT Interruption time )Dri%e Test 2ormula*
%S/2RAT2nterruptionTime . (TimeRAp-ateComplete/5 1 TimeCellC"ange0r-er/RNC)
-uation ,,1 PSD I(AT User Data Interruption time )Dri%e Test 2ormula*
%S/2RATserata2nterruptionTime . (TimeFirst%acketataRecei&e-2n+* 1
Time'ast%acketataRecei&e-2n*)
Measurement Con"ition1
This 6P' is applicable !or dedicated drive test route on ;
-
8/11/2019 Umts Network Kpi
33/42
KPI Term At $aunch
PSD I(AT User DataInterruption time
Measure an" (eport
Seller agrees to the ?:thpercentile and the 12 seconds provided the impact o! non UT&A %Cuipment is
within the industr- t-pical value range#
,.!.++ +S*PA Access ailure
This test shall be done with a single U% doing +S*PA call in the )ell under test with ;3.9 6bpsassociated *)+ on the uplin5#
-uation ,71 SDPA Access 2ailure (ate )Counter 2ormula*
144J
#$R%&
#$&'
&
&'
R%&
&1
DSC%%S7uestentRA8Assi,nm
DSC%%SSuccessentRA8Assi,nm
SR8Attempt
SR8Success
7uestConnectionRRC
CompleteConnectionRRC
144J
,,#$U()*+C%+(%)*/(2B%-(P*/ success rate until S&> counters per )S and PS domain are made available at P3#
As an interim solution/ it shall be de!ined as a drop rate o! 2G over an average call length o! ?4seconds/ the probabilit- o! dropping the S&> during the direct trans!er phase is ;s.?4sJ2GL 4#4=G#'! during the deplo-ment/ !ault rates higher than 4#1G are observed/ seller shall develop counters inP=#
Table 751 SDPA Access 2ailure Term Deinition
Ke# Perormance In"icator Term Deinition
#RRCConnectionComplete The number o! success!ul &&) )onnectionSetups with Pac5et %stablishment )auses(both originating and terminating"#
#RRCConnectionRequest The number &&) )onnection &eCuestMessages received with Pac5et%stablishment )auses (both originating andterminating"#
#RABAssignmentResponse (,S4SC,)
The number o! &AAPB &A> Assignment&esponse messages sent !rom the &) tothe S
-
8/11/2019 Umts Network Kpi
34/42
Ke# Perormance In"icator Term Deinition
#RABAssignmentRequest(,S4SC,) The number o! &AAPB &A> Assignment&eCuest messages sent !rom the S#
-uation ,:1 SDPA Drop (ate )Counter 2ormula*
144J *(4+S//%DSC7A,,4/-S&
,)%%D%T4F*DSC7R%,%*-S&
144J
++
+
#
%I+(%)*/(B/%P*/
-
8/11/2019 Umts Network Kpi
35/42
pmoS-stem&ab&eleasePac5et is onl- increased due to a &AAP'u &elease )ommand or &A>Assignment &eCuest message with release cause L an-thing except ormal &elease/Success!ul &elocation/ &esource Optimisation &elocation/ User 'nactivit- or releaseduetoU%generated signallingconnectionrelease# This counter is incremented !or the best cell in the ActiveSet in the S&) and when releasing a +S &A>/ this counter is stepped !or the Serving +S*)+cell#
pmNoRa!#sta!lis$S%ccessPacketInteractive"sB The number o! success!ul &A> establishments
!or PS 'nteractive &A> mapped on +S*S)+# The counter is stepped !or the selected Serving +S*S)+ cell at &A> establishment a!ter the success!ull- transition S&>*)+ to PS 'nteractive 9.+S +S*S)+#
pmDl&ps'itc$S%ccess"s( umber o! success!ul *$ upswitches to an- +S state# The counter isstepped !or success!ul *$ upswitch to a &> combination containing +S# The counter is incrementedin all cells o! the active set#
pmNoRa!#sta!lis$S%ccessPacketInteractive#%l( The number o! success!ul &A>establishments !or PS 'nteractive &A> mapped on %*)+.+S*PA# )ounter is stepped !or theServing %*)+ cell at success!ul &A>.&> combination transition to PS 'nteractive %*)+.+S +S*S)+ due to &A> establishment# The counter is triggered a!ter sending o! &A> Assignment
&esponse (success!ul"#
pm&l&ps'itc$S%ccess#%l(umber o! success!ul upswitches/ triggered b- U$ user activit-/ to a target
&> combination %*)+.+S*PA# Stepped !or the target cell# )ounter in target cell is stepped at a
success!ul upswitch triggered b- U$ user activit-#
Measurement Con"ition1
The Seller counter based metrics !ormula shall be updated as new !unctionalit- is introduced in the
S-stem
Table 7+1 SDPA Drop Term Deinition
Ke# Perormance In"icator Term Deinition
,S4SC,/ReleaseueToFailure umber o! +S*S)+ allocation releases due to radiolin5 and other !ailures
,S4SC,/AllocationSuccess umber o! allocations when the &) has received&&)B &adio >earer &e)on!iguration )ompletemessage !rom the U% a!ter success!ul +S*S)+ MA)d !low setup
-uation ,:1 SDPA Drop (ate )Dri%e Test 2ormula*
=
Call%SD/A
Call%SD/A
SuccessAllocationDSC%%SDropRate%SD/A
7
7
7
DSC7D)4.-S
'1""7
Measurement Con"ition1
+S*PA *rop &ate shall be measured b- data session activation (+S*PA" !ollowed b- !tp download
Table 7,1 SDPA Drop (ate KPI
Pre&$aunch $aunch Post&$aunch
4 ,.5 6 4 +.5 6 4 +.5 6
TMobile USA/ 'nc# ;: o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
36/42
,.!.+7 +S*PA $atenc-
Table 771 SDPA $atenc# Term Deinition
Ke# Perormance In"icator Term Deinition
,S%A 'atency&ound trip time !or a ;2 >-tes ping !or +S*PA&T &A>
Measurement Con"ition1
$atenc- shall be measured with the destination server !or ping connected directl- to the
-
8/11/2019 Umts Network Kpi
37/42
=
Call%SD/A
Call%SD/A
ationSessionDur
0bans#erred4serData+r
+hrou,hput%SD/A
7
7
$%/#
#$
7
Measurement Con"ition1
Measurement shall be !or Application $a-er bit rate# The +S*PA throughput is onl- applicable when
the U% is on +S*S)+#
Table 7;1 Stationar# Maimum D$ SDPA 3it (ate )kbps* KPI
Pre&$aunch $aunch Post&$aunch ! !,55 > !,55 > !,55
)at ($C $a#erusin' counter*
Un"er no loa" con"ition
> !!55 > !!55 N.A 856 o A%ailable Power at
S#stem (eerence Pointallocate" to SDPA
Measurement Con"ition1
U% shall be in Stationar- location under excellent & condition ()P')+ &S)P I 34 d>m and
)P')+ %c.o I 3 d>"#
The download !ile shall be compressed t-pe#
Measurement shall be based on TP !ile download o! minimum ten (14" M> !ile to reduce the
impact o! T)P slow start#
Measurement shall be at application la-er throughout the +S*PA Service Area#
Table 7 ;55 > ;55 > ;55
)at o peak*
Un"er no loa" con"ition
> :55 > :55 N.A 856 o A%ailable Power atS#stem (eerence Pointallocate" to SDPA
Measurement Con"ition1
U% shall be in mobile environment within designed +S*PA Service Area# The supported *$ +S
*S)+ during drive test is 1344 5bps !or U% )ategor- 12# The )ell shall be loaded in such a wa-
that +S*PA is allocated !i!t-percent (:4G" o! the available power at S-stem &e!erence Point# The
remaining :4 G o! available *$ power at S-stem &e!erence Point shall include common channels
power/ load due to one drive test U% (Eoice" and the load simulated b- O)S speech mode# There
shall be one U% ma5ing short Eoice )all (AM& 12#25" in the same cell as +S*PA call to monitor the
impact o! +S*PA on the voice user# Seller shall provide measurement report on short voice call !or
Setup ailure and )all *rop &ate as de!ined in Section ;#1#;and Section;#1#respectivel-# The
average *$ throughput measured during the entire drive test route within )luster.Mar5et Area shall
TMobile USA/ 'nc# ;= o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
38/42
be based on +S*S)+ Application $a-er throughput# Measurement shall be based on drive test
with TP !ile download o! minimum ten (14" M> !ile to reduce the impact o! T)P slow start#
+S*PA Service Area shall be same as PS* 95 Service Area#
3.1.26 +SUPA Throughput
Total number o! &$) bloc5s sent over the observation window excluding retransmission#
-uation ,=1 SUPA Throu'hput )Counter 2ormula*
=
Session%S4/A
Session%S4/A
Duration/D4R2CA6
0bData/D4R2CA6
+hrou,hput%S4/A
7
7
777
#$777
7
#1"'1"$ lmsFramesEupm5oActi&e
l8itsCellEupmSumAc0edhrou,hput%S4/ACell+ =
pmSumAc5ed>its)ell%ulB The number o! Media Access )ontrol %nhanced Uplin5 (%ul" bits
received and ac5nowledged b- the &>S#pmoActive14msrames%ulB The number o! 14ms !rames containing enhanced uplin5 datatransmitted b- the U%
Table 7=1 SUPA Throu'hput Term Deinition
Ke# Perormance In"icatorTerm
Deinition
A/R'C/%/ata(kb) Total AM &$) P*Us (5ilobit" trans!erred excluding retransmission in the uplin5
A/R'C/%/uration The total &$) P*U transmission duration (in seconds"#
-uation 751 SUPA Throu'hput )Dri%e Test 2ormula*
=
Session%S4/A
Session%S4/A
ationSessionDur
0bans#erred4serData+r
+hrou,hput%S4/A
7
7
$%/#
#$
7
Measurement Con"ition1
Measurement shall be at Application $a-er bit rate# The upload !ile shall be compressed t-pe#
+SUPA Service Area shall be same as PS* 95 Service Area#
U% shall be in Stationar- location under excellent & condition ()P')+ &S)P I 34 d>m and)P')+ %c.o I 3 d>"
Table 851 SUPA Stationar# U$ 3it (ate )kbps* KPI
Pre&$aunch $aunch Post&$aunch U- Cate'or# , )!.78 Mbps*
> !!55 > !!55 Measure an"(eport
Stationar# Peak Throu'hput)kbps* un"er no loa"
> 855 > 855 Measure an"(eport
A%era'e Throu'hput )kbps*un"er no loa"
TMobile USA/ 'nc# ;3 o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
39/42
3.1.2 +S*PA *ata Session Setup Time
+S*PA *ata Session setup time indicates etwor5 response time to a user reCuest !or an +S*PAdata service#
-uation 7!1 SDPA session "einition )Dri%e Test 2ormula*
,S%A ata Session setup time . %% Conte3t Acti&ation accept (0C) 4 RRC ConnectionRequest (0C)
Measurement Con"ition1
This test shall be done with a single U% per!orming +S*PA call in the cell under test# The U% isalread- attached to the UT&A etwor5#
Table 8!1 SDPA Data Session Setup time KPI
KPI Pre&$aunch $aunch
SDPA Session Acti%ation time N.A =8thpercentile sessions 48 secon"s
Seller agrees to the ?:thpercentile and the : seconds provided the impact o! non UT&A %Cuipment is
within the industr- t-pical value range#
S#stem A%ailabilit#
S-stem Availabilit- is de!ined as the percentage o! time the etwor5 can handle one hundred percent(144G" o! the tra!!ic demand within the limits it is designed !or as measured at )ell $evel#
The purpose o! this metric is to calculate the total amount o! time (in percentage" out o! the totaloperating time the &) and ode> are available to carr- commercial tra!!ic# Minimum granularit- !or6P' purposes is total loss o! tra!!ic at )ell level#
Seller is responsible onl- !or the SubS-stem supplied to PurchaserB &) and ode># This excludesAntenna S-stems/ Transport S-stems/ Power.>atter- >ac5up/ nonSeller )ore etwor5 and externalevents outside the control o! Seller (e#g# weather conditions"#
The loss o! tra!!ic at )ell $evel can be due to one or more reasonsB
1# %Cuipment !ailures2# So!tware !ailures
;# Seller originated (accidental/ misuse/ reset etc#"
# Planned events authoried b- Seller (So!tware upgrade/ %Cuipment upgrade/ Parameter changeetc"
The purpose o! the below 6P' is to measure Seller@s > contribution to )ell availabilit-#
or Average )ell Availabilit-/ Seller shall be responsible !or service degradation due to 1/ 2/ ; (causedb- Seller@s personnel or subcontractors o! Seller" and #
or Average )ell onMaintenance Availabilit-/ Seller shall be responsible !or service degradation dueto 1/ 2 and ; (caused b- Seller@s personnel or subcontractors o! Seller"#
The level o! aggregation !or this metric is Purchaser@s entire UMTS etwor5 !or which Seller hassupplied the %Cuipment and So!tware (&) and ode>"# The alarm aggregation !or this metrics shallbe per!ormed on dail- basis# S-stem Availabilit- 6P' !or Seller shall be calculated on a -earl- averagedbasis !or the purpose o! achieving 6P' target starting !rom the etwor5 commercial $aunch !or &) andode> %Cuipment# Seller and Purchaser shall mutuall- agree on all the necessar- alarm details toassist Purchaser in realiing S-stem Availabilit- 6P' matrices !or the subS-stems supplied b- Seller(&) and ode>"# Seller shall recommend to Purchaser which alarms to use to measure these 6P's#
Purchaser and Seller shall mutuall- agree on a report# Such report shall be provided b- Purchaser toSeller and clearl- demonstrates Seller@s contribution to the metric#Purchaser shall monitor the 6P's ona regular basis and provide such report to Seller on a monthl- basis# 'n the event that Purchaser
TMobile USA/ 'nc# ;? o! 2Strictl- )on!idential and Proprietar-
UMTS etwor5 6P'/ Appendix U12 24#43#241
-
8/11/2019 Umts Network Kpi
40/42
determines that the 6P' is not met in an- particular month/ Seller can wor5 with the Purchaser to auditthe data#
Seller shall commit to the availabilit- level (in brac5ets" provided that/ !or 6P' calculation purposes/ thetime considered !or 6P' calculation to !ix an event triggering alarm is limited to 124min !or +, relatedevents and ;4min !or S, related events#
*ail- S-stem Availabilit- shall be measured as !ollowsB
3.1.28 Average )ell Availabilit-
-uation ,;1 A%era'e Cell A%ailabilit# ormula
Using Alarms and S-stems noti!ication/ the !ollowing !ormula shall appl-
R5C
R5C
rCount+otalSecto6in%rs
owntime+otalCellD
'$%/#@"'#$@"'#$24
$%/#
1'1""
Table 8+1 A%era'e Cell A%ailabilit# Term Deinition
Ke# Perormance In"icator Term Deinition
TotalCellDo'ntime)sec* Total duration (in seconds" o! ode> )ells within&) unable to carr- tra!!ic due to planned or nonplanned events due to &) or ode># The durationshall be calculated when Alarm.S-stem noti!icationclears minus when Alarm.S-stem noti!ication triggers#
TotalSectorCo%nt Total number o! active ode> )ells within &)
AvgCellAvaila!ilit Average ode> )ells availabilit- to carr- user tra!!iccalculated as a percentage o! total time
Table 8,1 A%era'e Cell A%ailabilit# KPI
A%era'e Cell A%ailabilit# KPI Sub&S#stem (AN (elease
> ==.; 6 (NC E No"e&3 P8
> ==.< 6 (NC E No"e&3 P:
> ==.= 6 (NCE No"e&3 P;
> F==.=6 (NCE No"e&3 >Ps is limited to three per -ear#
3.1.29 Average )ell onMaintenance Availabilit-
-uation ,
-
8/11/2019 Umts Network Kpi
41/42
Table 871 A%era'e Cell Non&Maintenance A%ailabilit# Term Deinition
Ke# Perormance In"icator Term Deinition
TotalCellNon+aintenanceDo'ntime)sec* Total duration (in seconds" o! ode> )ells withina &) not able to carr- an- tra!!ic during normaloperation (excluding planned events" due to &)and ode> %Cuipment reason# The duration shall
be calculated when Alarm.S-stem noti!icationclears minus when Alarm.S-stem noti!icationtriggers#
TotalSectorCo%nt Total number o! active ode> )ells within &)
AvgCellNon+aintenanceAvaila!ilit Average ode> )ells available calculated as apercentage o! available time at )ell level
Table 881 A%era'e Cell Non&Maintenance A%ailabilit# KPI
A%era'e Cell Non&Maintenance A%ailabilit# KPI Sub&S#stem (AN (elease
> ==.< 6 (NC E No"e&3 P8
> ==.= 6 (NC E No"e&3 P:
> ==.=8 6 (NCE No"e&3 P;
> ==.=; 6 (NCE No"e&3 >P