independent drive test report idt report_september 16_final.pdfindependent drive test report -...

18
Independent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of the operators have met the Call Dropped Rate (CDR) benchmark of <=2% and also most of the operators have met the Call Setup Success Rate (CSSR) benchmark of >=95% in compare to previous drive test (Dec’15). Methodology: Independent Drive test was conducted in Kolkata from 9:00 AM to 9:PM from 9 th to 10 th of September 2016. The total drive test covered in Kolkata area was approximately 200 km over a period of 2 days. A total of ~5611 calls were made for seven 2G networks, six 3G networks and 2 CDMA networks covering eight operators. 1 2 3 4 City-Level Performance Area-Level Performance Analysis Summary and Highlights Date: 03 November 2016 5 Appendix I. Benchmarking KPIs II. Coverage III. Receive (Rx) Quality IV. City-Level Ranking V. City-Level KPI The independent drive test has been carried out by M/s IMRB International on behalf of TRAI Introduction

Upload: others

Post on 16-Mar-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Independent Drive Test Report IDT Report_September 16_Final.pdfIndependent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of

Independent Drive Test Report

- September’16

Kolkata

Key performance indicators for most of the operators: Most of the operators have met the Call

Dropped Rate (CDR) benchmark of <=2% and also most of the operators have met the Call Setup

Success Rate (CSSR) benchmark of >=95% in compare to previous drive test (Dec’15).

Methodology:

Independent Drive test was conducted in Kolkata from 9:00 AM to 9:PM from 9th to 10th of September 2016. The total drive test covered in

Kolkata area was approximately 200 km over a period of 2 days. A total of ~5611 calls were made for seven 2G networks, six 3G networks and 2

CDMA networks covering eight operators.

1 2 3 4

City-Level

Performance

Area-Level

Performance Analysis Summary

and

Highlights

Date: 03 November 2016

5

Appendix I. Benchmarking KPIs

II. Coverage

III. Receive (Rx) Quality

IV. City-Level Ranking

V. City-Level KPI

The independent drive test has been carried out by M/s IMRB International on behalf of TRAI

Introduction

Page 2: Independent Drive Test Report IDT Report_September 16_Final.pdfIndependent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of

Introduction

Ancillary Details

Overview

TRAI is regularly monitoring the performance of Telecom Service Providers (TSP) against the benchmarks for the various Quality of

Service (QoS) parameters laid down by the Authority. TSPs submit Performance Monitoring Reports to TRAI every quarter. TRAI also

undertakes audit and assessment of Quality of Service through independent agencies to verify the Quality of Service claimed. The Audit

agencies conduct sample ‘Drive tests’ across various cities all over the country as part of audit and assessment of the TSPs’

performance.

In view of complaints on call drops and other network issues, on behalf of TRAI, an Independent Drive Test (IDT) was conducted from 9th

September 2016 to 10th September 2016 covering various locations in Kolkata . The performance of Aircel, Airtel, BSNL, Idea,

Vodafone, Reliance, Tata, MTS was monitored across various technologies (2G, 3G and CDMA). The drive test route was defined on the

basis of several factors that include - areas from where call drop complaints are commonly received; areas of heavy usage; residential

areas away from arterial roads; office areas; areas where previous Drive tests showed network issues; etc.

For the purpose of these tests, 2G + 3G Mode (Auto) was used. The test results obtained from these drive tests were conducted to

assess the network condition more specifically in terms of Radio Frequency (RF) Coverage; Rx Quality; Call Setup Success Rate; Call

Drop Rate; Blocked Calls and Carrier to Interference ratio.

Drive Route Details For Goa Area:

Independent Drive test was conducted in Mumbai to Goa area from 9:00 AM to 9:PM from 9th to 10th of September 2016. The total

drive test covered in Kolkata area was approximately 300 km over a period of 2 days. Total of ~5611 calls were made for seven 2G

networks, six 3G networks & two CDMA networks covering seven operators.

Roads and Areas covered in Kolkata is shown in the below map.

Below is the List of Areas Covered and Drive Routes

1

Day 1 Day 2

Harinavi South Dum Dum

Narendrapur Gangulipara

Rajpur sonarpur Noonegola Basti

Naktala Nainan Para

Sangato colony Palpara Noapara

Gandhi Colony Santi Nagar

Ashwini Nagar Government quarters

Shanti Nagar Belghoria

Regent estate ss roy Colony

Ganguly Bagan Kamarhati

Santhospur Panihati

Jadavpur University Subhas nagar

Poddar nagar Kulinpara

Safui Pura Deshpriya nagar

North Purbachal Badai

Ekdalia New barrakpur

Lake Market Chandpur

Natinal Library North Dum Dum

Victoria Memorial Netaji Subhas Chandra Bose Airport

Shibur Parjhat

Howarh bridge New town

Eden Garden Kadampukar

Phool Bagan

Bidhan Nagar

Drive test route

Page 3: Independent Drive Test Report IDT Report_September 16_Final.pdfIndependent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of

1. City-Level Performance

City-Level Details Operator Performance against Key Performance Indicators :

1. Call Setup Success Rate, 2. Blocked Call Rate, 3. Call Drop Rate, 4. Rx Quality

Legends

Threshold for each KPI are considered as per TRAI guidelines Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

Most of the operators have met the

Call Setup Success Rate benchmark

of >=95%, except Reliance 3G and

Tata 2G. Refer. Fig 1

Most of the operators have met the

Blocked Call Rate benchmark of

<=3%, except Reliance 3G and Tata

2G. Refer. Fig 2

Most of the operators met the Call

Drop Rate benchmark of <=2%,

except Aircel 2G, Airtel 3G, BSNL

3G, Reliance 3G and Tata 2G.

Refer. Fig 3

Most of the operators met the Rx

Quality Rate benchmark of >=95%,

except Aircel 2G, BSNL 2G and

TATA 2G.

Refer. Fig 4

Operator meeting the benchmark Operator not meeting the benchmark

2

Current Drive: September 2016

97.39% 98.09% 97.73% 99.14% 98.31% 98.16% 99.27% 97.23% 100.00% 97.29%

89.47% 86.87%

100.00% 98.55% 98.64%

Air

cel 2

G

Air

cel 3

G

Air

tel 2

G

Air

tel 3

G

Bsn

l 2G

Bsn

l 3G

Idea

2G

Idea

3G

MTS

CD

MA

Re

lian

ce 2

G

Re

lian

ce 3

G

TATA

2G

TATA

CD

MA

Vo

da

fon

e 2

G

Vo

da

fon

e 3

G

Fig 1. Call Setup Success Rate (%)

95%

2.61% 1.91% 2.27% 0.86% 1.69% 1.84% 0.73% 2.77%

0.00% 2.71%

10.53% 13.13%

0.00% 1.45% 1.36%

Air

cel 2

G

Air

cel 3

G

Air

tel 2

G

Air

tel 3

G

Bsn

l 2G

Bsn

l 3G

Idea

2G

Idea

3G

MTS

CD

MA

Re

lian

ce 2

G

Re

lian

ce 3

G

TATA

2G

TATA

CD

MA

Vo

da

fon

e 2

G

Vo

da

fon

e 3

G

Fig 2. Block Call Rate (%)

3%

2% 4.15%

1.67% 1.81% 2.32% 1.43%

8.13%

0.98% 1.99% 1.21% 1.67%

7.72%

12.86%

1.00% 0.25% 0.83%

Air

cel 2

G

Air

cel 3

G

Air

tel 2

G

Air

tel 3

G

Bsn

l 2G

Bsn

l 3G

Idea

2G

Idea

3G

MTS

CD

MA

Rel

ian

ce 2

G

Re

lian

ce 3

G

TATA

2G

TATA

CD

MA

Vo

da

fon

e 2

G

Vo

da

fon

e 3

G

Fig 9. Call Drop Rate (%)

93.89%

98.56% 95.47%

97.29% 93.93%

98.05% 96.25%

99.52% 98.50% 96.97% 97.93%

90.93%

98.79% 97.49% 96.67%

Air

cel 2

G

Air

cel 3

G

Air

tel 2

G

Air

tel 3

G

Bsn

l 2G

Bsn

l 3G

Idea

2G

Idea

3G

MTS

CD

MA

Re

lian

ce 2

G

Re

lian

ce 3

G

TATA

2G

TATA

CD

MA

Vo

da

fon

e 2

G

Vo

da

fon

e 3

G

Fig 4. Rx Quality (%)

95%

Page 4: Independent Drive Test Report IDT Report_September 16_Final.pdfIndependent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of

1. City-Level Performance Comparison from Previous Comparison against previous drive test (May’16) – Most of the operators have shown

improvement in CSSR, CDR and Rx Quality.

Legends Current Drive: September 2016

Previous Drive: December 2015

Improvement from previous drive Degradation from previous drive

Most of the operators have shown

improvement in Call Setup Success

Rate performance, except Airtel 2G,

RCOM 3G and Tata 2G.

Refer Fig 5

Aircel 2G, Airtel 3G, Reliance 3G, Tata

2G and Tata CDMA have shown

degradation in performance compared

to previous drive. Refer Fig 6

All operators have shown improvement

in their performance in compare to the

previous drive test. Refer. Fig 7

Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good Rx Quality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

3

0.38% 1.59%

-0.95%

4.03% 2.79% 3.09%

1.58% 0.20%

-6.44%

-9.36%

0.18%

2.98% 2.17%

Air

cel 2

G

Air

cel 3

G

Air

tel 2

G

Air

tel 3

G

BS

NL

2G

BS

NL

3G

IDE

A 2

G

MTS

CD

MA

Re

lian

ce 3

G

Tata

2G

Tata

CD

MA

VO

DA

2G

VO

DA

3G

Fig 5. CSSR difference from previous drive (%)

-1.5%

1.5% 2.0%

-0.3% 2.4% 0.7%

3.5%

0.2%

-5.3% -6.2%

-0.8%

8.3%

1.8%

Air

cel 2

G

Air

cel 3

G

Air

tel 2

G

Air

tel 3

G

BS

NL

2G

BS

NL

3G

IDE

A 2

G

MTS

CD

MA

Re

lian

ce 3

G

Tata

2G

Tata

CD

MA

VO

DA

2G

VO

DA

3G

Fig 6. CDR difference from previous drive (%)

9.3%

36.7%

8.1%

19.0%

10.3%

36.1%

10.4%

1.1%

23.5%

3.0% 1.5%

12.3%

21.0%

Air

cel 2

G

Air

cel 3

G

Air

tel 2

G

Air

tel 3

G

BS

NL

2G

BS

NL

3G

IDE

A 2

G

MTS

CD

MA

RC

OM

3G

Tata

2G

Tata

CD

MA

VO

DA

2G

VO

DA

3G

Fig 7. Rx Quality difference from previous drive (%)

Page 5: Independent Drive Test Report IDT Report_September 16_Final.pdfIndependent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of

2. Area-Level Performance

Area-Level Details

Legends

Drive test route covered in Kolkata city

Fig 8. Area Level map)

Areas meeting the benchmark Areas not meeting the benchmark

Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

4

Threshold for each KPI are considered as per TRAI guidelines

Current Drive: September 2016

Page 6: Independent Drive Test Report IDT Report_September 16_Final.pdfIndependent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of

2. Area-Level Performance

Area-Level Details

Legends

Area Level KPI performance ( all operators inclusive)

Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

5

Areas meeting the benchmark Areas not meeting the benchmark

Threshold for each KPI are considered as per TRAI guidelines Current Drive: September 2016

Blocked Call Rate Aircel Airtel BSNL Idea MTS RCOM TATA Vodafone

North Dum Dum 1.3% 0.0% 8.3% 1.4% 0.0% 2.1% 1.3% 0.0%

South Dm Dum 2.7% 0.0% 4.3% 0.0% 0.0% 8.0% 3.4% 0.9%

Rajarhat 3.9% 3.1% 0.0% 2.9% 0.0% 6.0% 4.7% 1.9%

Bidhan Nagar 0.0% 3.4% 0.0% 5.0% 0.0% 0.0% 25.0% 4.9%

Kolkata Central 3.1% 1.6% 1.3% 1.4% 0.0% 4.8% 5.5% 1.8%

Rajpur Sonarpur 0.7% 1.6% 0.8% 1.5% 0.0% 14.4% 8.9% 0.0%

Call Dropped Rate Aircel Airtel BSNL Idea MTS RCOM TATA Vodafone

North Dum Dum 5.4% 0.0% 4.5% 0.0% 2.5% 0.0% 2.6% 0.0%

South Dum Dum 1.9% 0.0% 6.1% 1.8% 1.7% 3.8% 4.4% 0.9%

Rajarhat 8.1% 4.3% 13.4% 2.0% 2.6% 10.1% 2.9% 0.0%

Bidhan Nagar 3.3% 3.5% 4.9% 3.5% 0.0% 3.5% 21.2% 1.7%

Kolkata Central 2.1% 2.9% 2.0% 1.4% 0.6% 3.9% 6.5% 0.7%

Rajpur Sonarpur 0.7% 0.0% 4.3% 0.8% 1.6% 3.4% 8.7% 0.0%

Rx Quality Aircel Airtel BSNL Idea MTS RCOM TATA Vodafone

North Dum Dum 93.5% 97.2% 93.0% 98.4% 93.1% 98.6% 92.8% 96.9%

South Dum Dum 95.4% 97.9% 91.1% 99.2% 97.2% 99.2% 93.9% 98.0%

Rajarhat 92.6% 96.5% 87.5% 97.8% 92.4% 96.6% 90.7% 96.8%

Bidhan Nagar 94.9% 92.3% 92.7% 96.7% 98.3% 98.4% 91.6% 96.2%

Kolkata Central 95.2% 96.0% 95.0% 96.2% 95.9% 96.0% 93.6% 96.8%

Rajpur Sonarpur 98.1% 96.2% 97.6% 98.3% 95.5% 98.9% 90.3% 97.7%

Call Setup Success Rate Aircel Airtel BSNL Idea MTS RCOM TATA Vodafone

North Dum Dum 98.7% 100.0% 91.7% 98.6% 100.0% 97.9% 98.7% 100.0%

South Dum Dum 97.3% 100.0% 95.7% 100.0% 100.0% 92.0% 96.6% 99.1%

Rajarhat 96.1% 96.9% 100.0% 97.1% 100.0% 94.0% 95.3% 98.1%

Bidhan Nagar 100.0% 96.6% 100.0% 95.0% 100.0% 100.0% 75.0% 95.1%

Kolkata Central 96.9% 98.4% 98.7% 98.6% 100.0% 95.2% 94.5% 98.2%

Rajpur Sonarpur 99.3% 98.4% 99.2% 98.5% 100.0% 85.6% 91.1% 100.0%

Page 7: Independent Drive Test Report IDT Report_September 16_Final.pdfIndependent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of

Detailed Analysis of Operators

High RLT

• Radio Link Timeout (RLT indicates how long the

call can sustain during poor quality – Higher the

value the longer it will sustain the call).

3. Analysis

Legends Current Drive: September 2016

Operator meeting the set CDR threshold Operator not meeting the set CDR threshold

Abbreviation / Definition: CSSR (benchmark >=95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

Threshold for each KPI are considered as per TRAI guidelines

Operators

No. of Cells

with RLT <=

40

No. of Cells

with RLT > 40

Current

CDR

CDR, If all

Cells assume

RLT <= 40

Aircel 100.00% 0.00% 4.15% 4.15%

Airtel 100.00% 0.00% 1.81% 1.81%

BSNL 100.00% 0.00% 1.43% 1.43%

Idea 100.00% 0.00% 0.98% 0.98%

Reliance 98.20% 1.80% 1.67% 1.67%

TATA 94.10% 5.90% 12.86% 12.86%

Vodafone 100.00% 0.00% 0.25% 0.25%

6

Page 8: Independent Drive Test Report IDT Report_September 16_Final.pdfIndependent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of

3. Analysis

Detailed Analysis of Operators

Aircel 2G (CDR : 4.15%, Rx Quality : 93.89%, )

• Poor quality of network is clear indication of high call Dropped rate. Call

drops happen in all over areas

BSNL 3G (CDR : 8.13%, HOSR : 89.36%, Coverage : 37.38%)

• Poor coverage and poor HOSR is clear indication of high call drop in network.

• Rajarhat & Rajpur Sonarpur are the key contribution are of drop calls. These

areas have 57.69% dropped call of total dropped call in all areas.

Legends Current Drive: September 2016

Operator meeting the set CDR threshold Operator not meeting the set CDR threshold

Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

7

Parameter

Highlighted areas

( Rajarhat & Rajpur

Sonarpur)

Rest of

Kolkata

# call drops 15 11

Threshold for each KPI are considered as per TRAI guidelines

Parameter Whole Kolkata

# call drops 17

RCOM 3G (CDR : 7.72%, BCR : 10.53% Coverage : 60.02%)

• RCOM 3G has call dropped all across the network which is clear

indication of poor network coverage. Kolkata central is the key area where

most of the calls are dropped (42.86%).

• RCOM 3G performance have been decreases in compare to previous drive

test for CDR, CSSR and BCR.

Parameter Whole Kolkata

# call drops 21

Page 9: Independent Drive Test Report IDT Report_September 16_Final.pdfIndependent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of

3. Analysis

Detailed Analysis of Operators

TATA 2G (CDR : 12.86%, BCR : 13.13%, Coverage : 55.30%, Quality : 90.93%)

• Bidhan Nagar, Kolkata Central and Rajpur Sonarpur are the key

contributed areas of dropped calls. Dropped Calls in these area is

82.50% of total dropped calls in all areas

• Poor Coverage & poor Quality of network is clear indication of high call

drop rate.

• Tata 2G performance have been decreases in compare to previous drive

test for CDR, CSSR and BCR.

Legends Current Drive: September 2016

Operator meeting the set CDR threshold Operator not meeting the set CDR threshold

Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

8

Threshold for each KPI are considered as per TRAI guidelines

Parameter

Highlighted areas (

Kolkata Central , Bidhan

Nagar, Rajpur Sonarpur)

Rest of

Kolkata

# call drops 33 7

Page 10: Independent Drive Test Report IDT Report_September 16_Final.pdfIndependent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of

4. Summary & Highlights

Summary & Highlights

Most of the operators met the Call Drop Rate benchmark of <=2%, except Aircel 2G, Airtel 3G, BSNL

3G, Reliance 3G and TATA 2G.

Key Highlights

• Most of the operators have shown improvement in CDR from pervious drive, except Aircel 2G, Airtel 3G, Reliance 3G

and Tata 2G.

• Most of the operators meet the call drop rate benchmark of <=2%, except Aircel 2G, Airtel 3G, BSNL 3G, Reliance 3G

and TATA 2G.

• BSNL 3G, Reliance 3G and TATA 2G have call drop rate of >7%. The high drop rate is clear indication for urgent need

of improvement in order to deliver reasonable levels of services.

Fig 9. Call Drop Comparison

9

4.2 1.7 1.8 2.3 1.4

8.1 1.0 1.2

7.7

12.9

1.0 0.3

0.8

Air

cel 2

G

Air

cel 3

G

Air

tel 2

G

Air

tel 3

G

BSN

L 2

G

BSN

L 3

G

IDEA

2G

MTS

CD

MA

Rel

ian

ce 3

G

Tata

2G

Tata

CD

MA

VO

DA

2G

VO

DA

3G

Page 11: Independent Drive Test Report IDT Report_September 16_Final.pdfIndependent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of

5. Appendix

Ancillary Details

I. Benchmarking KPI Details

II. Coverage Details

III. Receive (Rx) Quality Details

IV. City-Level Ranking and KPI details

V. City-Level KPI details

Table of Contents in Appendix

10

Page 12: Independent Drive Test Report IDT Report_September 16_Final.pdfIndependent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of

Appendix

Ancillary Details

2. Benchmarking KPI Details

RF Coverage

RF Coverage relates to the geographical footprint within the system that has sufficient RF signal strength to provide for a call/data

session. Coverage rate of an operator is calculated basis of % of samples in which the Rx level is better than -85 dBm

Accessibility

Accessibility is the ability of a service to be obtained within specific tolerances and other given conditions, when requested by the user.

In other words, the ability of a user to obtain the requested service from the system. Accessibility is monitored by measuring Call Setup

Success Rate (CSSR) which is defined as the ratio of Established Calls to Call Attempts

Retainability

Retainability is “The ability of a service, once obtained, to continue to be provided under given conditions for a requested duration.” For

determining the Retainability the regulation prescribes three important parameters namely Call Drop Rate (CDR), Worst affected Cells

having more than 3% TCH drop and Connection with good voice quality. Drop Call and Connection with good voice quality were

monitored by the drive test

Mobility

In a cellular system a base station has only a limited coverage area. Hence it is possible for a moving subscriber to be out of range of a

base station while making a call. The process by which a mobile telephone call is transferred from one base station to another as the

subscriber passes the boundary of a cell is called a handover. The Handover success rate (HOSR) more than 95% is considered to be

good

Rx Quality

For measuring voice quality, RxQual samples on a scale from 0 to 7 for GSM operators, EcNo from 0 to -30 dBm and Frame Error Rate

(FERs) for CDMA service providers are measured. As per the QoS norms, RxQual between 0- 5 for GSM operators, EcNo >= -15 dBm and

between 0-4% FER value for CDMA operators FERs is considered to be good, where as RxQual beyond this benchmark is considered to

be bad

11

Coverage % Accessibility % Retainability % Mobility % Rx Quality %

Aircel 2G 81.87% 97.39% 95.85% 97.53% 93.89%

Aircel 3G 89.25% 98.09% 98.33% 99.37% 98.56%

Airtel 2G 95.01% 97.73% 98.19% 96.82% 95.47%

Airtel 3G 98.55% 99.14% 97.68% 99.76% 97.29%

BSNL 2G 92.84% 98.31% 98.57% 91.80% 93.93%

BSNL 3G 37.38% 98.16% 91.88% 89.36% 98.05%

IDEA 2G 78.56% 99.27% 99.02% 98.64% 96.25%

IDEA 3G 70.10% 97.23% 98.01% 99.87% 99.52%

MTS CDMA 97.61% 100.00% 98.79% 100.00% 98.50%

RCOM 2G 81.98% 97.29% 98.33% 95.82% 96.97%

RCOM 3G 60.02% 89.47% 92.28% 98.17% 97.93%

Tata 2G 55.30% 86.87% 87.14% 96.43% 90.93%

Tata CDMA 98.03% 100.00% 99.00% 100.00% 98.79%

VODA 2G 88.08% 98.55% 99.75% 98.63% 97.49%

VODA 3G 82.01% 98.64% 99.17% 99.85% 96.67%

0.00%

25.00%

50.00%

75.00%

100.00%

KPI Distribution

Page 13: Independent Drive Test Report IDT Report_September 16_Final.pdfIndependent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of

Appendix

Ancillary Details

3. Coverage Details

RF Coverage relates to the geographical footprint within the system that has sufficient RF signal strength to provide for a call/data

session. The Coverage rate of an operator is calculated basis of % of samples in which the Rx level is better than -85 dBm. The details

are as follows.

Operators are not meeting benchmark

12

Aircel 2G Aircel 3G Airtel 2G

Airtel 3G BSNL 2G BSNL 3G

0.00%

25.00%

50.00%

75.00%

100.00%

Air

cel 2

G

Air

cel 3

G

Air

tel 2

G

Air

tel 3

G

Bsn

l 2G

Bsn

l 3G

Idea

2G

Idea

3G

MTS

CD

MA

Re

lian

ce 2

G

Re

lian

ce 3

G

TATA

2G

TATA

CD

MA

Vo

da

fon

e 2

G

Vo

da

fon

e 3

G

Coverage Distribution

-95 to -120 dBm -85 to -95 dBm -75 to -85 dBm 0 to -75 dBm

Operators Coverage Rate

Aircel 2G 81.87%

Aircel 3G 89.25%

Airtel 2G 95.01%

Airtel 3G 98.55%

Bsnl 2G 92.84%

Bsnl 3G 37.38%

Idea 2G 78.56%

Idea 3G 70.10%

MTS CDMA 97.61%

Reliance 2G 81.98%

Reliance 3G 60.02%

TATA 2G 55.30%

TATA CDMA 98.03%

Vodafone 2G 88.08%

Vodafone 3G 82.01%

Page 14: Independent Drive Test Report IDT Report_September 16_Final.pdfIndependent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of

Appendix

Ancillary Details

3. Coverage Details

13

IDEA 3G

Reliance 2G

IDEA 2G MTS CDMA

Reliance 3G TATA 2G

TATA CDMA Vodafone 2G Vodafone 3G

Page 15: Independent Drive Test Report IDT Report_September 16_Final.pdfIndependent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of

Appendix

Ancillary Details

4. Receive (Rx) Quality Details

For measuring voice quality, RxQual samples on a scale from 0 to 7 for GSM operators, EcNo for 3G operators on a scale of 0 to -30

dBm and Frame Error Rate (FERs) for CDMA service providers are measured. As per the QoS norms, Rx Quality between 0- 5 for GSM

operators, EcNo >= -15 dBm and between 0-4% FER value for CDMA operators FERs is considered to be good, where as quality beyond

this benchmark is considered to be bad. The benchmark should usually be > =95%.

Operators are not meeting benchmark

14

Aircel 2G Aircel 3G Airtel 2G

Airtel 3G BSNL 2G BSNL 3G

0.00%

25.00%

50.00%

75.00%

100.00%

Air

cel 2

G

Air

cel 3

G

Air

tel 2

G

Air

tel 3

G

Bsn

l 2G

Bsn

l 3G

Idea

2G

Idea

3G

MTS

CD

MA

Re

lian

ce 2

G

Re

lian

ce 3

G

TATA

2G

TATA

CD

MA

Vo

da

fon

e 2

G

Vo

da

fon

e 3

G

Rx Quality Distribution

RxQual 6 to 7, EcNo <-15 dBm, FER <= 4% RxQual 0 to 5, EcNo >=-15 dBm, FER > 4%

Operators Rx Quality

Aircel 2G 93.89%

Aircel 3G 98.56%

Airtel 2G 95.47%

Airtel 3G 97.29%

Bsnl 2G 93.93%

Bsnl 3G 98.05%

Idea 2G 96.25%

Idea 3G 99.52%

MTS CDMA 98.50%

Reliance 2G 96.97%

Reliance 3G 97.93%

TATA 2G 90.93%

TATA CDMA 98.79%

Vodafone 2G 97.49%

Vodafone 3G 96.67%

Page 16: Independent Drive Test Report IDT Report_September 16_Final.pdfIndependent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of

Appendix

Ancillary Details

4. Receive (Rx) Quality Details

15

Idea 2G MTS CDMA Idea 3G

Reliance 2G Reliance 3G TATA 2G

TATA CDMA Vodafone 2G Vodafone 3G

Page 17: Independent Drive Test Report IDT Report_September 16_Final.pdfIndependent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of

Appendix

Ancillary Details

5. City-Level Ranking and KPI details

Accessibility is the ability of a service to be obtained within specific tolerances and other given conditions, when requested by the user.

In other words, the ability of a user to obtain the requested service from the system. Accessibility is monitored by measuring Call Setup

Success Rate (CSSR) which is defined as the ratio of Established Calls to Call Attempts. The benchmark is >=95%. The details are as

follows:

Retainability is “the ability of a service, once obtained, to continue to be provided under given conditions for a requested duration.” For

determining the Retainability, the regulation prescribes three important parameters namely Call drop rate (CDR), Worst affected Cells

having more than 3% TCH drop and Connection with good voice quality. The call drop and connection with good voice quality were

monitored by the drive test

Call Drop Rate (CDR): The parameter gives a reliable measurement of the mobile network used by the service provider for maintaining a

call once it has been correctly established

Mobility: In a cellular system a base station has only a limited coverage area. Hence it is possible for a moving subscriber to get out of

reach of a base station while making a call. The process by which a mobile telephone call is transferred from one base station to

another as the subscriber passes the boundary of a cell is called a handover. The Handover Ssuccess Rate (HOSR) more than 95% is

considered to be good

*In case of multiple call failure in similar geo location in given period of 60sec has been counted as one call failure

Operators not meeting benchmark

16

Operators Total Call Attempt Blocked Calls Blocked Call Rate* CSSR

Aircel 2G 421 11 2.61% 97.39%

Aircel 3G 366 7 1.91% 98.09%

Airtel 2G 396 9 2.27% 97.73%

Airtel 3G 348 3 0.86% 99.14%

BSNL 2G 355 6 1.69% 98.31%

BSNL 3G 326 6 1.84% 98.16%

IDEA 2G 410 3 0.73% 99.27%

IDEA 3G 361 10 2.77% 97.23%

MTS CDMA 414 0 0.00% 100.00%

RCOM 2G 369 10 2.71% 97.29%

RCOM 3G 304 32 10.53% 89.47%

Tata 2G 358 47 13.13% 86.87%

Tata CDMA 401 0 0.00% 100.00%

Vodafone 2G 414 6 1.45% 98.55%

Vodafone 3G 368 5 1.36% 98.64%

Operators Total Call Established Total Call Drop CDR CCSR

Aircel 2G 410 17 4.15% 95.85%

Aircel 3G 359 6 1.67% 98.33%

Airtel 2G 387 7 1.81% 98.19%

Airtel 3G 345 8 2.32% 97.68%

BSNL 2G 349 5 1.43% 98.57%

BSNL 3G 320 26 8.13% 91.88%

IDEA 2G 407 4 0.98% 99.02%

IDEA 3G 351 7 1.99% 98.01%

MTS CDMA 414 5 1.21% 98.79%

RCOM 2G 359 6 1.67% 98.33%

RCOM 3G 272 21 7.72% 92.28%

Tata 2G 311 40 12.86% 87.14%

Tata CDMA 401 4 1.00% 99.00%

Vodafone 2G 408 1 0.25% 99.75%

Vodafone 3G 363 3 0.83% 99.17%

Operators Total HO Attempt HO Failure HO Success HO Failure Rate HO Success Rate

Aircel 2G 930 23 907 2.47% 97.53%

Aircel 3G 2372 15 2357 0.63% 99.37%

Airtel 2G 1511 48 1463 3.18% 96.82%

Airtel 3G 5521 13 5508 0.24% 99.76%

BSNL 2G 1269 104 1165 8.20% 91.80%

BSNL 3G 2312 246 2066 10.64% 89.36%

IDEA 2G 1618 22 1596 1.36% 98.64%

IDEA 3G 4478 6 4472 0.13% 99.87%

MTS CDMA 4261 0 4261 0.00% 100.00%

RCOM 2G 958 40 918 4.18% 95.82%

RCOM 3G 2242 41 2201 1.83% 98.17%

Tata 2G 757 27 730 3.57% 96.43%

Tata CDMA 5995 0 5995 0.00% 100.00%

Vodafone 2G 1823 25 1798 1.37% 98.63%

Vodafone 3G 6115 9 6106 0.15% 99.85%

Page 18: Independent Drive Test Report IDT Report_September 16_Final.pdfIndependent Drive Test Report - September’16 Kolkata Key performance indicators for most of the operators: Most of

Appendix

Ancillary Details

6. City-Level KPI details

17

Call Events

Operators (Summary)

Aircel Airtel BSNL IDEA MTS RCOM TATA Vodafone

2G 3G 2G 3G 2G 3G 2G 3G CDMA 2G 3G 2G CDMA 2G 3G

Call Attempt

Sep' 16 421 366 396 348 355 326 410 361 414 369 304 358 401 414 368

Dec' 15 435 515 455 511 513 487 476 NA 497 NA 513 451 554 451 481

Sep' 15 513 NA 533 NA 538 NA 464 NA 516 NA NA 500 502 538 NA

Blocked Call Rate

Sep' 16 2.61% 1.91% 2.27% 0.86% 1.69% 1.84% 0.73% 2.77% 0.00% 2.71% 10.53% 13.13% 0.00% 1.45% 1.36%

Dec' 15 2.99% 3.50% 1.32% 4.89% 4.48% 4.93% 2.31% NA 0.20% NA 4.09% 3.77% 0.18% 4.43% 3.53%

Sep' 15 10.14% NA 18.76% NA 3.72% NA 10.56% NA 1.94% NA NA 4.60% 1.00% 2.79% NA

CSSR (Accessibility)

Sep' 16 97.39% 98.09% 97.73% 99.14% 98.31% 98.16% 99.27% 97.23% 100.00% 97.29% 89.47% 86.87% 100.00% 98.55% 98.64%

Dec' 15 97.01% 96.50% 98.68% 95.11% 95.52% 95.07% 97.69% NA 99.80% NA 95.91% 96.23% 99.82% 95.57% 96.47%

Sep' 15 89.86% NA 81.24% NA 96.28% NA 89.44% NA 98.06% NA NA 95.40% 99.00% 97.03% NA

Dropped Call Rate

Sep' 16 4.15% 1.67% 1.81% 2.32% 1.43% 8.13% 0.98% 1.99% 1.21% 1.67% 7.72% 12.86% 1.00% 0.25% 0.83%

Dec' 15 2.61% 3.22% 3.79% 2.06% 3.88% 8.86% 4.52% NA 1.41% NA 2.44% 6.68% 0.18% 8.58% 2.59%

Sep' 15 2.60% NA 1.85% NA 5.60% NA 0.48% NA 1.58% NA NA 2.31% 2.01% 2.49% NA

HOSR (Mobility)

Sep' 16 97.53% 99.37% 96.82% 99.76% 91.80% 89.36% 98.64% 99.87% 100.00% 95.82% 98.17% 96.43% 100.00% 98.63% 99.85%

Dec' 15 98.25% 97.82% 95.63% 96.49% 93.16% 92.86% 98.22% NA 100.00% NA 98.95% 95.86% 100.00% 97.15% 97.25%

Sep' 15 95.87% NA 98.03% NA 96.46% NA 98.84% NA 100.00% NA NA 94.66% 100.00% 97.90% NA

Network Quality

Sep' 16 93.89% 98.56% 95.47% 97.29% 93.93% 98.05% 96.25% 99.52% 98.50% 96.97% 97.93% 90.93% 98.79% 97.49% 96.67%

Dec' 15 84.62% 61.87% 87.39% 78.33% 83.62% 62.00% 85.84% NA 97.44% NA 74.48% 87.96% 97.26% 85.16% 75.66%

Sep' 15 83.78% NA 87.44% NA 86.14% NA 86.43% NA 95.64% NA NA 84.87% 95.10% 92.78% NA

Operators are meeting the benchmark Operators are not meeting the benchmark