bës tni test.phones in comparison to other lte/umts/gsm mobile radio networks in metropolitan and...

10
For adding something on top of telecommunication services and network connectivity in Czech Republic and reaching an overall score of 945 dots in the annual umlaut benchmarking survey we proudly award this certificate to T-Mobile Czech Republic a.s. Score 945 of 1000 in Total Score 314 of 320 in Voice Services Score 460 of 480 in Data Services Score 171 of 200 in Crowdsourced Quality bëst in test. Hakan Ekmen Chief Executive Officer Telecommunication umlaut Mobile Benchmark Czech Republic 11 19

Upload: others

Post on 18-Mar-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: bës tni test.phones in comparison to other LTE/UMTS/GSM mobile radio networks in metropolitan and rural areas of Czech Republic. The audit was done as a performance benchmark performed

For adding something on top of telecommunication services and network connectivity in Czech Republic and reaching an overall score of 945 dots in the annual umlaut benchmarking survey we proudly award this certificate to

T-Mobile Czech Republic a.s.

Score 945 of 1000 in TotalScore 314 of 320 in Voice ServicesScore 460 of 480 in Data ServicesScore 171 of 200 in Crowdsourced Quality

bëst in test.

Hakan EkmenChief Executive Officer Telecommunication umlaut

Mobile BenchmarkCzech Republic

11 19

Page 2: bës tni test.phones in comparison to other LTE/UMTS/GSM mobile radio networks in metropolitan and rural areas of Czech Republic. The audit was done as a performance benchmark performed

Measurement setupMeasurement Overview

Drivetest Voice Data

Device Samsung Galaxy S9 Samsung Galaxy S9

Test Cases Mobile-to-Mobile (M2M)Side1 (4G preferred: Volte) to Side2 (4G preferred: Volte)115 sec call window70 sec call duration15 sec call setup timeoutMulti-RAB traff ic injection on both sides

Data 4G preferred CAHTTP DL datastream 7sHTTP UL datastream 7sHTTP 5MB DL fi xed fi le transferHTTP 2.5MB UL fi xed fi le transferWeb Browsing - Kepler ETSI Ref. Page10 Live web pages2 YouTube HD video ~ 45s1 YouTube live stream ~ 45s

Mobility andRoute Types

Drive test 100%57% in Cities, 14% in Towns and 26% on Roads

Samples ~ 2650 per Operator ~ 2100 per Operator

Dates 13 measurement daysOctober 17th 2019 - November 1st 2019

Crowd DataAssessment

24 weeksCW20 2019 – CW43 2019

2

umlaut certifi cate umlaut certifi cate

3

umlaut communications GmbH tested and measured the

performance of its voice and data services on smart-

phones in comparison to other LTE/UMTS/GSM mobile

radio networks in metropolitan and rural areas of Czech

Republic.

The audit was done as a performance benchmark

performed by umlaut communications between 17.10.2019

and 01.11.2019 in cities and towns as well as on connection

roads.

Dedicated measurements have been executed as drive

tests outdoors using a Samsung Galaxy S9 cat18 Smart-

phone 1200 Mbit/s Download / 200 Mbit/s Upload.

All data measurements have been performed in 4G

preferred mode. Voice measurements have been done in

4G/4G preferred mode on both sides, while call origin has

been alternated.

In addition crowdsourced performance data has been

collected and evaluated between CW20 2019 and CW43

2019.

The following pages provide a comparative overview about

the performance results observed for the different tested

service types.

Page 3: bës tni test.phones in comparison to other LTE/UMTS/GSM mobile radio networks in metropolitan and rural areas of Czech Republic. The audit was done as a performance benchmark performed

Testing areasDrive route

Testing areasCrowdsourcing tested area

30 % of population measured

97.9 % of populated areas Urban

74.4 % of populated areas Non-Urban

7700 kmmeasuring distance

58262 km2

size of tested area

Liberec

Brno

Jihlava

Ceske Budejovice

Plzen

Ostrava

Opava

Olomouc

Zlin

Praha

Hradec KraloveKladno

4

umlaut certifi cate umlaut certifi cate

5

Page 4: bës tni test.phones in comparison to other LTE/UMTS/GSM mobile radio networks in metropolitan and rural areas of Czech Republic. The audit was done as a performance benchmark performed

Claims Methodology

The leader in mobile benchmarking, umlaut, has analyzed

the mobile networks of Czech Republic with regards to

mobile network performance. We measure smartphone

voice and data performance based on extensive dri-

ve-tests – from major metropolitan areas to smaller cities

and connection roads.

We objectively define the routes and test methodolo-

gy and publish the results through certificates or public

benchmark reports.

As the de-facto industry standard, our benchmarking me-

thodology focuses on customer-perceived network quality

and covers a wide range of mobile services.

Today, more than 200 mobile networks in more than

120 countries are being evaluated by our unique scoring

methodology. It allows a technical analysis that is unpre-

cedented in its level of detail and enables comparisons

between the network performance and capability of each

mobile network. Our public benchmarks as well as the

certificate benchmarks help network operators to demon-

strate how well they are delivering wireless connections to

consumers, business users and enterprises and reveals the

areas of improvement.

Best in voiceT-Mobile Czech Republic a.s.

Best in dataT-Mobile Czech Republic a.s.

Best in testT-Mobile Czech Republic a.s.

6

umlaut certifi cate umlaut certifi cate

7

Page 5: bës tni test.phones in comparison to other LTE/UMTS/GSM mobile radio networks in metropolitan and rural areas of Czech Republic. The audit was done as a performance benchmark performed

Score and breakdown

Shown scores are rounded.

T-Mobile Czech Republic a.s. achieved the highest overall score among competitors with 945 dots out of maximum

1000.

Total score

T-Mobile Operator 2 Operator 3

Voice max. 320 314 310 289

Cities Drivetest 192 98% 96% 91%

Towns Drivetest 64 98% 99% 87%

Roads Drivetest 64 98% 96% 92%

Data max. 480 460 457 434

Cities Drivetest 288 97% 96% 90%

Towns Drivetest 96 94% 94% 88%

Roads Drivetest 96 95% 94% 94%

Crowdsourced Quality max. 200 171 173 170

Crowd 200 3% 87% 85%

Total 1000 945 940 894

The graphic indicates the score dots achieved by the networks under test in the modules “Voice”, “Data Services” and

“Crowdsourced Quality”.

Total Score1000 Dots

Operator 2

457

310

173

Operator 3

434

289

170

- S

how

n to

tal s

core

s ar

e ro

und

ed.

T-Mobile

460

314

171

Voicemax. 320

Datamax. 480

Crowdmax. 200

Operator

945 940894

8

umlaut certifi cate umlaut certifi cate

9

Page 6: bës tni test.phones in comparison to other LTE/UMTS/GSM mobile radio networks in metropolitan and rural areas of Czech Republic. The audit was done as a performance benchmark performed

The following table indicates the achieved percentage of the maximum score in each of the diff erent data services. The following table indicates the achieved percentage of the maximum score in each of the diff erent data services.

Data Service Group max T-Mobile Operator 2 Operator 3

Cities

Web Browsing 64,0 98% 98% 97%

File Download 80,0 96% 94% 83%

File Upload 80,0 98% 96% 93%

YouTube 64,0 95% 96% 89%

Towns

Web Browsing 21,3 98% 99% 97%

File Download 26,7 87% 92% 78%

File Upload 26,7 97% 92% 92%

YouTube 21,3 95% 94% 85%

Roads

Web Browsing 21,3 98% 97% 97%

File Download 26,7 94% 92% 89%

File Upload 26,7 97% 92% 96%

YouTube 21,3 92% 94% 92%

Crowd Service Group max T-Mobile Operator 2 Operator 3

Country Operational Excellence 60 97% 100% 100%

Urban

Voice Coverage 13 97% 98% 89%

Data Coverage 17 93% 97% 94%

4G Coverage 29 89% 94% 93%

DL Data Speed 17 58% 56% 49%

UL Data Speed 8 35% 35% 22%

Non-urban (Benchmark view)

Voice Coverage 7 100% 100% 100%

Data Coverage 9 100% 99% 100%

4G Coverage 15 100% 100% 100%

DL Data Speed 9 50% 40% 40%

UL Data Speed 4 33% 24% 28%

Non-urban (Own network view)

Voice Coverage 2 100% 100% 100%

Data Coverage 2 99% 99% 99%

4G Coverage 4 99% 99% 100%

DL Data Speed 2 40% 30% 33%

UL Data Speed 1 29% 22% 27%

10

umlaut certifi cate umlaut certifi cate

11

Page 7: bës tni test.phones in comparison to other LTE/UMTS/GSM mobile radio networks in metropolitan and rural areas of Czech Republic. The audit was done as a performance benchmark performed

Voice KPI overviewThe following table indicates the achieved values of all networks under test in each of the relevant Voice Key

Performance Indicators (KPIs) for the geographical categories “Cities”, “Towns” and “Roads”.

Voice Service Group Unit T-Mobile Operator 2 Operator 3

Cities

Qualifi er [%] 99,8 99,7 98,8

Call Setup Time [s] 1,7 1,7 2,4

Call Setup Time (P90) [s] 2,4 1,9 3,0

Speech Quality (AVG) [MOS-LQO] 4,6 3,8 3,7

Speech Quality (P10) [MOS-LQO] 4,3 3,2 3,4

Multirab connectivity [%] 99,9 100,0 99,8

Towns

Qualifi er [%] 99,7 100,0 98,1

Call Setup Time [s] 1,6 1,7 2,4

Call Setup Time (P90) [s] 1,8 1,9 3,0

Speech Quality (AVG) [MOS-LQO] 4,6 3,8 3,8

Speech Quality (P10) [MOS-LQO] 4,4 3,3 3,5

Multirab connectivity [%] 99,5 100,0 99,7

Roads

Qualifi er [%] 99,6 99,6 98,4

Call Setup Time [s] 1,8 1,7 2,5

Call Setup Time (P90) [s] 2,6 1,9 3,2

Speech Quality (AVG) [MOS-LQO] 4,5 3,8 3,7

Speech Quality (P10) [MOS-LQO] 4,1 3,1 3,4

Multirab connectivity [%] 98,8 99,3 99,1

Data KPI overviewThe following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance

Indicators (KPIs) for the geographical category “Cities”.

Data Cities KPI Name Unit T-Mobile Operator 2 Operator 3

HTTP Live Page DL Smartphone

Qualifi er [%] 99,8 99,9 99,6

Overall Session Time [s] 0,9 0,9 1,0

HTTP Static Page DL Smartphone

Qualifi er [%] 100,0 100,0 99,9

Overall Session Time [s] 0,9 0,9 0,9

HTTP 5MB DL Smartphone

Qualifi er [%] 99,9 100,0 99,7

Average Session Time [s] 1,0 1,4 2,5

90% faster than [Mbit/s] 29,3 19,9 7,7

10% faster than [Mbit/s] 101,8 85,5 84,6

HTTP 2500KB UL Smartphone

Qualifi er [%] 100,0 100,0 99,7

Average Session Time [s] 0,9 1,1 1,2

90% faster than [Mbit/s] 16,3 11,5 13,1

10% faster than [Mbit/s] 39,5 39,3 36,3

HTTP DL FDTT

Qualifi er [%] 99,4 100,0 99,5

Average Data Rate [Mbit/s] 103,1 81,5 52,6

90% faster than [Mbit/s] 37,4 26,4 8,7

10% faster than [Mbit/s] 180,9 145,8 130,1

HTTP UL FDTT

Qualifi er [%] 99,9 99,9 99,7

Average Data Rate [Mbit/s] 43,3 36,2 28,2

90% faster than [Mbit/s] 21,6 11,9 12,2

10% faster than [Mbit/s] 59,6 58,5 46,4

YouTube

Qualifi er [%] 99,7 99,8 99,0

Start Time [s] 0,9 0,9 1,1

AVG Resolution [p] 918 921 913

YouTube LiveSmartphone

Qualifi er [%] 99,5 100,0 98,4

Start Time [s] 1,1 1,2 1,3

AVG Resolution [p] 1037 1039 1031

12

umlaut certifi cate umlaut certifi cate

13

Page 8: bës tni test.phones in comparison to other LTE/UMTS/GSM mobile radio networks in metropolitan and rural areas of Czech Republic. The audit was done as a performance benchmark performed

Data KPI OverviewThe following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance

Indicators (KPIs) for the geographical category “Towns”.

The following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance

Indicators (KPIs) for the geographical category “Roads”.

Data Towns KPI Name Unit T-Mobile Operator 2 Operator 3

HTTP Live Page DL Smartphone

Qualifi er [%] 99,9 100,0 99,7

Overall Session Time [s] 0,9 0,9 1,0

HTTP Static Page DL Smartphone

Qualifi er [%] 100,0 100,0 99,7

Overall Session Time [s] 0,9 0,9 1,0

HTTP 5MB DL Smartphone

Qualifi er [%] 100,0 100,0 100,0

Average Session Time [s] 1,7 1,3 3,1

90% faster than [Mbit/s] 11,7 18,4 6,6

10% faster than [Mbit/s] 90,2 79,3 76,8

HTTP 2500KB UL Smartphone

Qualifi er [%] 100,0 100,0 100,0

Average Session Time [s] 1,1 1,4 1,3

90% faster than [Mbit/s] 13,0 8,2 11,8

10% faster than [Mbit/s] 37,2 34,2 33,4

HTTP DL FDTT

Qualifi er [%] 98,8 100,0 98,5

Average Data Rate [Mbit/s] 75,6 70,4 38,4

90% faster than [Mbit/s] 16,8 23,7 6,7

10% faster than [Mbit/s] 138,1 121,2 96,6

HTTP UL FDTT

Qualifi er [%] 100,0 100,0 99,4

Average Data Rate [Mbit/s] 33,7 28,0 24,5

90% faster than [Mbit/s] 14,4 8,0 11,3

10% faster than [Mbit/s] 56,7 43,2 43,5

YouTube

Qualifi er [%] 99,7 100,0 98,5

Start Time [s] 0,9 0,9 1,2

AVG Resolution [p] 911 920 906

YouTube LiveSmartphone

Qualifi er [%] 100,0 98,7 97,4

Start Time [s] 1,2 1,2 1,3

AVG Resolution [p] 1024 1040 1026

Data Roads KPI Name Unit T-Mobile Operator 2 Operator 3

HTTP Live Page DL Smartphone

Qualifi er [%] 99,8 99,6 99,7

Overall Session Time [s] 1,0 1,0 1,1

HTTP Static Page DL Smartphone

Qualifi er [%] 100,0 99,6 99,7

Overall Session Time [s] 1,0 1,0 1,0

HTTP 5MB DL Smartphone

Qualifi er [%] 99,7% 99,8% 99,8

Average Session Time [s] 2,4 3,0 3,3

90% faster than [Mbit/s] 8,6 6,5 6,5

10% faster than [Mbit/s] 86,5 66,1 72,1

HTTP 2500KB UL Smartphone

Qualifi er [%] 100,0 99,7 100,0

Average Session Time [s] 1,6 2,1 1,6

90% faster than [Mbit/s] 7,5 5,3 9,1

10% faster than [Mbit/s] 36,4 28,6 34,4

HTTP DL FDTT

Qualifi er [%] 99,5 99,7 98,6

Average Data Rate [Mbit/s] 59,5 39,7 36,3

90% faster than [Mbit/s] 7,7 8,5 6,6

10% faster than [Mbit/s] 130,1 88,5 95,0

HTTP UL FDTT

Qualifi er [%] 99,7 99,5 99,5

Average Data Rate [Mbit/s] 28,7 21,8 23,1

90% faster than [Mbit/s] 8,7 5,7 8,2

10% faster than [Mbit/s] 55,7 40,9 43,9

YouTube

Qualifi er [%] 98,5 99,3 98,8

Start Time [s] 1,0 1,1 1,2

AVG Resolution [p] 913 913 906

YouTube LiveSmartphone

Qualifi er [%] 99,3 99,0 98,6

Start Time [s] 1,3 1,3 1,3

AVG Resolution [p] 1024 1033 1033

14

umlaut certifi cate umlaut certifi cate

15

Page 9: bës tni test.phones in comparison to other LTE/UMTS/GSM mobile radio networks in metropolitan and rural areas of Czech Republic. The audit was done as a performance benchmark performed

Crowd KPI overviewThe following table indicates the achieved values of all networks under test in each of the relevant Crowd Key Perfor-

mance Indicators (KPIs) for the geographical categories “country”, “urban” and “non-urban”.

Crowd Service Group Unit T-Mobile Operator 2 Operator 3

CountryOperational Excellence

Degraded days [d] 1 0 0

Degraded periods [h] 2 0 0

Urban

4G Coverage Quality of Coverage [%] 97,2 98,6 98,4

Data Coverage Quality of Coverage [%] 99,0 99,5 99,1

DL Data Speed P90 EA Top Throughput [bit/s] 50.276.992 48.545.564 43.232.388

UL Data Speed P90 EA Top Throughput [bit/s] 8.122.108 8.031.833 6.205.446

Voice Coverage Quality of Coverage [%] 99,9 99,9 99,4

Non-urban (Benchmark view)

4G Coverage Test Area Coverage [%] 99,9 99,9 99,9

Data Coverage Test Area Coverage [%] 99,9 99,9 100,0

DL Data Speed P90 EA Top Throughput [bit/s] 21.241.356 18.981.270 19.090.524

UL Data Speed P90 EA Top Throughput [bit/s] 3.392.057 2.772.296 3.047.590

Voice Coverage Test Area Coverage [%] 100,0 100,0 100,0

Non-urban (Own network view)

4G Coverage Test Area Coverage [%] 99,8 99,8 99,9

Data Coverage Test Area Coverage [%] 99,8 99,8 99,9

DL Data Speed P90 EA Top Throughput [bit/s] 18.944.458 17.178.240 17.690.114

UL Data Speed P90 EA Top Throughput [bit/s] 3.062.474 2.636.696 2.933.042

Voice Coverage Test Area Coverage [%] 100,0 100,0 100,0

16

umlaut certifi cate

Page 10: bës tni test.phones in comparison to other LTE/UMTS/GSM mobile radio networks in metropolitan and rural areas of Czech Republic. The audit was done as a performance benchmark performed

umlaut AG

Am Kraftversorgungsturm 3 · 52070 Aachen · Germany

Hakan Ekmen · Chief Executive Officer Telecommunication

cell +49 151 571 33 235 · [email protected]

www.umlaut.com