bës tni test.the following table indicates the achieved values of all networks under test in each...

9
For adding something on top of telecommunication services and network connectivity in Ireland and reaching an overall score of 853 dots in the annual umlaut benchmarking survey we proudly award this certificate to Vodafone Ireland Score 853 of 1000 in Total Score 289 of 340 in Voice Services Score 454 of 510 in Data Services Score 110 of 150 in Crowdsourced Quality bëst in test. Hakan Ekmen Chief Executive Officer Telecommunication umlaut Mobile Benchmark Ireland 11 18

Upload: others

Post on 22-Mar-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: bës tni test.The following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geographical category

For adding something on top of telecommunication services and network connectivity in Ireland and reaching an overall score of 853 dots in the annual umlaut benchmarking survey we proudly award this certificate to

Vodafone Ireland

Score 853 of 1000 in TotalScore 289 of 340 in Voice ServicesScore 454 of 510 in Data ServicesScore 110 of 150 in Crowdsourced Quality

bëst in test.

Hakan EkmenChief Executive Officer Telecommunication umlaut

Mobile BenchmarkIreland

11 18

Page 2: bës tni test.The following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geographical category

Measurement setupMeasurement Overview

Drivetest Voice Data

Device Samsung Galaxy S8 Samsung Galaxy S8

Test Cases Mobile-to-Mobile (M2M)Side1 (4G preferred: Volte) to Side2 (4G preferred: Volte)115 sec call window70 sec call duration15 sec call setup timeoutMulti-RAB traff ic injection on both sides

Data 4G preferred CAHTTP DL datastream 7sHTTP UL datastream 7sHTTP 3MB DL fi xed fi le transferHTTP 1MB UL fi xed fi le transferWeb Browsing - Kepler ETSI Ref. Page8 Live web pages (4 http / 4 https)2 YouTube HD video ~ 45s1 YouTube live stream ~ 45s

Mobility andRoute Types

Drive test 100%55% in Cities, 16% in Towns and 33% on Roads

Samples ~ 2000 per Operator ~ 1700 per Operator

Dates 9 measurement days16.11.2018 – 28.11.2018

Crowd DataAssessment

Crowd Coverage and User Download Speed August – OctoberCrowd Data Service Availability April – October

2

umlaut certifi cate umlaut certifi cate

3

umlaut communications GmbH tested and measured the

performance of its voice and data services on smart-

phones in comparison to other LTE/UMTS/GSM mobile

radio networks in metropolitan and rural areas of Ireland.

The audit was done as a performance benchmark

performed by umlaut communications between 16.11.2018

and 28.11.2018 in cities and towns as well as on connection

roads.

Dedicated measurements have been executed as drive

tests outdoors using a Samsung Galaxy S8 cat16 Smart-

phone 1000 Mbit/s Download / 105 Mbit/s Upload.

All data measurements have been performed in 4G pre-

ferred mode. Voice measurements have been done in

4G/4G preferred mode on both sides, while call origin

has been alternated.

In addition crowdsourced performance data has been

collected and evaluated between April 2018 and

October 2018.

The following pages provide a comparative overview

about the performance results observed for the

different tested service types.

Page 3: bës tni test.The following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geographical category

Testing areasDrive route

Testing areasCrowdsourcing tested area

40 % of population measured

64.5 % of populated areas

10260 km² size of tested area

4000 kmmeasuring distance

DublinGalway

Limerick

Cork

Waterford

Drogheda

Swords

Dundalk

4

umlaut certifi cate umlaut certifi cate

5

Page 4: bës tni test.The following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geographical category

Claims Methodology

The leader in mobile benchmarking, umlaut, has analy-

zed the mobile networks of Ireland with regards to mobile

network performance. We measure smartphone voice

and data performance based on extensive drive-tests

– from major metropolitan areas to smaller cities, roads

and railways, complemented by walk-tests in big cities

with special focus on busy areas, on public transport and

in frequently visited buildings, like shopping malls, main

station, etc.

We objectively define the routes and test methodolo-

gy and publish the results through certificates or public

benchmark reports.

As the de-facto industry standard, our benchmarking me-

thodology focuses on customer-perceived network quality

and covers a wide range of mobile services.

Today, more than 200 mobile networks in more than

120 countries are being evaluated by our unique scoring

methodology. It allows a technical analysis that is unpre-

cedented in its level of detail and enables comparisons

between the network performance and capability of each

mobile network. Our public benchmarks as well as the

certificate benchmarks help network operators to demon-

strate how well they are delivering wireless connections to

consumers, business users and enterprises and reveals the

areas of improvement.

Best in crowd-sourced qualityVodafone

Best in voiceVodafone

Best in dataVodafone

Best in testVodafone

6

umlaut certifi cate umlaut certifi cate

7

Page 5: bës tni test.The following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geographical category

Score and breakdown

Shown scores are rounded.

Vodafone achieved the highest overall score among competitors with 853 dots out of maximum 1000.

Vodafone Operator 2 Operator 3

Voice max. 340 289 241 246

Cities Drivetest 204 84% 70% 75%

Towns Drivetest 68 89% 75% 78%

Roads Drivetest 68 82% 69% 60%

Data max. 510 454 402 333

Cities Drivetest 306 94% 83% 73%

Towns Drivetest 102 89% 78% 51%

Roads Drivetest 102 75% 66% 58%

Crowdsourced Quality max. 150 110 95 104

Crowd 150 73% 63% 69%

Total 1000 853 738 683

The graphic indicates the score points achieved by the networks under test in the modules “Voice”, “Data Services” and

“Crowdsourced Quality”.

Total Score1000 Points

Operator 2

402

241

738

95

Operator 3

333

246

683

104

- S

how

n to

tal s

core

s ar

e ro

und

ed.

Vodafone

454

289

110

853

Voicemax. 340

Datamax. 510

Crowdmax. 150

Operator

8

umlaut certifi cate umlaut certifi cate

9

Page 6: bës tni test.The following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geographical category

The following table indicates the achieved percentage of the maximum score in each of the diff erent data services.

Data Service Group max Vodafone Operator 2 Operator 3

Cities

Web Browsing 68,0 95% 92% 83%

File Download 85,0 89% 79% 69%

File Upload 85,0 94% 83% 63%

YouTube 68,0 98% 81% 78%

Towns

Web Browsing 22,7 92% 91% 66%

File Download 28,3 84% 73% 48%

File Upload 28,3 88% 77% 25%

YouTube 22,7 96% 72% 72%

Roads

Web Browsing 22,7 78% 73% 64%

File Download 28,3 75% 67% 66%

File Upload 28,3 72% 56% 42%

YouTube 22,7 74% 68% 64%

Voice KPI overviewThe following table indicates the achieved values of all networks under test in each of the relevant Voice Key

Performance Indicators (KPIs) for the geographical categories “Cities”, “Towns” and “Roads”.

Voice Service Group Unit Vodafone Operator 2 Operator 3

Cities

Call Setup Time [s] 5,6 8,5 7,1

Call Setup Time (P90) [s] 6,7 9,7 7,9

Speech Quality (AVG) [MOS-LQO] 3,6 3,6 3,6

Qualifi er [%] 99,2 97,6 98,0

Towns

Call Setup Time [s] 5,2 8,3 7,0

Call Setup Time (P90) [s] 6,0 9,8 7,7

Speech Quality (AVG) [MOS-LQO] 3,5 3,6 3,5

Qualifi er [%] 100,0 98,5 98,5

Call Setup Time [s] 5,5 8,4 7,2

Call Setup Time (P90) [s] 6,6 10,5 8,2

Speech Quality (AVG) [MOS-LQO] 3,6 3,5 3,5

Qualifi er [%] 98,2 96,2 93,1

10

umlaut certifi cate umlaut certifi cate

11

Page 7: bës tni test.The following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geographical category

Data KPI overviewThe following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance

Indicators (KPIs) for the geographical category “Cities”.

Data Cities KPI Name Unit Vodafone Operator 2 Operator 3

HTTP Live Page DL

Qualifi er [%] 99,6 99,2 97,5

Time to fi rst Byte [ms] 395 321 362

KBytes fi rst second [KB] 745 656 654

HTTP Static Page DLQualifi er [%] 99,9 99,2 97,9

Overall Session Time [s] 1,1 1,2 1,5

HTTP fi le DL 3MB

Qualifi er [%] 100,0 99,7 96,4

Average Session Time [s] 1,1 2,7 2,8

90% faster than [kbit/s] 13690 4519 4810

10% faster than [kbit/s] 67416 51392 55122

HTTP fi le UL 1MB

Qualifi er [%] 100,0 99,6 96,4

Average Session Time [s] 0,7 1,2 1,8

90% faster than [kbit/s] 7747 3568 1864

10% faster than [kbit/s] 27482 19185 17582

HTTP DL FDTT

Qualifi er [%] 99,8 99,6 98,7

Average Data Rate [kbit/s] 53006 28842 32868

90% faster than [kbit/s] 15949 5715 4827

10% faster than [kbit/s] 100473 60227 69731

HTTP UL FDTT

Qualifi er [%] 99,9 99,4 95,1

Average Data Rate [kbit/s] 30359 17094 15504

90% faster than [kbit/s] 10418 5327 4471

10% faster than [kbit/s] 52826 27045 29332

YouTube

Start Time [s] 1,2 1,5 1,5

Playouts w/o interruptions [%] 99,7 98,2 98,2

AVG Resolution [p] 1076 1054 1067

Qualifi er [%] 99,9 97,7 96,9

YouTube Live

Start Time [s] 1,7 2,3 2,1

Playouts w/o interruptions [%] 99,8 97,4 97,1

AVG Resolution [p] 1078 1030 1058

Qualifi er [%] 99,4 96,4 95,9

Data Towns KPI Name Unit Vodafone Operator 2 Operator 3

HTTP Live Page DL

Qualifi er [%] 99,4 99,1 93,8

Time to fi rst Byte [ms] 406 339 414

KBytes fi rst second [KB] 708 645 671

HTTP Static Page DLQualifi er [%] 99,1 99,3 95,4

Overall Session Time [s] 1,2 1,4 1,7

HTTP fi le DL 3MB

Qualifi er [%] 100,0 99,3 89,0

Average Session Time [s] 1,7 3,3 2,6

90% faster than [kbit/s] 7422 3097 5933

10% faster than [kbit/s] 61507 40609 57875

HTTP fi le UL 1MB

Qualifi er [%] 99,7 99,7 88,5

Average Session Time [s] 1,0 1,5 2,6

90% faster than [kbit/s] 5438 2686 983

10% faster than [kbit/s] 23795 15238 16607

HTTP DL FDTT

Qualifi er [%] 99,6 99,3 97,1

Average Data Rate [kbit/s] 43849 20012 33951

90% faster than [kbit/s] 7654 3759 2521

10% faster than [kbit/s] 90241 41354 72730

HTTP UL FDTT

Qualifi er [%] 99,7% 98,6% 87,1%

Average Data Rate [kbit/s] 21628 13023 16303

90% faster than [kbit/s] 6031 4823 2335

10% faster than [kbit/s] 44181 19396 32543

YouTube

Start Time [s] 1,4 1,6 1,5

Playouts w/o interruptions [%] 100,0 98,2 98,8

AVG Resolution [p] 1056 1030 1066

Qualifi er [%] 99,3 95,5 94,9

YouTube Live

Start Time [s] 1,8 2,4 2,3

Playouts w/o interruptions [%] 99,3 96,4 99,2

AVG Resolution [p] 1042 982 1063

Qualifi er [%] 99,3 95,9 93,3

Data KPI OverviewThe following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance

Indicators (KPIs) for the geographical category “Towns”.

12

umlaut certifi cate umlaut certifi cate

13

Page 8: bës tni test.The following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geographical category

The following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance

Indicators (KPIs) for the geographical category “Roads”.

Data Roads KPI Name Unit Vodafone Operator 2 Operator 3

HTTP Live Page DL

Qualifi er [%] 95,6 95,0 90,6

Time to fi rst Byte [ms] 466 416 484

KBytes fi rst second [KB] 617 511 611

HTTP Static Page DLQualifi er [%] 95,0 93,2 91,7

Overall Session Time [s] 1,7 1,9 1,8

HTTP fi le DL 3MB

Qualifi er [%] 97,7 95,9 92,9

Average Session Time [s] 4,9 4,8 4,5

90% faster than [kbit/s] 2269 2601 2177

10% faster than [kbit/s] 55300 31742 58882

HTTP fi le UL 1MB

Qualifi er [%] 96,6 93,0 88,4

Average Session Time [s] 2,3 3,6 3,9

90% faster than [kbit/s] 1642 878 742

10% faster than [kbit/s] 20954 14787 15340

HTTP DL FDTT

Qualifi er [%] 95,7 95,3 94,4

Average Data Rate [kbit/s] 30194 15276 35206

90% faster than [kbit/s] 3303 2440 3010

10% faster than [kbit/s] 79113 35356 81756

HTTP UL FDTT

Qualifi er [%] 95,6 92,6 87,8

Average Data Rate [kbit/s] 13478 7962 9466

90% faster than [kbit/s] 1675 1090 904

10% faster than [kbit/s] 28531 17522 21228

YouTube

Start Time [s] 1,7 2,2 1,9

Playouts w/o interruptions [%] 97,5 96,7 96,8

AVG Resolution [p] 934 866 972

Qualifi er [%] 94,3 93,0 90,2

YouTube Live

Start Time [s] 2,1 2,6 2,4

Playouts w/o interruptions [%] 96,7 96,0 96,4

AVG Resolution [p] 877 745 932

Qualifi er [%] 92,1 92,7 89,9

14

umlaut certifi cate

Page 9: bës tni test.The following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geographical category

umlaut AG

Am Kraftversorgungsturm 3 · 52070 Aachen · Germany

Hakan Ekmen · Chief Executive Officer Telecommunication

cell +49 151 571 33 235 · [email protected]

www.umlaut.com