bës tni test....the leader in mobile benchmarking, umlaut, has analyzed the mobile networks of...

For adding something on top in Sweden and reaching an overall score of 939 dots in mobile network benchmarking survey we proudly award this certificate to

Telia Sweden

Score 939 out of 1000 in TotalScore 305 out of 320 in Voice ServicesScore 448 out of 480 in Data ServicesScore 186 out of 200 in Crowdsourced Quality

bëst in test.

Hakan EkmenChief Executive Officer Telecommunication

Mobile BenchmarkSweden

11 20

Measurement setupMeasurement Overview

Drivetest Voice Data

Device Samsung Galaxy S10Samsung Galaxy S10Samsung Galaxy S20+

Test Cases Mobile-to-Mobile (M2M)Side1 (VoLTE) to Side2 (VoLTE) 115 sec call window70 sec call duration15 sec call setup timeoutMulti-RAB traff ic injection on both sides

Data 4G preferred CAData 5G preferred CAHTTP DL datastream 7sHTTP UL datastream 7sHTTP 5MB DL fi xed fi le transferHTTP 2.5MB UL fi xed fi le transferWeb Browsing - Kepler ETSI Ref. Page10 Live web pages 3 YouTube HD video ~ 45s

Mobility andRoute Types

100% Drivetest51% in Cities, 22 % in Towns and 27% on Roads

Samples ~ 18,255 in total ~ 169,972 in total

Dates 23 measurement days22.10.2020 – 18.11.2020

Crowd DataAssessment

24 weeksCW23 2020 – CW46 2020

2

umlaut certifi cate umlaut certifi cate

3

umlaut tested and measured the performance of its voice

and data services on smartphones in comparison to other

5G/LTE/UMTS mobile radio networks in metropolitan and

rural areas of Sweden.

The audit was done as a performance benchmark performed

by umlaut between 22.10.2020 and 18.11.2020 in cities and

towns as well as on connection roads.

Dedicated measurements have been executed as drive

tests outdoors using a Samsung Galaxy S10 and Samsung

Galaxy S20+ Smartphone.

All data measurements have been performed in 4G and

5G preferred mode. Voice measurements have been done

in 4G/4G preferred mode on both sides, while call origin

has been alternated.

In addition crowdsourced performance data has been

collected and evaluated between CW23 and CW46.

The following pages provide a comparative overview

about the performance results observed for the

different tested service types.

Testing areasDrive route

Crowdsourcing based test area

45 % of population measured

10150 km2measuring distance

97.1 % of the ‘Population area’ covered

98.3 % of the ‘build-up area’ covered

133.803 km2size of tested area

Goteborg

Orebro

VasterasUppsala

LidingoStockholm

SodertaljeNorrkoping

Linkoping

Helsinborg

Malmo

Lund

4


5

tested area

Claims Methodology

The leader in mobile benchmarking, umlaut, has analyzed

the mobile networks of Sweden with regards to mobile

network performance. We measure smartphone voice and

data performance based on extensive drivetests – from

major metropolitan areas to smaller cities and connection

roads.

We objectively define the routes and test methodology

and publish the results through certificates or public

benchmark reports.

As the de-facto industry standard, our benchmarking

methodology focuses on customer-perceived network

quality and covers a wide range of mobile services.

Today, more than 200 mobile networks in more than

120 countries are being evaluated by our unique scoring

methodology. It allows a technical analysis that is unpre-

cedented in its level of detail and enables comparisons

between the network performance and capability of each

mobile network. Our public benchmarks as well as the

certificate benchmarks help network operators to demon-

strate how well they are delivering wireless connections to

consumers, business users and enterprises and reveals the

areas of improvement.

Best in crowd-sourced qualityTelia

Best in voiceTelia

Best in dataTelia

Best in testTelia

6


7

Score and breakdown

Shown scores are rounded.

Telia achieved the highest overall score among competitors with 939 dots out of 1000.

Total score

Telia Telenor Tele2 Tre

Voice max. 320 305 302 301 276

Cities Drivetest 192 95% 94% 95% 90%

Towns Drivetest 64 97% 94% 94% 82%

Roads Drivetest 64 95% 94% 93% 79%

Data max. 480 448 412 411 415

Cities Drivetest 288 95% 86% 87% 88%

Towns Drivetest 96 91% 86% 84% 83%

Roads Drivetest 96 90% 85% 84% 85%

Crowdsourced Quality max. 200 186 179 177 173

Broadband Coverage 100 93% 86% 87% 81%

Download Speed 60 93% 91% 89% 90%

Latency 40 94% 95% 93% 95%

Total 1000 939 892 889 863

Overall score considering Voice, Data and Crowdsourcing.

Total Score1000 Dots

Telia

448

305

186

Telenor

412

302

179

Tele2

411

301

177

Tre

415

276

173

- S

how

n to

tal s

core

s ar

e ro

und

ed.

963939892 889

863

Voicemax. 320

Datamax. 480

Crowdmax. 200

Operator

8


9

Achieved percentage of the maximum score in each of the diff erent data services.

Data Service Group max Telia Telenor Tele2 Tre

Cities

Web Browsing 72,0 98% 97% 95% 97%

File Download 72,0 95% 80% 81% 85%

File Upload 72,0 92% 83% 83% 77%

YouTube 72,0 95% 84% 88% 92%

Towns

Web Browsing 24,0 97% 97% 95% 94%

File Download 24,0 88% 79% 78% 81%

File Upload 24,0 85% 82% 81% 72%

YouTube 24,0 93% 84% 84% 88%

Roads

Web Browsing 24,0 97% 96% 94% 92%

File Download 24,0 90% 80% 79% 84%

File Upload 24,0 79% 84% 84% 77%

YouTube 24,0 92% 80% 77% 88%

Achieved percentage of the maximum score in each of the diff erent crowdsourcing services.

Infrastructure Service Group max Telia Telenor Tele2 Tre

Crowd

Broadband Coverage 100 93% 86% 87% 81%

DL Speed 60 93% 91% 89% 90%

Latency 40 94% 95% 93% 95%

10


11

Voice KPI overviewAchieved values of all networks under test in each of the relevant Voice Key Performance Indicators (KPIs) for the

geographical categories “Cities”, “Towns” and “Roads”.

Voice Service Group Unit Telia Telenor Tele2 Tre

Cities

Qualifi er [%] 99,7 99,7 99,8 99,3

Call Setup Time [s] 2,1 2,3 2,1 2,4

Call Setup Time (P90) [s] 3,1 2,8 2,6 3,9

Speech Quality (AVG) [MOS-LQO] 4,3 4,3 4,2 4,3

Speech Quality (P10) [MOS-LQO] 3,6 3,5 3,5 3,6

Multirab connectivity [%] 100,0 100,0 98,3 100,0

Towns

Qualifi er [%] 99,9 99,6 99,7 99,8






Roads

Qualifi er [%] 99,6 99,5 99,8 99,0






Data Services KPI overviewAchieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the

geographical category “Cities”.

Data Cities KPI Name Unit Telia Telenor Tele2 Tre

HTTP Live Page DL Smartphone

Qualifi er [%] 99,9 99,9 99,7 99,9

Overall Session Time [s] 0,8 0,9 1,0 1,0

HTTP Static Page DL Smartphone

Qualifi er [%] 100,0 99,8 99,8 99,9


HTTP 5MB DL Smartphone

Qualifi er [%] 99,9 99,9 99,9 99,8

Average Session Time [s] 1,1 3,3 2,9 2,1

90% faster than [Mbit/s] 27,2 7,8 7,5 13,8


HTTP 2500KB UL Smartphone

Qualifi er [%] 99,9 99,9 99,9 99,8




HTTP DL FDTT

Qualifi er [%] 99,8 99,9 99,9 99,9

Average Data Rate [Mbit/s] 126,4 54,4 60,7 62,6



HTTP UL FDTT

Qualifi er [%] 99,9 99,9 100,0 99,6




YouTube

Qualifi er [%] 99,8 97,7 98,8 99,3

Start Time [s] 1,1 1,2 1,7 1,2

AVG Resolution [p] 920 915 915 919

YouTube LiveSmartphone

Qualifi er [%] 99,8 98,6 99,1 99,6

Start Time [s] 1,0 1,2 1,5 1,3

AVG Resolution [p] 1038 1032 1035 1037

12


13

Data Services KPI OverviewAchieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geo-

graphical category “Towns”.

Achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geo-

graphical category “Roads”.

Data Towns KPI Name Unit Telia Telenor Tele2 Tre


Qualifi er [%] 100,0 99,9 99,6 99,6



Qualifi er [%] 99,9 100,0 99,8 99,6



Qualifi er [%] 100,0 100,0 99,9 99,9





Qualifi er [%] 100,0 99,9 99,8 99,5




HTTP DL FDTT

Qualifi er [%] 99,9 100,0 99,8 99,9




HTTP UL FDTT

Qualifi er [%] 99,8 100,0 100,0 99,3




YouTube

Qualifi er [%] 99,6 98,4 98,3 99,1

Start Time [s] 1,3 1,4 1,8 1,4



Qualifi er [%] 99,5 97,8 98,6 98,1

Start Time [s] 1,3 1,3 1,7 1,4

AVG Resolution [p] 1035 1021 1025 1032

Data Roads KPI Name Unit Telia Telenor Tele2 Tre


Qualifi er [%] 99,9 99,6 99,4 99,3



Qualifi er [%] 99,9 99,7 99,2 99,6



Qualifi er [%] 100,0 100,0 99,9 99,2





Qualifi er [%] 98,8 99,7 99,6 99,6




HTTP DL FDTT

Qualifi er [%] 99,9 99,7 99,3 99,2




HTTP UL FDTT

Qualifi er [%] 97,7 99,1 99,6 98,5




YouTube

Qualifi er [%] 99,1 95,9 95,5 98,2

Start Time [s] 1,4 1,5 1,9 1,6



Qualifi er [%] 99,3 94,9 94,8 98,0

Start Time [s] 1,2 1,3 1,8 1,6

AVG Resolution [p] 1029 1012 1012 1023

14


15

Crowd KPI overviewAchieved values of all networks under test in each of the relevant Crowd Key Performance Indicators (KPIs) for the

categories “Broadband Coverage”, “Download Speed” and “Latency”.

Category KPI name Unit Telia Telenor Tele2 Tre

Broadband CoverageCoverage Excellence [%] 60,1 48,8 46,7 40,3

Time on broadband [%] 97,7 94,2 96,6 93,0

Download Speed

Basic internet class [%] 96,3 95,2 94,3 94,2

HD video class [%] 82,9 77,5 74,2 78,6

UHD video class [%] 22,9 17,8 14,5 18,7

LatencyGaming class [%] 78,6 85,6 78,5 88,1

OTT voice class [%] 98,6 98,7 98,4 98,5

16

umlaut certifi cate

umlaut SE

Am Kraftversorgungsturm 3 · 52070 Aachen · Germany

Hakan Ekmen · Chief Executive Officer Telecommunication

cell +49 151 571 33 235 · [email protected]

www.umlaut.com

bës tni test....the leader in mobile benchmarking, umlaut, has analyzed the mobile networks of...

Documents