evaluation of quality of service - anacom

32
Evaluation of Quality of Service Evaluation of the quality of GSM, UMTS and LTE voice services, data services and radio network coverage in the major urban centres and along the main roads of mainland Portugal. December 2014

Upload: others

Post on 22-Apr-2022

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Evaluation of Quality of Service - ANACOM

Evaluation of Quality of Service

Evaluation of the quality of GSM, UMTS and LTE voice services,

data services and radio network coverage in the major urban centres and along the main roads of mainland Portugal.

December 2014

Page 2: Evaluation of Quality of Service - ANACOM
Page 3: Evaluation of Quality of Service - ANACOM

Evaluation of Voice Services, Data Services and Radio Network Coverage | Mainland Portugal | 30 Sept. - 3 Dec. 2014 3

PRIOR NOTE

ANACOM HOLDS NO RESPONSIBILITY FOR ANY ANALYSIS, STUDY OR COMMENTARY

BASED ON THE RESULTS OF THIS REPORT.

Page 4: Evaluation of Quality of Service - ANACOM
Page 5: Evaluation of Quality of Service - ANACOM

Evaluation of Voice Services, Data Services and Radio Network Coverage | Mainland Portugal | 30 Sept. - 3 Dec. 2014 5

Contents

I Executive Summary ..........................................................................................Error! Bookmark not defined.

I.I General Framework ............................................................................................... Error! Bookmark not defined.

I.II Key Findings and Conclusions ............................................................................... Error! Bookmark not defined.

Page 6: Evaluation of Quality of Service - ANACOM
Page 7: Evaluation of Quality of Service - ANACOM

Evaluation of Voice Services, Data Services and Radio Network Coverage | Mainland Portugal | 30 Sept. - 3 Dec. 2014 7

I EXECUTIVE SUMMARY

I.I GENERAL FRAMEWORK

From 30 September to 3 December 2014, Autoridade Nacional de Comunicações (ANACOM)

undertook an evaluation of the quality of the voice and data services and GSM, UMTS and LTE radio

network coverage provided by the following operators in the major urban centres and along the main

roads of mainland Portugal: MEO - Serviços de Comunicações e Multimédia, S.A. (MEO), NOS

Comunicações, S.A. (NOS) and VODAFONE PORTUGAL - Comunicações Pessoais, S.A. (Vodafone).

This study is based on field tests conducted with moving vehicles and outdoor antennas, using an

automatic measurement system, reflecting the various aspects that affect quality of services (end-to-end

measurements). Measurements were carried out simultaneously in the same locations and with the

same parameterization for the three operators.

Studies which seek to gauge the user´s perception of quality, such as the present study, are known as

Quality of Experience Studies (QoE), setting out to determine the user experience in terms, for example,

of service accessibility, retention and integrity. In contrast, analyses of Network Performance or Quality

of Service seek to assess the capacity of a network (or a part of a network) to provide a service with a

determined level of quality. This covers functions, mechanisms and procedures implemented by the

cellular network and by terminal equipment, which ensure the provision of the quality of service

negotiated between the terminal equipment and the core network infrastructure.

However, this does not mean that the results of a Quality of Experience Study represents quality as

perceived by an average user or by the majority of users, because such studies are always subject to

the conditions under which they were performed; so, for example, in the case of this study, it is

recognized that, in the most part, data services are not usually accessed outdoors using a laptop

computer connected to the network via a data card and an external antenna (as in the tests conducted).

Therefore, although the present study is a Quality of Experience Study, its analysis may not reflect, in

particular with regard to data services and respective coverage, the actual perception of the majority of

users.

Quality of Experience is usually expressed in terms of human feelings, such as "Excellent", "Good",

"Acceptable", "Poor" and "Bad", while Network Performance is a purely technical concept measured,

Page 8: Evaluation of Quality of Service - ANACOM

8 QoS-Mobile Networks and Services | GSM-UMTS-LTE

expressed and understood in the context of a network or network components, with little meaning as far

as the user is concerned.

To evaluate the voice service, capacity for call establishment and termination was measured, together

with the perceptibility of the communication.

In assessing the data service, an analysis was made of file transfer capacity (FTP upload / download),

Internet navigation (HTTP web browsing) and also transmission latency (ping).

To evaluate radio network coverage, measurements were made of the radio signal levels received by

the mobile terminal equipment (downlink) for each of the technologies used by the operators.

The main quality indicators analyzed for the services covered by the study were as follows:

1. Radio Network coverage - GSM, UMTS and LTE network availability;

2. Accessibility of the Voice Service - probability of success when establishing calls;

3. Voice Call Establishment Time - Length of time taken by the network to establish a

communication after correct submission of the request (destination telephone number);

4. Voice Call Termination Rate - Probability, after a call is successfully established, that it will

remain active for a period of time and terminate normally, i.e. as intended by the user;

5. Voice Call Audio Quality - Perceptibility of the conversation during a call;

6. Termination Rate of Sessions Using the Data Service - Probability that a session using the

data service - file transfer or Internet browsing - is established and is maintained successfully,

i.e., it remains active during the entire period required for the file transfer or to allow the transfer of

the entire web page;

7. Data Transfer Speed - Quantifies the average speed of data transfer during a file transfer

session;

8. Web Page Transfer Time - Quantifies the average time taken to download a reference web

page;

9. Data Transmission Latency - quantifies the time needed for an information packet to travel from

the user´s device to the Content Server or visa versa.

Page 9: Evaluation of Quality of Service - ANACOM

Evaluation of Voice Services, Data Services and Radio Network Coverage | Mainland Portugal | 30 Sept. - 3 Dec. 2014 9

The field work took place on working days and during normal working hours, from 30 September to 3

December 2014. 12,887 test calls were performed, 53,183 sessions using data services and 7,091,279

measurements taken of the radio network signal, which corresponds to about 219 hours of

measurements over approximately 10,350 kilometres.

Given the penetration rate of these services, the diversity of terminal equipment used and the very

subjectivity inherent to each user, it is impossible to accurately reproduce the conditions of each

consumer's interaction with the networks. A study of this type cannot be completed without adopting

certain compromises and estimates, within limits which ensure that the results obtained can be viewed

as a reliable indicator of the overall performance of mobile communication systems. The transposition or

extrapolation of the results to specific situations must be done with prudence, at the risk of drawing

conclusions that distort the reality of the situation.

The adopted technical and methodological options directly influence the results and should be taken into

account in their analysis. The following options are particularly relevant:

The testing was conducted exclusively using a technical solution (hardware and software) and

was processed completely automatically, allowing the homogeneous setting of measurement

conditions for the three operators and eliminating any subjectivity inherent to a human user;

The following terminal equipment was used: Nokia C7 and Huawei E392;

The tests were conducted with moving vehicles and outdoor antennas;

The duration of the conversation phase of voice calls was 120 seconds;

Voice and data tests were performed with automatic selection of GSM, UMTS and LTE

infrastructure;

The Servers, used in the data service tests, were hosted in Portugal, in a data centre at FCT -

Fundação para a Ciência e a Tecnologia, I.P. (Foundation for Science and Technology);

In data tests, stable content was used, i.e. web pages and files that had no quantitative or

qualitative changes over time;

File Transfer Tests (FTP upload / download) were performed according to the concept of fixed

data transfer time, i.e., data transfer is performed over a predefined period of time instead of the

full transfer of files of a fixed size;

Page 10: Evaluation of Quality of Service - ANACOM

10 QoS-Mobile Networks and Services | GSM-UMTS-LTE

Radio network coverage indicators, in particular, UMTS and LTE network coverage, did not take

network load into account (number of simultaneous users and type of services used);

The GSM, UMTS and LTE network coverage indicators presented in this study result from the

analysis of the radio channel provided by operators prior to the study´s performance. Due to an

omission by Vodafone, some of the LTE channels of this operator were not analyzed. According

to the operator, these channels were used on a local basis - Zambujeira do Mar, Guarda,

Bragança, Évora and Coimbra -, and this omission had a direct impact on the LTE network

coverage indicator reported for Vodafone in the urban centres of mainland Portugal and on the

statistical significance of this indicator;

In some parts of the Portuguese territory, especially near the Spanish border, performance of the

LTE networks of Portuguese operators was affected by Spanish DTT during the period of testing.

With the shutdown of Spanish transmitters, which occurred in early 2015, the performance of

Portuguese LTE networks in these locations is expected to improve;

The generic test scenario used by ANACOM in this study corresponds to a use of

communications services which is the most favourable given the strength of signal reception on

the mobile terminal device, due to the non-consideration of signal loss because of indoor

environments and due to use of mobile terminal equipment with outdoor antennas. This situation,

is not very significant as far as the Voice Service is concerned, but has significant impact on

Radio Network Coverage and on Data Services, resulting in higher levels of performances than

could be obtained indoors;

The servers used were dedicated exclusively to the performance of these tests, so that, in the context

of the study conducted, there are no limitations on processing power and information storage,

whereby availability and access bandwidth can have a positive influence on the results of the data

transmission speed (as opposed to the results that may be obtained by a general user accessing

conventional servers). Furthermore, the servers used, which function along the same lines as servers

available on the Internet, are identified by the respective IP addresses and not through their FQDN

(Fully Qualified Domain Name), ensuring that the measurements were not negatively affected by DNS

(Domain Name System) resolution problems or caching strategies;

The results of the study only reflect the behaviour of networks in the locations and at the times of

actual measurement;

Operators are continually improving their networks. The technical interventions necessary for

Page 11: Evaluation of Quality of Service - ANACOM

Evaluation of Voice Services, Data Services and Radio Network Coverage | Mainland Portugal | 30 Sept. - 3 Dec. 2014 11

these improvements can cause momentary degradations of the service in the geographical areas

were work is performed.

Page 12: Evaluation of Quality of Service - ANACOM

12 QoS-Mobile Networks and Services | GSM-UMTS-LTE

I.II KEY FINDINGS AND CONCLUSIONS

Mobile communications systems provide good GSM and UMTS radio network coverage levels and good

voice service performance in the major urban centres and along the main roads of mainland Portugal

Data services and LTE network coverage give different results depending on the type of site tested. In

urban areas, good levels of performance were observed for data services and good LTE network

coverage. Along main roads, mobile communication systems provide poor LTE coverage and

acceptable levels of performance when it comes to data services, albeit significantly lower than those

seen in urban centres.

GSM, UMTS and LTE Radio Network Coverage

The mobile communications systems tested in the study provide high levels of GSM Radio Network

Coverage and UMTS Radio Network Coverage, both in urban centres and along main roads, without

significant differences reported between operators (

100,

0%

0,0%

0,0%

0,0%

100,

0%

0,0%

0,0%

0,0%

100,

0%

0,0%

0,0%

0,0%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Boa Aceitável Má Inexistente

Radio Network CoverageGSM

MEO NOS Vodafone

Page 13: Evaluation of Quality of Service - ANACOM

Evaluation of Voice Services, Data Services and Radio Network Coverage | Mainland Portugal | 30 Sept. - 3 Dec. 2014 13

Figure 1 and

Figure 2).

LTE networks provide good Radio Network Coverage in urban areas, particularly in the case of MEO

and NOS, with 97.9% Good Radio Network Coverage (

99,7

%

0,2%

0,0%

0,0%

99,7

%

0,3%

0,0%

0,0%

100,

0%

0,0%

0,0%

0,0%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Boa Aceitável Má Inexistente

Radio Network CoverageUMTS

MEO NOS Vodafone

97,9

%

1,7%

0,3%

0,1%

97,9

%

1,7%

0,3%

0,1%

94,0

%

2,1%

1,4%

2,4%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Boa Aceitável Má Inexistente

Radio Network CoverageLTE

MEO NOS Vodafone

99,8

%

0,1%

0,0%

0,0%

99,9

%

0,1%

0,0%

0,0%

99,8

%

0,2%

0,0%

0,0%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Boa Aceitável Má Inexistente

Radio Network CoverageGSM

MEO NOS Vodafone

98,6

%

1,2%

0,2%

0,0%

96,5

%

2,7%

0,7%

0,1%

99,2

%

0,4%

0,2%

0,2%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Boa Aceitável Má Inexistente

Radio Network CoverageUMTS

MEO NOS Vodafone

70,9

%

15,5

%

9,5%

4,1%

74,3

%

10,7

%

5,9% 9,1%

74,1

%

9,6%

7,7%

8,6%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Boa Aceitável Má Inexistente

Radio Network CoverageLTE

MEO NOS Vodafone

Page 14: Evaluation of Quality of Service - ANACOM

14 QoS-Mobile Networks and Services | GSM-UMTS-LTE

Figure 1). Along main roads, LTE Radio Network Coverage is reported at significantly lower levels, and

extensive geographic areas were found to have poor or non-existent coverage (

100,

0%

0,0%

0,0%

0,0%

100,

0%

0,0%

0,0%

0,0%

100,

0%

0,0%

0,0%

0,0%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Boa Aceitável Má Inexistente

Radio Network CoverageGSM

MEO NOS Vodafone

99,7

%

0,2%

0,0%

0,0%

99,7

%

0,3%

0,0%

0,0%

100,

0%

0,0%

0,0%

0,0%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Boa Aceitável Má Inexistente

Radio Network CoverageUMTS

MEO NOS Vodafone

97,9

%

1,7%

0,3%

0,1%

97,9

%

1,7%

0,3%

0,1%

94,0

%

2,1%

1,4%

2,4%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Boa Aceitável Má Inexistente

Radio Network CoverageLTE

MEO NOS Vodafone

99,8

%

0,1%

0,0%

0,0%

99,9

%

0,1%

0,0%

0,0%

99,8

%

0,2%

0,0%

0,0%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Boa Aceitável Má Inexistente

Radio Network CoverageGSM

MEO NOS Vodafone

Page 15: Evaluation of Quality of Service - ANACOM

Evaluation of Voice Services, Data Services and Radio Network Coverage | Mainland Portugal | 30 Sept. - 3 Dec. 2014 15

Figure 2 and Section Error! Reference source not found.). Along these main roads, the best

levels of Good network coverage were recorded for NOS and Vodafone with 74.3% and 74.1%

respectively for the measurements taken at that level. However, adding areas with good levels of

coverage and acceptable levels of coverage, the best performance is reported for MEO and NOS, with

86.4% and 85.0%, respectively, while Vodafone is reported at 83.7%.

Figure 1 – Indicator: Radio Network Coverage in the Urban Centres of Mainland Portugal.

98,6

%

1,2%

0,2%

0,0%

96,5

%

2,7%

0,7%

0,1%

99,2

%

0,4%

0,2%

0,2%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Boa Aceitável Má Inexistente

Radio Network CoverageUMTS

MEO NOS Vodafone

70,9

%

15,5

%

9,5%

4,1%

74,3

%

10,7

%

5,9% 9,1%

74,1

%

9,6%

7,7%

8,6%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Boa Aceitável Má Inexistente

Radio Network CoverageLTE

MEO NOS Vodafone

100,

0%

0,0%

0,0%

0,0%

100,

0%

0,0%

0,0%

0,0%

100,

0%

0,0%

0,0%

0,0%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Boa Aceitável Má Inexistente

Radio Network CoverageGSM

MEO NOS Vodafone

99,7

%

0,2%

0,0%

0,0%

99,7

%

0,3%

0,0%

0,0%

100,

0%

0,0%

0,0%

0,0%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Boa Aceitável Má Inexistente

Radio Network CoverageUMTS

MEO NOS Vodafone

97,9

%

1,7%

0,3%

0,1%

97,9

%

1,7%

0,3%

0,1%

94,0

%

2,1%

1,4%

2,4%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Boa Aceitável Má Inexistente

Radio Network CoverageLTE

MEO NOS Vodafone

Page 16: Evaluation of Quality of Service - ANACOM

16 QoS-Mobile Networks and Services | GSM-UMTS-LTE

Figure 2 - Indicator: Radio Network Coverage along the Main Roads of Mainland Portugal.

Voice Service

Good results are reported for the voice service for all analyzed indicators, without significant differences

in performance between operators. The performance of the service is generally better (although the

difference is not significant) in urban centre than along main roads (

99,8

%

0,1%

0,0%

0,0%

99,9

%

0,1%

0,0%

0,0%

99,8

%

0,2%

0,0%

0,0%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Boa Aceitável Má Inexistente

Radio Network CoverageGSM

MEO NOS Vodafone

98,6

%

1,2%

0,2%

0,0%

96,5

%

2,7%

0,7%

0,1%

99,2

%

0,4%

0,2%

0,2%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Boa Aceitável Má Inexistente

Radio Network CoverageUMTS

MEO NOS Vodafone

70,9

%

15,5

%

9,5%

4,1%

74,3

%

10,7

%

5,9% 9,1%

74,1

%

9,6%

7,7%

8,6%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Boa Aceitável Má Inexistente

Radio Network CoverageLTE

MEO NOS Vodafone

99,7% 98,9%99,0% 99,1%99,2% 99,7%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Acessibilidade do Serviço Taxa de Terminação de Chamadas

Voice ServiceMobilegFixed

MEO NOS Vodafone

98,9% 99,3%99,0% 98,7%98,6% 99,2%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Acessibilidade do Serviço Taxa de Terminação de Chamadas

Voice ServiceFixedgMobile

MEO NOS Vodafone

Page 17: Evaluation of Quality of Service - ANACOM

Evaluation of Voice Services, Data Services and Radio Network Coverage | Mainland Portugal | 30 Sept. - 3 Dec. 2014 17

Figure 3,

Figure 4,

98,6% 98,9%97,6% 98,5%98,2% 98,2%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Acessibilidade do Serviço Taxa de Terminação de Chamadas

Voice ServiceMobilegFixed

MEO NOS Vodafone

97,8% 99,3%98,6% 98,9%98,4% 99,0%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Acessibilidade do Serviço Taxa de Terminação de Chamadas

Voice ServiceFixedgMobile

MEO NOS Vodafone

4,0

11,7

2,3

4,4

19,5

3,33,8

9,9

2,9

0

2

4

6

8

10

12

14

16

18

20

Médio Máximo Mínimo

Call Establishment Time MobilegFixed

MEO NOS Vodafone

[s]

Page 18: Evaluation of Quality of Service - ANACOM

18 QoS-Mobile Networks and Services | GSM-UMTS-LTE

Figure 5,

7,0

18,1

5,5

7,1

19,2

5,5

7,0

17,7

5,6

0

2

4

6

8

10

12

14

16

18

20

Médio Máximo Mínimo

Call Establishment Time FixedgMobile

MEO NOS Vodafone

[s]

4,0

12,1

2,9

4,4

11,4

3,13,

8

9,0

3,0

0

2

4

6

8

10

12

14

16

18

20

Médio Máximo Mínimo

Call Establishment Time MobilegFixed

MEO NOS Vodafone

[s]

7,2

16,2

5,4

7,1

18,7

5,5

7,1

17,2

5,6

0

2

4

6

8

10

12

14

16

18

20

Médio Máximo Mínimo

Call Establishment Time FixedgMobile

MEO NOS Vodafone

[s]

Page 19: Evaluation of Quality of Service - ANACOM

Evaluation of Voice Services, Data Services and Radio Network Coverage | Mainland Portugal | 30 Sept. - 3 Dec. 2014 19

Figure 6,

Figure 7 and

3,82 4,

00

1,00

3,79 3,

98

1,03

3,86 4,

00

1,04

0,0

0,5

1,0

1,5

2,0

2,5

3,0

3,5

4,0

4,5

5,0

Média Máxima Mínima

Voice Call Audio QualityMobilegFixed

MEO NOS Vodafone

[MOS]

3,93 4,

18

1,00

3,94 4,

19

1,04

4,02 4,

18

1,00

0,0

0,5

1,0

1,5

2,0

2,5

3,0

3,5

4,0

4,5

5,0

Média Máxima Mínima

Voice Call Audio QualityFixedgMobile

MEO NOS Vodafone

[MOS]

3,81 3,

99

2,97

3,74 4,

00

2,06

3,83 4,

01

1,00

0,0

0,5

1,0

1,5

2,0

2,5

3,0

3,5

4,0

4,5

5,0

Média Máxima Mínima

Voice Call Audio QualityMobilegFixed

MEO NOS Vodafone

[MOS]

Page 20: Evaluation of Quality of Service - ANACOM

20 QoS-Mobile Networks and Services | GSM-UMTS-LTE

Figure 8).

Figure 3 – Indicators: Accessibility of Service and Call Termination Rate in the Urban Centres of Mainland Portugal.

3,97 4,

17

2,72

3,89 4,

20

2,09

4,01 4,

18

1,00

0,0

0,5

1,0

1,5

2,0

2,5

3,0

3,5

4,0

4,5

5,0

Média Máxima Mínima

Voice Call Audio QualityFixedgMobile

MEO NOS Vodafone

[MOS]

99,7% 98,9%99,0% 99,1%99,2% 99,7%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Acessibilidade do Serviço Taxa de Terminação de Chamadas

Voice ServiceMobilegFixed

MEO NOS Vodafone

98,9% 99,3%99,0% 98,7%98,6% 99,2%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Acessibilidade do Serviço Taxa de Terminação de Chamadas

Voice ServiceFixedgMobile

MEO NOS Vodafone

Page 21: Evaluation of Quality of Service - ANACOM

Evaluation of Voice Services, Data Services and Radio Network Coverage | Mainland Portugal | 30 Sept. - 3 Dec. 2014 21

Figure 4 – Indicators: Accessibility of Service and Call Termination Rate along the Main Roads of Mainland Portugal.

Figure 5 – Indicator: Call Establishment Time in the Urban Centres of Mainland Portugal.

98,6% 98,9%97,6% 98,5%98,2% 98,2%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Acessibilidade do Serviço Taxa de Terminação de Chamadas

Voice ServiceMobilegFixed

MEO NOS Vodafone

97,8% 99,3%98,6% 98,9%98,4% 99,0%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Acessibilidade do Serviço Taxa de Terminação de Chamadas

Voice ServiceFixedgMobile

MEO NOS Vodafone

4,0

11,7

2,3

4,4

19,5

3,33,8

9,9

2,9

0

2

4

6

8

10

12

14

16

18

20

Médio Máximo Mínimo

Call Establishment Time MobilegFixed

MEO NOS Vodafone

[s]

7,0

18,1

5,5

7,1

19,2

5,5

7,0

17,7

5,6

0

2

4

6

8

10

12

14

16

18

20

Médio Máximo Mínimo

Call Establishment Time FixedgMobile

MEO NOS Vodafone

[s]

Page 22: Evaluation of Quality of Service - ANACOM

22 QoS-Mobile Networks and Services | GSM-UMTS-LTE

Figure 6 - Indicator: Call Establishment Time along the Main Roads of Mainland Portugal.

Figure 7 – Indicator. Call Audio Quality in the Urban Centres of Mainland Portugal.

4,0

12,1

2,9

4,4

11,4

3,13,

8

9,0

3,0

0

2

4

6

8

10

12

14

16

18

20

Médio Máximo Mínimo

Call Establishment Time MobilegFixed

MEO NOS Vodafone

[s]

7,2

16,2

5,4

7,1

18,7

5,5

7,1

17,2

5,6

0

2

4

6

8

10

12

14

16

18

20

Médio Máximo Mínimo

Call Establishment Time FixedgMobile

MEO NOS Vodafone

[s]

3,82 4,

00

1,00

3,79 3,

98

1,03

3,86 4,

00

1,04

0,0

0,5

1,0

1,5

2,0

2,5

3,0

3,5

4,0

4,5

5,0

Média Máxima Mínima

Voice Call Audio QualityMobilegFixed

MEO NOS Vodafone

[MOS]

3,93 4,

18

1,00

3,94 4,

19

1,04

4,02 4,

18

1,00

0,0

0,5

1,0

1,5

2,0

2,5

3,0

3,5

4,0

4,5

5,0

Média Máxima Mínima

Voice Call Audio QualityFixedgMobile

MEO NOS Vodafone

[MOS]

Page 23: Evaluation of Quality of Service - ANACOM

Evaluation of Voice Services, Data Services and Radio Network Coverage | Mainland Portugal | 30 Sept. - 3 Dec. 2014 23

Figure 8 – Indicator. Call Audio Quality along the Main Roads of Mainland Portugal.

File Transfer Service (FTP)

The performance of the File Transfer Service (FTP) varies according to the type of location analyzed,

and is significantly better in urban centres than along main roads, for all operators.

In urban centres, good levels were reported in terms of File Transfer Session Termination Rate (

3,81 3,

99

2,97

3,74 4,

00

2,06

3,83 4,

01

1,00

0,0

0,5

1,0

1,5

2,0

2,5

3,0

3,5

4,0

4,5

5,0

Média Máxima Mínima

Voice Call Audio QualityMobilegFixed

MEO NOS Vodafone

[MOS]

3,97 4,

17

2,72

3,89 4,

20

2,09

4,01 4,

18

1,00

0,0

0,5

1,0

1,5

2,0

2,5

3,0

3,5

4,0

4,5

5,0

Média Máxima Mínima

Voice Call Audio QualityFixedgMobile

MEO NOS Vodafone

[MOS]

99,4% 99,3%97,1% 97,0%97,4% 97,2%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

download upload

Data Session Termination RateFile Transfer (FTP)

MEO NOS Vodafone

Page 24: Evaluation of Quality of Service - ANACOM

24 QoS-Mobile Networks and Services | GSM-UMTS-LTE

Figure 9). MEO records the best performance, with 99.4% for downloads and 99.3% for uploads, in terms

of sessions successfully established and allowing the transfer of files during the pre-defined period. The

levels of performance provided by Vodafone and NOS in terms of this indicator are very close:

Vodafone reports rates of 97.4% and 97.2% respectively for downloads and uploads, while NOS reports

rates of 97.1% and 97.0% respectively for downloads and uploads.

Figure 9 – Indicator: Data Session Termination Rate in the Urban Centres of Mainland Portugal.

Figure 10 – Indicator. Data Session Termination Rate along the Main Roads of Mainland Portugal.

93,6% 93,3%90,2% 89,6%91,3% 90,7%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

download upload

Data Session Termination RateFile Transfer (FTP)

MEO NOS Vodafone

99,4% 99,3%97,1% 97,0%97,4% 97,2%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

download upload

Data Session Termination RateFile Transfer (FTP)

MEO NOS Vodafone

93,6% 93,3%90,2% 89,6%91,3% 90,7%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

download upload

Data Session Termination RateFile Transfer (FTP)

MEO NOS Vodafone

Page 25: Evaluation of Quality of Service - ANACOM

Evaluation of Voice Services, Data Services and Radio Network Coverage | Mainland Portugal | 30 Sept. - 3 Dec. 2014 25

In the same locations, good levels of performance are observed in terms of Average Data Transfer

Speeds for both downloads and uploads (

Figure 11). MEO reports the best average speeds, with 27,387 kbps (download) and 6,705 kbps

(upload). For the same indicator, the levels of performance reported for NOS and Vodafone are very

close: NOS provides average data transfer speeds of 22,710 kbps (download) and 5,791 kbps (upload),

while Vodafone reports 22,493 kbps (download) and 5,813 kbps (upload).

Along main roads, the performance of the operators is significantly lower than as observed in urban

centres, although still acceptable. MEO provides the best File Transfer Session Termination Rates

(Figure 10), reporting 93.6% (download) and 93.3% (upload) success in establishing and maintaining

File Transfer Sessions. Vodafone reports success rates of 91.3% (download) and 90.7% (upload) for

this indicator, while NOS reports 90.2% (download) and 89.6% (upload).

Likewise, along main roads, but as regards Average Data Transfer Speed (

27.3

87

58.6

13

104

22.7

10

56.1

68

168

22.4

93

47.8

05

19

0

10.000

20.000

30.000

40.000

50.000

60.000

70.000

Média Máxima Mínima

Data Transfer Speed File download (FTP)

MEO NOS Vodafone

[kbps]

6.70

5

11.0

50

21

5.79

1

8.88

6

65

5.81

3

8.73

4

55

0

10.000

20.000

30.000

40.000

50.000

60.000

70.000

Média Máxima Mínima

Data Transfer Speed File upload (FTP)

MEO NOS Vodafone

[kbps]

Page 26: Evaluation of Quality of Service - ANACOM

26 QoS-Mobile Networks and Services | GSM-UMTS-LTE

Figure 12), the best performance for downloads was observed for MEO, with average data transfer

speeds of 13,986 kbps, followed by Vodafone with 13,143 kbps, and finally NOS, with 10,981 kbps. In

terms of file uploads, Vodafone reports the best performance, with an average data transfer rate of

4,314 kbps, followed by MEO with 4,084 kbps and NOS with 3,771 kbps.

Figure 11 – Indicator: Data Transfer Speed in the Urban Centres of Mainland Portugal.

13.9

86

52.5

79

161

10.9

81

52.0

34

5

13.1

43

44.6

59

18

0

10.000

20.000

30.000

40.000

50.000

60.000

70.000

Média Máxima Mínima

Data Transfer Speed File download (FTP)

MEO NOS Vodafone

[kbps]

4.08

4 11.0

62

18

3.77

1

16.3

84

18

4.31

4

8.77

0

18

0

10.000

20.000

30.000

40.000

50.000

60.000

70.000

Média Máxima Mínima

Data Transfer Speed File upload (FTP)

MEO NOS Vodafone

[kbps]

27.3

87

58.6

13

104

22.7

10

56.1

68

168

22.4

93

47.8

05

19

0

10.000

20.000

30.000

40.000

50.000

60.000

70.000

Média Máxima Mínima

Data Transfer Speed File download (FTP)

MEO NOS Vodafone

[kbps]

6.70

5

11.0

50

21

5.79

1

8.88

6

65

5.81

3

8.73

4

55

0

10.000

20.000

30.000

40.000

50.000

60.000

70.000

Média Máxima Mínima

Data Transfer Speed File upload (FTP)

MEO NOS Vodafone

[kbps]

Page 27: Evaluation of Quality of Service - ANACOM

Evaluation of Voice Services, Data Services and Radio Network Coverage | Mainland Portugal | 30 Sept. - 3 Dec. 2014 27

Figure 12 – Indicator: Data Transfer Speed along the Main Roads of Mainland Portugal.

Internet navigation (HTTP web browsing)

The performance of mobile communication systems in terms of the Internet navigation service is clearly

better in urban centres (

13.9

86

52.5

79

161

10.9

81

52.0

34

5

13.1

43

44.6

59

18

0

10.000

20.000

30.000

40.000

50.000

60.000

70.000

Média Máxima Mínima

Data Transfer Speed File download (FTP)

MEO NOS Vodafone

[kbps]

4.08

4 11.0

62

18

3.77

1

16.3

84

18

4.31

4

8.77

0

18

0

10.000

20.000

30.000

40.000

50.000

60.000

70.000

Média Máxima Mínima

Data Transfer Speed File upload (FTP)

MEO NOS Vodafone

[kbps]

99,4% 97,1% 97,1%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

MEO NOS Vodafone

Data Session Termination RateInternet Navigation (HTTP web browsing)

Page 28: Evaluation of Quality of Service - ANACOM

28 QoS-Mobile Networks and Services | GSM-UMTS-LTE

Figure 13). In these locations, the capacity of networks to establish and maintain Internet browsing

sessions is good and the reference web page downloads quickly. MEO is the operator with the best

performance, with 99.4% of sessions successfully established and allowing the download of the entire

web page in an average of 2.0 seconds. NOS reports a success rate of 97.1% and 2.7 seconds to

download the web page, while Vodafone reports 97.1% and 3.1 seconds respectively in terms of

Session Termination Rate and Average Web Page Transfer Time.

Figure 13 – Indicators: Data Session Termination Rate and Average Web Page Transfer Time in the Urban Centres of Mainland Portugal.

2,0

56,9

1,22,7

49,5

1,53,

1

57,0

1,2

0

10

20

30

40

50

60

Média Máxima Mínima

Web Page Transfer TimeInternet Navigation (HTTP web browsing)

MEO NOS Vodafone

[s]

99,4% 97,1% 97,1%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

MEO NOS Vodafone

Data Session Termination RateInternet Navigation (HTTP web browsing)

2,0

56,9

1,22,7

49,5

1,53,

1

57,0

1,2

0

10

20

30

40

50

60

Média Máxima Mínima

Web Page Transfer TimeInternet Navigation (HTTP web browsing)

MEO NOS Vodafone

[s]

Page 29: Evaluation of Quality of Service - ANACOM

Evaluation of Voice Services, Data Services and Radio Network Coverage | Mainland Portugal | 30 Sept. - 3 Dec. 2014 29

Figure 14 – Indicators: Data Session Termination Rate and Average Web Page Transfer Time along the Main Roads of Mainland Portugal.

Along the main roads, the performance of the Internet navigation service is acceptable (

Figure 14). The best results were reported for MEO with a 93.6% success rate in the establishment and

maintenance of sessions using the service and 3.8 seconds average duration to download the entire

reference web page. MEO is followed by Vodafone with 91.1% and 4.3 seconds, and finally NOS with

88.9% and 5.1 seconds respectively for the same indicators.

Data Transmission Latency

93,6%88,9% 91,1%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

MEO NOS Vodafone

Data Session Termination RateInternet Navigation (HTTP web browsing

3,8

56,0

1,25,

1

55,2

1,64,

3

56,0

1,9

0

10

20

30

40

50

60

Média Máxima Mínima

Web Page Transfer TimeInternet Navigation (HTTP web browsing)

MEO NOS Vodafone

[s]

93,6%88,9% 91,1%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

MEO NOS Vodafone

Data Session Termination RateInternet Navigation (HTTP web browsing

3,8

56,0

1,25,

1

55,2

1,64,

3

56,0

1,9

0

10

20

30

40

50

60

Média Máxima Mínima

Web Page Transfer TimeInternet Navigation (HTTP web browsing)

MEO NOS Vodafone

[s]

Page 30: Evaluation of Quality of Service - ANACOM

30 QoS-Mobile Networks and Services | GSM-UMTS-LTE

In line with the other data services, the best levels of performance provided by mobile communication

systems in terms of data transmission latency were observed in urban centres (

Figure 15 and

Figure 16).

99,3% 97,1% 97,5%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

MEO NOS Vodafone

Data Session Termination RateLatency (PingRTT / 2)

18

545

1128

357

1730

362

14

0

100

200

300

400

500

600

700

800

Média Máxima Mínima

Latency(PingRTT / 2)

MEO NOS Vodafone

[ms]

93,9%90,3% 91,2%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

MEO NOS Vodafone

Data Session Termination RateLatency (PingRTT / 2)

37

711

11

42

630

18

42

308

21

0

100

200

300

400

500

600

700

800

Média Máxima Mínima

Latency(PingRTT / 2)

MEO NOS Vodafone

[ms]

Page 31: Evaluation of Quality of Service - ANACOM

Evaluation of Voice Services, Data Services and Radio Network Coverage | Mainland Portugal | 30 Sept. - 3 Dec. 2014 31

As regards the Session Termination Rate indicator, MEO provides the best levels of performance, with

success rates of 99.3% and 93.9% respectively for urban centres and main roads. The performance of

Vodafone and NOS is very close in terms of this indicator: Vodafone has rates of 97.5% and 91.2%,

respectively for urban centres and main roads, while NOS recorded rates of 97.1% and 90.3%

respectively for urban centres and main roads.

Figure 15 – Indicators: Data Session Termination Rate and Latency in the Urban Centres of Mainland Portugal.

Figure 16 – Indicators: Data Session Termination Rate and Latency along the Main Roads of Mainland Portugal.

As regards the Latency indicator, MEO reports the best performance with average data transmission

99,3% 97,1% 97,5%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

MEO NOS Vodafone

Data Session Termination RateLatency (PingRTT / 2)

18

545

1128

357

1730

362

14

0

100

200

300

400

500

600

700

800

Média Máxima Mínima

Latency(PingRTT / 2)

MEO NOS Vodafone

[ms]

93,9%90,3% 91,2%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

MEO NOS Vodafone

Data Session Termination RateLatency (PingRTT / 2)

37

711

11

42

630

18

42

308

21

0

100

200

300

400

500

600

700

800

Média Máxima Mínima

Latency(PingRTT / 2)

MEO NOS Vodafone

[ms]

Page 32: Evaluation of Quality of Service - ANACOM

32 QoS-Mobile Networks and Services | GSM-UMTS-LTE

delays of 18 and 37 milliseconds respectively for urban centres and main roads. The performance of

NOS and Vodafone is also very close in terms of this indicator: NOS reported average latency of 28 and

42 milliseconds respectively for urban centres and main roads, while Vodafone reported average

latency of 30 to and 42 milliseconds respectively for urban centres and main roads.