eng. luis enrique conde del oso. etecsa. cuba [email protected]

Havana, Cuba, 8-9 February 2011

Eng. Luis Enrique Conde del Oso.ETECSA. [email protected]

Eng. Luis Enrique Conde del Oso.ETECSA. [email protected]

“Evaluation of the QoE in NGN starting from UIT recommendations.”

“ITU-T Standardization and other key ITU Activities”

Havana, Cuba 8 - 9 February 2011.

NGN

mailto:[email protected]

mailto:[email protected]

Havana, Cuba, 8-9 February 2011 2

• Background.

Current scenarioof Telecom

Carriers

• Obsolescence of TDM Technology.• Requirements for new services and increase of the current services. - Fixed telephone service growth. - Mobile service growth - Wide development of data services. - Introduction of novel services such as IPTV.

Proposal of Development

• Development of Services on NGN networks with NAM (GIE).• Optimization of National Transport Network IP/MPLS.• Designs and implementation of Local and Regional Metro Networks.• Introduction of the objective quality validation of services in real time (and its extension to quality profile of telecommunications network).

Beginning of the scheduled development


• The Metro Ethernet like support of the Broadband.

Source: Telecom Italia – VPDT ETECSA.

Standards defined in the T-MPLS:

G.8110.1 Network Architecture of T-MPLS G.8113 Requirements OAM G.8114 OAM G.8112 UNI/NNI G.8131 Lineal Protection G.8132 Rings Protection G.8121 Equipment T-MPLS G.8151 EMF G.8152 Infomodel

Ring

RingRing

To the Service POP

To the Service POP

To the Service POP


• Pseudo rings of the Provincial Metro Ethernet of Havana. Network simulations in TILAB.


BRAS PE

IP/MPLS

AR BRAS PEAR

METROREGIONAL

Service PoPService PoP

METROPROVINCIAL

ADMADM

ADMADM

ADMADM

Eth/SDH

Source: VPDT. ETECSA.

E1STMnFE

GE

Platform of IPTV

VoDVoD

Punto 1Validación

Punto 2Validación

Punto 3Validación

(Signal encrypted)

(Signal no encrypted)

The Operators of Telecommunications generally use unique network which include the return channel, and they are IP broadband network with solutions FTTH, FTTB and FTTC and last mile Technologies ADSL, ADSL2 +, VDSL, VDSL2 + and GPON. In these network protocols like PIM, IGMP and BGP should be activated.

• Different levels of a NGN Network.


• Quality Profile on networks, according to the following ITU-T Recommendations G.1050, and ITU-T Y.1541.

Source: UIT-T.

DSL Forum's WT-126

•SD. 1 pack./loss every 30 minutes.(MLR=0.004 pack/seg)

•HD 1pack./loss. every 4 hours(MLR=0.0005 pack/seg)

Source: DSL Forum's WT-126

Havana, Cuba, 8-9 February 2011 7Source Asistencia Técnica de Telecom Italia.

• Quality Profile of ToIP, according to the ITU-T Recommendations .

ITU-T G.114 Delay ≤ 300 mseg.(Bidirectional).


• Obtaining of the information for the validation of the quality of the video signal.

A video signal to be transmitted over a IP network should be compressed. The codec MPEG defines a sequence of images I, B and P, which a GOP conforms. In the header of these packets they are fields that possess outstanding information's to be able to make the validation of the quality of the video signal

Source: Shenick.


8 Bytes

• Main fields of the header in Transport Stream.

Source: UIT-T

They group in 3 levels of priority:

Priority 1. Correct decoding. Priority 2. Quality Tx of the IP Package. Priority 3. It Influences in specific applications.


SLA SLA SLA

Perceived Quality (QoE), at service level end to end.

STB influence

Quality dependence of

the Service

Network Quality (QoS), transport packet functionSource: VPDT. ETECSA.

Data Metrics“Same value of PSNR”

• QoE and QoS. Human Vision Constraints.


Metrics(VQM)

SubjectiveMetrics

Implicit comparison (DSCQS). Explicit comparison (DSIS)

Absolute valuations (SSCQE) Valuations with Absolute Category (ACR).Objective

Metrics

Ref. Complete. Ref. Reduced.

Without Reference.

Picture Metrics

Analysis of the Information visual contained. VHS Metric. (Aspects of the Human vision)

Data Metrics

Analysis of Videos Decoded. MSE PSNR (Evaluation of Packages)

Flows of VideoMetrics

T- Factor (Deep Inspection of the flow of the Video (TS and UDP). The impact of the disturbances of the Network depends on the Codec, the losses and its propagation (space and time). MDI (Slight Inspection of the Video flow (TS and UDP). Independent of the Codec IP Network.).

Correlation


• State of the art of validation Metrics for video quality.

BT.500.11 (Images of TV). P.910 (Aplic. of Multimedia), Video Quality. P.911 (Aplic. of Multimedia), Audiovisual Quality.


FreeProbe with T- Factor Metric.

• Development of metrics in FreeProbe Tools. (Software open source).

Source: Telecom Italia - VPDT. ETECSA.

FreeProbe with MDI Metric.

Freeprobe for Codec H.264 AVC.

FreeprobeJPER (ToIP Service)


Here the impact of the transcodificación of the signal was evaluated due to not having the contents the same code format as well as the employment of a Hybrid solution in Havana City and its repercussion starting from the behavior of the error accountants SAE, SDE and SIE in the period of evaluation of the quality and its correlation with the subjective observation of the sign.

This test allowed the evaluation of the potentialities and the weaknesses of the ETECSA access network to support a service of BTV, MPEG-2, and it consisted on the design of a Hybrid Network that simulates the solution used by Orange in its service of IPTV, which allows to increase the covering of a service of BTV in areas where you cannot offer an appropriate band width for this service. It facilitates the determination of Eligible and Not Eligible Users

• Test with the FreeProbe (T-factor), simulation of the solution of Orange.

Source. VPDT. ETECSA.

200 Watts

Elegible Users≤ 500 m @ 4 Mbps

Not Eligible Users 2 Km. @ 512 Kbps


Source VPDT. ETECSA.

The introduction of the metric MDI in the Freeprobe and the necessity of making experimental tests to define the necessary objective-subjective correlation and to determine the respective thresholds in each disturbance type, made necessary the design of a laboratory testing model.

• IPTV Service Testing Model applied at ETECSA test.


• Services implemented in IPTV Platform in Testing Model.



Video Server

NetDisturb


Source: Telecom Italia – VPDT ETECSA.

• Training preparation of the subjective observer.

Delay

Jitte

r

Packe

t Loss

UIT-T J.144R y UIT-R BT.1683.

Muy Molesto Presencia elevada de errores que perjudican el audio y el video

(1)

(2)

(3)

(5)

(4)

MOS DMOS


Results of the Simulations Tests. Uniform packet loss: Superior losses to 0.001% are inadequate for a service of IPTV and they have bigger impact in the audio one that in the video. Packet Loss in Burst: Bigger affectation in the video that in the audio one, however they are less annoying for the user than the uniform losses. Delay and the Jitter: Affectations are not observed in the range between 0 and 50 mseg, what demonstrates the recommendations of the WT-126 of the DSL Forum´s.

• Test results done in the testing model (Channel SD to 4 Mbps)


ServPOP 2

DWDM

ServPOP 4

Serv POP 1

ServPOP 3

Pseudo ringEthernet

Pseudo ringEthernet

Pseudo ringEthernet

Source: Telecom Italia - VPDT. ETECSA.

FreeProbe

FreeProbe Server

Measurement point

Data collect

FreeProbe

IPTV

Head End

FreeProbe

•Centralization of QoE Validation with FreeProbe to substitute solutions with Shadow Router. (Cisco, Tektronix, JDSU, Huawei).

Metric MDI

Metric MDI

Metric T-Factor

SNMPSNMP

SNMP


VLAN

QoS


VLAN 10

VLAN 20

VLAN 30

• Results of the Tests of the Triple Service Play with FreeProbe (MDI).

Results of the tests of a Triple Play service with the use of the FreeProbe with metric MDI in the testing model, with the services BTV (1.5 Mbps MPEG-2), Access to Internet and ToIP (G.729A) on a Network with QoS and without implemented QoS (Network BPL vs Intranet of ETECSA).

QoS

BPL

ETECSA National Intranet

ElectricNetwork


Video Server


1.5 seg

4 Mbps and codification MPG2

Methodology for the measurement of the capacity of memory of temporary storage (Buffer) of the STB AmiNET110.

Capacity of Memory = 6 Mb.

(Without Packets Loss)

HUB

• Methodology for the measurement of the capacity of memory of temporary storage (Buffer) of the STB AmiNET110.


Conclusions.

The design of the IP network of broadband in ETECSA with the implementation of protocols like the PIM, IGMP and BGP among others constitutes the fundamental pillar of the development of the Objective Network of ETECSA, allowing the expansion of the NGN and the possibility of offering novel services like the IPTV. The valuable theoretical and investigative experiences developed for the appropriate correlation of the QoS and the QoE with the employment of the probe FreeProbe, with metric T-factor and MDI, they have allowed ETECSA to have a tool personalized for the validation of the quality of the service of IPTV, which was extended, with the addition of new metric in the Freeprobe that include the validation of the service of ToIP (at the moment in test). The Platform of Services of IPTV developed in ETECSA, jointly with the laboratory testing model that incorporates a IP network emulator was an important aspects that minimized the costs of the investments of the investigative stage were and they allowed to obtain important theoretical and practical results. The proposal of use of the FreeProbe (MDI) to validate the Profile of Quality of the IP Network of ETECSA, it transforms it into an important alternative in front of the expensive acquisition of the Shadow Router dedicated to this only function.


• Windows (GUI) of FreeProbe (T-Factor Metric ) .

SA: Service Availability.SD: Service degradation.SI: Service Impairment.

It is based on the propagation of errors inside the GOP, among images I, P and B during the transport of the same one in the IP network, taking in consideration the behavior of the error accountants SAE, SDE and SIE, in the period of analysis of the quality, having in bill determined preset thresholds and the priority defined in the obtained parameters of the head of the packages.

Fuente Telecom Italia - VPDT. ETECSA.

Delay

Jitter

PacketLoss

Dependent of the codification

Metric with capacity of identification of errors at level of MPEG-2 caused by

losses of packages UDP/RTP.

Metric of macro indicators SA,SD y SI


It is based on the analysis of the behavior of the buffer, “Underflow” or “Overflow” of the same one, that which can cause the freezing of the image or the appearance of defects in the same product of excessive losses of packages, having bigger repercussion if these lost packages contain images of the type I or P.

Fuente Telecom Italia

DF: MLR

Propuesta

It doesn't depend on the codification

DF = [VB(max) – VB(min)] / MR

MLR = (Prospective packages-Received Packages) / interval of time in seconds Delay

Jitter

PacketLoss

A Buffer Virtual minimum 1Mb, requires which adds a retard of 266.67 mseg

(1Mb / 3.75 Mbps)

Metric Media Delivery IndexDF= Delay Factor

MLR= Media Loss Rate

DF:MLR

• Windows (GUI) of FreeProbe (Metric MDI) .


• Original video VS Original video with 1% Packet Loss Rate.

• Original Video. •Video with 1% Packet Loss Rate.


eng. luis enrique conde del oso. etecsa. cuba [email protected]

Documents

video quality

network architecture

audiovisual quality

ip network

unique network

network simulations

network protocols

quality profile of toip