quality of experience (qoe) for next generation video network...1. alert video and audio impairments...

Quality Of Experience (QOE) for next generation video network

By Weerapong Tocharoen

TRINERGY INSTRUMENT CO.,LTD.

What are the industry challenges?

Confidential 2

Human operator doing manual visual inspection. Too many channels/programs. Tradition Quality of Service(QOS) Monitoring provide complex metrics. Not focus on Viewer impact issues.


1. measure the frustration/satisfaction level of your TV viewer.

2. Easy to understand score – 0 to 100. 3. The QOE score should derived from:

i. Where the defects? ii. Area size? iii. Frequency?

4. Analyzes not only QOS but also the raw video and audio.

What is Quality of Experience?

3 Copyright © 2004-12 Tektronix, Inc.


What is Quality of Service? Transport Metrics IP, RTP, MPEG Transport Statistics IP Arrival Interval, IP Delay Factor, Partial datagrams and Invalid Packets. PCR Jitter Transport Stream Synchronization loss Sync byte error Continuity count error Transport error PCR error PCR repetition error PCR discontinuity indicator error Etc.


5

Monitor Viewer Reported Errors – Poor QoE

Top Video Error*

Operators

Macroblocking 89.5% Blackout 88.4% Freeze 84.2% Audio Silence 52.6%

Measure of the likelihood that viewer complains, changes channel, churns Viewers do not bother about QOS problems like bitrate, sync byte, Transport error, etc.

Copyright © 2004-12 Tektronix, Inc.


Sentry model

6

-ASI model – 4 ASI ports – 852Mbps(MPEG2) - 500Mbps(MPEG4) -IP model – 1 or 3Gbps(MPEG2) - 500Mbps(MPEG4) - 250 TS inputs -Optical model -T2,S2 model



7

What Sentry do? 1. Alert video and audio impairments that

affect viewer satisfaction.

2.Maintain and improve video quality and

viewer experience.

3.Constant health check on your contents.

4.Reduce un-necessary field technical

support.

5.Automated program availability.

6.Automated reports and charts. TRINERGY INSTRUMENT CO.,LTD.

8

Local Content

Degradation can occur everywhere!

SDI Splice

Encrypt Modulate

MPTS

Encode/ Transcode

Multiplex

SPTS

Content Acquisition

RF

IP

ASI Trans-

mission

VOD Pumps

VOD Ingest

IP/ASI

? ? ? ? ?

Source to Edge

Cable

Satellite

Terrestrial

IPTV

Source Quality Impairments

Encoding / Transcoding / Multiplexing Impairments

Network / Transmission Impairments



9

Local Content

Source to Edge Content Monitoring & Diagnostics

SDI Splice

Encrypt Modulate

IP MPTS

Encode/ Transcode

Multiplex

IP SPTS

Content Acquisition

RF

IP

ASI IP Core

VOD Pumps

VOD Ingest

Incoming VOD Asset QC – Tek Cerify

Monitor for IP&TS Errors –

Sentry-Verify

Monitor multiplex output for Video &

Audio QoE plus problem root cause –

Sentry

Monitor encoding performance for

Video & Audio QoE plus problem root

cause – Sentry

Monitor decoded baseband video –

Tek Waveform Monitors

Validate network element performance – Tek MTS4000 and Sentry RF, IP and

MPEG Monitor and Analysers

Monitor ingested content for Video &

Audio QoE plus problem root cause –

Sentry

IP/ASI

Cable

Satellite

Terrestrial

IPTV


QAM RF Edge– Sentry-EdgeII


10

Simultaneously, All the time, 24x7x365days

Improve and Maintain Service Availability

Round Robin(Non-simultaneous)

Sentry Simultaneous Analysis



Sentry Different Layers of Analysis


QOS


12

PES layer Deep dive analysis



Deeper & wider=accuracy=time/money/space savings

13

Pay attention to technical details: Deep (Sub-Picture layer) content analysis provides more accurate

information than those which only look at the blue shaded area Analyze everything (QOE & QOS) at in real time



14

QoE Reason Codes Reflects what the TV viewer experience

Drop in Confidence

Plain/Simple English Copyright © 2004-12 Tektronix, Inc.


15 15

Monitor Additional Program Details



16 16

Monitor Program Statistics Generate system performance report automatically. save as a template schedule by hourly, daily, week, and monthly

Export the following data across all programs on a Sentry to a CSV file

– Program Availability – Video QoE – Audio QoE – Audio Volume Level – Bit rate – Discontinuities – GOP length – eMOS – Availability – Ad Cue Events – Closed Caption

Benefits: Service Level Agreement deliverables



Now we give you - Program Dashboard!



18 18

Monitor Audio Monitoring

Subscriber perceived audio volume variations (against mean value and Dialnorm)

Reflects what the subscriber actually hears while watching TV - monitor audio level in weighted dB scale

Audio Silence, Levels, True Peak and Loudness ITU BS.1770

Absolute audio level alert

Mean audio level alert

Threshold based alerts on audio level issues



19

Monitor GOP Length Reporting

GOP length statistics (max, min, avg) – Included in Sentry Program Statistics report for compliance validation

(e.g. some STBs may not work appropriately when GOP length exceeds 45)


TS Header TS payload


20

Alert triggered program capture-symptoms viewing



21 21

Seen Video error with no transmission error?

21

No Transmission Error

“Every time Sentry alerts, I know there’s a problem I need to solve now!” – Head of Operations, Large Cable Operator

Packet loss? Discontinuity? Syntax error?



QOE Errors & Impact Content(PayLoad) Related Issue

Reference Blockiness Missing Video Splice Syntax/Structural Errors

Blockiness – Low Bitrate coding and coarse quantization Video Splice – Result due to missing splice in encoding. Syntax Errors – Encoding/Transcoding negative effects

Transmission Related Issue

Jitter Loss

Jitter – Non uniform packets arrival cause errors Loss – Packet loss severely impacts Video



23

Audio & video PID bit rate report

Audio & video QoE report

Audio loudness & Dialnorm report

Discontinuity event report

Transport IP statistics report

Splicing even report

Monitor Time-based troubleshooting



Why need Perceptual Video Quality (eMOS)?

So many Encoders out in the market. Which is good? Each has its own proprietary encoding algorithm methods. Some may use inferior chipset in order to lower costs.

24

How to qualify them?



MPEG2/H.264 PVQ (eMOS) Example

25

Perceptual Video Quality (PVQ) Degradation Due to Compression Artifacts



Benchmark Encoders and Optimize Compression bitrate

26

Highest Bitrate

Lowest Bitrate

Result in Compression Artifacts

Finding the right bitrate/threshold.



Thumbnail Wall

Jan 2013 Sentry Release 8.0


Confidential 28

Customer Satisfaction & Industry Trends TRINERGY INSTRUMENT CO.,LTD.

29 Confidential 29

No more heaps of hard-to-understand error logs



30 Confidential 30

Operations Management Reports & Data Analytics



31 31

Program Availability 1. Measure in terms of percentage. 2. Allow user define period of up to 60 days. 3. Allow user to input start and end time/date.

Benefits and use case:

- Use for SLA, Service Level Agreements measurement parameters.

- Compliance metrics - Trending and tracking purposes - Increase productivity and efficiency.



quality of experience (qoe) for next generation video network...1. alert video and audio impairments...

Documents