towards “wow!” multimedia quality of experience: if … · towards “wow!” multimedia...

TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE:

IF YOU CAN MEASURE IT, YOU CAN ACHIEVE ITJUDITH REDI

MULTIMEDIA COMPUTING, TU DELFT DISTRIBUTED AND INTERACTIVE SYSTEMS, CWI

WOW! EXPERIENCES

WOW! EXPERIENCES

VIDEO CONSUMPTION

Broadband speedUser Expectations

The amount of time lost from a viewing session due to a 1% buffering increase, has quadrupled in the past 4 years (Conviva 2015)

It would take an individual over 5 million years to watch the amount of video that will cross global IP networks each month in 2020(CISCO white paper 2016)

HDRUHD360!

Hex

abite

spe

r mon

th

QOE CONTROL

Adaptive streaming

Perceptual coding

… Optimization …

Quality Preservation

Postprocessing

QoE-based network MGMT

QOE CONTROL

The quality measurement system should reproduce accurately human QoE appreciation

Adaptive streaming

Perceptual coding

… Optimization …

Quality Measurement Quality Preservation

Postprocessing

QoE-based network MGMT

Lower quality! Q = 0.3!

OBJECTIVE QUALITY MEASUREMENT

Distortion (=blockiness, stalls, freezes…) visibility ~ QoE

Prediction module QoE

CBP Neural Network

Circular Extreme Learning

MachineTCSVT 2010SPIC 2013Neurocomputing 2013

OBJECTIVE QUALITY MEASUREMENT

Distortion (=blockiness, stalls, freezes…) visibility ~ QoE

TCSVT 2010SPIC 2013Neurocomputing 2013

But… is this really measuring QoE?

QoE

QoE is the degree of delight or annoyance of the user of an application or service.It results from the fulfillment of his or her expectations with respect to the utility and / or enjoyment of the application or service in the light of the user’s personality and current state

SO, WHAT IS (WOW) QOE?

QoE is the degree of delight or annoyance of the user of an application or service.It results from the fulfillment of his or her expectations with respect to the utility and / or enjoyment of the application or service in the light of the user’s personality and current state

SO, WHAT IS (WOW) QOE?

Variance explained by user factorsVariance explained by system factorsQoMEX 2016, PQS 2016

ENABLING “WOW!” EXPERIENCES

Providing the right video to the right user at the right time and at the right quality for that user

ENABLING “WOW!” EXPERIENCES

Providing the right video to the right user at the right time and at the right quality for that user

Perception

System Factors

Bitrate, loss, ...

QoE

ENABLING “WOW!” EXPERIENCES

Providing the right video to the right user at the right time and at the right quality for that user

Perception

System Factors

Bitrate, loss, ...

QoE

Context Factors

TaskSocial Context

Economical Cont.

Semantic ContentAffective ContentISM’16

User Factors

PersonalityInterestGender..MM’16

CHB’15

ENABLING “WOW!” EXPERIENCES

Providing the right video to the right user at the right time and at the right quality for that user

Perception

System Factors

Bitrate, loss, ...

QoE

Context Factors

TaskSocial Context

Economical Cont.Interaction

TVX’15

Semantic ContentAffective ContentISM’16

User Factors

PersonalityInterestGender..MM’16

CHB’15

WOW! EMPATHIC EXPERIENCES

8

WOW! EMPATHIC EXPERIENCES

8

WOW! EMPATHIC EXPERIENCES

Can we design MM systems that are so intelligentthat they can detect negative affective states and

and provide empathic experiences to make the user feel better?

8

EMPATHIC MM EXPERIENCES: CHALLENGES

User Sensing and Modeling

Design: MM Alternate Realities

THANK YOU. AND THANKS TO MMC@TUD AND DIS@CWIj.a.redi@tudelft.nl

10