Communicating Quality of Experience data for the development of multimedia services

Peter Brooks, Teolys (F)Bjørn Hestnes, Telenor R&D (N)Svein Heiestad, Telenor R&D (N)Carl Aaby, TANDBERG (N)

•Download•Push•TV Anytime

Non Real-TimeNon Real-Time

• Live streaming• Almost live TV

• VoiceMail• VideoMail• E-Mail• Web surfing

Real-TimeReal-Time

• Multimedia Conf• Videotelephony• Data conferencing• Avatar-telephony• Audio telephony• Real-time text

Real-Time Person-to-Person CommunicationReal-Time Person-to-Person Communication

• Multimedia• Video• Data• Avatar• Audio• Text

Real-Time Person-to-Person CommunicationReal-Time Person-to-Person Communication

• Multimedia• Video• Data• Avatar• Audio• Text

Input-Output devices

End-to-end components

EncodersEncoders

keyboardkeyboard

microphonemicrophone

cameracamera

screenscreen

keyboardkeyboard

microphonemicrophone

cameracamera

screenscreen

RoutersRouters

DecodersDecoders

PANsPANs Wireless Network AccessWireless Network Access

Tunnels, Firewalls, EncryptionTunnels, Firewalls, Encryption

WANsWANs

ISPsISPsProtocols• TCP-IP• UDP-IP

Protocols• TCP-IP• UDP-IP

Input-Output devices

Making informed decisions…• Requirements for QoE data• Making QoE data available within industry

Based on case studies with• Network operators• Equipment manufacturers• Service providers

Requirements for QoE data

• Provide guidelines on key topics

• Provide tutorials

• Link QoS and QoE variables

• Provide QoE data for different guideline

users

• Provide information about user behaviour

that is feasible to apply

Requirements for QoE data

• Provide guidelines on key topics

• Provide tutorials

• Link QoS and QoE variables

• Provide QoE data for different guideline

users

• Provide information about user behaviour

that is feasible to apply

The main topics of concern• User choice– Reliability of service– Duration of call– Cost-benefit

• User appearance– Head / Upper body– Eye contact– Perception of other

• User groups– Business persons– Deaf persons– Blind persons

• Purpose of communication

– Negotiation– Problem solving– Showing surroundings

• Group communication– Multi-point– Window configuration– Human support

• Technical parameters– Delay– Packet loss– Resolution

Requirements for QoE data

• Provide guidelines on key topics

• Provide tutorials

• Link QoS and QoE variables

• Provide QoE data for different guideline

users

• Provide information about user behaviour

that is feasible to apply

Key concepts & lessons

•Packet loss• Jitter•Lip-synchrony / asynchrony•Frame-rate / resolution•Reliability of service•Multi-point social presence•Heterogeneous

transcoding

•User communication modes•User task types• Influence of participant

status•Configurations for blind

persons•Configurations for deaf

persons•Quality of Experience

Requirements for QoE data

• Provide guidelines on key topics

• Provide tutorials

• Link QoS and QoE variables

• Provide QoE data for different guideline

users

• Provide information about user behaviour

that is feasible to apply

Intermediate Guideline Format

IF Communication SituationUSING Service PrescriptionWITH Technical ParametersTHEN Usage Outcome

Requirements for QoE data

• Provide guidelines on key topics

• Provide tutorials

• Link QoS and QoE variables

• Provide QoE data for different guideline

users

• Provide information about user behaviour

that is feasible to apply

Who would use QoE data?

• Strategic network planning• Sales• Marketing• System integration• Network testing• Development engineering• Technical research• HF research

Network operator• Sales• Marketing• Development engineering• Customer support• Technical research• HF research

Equipment manufacturer

• Service creation• Service host• Service operator• Service support • Sales• System integration• Terminal testing

Service provider

Base knowledge

Test result #1 Test result #2 Test result #n

IF ----------USING ----------WITH ---------lTHEN ----------

Guideline #1Guideline #1 Guideline #2Guideline #2GuidelinesGuidelines

IntermediateGuidelines

IntermediateGuidelines

Base Knowledge Units

Base Knowledge Units

IF ----------USING ----------WITH ---------lTHEN ----------

IF ----------USING ----------WITH ---------lTHEN ----------

Guideline #nGuideline #n

Abstracting test results

Requirements for QoE data

• Provide guidelines on key topics

• Provide tutorials

• Link QoS and QoE variables

• Provide QoE data for different guideline

users

• Provide information about user behaviour

that is feasible to apply

Example QoE measure

IF Communication SituationUSING Service PrescriptionWITH Technical Parameters

THEN Usage Outcome

• Prevents adequate communication• Is usable• Offers acceptable quality• Offers good quality• Offers very good quality

Making QoE data available within industry

ETSI Guide

Web-based system

Conclusions• Service developers want end-user data• Much data not available• Tutorial support required• Standardisation bodies well positioned to disseminate

QoE data– ETSI STF284

– http://portal.etsi.org/stfs/hf/STF284.asp

Please visit the web-based system & provide your feedback!

Communicating Quality of Experience data for the development of multimedia services

Peter Brooks, Teolys (F)Bjørn Hestnes, Telenor R&D (N)Svein Heiestad, Telenor R&D (N)Carl Aaby, TANDBERG (N)