quality virtual, augmented or other realities...vr‐display/light filed displays: we need light...

10
© ETSI 2017. All rights reserved Presented by Hans W. Gierlich, ETSI TC STQ Chair, Head Acoustics GmbH Workshop on Multimedia Quality in Virtual, Augmented or other Realities 1011 May 2017, ETSI, Sophia Antipolis Closing remarks

Upload: others

Post on 05-Sep-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Quality Virtual, Augmented or other Realities...VR‐Display/Light Filed displays: We need Light Field formats that are display focused Tactile: Tactile and Sound are quite comparable

© ETSI 2017. All rights reservedPresented by Hans W. Gierlich, ETSI TC STQ Chair, Head Acoustics GmbH

Workshop on Multimedia Quality in Virtual, Augmented or other Realities10‐11 May 2017, ETSI, Sophia AntipolisClosing remarks

Page 2: Quality Virtual, Augmented or other Realities...VR‐Display/Light Filed displays: We need Light Field formats that are display focused Tactile: Tactile and Sound are quite comparable

© ETSI 2017. All rights reserved

ABE‐technologies: DNN based bandwidth extension is giving a superior performance VR‐Display/Light Filed displays: We need Light Field formats that are display focusedTactile: Tactile and Sound are quite comparable –both based on vibration, frequency range different – tactile multi‐dimensional vibrations – latency requirements are higher for texture tactile

Highlights from the presentations

Page 3: Quality Virtual, Augmented or other Realities...VR‐Display/Light Filed displays: We need Light Field formats that are display focused Tactile: Tactile and Sound are quite comparable

© ETSI 2017. All rights reserved

Parallel task testing – many basic questions concerning scenarios, which task of the scenarios – use of VR for parallel testingGaming: Dimension based modelling of the quality of gaming – again use of VR to increase immersivenessCar Audio: Multi dimensions to be discussed for audio quality – what are these? How important are they under which condition?

Highlights from the presentations

Page 4: Quality Virtual, Augmented or other Realities...VR‐Display/Light Filed displays: We need Light Field formats that are display focused Tactile: Tactile and Sound are quite comparable

© ETSI 2017. All rights reserved

Car – related: ICC performance requirements are different – standardization is required now –different aspects than for other communication systemsABE: New proposal for a test procedure for ABE testing with high correlation to subjective testing

Highlights from the presentations

Page 5: Quality Virtual, Augmented or other Realities...VR‐Display/Light Filed displays: We need Light Field formats that are display focused Tactile: Tactile and Sound are quite comparable

© ETSI 2017. All rights reserved

Loudness: An extensive loudness study based on a variety of  subj. tests confirms the applicability of existing loudness models (e.g. ISO 532‐1, Moore/ Glasberg); good correlation found – Input for Loudness standardization in ITU‐T SG 12Voice Assistant Devices: Another type of “reality” performance testing, task completion should be part of testingAuditory stimuli for VR: Summary of the important features needed to produce a good user experience

Highlights from the presentations

Page 6: Quality Virtual, Augmented or other Realities...VR‐Display/Light Filed displays: We need Light Field formats that are display focused Tactile: Tactile and Sound are quite comparable

© ETSI 2017. All rights reserved

Parallel Task Evaluations: Important topic to evaluate the impact of a realistic environment on the desired performance of a serviceVR‐Displays: Light Field displays seem to be a bit away from being introduced in the market – For evaluation artificial stimuli are used, important: • continuous smooth parallax resolution, • adaptive streaming based on spatial and angular resolution

VR‐Audio: Channel‐, Scene‐ & Object‐based audio are compared ‐ Focus is on Ambisonics

Highlights from the presentations

Page 7: Quality Virtual, Augmented or other Realities...VR‐Display/Light Filed displays: We need Light Field formats that are display focused Tactile: Tactile and Sound are quite comparable

© ETSI 2017. All rights reserved

ITU‐T: In ITU‐T a variety of activities in VR in different study groupsHuman factors: Overview of human factors and mapping requirements for VR/AR systems to human needs:• Visual/vestibular conflicts• VR – sickness• Visual conflicts• ‐> technical impacts

Highlights from the presentations

Page 8: Quality Virtual, Augmented or other Realities...VR‐Display/Light Filed displays: We need Light Field formats that are display focused Tactile: Tactile and Sound are quite comparable

© ETSI 2017. All rights reserved

Taxonomy & performance requirements for xR –systems – discussion of new aspects for QoS & QoE

AV&VR challenges for networks: The network and it’s future design:• Networks need to get less complex• Need of ultra‐low latency in networks• Need of constant high network quality• Servers need to get closer to the end‐users

Highlights from the presentations

Page 9: Quality Virtual, Augmented or other Realities...VR‐Display/Light Filed displays: We need Light Field formats that are display focused Tactile: Tactile and Sound are quite comparable

© ETSI 2017. All rights reserved

We need to identify relevant perceptual dimensions, parameters and performance parameters for xR.The inter‐dependency of the different modes (audio, video, tactile…) need to be understood.We need to provide networks and architectures addressing better requirements: latency, bandwidth and continuous delivery of quality.  We need to extend our work in multimedia more towards IoT applications.

Issues raised

Page 10: Quality Virtual, Augmented or other Realities...VR‐Display/Light Filed displays: We need Light Field formats that are display focused Tactile: Tactile and Sound are quite comparable

© ETSI 2017. All rights reserved

Join STQ – our next meeting:Zagreb, 10‐14 July 2017:

https://portal.etsi.org/webapp/meetingCalendar/MakeChoice.asp?m_id=19073&date=2017%2D07%2D10+14%3A00%3A00

Schedule can be adaptive, contributions and proposals for new work‐items are welcome

Possible way forward