1 · web viewshould text be in a new profiling dimension or be put in the graphics dimension, where...
TRANSCRIPT
INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATION
ISO/IEC JTC 1/SC 29/WG 11CODING OF MOVING PICTURES AND AUDIO
ISO/IEC JTC 1/SC 29/WG 11 N5679July 2003
Source Leonardo Chiariglione, Convenor
Title Report of the 65th meetingStatus
Report of the 65th meeting
1 Opening The 65th MPEG meeting was held at Trondheim on 2003/07/21T09:00-25T20:25.
2 Roll call of participantsAnnex 1 gives the attendance list.
3 Approval of agenda Annex 2 gives the approved agenda.
4 Allocation of contributions Annex 3 gives the list of contributions submitted.
5 Communications from ConvenorThe Convenor announced that he had left elecom Italia, his former employer, but that this would not have an impact on his position in MPEG.
6 Report of previous meeting This was approved.
7 Processing of NB Position PapersImput documents were processed and responses provided where appropriate.
1
8 MPEG Phase 1 8.1 Part 1 – Systems8.1.1 Standard
8.1.2 Corrigenda8.2 Part 2 – Video 8.2.1 Standard
8.2.2 Corrigenda8.3 Part 3 – Audio8.3.1 Standard
8.3.2 Corrigenda8.4 Part 4 – Conformance8.4.1 Standard 8.5 Part 5 – Reference software8.5.1 Standard
9 MPEG Phase 2 9.1 Requirements 9.2 Part 1 – Systems 9.2.1 Standard
9.2.2 Amendments The following documents were approved
N5770 DoC on ISO/IEC 13818-1:2000/FPDAM3N5771 Text of ISO/IEC 13818-1:2000/FDAM3N5867 Text of ISO/IEC 13818-1:2000/AM1+COR1
9.2.3 Corrigenda9.3 Part 2 – Video9.3.1 Standard
9.3.2 Amendments
9.3.3 Corrigenda9.4 Part 3 – Audio9.4.1 Standard 9.5 Part 4 – Conformance 9.5.1 Standard The following document was approved
5797
Second draft of ISO/IEC 13818-4 Second Edition
2
9.5.2 AmendmentsThe following documents were approved
5799
Request for ISO/IEC 13818-4:2004/AMD1 (IPMP Conformance Extensions)
5798
Text of ISO/IEC 13818-4:2004/PDAM1 (IPMP Conformance)
5805
WD 2.0 of ISO/IEC 13818-4:2004/AMD2 (Audio Conformance)
9.5.3 Corrigenda9.6 Part 5 – Reference software 9.6.1 Standard The following document was approved
5806
Draft of ISO/IEC TR 13818-5 Second Edition
9.6.2 AmendmentThe following documents were approved
5808
Request for ISO/IEC 13818-5:2004/AMD1 (IPMP Reference Software Extensions)
5807
Text of ISO/IEC 13818-5:2004/DAM1 (IPMP Reference Software Extensions)
9.6.3 Corrigenda9.7 Part 6 – DSM-CC9.7.1 Standard
9.7.2 Amendment
9.7.3 Corrigenda9.8 Part 7 – Advanced Audio Coding9.8.1 Standard The following document was approved
5708 Proposed ISO/IEC 13818-7:2004 (AAC 3rd
edition)
9.8.2 AmendmentThe following documents were approved
5709 DoC on ISO/IEC 13818-7:2001/FPDAM 15710 Text of ISO/IEC 13818-7: 2001/FDAM 1 (Embedding of Bandwidth
Extension)
3
9.8.3 Corrigenda9.9 Part 9 – System extension RTI9.9.1 Standard 9.10 Part 10 – Conformance extension - DSM-CC9.10.1 Standard 9.11 Part 11 – IPMP on MPEG-2 Systems9.11.1 Standard 9.12 Workplan This was approved (N5801)
10 MPEG Phase 4 10.1 Requirements The following documents were approved
5865 MPEG-4 Profiles under Consideration
5860 MPEG-4 Requirements Document
10.2 Part 1 – Systems 10.2.1 Standard
10.2.2 Amendments The following document was approved
N5772 Study Text of ISO/IEC 14496-1:2001/FPDAM7
10.2.3 Corrigenda 10.3 Part 2 – Visual 10.3.1 Standard The following document was approved
5691
MPEG-4 Visual: List of Problems Reported version 9.0
10.3.2 AmendmentsThe following documents were approved
5689
Disposition of Comments on 14496-2:2001/FPDAM 4
5690
Text of ISO/IEC 14496-2:2003/FDAM1 Visual Error Resilient Simple Scalable Profile
4
10.4 Part 3 – Audio 10.4.1 Standard The following document was approved
5711 Proposed ISO/IEC 14496-3:2003 (Audio 3rd
edition)
10.4.2 AmendmentsThe following documents were approved
5713 Text of ISO/IEC 14496-3:2001/FPDAM 2 (Parametric Audio)5714 Study on ISO/IEC 14496-3:2001/FPDAM 2 (Parametric Audio)5716 Request for new amendment to ISO/IEC 14496-35717 Text of ISO/IEC 14496-3:2001/PDAM 3 (MP3onMP4)5718 WD of ISO/IEC 14496-3:2001 /AMD 4 (Audio Lossless Coding -
ALS)5721 Call for Proposals on Lossless Coding of 1-bit Audio Signals
10.4.3 Corrigenda The following document was approved
5712 Proposed ISO/IEC 14496-3:200X/Cor to N5711
10.5 Part 4 – Conformance Testing 10.5.1 Standard
10.5.2 AmendmentsThe following documents were approved
5810
DoC on ISO/IEC 14496-4:2002/FPDAM3
5809
Text of ISO/IEC 14496-4:2002/FDAM3 (Visual New Level and Tools)
5812
DoC on ISO/IEC 14496-4:2002/PDAM4
5811
Text of ISO/IEC 14496-4:2002/FPDAM4 (IPMP Conformance Extensions)
5813
Text of ISO/IEC 14496-4:2002/FPDAM5 (Error Resilience Scalable Profile Conformance)
5815
Request for ISO/IEC 14496-4:2002/AMD6 (AVC Conformance)
5814
Text of ISO/IEC 14496-4:2002/PDAM6 (AVC Conformance)
5764
Study of DoC on ISO/IEC 14496-4:2004/PDAM7 (AFX Conformance)
5763
Study of ISO/IEC 14496-4:2004/PDAM7 (AFX Conformance)
5895
Request for ISO/IEC 14496-4:2002/AMD4 (IPMP Conformance Extensions)
5
5896
Request for ISO/IEC 14496-4:2002/AMD7 (AFX Conformance Extensions)
10.5.3 Corrigenda 10.6 Part 5 – Reference software 10.6.1 Standard
10.6.2 Amendments The following documents were approved
5819
DoC on ISO/IEC 14496-5 :2002/PDAM4
5818
Text of ISO/IEC 14496-5:2002/FPDAM4 (IPMP Extension Ref Soft)
5820
Text of ISO/IEC 14496-5:2003/FPDAM5 (Error Resilience Scalable Profile Reference Software)
5822
Request for ISO/IEC 14496-5:2004/AMD6 (AVC Ref Soft)
5821
Text of ISO/IEC 14496-5:2004/PDAM6 (AVC Ref Soft)
5762
Study of ISO/IEC 14496-5:2004/PDAM7 (AFX Reference Software)
5897 Request for ISO/IEC 14496-5:2002/AMD4 (IPMP Reference Software Extensions)5898 Request for ISO/IEC 14496-5:2002/AMD7 (AFX Reference Software Extensions)
10.7 Part 6 – DMIF 10.7.1 Standard 10.8 Part 7 – Optimised software 10.8.1 Technical Report
10.8.2 Amendment10.9 Part 8 – 4 on IP Framework 10.9.1 Standard 10.10 Part 9 – Hardware Reference Description 10.10.1 Technical Report The following documents were approved
N6586 DoC of ISO/IEC DTR 14496-9 Information technology coding of audio visual Objects - Part 9: Reference hardware description
N6585 Text of ISO/IEC TR 14496-9 Information Technology – Coding of Audio Visual Objects - Part 9: Reference Hardware Description
10.10.2 AmendmentThe following document was approved
N6587 Working Draft of Amendment 1 to TR 14496-9 Information Technology – Coding of Audio Visual Objects - Part 9: Reference Hardware Description
6
10.11 Part 10 – Advanced Video Coding 10.11.1 Standard The following document was approved
5826 AVC Video Verification Test Plan Version 2.0
10.11.2 AmendmentThe following documents were approved
5692
Request for ISO/IEC 14496-10 Amd.1
5693
Text of ISO/IEC 14496-10 PDAM1 AVC Professional Extensions
10.12 Part 11 – Scene Description and Application Engine 10.12.1 Standard
10.12.2 AmendmentsThe following documents were approved
N5773 DoC on ISO/IEC 14496-11/PDAM2N5774 Text of ISO/IEC
14496-11/FPDAM2N5775 Text of ISO/IEC 14496-11/DCOR1N5776 RER for OpenType SpecificationN5777 WD 2.0 of ISO/IEC 14496-11/Amd.3
10.13 Part 12 – ISO Base Media File Format10.13.1 Standard The following document was approved
N5778 WD 2.0 ISO/IEC 14496-12/Amd.1
10.14 Part 13 – IPMP Extensions 10.14.1 Standard 10.15 Part 14 – MP4 File Format 10.15.1 Standard 10.16 Part 15 – AVC File Format 10.16.1 Standard The following documents were approved
N5779 DoC on ISO/IEC 14496-15/FCD
N5780 Text of ISO/IEC
7
14496-15/FDIS
10.17 Part 16 Animation Framework eXtension (AFX)10.17.1 Standard
10.17.2 AmendmentThe following documents were approved
5765 Request for ISO/IEC 14496-16/AMD1
5759 ISO/IEC 14496-16/AMD1 WD 1.0
10.18 Streaming Text Format10.18.1 Standard The following documents were approved
N5781 Request for new part of ISO/IEC N5782 Text of ISO/IEC 14496-17/CD Streaming text
format
10.19 Workplan This was approved (N5801)
11 MPEG Phase 7 11.1 Requirements The following document was approved
5869 MPEG-7 Profiles under Consideration
11.2 Systems 11.2.1 Standard
11.2.2 AmendmentThe following documents were approved
N5784 DoC on ISO/IEC 15938-1/PDAM1N5785 Text of ISO/IEC
15938-1/FPDAM1
11.2.3 Corrigenda The following document was approved
N5783 Text of ISO/IEC 15938-1/DCOR1
8
11.3 Description Definition Language 11.3.1 Standard 11.4 Visual 11.4.1 Standard
11.4.2 AmendmentThe following documents were approved
5694
Disposition of Comments on 15938-3 PDAM 1
5695
Text of ISO/IEC 15938-3 FPDAM 1 Visual Extensions
11.4.3 CorrigendaThe following document was approved
5696
Text of ISO/IEC 15938-3 DCOR1
11.5 Audio 11.5.1 Standard
11.5.2 AmendmentsThe following documents were approved
5726
DoC on ISO/IEC 15938-4/FPDAM 1
5727
Text of ISO/IEC 15938-4/FDAM 1
11.6 Description Schemes 11.6.1 Standard
11.6.2 AmendmentThe following documents were approved
5816 ISO/IEC 15938-5 AMD/1 FDAM - MDS Extensions
5817 MPEG-7 MDS Extensions II Working Draft
9
11.7 Reference software 11.7.1 Standard
11.7.2 Amendment11.8 Conformance Testing 11.8.1 Standard
11.8.2 AmendmentThe following document was approved
5834 ISO/IEC 15938-7 PDAM/1 - MPEG-7 Conformance Extensions
11.9 Extraction and use of visual descriptors 11.9.1 Technical Report
11.9.2 AmendmentsThe following documents were approved
5698
Request for ISO/IEC TR 15938-8 AMD 1 Extensions of Extraction and Use of MPEG-7 Descriptions
5699
WD 1.0 of Extensions of Extraction and Use of MPEG-7 Descriptions
11.10 Profiles11.10.1 StandardThe following document was approved
5870 Text of Working Draft for ISO/IEC 15938-9 MPEG-7 Profiles
11.11 Workplan This was approved (N5801)
12 MPEG phase 21 12.1 Requirements The following document was approved
5873 MPEG-21 Requirements Document
12.2 Part 1 – Vision, Technologies and Strategy 12.3 Part 2 – Digital Item Declaration 12.3.1 Standard
12.3.2 AmendmentsThe following document was approved
5837 ISO/IEC 21000-2 AMD/1 WD – DID Extensions
10
12.4 Part 3 – Digital Item Identification 12.4.1 Standard 12.5 Part 4 – Intellectual Property Management and Protection 12.5.1 Standard 12.6 Part 5 – Rights Expression Language 12.6.1 Standard The following documents were approved
5838 DoC on ISO/IEC 21000-5 FCD – Rights Expression Language5839 ISO/IEC FDIS 21000-5 - Rights Expression Language
12.7 Part 6 – Rights Data Dictionary 12.7.1 Standard The following documents were approved
5841 DoC on ISO/IEC 21000-6 FCD – Rights Data Dictionary
5842 ISO/IEC FDIS 21000-6 - Rights Data Dictionary
12.8 Part 7 – Digital ItemAdaptation 12.8.1 Standard The following documents were approved
5844 DoC on ISO/IEC 21000-7 CD – Digital Item Adaptation5845 Text of ISO/IEC 21000-7 FCD - Digital Item
Adaptation
12.9 Part 8 – Reference software 12.9.1 Standard The following policy was agreed1. Requirements on Reference Software for individual parts of the MPEG-21 Standard:
a) The Reference Software shall exercise/represent all the normative features in the Standard
b) It shall be Source Codec) It shall be possible to build an application on top of itd) The code should be reasonably efficient, however thre are no requirements for
optimisation e) Just like the Text parts of the standard, Reference Software can have normative and
informative parts. The normative parts of the Reference Software correspond to the normative parts of
the Text. The informative parts of the Reference Software complement the normative parts to
provide meaningful use of the SW There is no requirement on the informative parts of text and SW to correspond.
11
f) The subgroup that develops an individual part of MPEG recommends what constitutes an acceptable implementation of that part in Reference SW.
g) Code for different elements within a single part shall share a common code base or a common set of interfaces
2. Requirements on Integration of the different parts: It is MPEG’s goal to achieve integration between the reference SW parts for the different parts of MPEG-21, in order to be able to use these together in an application. Therefore:a) Code for different parts in MPEG-21 shall share a common code base or a common set
of interfaces, b) It shall be possible to compile and run the Reference Software on a single platformc) Until the reference software matures, integration of reference SW elements for the
different parts of MPEG-21 will be handled on a case by case basis.d) The MPEG-21 Architecture, when sufficiently mature, will be used to define guidelines
for the interfaces, including interfaces to applications built on top of the reference SWe) The Reference SW may include informative code that sits between the normative
elements corresponding to the different parts of MPEG-2112.10 Part 9 – File format12.10.1 Standard The following document was approved
N5789 WD 3.0 of ISO/IEC 21000-9
12.11 Part 10 – Digital Item Processing12.11.1 Standard The following documents were approved
5854 Procedure for Accepting DIBOs in MPEG-21 DIP
5855 MPEG-21 Digital Item Processing WD v.2
12.12 Part 11 – Persistent Association12.12.1 Technical report The following document was approved
5875 Text of ISO/IEC 21000-11 WD 3.0 Evaluation Tools for Persistent Association
12.13 Test Bed for MPEG-21 Resource Delivery12.13.1 Standard 12.14 Other MPEG-21 parts 12.14.1 Event reporting12.15 Workplan This was approved (N5801)
13 Overall WG11 workplanThis was approved (N5801)
12
14 Explorations 14.1 Scalable Video Coding The following documents were approved
5880 Scalable Video Coding Requirements 5701 Report on Call for Evidence on Scalable Video Coding
Technology5702 Draft Call for Proposals for Scalable Video Coding
14.2 3D AV coding The following documents were approved
5877 Applications and Requirements for 3DAV
5878 Report on 3DAV Exploration5879 3DAV Call for Comments
14.3 Test material 14.4 VocabularyThe following document was approved
5892 MPEG Vocabulary 0.01
15 Liaison matters The following liaison statements were received
9664 Liaison Statement from DVB 9665 Liaison Statement from ITU-R SG 6/WP 6M 9677 Liaison Statement from ITU-R SG 6/WP 6Q 9718 Liaison Statement from ITU-T SG 16 on Development of ITU-T Metadata
Recommendations 9719 Liaison Statement from ITU-T SG 16 on ISO/IEC 13818-1:2000/Amd.1/Cor.1 9720 Liaison Statement from ITU-T SG 16 on ITU-T Q9/16 Embedded Audio Coding Work 9666 Liaison Statement from ITU-T SG 9 on MPEG 3DAV 9667 Liaison Statement from ITU-T SG 9 on Timed Text in MPEG-4 and the Brand Name Issue
of the File Format9726 Liaison Statement from the Content Reference Forum (CRF)9675 Liaison Statement from the Open Mobile Alliance (OMA)9663 Liaison Statement from TV-Anytime Forum9671 Liaison Statement from TV-Anytime Forum
And the following output documents produced
N5735 Liaison Statement to the Content Reference Forum (CRF)N5737 Liaison Statement to EDItEURN5738 Liaison Statement to OMAN5739 Liaison Statement to ITU-T SG 16 on ITU-T Q9/16
13
N5740 Liaison Statement to ITU-T SG 16 on metadata recommendationsN5741 Liaison Statement to DVB on AVCN5742 Liaison Statement to 3GPP TSG SA WG4 on AVCN5743 Liaison Statement to 3GPP TSG SA WG4 on MPEG-4 Visual ProfilesN5744 Liaison Statement to TV-Anytime ForumN5745 Liaison Statement to SC36 WG4N5746 Liaison Statement to ITU-T SG9N5747 Liaison Statement to OeBFN5748 Liaison Statement to IEEE LTSCN5749 Liaison Statement to 3D consortiumN5750 Liaison Statement to 3GPP TSG SA WG4 on Meta-Data in ISO Media Files, Streaming
Text, Advanced Text and Graphics AmendmentN5751 Liaison Statement to ITU-R SG 6/WP 6MN5752 Liaison Statement to ITU-T SG 9 on MPEG 3DAVN5753 Liaison Statement to the ETSI HF Committee on Auditory and Visual Impairment tools
and MPEG-21 Digital Item AdaptationN5754 Liaison Statement to ISO TC 46 SC 9N5755 Liaison Statement to DVB on AVC professional levelN5756 List of Organisations with which MPEG entertains liaisonsN5757 Responses to National Body CommentsN5828 Liaison Statement to the Radio Frequency Hearing Impaired Committee on Auditory and
Visual Impairment tools and MPEG-21 Digital Item AdaptationN5829 Liaison Statement to ITU-T SG16 on Auditory and Visual Impairment tools and MPEG-
21 Digital Item AdaptationN5830 Liaison Statement to W3C WAI on Auditory and Visual Impairment tools and MPEG-21
Digital Item AdaptationN5831 Liaison Statement to OeBF on Auditory and Visual Impairment tools and MPEG-21
Digital Item AdaptationN5832 Liaison Statement to the Daisy Consortium on Auditory and Visual Impairment tools and
MPEG-21 Digital Item Adaptation
16 Administrative matters 16.1 Schedule of future MPEG meetings The following meeting schedule was approved
Meeting City Country
Yr.
Mo.
Days
66th Brisbane, QLD AU 03 10 20-2467th Waikaloa, HI US 03 12 08-1268th München DE 04 03 15-1969th Seattle US 04 07 19-2370th ? ES 04 10 18-2271st Hong Kong CN 05 01 17-2172nd ? KR 05 04 11-1573rd Poznán PL 05 07 25-29
16.2 Promotional activities The FAQ was updated.
14
17 Organisation of this meeting 17.1 Tasks for subgroups Tasks were assigned.17.2 Joint meetings The following joint meetings were held
Group 1
Group 2 What Where Day Time
Vid Sys AVC FF & MP2 Sys Mon 17:00-18:00Digital Media Project Plen Mon 18:00-18:30MPEGIF Plen Mon 20:00-Req MDS REL&RDD++ Req Tue 09:00-11:00Vid Tst AVC VT Tst Tue 09:00-11:00Req MDS, Sys, Int Ref SW Req Tue 11:00-12:00Req Vid, Aud, MDS,
SysMP7 Prof Req Tue 14:00-16:00
Req Vid MP4, SVC, 3DAV Req Tue 16:00-18:00MDS Int REL SW MDS Tue 17:00-18:00Req MDS, Sys MP21 general Req Wed 11:00-13:00Vid Sys AVC AU++ Vid Wed 11:00-12:00Aud Sys, Vid MP4 FF Aud Wed 14:00-15:00Vid Tst SVC CfE Vid Wed 14:00-16:00Req MDS, Int Ref SW Req Wed 14:00-14:30Aud Sys BIFS Aud Wed 15:00-16:00MDS Int DIA SW MDS Wed 15:00-16:00MDS Aud Audio DIA MDS Wed 16:00-16:30Vid SNH 3DAV Vid Wed 16:00-18:00Req Sys, MDS M3W and API Req Wed 17:00-18:00Req Sys, SNH MP4 several Req Thu 09:00-10:30Aud Sys BiM Aud Thu 09:00-10:00Vid Tst AVC VT Tst Thu 09:00-10:00Vid MDS Video-MDS I/F MDS Thu 09:30-10:00Vid Req PA Vid Thu 10:00-10:30Req Vid AVC PE Req Thu 10:30-11:00Aud Int Audio contrib to
confAud Thu 11:00-11:30
Vid Req 3D AV and SVC Req Thu 11:00-11:30Req MDS MP7 profiles Req Thu 11:30-12:00Contribution to Digital Media Project Req Thu 18:00-19:00
17.3 Planning of future activities The following ad hoc groups were established
5768 Ad Hoc Group on AFX Conformance5766 Ad Hoc Group on AFX documents editing and Core Experiments5769 Ad Hoc Group on AFX Profile5767 Ad Hoc Group on AFX SW Implementation5791 Ad Hoc Group on Cluster Animation and Morphing5794 Ad Hoc Group on IM1
15
5793 Ad Hoc Group on MPEG-4 Scene Representation5792 Ad Hoc Group on MPEG-7 Systems5758 AFX CE description
5761 AFX FAQ 11.05760 AFX VM 11.05893 AHG for MPEG-21 Architecture5706 AHG on 3DAV Coding5884 AHG on 3DAV Coding5827 AHG on AVC Verification Tests5862 AHG on Core Experiments for MPEG-21 Digital Item Adaptation5864 AHG on Editing MPEG-21 DID and DIP Working Drafts5860 AHG on Editing MPEG-21 Digital Item Adaptation FCD & AM5857 AHG on Editing of the MPEG-21 Rights Expression Language FDIS5705 AHG on Editing Visual FPDAM1, DCOR1 and WD for 15538-8 DAM15861 AHG on Integration of DIA with REL and RDD5703 AHG on Maintenance of MPEG-4 Visual Text, Reference Software and Conformance5796 AHG on MP4 Extensions5888 AHG on MPEG Vocabulary5731 AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software5729 AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP45889 AHG on MPEG-21 DIA Reference Software5881 AHG on MPEG-21 Event Reporting5883 AHG on MPEG-21 Profiles5859 AHG on MPEG-21 RDD Editing5858 AHG on MPEG-21 REL and RDD Reference Software5730 AHG on MPEG-4 Audio Conformance5732 AHG on MPEG-4 Audio Extensions 1 and 25733 AHG on MPEG-4 Audio Lossless Coding5688 AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 25734 AHG on MPEG-7 Audio5890 AHG on MPEG-7 Interoperability and Profiling5887 AHG on Multimedia Middleware (M3W)5804 AHG on Multimedia Test Bed5894 AHG on Music Notation Requirements5885 AHG on Persistent Association5886 AHG on Profiles and Extensions for the MPEG-21 REL5707 AHG on Scalable Video Coding5882 AHG on study of MPEG-21 and broadcasting5795 AHG on the Carriage of MPEG-4 Content5863 AHG on Updating DIA Descriptions5704 AHG on Visual Descriptors and Visual-only Description Schemes in MPEG-7
18 Resolutions of this meeting These were approved19 A.O.B There was no other business20 Closing The meeting ended at 2003/07/25T20:25 with thanks to the hosting organisation.
16
17
Annex 1Attendance list
1. Becker, Axel CISRA AU2. Burnett, Ian University of Wollongong AU3. Drury, Gerrard University of Wollongong AU4. Powley, Brett University of Wollongong AU5. Timmerer, Chirstian University Klagenfurt AT6. Kofler-Vogt, Andrea University of Klagenfurt AT7. De Neve, Wesley Ghent University BE8. Van de Walle, Rik Ghent University BE9. Bormans, Jan IMEC BE10. Delfosse, Eric IMEC BE11. Devillers, Sylvain IMEC BE12. Rogge, Boris Metanous BE13. Andreopoulos, Yannis Vrije Universiteit Brussel BE14. Salomie, Alexandru Vrije Universiteit Brussel BE15. Luccisano, Alex Scientific Atlanta Canada CA16. Mignot, Alain SGDL Systems Inc. CA17. Zhao, Haiwu Central Research Academy of SVA Group CN18. Gao, Wen Institute of Computing Technology CN19. Tung, Yi-Shin National Taiwan University CN20. Feng, Bo Tsinghua University CN21. He, Yun Tsinghua University CN22. Xu, Jianfeng Tsinghua University CN23. Yang, Shiqiang Tsinghua University CN24. Lugmayr, Artur DMI/TTY FI25. Karczewicz, Marta Nokia FI26. Väänänen, Mauri Nokia FI27. Wang, Ye-Kui Nokia FI28. BAPTISTE, Eric CISAC FR29. NUTTALL, Francois-Xavier CISAC FR30. Dufourd, Jean-Claude ENST FR31. Seyrat, Claude Expway FR32. Curet, Dominique France Telecom FR33. GIOIA, Patrick France Telecom R & D FR34. Avaro, Olivier France Telecom R&D FR35. Benjelloun Touimi, Abdellatif France Telecom R&D FR36. Cotarmanach, Alexandre France Telecom R&D FR37. DAGUET, Christophe France Telecom R&D FR38. Philippe, Pierrick France Telecom R&D FR39. RAULT, Jean-Bernard France Telecom R&D FR40. VIRETTE, David FRANCE TELECOM R&D FR41. Cammas, Nathalie FTR&D - IRISA FR42. GUILLEMOT, Christine INRIA FR43. Preteux, Francoise INT FR44. Barthelemy, Jerome IRCAM FR45. Dulong de Rosnay, Melanie Medialive FR46. VUCHER GUEZ, Marc SCPP FR47. marquant, gwenaelle Thomson FR48. vieron, jerome thomson FR49. Schuster, Brigitte Tigress FR50. Kummer-Hardt, Thomas CH-TV Media GmbH DE51. Dietz, Martin Coding Technologies GmbH DE52. Purnhagen, Heiko Coding Technologies GmbH DE53. Feiten, Bernhard Deutsche Telekom, T-Systems, Berkom DE54. Herpel, Carsten Deutsche Thomson-Brandt GmbH DE55. Schmidt, Jürgen Deutsche Thomson-Brandt GmbH DE
18
56. Spille, Jens Deutsche Thomson-Brandt GmbH DE57. Brandenburg, Karlheinz Fraunhofer AEMT DE58. Geiger, Ralf Fraunhofer AEMT DE59. Rohden, Jan Fraunhofer AEMT DE60. Schuller, Gerald Fraunhofer AEMT DE61. Smolic, Aljoscha Fraunhofer HHI DE62. Baum, Oliver Fraunhofer IIS DE63. Fuchs, Harald Fraunhofer IIS DE64. Herre, Juergen Fraunhofer IIS DE65. Sperschneider, Ralph Fraunhofer IIS DE66. Thoma, Herbert Fraunhofer IIS DE67. Grill, Bernhard Fraunhofer Institute for Integratd Circuits DE68. Neubauer, Christian Fraunhofer Institute IIS DE69. Rümmler, Kathrin Heinrich-Hertz-Institut DE70. Stoll, Gerhard Institut für Rundfunktechnik DE71. Ahrenberg, Lukas Max-Planck Institut fuer Informatik DE72. Piesk, Jens Media Arts College DE73. Oelbaum, Tobias Munich University of Technology DE74. Benzler, Ulrich Robert Bosch GmbH DE75. Ohm, Jens-Rainer RWTH Aachen DE76. Hanke, Konstantin RWTH Aachen University DE77. Amon, Peter Siemens AG DE78. Hutter, Andreas Siemens AG DE79. Taddei, Herve Siemens AG DE80. Liebchen, Tilman Technical University of Berlin DE81. Moreau, Nicolas Technical University of Berlin DE82. Graffunder, Andreas T-Systems DE83. Martinez-Ibanez, Jose M TUM DE84. Man, Ahchihuo Quix Technologies IL85. Lifshitz, Zvi Triton R&D Ltd. IL86. Spiegel, Ehud Vimatix Inc. IL87. Chiariglione, Leonardo CEDEO IT88. Nesi, Paolo DSI, University of Florence, MUSICNETWORK IT89. Baroncini, Vittorio Fondazione Ugo Bordoni IT90. Leonardi, Riccardo University of Brescia IT91. Schultz, Craig Access Ticket JP92. Aizu, Masao Canon Inc. JP93. Sasaki, Mikio DENSO CORPORATION JP94. Kitamura, Masatsugu For more convenient AV life JP95. Kazui, Kimihiko Fujitsu Laboratories Ltd. JP96. Murakami, Tomokazu Hitachi Central Research Labolatory JP97. Yokoyama, Toru Hitachi, Ltd. JP98. Ogura, Yukiko IPSJ/ITSCJ JP99. Sugihara, Yoshinori JEITA JP100. Habe, Hitoshi Kyoto University JP101. Katsura, Yosuke Kyoto University JP102. Senoh, Takanori Matsushita JP103. Tanaka, Naoya Matsushita Electric JP104. Emura, Koichi Matsushita Electric Industrial Co., Ltd. JP105. Okada, Yuji Matsushita Electric Industrial Co., Ltd. JP106. Toma, Tadamasa Matsushita Electric Industrial Co., Ltd. JP107. Ueno, Takafumi Matsushita Electric Industrial Co., Ltd. JP108. Neergaard, Mika Melodies & Memories Global JP109. Kinoshita, Nobuyuki Melodies & Memories Global Limited. JP110. Yoshioka, Makoto Melodies & Memories Global Limited. JP111. Asai, Kohtaro Mitsubishi Electric Corporation JP112. Murakami, Tokumichi Mitsubishi Electric Corporation JP113. Nishikawa, Hirofumi Mitsubishi Electric Corporation JP114. Fujii, Toshiaki Nagoya University JP
19
115. Tanimoto, Masayuki Nagoya University JP116. Yamazawa, Kazumasa Nara Institute of Science and Technology JP117. Kimoto, Takahiro NEC JP118. Nomura, Toshiyuki NEC JP119. Yamada, Akio NEC JP120. GOSHI, SEIICHI NHK JP121. Sano, Masanori NHK JP122. Kimata, Hideaki NTT JP123. Moriya, Takehiro NTT JP124. Kitaura, Ryuji SHARP Corporation JP125. Watanabe, Shuichi Sharp Corporation JP126. SUZUKI, Teruhiko Sony Corp. JP127. Toguri, Yasuhiro sony corporation JP128. Yasuda, Hiroshi The University of Tokyo JP129. KAMBAYASHI, Toru Toshiba JP130. Kaneko, Toshimitsu Toshiba JP131. Kikuchi, Yoshihiro Toshiba JP132. Kogure, Takuyo University of Tokyo JP133. Koike, Mayumi University of Tokyo JP134. Azami, Tomohiro Victor Company of Japan, Limited (JVC) JP135. Kaneko, Itaru Waseda Unic JP136. Inoue, Daisuke Waseda University JP137. Watanabe, Hiroshi Waseda University JP138. Won, Chee Sun Dongguk University KR139. Seo, Jeong-Il Electronics and Telecommunication Research Institute KR140. Seok, Jongwon Electronics and Telecommunication Research Institute KR141. Cho, Yongju ETRI KR142. Jeong, Senator ETRI KR143. Kim, Jae-Gon ETRI KR144. Kim, Kyuheon ETRI KR145. Kim, Wook Joong ETRI KR146. Min, Okgee ETRI KR147. NAM, JEHO ETRI KR148. Oh, Weon Geun ETRI KR149. Park, Soo Jun ETRI KR150. IL DONG, YUN Hankuk Univ. of F. S. KR151. Euee S., Jang Hanyang University KR152. Kim, Whoi-Yul Hanyang University KR153. Park, Seong Joon ICU KR154. Yong Man, Ro ICU KR155. Truong Cong, Thang Information and Communication University KR156. Kim, Munchurl Information and Communications University KR157. Kim, Han Kyun Interjungbo., Co. LTD KR158. Lee, Chung Young Interjungbo., Co. LTD KR159. Kim, Man Bae Kangwon National Univ. KR160. Sohn, Hyun Sik Kangwon National Univ. KR161. Kim, Hyoung Joong Kangwon National University KR162. Kim, Jong-Nam KBS KR163. Park, Keunsoo KBS KR164. Suh, Doug KHU KR165. Oh, Seoung-Jun KwangWoon University KR166. Park, Gwang-Hoon Kyung Hee University KR167. Kim, Chul-Woo Mcube Works Inc KR168. Kim, Yong-Goo Multimedia R&D Lab., onTimetek Inc. KR169. LIM, Young-Kwon net&tv Inc. KR170. Kim, Yongyoun Net@TV KR171. Kim, Sang Wook Samsung KR172. Kim, Sang-Kyun Samsung A.I.T. KR173. LEE, WonSook Samsung Advanced Institute of Technology KR
20
174. Park, In Kyu Samsung Advanced Institute of Technology KR175. Han, Mahnjin Samsung AIT KR176. Huh, Youngsik Samsung AIT KR177. Hwang, Wonjun Samsung AIT KR178. Kim, Do Kyoon Samsung AIT KR179. Kim, Hyun Mun Samsung AIT KR180. Kim, Woo-Shik Samsung AIT KR181. Oh, Eunmi Samsung AIT KR182. Han, Woo-Jin Samsung Electronics KR183. Lee, Yung Gi Sejong Univeristy KR184. Jin, Kwang Bum Sejong University KR185. Kim, Hae Kwang Sejong University KR186. Lee, Nam Yeol Sejong University KR187. Lee, Yung Lyul Sejong University KR188. Kim, Duck Hoon Seoul National University KR189. Ji, Kyunghee SIT KR190. Moon, Nammee SIT KR191. Jeon, Byeungwoo SKKU KR192. Choi, Woong Il Sungkyunkwan University KR193. Kim, Yong Han University of Seoul KR194. Mulder, Peter Digiframe / NOB NL195. Klein Middelink, Marc Philips NL196. van der Meer, Jan Philips NL197. Oomen, Werner Philips Digital Systems Labs. Eindhoven NL198. van der Schaar, Mihaela Philips Reseach NL199. Barbieri, Mauro Philips Research NL200. van den Heuvel, S.A.F.A. Philips Research NL201. Oostveen, Job Philips Research Eindhoven NL202. Gelissen, Jean H. A. Philips Research Labs NL203. de Bruijn, Frederik J. Royal Philips Electronics NL204. Tokmakoff, Andrew Telematica Instituut NL205. Holthe, Ole-Ivar GRIDMEDIA AS NO206. Fossbakk, Eyvind Norwegian Broadcasting Corporation NO207. Lie, Arne NTNU NO208. Perkis, Andrew NTNU NO209. Zhang, Jijun NTNU NO210. Johansen, Stian NTNU - Q2S NO211. Hillestad, Odd Inge Q2S, NTNU NO212. Bjøntegaard, Gisle Tandberg NO213. Klungsøyr, Gunn Kristin Telenor NO214. Pedersen, Lena Telenor R&D NO215. Domanski, Marek Poznan University of Technology PL216. Pereira, Fernando Instituto Superior Técnico PT217. Navarro, Antonio Instituto Telecomunicações PT218. Lin, Xiao Institute for Infocomm Research SG219. Rahardja, Susanto Institute for Infocomm Research SG220. Yu, Rongshan Institute for Infocomm Research SG221. Tan, Thiow Keng M-Sphere Consulting Pte. Ltd. SG222. Chong, Kok Seng Panasonic Singapore Laboratories Ptd Ltd SG223. Huang, Zhongyang Panasonic Singapore Laboratories Ptd Ltd SG224. Lee, Men Huang Panasonic Singapore Laboratories Pte Ltd SG225. Lim, Chong Soon Panasonic Singapore Laboratories Pte Ltd SG226. Ji, Ming Panasonic Singapore Laborotaries Pte Ltd SG227. Liu, Jing Panasonic Singapore Laborotaries Pte Ltd SG228. Shen, Shengmei Panasonic Singapore Labs SG229. Gauvin, Marc sDae ES230. Villegas, Paulo TELEFONICA I+D ES231. Delgado, Jaime Universitat Pompeu Fabra ES232. Rodríguez Luna, Eva Universitat Pompeu Fabra ES
21
233. Kjoerling, Kristofer Coding Technologies AB SE234. Fröjdh, Per Ericsson SE235. Alberti, Claudio EPFL CH236. Ebrahimi, Touradj EPFL CH237. Mattavelli, Marco EPFL CH238. ZOIA, Giorgio EPFL CH239. Wuermlin, Stephan ETH Zurich CH240. Di Giacomo, Thomas MIRALab, University of Geneva CH241. Joslin, Chris MIRALab, University of Geneva CH242. Reichel, Julien VisioWave CH243. Ziliani, Francesco VisioWave S.A. CH244. VEXO, Frederic VRlab-EPFL CH245. Watt, Simon ARM Ltd UK246. Stride, Jean BSI UK247. Rowe, Simon Canon Research Centre Europe UK248. Chiariglione, Filippo CRL UK249. Kudumakis, Panos CRL UK250. Green, Brian EDITEUR UK251. Gooch, Richard IFPI Secretariat UK252. Jessop, Paul IFPI Secretariat UK253. Harrower, Andy MCPS-PRS Alliance Ltd UK254. Bober, Miroslaw Mitsubishi Electric ITE-VIL UK255. Cieplinski, Leszek Mitsubishi Electric ITE-VIL UK256. Teh, Jonathan Motorola Ltd. UK257. Millar, Keith NDS Ltd UK258. Grant, Kate Nine Tiles UK259. Harwood, Don Oxford Semiconductor Ltd UK260. Barlas, Christopher Rightscom Limited UK261. Rump, Niels Rightscom Limited UK262. Rust, Godfrey Rightscom Limited UK263. Wragg, Barney Universal Music eLabs UK264. Levantovsky, Vladimir Agfa Monotype Corp. US265. Singer, David Apple Computer US266. Quackenbush, Schuyler Audio Research Labs US267. Melby, Alan BYU US268. Woods, John Center for Next Generation Video US269. wu, fang Cisco System US270. Wang, Feng Chi Conexant Systems, Inc. US271. Gandee, Bradford ContentGuard US272. Wang, Xin ContentGuard, Inc US273. DeMartini, Thomas ContentGuard, Inc. US274. Tsai, Chun-Jen Dept. of CSIE, National Chiao Tung University US275. McMahon, Thomas DGFX, Inc. US276. Powell, Gerald A. DoCoMo Communications Laboratories USA Inc. US277. Gish, Walter Dolby Laboratories US278. Husak, Walt Dolby Laboratories US279. Vinton, Mark Dolby Laboratories US280. Fischer, Andrew Dolby Laboratories (Via Licensing) US281. Fellers, Matt Dolby Laboratories Inc. US282. Mukherjee, Debargha Hewlett Packard Laboratories US283. Garrido, Ramon Hewlett-Packard US284. Liu, Sam Hewlett-Packard US285. Swaminathan, Kumar Hughes Electronics Company US286. Hurtado, Marco IBM Corporation US287. Kim, Michelle IBM Corporation US288. Schirling, Peter IBM Research US289. Smith, John R. IBM T. J. Watson Research Center US290. Mitchell, Stephen InterTrust US291. Koenen, Rob InterTrust Technologies Corp US
22
292. Chao, T.H. Steve ITRI, Inc. US293. Chen, Chien-Fa ITRI, Inc. US294. Wu, Guo-Zua ITRI, Inc. US295. Johnston, James Microsoft US296. Nalebuff, MJ Microsoft US297. Tescher, Andrew Microsoft US298. Paramasivam, M Microsoft Coroporation US299. Nelson, Paul Microsoft Corporation US300. Sullivan, Gary Microsoft Corporation US301. Bourges-Sevenier, Mikael Mindego Inc. US302. Chiang, Tihao Mitsubishi US303. Vetro, Anthony Mitsubishi Electric US304. Sun, Huifang Mitsubishi Electric Research Labs US305. Gandhi, Bhavan Motorola US306. Narasimhan, Mandayam Motorola US307. Russell, Chris MPAA US308. Fenimore, Charles National Institute of Standards and Technology (NIST) US309. Hang, Hsueh-Ming NCTU US310. Chang, Wo NIST US311. Rubinfeld, Myron (Mike) NIST, US Dept of Commerce US312. Chau, Kwok NJR Corporation US313. Raveendran, Viji QUALCOMM Incorporated US314. Reznik, Yuriy RealNetworks, Inc US315. Block, Bruce Recording Industry Association of America US316. Grearson, Paul D Sand Video, Inc. US317. Visharam, Mohammed Sony Electronics Inc. US318. Fernando, Gerard Sun Microsystems Inc US319. Gomila, Cristina Thomson Inc US320. Turney, Robert Xilinx Research Labs US
23
Annex 2Agenda
1 Opening 2 Roll call of participants 3 Approval of agenda 4 Allocation of contributions 5 Communications from Convenor 6 Report of previous meeting 7 Processing of NB Position Papers 8 MPEG Phase 1 8.1 Part 1 – Systems8.1.1 Standard 8.1.2 Corrigenda8.2 Part 2 – Video 8.2.1 Standard 8.2.2 Corrigenda8.3 Part 3 – Audio8.3.1 Standard 8.3.2 Corrigenda8.4 Part 4 – Conformance8.4.1 Standard 8.5 Part 5 – Reference software8.5.1 Standard 9 MPEG Phase 2 9.1 Requirements 9.2 Part 1 – Systems 9.2.1 Standard 9.2.2 Amendments 9.2.3 Corrigenda9.3 Part 2 – Video9.3.1 Standard 9.3.2 Amendments 9.3.3 Corrigenda9.4 Part 3 – Audio9.4.1 Standard 9.5 Part 4 – Conformance 9.5.1 Standard 9.5.2 Amendments9.5.3 Corrigenda9.6 Part 5 – Reference software 9.6.1 Standard 9.6.2 Amendment9.6.3 Corrigenda9.7 Part 6 – DSM-CC9.7.1 Standard 9.7.2 Amendment9.7.3 Corrigenda9.8 Part 7 – Advanced Audio Coding9.8.1 Standard 9.8.2 Amendment
24
9.8.3 Corrigenda9.9 Part 9 – System extension RTI9.9.1 Standard 9.10 Part 10 – Conformance extension - DSM-CC9.10.1 Standard 9.11 Part 11 – IPMP on MPEG-2 Systems9.11.1 Standard 9.12 Workplan 10 MPEG Phase 4 10.1 Requirements 10.2 Part 1 – Systems 10.2.1 Standard 10.2.2 Amendments 10.2.3 Corrigenda 10.3 Part 2 – Visual 10.3.1 Standard 10.3.2 Amendments10.4 Part 3 – Audio 10.4.1 Standard 10.4.2 Amendments10.5 Part 4 – Conformance Testing 10.5.1 Standard 10.5.2 Amendments10.5.3 Corrigenda 10.6 Part 5 – Reference software 10.6.1 Standard 10.6.2 Amendments 10.7 Part 6 – DMIF 10.7.1 Standard 10.8 Part 7 – Optimised software 10.8.1 Technical Report 10.8.2 Amendment10.9 Part 8 – 4 on IP Framework 10.9.1 Standard 10.10 Part 9 – Hardware Reference Description 10.10.1 Technical Report 10.10.2 Amendment10.11 Part 10 – Advanced Video Coding 10.11.1 Standard 10.11.2 Amendment10.12 Part 11 – Scene Description and Application Engine 10.12.1 Standard 10.12.2 Amendments10.13 Part 12 – ISO Base Media File Format10.13.1 Standard 10.14 Part 13 – IPMP Extensions 10.14.1 Standard 10.15 Part 14 – MP4 File Format 10.15.1 Standard 10.16 Part 15 – AVC File Format 10.16.1 Standard
25
10.17 Part 16 Animation Framework eXtension (AFX)10.17.1 Standard 10.17.2 Amendment10.18 Streaming Text Format10.18.1 Standard 10.19 Workplan 11 MPEG Phase 7 11.1 Requirements 11.2 Systems 11.2.1 Standard 11.2.2 Amendment11.3 Description Definition Language 11.3.1 Standard 11.4 Visual 11.4.1 Standard 11.4.2 Amendment11.4.3 Corrigenda11.5 Audio 11.5.1 Standard 11.5.2 Amendments11.6 Description Schemes 11.6.1 Standard 11.6.2 Amendment11.7 Reference software 11.7.1 Standard 11.7.2 Amendment11.8 Conformance Testing 11.8.1 Standard 11.8.2 Amendment11.9 Extraction and use of visual descriptors 11.9.1 Technical Report 11.10 Workplan 12 MPEG phase 21 12.1 Requirements 12.2 Part 1 – Vision, Technologies and Strategy 12.3 Part 2 – Digital Item Declaration 12.3.1 Standard 12.4 Part 3 – Digital Item Identification 12.4.1 Standard 12.5 Part 4 – Intellectual Property Management and Protection 12.5.1 Standard 12.6 Part 5 – Rights Expression Language 12.6.1 Standard 12.7 Part 6 – Rights Data Dictionary 12.7.1 Standard 12.8 Part 7 – Digital ItemAdaptation 12.8.1 Standard 12.9 Part 8 – Reference software 12.9.1 Standard 12.10 Part 9 – File format12.10.1 Standard
26
12.11 Part 10 – Digital Item Processing12.11.1 Standard 12.12 Part 11 – Persistent Association12.12.1 Standard 12.13 Test Bed for MPEG-21 Resource Delivery12.13.1 Standard 12.14 Other MPEG-21 parts 12.14.1 Event reporting12.15 Workplan 13 Overall WG11 workplan14 Explorations 14.1 Scalable Video Coding 14.2 3D AV coding 14.3 Test material 15 Liaison matters 16 Administrative matters 16.1 Schedule of future MPEG meetings 16.2 Promotional activities 17 Organisation of this meeting 17.1 Tasks for subgroups 17.2 Joint meetings 17.3 Planning of future activities 18 Resolutions of this meeting 19 A.O.B 20 Closing
27
Annex 3List of documents submitted
Nò. Authors Title
9626 Wo Chang Document Register for SC29/WG11 Meeting Trondheim, Norway
9627 Wo Chang AHG on MPEG-7 Interoperability and Profiling
9628 Barney WraggCraig SchultzRob KoenenIan Burnett
AHG on MPEG-21 Architecture and IPMP Requirements
9629 FX NuttallAndrew Tokmakoff
AHG on MPEG-21 Event Reporting CE
9630 Paul JessopNiels Rump
AHG on Persistent Association
9631 Mike Rubinfeld AHG on Vocabulary
9632 T. ChiangYi-Shin TungChung-Neng Wang
AHG on Editorial Convergence and Maintenance of MPEG-4 Reference Software
9633 Miroslaw BoberSang-Kyun Kim
AHG on Core Experiments for Visual Descriptors and Visual-only Description Schemes in MPEG-7
9634 L. CieplinskiA. Yamada
AHG on Editing MPEG-7 Visual XM and WD
9635 Aljoscha SmolicHideaki Kimata
AHG on 3DAV Coding
9636 Mihaela van der SchaarC.J. Tsai
AHG on Scalable Video Coding
9637 Tobias OelbaumXuemin ChenTK Tan
AHG on AVC Verification Tests
9638 Jens Spille AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4
9639 Ralph Sperschneideron behalf of the AHG on MPEG-4 Audio Conformance
Report of the AHG on MPEG-4 Audio Conformance
9640 M. VaananenH. Purnhagen
AHG on MPEG-4 Audio Text and Software
9641 Schuyler Quackenbush AHG on MPEG-4 Audio Extensions 1 and 2
9642 Schuyler Quackenbush AHG on MPEG-4 Audio Lossless Coding
9643 Jan RohdenSchuyler QuackenbushJoerg Bitzer
AHG on MPEG-7 Audio
9644 Sang-Wook Kim AHG on MPEG-21 Audio DIA
9645 David SingerEric Rehm Peter MulderMasanori Sano
AHG on Metadata Interoperability
28
9646 Barney WraggThomas DeMartini
AHG on Editing the MPEG-21 Rights Expression Language
9647 Brad GandeeBarney Wragg
AHG on Profiles and Extensions of the MPEG-21 Rights Expression Language
9648 Chris BarlasBrad Gandee
AHG on MPEG-21 Publishing Extension
9649 Chris BarlasGodfrey Rust
AHG on RDD Reference Software and Editing
9650 Gerrard DruryDo-Nyun Kim
AHG on Use of DID by other MPEG 21 parts
9651 Anthony VetroAndrew PerkisChristian TimmerEric Delfosse
AHG on Editing MPEG-21 Digital Item Adaptation Study of CD & AM
9652 Jeho NamDebargha Mukherjee
AHG on Core Experiments for MPEG-21 Digital Item Adaptation
9653 Rik Van de WalleIan BurnettMunchurl KimVishy Swaminathan
AHG on Editing MPEG-21 DIP
9654 Robert TurneyMarco Mattavelli
AHG on MPEG-4 Part 9 Reference Hardware Description Phase 1 and 2
9655 Claude SeyratCarsten HerpelAdam LindsayAli Tabatabai
AHG on MPEG-7 Systems
9656 Jean-Claude DufourdYuval Fisher
AHG on MPEG-4 Scene Representation
9657 Zvi Lifshitz AHG on IM1
9658 Young-Kwon LimJan Van der MeerCarsten Herpel
AHG on the Carriage of MPEG-4 Content
9659 Dave Singer AHG on MP4 Extensions
9660 Ralph SperschneiderJens Spille Jean-Claude Dufourdon behalf of the AHG on MPEG Conformance
Report of the AHG on MPEG Conformance
9661 Ian BurnettRik Van de WalleTor Halvorsen
AHG on MPEG-21 Reference Software
9662 Chun-Jen TsaiMihaela van der ShaarYoung-Kwon Lim
AHG on MPEG Multimedia Test Bed
9663 SC 29 Secretariat Liaison Statement from TV-Anytime Forum [SC 29 N 5316]
9664 SC 29 Secretariat Liaison Statement from DVB [SC 29 N 5331]
9665 SC 29 Secretariat Liaison Statement from ITU-R SG 6/WP 6M [SC 29 N 5338]
29
9666 SC 29 Secretariat Liaison Statement from ITU-T SG 9 on MPEG 3DAV [SC 29 N 5345]
9667 SC 29 Secretariat Liaison Statement from ITU-T SG 9 on Timed Text in MPEG-4 and the Brand Name Issue of the File Format [SC 29 N 5346]
9668 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-2:2001/FDAM 3 [SC 29 N 5343]
9669 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:2003/FPDAM 3 [SC 29 N 5357]
9670 SC 29 Secretariat IEC CDV 62360: Baseline Specifications of Satellite and Terrestrial Receivers for ISDB (Integrated Service for Digital Broadcast) [SC 29 N 5358]
9671 SC 29 Secretariat Liaison Statement from TV-Anytime Forum [SC 29 N 5359]
9672 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:2003/PDAM 4 [SC 29 N 5361]
9673 SC 29 Secretariat Summary of Voting on ISO/IEC CD 21000-7 [SC 29 N 5385]
9674 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 15938-6 [SC 29 N 5369]
9675 SC 29 Secretariat Liaison Statement from the Open Mobile Alliance (OMA) [SC 29 N 5371]
9676 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-1/PDAM 1 [SC 29 N 5378]
9677 SC 29 Secretariat Liaison Statement from ITU-R SG 6/WP 6Q [SC 29 N 5379]
9678 Claudio AlbertiAntonio RomeoMarco MattavelliSM ShenCraig A. Schultz
Contribution to MPEG-21 IPMP requirements. IPMP systems provider requirements
9679 A. G. Tescher for USNB USNB Contribution: Usage of dii:Type's in MPEG-21
9680 A. G. Tescher for USNB USNB Contribution: On Development of IPMP in MPEG-21
9681 Chris JoslinThomas Di GiacomoStephane GarcheryTom MoletNadia Magnenat-Thalmann
Swiss NB Comment for Levels of Articulation for Virtual Humans
9682 AUNB AUNB Contribution: Usage of dii:Type's in MPEG-21
9683 Ming JiZY HuangSM ShenJ LiuTaka SenohTakafumi UenoTakuyo Kogure
IPMP Scheme for MPEG-21 IPMP
9684 ZY HuangSM ShenM JiJ LiuTaka SenohTakafumi UenoTakuyo Kogure
MPEG-21 Architecture and IPMP
9685 ZY HuangSM ShenM Ji
Digital Item Method/Operations in DIP for MPEG-21 IPMP
30
J LiuTaka SenohTakafumi UenoTakuyo Kogure
9686 Xin Wang Thomas DeMartini Brad Gandee
Indication of IPMP Governed Digital Items
9687 Xin Wang Thomas DeMartiniBrad Gandee
Comments on IPMP Requirements
9688 Koenen Contributions to MPEG-21 IPMP Requirements Process
9689 MitchellCarey
Contributions to MPEG-21 IPMP Architecture
9690 Chris JoslinThomas Di GiacomoTom MoletMarius PredaFrançoise Preteux
National Body Comment on AFX (Editing)
9691 Chris JoslinThomas Di GiacomoTom Molet
Swiss National Body Comment on AFX (Technical Contribution to BBA)
9692 Niels Rump Paul Jessop
Editors' Input: Evaluation Methods for Persistent Association Tools
9693 Ajay LuthraSam Narasimhan
US Experts’ Comments on the errata reports on JVT-G050 reported in JVT-H010d4
9694 C. Timmereron behalf of the Austrian NB
ANB comment on ISO/IEC CD 21000-7 (Digital Item Adaptation)
9695 Xin WangThomas DeMartiniBrad Gandee
An MPEG-21 IPMP Use Case for Multiple Accesses to Digital Items
9696 Jijun Zhang (NTNU) Andrew Perkis (NTNU)
Error log for MPEG-21 DIA AM schema v5.0
9697 Jean StrideDel DennisFilippo ChiariglioneLeon SucharovPanos Kudumakis
UK NB Comments on ISO/IEC 14496-5/PDAM 4
9698 Itaru KanekoOnsihi Neergaard
MMG MPEG-21 IPMP Use Case / Walkthrough
9699 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-4:2003/FDAM 1 [SC 29 N 5389]
9700 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-4:2003/FDAM 2 [SC 29 N 5390]
9701 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-1:2000/FPDAM 3 [SC 29 N 5392]
9702 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 21000-5 [SC 29 N 5394]
9703 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 21000-6 [SC 29 N 5395]
9704 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:2003/PDAM 5 [SC 29 N 5396]
31
9705 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/PDAM 5 [SC 29 N 5397]
9706 A Schultz IPMP Use cases and Walkthroughs
9707 marius predafrancoise preteux
French National Body Comment on AFX (editing)
9708 Claudio AlbertiAntonio RomeoMarco Mattavelli
Swiss NB comment for backward compatibility of MPEG-21 IPMP with MPEG-2/4 IPMP(X)
9709 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 14496-15 [SC 29 N 5404]
9710 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-1:2000/Amd.1/DCOR 1 [SC 29 N 5405]
9711 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/PDAM 4 [SC 29 N 5406]
9712 A. G. Tescher for USNB USNB Contribution: Project editor addition
9713 A. G. Tescher for USNB USNB Contribution: JVT issues
9714 Artur LugmayrSamuli NiiranenSeppo KalliAndrew PerkisPerttu RautavirtaMikko Oksanen
Digital Broadcast Item Model: Harmonization of Broadcast Metadata
9715 Keith Millar Fast Random Access within BiM Streams
9716 Thomas DeMartini Editors' Input on REL
9717 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-3/PDAM 1 [SC 29 N 5410]
9718 SC 29 Secretariat Liaison Statement from ITU-T SG 16 on Development of ITU-T Metadata Recommendations [SC 29 N 5412]
9719 SC 29 Secretariat Liaison Statement from ITU-T SG 16 on ISO/IEC 13818-1:2000/Amd.1/Cor.1 [SC 29 N 5413]
9720 SC 29 Secretariat Liaison Statement from ITU-T SG 16 on ITU-T Q9/16 Embedded Audio Coding Work [SC 29 N 5414]
9721 Stephan WuermlinEdouard LamborayHanspeter PfisterMarkus Gross
3D Video Fragments as a Data Representation and Streaming Method for EE2 in MPEG 3DAV
9722 Marquant Jerome Vieron Edouard Francois
FNB Comments on Requirements for Scalable Video Coding
9723 Abhijeet GolwelkarIvan BajicJohn Woods
Response to Call for Evidence on Scalable Video Coding
9724 Jan Bormanson behalf of the BNB
Belgian National Body Comment on ISO/IEC 21000-7 CD – Part 7: Digital Item Adaptation document ISO/IEC JTC 1/SC 29/WG 11/N5353
9725 Thomas RusertMathias Wien
AVC Anchor Sequences for Call for Evidence on Scalable Video Coding
9726 SC 29 Secretariat Liaison Statement from the Content Reference Forum (CRF) [SC 29 N 5419]
32
9727 SC 29 Secretariat IEC CD 60728-9/Amd.1 [SC 29 N 5420]
9728 Kristofer KjörlingHeiko PurnhagenDaniel Homm
Proposed working draft for SBR conformance
9729 Ying Sha Yuzhuang Hu
A Linux Implementation of MPEG-21 REL Reference Software
9730 Eunmi OhSangJo LeeMiYoung KimYoungsik HuhSangWook KimBernhard FeitenIngo Wolf
CE report on audio adaptationQoS
9731 Giorgio ZoiaPaolo NesiJerome BarthelemyPierfrancesco BelliniDavid FuschiDavid CrombieFrancesco SpadoniKia NgMartin Schmucker
Proposal for Music Notation Modeling and its integration within MPEG-4 and MPEG-7
9732 Jonathan TehTony May
Contributions to Scalable Video Coding Requirements
9733 C. J. Lee Further SgNB Comment on ISO/IEC CD 21000-7 (MPEG-21 DIA)
9734 C. J. Lee SgNB Comment on MPEG-21 IPMP Requirements
9735 Soo-Jun Park Report of Cross-Verification of VCE-3 (HTD for "Timesequence" data container)
9736 Ralph Sperschneider on behalf of the AHG on MPEG-4 Audio Conformance
Status of MPEG-4 Audio Conformance
9737 Steve MitchellKnox Carey
Updated Contributions to MPEG-21 IPMP Architecture
9738 Rob Koenen Updated Contributions to MPEG-21 IPMP Requirements
9739 Soo-Jun Park Report of the core experiment result of binary representation of visual descriptors (VCE-2)
9740 Nammee MoonKyunghee JiJungsu KimYoungJoo SongJinWoo Hong
Report of CE on Event Reporting Language
9741 C. Timmereron behalf of the CE
Report of CE on AdaptationQoS and BSDLink
9742 Jean-Bernard Rault MPEG4-Audio Extension 2: Core Experiments on Complexity Reduction in Parametric Stereo Decoding
9743 Eva RodriguezJaime Delgado
DMAG REL Tool Implementation
9744 Giorgio Zoia Report of the European project CARROUSO
33
9745 Mariam Kimiaei AsadiJean-Claude DufourdTruong Cong Thang
report of Transmoding Core Experiment
9746 Masanori SanoAlan MelbyBhavan Gandhi
Statement in Support and Improvement of the Video Program Profile (VPP)
9747 Mikio Sasaki for JNB JNB Comments on Study of ISO/IEC 21000-7 CD (MPEG-21 DIA)
9748 Senator JeongWeon-Geun OhKi-Song Yoon
Reference Software for the Multilingual RDD Registry
9749 dominique Curet FNB comments for Trondheim
9750 Ehud SpiegelYoram ElichaiShlomo BirmanCyril ConcolatoAlexandre Cotarmanac’h
Report on Synthesized Texture Coding and Animation CE
9751 Yoram ElichaiIttay SharonYosi YomdinEhud Spiegel
Sythesized Texture node definition, description and coding
9752 Ehud SpiegelShlomo Birmanon behalf of the Israeli NB
Israeli NB Comment on Synthesized Texture CE (N5648) and Text of ISO/IEC 14496-11/PDAM2 (N5645)
9753 Jean Le FeuvreCyril ConcolatoJean-Claude Dufourd
Corrections to the BIFS ATG Extensions
9754 Frederik De KeukelaereWesley De NeveRobbie De SutterRik Van de Walle
Suggestions concerning MPEG-21 Digital Item Method Operations and their implementation
9755 Jeroen BekaertPatrick Hochstenbach Wesley De NeveHerbert Van de SompelRik Van de Walle
Suggestions concerning MPEG-21 Digital Item Declaration
9756 Sam S Tsai Hsueh-Ming HangTihao Chiang
Motion Information Scalability for MC-EZBC: Response to Call for Evidence on Scalable Video Coding
9757 Caporossi JérômeParayre DanielaLecomte Daniel
Scalable Video Medialiving : a very low-bit rate layered protection of content
9758 Alexandre Cotarmanac'h French National Body Position on MPEG-21 DIA NetworkCharacteristics
9759 Giorgio Zoia Comments on AudioBIFS v3 WD
9760 Bhavan Gandhi Merging Relevant Tools from SP into the VPP
9761 Takashi MatsuyamaYosuke KatsuraMartin BoehmeHitoshi Habe
Compression Scheme for Model-based 3D Video
34
9762 Takehiro Moriya Dai Tracy Yang
Proposal of lossless coding for audio data in the IEEE floating point format
9763 Yi-Shin TungChung-Neng WangTihao ChiangJens-Rainer Ohm
MPEG-4 Visual: Updated List of Problems Reported, v.8
9764 Chung-Neng WangTihao Chiang
Improvement of Optimized MPEG-4 14496-2 Simple Codec with EPFL SIT Analyzer
9765 Chun-Jen TsaiChung-Neng Wang
Proposed Draft Requirements for ISO/IEC TR21000-12 Multimedia Test Bed for Resource Delivery, v. 2
9766 Chung-Neng WangChia-Yang TsaiYao-Chung LinHsiao-Chiang ChuangKin-Lam TongJin-He ChenFeng-Chen ChangHan-Chung LinChun-Jen Tsai
FGS-Based Video Streaming Test Bed for Media Coding and Testing in Streaming Environments
9767 Hsiang-Chun HuangWen-Hsiao PengChung-Neng WangTihao ChiangHsueh-Ming Hang
Stack Robust Fine Granularity Scalability: Response to Call for Evidence on Scalable Video Coding
9768 ChingYao HuangHuei-Yuan Su
Network Profiles to Evaluate MPEG Coding Performance in Wireless Communications Systems
9769 Cheng-Nan ChiuFrank HoSpencer HsuChun-Jen Tsai
FGS Audio Integration for TR-21000 Multimedia Test Bed WD 2.0
9770 Takahiro KimotoYoshihiro Miyamoto
Multi-Resolution MCTF for 3D Wavelet Transformation in Highly Scalable Video
9771 Jens-Rainer Ohm Summary of responses on Call for Evidence on Scalable Video Coding Advances
9772 Debargha MukherjeeGeraldine KuoSam LiuGiordano Beretta
Proposal for a Universal Constraints Descriptor in DIA
9773 Debargha MukherjeeGeraldine KuoSam LiuGiordano Beretta
Model-based lightweight BSD Transformation Instructions and Reserved Marker Token Formats
9774 Mikio Sasaki Towards Finalization of Destination in MPEG-21 DIA
9775 Mikio Sasaki Linguistic Expression of Time in MPEG-7 and MPEG-21 DIA
9776 Akio YamadaLeszek Cieplinski
MPEG-7 Visual part of eXperimentation Model Version 18.1
9777 Akio YamadaLeszek Cieplinski
Editor's Study of ISO/IEC 15938-3/PDAM1
9778 Akio Yamada MPEG-7 Visual: List of Problems Reported v.3.1
35
Leszek Cieplinski
9779 Helge Drumm CE Shadow Algortihm
9780 Filippo ChiariglionePanos KudumakisMassimo Balestri
MPEG-4 IPMP-X MOSES Interfaces
9781 Tilman Liebchen Detailed technical description of the TUB 'lossless only' proposal for MPEG-4 Audio Lossless Coding
9782 Abdellatif Benjelloun Touimi MPEG-21 IPMP Use Case - Secured Adaptation of Digital Item
9783 VieronMarquantBoissonFrancoisGuillemot
Demonstrations of Scalable Video Coding on interlaced material
9784 vieronmarquantboissonrobertfrancoisguillemot
Response to the Call For Evidence on Scalable Video Coding Advances
9785 Mariam Kimieai AsadiJean-Claude Dufourd
Contribution on MPEG-21 DIA reference software implementation
9786 Jean Le FeuvreCyril ConcolatoJean-Claude Dufourd
Osmo4-GPAC: description and demonstration
9787 Ralph Sperschneider WD of ISO/IEC ISO/IEC 13818-4:1998/Amd.4
9788 Jaime DelgadoEva RodríguezIsabel Gallego
Some ideas on profiles for MPEG-21
9789 Ralph Sperschneider Proposed 3rd Edition of ISO/IEC13818-7
9790 Jean-Claude Dufourd Proposed specification of BIFS Low Complexity
9791 Ralph Sperschneider Proposed 2nd Edition on ISO/IEC TR 13818-5:2003 (MPEG-2 Reference Software)
9792 Ralph Sperschneider WD of 3rd Edition of ISO/IEC14496-3
9793 Geraldine KuoDebargha MukherjeeSam LiuGiordano Beretta
Development of a fully format-independent adaptation engine using current and proposed DIA tools
9794 FengYang
MPEG4 AVC Reference Software 's Optimization
9795 Hitoshi HabeKazumasa YamazawaToshio NomuraTakashi Matsuyama
Report of EE1 on Omni-directional Video
9796 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-11/PDAM 2
9797 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-6/PDAM 1 [SC 29 N 5431]
9798 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-7:2003/FPDAM 1 [SC 29 N 5432]
36
9799 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-2:2001/FPDAM 4 [SC 29 N 5433]
9800 Doug Young SuhHyun-Cheol KimKyuheon Kim
Forward Erasure Correction for Variable Size packets of Continuous Media
9801 Won-Sook LEEKyungAh SOHN
Multi-view 3D-Face Descriptor: proposal for CE
9802 Sylvain DevillersEric DelfosseWolfgang Van Raemdonck
MPEG-21 descriptions and file format addressing schemes
9803 Sylvain DevillersEric DelfosseWolfgang Van Raemdonck
Requirements for MPEG-21 descriptions and file format addressing schemes
9804 Sylvain DevillersEric Delfosse
Non-normative features for BSDL and update on reference software
9805 Rui J.Lopes Assessment of the relationship between fragment referece and multiple stream tools
9806 Rui J. Lopes Proposal of a mechanism for asynchronous inter-stream AU decoding ordering
9807 Rui J. Lopes Proposal for a terminal architecture and stream syntax for the support of multiple description streams
9808 Masayuki TanimotoToshiaki Fujii
Comparative Evaluation of Ray-Space Interpolation Methods
9809 In Kyu ParkDuck Hoon KimIl Dong YunSang Uk Lee
Perceptual 3D shape descriptor: Result of core experiment
9810 In Kyu ParkShinjun LeeIn-Wook SongChang-Su Kim
Compression of PointTexture in Depth Image-based Representation (DIBR)
9811 Sang-Kyun Kim Dataset and Ground Truth set for VCE-3 (Definition and use of a new
9812 Sang-Kyun Kim Report of the Core Experiment of Definition and use of a new “TimeSequence?data container (VCE-3)
9813 Kyuheon KimKNB
Korean NB comment on Text of ISO/IEC 15938-3 PDAM 1 Visual Extensions
9814 Lakshan De SilvaIan Burnett
Remote Digital Item Methods for MPEG-21 Messaging
9815 Changhoon YimHo Jin HaBae-Keun LeeWoo-Jin Han
Methods for Minimizing Average Temporal Distance for Motion Estimation in Interframe Wavelet Video Coding
9816 Yongju ChoYoungkwon LimMoonsup SongHyungjoong Kim
Media Resource Addressing Technique in DID
9817 Jeongil SeoDaeyoung Jang
Consideration on audioFXReverb PROTO
37
Kyeongok KangJinwoong Kim
9818 Shuichi WatanabeYasuaki Tokumo
Report on MPEG-7 Systems CE-9 Item f: multiple payload mode with rational position codes (Mini-Experiment)
9819 KNB KNB comment on AFX part of 14496-4:2003/PDAM4
9820 KNB Korean NB’s comment on the status of the 3DAV group
9821 Yi-Shin TungWei-Ta ChuWen-Huang ChengTing-Jian PanHsien-Shuo ChenJa-Ling Wu
FGS Anchor Sequences for Call for Evidence on Scalable Video Coding Advances and Related Tools
9822 Yi-Shin TungJa-Ling WuJim ShiuZhixiong Wu
Quality Degradation Problem: IDCT Mismatch Propagated and Scaled by MPEG-4 Quarter-pel Filtering
9823 Ryu Dae HaKim Mi JaPark Sung WonKim Dai YongEuee S.Jang
Lossless Coding support for 3DMC
9824 Ryu Dae Ha Kim Mi Ja Park Sung Won Kim Dai YongEuee S.Jang
Lossless Coding experiments results for 3DMC
9825 Masanori SANOMasahiro SHIBATA
Levels and templates for CoreContentDescriptionProfile
9826 Lee Nam YeolKim Hae KwangJeho Nam
MPEG-21 Graphics DIA reference software implementation
9827 Itaru KanekoJunya TsutsumiMark CallowJiro KattoDaisuke Inoue
Lightweight Graphics Adaptation, integration of portable 3D graphics in MPEG-4
9828 Itaru Kaneko (JNB) Japanese National Body contribution to MPEG-21 architecture
9829 Itaru Kaneko Satoshi Miyata
Waseda-TOA experiments on evaluating noise robustness for Lossless Audio Coding
9830 Tadamasa TomaYoshinori Matsui
Usage of the Movie Fragment
9831 Tadamasa TomaYoshinori Matsui
Visual Presentation in MP4
9832 Euee S. JangWook-Joong KimMyungsuk KiJungil SeoKyuheon KimJinwoong Kim
3DAV, are we there yet?
38
9833 Letian RongZhongyang HuangEric Delfosse
CE on DIA Configuration and Messaging
9834 Mario GutierrezFrederic VexoMarius PredaJens PieskFrançoise Preteux
Simple Vextex based animation technique
9835 Konstantin HankeThomas RusertStefan SmeetsDaniel Thull
Response to the Call for Evidence on Scalable Video Coding
9836 Thomas RusertDaniel Thull
Decoder Deblocking Filtering in Interframe Wavelet Video Coding with Block-based Motion Compensation
9837 Aljoscha SmolicKarsten MuellerMichael DroeseBirgit KasparPhilipp MerklePeter EisertThomas Wiegand
Multi-texture Surfaces for View-dependent Rendering in Free Viewpoint Video and Graphics
9838 Toshio KameiAkio YamadaHyunwoo KimWonjun HwangTae-Kyun KimSeok Cheol Kee
Software Update on MPEG-7 Advanced Face Recognition Descriptor
9839 Aljoscha SmolicDavid McCutchen
Requirement for Random Access and View-dependent Partial Decoding and Rendering in 3DAV
9840 Jing LiuJongwon SeokMing JiShengmei ShenJinwoo HongJinwoong Kim
WD1.0 of ISO/IEC 13818-5:1997/AMD2:2003 MPEG-2 IPMP Reference Software
9841 Gerrad DruryIan Burnett
Response to USNB on ISO/IEC CD 21000-7 (DIA)
9842 ZY HuangSM ShenM JiTaka SenohTakafumi UenoTakuyo Kogure
Digital Item Method/Operations in DIP for MPEG-21 DIA
9843 Lee Men HuangShen Sheng MeiYoshimasa Honda
Results on Scalable Video Coding in Low Delay Mode
9844 Giorgio Zoia Report on SA reference software and conformance bitstreams
9845 ZY HuangSM ShenM JiTaka Senoh
General analysis and technical discussion on DIADM tool for DIA application
39
Takafumi UenoTakuyo Kogure
9846 Gerrard DruryIan Burnett
Proposed additional DIBOs for MPEG-21 DIP
9847 Chris BarlasGodfrey Rust
MPEG 21000-6 (RDD) Editors' Version
9848 Ji MingZY HuangTaka Senoh
An MPEG-21 IPMP Use Case for an DI with encrypted rights and encrypted resource
9849 Nicola Adami Sergio Benini Riccardo LeonardiHirofumi Nishikawa
Report of CE on Metadata Adaptation – Integration
9850 Koichi Emura MPEG-21 application: Content exchange in content creation process
9851 Tomohiro Azami Rui J. Lopes
Report on MPEG-7 Systems CE-5quat: Evaluation of multiple description streams
9852 Ye-Kui WangMiska M. Hannuksela
Finnish NB comments on AVC file format
9853 Ye-Kui Wang Issues of gradual decoding refresh in AVC file format
9854 Miska M. HannukselaYe-Kui Wang
Redundant pictures in AVC file format
9855 Ye-Kui WangEmre Aksu
Signaling of error resilience information in file formats
9856 Ye-Kui Wang Bitrate information in media tracks
9857 Ye-Kui Wang Support of sub-sample in file formats
9858 Juergen Herreon behalf of the GNB
GNB Comment on Lossless Audio Coding
9859 Juergen SchmidtKlaus Eilts-Grimm
Update to WD 1.0 of ISO/IEC 14496-11/Amd.3
9860 Juergen Schmidt Comments on 3D Audio in a 2D Scene context
9861 Klaus Eilts-Grimm AudioFX solutions for small systems with reduced implementation overhead; an examination
9862 Jan RohdenMarkus CremerChristian Uhle
An Appropriate Rhythmic Pattern Representation for Music Retrieval and Comparison
9863 Kyuheon KimKNB
Korean NB comment on MPEG-4 pt.10 Professional Extension
9864 Wo Chang Propose Update Profile under Consideration (PuC)
9865 Jan RohdenMarkus CremerChristian Uhle
A proposal for the description of Micro Time
9866 Wo Chang Propose MPEG-7 Profile Working Draft
9867 Wo Chang M7Profile Conference Call Report (for discussion)
9868 Wo Chang M7ITB Teb Bed and Available Tools
9869 Jan Bormans Belgian National Body Comment on AFX (editing)
40
on behalf of the BNB
9870 Jan Rohden Jürgen Herre
CE-8: Evaluation of Quantization Schemes for Binary Audio Metadata
9871 Ralph Sperschneideron behalf of the GNB
GNB Comment on MPEG-4 AAC scalable tool combination
9872 Ralf Geiger Information on Improved Integer MDCT
9873 Ralf Geiger Information on Improved Coding Results for Proposed Scalable Lossless Audio Codec
9874 Ralf Geiger Juergen Herre Gerald Schuller Sang-Wook Kim Miao Lei
Information on Feasibility of Combining the FHG-Proposal for Scalable Lossless Enhancement with MPEG-4 AAC/BSAC
9875 Christoph FehnPeter KauffAljoscha Smolic
Broadcast Transmission of 3D-TV Data
9876 Whoi-Yul KimHyun-Sun ParkJae-Ho LeeHee-Jung Kim
Proposal for CE on 3D Face Recognition Descriptor
9877 Jeewoong RyuMunchurl KimJong-Nam KimKeunsoo Park
Some DIBO's functions for the linkages of DIP-DIA and DIP-IPMP in MPEG-21 DIP
9878 Jeewoong RyuMunchurl KimJong-Nam KimKweonsoo Park
Some DIBO's for the linkages of DIP-DIA and DIP-IPMP in MPEG-21 DIP
9879 Yuriy A. Reznik Verification Report on RM0 for MPEG4 Lossless Audio Coding
9880 Leszek Cieplinski Report of VCE-3 for DominantColor descriptor
9881 Derk ReefmanWerner Oomen
Lossless performance for DST for 1 bit oversampled signals with different oversampling ratios
9882 OomenErik Schuijers
MPEG-4 Extension 2, proposed editorial changes
9883 Werner OomenErik Schuijers
MPEG-4 Extension 2, Integration of Reference SW
9884 Andy GerritsBert den BrinkerWerner Oomen
Core Experiment proposal on ADPCM coding of sinusoidal parameters in MPEG-4 Audio Extension 2 (parametric coding for High Quality Audio).
9885 Kristofer Kjörling on behalf of the Swedish NB
Swedish NB comment on lossless audio coding
9886 Marc Klein Middelink Comments on MPEG-4 Ext.3 (Mp3 in MPEG-4)
9887 Ming LiSabina BihlmaierLukas AhrenbergChristian TheobaltMarcus Magnor
A Synthetic Test Data Set for Rendering/Reconstruction Methods in EE2
9888 Vissarion Ferentinos Memory Complexity Study and Optimization of Wavelet-Based
41
Maurizio MiliaGauthier LafruitJan Bormans
Coders
9889 Peter LedererAndreas HutterJoerg Heuer
Results of CE on Specification consistency – Item c – Schema Transmission Framework
9890 Yuriy A. Reznik Performance Limits of Codes for Prediction Residual
9891 Andreas Hutter on behalf of the GNB
GNB Comment on on progressing towards ISO/IEC FCD 21000-7 and towards ISO/IEC FPDAM1 15938-1
9892 Andreas HutterJoerg HeuerHarald KoschAndrea Kofler-Vogt
Results on CE-10: Fast Random Access
9893 Yuriy A. Reznik Proposed CE for Improving Coding of Prediction Residual
9894 Claudio AlbertiAntonio Romeo Marco Mattavelli
Stand alone Structured IPMP decoder for MPEG-4 IPMPX tools
9895 Lukasz Blaszak Marek Domanski
Modified AVC Codecs with Spatial and Temporal Scalability
9896 Peter van BeekShuichi WatanabeIbrahim SezanKyoungro Yoon
Support for MPEG-7 User Description Profile
9897 Chris JoslinThomas Di GiacomoNadia Magnenat-Thalmann
Results of Mini-experiment on CPU capabilities in DIA
9898 Xin Wang Venkatraman Venugopal Robert Chancellor Joseph FungEdgar Valenzuela
A Linux Version of the Example Implementation of MPEG-21 REL Reference Software
9899 Peter van Beek Signaling of profile & level in MPEG-7 descriptions
9900 Wo ChangBhavan GandhiSchuyler QuackenbushEric RehmDavid SingerJohn R. SmithVetro
Towards a Simple Metadata Profile
9901 Anthony VetroPeter van Beek
Supporting MPEG-21 DIA with MPEG-7 User Description Profile
9902 Anthony VetroAndrew PerkisChristian Timmerer
Editors Input on DIA FCD
9903 Anthony Vetro Andrew Perkis Christian Timmerer
MPEG-21 Digital Item Adaptation AM v5.1
9904 Steve WoodMichelle Kim
XMT Schema Corrections and Advanced Graphics items
42
9905 Dave SingerMohammed Zubair VisharamAli. Tabatabai
MP-4 File Format: Interoperability issue/error pertaining to the storage of AAC encoded content
9906 Mitsuhiro HirabayashiSatoshi TsujiiTeruhiko SuzukiToshihiro IshizakaMohammed Zubair VisharamAli Tabatabai
Definition for Multiple Frames per Sample in the AVC File Format
9907 Dave SingerMohammed Zubair VisharamGuy MoreillonGuido Franceschini
Storage of encrypted media in MP4
9908 S. R. Quackenbush 65th MPEG Audio Task Groups
9909 S. R. Quackenbush 64th MPEG Audio Report
9910 S. R. Quackenbush Proposed Modified core experiment methodology for MPEG-4 audio
9911 Yiannis AndreopoulosJoeri BarbarienFabio VerdicchioAdrian MunteanuMihaela Van der SchaarJan CornelisPeter Schelkens
Response to Call for Evidence on Scalable Video Coding
9912 Vishy SwaminathanGautam GopinadhanGerard Fernando
Draft text input and additions to the DIP Working Draft
9913 S. R. Quackenbush DRAFT Report on the Formal Subjective Listening Tests of MPEG-4 Bandwidth Extension Coding
9914 Kate GrantJack Sandover
Auditory Impairment and Digital Item Adaptation
9915 Vishy Swaminathan Gautam Gopinadhan Gerard Fernando
Additions to DIP Reference Implementation for J-DIxOs.
9916 ---
9917 Gary Sullivan Some Remarks on N5605 Study on MPEG-2 Systems for AVC Video
9918 Charles FenimorePaul Boynton
Measurements to support the use of various display systems for the AVC verification tests
9919 mikael bourges-sevenier Report on Ad-hoc Groups on AFX
9920 Mikael Bourges-Sevenier Updates on the MPEG-4 X3D Interactive profile
9921 Sam LiuCE on AdaptationQoS BSD Link
Terminology and Additional Requirements for bitstream adaptation
9922 KNB Korean NB Comment on Lossless Audio Coding
9923 Woo-Jin HanBae-Keun Lee
Experimental Results for Call for Evidence on Scalable Video Coding Advances
43
Ho Jin HaChanghoon Yim
9924 Riitta VäänänenJean-Bernard RaultJérôme Daniel
Finalizing the production and crosschecking of 3D audio conformance bitstreams
9925 Jean-Claude Dufourd Integration report for the Pattaya meeting
9926 Seyrat Editor's study of ISO/IEC 15938-1/PDAM1
9927 Vladimir Levantovsky IPR and Trademark statements
9928 F.J. de BruijnW.H.A. BrulsR.J. van der VleutenI.O. KirenkoJ. van der Meer
Layered Spatial Coding and Local Motion Processing
9929 Gregoire Pau Christophe Tillier Béatrice Pesquet-Popescu Henk Heijmans
Iterative predict optimization in MCTF video
9930 SC 29 Secretariat Liaison Statement from 3GPP TSG SA WG4
9931 SC 29 Secretariat Liaison Statement from 3GPP TSG SA WG4
9932 SC 29 Secretariat Liaison Statement from 3GPP TSG SA WG4
9933 JTC 1 Secretariat via SC 29 Secretariat
Summary of Voting on ISO/IEC DTR 14496-9
9934 Taka SenohTakafumi UenoMing JiJing Liu
WD1.1 of ISO/IEC 13818-4:1998/AMD4:2003 MPEG-2 IPMP Conformance Testing
9935 Brian Green Liaison Statement from EDItEUR
9936 Vladimir LevantovskyPaul Nelson
Comments on the proposed structure of MPEG-4 Text Profiles
9937 John R. Smith Proposed Process for Managing MPEG-7 Schema Extensions and Versions and their Relation to Profiles
9938 Melanie Dulong de Rosnay Interaction between standardization and legislation
9939 Jesús Bescós Shot Transitions Ground Truth for the MPEG7 Content Set (GTI TR 2003/06)
9940 Ian Burnett Distributed Peer and Session Mobility Architecture Use Cases
9941 Brad Gandee OeBF Liaison Statement to MPEG
9942 Chris BarlasBrett Powley
Reference software for a database-driven RDD implementation
9943 fx nuttallAndrew Tokmakoff
ER Use case for MPEG 21 IPMP and Architecture
9944 Mauri VäänänenMarta Karczewiczon behalf of the Finnish NB
Finnish National Body comment on the addition of Level 0b to the MPEG-4 Simple Visual Profile
9945 Thomas DeMartini REL Draft FDIS
9946 Hutter and J.-R. Ohm on behalf of German NB
GNB comment on the addition of Level 0b to the MPEG-4 Simple Visual Profile
44
9947 Kohtaro Asai Suggestion of intra-only MPEG
9948 Walt HusakTom McMahon
Dolby 4:4:4 Film Content Kit 1 Description
45
Annex 4Report of Requirements meeting
Source: Rob Koenen, InterTrust Technologies
Note: the links in the Requirements Report generally work if the report is placed in the directory that also holds the “contrib” subdirectory, i.e., one level above the contrib directory.
AgendaMonday
9:00-13:45 opening plenary meeting 13:45-14:45 Lunch (ends one hour after plenary ends)
14:45-17:00
MPEG-21 Architecture and IPMP RequirementsGeneral9628 AHG on MPEG-21 Architecture and IPMP Requirements - Barney Wragg, et.al.9680 USNB Contribution: On Development of IPMP in MPEG-21 - A. G. Tescher for USNB 9708 Swiss NB comment for backward compatibility of MPEG-21 IPMP with MPEG-2/4 IPMP(X) –
Alberti,… 9734 SgNB Comment on MPEG-21 IPMP Requirements - C. J. Lee9828 Japanese National Body contribution to MPEG-21 architecture - Itaru Kaneko (JNB)
Rqs
17:00-17:30
Persistent Association9692 Editors' Input: Evaluation Methods for Persistent Association Tools - Rump, Jessop9630 AHG on Persistent Association - Paul Jessop, Niels Rump
Event Reporting9740 Report of CE on Event Reporting Language - Nammee Moon, et.al. 9629 AHG on MPEG-21 Event Reporting CE - FX Nuttall, Andrew Tokmakoff
Rqs
17:30-18:00 9738 Updated Contributions to MPEG-21 IPMP Requirements - Rob Koenen Rqs
Tuesday
09:00-11:00
MPEG-21 REL/RDD related – joint with MDS9650 AHG on Use of DID by other MPEG 21 parts - Gerrard Drury, Do-Nyun Kim9647 AHG on Profiles and Extensions of the MPEG-21 REL - Brad Gandee, Barney Wragg9675 Liaison Statement from the Open Mobile Alliance (OMA)] - SC 29 Secretariat9935 Liaison Statement from EDItEUR - Brian Green
Other joint with MDS9814 Remote Digital Item Methods for MPEG-21 Messaging - Lakshan De Silva, Ian Burnett9921 Terminology and Additional Requirements for bitstream adaptation - Sam Liu, for CE
Rqs
11:00-12:00 Reference Software Requirements for MPEG-21 Rqs
12:00-13:00
Continuing MPEG-21 Architecture and IPMP9940 Distributed Peer and Session Mobility Architecture - Ian Burnett
Use Cases9695 An MPEG-21 IPMP Use Case for Multiple Accesses to Digital Items - Xin Wang, et.al.9698 MMG MPEG-21 IPMP Use Case / Walkthrough - Itaru Kaneko, Onsihi Neergaard9706 IPMP Use cases and Walkthroughs - A Schultz9782 MPEG-21 IPMP Use Case - Secured Adaptation of Digital Item – A. Benjelloun Touimi9940 Distributed Peer and Session Mobility Architecture Use Cases - Ian Burnett9848 An MPEG-21 IPMP Use Case for an DI with encrypted rights and encrypted resource - Ji Ming,
et.al.9943 Event Reporting Use Case – FX Nuttall
Architecture9737 Updated Contributions to MPEG-21 IPMP Architecture - Steve Mitchell, Knox Carey
Rqs
13:00-14:00 Lunch 14:00-16:00 Joint with Video, Audio, MDS, Systems on MPEG-7 Profiling
9627 AHG on MPEG-7 Interoperability and Profiling - Wo Chang9746 Statement in Support and Improvement of VPP- Sano, Melby, Gandhi9760 Merging Relevant Tools from SP into the VPP - Bhavan Gandhi9825 Levels and templates for CoreContentDescriptionProfile - SANO, SHIBATA9864 Propose Update Profile under Consideration (PuC) - Wo Chang9866 Propose MPEG-7 Profile Working Draft - Wo Chang9867 M7Profile Conference Call Report (for discussion) - Wo Chang9868 M7ITB Teb Bed and Available Tools - Wo Chang
Rqs
46
9896 Support for MPEG-7 User Description Profile - Peter van Beek et. Al.9900 Towards a Simple Metadata Profile - Wo Chang, et.al. 9901 Supporting MPEG-21 DIA with MPEG-7 User Description Profile - Vetro, van Beek9937 Proposed Process for Managing MPEG-7 Schema Extensions and Versions and their Relation to
Profiles - John R. Smith9899 Signaling of profile & level in MPEG-7 descriptions - Peter van Beek
16:00-18:00
MPEG-4 Video – joint with Video9931 Liaison Statement from 3GPP TSG SA WG4 - SC 29 Secretariat
Scalable Video Coding – joint with Video9732 Contributions to Scalable Video Coding Requirements - Jonathan Teh, Tony May9722 FNB Comments on Requirements for Scalable Video Coding – Marquant, Vieron
3D Video Coding – joint with Video9832 3DAV, are we there yet? - Euee S. Jang, et.al.9820 Korean NB’s comment on the status of the 3DAV group – KNB
Rqs
Wednesday 9:00-11:00 Plenary meeting Rqs
11:00-13:00
MPEG-21 Architecture and IPMP (joint with Systems, MDS)9679 USNB Contribution: Usage of dii:Type's in MPEG-21 - A. G. Tescher for USNB9682 AUNB Contribution: Usage of dii:Type's in MPEG-21 – AUNB9686 Indication of IPMP Governed Digital Items – Xin Wang , Thomas DeMartini , Brad Gandee9803 Rqs for MPEG-21 descriptions and file format addressing schemes – Devillers et. al. Appropriate contribs from Monday can be included in this session; including at least:9628 AHG on MPEG-21 Architecture and IPMP Requirements - Barney Wragg, et.al.Report from Break-out group
Rqs
13:00-14:00 Lunch14:00-14:30 Reference Software Requirements for MPEG-21 – joint with MDS, Integration Rqs
14:30-17:00
MPEG-21 Requirements – general9714 Digital Broadcast Item Model: Harmonization of Broadcast Metadata – Lugmayr et.al.9662 AHG on MPEG Multimedia Test Bed - Tsai, Van der Schaar, Young-Kwon Lim9765 Proposed Draft Requirements for Multimedia Test Bed […], v. 2 – Chun-Jen Tsai, Chung-Neng
Wang9788 Some ideas on profiles for MPEG-21 – Jaime Delgado, Eva Rodríguez, Isabel Gallego9850 MPEG-21 application: Content exchange in content creation process – Koichi Emura9938 Interaction between standardization and legislation – Melanie Dulong de Rosnay
Rqs
17:00-18:00 M3W Rqs
Thursday8:30-9:00 MPEG-21 Ref Soft Requirements Rqs
9:00-10:30
Various MPEG-4 things - Joint with Systems, SNHC9936 Comments on the proposed structure of MPEG-4 Text Profiles – Levantovsky, Nelson9920 Updates on the MPEG-4 X3D Interactive profile – Mikael Bourges-Sevenier9827 Lightweight Graphics Adaptation, integration of portable 3D graphics in MPEG-4 – Itaru
Kaneko et.al.9834 Simple Vextex based animation technique – Mario Gutierrez, et.al.9823 Lossless Coding support for 3DMC - Ryu Dae Ha, e.al.
Rqs
10:30-11:00AVC issues – joint with JVT
9863 Korean NB comment on MPEG-4 pt.10 Professional Extension – Kyuheon Kim, KNB9930 Liaison Statement from 3GPP TSG SA WG4 – SC 29 Secretariat
Rqs
11:30-12:00 3DAV and SVC – joint with Video Group Rqs12:00-12:30 MPEG-7 Profiles – joint with MDS Rqs
12:30-13:00 MPEG Vocabulary9631 AHG on Vocabulary - Mike Rubinfeld Rqs
13:00-13:30 Lunch
13:30-14:00 DIA Requirements9921 Terminology and Additional Requirements for bitstream adaptation - Sam Liu, for CE Rqs
14:00-18:00Requirements issues, followed by MPEG-21 Architcture and IPMP
9726 Liaison Statement from the Content Reference Forum (CRF) – SC 29 Secretariat 9665 Liaison Statement from ITU-R SG 6/WP 6M [SC 29 N 5338] - SC 29 Secretariat
Rqs
Friday8:00-9:30 Explorations/General
Contribution: M9947 - Suggestion for intra-only MPEG
3DAV Status Report – Aljoscha 3DAV Call for Comments – Aljoscha 3DAV Requirements Document – Aljoscha
Rqs
47
Response to KNB on 3DAV Draft MPEG Vocabulary - Mike SVC Requirements Document - Mihaela Draft Call for Proposals for SVC (Video Document)
9:30- 10:00Concluding MPEG-4
WD on new Video levels FDAM 1 – Video Group document Profiles under Consideration – Fernando (editing period)
Rqs
10:00-10:30
Concluding MPEG-7 WD for MPEG-7 part 9 - Wo Profiles under Consideration - Wo Profile Definition Description Document – Wo M7ITB Test Bed and available tools – Wo AHG on Profiles and Interop - Wo
Rqs
10:30-12:00
Concluding MPEG-21 MPEG-21 Requirements document - Jan Bormans MPEG-21 Architecture, Scenarios and IPMP Requirements document – Rob MPEG-21 MM Test Bed Requirements – CJ PAT WD 3.0 - Niels AHG on Architecture and IPMP Requirements – Rob AHG on PAT - Niels AHG on REL Profiles and Extensions (including OeBF work) – Brad AHG on ER Resolution on Ref Soft AHG on MPEG-21 Profiling Resolution on Standards and Law??
Rqs
12:30-14:00 Lunch 14:00-22:10 Plenary meeting
Break-outs
Persistent Association: Hjallis, Tuesday, 10:00 – 11:00 Joint meeting with Video: Thursday, 10:00 – 10:30 in Video room
MPEG-21 IPMP and Architecture Lerkendal, Tue Afternoon, Wed Hjallis, Thursday until 10:30 ??? Thursday 11-13
MPEG-21 Architecture and IPMP Requirements – already discussed in Santa Clara AHG9678 Contribution to MPEG-21 IPMP requirements. IPMP systems provider requirements - Claudio Alberti, Antonio Romeo,
Marco Mattavelli, SM Shen, Craig A. Schultz9687 Comments on IPMP Requirements - Xin Wang , Thomas DeMartini, Brad Gandee9688 Contributions to MPEG-21 IPMP Requirements Process - Koenen9689 Contributions to MPEG-21 IPMP Architecture - Mitchell, Carey9683 IPMP Scheme for MPEG-21 IPMP - Ming Ji, ZY Huang, SM Shen, J Liu, Taka Senoh, Takafumi Ueno, Takuyo Kogure9684 MPEG-21 Architecture and IPMP - ZY Huang, SM Shen, M Ji, J Liu, Taka Senoh, Takafumi Ueno, Takuyo Kogure9685 Digital Item Method/Operations in DIP for MPEG-21 IPMP - ZY Huang, SM Shen, M Ji, J Liu, Taka Senoh, Takafumi
Ueno, Takuyo Kogure
End Agenda
48
Explorations, General
Scalable Video CodingTuesday 22 July 2003, 16:33 (SVC)Status Quo: svc results have been observed that are significantly better than FGS. Result depends on sequences, bitrate … A preliminary call for Proposals was readied this week; a final CfP will go out in December.
9722 FNB Comments on Requirements for Scalable Video Coding – Marquant, VieronRequirements Group agrees with FNB suggestion that the SVC toolbox shall support interlaced, and remarks that this does not imply that every implementation shall support it. There may be profiles that do not include support for interlaced material. Requirements Document was updated to reflect decision.
9732 Contributions to Scalable Video Coding Requirements - Jonathan Teh, Tony MayRequirements Group agrees that there are low-delay applications that will benefit from SVC. Requirements Document was updated to include requirements for low delay support. Again the note is made that this does not imply that every implementation shall support low delay.
9757 Scalable Video Medialiving : a very low-bit rate layered protection of content - Caporossi et.al.Requirements Group thanks Medialive for interesting presentation with relevance to the IPMP work and the work on scalable video coding.
3DAV9832 3DAV, are we there yet? - Euee S. Jang, et.al.9820 Korean NB’s comment on the status of the 3DAV group – KNB
The SNHC, Video and Requirements Groups in a joint meeting decided that it was time to release a status report of the work on 3DAV, after 1.5 years of activity in MPEG on 3DAV. There will also be a call for comments, which invites people to review the report, bring new requirements, applications, and suggestions. Further work will be decided after responses to the Call for Comments have been received. The Call is scheduled for October with responses due in December. The members of the Korean delegation agreed with this course of action.
M3WWednesday 23 July 2003, 17:00 (M3W)
A brainstorm was held in the Requirements Group on Multimedia Middleware. Here are some points from that brainstorm.
What is M3W? Abstract interface to platform In MPEG-21, sits between DIBO’s and hardware
o DIBO can choose to call through M3W or directly to platform No direct link with reference software Framework for calling decoders, renderers, secure functions – for media players Open standard for interfaces
49
Not the usual MPEG level of standardization, more at the multimedia level, how to use the tools rather than the tools themselves. May be this is a logical next step for MPEG. ‘subtle change’.
What is M3W for? Opening market for plug and play architectures, enabling MPEG standards Currently no way of building e.g. Java applications that use the resources that are available,
e.g. on phone. o Need Set of API’s that exploit available resources
IPMP – we so far tried to market to two constituencies:o Other bodies – they want tools, which MPEG doesn’t have (yet)o Companies – they want API’s, and may be helped
Which industries would need / benefit from M3W? Lower development cost? – would be good. Some companies may lose something? IPR
situation? IPR in implementation is not going to be touched.
As a next step, it was decided to create a separate AHG for this issue. Issues that would need to be addressed in the AHG are:
1) Assess potential customers and benefits to them2) Getting feedback.3) Define where in the platform the API is located exactly? Which layer?
MPEG VocabularyThursday 24 July 2003, 12:30 (Vocabulary)
Requirements Group reviewed the situation of the Vocabulary. The chair of the AHG presented good ideas for an only thesaurus and had relevant 3rd party sources for information. The Requirements Group concluded that the ideas were attractive, but that we first need to have the core in place: a vocabulary of terms (not just acronyms) that are used in MPEG with their meaning. First audience is MPEG itself, second audience is the world beyond MPEG.
MPEG-4
MPEG-4 VisualTuesday 22 July 2003, 16:33 (MPEG-4 Levels)9931 Liaison Statement from 3GPP TSG SA WG4 - SC 29 Secretariat
3GPP asks for a Level in Simple Profile that is close to Level 0, but has 128 kbps rather than 64 kbps upper limit, and double the VBV size. The Requirements group considers 3GPP an important user of MPEG-4 standards, and recommends accommodating the request, giving that companies have committed to carry out the work (drafting the text and providing the required bitstreams).
MPEG-4 AVCThursday 24 July 2003, 10:44 (Joint with Video on AVC)9863 Korean NB comment on MPEG-4 pt.10 Professional Extension – Kyuheon Kim, KNB
On lossless Coding:
50
This is not currently in the mandate of JVT. It seems to be mostly useful for Digital Cinema. MPEG has spent much resources on Digital Cinema in the recent past, but there is currently no indication that the work will be used by industry. MPEG will be happy to address requirements for lossless coing when there is evidence that industry will use that work.
On color spaces:The JVT extensions CfP calls out support for YUV, RGB and XYZ. If a color space can be enabled be transformations before and after coding while maintaining fidelity, that would fulfill the requirement to satisfaction for the Requirements Group. JVT is kindly requested in resolution to study if such fidelity is indeed retained by the current approach.
9930 Liaison Statement from 3GPP TSG SA WG4 – SC 29 Secretariat9664 Liaison Statement from DVB [SC 29 N 5331] – SC 29 Secretariat
Requirements group wants to accommodate request from DVB and 3GPP for such a Level that sits above L1. If no-one is interested in the current L1, the Requirements Group would prefer amending/correcting that lowest level to accommodate the higher requested bitrate. Groups has asked NB’s and industry to comment in a Resolution and in liaison statements back to 3GPP an DVB..
MPEG-4 Text ProfilesThursday 24 July 2003, 09:00 (Text Profiles)9936 Comments on the proposed structure of MPEG-4 Text Profiles – Levantovsky, Nelson
Having reviewed the proposal in M9936, the Requirements Group has the following considerations.1) We only want to define the Profiles when we have reasonable indication that people will use
them. The proposal fills the entire space. Hence, the questions in defining profiles are as always: Who will use the profiles? (What is the Company support) Who will create the bitstreams? (AGFA can help but not construct the complete stream)
2) Should Text be in a new profiling dimension or be put in the Graphics dimension, where it has always been?
The proposed structure will be included in Profiles under Consideration, with a request for comments. Requirements Group will follow existing procedures to adopt new profiles. No decision was taken on whether this should be a new dimension. There is a mandate in the BiFS AhG to discuss pros and cons.
Other Requirements IssuesThursday 24 July 2003, 10:03 (Joint Systems and Systems)9920 Updates on the MPEG-4 X3D Interactive profile – Mikael Bourges-SevenierNew companies in support of the X3D Interactive profile are the following: FhG, INT, Octaga, Bitmanagement. Bistreams are promised by next meeting. The profile is currently ‘on hold’, waiting for Web3D’s X3D profile to go through ISO standardization.
One-to-one mapping with profile in X3D. Profile will allow X3D content to be used in MPEG-4 combined with Audio and Video
9823 Lossless Coding support for 3DMC - Ryu Dae Ha, e.al.
51
Proposed changes to requirements were accepted and incorporated in Requirements Document.
MPEG-7
MPEG-7 ProfilesTuesday 22 July 2003, 13:55 (MPEG-7 Profiling)There are 3 Issues up for discussion in the ‘MPEG-7 Plenary’
1. Profiles2. their signaling3. how do we do extensions?
9627 AHG on MPEG-7 Interoperability and Profiling - Wo Chang9746 Statement in Support and Improvement of VPP- Sano, Melby, Gandhi9760 Merging Relevant Tools from SP into the VPP - Bhavan Gandhi9896 Support for MPEG-7 User Description Profile - Peter van Beek et. Al.9901 Supporting MPEG-21 DIA with MPEG-7 User Description Profile - Vetro, van Beek9864 Propose Update Profile under Consideration (PuC) - Wo Chang9866 Propose MPEG-7 Profile Working Draft - Wo Chang9867 M7Profile Conference Call Report (for discussion) - Wo Chang9868 M7ITB Teb Bed and Available Tools - Wo Chang9900 Towards a Simple Metadata Profile - Wo Chang, et.al.
At least three profiles are fairly mature and have good support: Simple Metadata Profile Core Content Description Profile User Descriptio Profile
However, none of these meet the full requirements for description availability yet. the Requirements Group decided as follows:
No profiles go to WD yet WD will be stripped down to minimize the informative text. Intention is to go to CD at next meeting, and to consider these three profiles for adoption Profiles under Consideration document will be updated to reflect the new support statements
that have been received.The Requirements Group thanks all the companies and organizations that have expressed their support for the various profiles.
9825 Levels and templates for CoreContentDescriptionProfile - SANO, SHIBATAAfter discussion, it was decided not to introduce ‘Template’ as a normative element in profiling, but rather to keep the current structure. However, it was concluded that Level may not be the most appropriate name, and a different name will be sought.
9899 Signaling of profile & level in MPEG-7 descriptions - Peter van Beek
Consensus on the reflector that namespace option was not liked. This was further dealt with outside the Requirements Group.
52
MPEG-21
Architecture and IPMP Requirements9708 Swiss NB comment for backward compatibility of MPEG-21 IPMP with MPEG-2/4 IPMP(X) – Alberti,… 9734 SgNB Comment on MPEG-21 IPMP Requirements - C. J. Lee9828 Japanese National Body contribution to MPEG-21 architecture - Itaru Kaneko (JNB)Support for IPMP-X from CE providers
On 9708Swiss NB asks for unmodified use of content already protected with MPEG-2/4 IPMP-X. A way for the MPEG-21 terminal to handle the MPEG-2/4 protected content. Swiss delegates added: ‘We ask that best effort be made’
Remarks made during the discussion: “MPEG-21 has always been precisely like this – being able to use MPEG-2 and MPEG-4
and potentially other resources …” “We should be able to have MPEG-21 IPMP wrapper around MPEG-2 and -4 protected
content” “People that want to have support for hooks/IPMP-X should be able to do so”
On 9734Contribution argues that MPEG-21 to date is on higher level of abstraction. When we ‘get down to the bits’ we need to use the work that has already been done. We need to try our best to harmonize the architecture in MPEG-21 with the IPMP-X architecture (where applicable)
On 9828[Observation of the market environment] – MPEG needs to be fast in developing its MPEG-21 IPMP spec. the Requirements Group agrees.[Compatibility with existing technology] – the Requirements Group agrees that MPEG-21 should support / interface with / leverage / not duplicate legacy technology that provides IPMP functionality and is already deployed , e.g. DTCP, systems used in digital broadcasting. Group welcomes further, ore specific requirements. [Justification with industrial demand] – the Requirements Group agrees we need to keep looking at what industry needs. But – You may not always know in advance what the industry is going to use.
[Optimization of implementation and development process] A number of observations were made: Thee is a need to develop profile(s) within the MPEG-21 set specifications that are useful and
can be rapidly deployed. MPEG may consider a binary form of DID to ease implementation? (It was noted that this awas
looked at in the past and the standardization at that point was not deemed necessary) If there are specific requirements pertaining to efficient implementation of MPEG-21, then
please bring them – we will seriously consider these (e.g., there is no hard and fast rule that all tools in MPEG-21 need to be XML tools.)
On the 3 NB contributions together:The discussions are best summarized by the response that the group gave to these NBs:
53
The Requirements Group thanks the Japanese, Swiss and Singapore NB's for their comments on the relation between MPEG-21 IPMP and the IPMP Extensions.
The group is of the opinion that MPEG-21 IPMP should leverage the existing IPMP specifications to the extent possible and it is equally desirable to harmonize MPEG-21 IPMP with MPEG-2/4 IPMP. We are currently developing the MPEG-21 (IPMP) Architecture, and it is conceivable that MPEG-21 IPMP will simply hand off to the IPMP Extensions, or that the IPMP-X specification, or elements thereof, will become part of the MPEG-21 IPMP specification. We are studying the issue further in the IPMP AHG, and we invite you to take part in those studies.
The Requirements group agrees with the assessment of the JNB that the matter is urgent. We are seeking to engage in standardization as soon as possible, to which effect we are holding another intensive AHG meeting between the 65th and 66th meeting. In response to the JNB request, we welcome specific requirements for existing technology to support, and for the definition of simple profiles, the need for which we agree with. 9680 USNB Contribution: On Development of IPMP in MPEG-21 - A. G. Tescher for USNB This is contribution is consistent with the current approach.
9738 Updated Contributions to MPEG-21 IPMP Requirements - Rob KoenenGeneral support for approach. the Requirements Group agrees to adopt the principles into requirements document. On the issue of backward compatibility, the principles should be along the lines of the response to the Japanese, Singapore and Swiss NB’s as quoted above.
Summarzing: MPEG should see Terminal Interop as highest priority Component Interop useful if it helps achieving Terminal Interop
may be further pursued after Terminal Interop achieved
Apply Format Interoperability wherever possible Do not hide non-interoperability, but minimize it
Non-interoperable elements in trusted, opaque blocks Don’t use extra layers of abstraction of they don’t bring interop closer facilitating transfer of content and rights across different IPMP domains
Facilitate translation where it cannot be avoided
On use of existing MPEG IPMP specs: We need to develop an understanding of the role of existing MPEG IPMP specifications in
MPEG-21 IPMP We must leverage past work, which is structurally solid Allow use of hooks and IPMP-X in MPEG-21 framework Harmonize the architecture in MPEG-21 with the IPMP-X architecture where applicable
and to the extent possible
Is there a requirement to accommodate existing, non-normative tools that have been developed to date in industry? No strict requirement, we may try to help.
9679 USNB Contribution: Usage of dii:Type's in MPEG-21 - A. G. Tescher for USNB9682 AUNB Contribution: Usage of dii:Type's in MPEG-21 – AUNB
54
Conclusion: there are two different uses for ‘type’ – the AUNB is useful and informative, the USNB type is useful too and informative. Further discussions took place in MDS Group. The Requirements group invites contributions on how types could be useful in a normative way.
9686 Indication of IPMP Governed Digital Items – Xin Wang , Thomas DeMartini , Brad Gandee
The contribution is in the issue of the semantics of the absence/presence of a rights expression. This issue has come up repeatedly in previous meetings.
The conclusion of study and discussion in AHG is as follows: We need an indication of whether a DI is governed There are several potential solutions
o Presence of Rights Expression is oneo Presence of a short Rights Expression just stating that there exists a longer RE
somewhere else would be a solution tooo Presence of a “governed-bit” would be as well.
There needs to be a place in the standard to explain thiso This should be MPEG-21 Architecture, which will need to become a part of the
standard MPEG-21 IPMP needs to accommodate:
o A DI with RE ‘inside’o A DI with a linked REo A DI with link to discovery mechanism that allows you to find an RE that pertains to
the DI (there may be several!)o None of the above, but when you get the RE (in whatever – non-normative – way),
you know it applies to the DI. This means the RE points to the DI. For presence/absence Re, the following applies:
o If there is an indication that it is governed: don’t proceed without RE and fulfilling its terms;
o If it is protected: it is physically impossible to proceed;o If there is no expression / indication at all: you may proceed, but there may be non-
MPEG-21 reasons that your rights are restricted. There is, however, no normative reason for not continuing.
o This means that if there is no rights expression, then MPEG-21 is silent on the semantics – a DI may still be governed.
MPEG-21 semantics do not indicate that you cannot do anything MPEG-21 semantics do not indicate you can do everything
9803 Rqs for MPEG-21 descriptions and file format addressing schemes – Devillers et. al.the Requirements Group decided to adopt the proposed requirements in Requirements Document
9726 Liaison Statement from the Content Reference Forum (CRF) – SC 29 Secretariat Objectives of CR Forum seem very much aligned with those of MPEG-21. the Requirements Group wants to learn CR Forum’s requirements, and would welcome an analysis of what MPEG should address in addition to the current activities, to support CRF’s objectives. Liaison statement was sent back to this effect.the Requirements Group was pleased to learn that CRF’s liaison (Simon Watts) hopes to be able to get input to MPEG at 66th meeting.
9665 Liaison Statement from ITU-R SG 6/WP 6M [SC 29 N 5338] - SC 29 Secretariat
55
the Requirements Group decided to send liaison back explaining our work on IPMP. It should explain that MPEG is looking at requirements from all stakeholders.
Next Steps on Architecture9940 Distributed Peer and Session Mobility Architecture - Ian Burnett
Use Cases9695 An MPEG-21 IPMP Use Case for Multiple Accesses to Digital Items - Xin Wang, et.al.9698 MMG MPEG-21 IPMP Use Case / Walkthrough - Itaru Kaneko, Onsihi Neergaard9706 IPMP Use cases and Walkthroughs - A Schultz9782 MPEG-21 IPMP Use Case - Secured Adaptation of Digital Item – A. Benjelloun Touimi9940 Distributed Peer and Session Mobility Architecture Use Cases - Ian Burnett9848 An MPEG-21 IPMP Use Case for an DI with encrypted rights and encrypted resource - Ji Ming, et.al.9943 Event Reporting Use Case – FX Nuttall
Architecture9737 Updated Contributions to MPEG-21 IPMP Architecture - Steve Mitchell, Knox Carey
The contributions above were all discussed in the IPMP break-out group. The break-out group came back with an updated diagram, a list of questions and some answers. The decision was to record the result of the work in the break-out group into the Requirements, Scenarios and Architecture document, which was going to be edited after the meeting.
The following specific conclusions were derived in the plenary requirements meeting: Permission to execute a ‘master’ DIBO corresponding to a verb from a rights expression is
enough to be able call other sub-DIBO’s without needing separate permission We need text with The Diagram explaining the elements – the Break-out Group has
provided a list of terms with their definitions We may ultimately have multiple diagrams, on different levels of abstraction, or reflecting
different use configurations. There is no need to capture everything in a single Diagram.
The Requirements Group agreed that it is very desirable to have another AHG meeting. The Requirements Group was pleased to with Philips’s offer to host the meeting in Eindhoven in the week before IBC.
Profiling9647 AHG on Profiles and Extensions of the MPEG-21 REL - Brad Gandee, Barney WraggRequirements group understands that efforts have been concentrated on getting REL to FDIS. Going forward, Requirements Group wants a single AHG working on extensions and Profiles, which includes that work in different sub-domains.
9675 Liaison Statement from the Open Mobile Alliance (OMA)] - SC 29 SecretariatThe Requirements Group understanda OMA’s position, and decides to provide feedback on using the MPEG RDD to map the MPEG REL to the OMA DRM REL. Liaison will also ask to provide MPEG with OMA’s new requirements when done.
9935 Liaison Statement from EDItEUR - Brian GreenLiaison states that it should be possible to find out which public extensions exist, and what their specifications are. Signaling which extension if used is already provided for because it is tied to a name space. Requirements Group decides to study the desirability of a discovery mechanism for extensions:
To understand the requirements To understand if a registration authority is needed / useful
56
The Requirements Group will send a liaison back saying we will study this in the Profiling and Extensions AHG
Reference Software Requirements The Requirements Group held 3 joint sessions with Integration, MDS and Systems on the issue of reference Software.
It is the purpose of the reference software to allow users of the standard to understand the syntax, play with, and exercise the technology. The reference software is normative just like the text is. They are dual representations. If they do not match, experts in MPEG need to decide which one should be fixed. There is no automatic precedence for the text to prevail over the software.
MPEG-21 is a framework – the reference software should show it.
We need to distinguish 2 things:1. Requirements on Ref Soft for individual parts of MPEG-212. Requirements on integration
Considerations given during the discussions:1. Source or Object code?
a. Object code in exceptional casesb. For normative parts: source should be provided to help people understand how to
implement the standardc. For non-normative parts: object code may help demonstrating the functionality
enabled by the standard???d. MPEG-7: requirement for source code of a simple implementation for, e.g.,
extraction. Could be extended to MPEG-212. Purpose of Ref Soft:
a. Demonstrate that you can implement standardb. Give authoritative reference for behaviour / conformance checking (Ref Soft is
normative!) i. Text and SW are dual, complementary representations of the same
algorithms. Implementers need to be able to inspect both.c. Help people to understand and implement the standard
The following (from the meeting’s resolutions) represents the result of the discussion, and summarized the requirements on refrence software for MPEG-21:
1. Requirements on Reference Software for individual parts of the MPEG-21 Standard:a) The Reference Software shall exercise/represent all the normative features in the Standardb) It shall be Source Codec) It shall be possible to build an application on top of itd) The code should be reasonably efficient, however thre are no requirements for optimisation e) Just like the Text parts of the standard, Reference Software can have normative and
informative parts. The normative parts of the Reference Software correspond to the normative parts of the
Text. The informative parts of the Reference Software complement the normative parts to
provide meaningful use of the SW
57
There is no requirement on the informative parts of text and SW to correspond.f) The subgroup that develops an individual part of MPEG recommends what constitutes an
acceptable implementation of that part in Reference SW.g) Code for different elements within a single part shall share a common code base or a
common set of interfaces2. Requirements on Integration of the different parts:
It is MPEG’s goal to achieve integration between the reference SW parts for the different parts of MPEG-21, in order to be able to use these together in an application. Therefore:a) Code for different parts in MPEG-21 shall share a common code base or a common set of
interfaces, b) It shall be possible to compile and run the Reference Software on a single platformc) Until the reference software matures, integration of reference SW elements for the different
parts of MPEG-21 will be handled on a case by case basis.d) The MPEG-21 Architecture, when sufficiently mature, will be used to define guidelines for
the interfaces, including interfaces to applications built on top of the reference SWe) The Reference SW may include informative code that sits between the normative elements
corresponding to the different parts of MPEG-21
DIAThursday 24 July 2003, 13:30 (Joint with MDS)9921 Terminology and Additional Requirements for bitstream adaptation - Sam Liu, for CEPropose new requirements for DIA. Group agreed that update on requirements is good, but that proposal was too detailed. Proponents will make summary into more high-level requirements.
In a joint meeting with MDS, it was decided to accept the IPMP-X descriptors in DIA, as they will provide a meaningful description of the terminal that will allow adaptation of the content. The opinion of the group was that likely more description was necessary to fully determine the adaptation.
Event Reporting9943 Event Reporting Use Case – FX NuttallThe Event Reporting group has worked on use cases, and worked within the IPMP Break-out for part of the time. Conclusion of the AHG is that REL doesn’t seem to give a perfect match with the current requirements. Not all requirements supported, and the entire REL is rather heavy for just event reporting. It is decided to further study requirements in the context of the IPMP work.
Persistent Association9692 Editors' Input: Evaluation Methods for Persistent Association Tools - Rump, Jessop9630 AHG on Persistent Association - Paul Jessop, Niels RumpGroup is able to engage experts in its work, which is a good sign. Specification progressed to WD 3.0
Other MPEG-21 Requirements Issues9814 Remote Digital Item Methods for MPEG-21 Messaging - Lakshan De Silva, Ian BurnettIdea seems to raise interest. Its applications need to be studied. Can perhaps be useful in governance situations, e.g. in authorized domains. Interested parties are invited to bring further requirements and use cases where it could be used.
Wednesday 23 July 2003, 14:40 (MPEG-21 Requirements )
58
9714 Digital Broadcast Item Model: Harmonization of Broadcast Metadata – Lugmayr et.al.The idea of looking to MPEG-21 DI use in broadcast had quite a bit of support among delegates. An AHG was set up to further address the requirements.
9662 AHG on MPEG Multimedia Test Bed - Tsai, Van der Schaar, Young-Kwon Lim9765 Proposed Draft Requirements for Multimedia Test Bed […], v. 2 – Chun-Jen Tsai, Chung-
Neng WangDraft requirements accepted; IPMP section was left empty until more feedback had been obtaiend form IPMP exerts.
9788 Some ideas on profiles for MPEG-21 – Jaime Delgado, Eva Rodríguez, Isabel GallegoPresentation looked at past profiling experience and applied that to REL. It was agreed to start a separate AHG to study profiling in MPEG-21. At the next meeting, this AHG should be merged with the AHG on profiling and extensions of REL.
9850 MPEG-21 application: Content exchange in content creation process – Koichi EmuraQuestion is whether MPEG-21 should support the creation of content by many people. The Requirements Group thinks that was very much the vision of MPEG-21.
Requirement 2 (with differing governance on the constituent elements of a DI) and 3 (micro-payments) seem already accommodated in MPEG-21. MPEG-21 REL supports the aggregation of sublicenses to a license for a composite license for a composite DI. REL supports micro-payments as well. Requirements 2) and 3) together should support the composition of micro payment.
Requirement 1 on the creation of content: the question is whether MPEG-21 should standardize tools for the description of the content creation process? (Can we use something like templates?)
After some discussion, the Requirements Group welcomed the offer by Panasonic to provide a demonstration that will explain the ideas at the next meeting.
59
Annex 5Report of Systems meeting
Source: Olivier Avaro (France Telecom R&D)Contributors: Jan Van der Meer (Philips), Young-Kwon Lim (net&tv), Claude Seyrat (Expway), David Singer (Apple)
OverviewThe main outputs of the meeting from the Systems Sub-group perspective are:
No. Title TBP Available Editor13818-1 Systems
N5770 DoC on ISO/IEC 13818-1:2000/FPDAM3 No 2003/08/01 SamN5771 Text of ISO/IEC 13818-1:2000/FDAM3 No 2003/10/24 Jan
14496-1:2001/Amd.7 AVC in MPEG-4 SystemsN5772 Study Text of ISO/IEC 14496-1:2001/FPDAM7 No 2003/07/25 Young
14496-11:2003/Amd.2 ATGN5773 DoC on ISO/IEC 14496-11/PDAM2 No 2003/07/25 Jean-ClaudeN5774 Text of ISO/IEC 14496-11/FPDAM2 No 2003/08/04 Jean-ClaudeN5775 Text of ISO/IEC 14496-11/DCOR1 No 2003/08/25 Jean-ClaudeN5776 RER for OpenType Specification No 2003/07/25 Vladimir
14496-11 :2003/Amd.3 Audio BIFS ExtensionsN5777 WD 2.0 of ISO/IEC 14496-11/Amd.3 No 2003/07/25 Jens
14496-12/Amd.1 File FormatN5778 WD 2.0 ISO/IEC 14496-12/Amd.1 No 2003/07/25 David
14496-15 AVC File FormatN5779 DoC on ISO/IEC 14496-15/FCD No 2003/07/25 ZubairN5780 Text of ISO/IEC 14496-15/FDIS No 2003/08/11 Zubair
14496-17 Streaming Text FormatN5781 Request for new part of ISO/IEC No 2003/07/25 OlivierN5782 Text of ISO/IEC 14496-17/CD Streaming text
formatYes 2003/07/25 Jan
15938-1 SystemsN5783 Text of ISO/IEC 15938-1/DCOR1 No 2003/07/25 ClaudeN5784 DoC on ISO/IEC 15938-1/PDAM1 No 2003/07/25 ClaudeN5785 Text of ISO/IEC 15938-1/FPDAM1 No 2003/08/08 ClaudeN5786 Core Experiments for Systems Extensions No 2003/07/25 ClaudeN5787 Technology under consideration for
15938-1/Amd.1No 2003/07/25 Claude
N5788 MPEG-7 Systems reference software workplan No 2003/07/25 Claude21000-9 MPEG-21 File Format
N5789 WD 3.0 of ISO/IEC 21000-9 No 2003/07/25 DavidExplorations and Support
N5790 FAQ on IPMP-X Yes 2003/07/25 Craig
60
General issues
GeneralThe meeting report has been approved.
List of standards under development
Pr
Pt Edit.
Project
Description CfP WD CD FCD FDIS
2 1 2002 Amd.3 Carriage of AVC 02/05
02/12
03/07
4 1 2002 Amd.7 Use of AVC in MPEG-4 Systems
02/07
03/03
03/10
4 11 2003 Amd.2 Advanced Text and 2D Graphics
02/07
03/03
03/07
03/12
4 11 2003 Amd.3 Audio BIFS Extensions 03/07
03/10
04/03
04/07
4 11 2003 Amd.4 Streaming Text Format 03/03
03/07
03/12
04/03
4 11 2003 Cor.1 Scene Description Corrigendum
03/03
03/07
03/12
4 12 2003 Amd.1 ISO File Format Extensions 03/07
03/12
04/03
04/07
4 15 2003 1st Ed. AVC File Format 02/07
02/12
03/07
7 1 2002 Cor.1 Systems Corrigendum 02/12
03/07
03/12
7 1 2002 Amd.1 Systems extensions 02/03
02/07
02/12
03/07
03/12
21 9 200x 1st Ed. File Format 03/07
03/10
04/03
04/07
Latest references
Pr Pt Standard Issue No. Published2 1 ISO/IEC 13818-1:2000 (MPEG-2 Systems 2nd
Edition)00/12 2000/12/01
2 1 ISO/IEC 13818-1:2000/COR1 01/01 Pisa N3844
2002/03/01
2 1 ISO/IEC 13818-1:2000/Amd.1 (Metadata on 2) + COR2 03/07 Trondheim
N5867
Not
2 1 ISO/IEC 13818-1:2000/Amd.2 (Support for IPMP on 2) 03/03 Pattaya N5604
Not
2 1 ISO/IEC 13818-1:2000/Amd.3 (AVC Carriage on MPEG-2)
03/03 Pattaya N5771
Not
2 11 ISO/IEC 13818-1:2003 (IPMP on 2) 03/03 Pattaya N5607
Not
4 1 ISO/IEC 14496-1 (MPEG-4 Systems 3rd Ed.) 02/10 Shanghai
N5277
Not
4 1 ISO/IEC 14496-1:2001/Amd.3 (MPEG-4 IPMP Extensions) 02/10 N528 Not
61
Shanghai 24 1 ISO/IEC 14496-1:2003/Amd.1 (SL Extensions) 02/12 Awaji N547
1Not
4 8 ISO/IEC 14496-8 (MPEG-4 on IP Framework) 02/03 Jeju N4712
Not
4 11 ISO/IEC 14496-11 (MPEG-4 Scene Description)
02/10 Shanghai
N5278
Not
4 11 ISO/IEC 14496-11/Amd.1 (Multi-user and AFX) 02/10 Awaji N5480
Not
4 12 ISO/IEC 14496-12 (ISO Base Media File Format)
02/10 Shanghai
N5295
Not
4 13 ISO/IEC 14496-13 (IPMP-X) 02/10 Shanghai
N5284
Not
4 14 ISO/IEC 14496-14 (MP4 File Format) 02/10 Shanghai
N5298
Not
4 14 ISO/IEC 14496-14/Amd.1 (AVC File Format) 03/07 Trondheim
N5780
Not
7 1 ISO/IEC 15938-1 (MPEG-7 Systems) 01/07 Sydney N4285
2002/07/06
7 2 ISO/IEC 15938-2 (MPEG-7 DDL) 01/07 Sydney N4288
2002/02/02
DemonstrationsThe following demonstrations have been made:
Synthesized Texture (Vimatix): Demonstration of synthesized texture integration in Im1. MPEG-2 IPMP (Panasonics Singapore) M9786: Osmo4-GPAC : description and demonstration. Full MPEG-4 GPL implementation. M9827: Lightweight Graphics Adaptation.
FAQThe FAQ were updated as needed.
AOBM9800: Forward Erasure Correction for Variable Size packets of Continuous Media. Noted. Not in MPEG-4 Scope.M9780: MPEG-4 IPMP-X MOSES Interfaces For information. Noted.M9894: Stand alone Structured IPMP decoder for MPEG-4 IPMPX tools. Noted.
MPEG-2 Systems (13818-1)
GeneralM9710: Noted. Integrated document issued.
62
13818-1:2000/Amd. 3
Topics
Carriage of AVC Content in MPEG-2 SystemsContributions
Carriage of AVC Content in MPEG-2 SystemsM9712: USNB Contribution: Project editor addition. Accepted and implemented in a resolution from Systems.M9917: Noted and taken into account in the production of FDAM.M9701: See DoC. The Systems subgroup thanks the National Bodies for their thorough review of the carriage of AVC on MPEG-2 Systems specification and look forward to hear on the adoption of this specification by the industry.
MPEG-4 Systems (14496-1)
14496-1:2001 Amd.7
Topics
Elementary Stream Management1. Use of AVC in MPEG-4 Systems
Contributions
Elementary Stream ManagementNone.
MPEG-4 Scene Description (14496-11)
14496-11:2003 Amd.2
Topics
Scene Description2. Advanced Text and 2D Graphics
Contributions
Scene DescriptionM9927: Regular statement about IPR and trademarks. Sent to WG11 Convenor.
M9796, M9753: Comments on Amendment 2. See DoC.
M9752, M9750, M9751: CE finalized and approved. Efficient technology, very efficient for compressing and animating photo-realistic images. Not yet well integrated in MPEG architecture but on-going work on that. Very specific technology, very few participants (only one company supporting it). But interest from company to deploy it. Nobody has crosschecked the results in details. MPEG would welcome evidences that market will endorse that technology.
63
M9904: XMT Schema correction. Will be added in on-going corrigendum. New graphics feature : process set-up to analyse whether these features should go into BIFS or defined as PROTO.
M9790: BIFS has limitation for small footprint (memory, CPU) devices. Proposal to reduce the number of elements the decoder has to deal with. Simplify the scene tree. To be further studied in Core Experiment. Harmonization with XMT-O needs to be evaluated. Harmonization with SVG-Tiny to be studied. Simple transport for i.e. HTTP may need to be defined (to be assessed in AHG).
Joint Meeting with RequirementsM9936: Comments on the proposed structure of MPEG-4 Text Profiles. Issues:
Do we need a new dimension for text profile? Pro: let people combine easily with any graphic profile. Avoid explosion of profile. Cons: More complex P&L structure, people can define the combination right away as a graphic profile. Number of useful profile low anyway. To be further studied in an AHG.
Proposed structure for profiling and leveling the text spec. To be included into the profile under consideration.
M9920: Updates on the MPEG-4 X3D Interactive profile. To be included into the profiles under consideration.
M9834: To be further studied in AHG (See AHG mandate).
14496-11:2003 Amd.3
Topics
Scene Description3. New Audio BIFS
ContributionsM9859, M9759, M9817, M9860, M9861: Ref. Audio subgroup report.
M9731: Interest in making this application possible with MPEG. Not only one application but all range of application. Scope needs to be understood.Identify what could be the requirements on MPEG. Work to be carried out within the scope of an AHG.
14496-11 Exploratory activity
Topics
MPEG-JLow Complexity BIFSItems for Corrections
Contributions
MPEG-JM9827: New requirement identified “MPEG-4 Shall support APIs to synchronous rendering of audio, video, BIFS and other data coming from elementary streams”. Noted. Use of ETO to be further studied in AHG.
64
Low Complexity BIFSNone.
Items for CorrectionsNone.
ISO File Format (14496-12)
14496-12:2003 Amd.1
Topics
Extensions of the ISO File FormatContributions
Extensions of the ISO File FormatJoint Meeting with Audio and VideoTutorial of MP4 and use of metadata in MP4.
M9905: Cf. Audio report.
M9831: Accepted in principle, but (a) as a sampleentry extension, and (b) using enumerated values for the scaling, and (c) in one box with the scaling type and the center location.
M9830: Accepted.
M9855: Accepted in principle but we'd like to see more contributions on the subject. Can we distinguish burst (packet) loss and bit errors? What kind of axis should be used (enumeration as in the contribution, linear, logarithmic, etc.)? Should the information be in the sampleentry and thus attach itself to the encoded media? Should there be other 'error resilience' information (such as information about redundancy etc.) in this declaration (i.e. is it complete)?
M9907: On encrypted streams we agreed in principle to accept changes to the ISO file format and to MPEG-4 systems which would clearly indicate that a stream was encrypted and not decodable by a non-decrypting decoder. A contribution is expected detailing the proposed changes to MPEG-4 systems and to the ISO file format. The techniques in the ISO file format will be applicable both to MPEG-4 and non-MPEG-4 streams.
MPEG-4 AVC File Format (14496-15)
14496-15 AVC File Format
Topics
Elementary Stream Management4. AVC File Format
65
Contributions
Elementary Stream ManagementM9709: All NB comments were discussed and processed to the group's satisfaction.M9852, M9853, M9854, M9856, M9857, M9906: See DoC.
The document should be re-organized so that the generic extensions to the ISO Media File Format are in a separate section. The brand 'avc1' should indicate that these extensions are present. A future amendment to the ISO file format may move some of these into the base.
The file extension is always .mp4. If the file can be used without using avc extensions, and is otherwise compliant with the existing mpeg-4 brands mp41 or mp42, then the brands mp41 or mp42 may be used. If avc extensions are present, then the avc1 brand should be included.
Sections 5.4 and 4.2 should be merged into a single definition of a sample etc. The current split is confusing and unhelpful. The definition of a sample entry, sample format, etc. should be in an AVC-specific section.
Table 1 needs reformatting. Should be conformant to the canonical restrictions.
Add a Note: Warning about deviation from AVC HRD conformance when Filler Data NAL units are removed when storing in the File Format. This also holds true when zero_byte start codes are also removed from the bytestream, and redundant slices.
Add a note that what the hint tracks call "B frames" are really disposable (non-reference) frames in the AVC spec.
10.2 - buffersizeDB, max and average bit-rate are not computable from the VUI sequence parameters. If the encoder wishes to indicate something other than the values implied by the profile, then it can add an optional box to the sampleentry with more precise values.
Open issues in the AVC file format without input contributions were simply closed with no action.
66
MPEG-7 Systems (15938-1)
General
15938-1/Cor1
Topics
MPEG-7 Systems CorrigendumThe DCOR1 of MPEG-7 Systems has been produced
Contributions
MPEG-7 Systems CorrigendumNone.
15938-1/Amd 1
Topics
Joint meetingsAudioFew PDAM Ednotes were addressed jointly with the audio group concerning the uniform quantizers. The non uniform quantizer have been evaluated jointly and it has been agreed that the technology should be integrated in FPDAM.
Audio, Video, RequirementsMPEG-7 profiles and levels were considered. Sub-profiles might be required. However the current "schema based" framework for defining a profile seems to support it.
MPEG-7 Systems extensionsM9926: Taken as a basis for the production of the FPDAM.
M9676, M9891: See DoC. The Systems subgroup thanks the National Bodies for their thorough review of the MPEG-7 Systems extensions PDAM and look forward similar support for further ballotings.
M9663: TVA liaison letter on indexing scheme. The letter suggests a cooperative framework on the indexing solution. The group recognizes that the indexing of metadata stream is of high importance to the industry, with TV-Anytime having already adopted an appropriate technology. As suggested by the letter, a core experiments is defined and cooperative work of adapting TV-Anytime technology to MPEG-7 specificity is carried on.
M9892: Core experiments for MPEG-7 Systems extensions (Indexing Format). The contribution presents some indexing solution based on B-Trees which aims at speeding up data access. The proposal is promising but the implications it has on indexes management in case of changes are not well understood. The group proposes an attempt to improve the TV-Anytime proposed solution with some of the features presented in this contribution.
M9715: Fast random access within BiM Streams. This proposal is based on the work of TV-Anytime, and seeks to enhance MPEG-7 with the indexing functionality which is key to a range of
67
problems. It is a complete solution providing binary syntax. It presents a generic container description which embeds both AccessUnits and indexes. Indexes are organised in several layers: indexlist, indexes and subindexes. There is no software available yet, but the proponents commit to provide one before the next meeting. The group decided to continue this activity under the framework of a core experiment.
M9851: Report on MPEG-7 Systems CE-5quat: Evaluation of multiple description streams. This contribution presents the result of the core experiments on the evaluation of multiple description streams as an extension for the MPEG-7 Systems. It presents an overview of the fragment stream references solution, the constraints that must be applied to the referenced and referencing description streams and the use cases covered by the technology.
The following issues have been raised by the group: Inconsitency with BiM (regarding virtual root); Composition time issues ; The use of a URI table within the decoder init is not adequate as it will compromise the
flexibility of the mechanism; The intent of the decoderInit “subsetting” is not clear; Only 2-3 use cases are covered by the proposed technology; Implication with respect to indexing must be also evaluated; No BiM implementation has been provided.
The group decided to continue the core experiment on this topic.
M9805: Assessment of the relationship between fragment reference and multiple stream tools. This contribution presents the results of the CE related to comparing fragment references and multiple streams and present the notion of stream reference. Stream references are detailed on contribution m9851. The group decided to continue this work under the framework of a core experiment.
M9806: Proposal of a mechanisms for asynchronous inter-stream AU decoding orderingThis contribution presents a mechanism to address the decoding order issue – referred to as synchronisation – of inter-stream Access Units (AUs) in the asynchronous delivery mode. This mechanism is based on:
a distributed model of the terminal architecture, with description composer and elementary stream decoders as atomic components,
extensions of the AccessUnitType and FUPayloadType MPEG-7 system types
The group agrees that this mechanism is very important for the multiple stream feature. It should be addressed in the core experiment for multiple streams, implementation should be provided as well as a complete solution.
M9807: Proposal for a terminal architecture and stream syntax for the support of multiple description streams. This contribution proposes an architecture and new set of systems syntactic constructs that can support multiple description stream. The group decided to address this tools in the core experiment for multiple streams and implementation should be provided. The group emphasizes the need for a complete and verified solution at this late stage of the standardization process.
M9870: CE-8: Evaluation of Quantization Schemes for Binary Audio Metadata. This contribution presents an experiment showing what compression is possible if one uses multiple non-uniform quantizers. The results indicate that multiple non-uniform quantizers are able to achieve a factor of
68
two additional compression over the case of a single uniform quantizer. The group commented that the changes to the specification appear to be simple: all is needed is to define an additional attribute “dim” for certain types, e.g. “mean.” These changes to the specification will be incorporated into the FPDAM at this meeting. The reference software must also be changed to make the dim attribute available to the external quantizer, e.g. a non-uniform quantizer.
M9818: Report on MPEG-7 Systems CE-9 Item-f: multiple payload mode with rational position codes (Mini-Experiment). The group acknowledges the work on simplifying the sorting process. However, the group point at a specification inconsistency with the implicit assignment of rationale position code. The proposed informative annex will be included in the current amendment at the next meeting depending to the results of a mini experiment. Compression gain, complexity increases and the overall review of the rational position codes should be addressed by the mini-experiment.
M9889: Results of CE on Specification consistency – Item c – Schema Transmission Framework. The contribution presents the result of an implementation of the schema transmission framework. An enhancements of type codes is also proposed to avoid to recompute the complete type table. This promising improvement should be continued under the framework of a mini experiment. The group believes that the schema transmission technology is of high importance to the standard and acknowledges that the current implementation is in good shape but does not yet cover all the cases. Therefore the group decided to adopt the technology. The current text (available in the TuC) has been reviewed to cover only the cases proved by software implementation. The text has been integrated into the FPDAM.
MPEG-21 (21000)
21000-9
Topics
File FormatContributions
File FormatM9802: This contribution discussed using XPointer both within an MPEG-21 document, and also within the MPEG-21 container file format.
M9816: the contribution discussed addressing resources within an MPEG-4 and MPEG-21 presentation, and security.
DiscussionIt seems that the 9802 contribution goes in the right direction, addressing formal syntax for XPointer etc. The 9816 contribution covers concepts in sub-addressing of MPEG-4 (e.g. by track or OD_ID). The existing working draft has an important "item location" box which neither proposal fully use. We like the direction but would really like to combine the best features of these contributions and the working draft:
Have an MPEG-21 XPointer scheme for addressing items by item ID in the item location box;
Have MPEG-4 XPointer addressing schemes for selecting tracks by track ID or objects by OD_ID or streams by ES_ID (possibly with OD_ID);
69
Have it possible to recurse; if an MPEG-4 presentation is included in MPEG-21 file format, for example, or recursive MPEG-21.
The authors of these contributions, the editor (and any other volunteers) will work this out for the next meeting. We are delighted to see movement in this area!!
On security: we like the concept of being able to sign resources, but it should indirect through the item location box, we think. This both makes it more general (applicable to other than MPEG-21) and also keeps the addressing at the same level. There are questions here about what should be signed (how to detect the removal of a signature?), the overlap with XML signature (though we see that resource signing is outside that scope) and MPEG-21 resource security. Is there overlapping technology in MPEG-21 Architecture? Do we understand the requirements, at the MPEG-21 ('xml') level and at the file format level? There are detailed design matters (e.g. harmonization with the ISMA proposal) which can be easily managed. We will pursue an improved design in contributions while opening the discussion with MPEG-21 on this and the general architectural question. We should also discuss protecting parts or all of the MPEG-4 file format (and hope that we can generally apply the technique to box-structured files). There is technology in JPEG 2000 which may warrant investigation and harmonization. We note that IPMP can be used for this purpose for resources strictly within the MPEG-4 presentation, but not (for example) meta-data or other parts of the file format itself.
21000 Exploratory Activities
Topics
ArchitectureBinarisation
Contributions
ArchitectureM9803, M9679, M9682 Cf. Req. report.
BinarisationNone.
Beyond MPEG-21
Multimedia FrameworkSee Req. report.
70
Unpublished Systems Standard
Standard Title Status Document with
Purpose TopicsNo.
MPEG-2 Systems
13818-1:2000/Amd.1
Generic coding of moving pictures and associated audio information: Systems Amendment 1
FDIS 2002-10-25 SecretariatFDAM ballot was closed.Prepare AMD including Cor.1: to SC 29 by 03/07/25
Elementary Stream Management Carriage of Metadata in MPEG-2 Systems.
13818-1:2000/Cor.1
Generic coding of moving pictures and associated audio information: Systems Corrigendum 1
DCOR 2003-03 Secretariat Integration with Amd.1
13818-1:2000/Amd.2
Generic coding of moving pictures and associated audio information: Systems Amendment 2
FDIS 2003-07-25 Editor Final text editing Elementary Stream Management Carriage of AVC.
13818-1:2000/Amd.1
Generic coding of moving pictures and associated audio information: Systems Amendment 2
FDIS 2003-03-14 ITTF FDAM closing 03/09/10 IPMP Support for IPMP tools in MPEG-2.
13818-11:2003Generic coding of moving pictures and associated audio information: IPMP Extensions
FDIS 2003-03-14ITTF FDIS ballot to be issued on
03/07/17IPMP IPMP Tool Representation and Communication
Systems mapping on MPEG-2 Systems
MPEG-4 Systems
14496-1:2001/ COR1
Coding of audio-visual objects --Part 1: SystemsTECHNICAL CORRIGENDUM1
DCOR ballot : from ‘01-02-09 to ‘01- 05-09COR : ‘01-07-20
EditorTo be consolidated to 3rd Edition Miscellaneous correction to 14496-1
71
Standard Title Status Document with
Purpose TopicsNo.
14496-1:2001/Amd.2
Coding of audio-visual objects --Part 1: SystemsAMENDMENT 2: Textual Format
FDAM (Jeju w4698)2002-03[Editor's submission (FDAM and DOCR):2002-06]
EditorTo be consolidated to 3rd Edition
MPEG-4 Textual Format5. XMT-A6. XMT-
Scene Description7. Media Sensor8. MediaControl9. MediaBuffer10. MatteTexture
Elementary Stream Management11. OD Framework additions (OD
execute, Segment Descriptors)12. MP4 additions
Profiles and LevelsBasic2D, Core2D, Main2D, Advanced2D (Scene Graph and Graphics) profile.
14496-1:2001/Cor2
Coding of audio-visual objects --Part 1: SystemsTECHNICAL CORRIGENDUM2
Cor2 2002-10-25 EditorTo be consolidated to 3rd Edition Miscellaneous correction to 14496-1
14496-1:2003 Coding of audio-visual objects --Part 1: Systems Editor 3rd Edition
MPEG-4 Systems Edition 2003: Integration of 14496-1:2001, 14496-1:2001/Amd.1, 14496-1:2001 COR 1, 14496-1:2001/Amd;2, 14496-1:2001 COR2
14496-1:2001/Amd.3
Coding of audio-visual objects --Part 1: Systems Amendment 3 FDAM 2002-10-25 Editor Final Edits IPMP Extensions
14496-1:2003/Amd.1
Coding of audio-visual objects --Part 1: Systems Amendment 1 FDAM 2002-12-13 ITTF FDAM closing 03/07/22 SL Extensions
MPEG-4 Transport of MPEG-4 over IP Networks
14496-8Coding of audio-visual objects --Part 8: Transport of MPEG-4 over IP Network (14496-8)
FDIS (w4712)2001-12-07
Young-Kwon Integrate IETF comments
IETF RFC for transport of MPEG-4 over IPFramework for the carriage of MPEG-4 content over IP network.
MPEG-4 Scene Description and Application Engine
72
Standard Title Status Document with
Purpose TopicsNo.
14496-11Coding of audio-visual objects --Part 11: Scene Description and Application Engine
2002-10-25 Yuval 3rd EditionBIFSXMTMPEG-J
14496-11/Amd.1
Coding of audio-visual objects --Part 11: Scene Description and Application Engine Amendment 1
2002-12-13
SC29 To ITTF* ITTF doesn't issue FDAM ballot without submission of the original body, i.e. 14496-11.
Multi-user and AFX
MPEG-4 ISO Base Media File Format
14496-12Coding of audio-visual objects --Part 12: ISO Base Media File Format
2002-10-25ITTF FDIS ballot to be issued on
03/07/31 File Format
MPEG-4 IPMP Extension
14496-13 Coding of audio-visual objects --Part 13: IPMP Extension 2002-10-25 Craig Final Edits IPMP Extension
MP4 File Format
14496-14 Coding of audio-visual objects --Part 14 : MP4 File Format 2002-10-25 ITTF FDIS ballot to be issued in
mid-July MP4 File Format
14496-14/Amd.1
Coding of audio-visual objects --Part 14 : Amendment 1 2003-07-25 ITTF Final text editing AVC File Format
73
Published Systems Standard
Standard Title Status Topics
MPEG-2 Systems
13818-1/Amd.7
Generic coding of moving pictures and associated audio information: Systems AMENDMENT 7: Transport of ISO/IEC 14496 data over ISO/IEC 13818-1
Published 2000-12-01
Elementary Stream Management MPEG-4 Over MPEG-2
13818-1:2000Generic coding of moving pictures and associated audio information:Systems
Published 2000-12-01 MPEG-2 Systems Edition 2000
13818-1:2000/COR1Generic coding of moving pictures and associated audio information: SystemsTECHNICAL CORRIGENDUM 1
published on 2002-03-01
Elementary Stream Management FlexMux Descriptor
13818-1:2000/COR2Generic coding of moving pictures and associated audio information: SystemsTECHNICAL CORRIGENDUM 2
published 2002/12/01
Elementary Stream Management Buffer model for PID2.
MPEG-2 DSM-CC
13818-6/COR1
Generic coding of moving pictures and associated audio information – Part 6: Extensions for DSM-CCTECHNICAL CORRIGENDUM 1
Published 1999-12-01
Elementary Stream Management Editorial correction
13818-6/Amd.3
Generic coding of moving pictures and associated audio information --Part 6: Extensions for DSM-CCAMENDMENT 3: Transport buffer model in support of synchronized user-to-network download protocol
Published 2001-12
Elementary Stream Management Transport buffer model in support of synchronized user-to-network
download protocol.
74
Standard Title Status Topics
MPEG-2 Systems
13818-6/ COR2
Generic coding of moving pictures and associated audio information – Part 6: Extensions for DSM-CCTECHNICAL CORRIGENDUM 2
Published 2002 Q3
Elementary Stream Management Editorial correction
13818-6/ Amd.1:2000/COR1
Generic coding of moving pictures and associated audio information – Part 6: Extensions for DSM-CCTECHNICAL CORRIGENDUM 2
Published 2002 Q3 Elementary Stream Management
Editorial correction
MPEG-4 Systems
14496-1 Coding of audio-visual objects – Part 1: Systems
Published1999-12-15
Elementary Stream Management Systems Decoder Model Object Descriptor Framework Synchronization of Elementary streams Multiplexing of Elementary streams Object Content Information IPMPScene Description BIFSSyntactic Description LanguageProfiles and Levels
14496-1:1999/Amd.1Coding of audio-visual objects –Part 1: SystemsAMENDMENT 1: Systems extensions
Published 2001-11
Elementary Stream Management MPEG-4 File Format (MP4)Scene Description Application Window as a BIFS node Advanced Audio BIFS Material Keying Advanced coding (PROTO, Integration of Mesh, coding of Mfield).Application Engine (MPEG-J)Profiles and Levels
14496-1:1999/COR1Coding of audio-visual objects – Part 1: SystemsTECHNICAL CORRIGENDUM 1
Published 2001-11 Miscellaneous correction to 14496-1
75
Standard Title Status Topics
MPEG-2 Systems
14496-1:2001 Coding of audio-visual objects --Part 1: Systems
Published 2001-11
MPEG-4 Systems Edition 2001 Integration of 14496-1, 14496-1/Amd.1, 14496-1 COR 1
14496-1:2001/Amd.1Coding of audio-visual objects --Part 1: SystemsAMENDMENT 2: Extended BIFS
Published2001-10
Elementary Stream Management Flextime RebuferingScene Description Flextime nodes ServerCommand ExternProto Advanced BIFS CodingProfiles and Levels
MPEG-7 Systems
15938-1 Multimedia content description interface Part 1: Systems
Published 2002-07/06
MPEG-7 ArchitectureMPEG-7 dynamic descriptionsMPEG-7 binary format
15938-2 Multimedia content description interface Part 1: DDL
Published 02-02-2002 MPEG-7 DDL
76
Resolutions of Systems
Cf. WG11 resolution.
77
Action Plan
N° What Who When Status Trace1. Check Patent
statements & License for OpenType
David ASAP O Companies that have IP on OpenType spec. submitted Patent Statement but for Apple.
78
List of reviewed contribution
N° Title Authors9663 Liaison Statement from TV-Anytime Forum [SC 29 N 5316] SC 29 Secretariat9667 Liaison Statement from ITU-T SG 9 on Timed Text in MPEG-4
and the Brand Name Issue of the File Format [SC 29 N 5346]SC 29 Secretariat
9676 Summary of Voting on ISO/IEC 15938-1/PDAM 1 [SC 29 N 5378]
SC 29 Secretariat
9679 USNB Contribution: Usage of dii:Type’s in MPEG-21 A. G. Tescher9682 AUNB Contribution: Usage of dii:Type’s in MPEG-21 AUNB9701 Summary of Voting on ISO/IEC 13818-1:2000/FPDAM 3 [SC
29 N 5392]SC 29 Secretariat
9709 Summary of Voting on ISO/IEC FCD 14496-15 [SC 29 N 5404] SC 29 Secretariat9710 Summary of Voting on ISO/IEC 13818-1:2000/Amd.1/DCOR 1 [SC 29 N
5405]SC 29 Secretariat
9712 USNB Contribution: Project editor addition A. G. Tescher for USNB
9715 Fast Random Access within BiM Streams Keith Millar9731 Proposal for Music Notation Modeling and its integration within MPEG-4
and MPEG-7Giorgio Zoia et al.
9750 Report on Synthesized Texture Coding and Animation CE Ehud Spiegel et al.9751 Synthesized Texture node definition, description and coding Yoram Elichai et al.9752 Israeli NB Comment on Synthesized Texture CE (N5648) and
Text of ISO/IEC 14496-11/PDAM2 (N5645)Ehud Spiegel et al.
9753 Corrections to the BIFS ATG Extensions Jean Le Feuvre et al.9759 Comments on AudioBIFS v3 WD Giorgio Zoia9780 MPEG-4 IPMP-X MOSES Interfaces Filippo Chiariglione
et al.9786 Osmo4-GPAC : description and demonstration Jean Le Feuvre et al.9790 Proposed specification of BIFS Low Complexity Jean-Claude Dufourd9796 Summary of Voting on ISO/IEC 14496-11/PDAM 2 SC 29 Secretariat9800 Forward Erasure Correction for Variable Size packets of Continuous
MediaDoug Young Suh et al.
9802 MPEG-21 descriptions and file format addressing schemes Sylvain Devillers et al.9803 Requirements for MPEG-21 descriptions and file format
addressing schemesSylvain Devillers et al.
9805 Assessment of the relationship between fragment referece and multiple stream tools
Rui J.Lopes
9806 Proposal of a mechanism for asynchronous inter-stream AU decoding ordering
Rui J. Lopes
9807 Proposal for a terminal architecture and stream syntax for the support of multiple description streams
Rui J. Lopes
9816 Media Resource Addressing Technique in DID Yongju Cho et al.9817 Consideration on audioFXReverb PROTO Jeongil Seo et al.9818 Report on MPEG-7 Systems CE-9 Item f: multiple payload
mode with rational position codes (Mini-Experiment)Shuichi WatanabeYasuaki Tokumo
9827 Lightweight Graphics Adaptation, integration of portable 3D graphics in MPEG-4
Itaru Kaneko et al.
79
N° Title Authors9830 Usage of the Movie Fragment Tadamasa Toma
Yoshinori Matsui9831 Visual Presentation in MP4 Tadamasa Toma
Yoshinori Matsui9834 Simple Vertex based animation technique Mario Gutierrez et al.9851 Report on MPEG-7 Systems CE-5quat: Evaluation of multiple
description streamsTomohiro Azami Rui J. Lopes
9852 Finnish NB comments on AVC file format Ye-Kui WangMiska M. Hannuksela
9853 Issues of gradual decoding refresh in AVC file format Ye-Kui Wang9854 Redundant pictures in AVC file format Miska M. Hannuksela
Ye-Kui Wang9855 Signaling of error resilience information in file formats Ye-Kui Wang
Emre Aksu9856 Bitrate information in media tracks Ye-Kui Wang9857 Support of sub-sample in file formats Ye-Kui Wang9859 Update to WD 1.0 of ISO/IEC 14496-11/Amd.3 Juergen Schmidt et
al.9860 Comments on 3D Audio in a 2D Scene context Juergen Schmidt9861 AudioFX solutions for small systems with reduced
implementation overhead; an examinationKlaus Eilts-Grimm
9870 CE-8: Evaluation of Quantization Schemes for Binary Audio Metadata
Jan Rohden Jürgen Herre
9889 Results of CE on Specification consistency – Item c – Schema Transmission Framework
Peter LedererAndreas HutterJoerg Heuer
9891 GNB Comment on on progressing towards ISO/IEC FCD 21000-7 and towards ISO/IEC FPDAM1 15938-1
Andreas Hutter on behalf of the GNB
9892 Results on CE-10: Fast Random Access Andreas Hutter et al.9894 Stand alone Structured IPMP decoder for MPEG-4 IPMPX
toolsClaudio Alberti et al.
9904 XMT Schema Corrections and Advanced Graphics items Steve Wood et al.9905 MP-4 File Format: Interoperability issue/error pertaining to
the storage of AAC encoded contentDave Singer et al.
9906 Definition for Multiple Frames per Sample in the AVC File Format
Mitsuhiro Hirabayashi.
9907 Storage of encrypted media in MP4 Dave Singer et al.9917 Some Remarks on N5605 Study on MPEG-2 Systems for AVC
VideoGary Sullivan
9920 Updates on the MPEG-4 X3D Interactive profile Mikael Bourges-Sevenier
9926 Editor’s study of ISO/IEC 15938-1/PDAM1 Seyrat9927 IPR and Trademark statements Vladimir Levantovsky9932 Liaison Statement from 3GPP TSG SA WG4 SC 29 Secretariat9936 Comments on the proposed structure of MPEG-4 Text Profiles Vladimir Levantovsky
Paul Nelson
80
Annex 6Report of MDS meeting
Source: John R. Smith (on behalf of MDS sub-group)
Chair (contact):John R. SmithIBM T. J. Watson Research Center30 Saw Mill River RoadHawthorne, NY 10532 [email protected]
The MPEG MDS sub-group’s activities included work items for MPEG-7 and MPEG-21 standards as shown in Figure 1. The primary work items for the week included the following:
MPEG-7:o MPEG-7 Part 5 – MDS Extensions FDAMo MPEG-7 Part 8 – Profiles WDo MPEG-7 Part 10 – Schema Definition (new!) CD
MPEG-21:o MPEG-21 Part 2 – Digital Item Declaration AMD/1 WDo MPEG-21 Part 5 – Rights Expression Language FDISo MPEG-21 Part 6 – Rights Data Dictionary FDISo MPEG-21 Part 7 – Digital Item Adaptation FCDo MPEG-21 Part 10 – Digital Item Processing WD
Figure 1. Overview of MPEG Multimedia Description Schemes Sub-Group work items for 65 th
Trondheim meeting.
MPEG MDS Group activities
MPEG- 21:• DI D (FDI S AMD)• DI I (FDI S)• REL ( FDIS)• RDD ( FDIS)• DI A ( FCD)• DI P (WD v.2)
MPEG- 7 v.2:• AMD/1 (FDAM)• AMD/2 (WD)• Conformance
(CD)
MPEG- 7 v.1:• Extension• Profiles• Schema
Definition
81
Num.
Contributions
Agenda, Goals and Issues for the Week for MDS Sub-Group
Agenda, Goals and Issues for the Week for MDS GroupJohn R. Smith
During the kick-off session, the workplan for the week for MPEG-7 and MPEG-21 development was discussed and approved. Furthermore, the following points were discussed:
Organization of work into main MDS track with BoGs (REL/RDD/DIA/DIP)o All work held in main MDS track except where indicated for specific Break-out
Groups (BoG) Scheduling of MDS sub-group plenary meetings for Wednesday and Thursday Plan for generating revised MPEG-7 Multimedia Description Schemes AMD/1,
AMD/2,and XM Plan for producing MPEG-21 Rights Expression Language DoC and FDIS Plan for producing MPEG-21 Rights Data Dictionary DoC and FDIS Plan for generating MPEG-21 Digital Item Adaptation FCD, DoC, and and AM v.6 Plan for software development for MPEG-21 REL, RDD, DIA Schedule of joint meetings
MPEG-7 activities: MPEG-7 Extensions:
o MPEG-7 Schema Extension Processo MPEG-7 MDS AMD/1 FDAMo MPEG-7 MDS AMD/2 WD
MPEG-7 Profiles (joint meeting):o Joint with Requirements, Systems, Video, Audio
MPEG-7 Conformance:o AMD/1 (Version 2 bitstreams)
MPEG-21 activities: MPEG-21 Rights Expression Language (Part 5):
o Activity leaders: Barney Wragg, T. DeMartini o Input:
NB Comments Editors’ Input on REL Software contributions on REL Liaison statement (EDItEUR)
o Actions: Review and dispose NB comments Update REL software plan Update MPEG-21 MDS FAQ
o Output: MPEG-21 REL FDIS and DoC
MPEG-21 Rights Data Dictionary (Part 6):o Activity leaders: C. Barlas, G. Rust
82
o Input: NB Comments Editors’ Input on RDD Ref. SW on Multilingual RDD Liaison statement (OMA)
o Actions: Review and dispose NB comments Update RDD software plan Update MPEG-21 MDS FAQ
o Output: MPEG-21 RDD FDIS and DoC
MPEG-21 Digital Item Adaptation (Part 7):o Activity leaders: A. Vetroo Input:
DIA Editors’ Input, AM 5.1, AHG reports (2) CE reports (6) & proposal documents (8)
o Actions: Review and dispose NB comments Review CE results and proposals Refine DIA spec. & define core experiments Update DIA reference software plan
o Output: MPEG-21 DIA FCD and DoC MPEG-21 DIA Software Implementation Plan v.4
MPEG-21 Digital Item Processing (Part 10):o Input:
Input contributions (8)o Actions:
Review proposal documents Define CE’s Revise DIP WD and DIP PM
o Output: MPEG-21 DIP WD v.2, PM v.2 MPEG-21 DIP CEs MPEG-21 DIP Software Implementation Plan v.2
Joint Meetings (as of Monday): MPEG-7:
o Tues (14h00 - 16h00): MPEG-7 Profiles with Requirements, Audio, Video, Systems
MPEG-21:o Tues (09h00 – 10h00): MPEG-21 REL/RDD with Requirementso Tues (10h00 – 11h00): MPEG-21 with Requirementso Tues (11h00 – 12h00): MPEG-21 Reference Softwareo Wed (11h00 - 13h00): MPEG-21 Plenary with Requirementso Tues (17h00 - 18h00): MPEG-21 REL SW with Integrationo Wed (15h00 - 16h00): MPEG-21 DIA Software with Integration
83
o Wed (16h00 - 16h30): MPEG-21 Audio DIA with Audio
MPEG Standards Development Rule: To work on a new technology within an approved work item we require:
o Agreement that the technology is needed to satisfy the requirementso A minimum number of companies actively participating is requiredo If the number is deemed by chairman to be too low a specific resolution will be
passed with the name of the companies actively participating and those supporting
o Software implementation of tools as a requisite to progress to FCDo Full software implementation as a requisite to progress to FDISo Integration of these software tools into the reference software framework
Break-out Groups (created at kick-off meeting): Rights Expression Language (REL):
o Mandates: Review NB comments Prepare DoC and FDIS
o Schedule: Mon, Tues, Thurs
Rights Data Dictionary (RDD):o Mandates:
Review NB comments Prepare DoC and FDIS
o Schedule: Tues
Digital Item Adaptation (DIA):o Mandates:
Review NB comments Prepare DoC and FCD
o Schedule: Tues, Thurs
Digital Item Adaptation BSD:o Mandates:
Discuss open issues BSD Link DIA FCD (REF SW add to Adaptation QOS) Adaptation QoS DIA FCD (REF SW add to Adaptation QOS)
… as listed in CE report Workout detailed CE workplan addressing open issues
Two core experiments Draft response for disposing related comments
MPEG-21 Digital Item Processing:o Mandates:
Review proposals that have been submitted Prepare WD v.2 Define CEs as needed
84
o Schedule: Thurs
Review of AHG resolutions and action points:
Doc No. Contribution Source
9645 AHG on Metadata InteroperabilityDavid Singer, Eric Rehm , Peter Mulder, Masanori Sano
Topic: Explored metadata interoperability with ID3, 3GPP, EXIF, MXFResults: Most work on mapping to ID3, 3GPP, EXIF carried out under profiles work (proposal for
simple metadata profile) No new activity on MXF DMS-1 given that new effort to XML-ize MXF is being developedActions: Review simple metadata profile (joint meeting on Profiles) Continue to adopt new elements/attributes to AMDs as needed (start MDS AMD/2) Recommendation to merge with ongoing MPEG-7 profiles AHG
9650AHG on Use of DID by other MPEG 21 parts Gerrard Drury, Do-Nyun Kim
Topic: Develop new definition for CDI Discuss issues related to use of DID across MPEG-21Results: Input contribution: m9755 – Suggestions concerning MPEG 21 Digital Item Declaration Proposing new definitions of CDI/XDI Actions: Discuss CDI/XDI definitions in joint meeting with Requirements Continue AHG activities
9646AHG on Editing the MPEG-21 Rights Expression Language Barney Wragg, Thomas DeMartini
Topic: Edit SoCD Review and prepare DoC based on early comments Finalize DoC and FDISResults: Two technical comments: Authorization Algorithm and Revocation
o Authorization Algorithm: can currently get output that is unusable or undefined. Change to make less prescriptive and more declarative should reduce complexity
o Revocation taking away of a right, probably less impact than Authorization Editor’s input to meeting based on comments revisions of both Authorization and
RevocationActions: Complete DoC and prepare FDIS
9647AHG on Profiles and Extensions of the MPEG-21 Rights Expression Language Brad Gandee, Barney Wragg
Topic:
85
AHG addressing anticipated interest of mobile community in RELResults: OMA was not interestedActions: SC36 WG4 on Learning technologies could be extensions of MPEG REL and OeBF Could pursue as profile with implication for developing specific application for REL reference
SW
9648AHG on MPEG-21 Publishing Extension Chris Barlas, Brad Gandee
Topic: Work with OeBF and Editeur to study implications of extensionsResults: Extension is new namespace that defines terms for use in RELActions: Recommend to continue AHG
9649AHG on RDD Reference Software and Editing Chris Barlas, Godfrey Rust
Topic: Complete editing and prepare draft DoC on FCD Continue development of RDD reference SW requirements and integration with RELResults: 16 NB comments on RDD FCD Input Editor’s draft Two contributions for RDD SW to this meeting Prepared draft DoC with some clarifications on reflector prior to Trondheim meetingActions: Assess software contributions and integration with REL/RDD SW plan Complete DoC and prepare FDIS
9651AHG on Editing MPEG-21 Digital Item Adaptation Study of CD & AM
Anthony Vetro, Andrew Perkis, Christian Timmer, Eric Delfosse
Topic: Editing details documented in 9651. Results: Completed DIA CD and AM v.5Actions: Need joint meeting with Implementation studies group (ISG) to address complexity issues
9652AHG on Core Experiments for MPEG-21 Digital Item Adaptation Jeho Nam, Debargha Mukherjee
9730 CE report on audio adaptationQoS
Eunmi Oh, SangJo Lee, MiYoung Kim, Youngsik Huh, SangWook Kim, Bernhard Feiten, Ingo Wolf
9741Report of CE on AdaptationQoS and BSDLink C. Timmerer, on behalf of the CE
9745 report of Transmoding Core ExperimentMariam Kimiaei Asadi, Jean-Claude Dufourd, Truong Cong Thang
9833CE on DIA Configuration and Messaging
Letian Rong, Zhongyang Huang, Eric Delfosse
86
9849Report of CE on Metadata Adaptation – Integration
Nicola Adami , Sergio Benini , Riccardo Leonardi, Hirofumi Nishikawa
9897Results of Mini-experiment on CPU capabilities in DIA
Chris Joslin, Thomas Di Giacomo, Nadia Magnenat-Thalmann
Topic: The results of all MPEG-21 DIA core experiments were reported by CE AHGResults: Recommendations from CE on Metadata Adaptation
o Adopt Unified syntax for metadata adaptation by merging the two description schemes (MetadataAdaptation Hint and Integration DS) syntaxes in the MPEG-21 DIA FCD
o Submit the Reference SW Recommendations from CE on AdaptationQoS and BSDLink
o Promote refined AdaptationQoS to FCD, once the listed open issues are solvedo Promote BSDLink to FCD, once the listed open issues are solved.o Promote BSDTransformationInstructions to AMo Establisth a continued CE to investigate on the tools of Constraints and BSDTrIs o Clarify if the outcome of the future CE can be adopted into the FCD o Discuss requirements (m9221) during the meetingo Establish a BoG with following mandates:
to discuss open issues wrt AdaptationQoS as listed in the CE report to discuss open issues wrt BSDLink as listed in the CE report work out a detailed CE work plan which addresses the unsolved open
issues to recommend improvements of tools for AM and/or FCD to the MDS
group by the end of the week Recommendations from CE on DIA Configuration and Messaging
o Promote of DIA Configuration (DIAC) schema into the DIA FCDo Adopt the XPointer proposal for DIA descriptor linkingo Clarify the difference with DID Configuration Preferences
Recommendations from CE on Transmoding Consider open issues and revisit to clarifiy in MDS meeting during the week
o Reconsider the recommendation in CE report Recommendations from CE on Audio AdaptationQoS (Joint Audio/MDS groups)
o Promote the adaptation operations (termID=3.6-3.7) in AM to the DIA FCDo Adopt audio utilities; Objective Difference Grade (ODG) and Distortion Index
(DI), into AdaptationQoS CS (termID=2.3-2.4) in the DIA FCDo Rename the “AudioFGS” operator to “ScalableAudio” operator
Actions: Continue BoG meetings and joint meetings as needed
9653 AHG on Editing MPEG-21 DIPRik Van de Walle, Ian Burnett, Munchurl Kim, Vishy Swaminathan
Topic: Edit the Working Draft WD1.0 of MPEG-21 DIP. Encourage submissions of further DIBOs and discussion of the level of DIML and DIBO
processing. Discuss and encourage demonstration of DIxOs that illustrate the use of this extensibility
mechanism.
87
Produce study on WD1.0 and recommendations on improving WD1.0.Results: The first mandate has been realized immediately after the Pattaya meeting. The second mandate has been realized. There were no discussions on the reflector concerning the third mandate. However, proposals
dealing with this mandate have been submitted to the Trondheim meeting. Related to the fourth mandate, several proposals have been distributed via the reflector. They
will be discussed further during the Trondheim meeting.Actions: Keep the AHG on MPEG-21 Digital Item Processing "alive" after the Trondheim meeting. Prepare Working Draft v.2 during Trondheim meeting Establish methodology/guidelines to assess DIBO proposals
o This applies to new DIBOs and DIBOs that were already mentioned in WD v.1. Some first thoughts on this issue are listed below:
o Need for/relevance of including a new DIBO should be illustrated via a commitment to implement the DIBO and (core) experiments / demonstrators.
MPEG-21 Digital Item Declaration (DID):
Doc No. Contribution Source
9755Suggestions concerning MPEG-21 Digital Item Declaration
Jeroen Bekaert, Patrick Hochstenbach , Wesley De Neve, Herbert Van de Sompel, Rik Van de Walle
Topic: Internal contradiction wrt to definition of Resource element compared to StatementResults: Resource and Statement
o Should allow inclusion of XML within Resourceo Statement should allow inclusion by Referenceo Encoded vs. unencoded resources
Actions: Rules:
o Requirements – proponents will this work identify relevant requirements and explain how proposed solution satisfies those requirements
o Minimum active participants – Ghent, Los Alamos Labs, UoW Start AMD/1 on DID (“DID Extensions”)
MPEG-21 DIA Editing:
Doc No. Contribution Source
9902 Editors Input on DIA FCDAnthony Vetro, Andrew Perkis, Christian Timmerer
9903MPEG-21 Digital Item Adaptation AM v5.1
Anthony Vetro, Andrew Perkis, Christian Timmerer
9696Error log for MPEG-21 DIA AM schema v5.0
Jijun Zhang (NTNU) , Andrew Perkis (NTNU)
Topic:
88
Editor’s input on FCD and AM v5.1Results: Reviewed suggested editor’s revisions since Pattaya meeting on MPEG-21 DIA
(Editor’s input on FCD and AM v5.1)Actions: Main activities for week include reviewing and disposing of NB comments and
creating MPEG-21 DIA FCD Created DIA reference software peer review process to be carried out during
Trondheim meeting:o Peers to review the 20 DIA reference SW modules and report back to
group later in weeko Assessment forms to be completed
MPEG-21 DIA National Body Comments :
Doc No. Contribution Source
9673Summary of Voting on ISO/IEC CD 21000-7 [SC 29 N 5385] SC 29 Secretariat
9681Swiss NB Comment for Levels of Articulation for Virtual Humans
Chris Joslin, Thomas Di Giacomo, Stephane Garchery, Tom Molet, Nadia Magnenat-Thalmann
ANB comment on ISO/IEC CD 21000-7 (Digital Item Adaptation) C. Timmerer, on behalf of the Austrian NB
9724
Belgian National Body Comment on ISO/IEC 21000-7 CD – Part 7: Digital Item Adaptation document ISO/IEC JTC 1/SC 29/WG 11/N5353 Jan Bormans, on behalf of the BNB
9733Further SgNB Comment on ISO/IEC CD 21000-7 (MPEG-21 DIA) C. J. Lee
9747JNB Comments on Study of ISO/IEC 21000-7 CD (MPEG-21 DIA) Mikio Sasaki for JNB
9758French National Body Position on MPEG-21 DIA NetworkCharacteristics Alexandre Cotarmanac'h
9841Response to USNB on ISO/IEC CD 21000-7 (DIA) Gerrad Drury, Ian Burnett
9891
GNB Comment on on progressing towards ISO/IEC FCD 21000-7 and towards ISO/IEC FPDAM1 15938-1 Andreas Hutter on behalf of the GNB
Topic: NB comments on MPEG-21 DIAResults: NB comments reviewed in main MDS and DIA BoG meetings during weekActions: Editing actions reflected in DoC on MPEG-21 CD MDS resolutions made with respect to digital item adaptation rights and commitment to
reference software and core experiments for promotion
MPEG-21 REL/RDD Requirements :
89
Doc No. Contribution Source
9650AHG on Use of DID by other MPEG 21 parts Gerrard Drury, Do-Nyun Kim
Topic: Repeat of AHG report (above)Actions: Follow up DID revisions in MDS and review impact on dii:type on Wed in joint meeting.
9647AHG on Profiles and Extensions of the MPEG-21 Rights Expression Language Brad Gandee, Barney Wragg
Topic: MPEG-21 REL profiles and extensionsResults: No progress made wrt to OMA. New possibility for profile for e-learning. Actions: Recommend to combine this AHG with Publishing extension work.
9675
Liaison Statement from the Open Mobile Alliance (OMA) [SC 29 N 5371] SC 29 Secretariat
Topic: Request from OMA for MPEG to help with mapping from REL to OMA DRM REL using
RDDActions: MPEG to reply as follows:
o (1) on how RDD can be used to do such a worko (2) inform OMA that MPEG is working on IPMP interoperability in MPEG-21.
9935 Liaison Statement from EDItEUR Brian GreenTopic: Requests registration mechanism or directory for extensions of REL More directed towards promotion rather than signaling. MPEG-21 already allows signaling
of “extensions” using namespaces. However, it is not possible to find the information on the specification for the extension.
How and why should MPEG “know” about extensions of REL? – some could be “private”.Actions: Action – add mandate to extensions AHG to study if and how such a directory or discovery
mechanism should be established.
MPEG-21 Plus :
Doc No. Contribution Source
9814Remote Digital Item Methods for MPEG-21 Messaging Lakshan De Silva, Ian Burnett
Topic: Proposed that DIMs support remote invocation. This would allow, for example, one peer to
call methods on another peer, e.g., addtrackResults: Mandate to further work on requirements remote DIMs, create AHG or work this week.Actions:
90
Need to gather support Ultimately, need to provide software implementation Organize BoG to discuss this week (Thurs. 9-11)
MPEG DIA Description Message:
Doc No. Contribution Source
9845
General analysis and technical discussion on DIADM tool for DIA application
ZY Huang, SM Shen, M Ji, Taka Senoh, Takafumi Ueno, Takuyo Kogure
Topic: Discussion of general issues and analysis of DIA DM tool DIADM tool provides a means for updating descriptions USNB – raised some issues
o Transport of state out of scopeo More general need in MPEG-21o Overlap with tools in MPEG-7
Requirementso Argument that messaging tool does not satisfy stated requirements
Argument that tool does specify normative behavior, e.g., ordering of messaging, protocol, etc.
Other comments from other NBs – JNB, UKNB UKNB – agrees with USNB comments. Another comment that identification of peers needs
more thought Comment – not messaging but rather method for updating descriptors. As for identification of
peers, possibility to use DII. Biggest problem is terminology – message – has caused much confusion. Descriptor update tools os required.
Comment – tool has been developed to update descriptors, which is a requirement. Comment – lacks flexibility to achieve application framework. But, this point is not agreed. If removed, how would this requirement be satisfied?
o DIP RPC tool? – may be possible, but analysis is not complete Are updates needed in other parts of MPEG-21
o IPMP, Event Reporting, other placeso However, DIA needs now …
Question of timing – overarching requirements MPEG-7 provides a standard tool for updating descriptions
o Seems to satisfy this requirementso Version 1 – does not identify description to be updatedo AMD/1 – provides referencing mechanism
Good understanding the MPEG-7 Systems can satisfy the requirement (as explained in detail by MPEG-7 systems)
Actions: MDS group agrees to reconsider adoption of tool for updating should MPEG-7 systems not be
satisfactory
MPEG-21 DIA DIA Bitstream Description / Adaptation QoS :
Doc No. Contribution Source
91
9772Proposal for a Universal Constraints Descriptor in DIA
Debargha Mukherjee, Geraldine Kuo, Sam Liu, Giordano Beretta
9773
Model-based lightweight BSD Transformation Instructions and Reserved Marker Token Formats
Debargha Mukherjee, Geraldine Kuo, Sam Liu, Giordano Beretta
9793
Development of a fully format-independent adaptation engine using current and proposed DIA tools
Geraldine Kuo, Debargha Mukherjee, Sam Liu, Giordano Beretta
Topic: MPEG-21 DIA BSD and Adaptation QoSActions: BoG meetingActions: Discuss open issues
o BSD Link DIA FCD (REF SW add to Adaptation QOS)o Adaptation QoS DIA FCD (REF SW add to Adaptation QOS) o … as listed in CE report
Workout detailed CE workplan addressing open issues Two core experiments Draft response for disposing related comments
MPEG-7 Profiles (with Requirements):
Doc No. Contribution Source
9627 AHG on MPEG-7 Interoperability and Profiling Wo Chang
9746Statement in Support and Improvement of the Video Program Profile (VPP)
Masanori Sano, Alan Melby, Bhavan Gandhi
9760 Merging Relevant Tools from SP into the VPP Bhavan Gandhi
9825Levels and templates for CoreContentDescriptionProfile
Masanori SANO, Masahiro SHIBATA
9864Propose Update Profile under Consideration (PuC) Wo Chang
9866 Propose MPEG-7 Profile Working Draft Wo Chang
9867M7Profile Conference Call Report (for discussion) Wo Chang
9868 M7ITB Available Tools Wo Chang
9896 Support for MPEG-7 User Description ProfilePeter van Beek, Shuichi Watanabe, Ibrahim Sezan, Kyoungro Yoon
9899Signaling of profile & level in MPEG-7 descriptions Peter van Beek
9900 Towards a Simple Metadata Profile
Wo Chang, Bhavan Gandhi, Schuyler Quackenbush, Eric Rehm, David Singer, John R. Smith, Vetro
9901Supporting MPEG-21 DIA with MPEG-7 User Description Profile Anthony Vetro, Peter van Beek
92
9937
Proposed Process for Managing MPEG-7 Schema Extensions and Versions and their Relation to Profiles John R. Smith
Topic: Joint meeting with Requirements, MDS, Systems, Audio, VideoResults: Discussed status of MPEG-7 profiles under consideration Discussed terminology with respect to “levels” Discussed MPEG-7 schema extension and schema definition mechanismActions: Three profiles to be added to PuC indicating that they are under development:
o User Description Profileo Simple Metadata Profileo Core Content Description Profile
New process to be adopted for specifying MPEG-7 schema extensions via MPEG-7 part 10
MPEG-21 RDD DoC on FCD:
Doc No. Contribution Source
9649AHG on RDD Reference Software and Editing Chris Barlas, Godfrey Rust
9703Summary of Voting on ISO/IEC FCD 21000-6 [SC 29 N 5395] SC 29 Secretariat
9847 MPEG 21000-6 (RDD) Editors' Version Chris Barlas, Godfrey RustTopic: Reviewed all NB comments and discussed proposed disposition from RDD BoG.Results: MDS group accepted each of the dispositions and finalized DoC. Results are reflected in DoC on RDD FCD
MPEG-21 REL SW:
Doc No. Contribution Source
9729A Linux Implementation of MPEG-21 REL Reference Software Ying Sha , Yuzhuang Hu
Topic: GUI tool and linux implementation – select license, select query file, check boxes for
validation during load and logging.Results: Ports the previous REL SW submission from ContentGuard to LinuxActions: Add to MPEG-21 REL/RDD reference SW plan
9743 DMAG REL Tool Implementation Eva Rodriguez, Jaime DelgadoTopic: REL implementation using XQueryResults: Uses XQuery to search for matching grants from licenses, extracts those grants and extracts
93
the conditions Does not currently support grants that use variables, however, proponents think that XQuery
may work in this case and will be further investigatedActions: Add to MPEG-21 REL/RDD reference SW plan
9898
A Linux Version of the Example Implementation of MPEG-21 REL Reference Software
Xin Wang , Venkatraman Venugopal , Robert Chancellor , Joseph Fung
Topic: Linux implementation of prior codeResults: Porting of prior code; includes all source and Makefile for Linux.Actions: How to address other functionalities of REL?
o Dimensions for REL SW implementationo Validation rules checkero Variables vs. no variableso How many rights (should generalize)o How many conditions
Add to MPEG-21 REL/RDD reference SW plan
9649AHG on RDD Reference Software and Editing Chris Barlas, Godfrey Rust
Topic: Useful to separate into two parts:
o Exemplary XML Schemao Storage and retrieval tool for translated terms
Query of RDD Value as reference software demonstrating that RDD can be queriedActions: Recommendation to integrate REL & RDD for implementation demonstrating whether one
REL right is included in another, eg., if Adapt then Play.
9748Reference Software for the Multilingual RDD Registry
Senator Jeong, Weon-Geun Oh, Ki-Song Yoon
Topic: Multi-lingual RDDResults: Tool allows querying RDD in five languages (Chinese, English, French, Japanese, Korean)
and browsing and search of XML representation of RDDActions: Add to MPEG-21 REL/RDD reference SW plan
MPEG-21 Digital Item Processing:
Doc No. Contribution Source
9653 AHG on Editing MPEG-21 DIPRik Van de Walle, Ian Burnett, Munchurl Kim, Vishy Swaminathan
9754
Suggestions concerning MPEG-21 Digital Item Method Operations and their implementation
Frederik De Keukelaere, Wesley De Neve, Robbie De Sutter, Rik Van de Walle
94
9842Digital Item Method/Operations in DIP for MPEG-21 DIA
ZY Huang, SM Shen, M Ji, Taka Senoh, Takafumi Ueno, Takuyo Kogure
9846Proposed additional DIBOs for MPEG-21 DIP Gerrard Drury, Ian Burnett
9877
Some DIBO's functions for the linkages of DIP-DIA and DIP-IPMP in MPEG-21 DIP
Jeewoong Ryu, Munchurl Kim, Jong-Nam Kim, Keunsoo Park
9878Some DIBO's for the linkages of DIP-DIA and DIP-IPMP in MPEG-21 DIP
Jeewoong Ryu, Munchurl Kim, Jong-Nam Kim, Kweonsoo Park
9912Draft text input and additions to the DIP Working Draft
Vishy Swaminathan, Gautam Gopinadhan, Gerard Fernando
9915Additions to DIP Reference Implementation for J-DIxOs.
Vishy Swaminathan , Gautam Gopinadhan , Gerard Fernando
Topic: DIP session Proposals in three broad categories:
o Proposals concerning general DIM and DID DIBOs - 9574, 9846o Proposals concerning DIBOs for other parts of MEPG 21 (DIA (and IPMP)) –
9842, 9877, 9878o Proposals concerning DIxOs (JDIxOs) - 9912
Results: It was agreed that, pending approval by MDS chair, work could commence by interested
parties on integrating general and DIxO proposals in to an initial DIP WD 2.0, the text to be approved during the DIP BoG on Thursday morning. Interested parties to meet at 1.00pm on Wednesday in Room 601.
It was agreed that the requirements for and usage by other parts of MPEG 21 of DIP and in particular DIMs and supporting DIBOs needs to be further investigated. This would benefit from the input of experts in each area (DIA, RDD, REL, IPMP, etc). WG11 needs to understand what, if any, processing related to these other parts of MPEG 21 are required at the DIM level (and hence what supporting DIBOs are required).
The proposed DIA (and IPMP) DIBOs have indicated some possible requirements. These need to be further investigated and detailed in the context of the related part as a whole (DIA, etc) so that common/generic requirements can be identified and that, if DIBOs are required, that they may be clearly and precisely specified.
The DIP BoG already has a mandate to develop a process and criteria for adopting DIBOs. This need was again highlighted during the meeting. Possibly additional criteria might be needed by each MPEG 21 part.
Input from MDS chair sought, in how to progress the further investigation of DIM use and supporting DIBOs by other parts of MPEG 21
Some less understood current (and proposed) DIBOs could be placed in the DIP TuC and input sought from experts in related areas (RDD, DIA, etc), to allow a more clear and precise specification of the DIBO to be developed.
There was some discussions on use of standard W3C ECMAScript binding for DOM versus current DIDL specific DIBOs. Points raised:
o the standard DOM binding allows easy traversal of entire XML document [author’s response: the current DIDL based DIBOs allow traversal of a DIDL document just as easilt]
o a DI author would be more comfortable with the familiar standard DOM bindingo even if we did use the standard DOM binding, additional semantics would need to
be specified to ensure proper processing of DID elements (e.g. in accordance with
95
any rights/IPMP)o due to above, a standard implementation of the standard DOM binding could not
be used, it would still require a custom implementation to ensure adherence to more strict DIP requirements
This issue may require further discussion by DIP BoG/MDS.o It was noted that there may be some concerns regarding a proposal by Sun to
change the Java execution environment for JDIxOs (Annex B) from informative to normative and this will need to be further discussed by DIP BoG/MDS
Actions: Proceed with editing of WD, TuC, and Procedure document
MPEG-21 DIA Software:
Doc No. Contribution Source
9785Contribution on MPEG-21 DIA reference software implementation Mariam Kimieai Asadi, Jean-Claude Dufourd
Results: From Software Implementation (Pattaya) – integration with DID parser.
9804Non-normative features for BSDL and update on reference software Sylvain Devillers, Eric Delfosse
Results: Update to use SAX events and SAX parser (previously used DOM tree/parser). Datatype extensibility Debugging mechanism Datatype for bit stuffing
9826MPEG-21 Graphics DIA reference software implementation Lee Nam Yeol, Kim Hae Kwang, Jae Ho
Topic: First version of the MPEG-21 graphics DIA reference softwareResults: Input is a CDI containing Web3D-based 3D graphics contents and an XDI containing the three
user preference parameters on geometry, material and animation Output is a reduced quality graphics contents according to the related parameters in the XDI Uploaded to the MPEG-21 reference software ftp siteActions: Add to MPEG-21 DIA reference SW plan
n/a MPEG-21 DIA Peer Review MDS GroupTopic: DIA reference SWResults: Completed DIA reference SW peer review (all software deemed satisfactory) Assessment forms collected and feedback for developersActions: Revised MPEG-21 DIA reference SW plan
MPEG-21 DIA Proposals:
Doc No. Contribution Source
96
9774Towards Finalization of Destination in MPEG-21 DIA Mikio Sasaki
9775Linguistic Expression of Time in MPEG-7 and MPEG-21 DIA Mikio Sasaki
9914Auditory Impairment and Digital Item Adaptation Kate Grant, Jack Sandover
Topic: Proposals to MPEG-21 DIAResults: Addressed in DIA BoG meetingActions: Reflected in MPEG-21 DIA XM and FCD
MPEG-7 MDS AMD/2:
Doc No. Contribution Source
5595MPEG-7 Multimedia Description Schemes XM (v17.0) M. Kim
Topic: Reviewed content of MPEG-7 MDS XMResults: Decision of promotion to first AMD/1 WD of items related to MPEG-21 DIA and MPEG-7
harmonization with MXF as follows:o HistoryType XMo StructuredAnnotationType XMo PersonType XMo PersonNameType AMD/2o ElectronicAddressType AMD/2o Place DS AMD/2o Linguistic Description XMo Variations of Content XMo UserPreference DS AMD/2 (include in reference SW - MK)o BrowsingPreference DS AMD/2 (include in reference SW - MK)o UsageHistory DS AMD/2 (include in reference SW - MK)o AssociatedSourcePreferencesType AMD/2 (include in reference SW - MK)
Actions: Create AMD/2 including new promotions Create XM v.18 including items not promoted
9899Signaling of profile & level in MPEG-7 descriptions Peter van Beek
Topic: Need for mechanism for specifying MPEG-7 schema given extensions via AMDsResults: Create new MPEG-7 part (MPEG-7 part 10) and process for collecting schema definitions and
extensionsActions: MDS will manage the process and coordinate with Systems, Video, Audio
97
MPEG-7 Video-MDS Interface:
Doc No. Contribution Source
N/A MPEG-7 Video AMD Video Topic: New video tools impact on MDSResults: GoF/GoP Feature Illumination Invariant Color
o Adopt proposed revisions from Video to MDS AMD/2 to accommodate still region feature container and gof/gof feature container.
Color sampling – currently uses one color spaceo Add support for various color spaceso Presentation to incorporate into XM
Signaling of profile & levelo add attribute or elemento namespace
Actions: Adopt changes above Add mandate to profiles AHG to compare approaches for signaling profiles and levels
MPEG-21 REL DoC :
Doc No. Contribution Source
9702Summary of Voting on ISO/IEC FCD 21000-5 [SC 29 N 5394] SC 29 Secretariat
Topic: Reviewed all NB comments and discussed proposed disposition from REL BoG.Results: Some changes have been proposed in response to NB comments (reflected in Editor’s input) as
follows: Authorization model replaces authorization algorithm:
o Manually checked licenses against authorization model and verified example REL licenses using Prolog scripts
Revocation system:o Replaced with call in condition to revocation service, which allows use of context
MDS group accepted each of the dispositions and finalized DoC. Results are reflected in DoC on REL FCD Actions: Complete DoC on REL FCD and FDIS
98
Summary of Results on MPEG Multimedia Description Schemes (MDS) work items:
Results on MDS MPEG-7 work items:
1. MPEG-7 Schema Definition: Defined process for managing evolving MPEG-7 schema:
o Regular synchronization document (Part 10) defines schema across all parts of MPEG-7 standard
o Includes prior version schema + amendments Output: MPEG-7 Schema Definition WD v.1.0
2. MPEG-7 Amendments: MPEG-7 MDS Extensions:
o MPEG-7 MDS AMD/1 FDAMo Completed DoC work from Pattaya based on new process for managing
extensions to MPEG-7 schemao Issued MDS AMD/1 FDAM
MPEG-7 MDS AMD/2 WDo Revisions to PersonName, ElectronicMailAddress (MXF harmonization)o Revisions to User Preference, Browsing Preference, UsageHistory,
AuditorySourcePreference (DIA context)o Revisions to accommodate visual descriptor containers
NB Comments on FPDAM; MPEG-7 Extensions (with MPEG-7 Systems)
3. MPEG-7 Profiles (joint meetings): Joint with Requirements, Systems, Video, Audio, MDS Three profiles under development:
o User Description Profileo Simple Metadata Profileo Core Content Description Profile
4. MPEG-7 Conformance: FPDAM AMD/1 (MPEG-7 Version 2 bitstreams)
Results on MDS MPEG-21 work items:
1. Analyzed recommendations of AHGs and Core Experiments.
2. MPEG-21 Part 2 – Digital Item Declaration: Reviewed proposals and AHG results Adopted new tools addressing asymmetry in definitions of <Statement> and
<Resource>, w.r.t.,o Inclusion of inline XML o Inclusion by referenceo Inclusion of coded and un-encoded datao These additions allow pointing to “external” metadata (e.g., in digital library)
Start of AMD/1 on DID (“DID Extensions”) Active support from:
o Ghent University, Los Alamos Labs, UoW
99
3. MPEG-21 Part 5 – Rights Expression Language: Reviewed and disposed of NB comments on MPEG-21 Rights Expression Language
FCD (>90 comments)o All National Bodies agreed to dispositions
Revisions adopted for MPEG-21 Rights Expression Language FDIS:o Authorization model replaces authorization algorithm:
Manually checked licenses against authorization model and verified example REL licenses using Prolog scripts
o Revocation system: Replaced with call in condition to revocation service, which allows use of
context MPEG-21 Rights Data Dictionary AHG to start work developing conformance test cases
following Trondheim meeting Output:
o DoC on Rights Expression Language FCDo Rights Expression Language FDIS o REL software implementation plan v.4
Reviewed contributions on MPEG-21 Rights Expression Language software Revised MPEG-21 Rights Expression Language Reference Software Implementation
Plan, which consists of the following components:o Simple License Creator
Date: Oct. 2003 Designation: Informative Contributors: Universitat Pompeu Fabra (UPF)
o Schema Checker Date: revised version Oct. 2003 Designation: Normative Contributors: ContentGuard, UPF
o Validation Rules Checker Date: Oct. 2003 Designation: Normative Contributors: UPF, ContentGuard
o Interpretation Conformance Date: initial Oct. 2003; final Dec. 2003 Designation: Normative Contributors: UPF, ContentGuard
o Integration of REL & RDD Date: initial version Oct. 2003 Contributors: UoW, UPF ContentGuard
4. MPEG-21 Part 6 – Rights Data Dictionary: Reviewed and disposed of NB comments on MPEG-21 Rights Data Dictionary FCD (16
comments)o All National Bodies agreed to dispositions
MPEG-21 Rights Data Dictionary reference SW:o Added new contributions on multi-lingual and XML interface for MPEG-21
Rights Data Dictionaryo Plan for integration with REL - REL license interpretation using MPEG-21
Rights Data Dictionary term genealogy (initial version Oct. 2003) Created request for candidates for Registration Authority for RDD
100
Output:o DoC on Rights Data Dictionary FCDo Rights Data Dictionary FDIS
5. MPEG-21 Part 7 – Digital Item Adaptation: Reviewed and disposed of NB comments on MPEG-21 Digital Item Adaptation CD
(>200 comments from 13 NBs)o All National Bodies agreed to dispositions
Completed Tasks:o Evaluated promotion or status of all DIA tools against DIA reference SWo Revised the DIA scope statement and carefully examined all tools with respect to
the DIA scope DIA reference SW:
o Completed successful peer evaluation of 20 DIA SW tools (completed evaluation forms with feedback for using the DIA tools)
o Added new modules and revised integration plan Promoted DIA audio preference tools with help from audio experts:
o AHG mandate to continue close work with Audio group Decision to explore MPEG-7 systems tool for updating descriptions (replaces DM tool):
o Resolution to reconsider previous DIADM tool for updating if MPEG-7 not adequate
Requirement on IPMP for permissible DIA adaptation control currently not satisfied:o AHG mandate to develop use cases and define specialized Adapt actions using
RDD New AHGs:
o Updating DIA Descriptionso Integration of DIA with REL & RDD
Adopted to DIA AM and Core Experiments:o Device benchmarko Avatar preference and levels of articulation and detailo Transmodingo Universal constraints descriptoro Transformation instructions
Output: MPEG-21 Digital Item Adaptation FCD, MPEG-21 DIA AM (v.6)
6. MPEG-21 Part 10 – Digital Item Processing: Created “Procedure for Accepting DIBOs in MPEG-21 DIP” Continuing focus on developing DIP use cases Evaluated input contributions against this procedure:
o No new DIBOs adopted to WD DIBOs added to TuC v.2 to allow further study Adopted interface description reference implementation of DIXOs in Java Output:
o MPEG-21 DIP WD v.2 and TuC v.2
7. Edited and approved output documents (WD, CD, AHGs, new CEs, etc.)
101
New Core Experiments (CEs):
The following MPEG-21 experiments for MPEG-21 Digital Item Adaptation (DIA) were approved during the Trondheim meeting:
Organisations Application ReviewersUniversity of KlagenfurtIMECHP LabsETRISiemens
Universal Constraints Descriptor (UCD)
Anthony VetroZhongyang HuangIngo WolfBernhard Feiten
University of KlagenfurtIMECHP LabsETRISiemens
BSD Transformation InstructionsAnthony VetroIngo WolfBernhard Feiten
ENSTICUETRI
TransmodingYoungsik HuhRiccardo LeonardiIan Burnett
University of GenevaINT-EVRY
Avatar Preferences and Levels of Detail/Articulation
Alexandre Contarmanac’hAndreas HutterMikael Bourges-Sevenier (SNHC expert)
102
List of MDS Output documents:
No. Title TBP Available15938-5 MPEG-7 Multimedia Description Schemes
5816 ISO/IEC 15938-5 AMD/1 FDAM - MDS Extensions N 2003/08/1
5581
7 MPEG-7 MDS Extensions II Working Draft N 2003/08/09
5823 MPEG-7 Multimedia Description Schemes XM (v18.0) N 2003/08/0
9583
3 MPEG-7 Industry Support N 2003/08/15
15938-5 MPEG-7 Conformance 583
4 ISO/IEC 15938-7 PDAM/1 - MPEG-7 Conformance Extensions N 2003/08/15
15938-10 MPEG-7 Schema Definition583
5 Request for Subdivision of ISO/IEC 15938 N 2003/07/25
5836 MPEG-7 Schema Definition Working Draft v1.0 N 2003/08/1
521000-2 MPEG-21 Digital Item Declaration
5837 ISO/IEC 21000-2 AMD/1 WD – DID Extensions N 2003/08/0
121000-5 MPEG-21 Rights Expression Language
5838 DoC on ISO/IEC 21000-5 FCD – Rights Expression Language N 2003/07/2
5583
9 ISO/IEC FDIS 21000-5 - Rights Expression Language N 2003/08/08
5840 MPEG-21 REL/RDD Software Implementation Plan v.3 N 2003/07/2
521000-6 MPEG-21 Rights Data Dictionary
5841 DoC on ISO/IEC 21000-6 FCD – Rights Data Dictionary N 2003/07/2
5584
2 ISO/IEC FDIS 21000-6 - Rights Data Dictionary N 2003/08/22
5843 Request for Candidates for MPEG-21 RDD Registration Authority Y 2003/07/2
521000-7 MPEG-21 Digital Item Adaptation
5844 DoC on ISO/IEC 21000-7 CD – Digital Item Adaptation N 2003/07/2
5584
5 Text of ISO/IEC 21000-7 FCD - Digital Item Adaptation Y 2003/08/08
5846 MPEG-21 Digital Item Adaptation AM v.6 N 2003/08/1
5584
7 MPEG-21 DIA Software Implementation Plan v.4 N 2003/07/25
5848 Tool Design Guidelines for Extensibility in MPEG-21 DIA v.2 N 2003/07/2
5584
9 Overview of MPEG-21 DIA Core Experiments N 2003/07/25
103
5850
Workplan for Core Experiment on Universal Constraints Descriptor N 2003/07/2
5585
1Workplan for Core Experiment on BSD Transformation Instructions N 2003/07/2
5585
2Workplan for Core Experiment on Transmoding N 2003/07/2
5585
3Workplan for Core Experiment on Avatar Preference and Levels of Details/Articulation N 2003/07/2
521000-10 MPEG-21 Digital Item Processing
5854 Procedure for Accepting DIBOs in MPEG-21 DIP Y 2003/07/2
5585
5 MPEG-21 Digital Item Processing WD v.2 N 2003/08/08
5856
MPEG-21 Digital Item Processing Technologies under Consideration TuC v.2 N 2003/08/0
8
104
List of AHGs approved by the MDS group:
N5857 Ad Hoc Group on Editing the MPEG-21 Rights Expression Language FDIS
Mandate: Edit the FDIS to accommodate all actions arising from the DoC in Trondheim.
Prepared the Abstract required by ISO for the FDISCo-Chairs Barney WraggDuration: Thomas DeMartiniMeetings 8/8/03Reflector: Business will be conducted by E-mail or Telephone.Subscribe [email protected]
message titles prefixed [REL]N5858 AHG on MPEG-21 REL and RDD Reference Software
Mandate: 1. To list all validation rules2. To develop the validation rule checker3. To start to develop conformance licenses and test cases4. To develop input/output formats for the interpretation conformance
software5. To develop interpretation conformance software6. To develop the REL license interpretation using RDD term genealogy7. To coordinate work on other software in the REL/RDD reference software
plan8. To update the REL-RDD reference software plan
Chairman: Xin Wang, [email protected]
Co Chair Jaime Delgado, [email protected]
Duration: Until 66th Meeting
Meetings Meeting on Sunday before the 66th meeting. Business will also be conducted by E-mail or Telephone.
Reflector: [email protected] titles prefixed [REL/RDD-RS]
N5859 AhG on editing RDD FDISMandate: 1. Edit and complete RDD FDIS in line with FCD DoC
2. Submit text of FDIS to SC29 Secretariat by 22nd August 2003Chairman: Chris Barlas [[email protected]]
Godfrey Rust ([email protected])Co Chair Until the 65th MeetingDuration:
The AhG will be conducted by email and phone conference
[email protected] messages to use the prefix [RDD]
Reflector:Send email to [email protected]
N5860 20.1.1 AHG on Editing MPEG-21 Digital Item Adaptation FCD & AMMandate: 1. Produce the FCD after a 2-week editing period and upload by 2003/08/08; produce
AM6.0 after a 3-week editing period and upload by 2003/08/15. 2. Maintain schema for the FCD/AM6.0 on http://www.midgardmedia.net.3. Continue to study extensibility of tools within the DIA specification using the guidelines
document.4. Study existing description tools for network characteristics.
105
5. Produce Editors Input on Study of FCD and AM6.1.Co-Chairs Anthony Vetro ([email protected])Duration: Christian Timmerer ([email protected])
Eric Delfosse ([email protected])Meetings: Until the 66th Meeting.Reflector:
AHG Meeting to be held on the Sunday prior to 66th meeting.
Subscribe: [email protected] AHG on Integration of DIA with REL and RDD
Mandate: 1. To investigate solutions that satisfy the MPEG-21 requirement #4.6.4.2: IPMP System for Permissible Digital Item Adaptation Control
2. To propose additions to the DIA Study of FCD needed to enable this functionality
3. To provide examples of expressions of possible Digital Item adaptations, using the following sample use cases as basis: Rate reduction of audio file
- output bit-rate is reduced to 192kbpsSpatial resolution reduction is - aspect ratio is maintained (equal horizontal and vertical reduction)- output resolution is 720x480
Co-Chairs Thomas DeMartini ([email protected])Anthony Vetro ([email protected])Sylvain Devillers (Sylvain [email protected])Barney Wragg ([email protected])? Chris Barlas ([email protected])?
Duration: Until 66th meeting
Meetings: A meeting will be held on the weekend before the Brisbane meeting. Other business will be conducted by E-mail or telephone conference.
Reflector: UMA Reflector ([email protected])
Subscribe: Send a mail to [email protected] with subscribe in body
N5862 Ad Hoc Group on Core Experiments for MPEG-21 Digital Item Adaptation
Mandate: 1. Maintaining the MPEG-21 MDS CE Development process document.2. Carry out Core Experiments on DIA and make recommendations to modify
and improve the Final Committee Draft (FCD) and Adaptation Model (AM v6.0).
3. Encourage delivery (according to software implementation plan v.4 N5847) of implementation software from participants.
4. Review the progression of the audio related Usage Environment dscription tools requested by MDS and Audio groups
Co-Chairs: Jeho Nam ([email protected])
Duration: Debargha Mukherjee ([email protected])
Meetings: Until 66th MPEG meeting
Reflector: A meeting will be held on the weekend before the Brisbane meeting. Other business will be conducted by E-mail or Telephone.
Subscribe: [email protected]
N5863 AHG on Updating DIA Descriptions
Mandate: 1. Investigate the use and sufficiency of MPEG-7 Systems for updating DIA descriptions;
2. Discuss and possibly contribute requirements on capability negotiation
106
functionality;3. Consider improvements and additions taking into consideration DIADM
tool and MPEG-7 Systems.Chairman Andrew Perkis (NTNU)
Co-chairman Andreas Hutter (Siemens), Zhongyang Huang (PSL)
Duration: Until 66th meeting
Meetings: Business will be conducted by E-mail and/or telephone conference.
Reflector: [email protected]
N5864 AHG on Editing MPEG-21 DID and DIP Working Drafts
Mandate
1. Edit MPEG-21 DIP WD v.22. Edit MPEG-21 DID - Amendment 1 (DID Extensions) WD v.13. Produce study on MPEG-21 DIP WD v.2 and recommendations on
improving this document4. Produce study on MPEG-21 DID - Amendment 1 (DID Extensions)
WD v.1 and recommendations on improving this document5. Evaluate the DIBOs that are listed in MPEG-21 DIP WD v.1 against the
guidelines that are defined in the Procedure for accepting DIBOs in MPEG-21 DIP document
6. Encourage discussion on usage of DIMs and DIBOs by other parts of MPEG-21 and development of new proposals for evaluation according to the Procedure for accepting DIBOs in MPEG-21 DIP document
Chairman Gerrard Drury ([email protected])
Co Chair Rik Van de Walle ([email protected])Ian Burnett ([email protected])Munchurl Kim ([email protected])
Duration Until the 66th Meeting
Meetings AHG Meeting to be held on the Sunday prior to 66th meeting
Reflector [email protected]
107
MPEG MDS group schedule for 64th meeting:MDS Sub-Group Schedule
MPEG-7 and MPEG-21 Final # TITLE ROOM & SOURCE STD
Monday Morning (9h00-13h00) MPEG Plenary Plenary room
Monday Afternoon (14h00-20h00)
Kick-off of MPEG MDS activities (14h00-14h30) Tavern ALL
Agenda, Goals and Issues for the Week for MDS Group John R. Smith
Review of AHG resolutions and action points (14h30-16h00) Tavern ALL
9645 AHG on Metadata InteroperabilityDavid Singer, Eric Rehm , Peter Mulder, Masanori Sano
9650 AHG on Use of DID by other MPEG 21 parts Gerrard Drury, Do-Nyun Kim 9646 AHG on Editing the MPEG-21 Rights Expression Language Barney Wragg, Thomas DeMartini
9647AHG on Profiles and Extensions of the MPEG-21 Rights Expression Language Brad Gandee, Barney Wragg
9648 AHG on MPEG-21 Publishing Extension Chris Barlas, Brad Gandee 9649 AHG on RDD Reference Software and Editing Chris Barlas, Godfrey Rust
9651AHG on Editing MPEG-21 Digital Item Adaptation Study of CD & AM
Anthony Vetro, Andrew Perkis, Christian Timmer, Eric Delfosse
9652AHG on Core Experiments for MPEG-21 Digital Item Adaptation Jeho Nam, Debargha Mukherjee
9653 AHG on Editing MPEG-21 DIPRik Van de Walle, Ian Burnett, Munchurl Kim, Vishy Swaminathan
9730 CE report on audio adaptationQoS
Eunmi Oh, SangJo Lee, MiYoung Kim, Youngsik Huh, SangWook Kim, Bernhard Feiten, Ingo Wolf
9741 Report of CE on AdaptationQoS and BSDLink C. Timmerer, on behalf of the CE
9745 report of Transmoding Core ExperimentMariam Kimiaei Asadi, Jean-Claude Dufourd, Truong Cong Thang
9833 CE on DIA Configuration and MessagingLetian Rong, Zhongyang Huang, Eric Delfosse
9849 Report of CE on Metadata Adaptation – Integration
Nicola Adami , Sergio Benini , Riccardo Leonardi, Hirofumi Nishikawa
9897 Results of Mini-experiment on CPU capabilities in DIAChris Joslin, Thomas Di Giacomo, Nadia Magnenat-Thalmann
Define BoGs and Mandates (16h00-16h15) Tavern ALL REL, RDD, DIA DoC, BSD, DIP MPEG-21 DID (16h15 - 16h30) Tavern 21
108
9755 Suggestions concerning MPEG-21 Digital Item Declaration
Jeroen Bekaert, Patrick Hochstenbach , Wesley De Neve, Herbert Van de Sompel, Rik Van de Walle
MPEG-21 DIA Editing (16h30 - 17h00) Tavern 21
9902 Editors Input on DIA FCDAnthony Vetro, Andrew Perkis, Christian Timmerer
9903 MPEG-21 Digital Item Adaptation AM v5.1Anthony Vetro , Andrew Perkis , Christian Timmerer
9696 Error log for MPEG-21 DIA AM schema v5.0Jijun Zhang (NTNU) , Andrew Perkis (NTNU)
MPEG-21 DIA NB Comments (17h00 - 18h00) Tavern 21 9673 Summary of Voting on ISO/IEC CD 21000-7 [SC 29 N 5385] SC 29 Secretariat
9681Swiss NB Comment for Levels of Articulation for Virtual Humans
Chris Joslin, Thomas Di Giacomo, Stephane Garchery, Tom Molet, Nadia Magnenat-Thalmann
ANB comment on ISO/IEC CD 21000-7 (Digital Item Adaptation)
C. Timmerer, on behalf of the Austrian NB
9724
Belgian National Body Comment on ISO/IEC 21000-7 CD – Part 7: Digital Item Adaptation document ISO/IEC JTC 1/SC 29/WG 11/N5353 Jan Bormans, on behalf of the BNB
9733Further SgNB Comment on ISO/IEC CD 21000-7 (MPEG-21 DIA) C. J. Lee
9747JNB Comments on Study of ISO/IEC 21000-7 CD (MPEG-21 DIA) Mikio Sasaki for JNB
9758French National Body Position on MPEG-21 DIA NetworkCharacteristics Alexandre Cotarmanac'h
9841 Response to USNB on ISO/IEC CD 21000-7 (DIA) Gerrad Drury, Ian Burnett
9891GNB Comment on on progressing towards ISO/IEC FCD 21000-7 and towards ISO/IEC FPDAM1 15938-1
Andreas Hutter on behalf of the GNB
MPEG-21 REL BoG (17h00 - 19h00) Lerkendael 21 Tuesday Morning (09h00-13h00) MPEG-21 RDD BoG (08h00 - 09h00) with REL Hjallis 21 MPEG-21 DIA DoC (09h00 - 10h00) Tavern 21 MPEG-21 REL/RDD (09h00 - 10h00) with Requirements REQUIREMENTS 21 9650 AHG on Use of DID by other MPEG 21 parts Gerrard Drury, Do-Nyun Kim
9647AHG on Profiles and Extensions of the MPEG-21 Rights Expression Language Brad Gandee, Barney Wragg
9675Liaison Statement from the Open Mobile Alliance (OMA) [SC 29 N 5371] SC 29 Secretariat
9935 Liaison Statement from EDItEUR Brian Green
109
MPEG-21 Plus (10h00 - 11h00) with Requirements REQUIREMENTS 21 9814 Remote Digital Item Methods for MPEG-21 Messaging Lakshan De Silva, Ian Burnett
9921Terminology and Additional Requirements for bitstream adaptation
Sam Liu, CE on AdaptationQoS BSD Link
9714Digital Broadcast Item Model: Harmonization of Broadcast Metadata
Artur Lugmayr, Samuli Niiranen, Andrew Perkis, Perttu Rautavirta, Mikko Oksanen
MPEG Reference SW (11h00 - 12h00) with Requirements, Systems, Integration REQUIREMENTS 21 MPEG-21 DIA Description Message (12h00 - 13h00) Tavern 21
9845General analysis and technical discussion on DIADM tool for DIA application
ZY Huang, SM Shen, M Ji, Taka Senoh, Takafumi Ueno, Takuyo Kogure
MPEG-21 REL BoG (12h00 - 19h00) Hjallis 21 Tuesday Afternoon (14h00-20h00) MPEG-21 RDD BoG (14h00 - 15h00) - RDD Software Room 601 21
MPEG-21 DIA Bitstream Description / Adaptation QoS (14h00 - 15h00) Tavern 21
9772 Proposal for a Universal Constraints Descriptor in DIADebargha Mukherjee, Geraldine Kuo, Sam Liu, Giordano Beretta
9773Model-based lightweight BSD Transformation Instructions and Reserved Marker Token Formats
Debargha Mukherjee, Geraldine Kuo, Sam Liu, Giordano Beretta
9793Development of a fully format-independent adaptation engine using current and proposed DIA tools
Geraldine Kuo, Debargha Mukherjee, Sam Liu, Giordano Beretta
MPEG-21 REL BoG (14h00 - 17h00) Hjallis 21 MPEG-7 Profiles (14h00 - 16h00) with Requirements REQUIREMENTS 7 9627 AHG on MPEG-7 Interoperability and Profiling Wo Chang
9746Statement in Support and Improvement of the Video Program Profile (VPP)
Masanori Sano, Alan Melby, Bhavan Gandhi
9760 Merging Relevant Tools from SP into the VPP Bhavan Gandhi
9825 Levels and templates for CoreContentDescriptionProfileMasanori SANO, Masahiro SHIBATA
9864 Propose Update Profile under Consideration (PuC) Wo Chang 9866 Propose MPEG-7 Profile Working Draft Wo Chang 9867 M7Profile Conference Call Report (for discussion) Wo Chang
110
9868 M7ITB Available Tools Wo Chang
9896 Support for MPEG-7 User Description ProfilePeter van Beek, Shuichi Watanabe, Ibrahim Sezan, Kyoungro Yoon
9899 Signaling of profile & level in MPEG-7 descriptions Peter van Beek
9900 Towards a Simple Metadata Profile
Wo Chang, Bhavan Gandhi, Schuyler Quackenbush, Eric Rehm, David Singer, John R. Smith, Vetro
9901Supporting MPEG-21 DIA with MPEG-7 User Description Profile Anthony Vetro, Peter van Beek
9937Proposed Process for Managing MPEG-7 Schema Extensions and Versions and their Relation to Profiles John R. Smith
MPEG-21 DIA Reference Issue (15h00 - 16h00) Tavern 21
MPEG-21 RDD DoC on FCD (16h00 - 17h00) Tavern 21 9649 AHG on RDD Reference Software and Editing Chris Barlas, Godfrey Rust
9703Summary of Voting on ISO/IEC FCD 21000-6 [SC 29 N 5395] SC 29 Secretariat
9847 MPEG 21000-6 (RDD) Editors' Version Chris Barlas, Godfrey Rust
MPEG-21 REL SW (17h00 - 18h00) with Integration Tavern 21
9729A Linux Implementation of MPEG-21 REL Reference Software Ying Sha , Yuzhuang Hu
9743 DMAG REL Tool Implementation Eva Rodriguez, Jaime Delgado
9898A Linux Version of the Example Implementation of MPEG-21 REL Reference Software
Xin Wang , Venkatraman Venugopal , Robert Chancellor , Joseph Fung
9649 AHG on RDD Reference Software and Editing Chris Barlas, Godfrey Rust
9748 Reference Software for the Multilingual RDD RegistrySenator Jeong, Weon-Geun Oh, Ki-Song Yoon
MPEG-21 DIA DoC BoG (17h00 - 19h00) Singsaker 21
MPEG-21 DIP (18h00 - 19h30) Tavern 21
9653 AHG on Editing MPEG-21 DIPRik Van de Walle, Ian Burnett, Munchurl Kim, Vishy Swaminathan
9754Suggestions concerning MPEG-21 Digital Item Method Operations and their implementation
Frederik De Keukelaere, Wesley De Neve, Robbie De Sutter, Rik Van de Walle
9842 Digital Item Method/Operations in DIP for MPEG-21 DIA
ZY Huang, SM Shen, M Ji, Taka Senoh, Takafumi Ueno, Takuyo Kogure
9846 Proposed additional DIBOs for MPEG-21 DIP Gerrard Drury, Ian Burnett
9877Some DIBO's functions for the linkages of DIP-DIA and DIP-IPMP in MPEG-21 DIP
Jeewoong Ryu, Munchurl Kim, Jong-Nam Kim, Keunsoo Park
9878Some DIBO's for the linkages of DIP-DIA and DIP-IPMP in MPEG-21 DIP
Jeewoong Ryu, Munchurl Kim, Jong-Nam Kim, Kweonsoo Park
9912 Draft text input and additions to the DIP Working DraftVishy Swaminathan, Gautam Gopinadhan, Gerard Fernando
9915 Additions to DIP Reference Implementation for J-DIxOs.Vishy Swaminathan , Gautam Gopinadhan , Gerard Fernando
111
Wednesday Morning (09h00-13h00)
MPEG Plenary (9h00-12h30) Plenary roomMPEG Plenary
MPEG-21 Plenary (11h00 - 13h00) with Requirements REQUIREMENTS 21 9679 USNB Contribution: Usage of dii:Type's in MPEG-21 A. G. Tescher for USNB 9682 AUNB Contribution: Usage of dii:Type's in MPEG-21 AUNB
Wednesday Afternoon (14h00-17h30) MPEG-21 Reference SW (14h00 - 14h30) with Integration & Requirements REQUIREMENTS 21
MPEG-21 DIA CDI and XDI (14h30 - 15h00) Tavern 21
MPEG-21 DIA Software (15h00 - 16h00) with Integration Tavern 21
9785Contribution on MPEG-21 DIA reference software implementation
Mariam Kimieai Asadi, Jean-Claude Dufourd
9804Non-normative features for BSDL and update on reference software Sylvain Devillers, Eric Delfosse
9826 MPEG-21 Graphics DIA reference software implementationLee Nam Yeol, Kim Hae Kwang, Jae Ho
MPEG-21 Audio DIA (16h00 - 16h30) with Audio Tavern 21 MPEG-21 DIA Proposals (16h30 - 17h00) Tavern 21 9774 Towards Finalization of Destination in MPEG-21 DIA Mikio Sasaki
9775Linguistic Expression of Time in MPEG-7 and MPEG-21 DIA Mikio Sasaki
9914 Auditory Impairment and Digital Item Adaptation Kate Grant, Jack Sandover MPEG-21 M3W Middleware (17h00 - 18h00) with Requirements & Systems REQUIREMENTS 21
MPEG Social Event (18h00 - midnight) Thursday Morning (09h00-12h30) MPEG-21 Reference SW (08h30 - 09h00) with Requirements & Integration REQUIREMENTS 21 MPEG-21 REL BoG (09h00 - 14h00) Hjallis 21
112
MPEG-7 MDS AMD/2 (09h00-09h30) Tavern 7 5595 MPEG-7 Multimedia Description Schemes XM (v17.0) M. Kim 9899 Signaling of profile & level in MPEG-7 descriptions Peter van Beek
MPEG-7 Video-MDS Interface (09h30 - 10h00) with Video Tavern 7 MPEG-21 DIA DoC on CD (10h00-12h00) Tavern 21 9673 Summary of Voting on ISO/IEC CD 21000-7 [SC 29 N 5385] SC 29 Secretariat
MPEG-7 Profiles II (11h30 - 12h00) with Requirements REQUIREMENTS 7
Thursday Afternoon (14h00-19h00)
MPEG-21 DIA Requirements (13h30 - 14h00) with Requirements REQUIREMENTS 21 MPEG-21 DIA DoC BoG (14h00 - 16h00) Singsaker 21 MPEG-21 REL DoC (14h00-16h00) Tavern 21
9702Summary of Voting on ISO/IEC FCD 21000-5 [SC 29 N 5394] SC 29 Secretariat
Plenary MDS and Reports of BoG (16h00 - 17h00) TavernMDS Plenary
Review of Output documents, AHGs, CEs, DoC, Std (17h00- 18h00) Tavern Friday Morning (09h00-13h00) Wrapping up (09h00 - 13h00) Tavern
MDS Plenary
Approval of resolutions, AHGs and Output documents
Friday Afternoon (14h00-21h00) MPEG Plenary Plenary room
MPEG Plenary
113
New targets for the Brisbane (66th) meeting:
MPEG-7 Create second WD of MPEG-7 MDS AMD/2 (part 5) Create study of CD on MPEG-7 Conformance AMD/1 (part 7) Create second WD of MPEG-7 Schema Definition (part 10)
MPEG-21 Review results of MPEG-21 DIA Core experiments approved during the Trondheim meeting Review and advance MPEG-21 REL/RDD software implementation Create study of FCD on Digital Item Adaptation Create CD of MPEG-21 DIP Review and advance MPEG-21 DIA software implementation
114
Annex 7Report of Video meeting
Source : Jens-Rainer Ohm, Miroslaw Bober
MPEG-4
New Levels and Tools AmendmentThe conformance FDAM related to 14496-2:2001/Amd.3 was issued (N5809). The DoC on the FPDAM is in N5810.
Documents reviewed: M9668 Table of Replies on ISO/IEC 14496-2:2001/FDAM 3 [SC 29 N 5343] ITTF via SC 29
SecretariatM9669
Summary of Voting on ISO/IEC 14496-4:2003/FPDAM 3 [SC 29 N 5357] SC 29 Secretariat
Error resilience in Scalable Enhancement LayerThe FDAM text (N5690) was issued with two corrections made after NB comments. Further, the definition of new Level 0b of Simple Profile was included in this amendment based on a late request request by two NBs. The new level will have twice bitrate and VBV buffer size as compared to the previous Level 0, all other restrictions made for Level 0 are unchanged.The software (N5820) and conformance (N5813) FPDAMs were also produced.
Documents reviewed: M9799 Summary of Voting on ISO/IEC 14496-2:2001/FPDAM 4 SC 29 Secretariat
M9944
Finnish National Body comment on the addition of Level 0b to the MPEG-4 Simple Visual Profile
Mauri VäänänenMarta Karczewiczon behalf of the Finnish NB
M9946
GNB comment on the addition of Level 0b to the MPEG-4 Simple Visual Profile
Andreas HutterJ.-R. Ohm on behalf of German NB
M9704 Summary of Voting on ISO/IEC 14496-4:2003/PDAM 5 [SC 29 N 5396] SC 29 Secretariat
M9705 Summary of Voting on ISO/IEC 14496-5:2001/PDAM 5 [SC 29 N 5397] SC 29 Secretariat
List of Problems reported and Reference Software development A new version of the 'List of Problems Reported' was issued (N5691). This now fully refers to Edition 3 (2003) of MPEG-4 Visual. Even though no severe technical bugs are known in the standard text, a number of items that are described too vague need more clarification. It is planned issue a draft corrigendum by the October meeting.An issue that needs further study is related to increased IDCT mismatch propagation in the context of Quarterpel MC (M9822). As this mainly happens by untypical motion vector configurations, which nevertheless are not forbidden, a viable solution might be to add a note in the standard text pointing out this problem.Further work has been done in the cleanup of the video-related software problems, bug fixing is permanently performed, and cross-checks between the newest versions of the Momusys and Microsoft packages are running. Work is progressing to have all bugs as documented in the 'List of Problems Reported' (N5691) fixed until December when 14496-5:2001 FDAM5 (ERSSP
115
amendment) will be issued, such that the newest version of the software will as fast as possible be available.Progress was also made on encoder optimization. A new version of optimized Simple Profile encoder is available from NCTU web site, which gives another speedup of 25 % over the previous version. Documents reviewed:M9763
MPEG-4 Visual: Updated List of Problems Reported, v.8 Yi-Shin TungChung-Neng WangTihao ChiangJens-Rainer Ohm
M9764
Improvement of Optimized MPEG-4 14496-2 Simple Codec with EPFL SIT Analyzer
Chung-Neng WangTihao Chiang
M9822
Quality Degradation Problem: IDCT Mismatch Propagated and Scaled by MPEG-4 Quarter-pel Filtering
Yi-Shin TungJa-Ling WuJim ShiuZhixiong Wu
MPEG-4 AVCThe following documents related to AVC were input to the video group:M9693
US Experts’ Comments on the errata reports on JVT-G050 reported in JVT-H010d4
Ajay LuthraSam Narasimhan
M9713 USNB Contribution: JVT issues A. G. Tescher for
USNBM9794 MPEG4 AVC Reference Software 's Optimization Feng
Yang
As far as NB comments were concerned, answers were provided. In particular, it was clarified that the further development of AVC (corrigenda etc.) is in the responsibility of JVT as long as it exists, and must be managed by communication between the parent bodies afterwards. A proposal was made on development of optimized (faster) reference software. This was discussed together with JVT members who were present in Trondheim, and it was concluded that this work is not of highest priority as long as the reference software itself is still in a stabilization phase. The proponent was advised to get in contact with the responsible person for reference software encoder development.The Video group reviewed and approved the PDAM on AVC professional extensions (N5693; request is N5692), the PDAM on AVC conformance (N5814; request is N5813), the PDAM on AVC reference software (N5821; request is N5822) and Version 2.0 of the AVC Verification test plan (N5826).
Output documents related to MPEG-4
No. Title TBP Available
14496-2 MPEG-4 Visual5689 Disposition of Comments on 14496-2:2001/FPDAM 4 03/07/25
5690 Text of ISO/IEC 14496-2:2003/FDAM1 Visual Error Resilient Simple Scalable Profile
03/08/01
5691 MPEG-4 Visual: List of Problems Reported version 9.0 Y 03/07/2514496-10 MPEG-4 Advanced Video Coding
5692 Request for ISO/IEC 14496-10 Amd.1 03/07/255693 Text of ISO/IEC 14496-10 PDAM1 AVC Professional Extensions 03/08/31
116
MPEG-7
MPEG-7 related work in Trondheim
SummaryThe work in MPEG-7 mainly concerned the following themes:
Review and Approval of the Visual Ad Hoc Group Recommendations Reviewed the NB comments on Visual Amd1, Issue DOC Inclusion of new technology into Visual Experimental Model (for version 2) Review of the input documents and planning of new Core Experiments for amendment 3 Call for the MPEG-7 Visual Demos Review of the reports of problems with Visual version 1 specification and preparation of the
report including solutions. Work on MPEG-7 Profiles and Profiling mechanisms (jointly with Requirements, MDS,
Audio and Systems). Joint meeting with Systems on static metadata in MPEG-4 FF Joint meeting with MDS – Interfaces between new visual tools and MDS tools XM software status review with ISG (for version 2).
Review and Approval of the Visual Ad Hoc Group RecommendationsAll AdHoc group recommendations were approved:–GoP/GoF feature Temporal container with Homogeneous Texture promoted to XM–New work on temporal containers to continue (Dominant colour)–Good results on 3D perceptual shape D – work to continue
VCE-1: Perceptual 3D shape descriptor M 9809 - Perceptual 3D shape descriptor: Result of core experiment M9809 presented the result of core experiments performed with the Perceptual 3D Shape (P3DS) descriptor. A larger database has been constructed and categorised. In summary, the new database is composed of 1,281 models in the ‘core’ dataset and 3,841 models in the ‘expanded’ dataset. The expanded database has been constructed from the ‘core’ dataset by modifying the model resolution and by applying simple mesh operations like mesh simplification, subdivision, and noise addition to vertices. Two matching techniques based on the earth mover’s distance “EMD” and spectral graph theory “EIGEN” were evaluated. Test show that “EIGEN” method is faster with some minor degradation in retrieval performance. The comparison with the performance of Shape3D descriptor is also provided for comparison. It is observed that the performance of the P3DS descriptor is in most cases better than Shape3D descriptor. In addition, new functionalities of the P3DS descriptor, namely Query by Sketch and Query by Editing were demonstrated. These functionalities are not supported by the present descriptor. This CE will continue to further optimize the performance of the new descriptor.
VCE-2: Binary Representation of Visual DescriptorsExperimentation shown that several minor bugs still exist in the BiM software, this information was forwarded to the systems group for analysis and corrections. The recommendation is to continue the CE with the unchanged objective to provide a complete set of results obtained with the latest version of BiM (to be released during the meeting). Additionally, this CE should also deliver conformance bit-streams generated by the latest BiM software. VCE-3: Definition of a new "time-sequence" containerM9812 - Report of the Core Experiment of Definition and use of a new “TimeSequence” data container (VCE-3)M9735 - Report of Cross-Verification of VCE-3 (HTD for "Timesequence" data container) HomogeneousTexture Descriptor has been tested in a video shot retrieval scenario. SAIT has created a new dataset, query, and ground truth set that reflect the texture characteristic preserved in time domain. The test set was discussed and agreed on the reflector. The dataset is composed of 1822 shots, and there are 33 queries. The tests shown good retrieval performance. Consequently,
117
the use of HomogeneousTexture Descriptor is allowed in GofGopfeature and suitable text was added into ISO/IEC 15938-3 PDAM 1 Visual Extensions. Korean NB made a comment on such inclusion (M9813)
M9880 - Report of VCE-3 for DominantColor descriptor The results of VCE-3 for Dominant Colour descriptor were reported in M9880 and presented at the meeting. The authors found that existing (in version 1) aggregation methods are not appropriate for the DominantColor descriptor and proposed a new aggregation method called MERGE. Retrieval results were reported, showing a clear improvement compared to per-frame descriptors. The proponent requested the addition of the DominantColor descriptor and the MERGE aggregation method to the GoFGoPFeature descriptor. The issues of naming of the new aggregation method, inclusion of SpatialCoherency and cross-verification were raised by the group. The CE will continue to resolve remaining issues.
3 Core Experiments were approved for continuation (see below).
Reviewed the NB comments on Visual Amd1, Issue DOC All NB comment were addressed and a DOC issued (5694)
Promotion of technology into Visual PDAM (for version 2) Time-sequence container in conjunction with HomogeneousTexture was promoted
Review of the input documents and planning of new Core Experiments for version 3
4 Core experiments are defined (N5697): VCE-1: Perceptual 3D Shape Descriptor VCE-2: Binary Representation of Visual Descriptors, including collection of conformance
descriptions. VCE-3: Definition and use of a new "time-sequence" container
Review of the reports of problems with Visual version 1 specification The list of problems reported with the current (version 1) specification was reviewed and since the list was stable a PDAM was issued (W5695 -Amendment 1: Visual extensions). A list of known problems is maintained by Dr Cieplinski ([email protected]), where problems can be reported by emiail.
Review of the remaining input documentsNew proposals outlining the need for a “3D face descriptor” which can cope with significant pose variations was presented (M9876, M9801), but the results did not demonstrate clear improvement over version 2 descriptor to merit a new CE. However, it was agreed that the current AFD descriptor may not perform sufficiently well for significant pose variations (e.g. above 60deg) . It was agreed that an effort to secure more databases of facial images, including significant pose variations, should start and report at the next meeting. Also discussions on testing methodology for a 3D face recognition descriptor should be conducted on the reflector.
Other documents considered are listed in the table below.
Doc Authors TitleM9674 ITTF via SC 29
SecretariatTable of Replies on ISO/IEC FDIS 15938-6 [SC 29 N 5369]
M9717 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-3/PDAM 1 [SC 29 N 5410]
M9776 Akio YamadaLeszek Cieplinski
MPEG-7 Visual part of eXperimentation Model Version 18.1
M9777 Akio Yamada Editor's Study of ISO/IEC 15938-3/PDAM1
118
Leszek CieplinskiM9778 Akio Yamada
Leszek CieplinskiMPEG-7 Visual: List of Problems Reported v.3.1
M9797 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-6/PDAM 1M9801 Won-Sook LEE
KyungAh SOHNMulti-view 3D-Face Descriptor: proposal for CE
M9813 Kyuheon KimKNB
Korean NB comment on Text of ISO/IEC 15938-3 PDAM 1 Visual Extensions
M9838 Toshio KameiAkio YamadaHyunwoo KimWonjun HwangTae-Kyun KimSeok Cheol Kee
Software Update on MPEG-7 Advanced Face Recognition Descriptor
M9876 Whoi-Yul KimHyun-Sun ParkJae-Ho LeeHee-Jung Kim
Proposal for CE on 3D Face Recognition Descriptor
XM software status review with ISG New tools accepted should be delivered to Stephan Herrman within two weeks after the meeting. All software currently integrated is working correctly and the software is in a very good shape.
Output documents related to MPEG-7
No. Title TBP Available
15938-3 MPEG-7 Visual5694 Disposition of Comments on 15938-3 PDAM 1 03/08/085695 Text of ISO/IEC 15938-3 FPDAM 1 Visual Extensions 03/08/085696 Text of ISO/IEC 15938-3 DCOR1 03/08/085697 Description of Core Experiments for MPEG-7 Visual Extensions 03/07/25
15938-8 Extraction and Use of MPEG-7 Descriptions
5698 Request for ISO/IEC TR 15938-8 AMD 1 Extensions of Extraction and Use of MPEG-7 Descriptions
03/07/25
5699 WD 1.0 of Extensions of Extraction and Use of MPEG-7 Descriptions 03/07/25
Explorations
Scalable Video Coding23 technical contributions have been submitted that are related to the scalable video coding activity. 9 of these contributions were officially registered as responses for the call for evidence on scalable video coding technology. The results were reviewed in a 2-day AHG meeting on the weekend before, and then further analyzed during the meeting within the video subgroup. A concise description is given in the report on the call for evidence (N5701).
For the 9 different responses that have been received., the applied technologies code the video sequence once for all the bit-rates and spatio-temporal resolutions they provide.
The responses can be classified in two distinct classes:
119
Hybrid coding techniques using block-based texture coding and an AVC-based base-layer (3 contributions);
3D motion compensated wavelet coding techniques using open-loop motion compensation temporal filtering (MCTF) (6 contributions).
The block-based solutions can be further classified as follows: one technique (m9928) provides high-quality spatial scalability, but no temporal and fine-
granular SNR scalabilities. This proposal uses the AVC coder for coding the lower spatial resolution base-layer and proposes to use either the MPEG-2 or the AVC coder for compressing the spatial enhancement layer.
one technique (m9767) provides high-quality fine-granular SNR and temporal scalabilities, but no spatial scalability. This proposal uses the AVC coder for base-layer compression.
one technique (m9895) provides spatio-temporal scalability. This proposal uses the AVC coder for base-layer compression.
The 3D wavelet coders provide spatial, temporal and fine-granular SNR scalabilities. These coders have all a similar structure, employing MCTF, embedded texture coding and arithmetic coding. For MCTF, either Haar or longer temporal filters were used with or without (Unconstrained Motion Compensation Temporal Filtering - UMCTF) the update step. Different embedded texture coding techniques have been used, like EBCOT, EZBC or QTL. Different motion-estimation techniques have been used, including hierarchical variable size block motion estimation, multi-hypothesis motion estimation, etc. To reduce the number of motion vector bits at low bit-rates, a layered representation of the motion vectors was used in one of the proposals. Also, adaptive deblocking techniques have been employed for one of the proposals.The subjective tests for the call for evidence were conducted jointly with the test group. In particular, a total of 57 cases have been compared. Out of these cases, 27 cases were comparable (13), slightly better (8) or better (6) than AVC, 21 were slightly worse than AVC and 9 were worse. Based on the viewing results, a tendency could be observed that fully scalable solution exhibited the best performance at the higher rates. All proposals were clearly better than MPEG-4 FGS/FGST.Based on the showed evidence, it can be concluded that a variety of new scalable video coding technologies exist that are significantly better than best existing MPEG-4 FGS and by tendency comparable/ slightly worse than MPEG-4 AVC technology.Beyond the proposals which brought results on the test materials, new and promising input on Scalable Coding Technology was received that could potentially further improve the coding efficiency of SVC. These contributions proposed technologies for: De-blocking in motion compensation Improvements of motion estimation Concept for interchange of spatial and temporal downscaling without redundant wavelet
transforms Minimization of temporal distance in MC Efficient bi-directional motion compensation Receiver-side motion estimation for improved reconstruction.
Based on these results, which show a good potential for efficient scalable video coding technology, it was decided to issue a draft call for proposals (N5702). The planned schedule is to have a preliminary (public) Call by October and the (final) Call by December. As a starting point for the prospective Call, testing conditions were mostly adopted from the call for Evidence test 1, but extended by range of rates, and (in order to get more types of material for testing spatial scalability), also the spatial scaling of the set of CIF sequences down by one level (QCIF) was formulated. The set of test sequences was slightly revised, where those sequences that showed to be less relevant in the Call for evidence (Container, Harbour) shall be exchanged. Documents reviewed:
120
M9722 FNB Comments on Requirements for Scalable Video Coding Marquant Jerome Vieron Edouard Francois
M9723 Response to Call for Evidence on Scalable Video Coding Abhijeet GolwelkarIvan BajicJohn Woods
M9725 AVC Anchor Sequences for Call for Evidence on Scalable Video Coding
Thomas RusertMathias Wien
M9732 Contributions to Scalable Video Coding Requirements Jonathan TehTony May
M9756 Motion Information Scalability for MC-EZBC: Response to Call for Evidence on Scalable Video Coding
Sam S Tsai Hsueh-Ming HangTihao Chiang
M9757 Scalable Video Medialiving : a very low-bit rate layered protection of content
Caporossi JérômeParayre DanielaLecomte Daniel
M9767 Stack Robust Fine Granularity Scalability: Response to Call for Evidence on Scalable Video Coding
Hsiang-Chun HuangWen-Hsiao PengChung-Neng WangTihao ChiangHsueh-Ming Hang
M9770 Multi-Resolution MCTF for 3D Wavelet Transformation in Highly Scalable Video
Takahiro KimotoYoshihiro Miyamoto
M9771 Summary of responses on Call for Evidence on Scalable Video Coding Advances
Jens-Rainer Ohm
M9783 Demonstrations of Scalable Video Coding on interlaced material Jerome Vieron,Gwenaelle Marquant,Boisson,Robert,Francois,Christine Guillemot
M9784 Response to the Call For Evidence on Scalable Video Coding Advances
Jerome Vieron,Gwenaelle Marquant,Boisson,Robert,Francois,Christine Guillemot
M9815 Methods for Minimizing Average Temporal Distance for Motion Estimation in Interframe Wavelet Video Coding
Changhoon YimHo Jin HaBae-Keun LeeWoo-Jin Han
M9821 FGS Anchor Sequences for Call for Evidence on Scalable Video Coding Advances and Related Tools
Yi-Shin TungWei-Ta ChuWen-Huang ChengTing-Jian PanHsien-Shuo ChenJa-Ling Wu
M9835 Response to the Call for Evidence on Scalable Video Coding Konstantin HankeThomas RusertStefan SmeetsDaniel Thull
M9836 Decoder Deblocking Filtering in Interframe Wavelet Video Coding with Block-based Motion Compensation
Thomas RusertDaniel Thull
M9843 Results on Scalable Video Coding in Low Delay Mode Lee Men HuangShen Sheng MeiYoshimasa Honda
M9895 Modified AVC Codecs with Spatial and Temporal Scalability Lukasz Blaszak Marek Domanski
M9911 Response to Call for Evidence on Scalable Video Coding Yiannis AndreopoulosJoeri BarbarienFabio VerdicchioAdrian Munteanu
121
Mihaela Van der SchaarJan CornelisPeter Schelkens
M9923 Experimental Results for Call for Evidence on Scalable Video Coding Advances
Woo-Jin HanBae-Keun LeeHo Jin HaChanghoon Yim
M9928 Layered Spatial Coding and Local Motion Processing F.J. de BruijnW.H.A. BrulsR.J. van der VleutenI.O. KirenkoJ. van der Meer
M9929 Iterative predict optimization in MCTF video Gregoire Pau Christophe Tillier Béatrice Pesquet-Popescu Henk Heijmans
3D AV CodingIn 3D AV coding, the following Exploration Experiments were performed until the Trondheim meeting: EE1 – Evaluation of usage of mesh objects for omni-directional video EE2 – Free viewpoint video EE4 – Depth/disparity coding for 3D-TV EE5 – Preparation of promotional CD/DVDEE5 was successfully completed, the material is collected as planned and is made publicly available from an ftp site. EE4 was also successfully completed. It has been identified that basically, all tools for transport of 3DTV data over MPEG-2 streams are available, semi-proprietary systems could be built on this basis. However some mechanism would be needed to normatively describe the combination of different data like video and disparity/depth map, which might be possible by a new profile/level definition provided that interoperable systems are needed by industry.The technology investigated in EE1 can in principle fully be implemented by the Core profile. A rough guess indicates that plane size of up to 4000x4000 pixels would be needed, which is by far not supported by any level. However, not all of these data would have to be decoded at once. Hence, it is necessary to further investigate in EE1 mechanisms which would allow to partially decode Core objects, and to identify what the actual maximum size of a VOP would be.In EE2, new test material (both for natural multi-view video with 16 cameras and for synthetic objects) was provided and is available from the ftp site. EE2 intends to realize free viewpoint adaptation from multiple cameras, for which partially tools exist in MPEG as far as the synthesis side is concerned (in SNHC/AFX). Different technical approaches are proposed (M9721, M9761, M9808, M9837), where the ray space method is more oriented to video signal processing aspects, while others more on the model based (3D graphics) side. From the view point of video compression, the most important questions are whether the view interpolation should rather be performed at the sender side (possibly
providing a highly overcomplete information to the receiver), or if efficient and high-quality interpolation can be implemented at the client;
what the impact of compression artifacts on the quality of the interpolated views will be; whether the inter-view redundancy is significant enough (compared to the inter-frame
redundancy in the single views) to justify the development of innovative video coding methods;
These items are planned to be investigated in EE2 until the next meeting, it is further planned to extend the test data set by providing data that are shot by a system of 100 cameras, providig a larger range of viewpoint adaptation.
122
Documents reviewed:M9721 3D Video Fragments as a Data Representation and Streaming Method for
EE2 in MPEG 3DAVStephan WuermlinEdouard LamborayHanspeter PfisterMarkus Gross
M9761 Compression Scheme for Model-based 3D Video Takashi MatsuyamaYosuke KatsuraMartin BoehmeHitoshi Habe
M9795 Report of EE1 on Omni-directional Video Hitoshi HabeKazumasa YamazawaToshio NomuraTakashi Matsuyama
M9808 Comparative Evaluation of Ray-Space Interpolation Methods Masayuki TanimotoToshiaki Fujii
M9820 Korean NB’s comment on the status of the 3DAV group KNBM9832 3DAV, are we there yet? Euee S. Jang
Wook-Joong KimMyungsuk KiJungil SeoKyuheon KimJinwoong Kim
M9837 Multi-texture Surfaces for View-dependent Rendering in Free Viewpoint Video and Graphics
Aljoscha SmolicKarsten MuellerMichael DroeseBirgit KasparPhilipp MerklePeter EisertThomas Wiegand
M9839 Requirement for Random Access and View-dependent Partial Decoding and Rendering in 3DAV
Aljoscha SmolicDavid McCutchen
M9875 Broadcast Transmission of 3D-TV Data Christoph FehnPeter KauffAljoscha Smolic
M9887 A Synthetic Test Data Set for Rendering/Reconstruction Methods in EE2 Ming LiSabina BihlmaierLukas AhrenbergChristian TheobaltMarcus Magnor
Output documents related to Explorations
No. Title TBP Available
3D AV5700 Description of Exploration Experiments in 3DAV 03/07/25
Scalable Video Coding
5701 Report on Call for Evidence on Scalable Video Coding Technology
Y 03/08/08
5702 Draft Call for Proposals on Scalable Video Coding Technology 03/07/25
AHGs supported by the Video Subgroup No. Title Mtg Sponsor(s)
123
5703 AHG on Maintenance of MPEG-4 Visual Text, Reference Software and Conformance
N Video
5704 AHG on Visual Descriptors and Visual-only Description Schemes in MPEG-7
Y Video
5705 AHG on Editing Visual FPDAM1, DCOR1 and WD for 15538-8 DAM1
N Video
5706 AHG on 3DAV Coding Y Video,Requirements
5707 AHG on Scalable Video Coding Y Video,Requirements
5827 AHG on AVC Verification Test Y Test, Video5804 AHG on MPEG Multimedia Test Bed Y Integration,
Video
124
Annex 8Report of Audio meeting
Source: S. Quackenbush, Chair, Audio Subgroup
Opening of the meetingThe MPEG Audio Subgroup meeting was held during the 65th meeting of WG11, July 21-25, 2003 in Trondheim, Norway. The list of participants is given in Annex A-1. Administrative mattersApproval of previous meeting reportThe Audio Subgroup Pattaya meeting report had been previously distributed by email and was approved.
9909 S. R. Quackenbush 64th MPEG Audio Report
Approval of agenda and allocation of contributionsThe agenda and schedule for the meeting, shown in Annex A-II, was discussed, edited and approved. The documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary, are shown in the agenda and schedule. The Chair brought relevant documents from Requirements, Systems and MDS to the attention of the group.Communications from the ChairThe Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary.
9908 S. R. Quackenbush 65th MPEG Audio Task Groups
Joint meetingsThe joint meetings with Audio over the course of the week are listed here and are reported on below.Group 1 Group 2 What Where Day TimeAll MPEG-7 profiles (9900) Req Tue 1400-1600Systems Audio,
VideoTutorial on ISO FF AMD1 (static metadata) MPEG-4 file format (9905)
Audio Wed 1400-1500
Audio Systems MPEG-4 BIFS (9860)MPEG-4 BIFS (9759) Music notation (9731)
Audio Wed 1500-1600
MDS Audio Audio DIA MDS Wed 1600-1630Audio Integration Audio contribution to Conformance and
Reference SWAudio Thu 1100-1130
Audio Systems BiM Audio Thu 0900-1000
125
Received National Body Comments and Liaison mattersThe NB Comments and Liaison documents for the meeting that require a response are as shown below.No. Title Response From9858 GNB Comment on Lossless Audio Coding S. R. Quackenbush9871 GNB Comment on MPEG-4 AAC scalable tool combination S. R. Quackenbush9885 Swedish NB comment on lossless audio coding S. R. Quackenbush9922 Korean NB Comment on Lossless Audio Coding S-W Kim
9720 Liaison Statement from ITU-T SG 16 on ITU-T Q9/16 Embedded Audio Coding Work [SC 29 N 5414]
Karlheinz Brandenburg
Task GroupsTask groups were convened for the duration of the MPEG meeting, as shown in ANNEX-III. Results of task group activities are reported below.
Record of Audio plenary, joint meetings and task group activitiesAssociated AhG meetingsMPEG-4 Audio Lossless Coding - Sun 20 Jul 2003, 1000-1500
General topics9762 MPEG-4 Audio Takehiro Moriya
Dai Tracy YangProposal of lossless coding for audio data in the IEEE floating point format
Takehiro Moriya reported on a proposed technique for lossless compression of audio signals represented in IEEE floating point. Next steps are to gather more information on what forms of IEEE floating point format is used in industry, and to try to express this a possible requirements for lossless compression.
9881 MPEG-4 Audio Derk ReefmanWerner Oomen
Lossless performance for DST for 1 bit oversampled signals with different oversampling ratios
Werner Oomen reported on the performance of Philips DST technology as extended to higher sampling rates and word lengths. The Philips technology has been demonstrated to be extendable to higher sampling rates (e.g. 128, 256) with good performance. Next steps are to recommend to Audio Subgroup to issuing a CfP at the Trondheim meeting.
Lossless only compression9781 MPEG-4 Audio Tilman
LiebchenDetailed technical description of the TUB 'lossless only' proposal for MPEG-4 Audio Lossless Coding
Tilman Liebchen presented m9781. This satisfies the documentation component of this technology progressing to RM0, and will be the basis of the WD on this work item.
9879 MPEG-4 Audio Yuriy A. Reznik Verification Report on RM0 for MPEG4 Lossless Audio Coding
9890 MPEG-4 Audio Yuriy A. Reznik Performance Limits of Codes for Prediction Residual
Yuriy Reznik presented m9879, which is an independent check on the performance of Lossless Audio Coding (ALS), as implemented by RM0 source code obtained from the ALS ftp site
126
(ftp://ftlabsrv.nue.tu-berlin.de/mp4lossless/). It results indicated identical performance for RM0 decoder, with close performance for RM0 encoder (due to differences in setting encoder options). The conclusions are that RM0 has compression within 1% of that of Monkey’s Audio (however the RM0 encoder was not the optimized encoder that was used in the CfP), and that RM0 has much lower complexity than Monkey’s Audio.
He also presented 9890, which discussed performance limits of lossless compression algorithms, as are used in ALS. The document presents a histogram of actual residual for the MPEG lossless coding data set as compared to a theoretical model of the Laplacian distribution. It is shown in that document that:
Redundancy in Laplacian distribution vs. quantized Laplcian distribution is 1.2 percent Redundancy in observed distribution vs. true Laplcian distribution is 1.8 percent Redundancy in observed distribution vs. quantized Laplcian distribution is 1.6 percent
Hence the overall conclusion is that in the context of the current RM0, it will be difficult to achieve more than 1.6% of improvement in compression for the MPEG data set.Jim Johnston, Microsoft, observed that for MPEG lossless work, it may be required to specify some aspect of the encoder. Whereas an MPEG lossy encoder is a process that produces a correct bitstream, an MPEG lossless encoder is a process that produces a correct bitstream that must in addition be decodable to the identical input waveforem (i.e. achieve lossless compression).
9829 MPEG-4 Audio Itaru Kaneko Satoshi Miyata
Waseda-TOA experiments on evaluating noise robustness for Lossless Audio Coding
Itaru Kaneko presented results of using the TOA algorithm, RM0 and Monkey’s Audio to losslessly compress signals with high levels of additive noise at high audio frequencies. This might be typical of signals obtained from legacy analog formats (e.g. analog tape). The results were that RMO exhibited poorer performance as the level of additive noise was increased. The conclusion of the AhG was that perhaps the lossless coding signal set should included two distinct sets: the current set and a set representative of signals obtained from legacy analog content.
Scalable to lossless compression9872 MPEG-4 Audio Ralf Geiger Information on Improved Integer MDCT
Ralf Geiger presented information on a new Integer MDCT algorithm from FhG. The improvement in performance is due to a significantly lower number of rounding operations used in the Integer MDCT, and in addition the new algorithm also has lower complexity.
9873 MPEG-4 Audio Ralf Geiger Information on Improved Coding Results for Proposed Scalable Lossless Audio Codec
Ralf Geiger presented information on the performance of the FhG Lossless Audio Codec when used with the new Integer MDCT algorithm. Data indicates that the new Integer MDCT leads to an overall improvement in performance of more than 4 percent.
9874 MPEG-4 Audio Ralf Geiger Juergen Herre Gerald Schuller Sang-Wook Kim Miao Lei
Information on Feasibility of Combining the FHG-Proposal for Scalable Lossless Enhancement with MPEG-4 AAC/BSAC
127
This document, presented by Ralf Geiger, indicates a possible means of converting MPEG-4 BSAC into a lossless coder my mean of the new Integer MDCT and blocks from FhG’s proposal to the lossless CfP. Audio plenary discussionsReceived national body comments and liaison matters
Conformance test sequencesThe following NB comment was presented, which noted that since there are no conformance test sequences for the combination of LTP andScalable AAC tools for short block instances, and hence the GNB recommends that this combination be removed from the MPEG-4 standard.9871 Ralph
Sperschneideron behalf of the GNB
GNB Comment on MPEG-4 AAC scalable tool combination
Mauri Väänänen, Nokia, resolved the issue by committing to define the missing test sequences by the close of this MPEG meeting, and to supply the sequences by the opening of the December MPEG meeting.
Scalable to lossless audio coding – Monday 1600-1800hrsThe following NB comments were presented for discussion.
9858 Juergen Herreon behalf of the GNB
GNB Comment on Lossless Audio Coding
9885 Kristofer Kjörling on behalf of the Swedish NB
Swedish NB comment on lossless audio coding
9922 KNB Korean NB Comment on Lossless Audio Coding
The GNB asked that the work on scalable to lossless coding either be stopped or that it be folded into a new CfP that emphasises fine grain scalability as it’s primary objective. The Chair proposed several ways to resolve this issue For the current CfP, stipulate a minimum level of lossy compression performance for the
technology under consideration with respect to current MPEG-4 technology such that WG11 insures that the new technology does not duplicate current MPEG functionality.
Issue an MPEG internal CfP for fine-grain scalable technology. Abandon the scalable to lossless work since the CfP is satisfied by the lossless-only work in
conjunction with MPEG-4 simulcast.Scalable to lossless audio coding – Tuesday 1600-1800hrs
The Chair asked all interested parties to present their views on the procedure and criterion that should be used to move the Scalable Lossless Coding work forward. The Chair summarized these views as follows:
1. Processa. MPEG RM and CE process
2. Goalsa. Lossless enhancement on top of MPEG-4 lossy core coderb. Core shall be an MPEG-4 T/F coderc. Enhancement layer shall not rely on perceptual model other than that of the lossy
core coder3. Measurement criterion
a. Core coded is AAC-LC operating at 64kb/s/channelb. Primary
128
i. Lossless compression at Fs and Wd (primary)c. Secondary
i. Core to lossless scalability functionality (yes/no?) ii. Existence of other functionality (e.g. fine grain scalability, random access,
etc., see CfP)iii. Complexity ROM, RAM, MIPS, etc. (This is a deciding factor only if large
differences between systems. Decoder more important than encoder)4. RM0 selection
a. Select RM0, then use CE process IntIMDCT is first CE
5. Workplana. Status of RM0 and CEsb. Gather information on applications of scalable lossless coding in industry.
Scalable to lossless audio coding – Wednesday 1600-1800hrsThe Audio subgroup achieved consensus on a plan for the progression of the work on scalable to lossless audio coding, which is described in document N5720, Workplan for Scalable Lossless Coding (SLS). Chair notes that Jim Johnston, Microsoft, objects to using 64 kb/s/channel as an operating point for the MPEG-4 AAC-LC lossy code coder in the development plan for the SLS standardization work.The status of the Scalable Lossless Coding coding (which is documented in N5720 in greater detail) is that the proposal from I2R was selected as RM0, since it had the highest mean compression of all CfP responses based on a lossy core coder having in IMDCT. The work on selection of an IntIMDCT was accepted as the first Core Experiment. The architecture of RM0 is shown here:
Core Experiment Methodology9910 MPEG-4 Audio S. R.
QuackenbushProposed Modified core experiment methodology for MPEG-4 audio
The chair presented m9910. The Audio subgroup discussed and revised this document, and it was most particularly extended to cover the new work items on lossless coding. Joint Meetings All on MPEG-7 profilesThe Chair attended and waited for the presentation of m9900, which did not occur in during this joint meeting.9900 MPEG-7 Requirements Wo Chang
Bhavan GandhiSchuyler
Towards a Simple Metadata Profile
129
QuackenbushEric RehmDavid SingerJohn R. SmithVetro
With Systems: Tutorial on ISO File Format AMD1 and issues with AAC in MPEG_4 File FormatTutorial on ISO File Format AMD1Dave Singer, Apple, gave a tutorial on AMD1 to the ISO File Format. One type of static metadata is already supported in the ISO File Format, that being Object Content Information (OCI) as defined in MPEG-4 Systems. This amendment adds support for static MPEG-7 metadata. Note that the ISO File Format already supports dynamic metadata in tracks linked to audio content segment via track reference. Noted that IOD and MPEG-7 represent redundant mechanisms for encoding metadata. The goal is to publicize the MPEG-7 mechanism and hope that most of the market adopts this method.Problems still to be addressed are that metadata can be expressed as tag-value pairs, but type is implied by tag, e.g. tag implies type is 32-bit value. Hence if type is unknown then value cannot be parsed.The AMD text is at WD level, and can be found in document w5658 (from Pattaya). In that WD the static metadata part is pretty solid and hence worth reviewing! It defines a Meta box at file, presentation and stream level. Metadata is referenced via a Handler declaration that supports data-references. This permits metadata to be stored elsewhere (e.g. in the mdat pool) using same indirection mechanism as for the media itself. This box may contain textual or binary MPEG-7 metadata. In the case that the metadata itself contains a reference, e.g. a URL, it can point to the mdat pool, but it is still an open issue as to how to associate the URL with an entry into a offset pointer table.
AAC in mp4FFMohammed Visharam, Apple, presented
9905 Dave SingerMohammed Zubair VisharamAli. Tabatabai
MP-4 File Format: Interoperability issue/error pertaining to the storage of AAC encoded content
Since the AAC decoder is not adequately specified in terms of processing of stored state (i.e. the first half of the overlapped MDCT window), there is uncertainty as to the correct value of the time stamp associated with decoded AAC blocks. The solution suggested by the group is that the encoder shall operate such that a timestamp assigned to a compressed Audio block is associated with first sample of the output block produced by decoder when processing that block.Additionally, in the interest of facilitating deterministic (and highest possible quality) editing of AAC bitstreams, MPEG should consider how to specify the following:
Normative signaling of pre-roll within an MPEG-4 coded stream Normative table of pre-roll times or blocks (e.g. for each audioObjectType)
With Systems on MPEG-4 BIFSThis is covered in the Task Group report on this topic.
130
With MDS on Audio DIAThis is covered in the Task Group report on this topic.
With Systems on BiMJan Rohden, FhG, presented an experiment showing what compression is possible if one uses multiple non-uniform quantizers. The results indicate that multiple non-uniform quantizers are able to achieve a factor of two additional compression over the case of a single uniform quantizer. Claude Seyrat, Expway, commented that the changes to the specification appear to be simple: all is needed is to define an additional attribute “dim” for certain types, e.g. “mean.” These changes to the specification will be incorporated into the FPDAM at this meeting. The reference software must also be changed to make the dim attribute available to the external quantizer, e.g. a non-uniform quantizer.
With Integration on Audio contribution to Conformance and Reference SWConformanceAn amendment is produced as delta changes against the base document. Integration manages the WG11 document numbers for the amendment (i.e. numbers on the Friday of the MPEG week) and lists the amendment in the Integration section of the WG11 resolutions. Audio can produce an integrated Audio section of the conformance document at any time it may wish, and can manage those document numbers and approve those documents in the Audio section of the WG11 resolutions. At the time that the amendment progresses to AMD, Audio will pass to Integration an integrated Audio section that represents the AMD changes. At this meeting the conformance associated with Bandwidth Extension is WD, so there is not yet a need for interaction with Integration and Audio will manage that document. Note that when this progresses to PDAM, Integration will manage the document.Reference SoftwareThere is will be an amendment to MPEG-4 reference software started at this meeting (for AVC). Integration will expand that amendment to include Audio and Heiko Purnhagen will give Jean Claude DuFord an update of the full Audio VM.Task group discussions
MPEG-1/2/4 Layer III – Jens SpilleThe main activity was to review the input contributions and to discuss about the following issues:
Layer III Reference software The “Text of ISO/IEC 13818-5:1997/Amd.1:1999/DCor.2:2003” was reviewed and no changes were required.
Conformance Bitstreams Ralph Sperschneider, FhG reviewed the “Text of WD of ISO/IEC ISO/IEC 13818-4:1998/Amd.4"” and updated it to WD 1.1.
MP3onMP4 The Pattaya “WD of ISO/IEC 14496-3:2001 /AMD 3 (MP3 in MPEG-4)” contains two annexes to ISO/IEC 14496-3:2001 (MPEG-4 Audio) related to the use of ISO/IEC 11172-3 Audio Layer III and ISO/IEC 13818-3 Audio Layer III in MPEG-4. Annex XXX (informative) provides unambiguous assistance in the use of decSpecificInfo and accessUnit for the MPEG-1/2 Layer III case. Annex YYYY (normative) contains a description of an alternative way to carry data in MPEG-4 such that an accessUnit contains all bits necessary to decode the audio segment associated with the accessUnit's time stamp. Such a structure would result in Layer III accessUnits that are in the spirit of MPEG-4 and hence would better facilitate transport over packet based networks, random access, and editability. Philips made some “Comments on MPEG-4 Extension 3 (mp3 in MPEG-4)” on the Pattaya working draft. We discussed the comments and drafted some changes to the working draft. For the
131
first part of the working draft (informative) there was nothing to change. For the second part (normative) several changes were requested. We agreed on a new format, which enhanced the editability of the MPEG-4 stream. This was achieved by using variable bitrate with the main data begin pointer always set to zero. There are several ways to unpack this format, depending on the position of the ancillary data. For details please review the new working draft “Text of ISO/IEC 14496-3:2001 /PDAM 3 (MP3onMP4)” (N5717) which will become a Proposed Draft Amendment (PDAM) and will be balloted by the National Bodies during a four month balloting period to follow this meeting.There was a long discussion on the issue of whether the multichannel length information should replace the 12 bit synchronization information or if this field should be a separate field. Since technically there is no real difference, we decided to keep it as it was in the original proposal.
MPEG-2 AAC Text, MPEG-4 Audio Text, MPEG-4 Audio Conformance, Reference Software – Ralph Sperschneider, Heiko PurnhagenThe following documents were presented:
9736Ralph Sperschneider on behalf of the AHG on MPEG-4 Audio Conformance
Status of MPEG-4 Audio Conformance
9789 Ralph Sperschneider Proposed 3rd Edition of ISO/IEC13818-7
9792Ralph Sperschneideron behalf of the AHG on MPEG-4 Audio Text and Software
WD of 3rd Edition of ISO/IEC14496-3
9844 Giorgio Zoia Report on SA reference software and conformance bitstreams
9787Ralph Sperschneideron behalf of the AHG on MPEG Conformance
WD of ISO/IEC ISO/IEC 13818-4:1998/Amd.4
9791 Ralph Sperschneider Proposed 2nd Edition on ISO/IEC TR 13818-5:2003 (MPEG-2 Reference Software)
9787Ralph Sperschneideron behalf of the AHG on MPEG Conformance
WD of ISO/IEC ISO/IEC 13818-4:1998/Amd.4
9791 Ralph Sperschneider Proposed 2nd Edition on ISO/IEC TR 13818-5:2003 (MPEG-2 Reference Software)
MPEG-4 Extension 1, BWE, BWE Embedding - Kristofer KjörlingKristofer Kjörling presented m9728 “proposed WD conformance for SBR” which is a working draft document outlining the bitstream conformance and decoder conformance of the HE-AAC decoder (SBR). Only RMS/LSB conformance criterion will be used, albeit with different thresholds for different bitstreams. Furthermore, a Class A and Class B conformance is introduced giving implementers an opportunity to do optimizations that may introduce a higher noise-floor. Different parts of the SBR tool and their sensitivity to rounding in implementations were elaborated on.The document was approved and issued as a WG11 (output) document.A joint meeting was held with integration outlining the procedure surrounding the amendment to the conformance document.Kristofer Kjörling presented m9798 which is the ballot results for the MPEG-2 audio amendment 1. The editorial comments by the GNB and SNB were approved, and reflected in the FDAM 1 document. A DoC on FPDAM 1 was produced.Pierrick Philippe presented the test results from the France Telecom formal verification test. Late in the AhG period it was discovered that the at 30 kb/s MPEG-4 AAC mono reference codec signals were encoded with sub-optimal encoder settings (resulting in a lower than appropriate bandwith). Discussions on how to handle the 30Kbps AAC listening test results followed. Pierrick Philippe also did post screening of the data, using the agreed upon post screening method (getting the “correct” order of the test anchor signals, i.e. scoring ref > bw7kHz > bw3.5kHz) The post screening of the data did not change the outcome of the test.
132
No formal test report was prepared, however the outline of the report was agreed upon. The report will comprise: stereo MUSHRA test results from FT and T-Nova mono CMOS test results from FT mono MUSHRA test results from previous tests at FT, CT and MEI.
Hence, the recent mono MUSHRA test results from FT and T-Nova will not be used.The test report will be done in the AHG period, and registered as a contribution to the 66th MPEG meeting.
MPEG-4 Extension 2, Parametric Coding – Werner Oomen Four documents were presented:
M9882 MPEG-4 Extension 2, proposed editorial changes M9883 MPEG-4 Extension 2, Integration of Reference SW M9884 Core Experiment proposal on ADPCM coding of sinusoidal parameters in MPEG-4
Audio Extension 2 M9742 MPEG4-Audio Extension 2: Core Experiments on Complexity Reduction in Parametric
Stereo Decoding
M9882 Proposed editorial changes Presented by WO. Editorial changes w.r.t. PDAM and informative text on pitch tempo scaling. Changes have no impact on the reference SW. The audio sub-group agreed to adopt these editorial changes in the study on FPDAM document.
M9883 Integration of Reference SW Presented by WO. The MPEG4 Extension 2 reference SW has been integrated into the MPEG4 framework and uploaded to the CVS repository.
M9884 Core Experiment proposal on ADPCM coding of sinusoidal parameters Presented by WO. CE on efficient coding of the frequency and phase information by means of ADPCM. Applies to the sinusoidal components. The core experiment proposal was agreed to be complete. Subjective testing was performed at three different sites (Philips and FT R&D Rennes and Lannion). Particularly speech items improve. However, a number of other items (Harpsichord, castanets and bag pipes) have a slightly degraded quality. The proponent indicated that he has located the problem for this degradation and is currently adapting the encoder. The audio subgroup agreed to use the upcoming AdHoc group period to provide new subjective test results. Acceptance of the modifications associated with this core experiment will depend on whether these subjective results fulfill the CE acceptance criteria (i.e. at least one item statistically significant better and none of the other items statistically significant worse).
M9742 Core Experiments on Complexity Reduction in Parametric Stereo Decoding Presented by JB, FT R&D. CE on reduced complexity decoding of the parametric stereo coding module. Modifications save one FFT and one time-domain filtering operation. Subjective test results indicated that for typical items, these differences are inaudible though it has been noticed that for transient items such as castanets a slight difference was observed. The audio subgroup agreed to start further exploring the option of low complexity parametric coding, not limited to the parametric stereo module. The findings of France Telecom will be used as a basis in defining a low complexity decoder.
133
Workplan Philips is to provide new subjective evidence on the ADPCM coding of frequency and phase information, by the 66th MPEG meeting. France Telecom, Philips and other interested companies will explore the option of low complexity parametric decoding. France Telecom will provide the LC implementation of the Stereo Parametric decoder as a base.
Since there were no NB ballot comments on the PDAM, here will be no DoC this meeting. However the specification will progress to FPDAM, with the text incorporating the ISO template. There will also be a Study on text of FPDAM document, which was revised relative to the Study on PDAM and also an updated Workplan for Core Experiments.
MPEG-4 Extension 3, Lossless Coding Yuriy Reznik presented
9893 MPEG-4 Audio Yuriy A. Reznik Proposed CE for Improving Coding of Prediction Residual
This Core Experiment proposes using block Gilbert-Moore block codes to encode the central region of the distribution of the prediction residual. From a theoretical consideration, such codes should be able to approach a redundancy of zero, and hence have better performance than the Rice codes used in RM0. This CE used the RM0 encoder, and also the default options of the encoder. This means that the predictor order was 10 and the frame length was not truly adaptive, but rather depended only on signal sampling rate.The Audio subgroup accepted this CE. During the MPEG meeting week the CE proponent:Wrote a hybrid encoder that took the TUB CfP bitstreams, expanded them to get the prediction residual, re-conpressed them using the proposed proponent technology, and calculated the resultant comrepression. Had both Dolby and IFPI cross-check this workBased on this additional evidence the Audio subgroup accepted the check for this CE as successful. The Workplan on Lossless Coding (ALS) inditates the addition steps that are required for the successful completion of the CE.Tillman notes that, for this CE, the estimates of the probability density functions are based only on the test set, and that it would be preferable to validate such estimates against a larger signal set.
MPEG-7 Ext 1, Ext 1, Conformance and Reference Software Ext 1 – Jan RohdenThe following documents were presented:
9862
Jan RohdenMarkus CremerChristian Uhle
An Appropriate Rhythmic Pattern Representation for Music Retrieval and Comparison
9865
Jan RohdenMarkus CremerChristian Uhle
A proposal for the description of Micro Time
Systems experts agreed on the following solution concerning MPEG-7 extensibilty (i.e. base types v1 → v2). Here is how Claude Seyrat explained it:
All tools (V1 & V2) in a single new namespace (see w5596) Principle
o Cut and paste of the entire V1 in V2
134
o Replace (in V2) amended tools by new ones Pro: Version signaling is solved: the new namespace is used Con: Complexity is raised unnecessarily as the number of definitions to be managed by
a parser during parsing is doubled, although this is only in the case when dealing with both V1 and V2 descriptions.
Con: does not provide forward compatibility.
MPEG-4 Audio BIFS extensions (AudioBIFS version 3) – Giorgio ZoiaThe task group reviewed input documents. The first issue under discussion was the integration of 3D audio scenes into 2D visual context. After discussion of the related input proposal and clarification of the different aspects related to this issue, an agreement was reached on the fact that a transformation node above the rendering node (Sound, DirectiveSound, possibly WideSound) is a more general and comprehensive solution than the current Sound2DDepth alone. A new node called AudioTransform3D was then defined and inserted into the WD 2.0 document.As a second issue document m9817 was discussed, containing a proposal to add to the AudioFX PROTO definitions a new AudioReverb node to allow a more detailed reverb description and the use of measured room impulse responses. Some parts of this proposal were recognized as overlapping with existing Advanced Audio BIFS technology; moreover the measured impulse responses do not seem very adequate to a mainly streaming media environment such as MPEG-4 (experiments carried on in the CARROUSO project, m9744, were used to support this statement).The third issue was the integration of Ambisonics into MPEG-4 BIFS. It was recognized that this part of the proposal is not as mature as other parts and would need additional discussion. In particular the exact placement of the Ambisonics decoder with respect to the terminal is not completely clear and the corresponding channel configuration may be influenced by this aspect. Moreover it was noticed that the node AudioChannelConfig is not a real processing node, and it may be better defined as a node accessing the terminal directly instead of being part of the audio subtree. All these issues about Ambisonics and channel configuration will be discussed at length during an AHG meeting that it was decided to organize in Paris in September, with the purpose to reach for those parts the same degree of stability than other parts.Some technical details about AdvancedAudioBuffer and WideSound were discussed and acceptedFinally the problem of low complexity Audio Effects was discussed. Some clarifications were made for the proposed PROTOs solution, and also some points were clarified about the complexity metrics used in Conformance to measure complexity levels and bound AudioFX complexity. It was decided to proceed with some comparison tests and to evaluate better the pros and cons of the two approaches, in order to reach consensus by the next meeting. The availability of the necessary player is to be checked but the appropriate tests seem to be feasible in a reasonably short time.
MPEG-21 DIA - S-W KimThe MPEG-21 DIA ballot comments were reviewed by the Audio and MDS groups, and the Audio related disposition of comments was prepared. The report of Core Experiment on Audio AdaptationQoS was presented by Eunmi Oh, Samsung. The MDS group and Audio group agreed that the CE on Audio AdaptationQoS is finished, and as a result, the Audio AdaptationQoS related text in AM is promoted to MPEG-21 FCD.Meeting deliverablesPress statementThe Audio part of the press statement was prepared and reviewed. Dispositions of CommentsDoC were presented and approved.Responses to Liaison and NB commentsThe responses to liaison and NB comments were presented and approved.
135
Recommendations for final plenaryThe Audio recommendations were presented and approved.Establishment of Ad-hoc GroupsThe following ad-hoc groups were established by the Audio subgroup:No. Title Mtg
5729 AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4
No
5730 AHG on MPEG-4 Audio Conformance No5731 AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software Yes
5732 AHG on MPEG-4 Audio Extensions 1 and 2 No5733 AHG on MPEG-4 Audio Lossless Coding YesApproval of output documentsAll output documents, shown in Annex-IV, were presented in Audio plenary and were approved.Future activitiesSchedule of future meetingsAd Hoc group meetings are shown in the table listing the Ad Hoc groups.Agenda for next meetingThe agenda for the next MPEG meeting is shown in Annex V.All other businessThere was none.Closing of the meeting The 65th Audio Subgroup meeting was adjourned at 14:00hrs (plenty of time for lunch)!
136
Annex A-I: ParticipantsFirst Name
Last Name Country
Affiliation e-mail address
Jerome Barthelemy FR IRCAM [email protected] Brandenburg DE FHG IIS AMT [email protected] Chao USA ITRI Inc. [email protected] Chau US NJR Corp. [email protected] Chen USA ITRI Inc. [email protected] Seng Chong SG Panasonic
Martin Dietz DE Coding Technologies
Bernhard Feiten DE Deutsche Telecom
Matt Fellers USA Dolby [email protected] Geiger DE FhG IIS [email protected] Gooch UK IFPI 137 erner 137 .gooch@ifpi .orgBernhard Grill DE FhG IIS [email protected]ürgen Herre DE FhG-IIS [email protected] Johnston USA Microsoft
Itaru Kaneko JP Waseda Univ. [email protected]
Kim KR Samsung [email protected]
Kristofer Kjörling S Coding Technologies
Marc Klein Middelink
NL Philips marc.klein.middelink @137erner137.com
Tilman Liebchen DE TU Berlin [email protected] Moriya JP NTT [email protected] Nesi I UNIFI – DSI [email protected] Nomura JP NEC [email protected] Oh KR Samsung [email protected] Oomen NL Philips 137 erner.oomen@philips .comPierrick Philippe FR France Telecom
Heiko Purnhagen DE Coding Technologies
Schuyler Quackenbush USA ARL [email protected] Rahardja SG I2R [email protected] Bernard
Rault FR France Telecom R&D
Yuriy Reznik USA Realnetworks [email protected] Rohden DE FhG IIS EMT [email protected] Schuller DE FhG IIS EMT [email protected] Seo KR ETRI [email protected] Sperschneider DE FhG IIS [email protected] Spille DE Thomson [email protected] Stoll DE IRT Gmbh [email protected]
Herve Taddei DE Siemens AG [email protected] Tanaka JP Panasonic [email protected] Toguri JP Sony [email protected] Väänänen FIN Nokia Res.
Mark Vinton USA Dolby [email protected] Virette FR France Telecom
Lin Xiao SG I2R [email protected] Yu SG I2R [email protected] Zoia CH EPFL [email protected]
138
Annex A-II: Agenda and Schedule for the Trondheim MPEG Audio MeetingTime Agenda Item Rosenborg
MPEG-1/2/4
Room 612MPEG-7
Number Title Source
Sunday1000-1600 AHG on Lossless Coding
9762 Takehiro Moriya Dai Tracy Yang
Proposal of lossless coding for audio data in the IEEE floating point format
X
9829 Itaru Kaneko Satoshi Miyata
Waseda-TOA experiments on evaluating noise robustness for Lossless Audio Coding
X
9881 Derk ReefmanWerner Oomen
Lossless performance for DST for 1 bit oversampled signals with different oversampling ratios
X
9781 Tilman Liebchen
Detailed technical description of the TUB 'lossless only' proposal for MPEG-4 Audio Lossless Coding
X
9879 Yuriy A. ReznikVerification Report on RM0 for MPEG4 Lossless Audio Coding
X
9890 Yuriy A. ReznikPerformance Limits of Codes for Prediction Residual
X
9872 Ralf GeigerInformation on Improved Integer MDCT
X
9873 Ralf Geiger
Information on Improved Coding Results for Proposed Scalable Lossless Audio Codec
X
9874
Ralf Geiger Juergen Herre Gerald Schuller Sang-Wook Kim Miao Lei
Information on Feasibility of Combining the FHG-Proposal for Scalable Lossless Enhancement with MPEG-4 AAC/BSAC
X
Monday0900-1330 MPEG Plenary1330-1430 Lunch1430-1700 Audio Plenary
Opening of the meetingAudio Chair
Administrative mattersApproval of agendaApproval of Shanghai meeting report
9909 S. R. Quackenbush 64th MPEG Audio Report
X
Communications from the ChairList of contributionsAllocation of contributions to agenda and scheduleJoint meetings
Time Agenda Item RosenborgMPEG-
1/2/4
Room 612MPEG-7
Number Title SourceReview of AhG reports
9638 Jens Spille
AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4
X
9639Ralph Sperschneideron behalf of the AHG on MPEG-4 Audio Conformance
Report of the AHG on MPEG-4 Audio Conformance
X
9640 M. VaananenH. Purnhagen
AHG on MPEG-4 Audio Text and Software
X
9641 Schuyler QuackenbushAHG on MPEG-4 Audio Extensions 1 an d 2
X
Review of task groups and mandates
9908 S. R. Quackenbush 65th MPEG Audio Task Groups
X
Received national body comments and liaison matters
9720 SC 29 Secretariat
Liaison Statement from ITU-T SG 16 on ITU-T Q9/16 Embedded Audio Coding Work [SC 29 N 5414]
X
9871 Ralph Sperschneideron behalf of the GNB
GNB Comment on MPEG-4 AAC scalable tool combination
X
9858 Juergen Herreon behalf of the GNB
GNB Comment on Lossless Audio Coding
X
9885 Kristofer Kjörling on behalf of the Swedish NB
Swedish NB comment on lossless audio coding
X
9922 KNBKorean NB Comment on Lossless Audio Cod ing
X
1800-1830 Convenor remarks: Digital Media Project1830- HOD Meeting
Tuesday0900-0930 Audio Plenary Audio Chair
Outline plan for the dayBreak into task group activity
0900-1100 MPEG-4 Extension 2, Parametric Coding
9742 Jean-Bernard Rault
MPEG4-Audio Extension 2: Core Experiments on Complexity Reduction in Parametric Stereo Decoding
X
9882 OomenErik Schuijers
MPEG-4 Extension 2, proposed editorial changes
X
9883 Werner OomenErik Schuijers
MPEG-4 Extension 2, Integration of Reference SW
X
9884Andy GerritsBert den BrinkerWerner Oomen
Core Experiment proposal on ADPCM coding of sinusoidal parameters in MPEG-4 Audio Extension 2 (parametric coding for High Quality Audio) .
X
140
Time Agenda Item RosenborgMPEG-
1/2/4
Room 612MPEG-7
Number Title Source1100-1200 MPEG-4 Extension 1, BWE, BWE Embedding
9728Kristofer KjörlingHeiko PurnhagenDaniel Homm
Proposed working draft for SBR conformance
X
9913 S. R. Quackenbush
DRAFT Report on the Formal Subjective Listening Tests of MPEG-4 Bandwidth Extension Coding
X
9798 SC 29 SecretariatSummary of Voting on ISO/IEC 13818-7:2003/FPDAM 1
X
1200-1300 MPEG-1/2/4 Layer III
9886 marc klein middelink Comments on MPEG-4 Ext.3 (Mp3 in MPEG-4)
X
1300-1400 Lunch
1400-1600 Joint meeting w Req on MP7 Profiles
9900
Wo ChangBhavan GandhiSchuyler QuackenbushEric RehmDavid SingerJohn R. SmithVetro
Towards a Simple Metadata Profile
Discussion an review of other contributions
1600-1800 MPEG-4 Extension 3, Lossless Coding
Discussion on response to NB comments
1800-1830 Audio Plenary Audio ChairStatus for Chairs Meeting
1800-1900 Liaison Meeting1900- Chairs Meeting
Wednesday0900-1100 MPEG Plenary1100-1130 Audio Plenary Audio Chair
Report on Chairs meeting and outline of plan for the dayCE tutorial
9910 S. R. Quackenbush
Proposed Modified core experiment methodology for MPEG-4 audio
X
1130-1200 MPEG-4 Extension 3, Lossless Coding
9893 Yuriy A. ReznikProposed CE for Improving Coding of Prediction Residual
X
1300-1400 Lunch
1400-1800 MPEG-7 Ext 1, Ext 1, Conformance and Reference Software Ext 1
141
Time Agenda Item RosenborgMPEG-
1/2/4
Room 612MPEG-7
Number Title Source
9862Jan RohdenMarkus CremerChristian Uhle
An Appropriate Rhythmic Pattern Representation for Music Retrieval and Comparison
X
9865Jan RohdenMarkus CremerChristian Uhle
A proposal for the description of Micro Time
X
1400-1500 Joint meeting: Tutorial on ISO FF AMD1 (static metadata)MPEG-4 file format (9905)
Audio
9905Dave SingerMohammed Zubair VisharamAli. Tabatabai
MP-4 File Format: Interoperability issue/error pertaining to the storage of AAC encoded content
X
1500-1600 Joint meeting:MPEG-4 BIFS and Music notation
Audio
9860 Juergen Schmidt Comments on 3D Audio in a 2D Scene context
X
9759 Giorgio Zoia Comments on AudioBIFS v3 WD
X
9731
Giorgio ZoiaPaolo NesiJerome BarthelemyPierfrancesco BelliniDavid FuschiDavid CrombieFrancesco SpadoniKia NgMartin Schmucker
Proposal for Music Notation Modeling and its integration within MPEG-4 and MPEG-7
X
1600-1800 Lossless CodingFramework for Lossless Coding workResponse to NB comments
1600-1700 Joint meeting: Audio DIA MDS
9673 SC 29 SecretariatSummary of Voting on ISO/IEC CD 21000-7 [SC 29 N 5385]
X
9730
Eunmi OhSangJo LeeMiYoung KimYoungsik HuhSangWook KimBernhard FeitenIngo Wolf
CE report on audio adaptationQoS
X
9914 Kate GrantJack Sandover
Auditory Impairment and Digital Item Adaptation
X
9744 Giorgio Zoia Report of the European project CARROUSO
X
9817
Jeongil SeoDaeyoung JangKyeongok KangJinwoong Kim
Consideration on audioFXReverb PROTO
X
9859 Juergen SchmidtKlaus Eilts-Grimm
Update to WD 1.0 of ISO/IEC 14496-11/Amd.3
X
142
Time Agenda Item RosenborgMPEG-
1/2/4
Room 612MPEG-7
Number Title Source
9924Riitta VäänänenJean-Bernard RaultJérôme Daniel
Finalizing the production and crosschecking of 3D audio conformance bitstreams
X
1800-2200 Social
Thursday
0900-1000 Joint meeting: BiM
0900-1100 MPEG-2 AAC Text, MPEG-4 Audio Text, MPEG-4 Audio Conformance, Reference Software
9736Ralph Sperschneider on behalf of the AHG on MPEG-4 Audio Conformance
Status of MPEG-4 Audio Conformance
X
9789 Ralph Sperschneider Proposed 3rd Edition of ISO/IEC13818-7
X
9792Ralph Sperschneideron behalf of the AHG on MPEG-4 Audio Text and Software
WD of 3rd Edition of ISO/IEC14496-3
X
9844 Giorgio ZoiaReport on SA reference software and conformance bitstreams
X
9787Ralph Sperschneideron behalf of the AHG on MPEG Conformance
WD of ISO/IEC ISO/IEC 13818-4:1998/Amd.4
X
9791 Ralph Sperschneider
Proposed 2nd Edition on ISO/IEC TR 13818-5:2003 (MPEG-2 Reference Software)
X
9787Ralph Sperschneideron behalf of the AHG on MPEG Conformance
WD of ISO/IEC ISO/IEC 13818-4:1998/Amd.4
X
9791 Ralph Sperschneider
Proposed 2nd Edition on ISO/IEC TR 13818-5:2003 (MPEG-2 Reference Software)
X
1100-1130Joint meeting:Audio contribution to Conformance and Reference SW
1130-1300 Task group activites
1300-1400 Lunch
1400-1500 MPEG-21 DIA1500-1830 Task group activities
1830-1900 Audio Plenary Audio ChairStatus for Chairs Meeting
1900- Chairs Meeting (7PM for this meeting only!)
Friday0900-1300 Audio Plenary
143
Time Agenda Item RosenborgMPEG-
1/2/4
Room 612MPEG-7
Number Title SourceReport on Chairs meeting and outline of plan for the day Audio Chair
Discussion of unallocated contributionsMeeting deliverables
Press statementDispositions of commentsResponses to NB commentsLiaison statementsRecommendations for final plenaryEstablishment of new Ad-hoc groupsApproval of output documents
Future activitiesAgenda for next meeting
A.O.B.Closing of the Audio meeting
1300-1400 Lunch1400- MPEG Plenary
144
Annex A-III: Task Groups1. MPEG-1/2/4 Layer III
Chair: Jens SpilleMandates:1.1. Review contributions1.2. Review Audio part of ISO/IEC 13818-4:1998 AMD 4 1.3. Review Audio part of ISO/IEC 13818-5 DCor. X and Proposed ISO/IEC 13818-5:XXXX (2nd Edition)
1.3.1. Consider generating workplan for bugfixes1.4. Review WD of ISO/IEC 14496-3:2001/AMD 3 (MP3onMP4)
2. MPEG-2 AAC Text, MPEG-4 Audio Text, MPEG-4 Audio Conformance, Reference SoftwareChair: Ralph Sperschneider, Heiko PurnhagenMandates:2.1. Review contributions2.2. Review Proposed ISO/IEC 13818-7:2004 (3rd edition)
2.2.1. incorporate Text of ISO/IEC 13818-7: 2001/FDAM 12.3. Review Proposed ISO/IEC 14496-3:2003 (3rd edition)
2.3.1. don’t issue until it can be merged with AMD 1 (BWE)2.4. Review Proposed ISO/IEC 14496-3:XXXX/Cor. X2.5. Review and revise Status of MPEG-4 Audio Conformance2.6. Prepare Audio contribution to MPEG-4 Ref SW (BWE, Paramatric)2.7. Collect and review issues wrt reference software.
3. MPEG-4 Extension 1, BWE, BWE Embedding (FDAM 03/07)Chair: Kristofer KjörlingMandates:3.1. Review contributions3.2. Prepare DoC on ISO/IEC 13818-7:2001/FPDAM 1 3.3. Prepare Text of ISO/IEC 13818-7: 2001/FDAM 13.4. Prepare Report on Formal Verif Test3.5. Prepare Audio Contribution to MPEG-4 Conformance
3.5.1. Bandwidth Extension3.5.2. LTP / Scalable AAC / short blocks (define bitstreams)
4. MPEG-4 Extension 2, Parametric CodingChair Werner OomenMandates:4.1. Review contributions4.2. Revise Status of MPEG-4 Extension 2 Core Experiments4.3. Prepare DoC on ISO/IEC 14496-3:2003/PDAM 24.4. Prepare Text of ISO/IEC 14496-3:2003/FPDAM 24.5. Prepare CE Workplan
5. MPEG-4 Extension 3, Lossless CodingChair: Schuyler QuackenbushMandates:5.1. Review contributions and recommendations of AHG
5.1.1. Results of MDCT Evaluation5.2. Review contributions5.3. Revise MPEG-4 CE Methodology5.4. Prepare Workplan for Audio Lossless Coding 5.5. Prepare WD of ISO/IEC 14496-3:2001 /AMD 4, Audio Lossless Coding (ALS)5.6. Investigate industry use of IEEE floating point or other formats5.7. Prepare Call for Proposals for lossless compression of 1-bit oversampled audio representations
6. MPEG-7 Ext 1, Ext 1, Conformance and Reference Software Ext 1Chair: Jan RohdenMandates:6.1. Review contributions6.2. Produce DoC on ISO/IEC 15938-4/FPDAM 16.3. Produce text of ISO/IEC 15938-4/FDAM 16.4. Propose new CE for V36.5. Review Status and Workplan for MPEG-7 Audio Ref Sw and Conformance
6.5.1. Continue gathering conformance descriptions
7. MPEG-4 BIFSChair: Giorgio ZoiaMandates:7.1. Review contributions7.2. Identify and discuss open issues7.3. Revise WD 14496-11:/AMD 3
8. MPEG-21 DIA Chair: S-W KimMandates:8.1. Review contributions8.2. Identify audio-related open issues in MPEG-21 DIA
8.3. Produce Audio contribution to Text of MPEG-21 DIA FCD
Table of Audio-related Standards under DevelopmentStd Pt Edit. Projec
tDescription CfP WD CD FCD FDIS
2 7 1997 Amd.1 Embedding of bandwidth extension 03/03 03/074 3 2001 Amd.2 Extension 2 - Parametric Audio
extension01/12 02/12 03/07 03/12
4 3 2001 Amd.3 MP3onMP4 03/03 03/074 11 2002 Amd.3 Audio BIFS Extension 2 03/037 4 2001 Amd.1 Audio Descriptors Extensions 01/12 02/05 02/10 03/077 6 2001 Amd.1 Reference software extensions 01/12 02/05 03/03 03/07
146
Annex A-IV: Output DocumentsOutput DocumentsThe Audio Subgroup produced the following output documents. Those approved for public release are indicated by the entry “Yes” in column TBP (to be public).No. Title TB
PAvailable
13818-7 MPEG-2 Advanced Audio Coding 5708 Proposed ISO/IEC 13818-7:2004 (AAC 3rd edition) N 03/07/255709 DoC on ISO/IEC 13818-7:2001/FPDAM 1 N 03/07/25
5710 Text of ISO/IEC 13818-7: 2001/FDAM 1 (Embedding of Bandwidth Extension)
N 03/07/25
14496-3 MPEG-4 Audio5711 Proposed ISO/IEC 14496-3:2003 (Audio 3rd edition) N 03/07/255712 Proposed ISO/IEC 14496-3:200X/Cor X N 03/07/255713 Text of ISO/IEC 14496-3:2001/FPDAM 2 (Parametric Audio) Yes 03/07/255714 Study on ISO/IEC 14496-3:2001/FPDAM 2 (Parametric Audio) N 03/07/255715 Workplan for MPEG-4 Extension 2 Core Experiments N 03/07/255716 Request for new amendment to ISO/IEC 14496-3 N 03/07/255717 Text of ISO/IEC 14496-3:2001/PDAM 3 (MP3onMP4) N 03/08/29
5718 WD of ISO/IEC 14496-3:2001 /AMD 4 (Audio Lossless Coding - ALS)
N 03/07/25
5719 Workplan for Audio Lossless Coding (ALS) N 03/07/255720 Workplan for Scalable Lossless Coding (SLS) N 03/07/255721 Call for Proposals on Lossless Coding of 1-bit Audio Signals Yes 03/07/255722 Revised core experiment methodology for MPEG-4 audio N 03/07/255723 Importing MP3 into an MPEG-4 World N 03/07/25
14496-4 MPEG-4 Conformance
5724 WD of Audio Contribution to MPEG-4 Conformance (Bandwidth Extension)
N 03/07/25
5725 Status of MPEG-4 Audio Conformance N 03/07/2515938-4 MPEG-7 Audio
5726 DoC on ISO/IEC 15938-4/FPDAM 1 N 03/07/255727 Text of ISO/IEC 15938-4/FDAM 1 N 03/08/295728 Proposed MPEG-7 Audio Tools N 03/07/25
147
Annex A-V: Agenda for the 66th MPEG Audio MeetingAgenda Item1. Opening of the meeting2. Administrative matters
2.1. Approval of agenda2.2. Approval of Pattaya meeting report2.3. Communications from the Chair2.4. Allocation of contributions2.5. Joint meetings2.6. Review of AhG reports2.7. Review of task groups and mandates2.8. Received national body comments and liaison matters2.9. Plenary issues
3. Task group activities3.1. MPEG Layer III Items3.2. MPEG-4 Parametric Audio Coding3.3. MPEG-4 Lossless Audio Coding3.4. MPEG-4 BIFS3.5. MPEG-7 3.6. MPEG-21 DIA
4. Discussion of unallocated contributions5. Meeting deliverables
5.1. Press statement5.2. Dispositions of comments5.3. Responses to NB comments5.4. Liaison statements5.5. Recommendations for final plenary5.6. Establishment of new Ad-hoc groups5.7. Approval of output documents
6. Future activities6.1. Agenda for next meeting
7. A.O.B.8. Closing of the meeting
148
Annex 9Report of SNHC meeting
Opening of the Meeting
Approval of the agenda
Goals for the weekThe goals of this week are:
o Review on-going core experimentso Provide a better 'marketable' description of AFX specificationo Start ISO/IEC 14496-16/AMD1 for new toolso Continue discussion on profiles using AFX toolso Review 3DAV experiments and study common tools
149
Schedule
Time Monday Tuesday Wednesday Thursday Friday08
:00:30
09:00
:30
10:00
:30
11:00
:30
12:00
:30
13:00
:30
MPEG Plenary
MPEG Plenary
Lunch Break Lunch BreakLunch Break Lunch
Presentation reviewOutput docs review
9810 CE A.8 PointTexture results
9834 Vertex animationMorph objects
AFX software workplan reviewAFX conformance bitstreamsReview request for AFX AMD1
9827 – Light-weight graphics adaptation
9779 CE A.13 Shadow algorithms
9823, 9824 Lossless coding for 3DMC
Requirement Sys-SNHC9834 vertex animation / 9827 LGA / 9920 X3D profile
MeshGrid stream syntax
3DAV EE review
150
14:00
:30
15:00:30
16:00
:30
17:00
:30
Lunch Break
MPEG Plenary
Roll call, agenda
AFX FAQ
AFX reference softwareCSVT, papers/books
AFX FDIS editingConformance and profiles
3DAV / SNHC
Discussion on SNHC/AFX profiles
Discussion about 3DAV needs related to 3D tools
151
18:00
:30
19:00
:30
20:00:30
21:00:30
22:00…
Chairs Meeting
Social Event
Chairs Meeting
Demonstrations Liaison
152
Allocation of joint meetingsSub-Groups Monday Tuesday Wednesday Thursday Friday
Systems3DAV 14:00 – 16:00
in SNHC11:00 – 12:00with 3DAVin SNHC
Requirements 9:00 – 10:30with Systems
in RequirementsVideo 16:00 - 18:00
in Video room
Rooms allocationSNHC Lade 1Systems BrattoraVideo KristianstenRequirements Olav Tryggvasson
Allocation of contributions
N° Title Schedule ActivityD1 Monday D1
MPEG Plenary D1 09h00-14h00 MPEG Gen.
Report of AhGs on AFX MikaëlSNHC D1 15h00-18h00 SNHC Gen.
Agenda Mikaël 15h00SNHC FAQ Mikaël, All 15h30AFX reference software, conformance, profiles
Mikaël 16h00
AFX FDIS editing9690 Swiss NB comments on BBA9707 French NB comments on BBA9819 Korea NB comments on AFX
Mikaël, All 17h00
153
N° Title Schedule Activity9869 Belgium NB comments on
MeshGridSystems D1 18h00-19h00 MPEG Gen.
Demonstration of Light-weight graphics API Itraru KanekoD2 Tuesday D2
SNHC D2 09h00-13h00 SNHC
9823 Lossless coding support for 3DMC Euee Jang 9h009824 Lossless coding experiments results for
3DMCEuee Jang 9h30
9779 Core experiments on shadow algorithms Helge Drumm 10h009810 Compression of point textures in DIBR Mahnjin Han 11h009834 Simple vertex based animation technique Frederic Vexo 12h00
SNHC D2 14h00-17h00 SNHC
Discussion on SNHC/AFX profiles 14h00D3 Wednesday D3
MPEG Plenary D3 09h00-11h00 MPEG Gen.SNHC D3 11h00-13h00 SNHC
9827 Light-weight graphics adaptation Itaru Kaneko 11h003DAV – SNHC D2 16h00-18h00 SNHC
9635 AhG on 3D AV coding Aljoscha SmolicHideaki Kimata
9721 3D video fragments as a data representation and streaming method for EE2 in MPEG 3DAV
Stephan WuermlinEdouard LamborayHanspeter PfisterMarkus Gross
9761 Compression scheme for model-based 3D video
Takashi MatsuyamaYosuke KatsuraMartin BoehmeHitoshi Habe
9795 Report of EE1 on Omni-directional video Hitoshi HabeKazumasa Yamazawa
154
N° Title Schedule Activity
Toshio NomuraTakashi Matsuyama
9837 Multi-texture surfaces for view-dependent rendering in free viewpoint video and graphics
Aljoscha SmolicKarsten MuellerMichael DroeseBirgit KasparPhilipp MerklePeter EisertThomas Wiegand
9887 A synthetic test data set for rendering/reconstruction methods in EE2
Ming LiSabina BihlmaierLukas AhrenbergChristian TheobaltMarcus Magnor
D4 Thursday D4Requirements for new tools D4 09h00 – 10h30 Requirements
9827 Light-weight graphics adaptation Itaru Kaneko, Junya Tsutsumi, Mark Callow, Jiro Katto, Daisuke Inoue
9834 Simple vertex-based animation technique Mario Gutierrez, et.al.9920 Updates on the MPEG-4 X3D Interactive
profileMikaël
SNHC D4 11h00 – 17h00 SNHC Gen.
Review request for AFX AMD1 MikaëlReview conformance bitstreams Mahnjin, AllReview reference software implementation Mikaël, All
Other pending issues Mikaël, AllD5 Friday D5
SNHC D5 09h00-11h00 SNHC Gen.
Output documents review Mikaël 09h00MPEG Plenary D5 014h00-22h00 MPEG Gen.
155
General issues
Web siteThe SNHC Web site is http://www.sait.samsung.co.kr/snhc/src/index.html
AFX Reference softwareThe AFX Reference Software has been transferred to NIST and is available via CVS at
1. Register your login/password at http://mpeg.nist.gov/reg/login_new.php2. :pserver:<your login>@mpeg.nist.gov:/big/mpegcvs3. <your password>4. Checkout "MPEG-4/Systems/IM1" module (case sensitive).
The AFX-related code is in OpenGL/AFX and conformance samples are in Tests/AFX.
AFX reference software will be CD in October 2003 and FDIS in March 2004. Same schedule for AFX conformance document.
FAQThe FAQ has been updated with a better AFX description to promote AFX standard. Other parts of the FAQ related to AFX tools have also been updated.
ISO/IEC 14496-16 comments
M9690 – Swiss NB comment on BBABBA uses Euler angles while quaternions are better for rotation order.In order to test the impact of using quaternions vs. Euler angles, 1 bit is used to switch between Euler angles or quaternions. Quaternion compression leads to better compression ratio because of a smaller range of values vs. Euler angles and to better animation quality. Quaternions being widely used in the industry, it seems a better solution. However, quaternions are difficult to author and Euler angles are typically more preferred.
Resolution:A technical analysis needed on Euler angles vs. quaternions for different motion capture sequences. It is expected to have an input document for next meeting.
M9707 French NB editing comments on BBAResolution Accept XMT editing and English syntax correctionsAccept equation correction for sbmuscle.Delay approval of quaternion-related part until next meeting and review of the technical analysis.
M9869 Belgium NB editing comments on MeshGridResolution Accept modification of nLevels and nSlices fields from eventOut to exposedField for MeshGrid node.
Corrections will be added in an AFX corrigendum.
156
AFX activities
M9823/M9824 - Lossless coding support for 3DMC and results3DMC tool should be a generic tool for lossless and lossy compression. For objects with many connected components, coarse quantization will create misalignment of the components, so the need for lossless support.
Quantization from 1 to 32 bits (Qb) is already available in the standard but typically less than 13 bits is enough. The input format is floating point and the output format is 8.4f in the reference software so positions below 10-5 are quantized as 0. This will always happen because 3DMC uses mesh normalization, which is done by taking into account the longest axis. It is proposed to use Significant Digit Value (SDV) field for better lossless support.
Over 156 models, the results are: 3DMC can achieve near lossless already with sufficiently high number of Qb (22). This proposal enables to use less bits.
ResolutionMake an experiment until next meeting to define how to use SDV in 3DMC bitstream and to understand the implication of using SDV in existing 3DMC bitstreams.
M9779 - CE results on shadow algorithmShadow casting light source is defined by grouping objects together within Shadow node. Shadow node needs parameters from different nodes and a complex render management. The Shadow node defines shading parameters for its children geometry. In terms of implementation, the Shadow node attaches these properties to the geometry nodes so that the renderer can render shadows appropriately. The properties attached to a node are:
Cast: the object can cast shadow on each object of the Group Receive: idem with receiving shadow Self: object self emit shadow
Problems:1. When two Shadow nodes share geometries with different shadow properties, how are the properties propagated to nodes? The solution is that each Shadow node adds properties to each geometry using Boolean or operation.2. When Shadow nodes contain other Shadow nodes, shadow properties are added to each geometry.
Test conditions:For testing in this CE, the following conditions are: simple set of nodes, no routes, no shadow color or softness, simple light source. The CE was implemented in Player3D.
Results:Transmission of shadow property with one more light sources works well. However, the results show a complex framework and it is believed that a simpler framework should be possible. The current CE was tested with only one shadow algorithm and it is needed to evaluate with other techniques.
Proposal:Remove softness and shadowColor fields because this information is obtainable from the scene.
157
ResolutionEven if this is a much needed functionality to represent more realistic contents and very used in the industry, the current technology is not mature. This CE will continue to find a generally valid shadow creation method over various 3D objects.
M9810 - Compression of PointTextures in DIBRPointTexture is one of the formats for DIBR. For PointTexture nodes, the depth and color fields will be compressed as they hold very large amount of data. For compression, octree/voxel-based representation is used for depth information starting with the bounding box of the object is divided recursively. PPM (Prediction by Partial Matching) is used to compress nodes with information inside, this is lossless (no distortion). Each voxel are then labeled and similar voxels are merged using a bottom-up approach, leading to a simplified tree. The criteria for merging nodes is to minimize the rate-distortion (or increased minimum distortion) ratio.Therefore, the decoder can decode the object from the lowest resolution to the highest resolution.
Tests on 2563 and 5123 image data sets. Objects are compressed 5-20 to 1. Compared to WinZip, depth is 22-59% better compression. In exceptional cases where there is very little number of colors, LZW algorithm performs slightly better. Overall, the proposed algorithm requires only 49-75% of WinZip file size.
DiscussionPointTexture is used in current AFX standard but compression was not defined. The results are very satisfying.
ResolutionThe results are very satisfying. This compression will be added to AFX AMD1 WD.
M9834 - Simple vertex-based animationMotivation for vertex-based animationMPEG-4 doesn't have vertex-level and generic animation technique able to represent the deformation and animation effects available in state of the art authoring tools.
The idea is to take the final result of the animation from an authoring tool and decompose the animation into a set of keyframes and a function to animate between transitions. The transition function can be Linear (morphing), polynomial (the degree of the polynomial will increase the number of frames), NURBS (too complex?) trigonometric functions, other ways (programmatic?).
The proposed technique is a very low-level animation technique and is presented asr a generic approach to animate and deform any kind of object.
DiscussionAnimation is the deformation of an object over time. Animation methods typically control mesh deformers. Deformation is, on the other hand, a static operation and the Morph tool is proposed. Morph functionality was already available in AFX specification but due to lack of support it was not included in the current specification.
This proposal is for non-rigid deformations. However, more comparison with existing tools in MPEG-4 is necessary as it is believed that many of the proposed functionalities are already possible.
158
To allow all possibilities, a script could be sent in the stream that defines the transition function. This raises interesting questions such as the feasibility of such an approach, its complexity, synchronization with other animation streams and so on.
Discussion about morph objectsPlan B Media showed their production for various customers. The content is produced in Maya, rendered in custom proprietary renderers like Pulse3D. Because it is proprietary, they can't rely on a tool where API might change at any time or might be discontinued; a standard is needed.
Morph targets are different versions of the base mesh where the vertices are displaced in a certain position. Cluster of vertices can be deformed so to have different weights for all vertices of the mesh. The Morph tool renders objects using a linear combination of these Morph targets. This is different from interpolation between targets, which is already available in MPEG-4.
Note: morphing was originally in AFX VM but was abandoned for lack of support. It was also a simplified version of what is available today in any COTS authoring tools.
ResolutionCE to understand what is missing in MPEG-4 specifications.With Systems group, it was decided to create a new Ad-hoc group instead that would study: vertex-based animation, morph animation, and light-weight graphic adaptation.
New AFX requirements
M9827 - Light-weight graphics adaptationDiscussionThe Light-weight graphic adaptation (LGA) answers the two requirements approved in December: the possibility for MPEG-4 to carry a non-MPEG-4 stream and API to access media decoding buffers from Java.
The proposal shows an application built on top of MPEG-J and using a proprietary stream for its (Java) graphic engine. This proprietary stream is carried by the LGA_TGO_Transport stream. The proposed API extends MPEG-J to allow access to video decoding buffers that can be displayed in a layered manner.
While this API seems sufficient for many applications, we wonder if such access is not already possible with MPEG-J's Resource API. Likewise, is it sufficient for any type of graphic application? Is this solution portable or would it create interoperability issues? What are the performances when this API is used with a graphics API?
ResolutionThis proposal is an interface to video decoding buffers from Java not a graphics API. We must study the performances of this API with graphics API such as JSR-184.This study would be a result of the AhG with Vertex Anim and Morph.
M9824 – Lossless coding for 3DMCThe following requirement is approved (in blue are the additions):
159
RequirementMPEG-4 shall provide means for efficient compression and streaming or downloading 2D/3D vertex positions, normals, texture coordinates and topology. For 3D mesh, MPEG-4 shall provide means for lossless and near-lossless compression.
SpecificationTools shall be provided for incremental and error resilient download of models. Rendering of models shall be possible with incomplete models.
a) Error resilience: it is possible to cope with packet loss without having to retransmit the entire model.
b) Incremental download: useful rendering can be done already before the complete model has been downloaded
c) Lossless/near-lossless support: mathematically identical compression and near-lossless compression with higher quantization bits are provided.
Examples 3D elevation grid Face and body objects in the form of 3D polygon meshes. A 2D Delaunay mesh that can be represented by vertex positions. 3D Models can be very large with respect to the network capacity, and therefore it is useful if
they can be rendered even before completely downloaded. Convex hull of subdivision surfaces.
AFX profilesThe following companies in AFX have identified the following applications they are involved in:
SGDL (products)o High-quality representation of huge virtual environments and objects (archeological sites
and museum).
VUB (project supported)o Virtual character simulationo Streaming and visualization of large meshes (landscapes)o Virtual museumo Surface extraction/visualization from 3D medical or scientific datao Real-time surface generation and streaming from range-scanner/radar inputo Scientific simulations, morphingo Online gaming
Samsung (products)o Large public applications (e-commerce, instructional manuals, entertainment)o Educational (distance learning)o Commercials
INT (project supported)o Character animation…
160
France Telecom (project supported)o Virtual character simulationo Streaming and visualization of large meshes (landscapes)o Virtual museumo Virtual collaborative environments
The following profiles have been discussed and might be presented as inputs to October meeting. The following list is just for discussion purpose; it is not a SNHC resolution.
Core 3D profileIn the X3D interactive profile, it seems 5 nodes are not needed: Anchor, Inline, QuantizationParameter, Switch, SphereSensor, ProximitySensor, CylinderSensor, VisibilitySensor, PlaneSensor, Box, Cylinder, Cone, Sphere, ElevationGrid, PointSet, Background, Node/Route update, ColorInterpolator, NormalInterpolator
Targeted applicationsObject display (no manipulation, i.e. like a "Tamagushi" application): user can touch it, display a 3D object. Content is only downloaded and played.
Simple compressed 3DHierarchical profile on top of the Core 3DAdded: BitWrapper, 3DMC, InterpolatorCompression
Targeted applicationsSame as Core + compression. (Question: should it be merged with Core3D then?)
Main compressed 3DNew features: WSS, MeshGrid, BIFS updates, ProximitySensor, VisibilitySensor, Solids, DIBR
Targeted applicationCity/terrain navigation (with position of interest services using GPS), virtual museum
Animated character profileTargeted applicationGeneral skeleton-based animation, avatars…
3DAV and SNHC interaction
Report on the status of 3DAV. Section 3: results of CE
Free-viewpointRay-space: no model reconstruction but needs very dense sample of the fieldSurface light-field is used in graphics community for the radiance of an object. But ray-space is closer to image-based representations (IBR) as we have in AFX specification.
3D model reconstruction methodsDon't need too many cameras and the images are mapped onto an image. View-dependent representation and all the reconstruction must be done on the player side.
161
Image based visual hulls: all textures from different reference cameras are mapped on a surface, this is very similar to DIBR tool in AFX specification.
Polyhedral visual hullsView-independent representation with construction that can be done at the encoder.The mesh can topology-changed over each frame. There is no proposal of compression scheme for dynamically modifiable meshes.
3D video fragmentsA stream of points with color, normal etc. attributes is sent to the player. Such a stream provides the following feature: as topology changes are always a problem in graphics, using points resolve connectivity and other topological features.
Point samples are obtained from 3D acquisition; rendering is fast using surface splatting. An authoring tool/viewer is available for such data: www.pointshop3d.com.
The stream also contains the following commands: send update/delete/insert point or point attributes (color position).
Notes: for this technology, software and hardware rendering exist. MERL supports this technology and wants to produce 3D visio-conferencing systems.
Example of streams:25k point samples at 9fps with 200k updates/s leads to 3-5 MBits/s without compression.
ResolutionContinue EE2 to define compression stream.
Participants: ETH, ETRI, Hanyang, MERL. Goals: Document avantages/inconvenients of each approach, compare with existing
tools in MPEG-4, list companies interested in developing products for each technology.
Volumetric visual hullsThis technology uses voxels to represent objects.
Multi-texturingScene captured by different cameras mixed.
ResolutionMulti-texturing was originally in AFX VM. It is expected to have a detailed proposal for the next meeting.
Geometry videoMeshes are encoded using RGBA???Burden is decoding (complex to map the image to the mesh). No topological change allowed.
Ray-spaceCalibration parameters are very important and it is difficult to calibrate all these cameras.While ray-space theory shares some concepts with light-field mapping (LFM), we understood it is different: it is more a video-related technology than a graphics technology since the output of the
162
video decoder is simply map on the screen. It doesn't seem to use combination of multiple images for rendering as for LFM.
Synthetic test data set for EE2The goal is to provide test data for multi-view rendering/reconstruction algorithms in EE2.The test data set is done as follows:
A synthetic scene contains 25 cameras. Sequences are created for various combination of 4, 6, 8, 10, 13 cameras
For each sequence, the techniques listed above will be used to reconstruct the synthetic scene.
The data set will be available at request.
Resolutions of SNHC
Output documentsNo. Title TB
PAvailable
Editor
14496-16 MPEG-4 Animation Framework eXtension (AFX)
5758 AFX CE description No 03/07/25 Marius Preda5759 ISO/IEC 14496-16/AMD1 WD 1.0 No 03/08/01 Marius Preda5760 AFX VM 11.0 No 03/08/01 Marius Preda5761 AFX FAQ 11.0 Yes 03/08/01 Mikaël Bourges-
Sévenier5762 Study of ISO/IEC 14496-5/PDAM7 No 03/08/15 Patrick Gioia5763 Study of ISO/IEC 14496-4/PDAM7 No 03/08/08 Mahnjin Han5764 Study of DoC on ISO/IEC 14496-4/PDAM7 No 03/07/25 Mahnjin Han5765 Request for ISO/IEC 14496-16/AMD1 No 03/07/25 Mikaël Bourges-
Sévenier
Resolutions The SNHC subgroup acknowledges an emerging discussion on profiles using AFX
technologies. The SNHC subgroup acknowledges the interest of the industry for more animation tools
within AFX. The SNHC subgroup would like to recommend continuing investigation of APIs for 3D
related applications. The SNHC subgroup recommends starting a new amendment to AFX specification. The SNHC subgroup would like to recognize explorations of SNHC-related technologies in
3DAV and to assist in future investigations of these technologies. The SNHC subgroup acknowledges the need of standardization of usage of SNHC-related
technologies in MPEG-21 and is glad to assist in the standardization effort.
Establishment of SNHC Ad Hoc groupsNo. Title Meetin
gChair
5766 AhG on AFX document editing and Core Experiments
03/10/19
Marius Preda
163
5767 AhG on AFX SW implementation 03/10/19
Patrick Gioia
5768 AhG on AFX conformance 03/10/19
Mahnjin Han
5769 AhG on AFX profiles 03/10/19
Marius Preda
N5766 Ad Hoc Group on AFX documents editing and Core ExperimentsMandates: 1. Maintain and edit WD document
2. Maintain and edit VM document.3. Maintain and edit CE descriptions.
Chairman: Marius Preda (INT)Co-chairs: Mahnjin Han (Samsung AIT)
Mikaël Bourges-Sévenier (Mindego)Duration: Until 66th meeting Meetings Sunday before 66th meetingReflector: [email protected]: Send an email to [email protected] with the message
“subscribe” as the first line in the body.
N5767 Ad Hoc Group on AFX SW ImplementationMandate: 1. Coordinate the SW implementation process.
2. Study and develop the guidelines for SW development process. 3. Coordinate software integration of existing SNHC tools in IM1 Core.
Chairman: Patrick Gioia (France Telecom R&D)Co-chair: James D. K. Kim (Samsung AIT)Duration Until 66th meeting Meetings: Sunday before 66th meetingReflector: [email protected]: Send an email to [email protected] with the message
“subscribe” as the first line in the body.
N5768 Ad Hoc Group on AFX ConformanceMandate: 1. Maintain and edit the AFX conformance document
2. Coordinate collection of bitstreams3. Coordinate bitstream exchange
Chairman: Mahnjin Han (Samsung AIT)Co-chairs: Alain Mignot (SGDL Systems)
Mikael Bourges-Sevenier (Mindego)Duration Until 66th meeting Meetings: Sunday before 66th meetingReflector: [email protected]: Send an email to [email protected] with the message
“subscribe” as the first line in the body.
N5769 Ad Hoc Group on AFX ProfileMandate: 1. Identify potential applications of AFX tools
2. Identify the minimum toolset for simple 3D applications 3. Suggest candidate profiles
164
Chairman: Marius Preda (INT)Co-chairs: Mahnjin Han (Samsung AIT)Duration Until 66th meeting Meetings: Sunday before 66th meetingReflector: [email protected]: Send an email to [email protected] with the message
“subscribe” as the first line in the body.
Closing of the MeetingSee you in Brisbane, Australia in October.
165
Annex 10Report of Integration meeting
Source: Jean-Claude Dufourd
Opening of the Meeting
Allocation of contributionsMonday Plenary
m9632 T. Chiang AHG on Editorial Convergence and Maintenance of MPEG-4 Reference Software
m9638 Jens Spille AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4
m9639 Ralph Sperschneider Report of the AHG on MPEG-4 Audio Conformance
m9648 Chris Barlas AHG on RDD Reference Software and Editing
m9660 Ralph Sperschneider Report of the AHG on MPEG Conformance
m9661 Ian Burnett AHG on MPEG-21 Reference Software
m9662 C J Tsai AHG on MPEG Multimedia Test Bed
Joint Req-Sys-MDS-Integration, Reqs room, Tuesday 11:00-12:00
xxxx general reference software policy
Joint MDS-Integration, MDS room, Tuesday 17:00-18:00
xxxx REL software
m9729 Ying Sha , Yuzhuang Hu A Linux Implementation of MPEG-21 REL Reference Software
m9743 Eva Rodriguez, Jaime Delgado DMAG REL Tool Implementation
m9898Xin Wang , Venkatraman Venugopal , Robert Chancellor , Joseph Fung
A Linux Version of the Example Implementation of MPEG-21 REL Reference Software
m9748 Senator Jeong, Weon-Geun Oh, Ki-Song Yoon Reference Software for the Multilingual RDD Registry
Joint MDS-Reqs-Integration, Reqs room, 14:00-14:30
Joint MDS-Integration, MDS room, Wednesday 15:00-16:00
m9785 Mariam Kimieai Asadi Contribution on MPEG-21 DIA reference software implementation
m9804 Sylvain Devillers, Eric Delfosse Non-normative features for BSDL and update on reference software
m9826 Lee Nam Yeol, Kim Hae Kwang, Jae Ho MPEG-21 Graphics DIA reference software implementation
xxxx general MPEG-21 Reference Software review
Joint with Audio, Audio Room, Thursday 11:00 to 11:30
xxxx on Conformance and Reference Software
Integration Plenary, Thursday, Systems room, 14:00 to 16:00
m9669 SC29 Summary of Voting on ISO/IEC 14496-4:2003/FPDAM 3
m9672 SC29 Summary of Voting on ISO/IEC 14496-4:2003/PDAM 4
m9704 SC29 Summary of Voting on ISO/IEC 14496-4:2003/PDAM 5
m9705 SC29 Summary of Voting on ISO/IEC 14496-5:2001/PDAM 5
m9711 SC29 Summary of Voting on ISO/IEC 14496-5:2001/PDAM 4
m9797 SC29 Summary of Voting on ISO/IEC 15938-6/PDAM 1
xxxx documents, resolutions, AHGs issued at this meeting
m9766 Chung-Neng Wang FGS-Based Video Streaming Test Bed for Media Coding and Testing in Streaming Environments
166
m9769 Chun-Jen Tsai FGS Audio Integration for TR-21000 Multimedia Test Bed WD 2.0
m9787 Ralph Sperschneider WD1.1 of ISO/IEC ISO/IEC 13818-4:1998/Amd.4
m9791 Ralph Sperschneider Proposed 2nd Edition on ISO/IEC TR 13818-5:2003 (MPEG-2 Reference Software)
m9840 Jing Liu WD1.0 of ISO/IEC 13818-5:1997/AMD2:2003 MPEG-2 IPMP Reference Software
m9934 Taka Senoh WD1.1 of ISO/IEC 13818-4:1998/AMD4:2003 MPEG-2 IPMP Conformance Testing
m9924 JB Rault et al Finalizing the production and crosschecking of 3D audio conformance bitstreams
m9697 Panos Kudumakis et al UK NB Comments on ISO/IEC 14496-5/PDAM 4
xxxx IM1 workplan
List of standards under developmentStd
Pt
Edit.
Project
Description CfP
WD CD FCD FDIS
2 4 2004 Amd.1 IPMP Conformance Ext. 03/03
03/07
03/12 04/03
2 5 2004 Dam1 IPMP Ref.Soft. Ext. 03/07
03/12
4 4 2002 Amd.3 Visual New Level and Tools 02/07
02/12 03/07
4 4 2003 Amd.4 IPMP Extension Conformance 02/07
02/12
03/07 03/12
4 4 2003 Amd.5 Error Resilience Scalable Profile Conformance
03/03
03/07 03/12
4 4 2004 Amd.6 AVC 03/07
03/12 04/03
4 4 2003 Amd.7 AFX Conformance 02/07
02/12
03/10 04/03
4 5 2003 Amd.4 IPMP Extension Reference SW 02/10
02/12
03/07 03/12
4 5 2003 Amd.5 Error Resilience Scalable Profile Reference Software
03/03
03/07 03/12
4 5 2004 Amd.6 AVC 03/03
03/07
03/12 04/03
4 5 2003 Amd.7 AFX Reference SW 02/10
02/12
03/10 04/03
7 6 2001 Amd.1 Reference software extensions 01/12
02/05
03/03 03/10
7 7 2004 Amd.1 Conformance extensions 03/03
03/07
03/10 04/03
21 8 200x 1st Ed. Reference software 03/03
03/12
04/07 04/10
21 12 200x 1st Ed. Test Bed for MPEG-21 Resource Delivery
02/12
03/12
04/07
Latest references
Project P.
Standard Issue No.
MPEG-4 4 ISO/IEC 14496-4:2003 (MPEG-4 Conformance 2nd Ed.) 02/12 Awaji N5457MPEG-4 4 ISO/IEC 14496-4:2001/Amd.1 (FlexTime, Studio and
Streaming Video Profile)02/07 Klagenfurt
N5083
MPEG-4 5 ISO/IEC 14496-5:2001 (Ref. Soft 2nd Ed.) 01/07 Sydney N4368MPEG-4 5 ISO/IEC 14496-5:2001/Amd.1 (FlexTime) 02/03 Jeju N4711MPEG-4 5 ISO/IEC 14496-5:2001/Amd.2 (XMT) 02/05 Fairfax N4865
167
MPEG-7 6 ISO/IEC 15938-6:2002 (Reference Software) 01/12 Pattaya N4475MPEG-7 7 ISO/IEC 15938-7:2002 (Conformance) 02/07
KlagenfurtN4937
MPEG-2 Conformance
m9934 Taka Senoh WD1.1 of ISO/IEC 13818-4:1998/AMD4:2003 MPEG-2 IPMP Conformance Testing
Changes from the previous version were presented and discussed.
m9787 Ralph Sperschneider WD1.1 of ISO/IEC ISO/IEC 13818-4:1998/Amd.4
This document was presented in Audio, but its articulation with the IPMP extensions was discussed. This is going in a later amendment.
MPEG-2 Reference Software
This is the same document as last meeting, with a few fixes.
m9791 Ralph Sperschneider Proposed 2nd Edition on ISO/IEC TR 13818-5:2003 (MPEG-2 Reference Software)
Integration recommends the approval of this document.
MPEG-4 Conformance (14496-4) The following processing will be applied to the joint IPMP, MuW and AFX document: MuW is removed, IPMP is promoted, and AFX is delayed by one meeting.
m9669 SC29 Summary of Voting on ISO/IEC 14496-4:2003/FPDAM 3
m9672 SC29 Summary of Voting on ISO/IEC 14496-4:2003/PDAM 4
m9704 SC29 Summary of Voting on ISO/IEC 14496-4:2003/PDAM 5
All comments were accepted.
Joint with Audio :An amendment is produced as delta changes against the base document. Integration manages the WG11 document numbers for the amendment (i.e. numbers on the Friday of the MPEG week) and lists the amendment in the Integration section of the WG11 resolutions. Audio can produce an integrated Audio section of the conformance document at any time it may wish, and can manage those document numbers and approve those documents in the Audio section of the WG11 resolutions. At the time that the amendment progresses to AMD, Audio will pass to Integration an
m9840 Jing Liu WD1.0 of ISO/IEC 13818-5:1997/AMD2:2003 MPEG-2 IPMP Reference Software
168
integrated Audio section that represents the AMD changes. At this meeting the conformance associated with Bandwidth Extension is WD, so there is not yet a need for interaction with Integration and Audio will manage that document. Note that when this progresses to PDAM, Integration will manage the document.
m9924 JB Rault et al Finalizing the production and crosschecking of 3D audio conformance bitstreams
This was discussed in the Audio group.
MPEG-4 Reference Software (14496-5) The following processing will be applied to the joint IPMP, MuW and AFX document: MuW is removed, IPMP is promoted, and AFX is delayed by one meeting.
m9705 SC29 Summary of Voting on ISO/IEC 14496-5:2001/PDAM 5
m9711 SC29 Summary of Voting on ISO/IEC 14496-5:2001/PDAM 4
m9697 Panos Kudumakis et al UK NB Comments on ISO/IEC 14496-5/PDAM 4
All comments are accepted.
Joint with Audio:There is will be an amendment to MPEG-4 reference software started at this meeting (for AVC). Integration will expand that amendment to include Audio and Heiko Purnhagen will give Jean Claude Dufourd an update of the null Audio VM.
MPEG-21 Reference Software
m9766 Chung-Neng Wang FGS-Based Video Streaming Test Bed for Media Coding and Testing in Streaming Environments
m9769 Chun-Jen Tsai FGS Audio Integration for TR-21000 Multimedia Test Bed WD 2.0
Both contributions were presented: the streamer part was upgraded, problem with the video reference software which does not allow the use of MPEG-4 Systems timestamps (specially with hierarchical bitstreams), audio is in the test bed (but for synchronisation with video, to be added).We are still waiting for more information to improve the requirements document (from DIA in particular) and do architecture change. No WD this time.
Unpublished Integration Standards
14496-4 2003 2nd Ed Conformance testing ITTF To be published
14496-4 2003 Amd.1
Conformance Testing (Conformance testing for MPEG-4)
ITTF FDAM to be issued by ITTF
14496-4 2003 Amd. Conformance Testing (MPEG-4 Conformance
ITTF FDAM to be issued
169
2 extensions for XMT and media nodes)
by ITTF
14496-5 2001 Amd.2
Reference SW2nd ed. (XMT, DMIF)
02/05/10 ITTF to be published
14496-5 2001 Amd.3
Reference SW2nd ed. (Visual new level and tools)
03/03/14?
15938-6 Reference Software 01/12 ITTF Under FDIS ballot (Closing 2003-04-04-27)
15938-7 Conformance testing 02/10/25 Editor
Prepare FDIS text
Resolutions of Integration
Resolutions
1. The Integration subgroup kindly requests that MPEG-2 Video and Systems review the draft of second edition of MPEG-2 reference software (Nxxxx) until next meeting.
2. The Integration subgroup thanks the national bodies of France, UK and US for their comments on Integration documents under ballot.
Documents
No. Title TBP Available13818-4 MPEG-2 Conformance
5797 Second draft of ISO/IEC 13818-4 Second Edition N 25/07/035798 Text of ISO/IEC 13818-4:2004/PDAM1 (IPMP Conformance) N 08/08/03
5799 Request for ISO/IEC 13818-4:2004/AMD1 (IPMP Conformance Extensions)
N 25/07/03
5805 WD 2.0 of ISO/IEC 13818-4:2004/AMD2 (Audio Conformance) N 25/07/0313818-5 MPEG-2 Reference Software
5806 Draft of ISO/IEC TR 13818-5 Second Edition N 25/07/03
5807 Text of ISO/IEC 13818-5:2004/PDAM1 (IPMP Reference Software Extensions)
N 08/08/03
5808 Request for ISO/IEC 13818-5:2004/AMD1 (IPMP Reference Software Extensions)
N 25/07/03
No. Title TBP Available14496-4 MPEG-4 Conformance
5809 Text of ISO/IEC 14496-4:2002/FDAM3 (Visual New Level and Tools) N 25/07/03
5810 DoC on ISO/IEC 14496-4:2002/FPDAM3 N 25/07/03
5811 Text of ISO/IEC 14496-4:2002/FPDAM4 (IPMP Conformance Extensions) N 31/08/03
170
5812 DoC on ISO/IEC 14496-4:2002/PDAM4 N 25/07/03
5813 Text of ISO/IEC 14496-4:2002/FPDAM5 (Error Resilience Scalable Profile Conformance) N 25/07/03
5814 Text of ISO/IEC 14496-4:2002/PDAM6 (AVC Conformance) N 31/08/035815 Request for ISO/IEC 14496-4:2002/AMD6 (AVC Conformance) N 25/07/035816 Study of ISO/IEC 14496-4:2004/PDAM7 (AFX Conformance) N 31/08/03
5817 Study of DoC on ISO/IEC 14496-4:2004/PDAM7 (AFX Conformance) N 31/08/03
5895 Request for ISO/IEC 14496-4:2002/AMD4 (IPMP Conformance Extensions) N 25/07/03
5896 Request for ISO/IEC 14496-4:2002/AMD7 (AFX Conformance Extensions) N 25/07/03
14496-5 MPEG-4 Reference Software
5818 Text of ISO/IEC 14496-5:2002/FPDAM4 (IPMP Extension Ref Soft) N 31/08/03
5819 DoC on ISO/IEC 14496-5 :2002/PDAM4 N 25/07/03
5820 Text of ISO/IEC 14496-5:2003/FPDAM5 (Error Resilience Scalable Profile Reference Software) N 25/07/03
5821 Text of ISO/IEC 14496-5:2004/PDAM6 (AVC Ref Soft) N 31/08/035822 Request for ISO/IEC 14496-5:2004/AMD6 (AVC Ref Soft) N 25/07/03
5823 Study of ISO/IEC 14496-5:2004/PDAM7 (AFX Reference Software) N 31/08/03
5897 Request for ISO/IEC 14496-5:2002/AMD4 (IPMP Reference Software Extensions) N 25/07/03
5898 Request for ISO/IEC 14496-5:2002/AMD7 (AFX Reference Software Extensions) N 25/07/03
No. Title TBP Available
15938-7 MPEG-7 Conformance
5834 Text of ISO/IEC 15938-7:2004/PDAM1 (Conformance Extensions) N 25/07/03
AHG
AHG on MPEG-21 DIA Reference SoftwareMandate: 1. Follow the integration plan for the MDS DIA reference software
outlined in Nxxxx. 2. Produce at least one complete DIA parser and promote its use within the
parts of DIA reference software3. Collect results and feedback of the DID/DIA validations 4. Maintain the MDS DIA reference software implementation document,
including tracking of the proposed deliveries of software to http://www.titr.uow.edu.au/mpeg/mpeg21/ref-sw
Chairman:
Ian Burnett ([email protected]), Rik Van de Walle ([email protected])
Duration: Until 66th Meeting Meetings None
171
Reflector: [email protected]: Send email with “Subscribe mpeg-21-refsoft” to [email protected]
AHG on MPEG Multimedia Test BedMandate: Define requirements of this test bed
Create working drafts of test bed APIsDesign test environment for MPEG-21 DIA and MPEG IPMP TechnologiesWork with Scalable Video Coding AHG for testing of SVC technologiesDesign test environment for 14496-8
Chairman:
Chun-Jen Tsai (NCTU), Mihaela van der Shaar (Philips), Young-Kwon Lim (mp4cast)
Duration: Until 66th Meeting Meetings NoneReflector: [email protected]: Send an email to
[email protected] with subject ‘subscribe’
172
IM1 workplan
Module Tasks Responsibility DateATG Update of the ATG nodes in the
Osmo4 playerENST / Agfa next
meetingFont compression Microsoft DecemberSynthesized Texture Vimatix next
meetingIPMP Extensions
Fix bugs Panasonic / Access Ticket / Optibase / Moses
August 8
AFX Agreed workplan AFX next meeting
Elementary Stream Management
Integrate the implementation of SL-X France Telecom / Optibase
next meeting
173
Annex 11Report of Test meeting
Test Group Meeting Report for TrondheimReview Adhoc Group Reports and Documents m9637- AHG Report on AVC Verification Test
o Presented the Report.o Use of pre-processed content for SD and HD testo Proposal for a frame rate sub-sampling of CIF and QCIF sequences o Logistics for the test sites (NIST & FUB)o Up-dated volunteering list to produce coded material.o Anonymity issue solved (Cable Labs will gather all the proposal)o Selection of the decoder used (MPEG-2 and MPEG-4 the latest available; AVC the
latest available standard decoder)o Colour conversion and up sampling issues related to 4:2:2 to 4:2:0 for HD tests
(updated filters are required)o Discussion on the displays for HD (projector seems to be better than Plasma)o Recommendations of the AHG:
To update the test plan with the new information and decisions arrived at during the Adhoc discussions.
Revise the logistics of the tests and resources available.Work items during the week
- Output document for the AVC Verification Test Plan Version 2.0, public document Fixed coding conditions
o Colour conversion will be done by TUM by means of a new filter; new material will be available in two weeks.
Test sequences for all resolutions/scanning standards were selected o Test sequences are available at Hannover ftp server
New test method described in detail for the MM-Test. Demo will be provided at the 66th meeting and MPEG member will be asked to participate to a demo made of a real test session.
HD site set up better defined.
- CFE on SVC Revied CFE on SVC The CFE showed good results and a formal “call for proposal” will be issued to the next
meeting.
- Test Material A new set of HQ sequences has been made available by Dolby (not used in this test) A first distribution of this material have been made in Trondheim by mean of HDD (six
companies got a copy), Local redistribution will be allowed (after permission by Dolby) New set of HQ test material will be soon available. A private German company is going to prepare a new set of test sequences to be available for
any use at a reasonable fee (1000 USD).Adhoc Groups
AHG Report on coding efficiency analysis and testing of AVC codec
174
Output DocumentsVersion 2.0 AVC Video Verification Test PlanRecommendationsThanks to:
All the companies participating to the coding of sequences: Dolby for the provision of HQ material TUM for the continuous work on test material generation.
175
Annex 12Report of ISG meeting
Source: ISG ChairEditor: Marco Mattavelli (EPFL)
OverviewThe main work items of the Implementation Studies Subgroup in Trondheim are:
1. The advances in the development of the MPEG-4 “Part 9 Reference Hardware Description” and the promotion of the DTR to TR.
2. The advances in the work of phase 2 concerning the integration of the MPEG-4 optimized reference software in the mixed software hardware implementation.
3. The extension of the support to the development of MPEG-4 Part 7 to the AVC optimized software.
4. The reviews of the contributions providing examples and results of complexity analysis methodologies, tool for AVC and SVC analysis and results of tool supported software optimization.
Input contributions w.r.t. the above items are summarized according to the following table:
Contributions
M9654 “Report of the AHG on MPEG-4 Part 9 "Reference Hardware Description"
Marco Mattavelli, Robert Turney
M9888 “Memory Complexity Study and Optimization of Wavelet-Based Coders”
Vissarion Ferentinos, Maurizio Milia, Gauthier Lafruit, Jan Bormans Source: IMEC, Belgium
M9764 “Improvement of Optimized MPEG-4 14496-2 Simple Profile Codec with EPFL SIT Analyzer”
Allen (Chung-Neng) Wang and Tihao Chiang, Source: National Chiao Tung University (NCTU)
M9794 “MPEG4 AVC Reference Software Optimization”
Bo Feng, Shiqiang YangSource: Dept. of Computer Science and Technology Tsinghua University, Beijing,China
Detailed Report
Reference hardware description for MPEG-4
176
The MPEG-4 part 9 “Reference hardware description phase 1” has reached the status of TR at Trondheim meeting. The document has been approved by the group, will be available by the end of August after a short editing period.The activities for the development of Part 9 phase 2 has proceeded with consistent progress, the validation of the test platform (a laptop PC + PCMCIA Wild card II including the configurable HW module) has been completed. ISG recommends using such platform to validate, exercise and develop MPEG-4 part-9. Four working groups are already using the modules of Part 9 on such platform and are developing new modules The optimized reference software of Part-7 is currently integrated in the validation platform and examples of modules of part 9 working together with Part 7 are available for further developments.
A review of contributions concerning the definition of the virtual socket has been done during the meeting. Several aspects need to be checked and developed so as to respond to all the requirements defined for Part 9 functionality. An editing period for the WD of Amendment 1 of Part 9 has been agreed after the meeting. Part 9 editors will provide the WD text 6 weeks after the meeting.
The effectiveness of the methodologies and tools developed by ISG and provided as support to other activities has been shown in contribution M9764 “Improvement of Optimized MPEG-4 14496-2 Simple Profile Codec with EPFL SIT Analyzer” where a 25% increase in performance has been achieved on the optimization of Part 7. Further steps for the support of Part 7 activity have been planned. These includes two analysis stages of the newly developed optimized AVC codec M9794 “MPEG4 AVC Reference Software Optimization”, one on the current version and another one two weeks before next MPEG meeting in October.
The ad-hoc group on the development of MPEG-4 Part 9 has been re-established with the usual mandates, plus a specific mandate for the specification and development of the demonstration platform. The ad-hoc schedule includes 3 telephone conferences before next meeting.
Complexity analysis for AVC and SVC activities
One contribution M9888 reviewed presenting methodologies and results for appropriate complexity evaluations of video compression algorithms. It extends to a two-dimensional DWT the conjecture presented in previous contributions on one-dimensional cases that a bad specification of the interface of two well known and separately optimized functional blocks can lead to very inefficient implementations without any other advantage. Improvements in the methodology for the analysis of a complete system that includes such data dependencies has been proposed preparing the future activities on the definition of optimal, in terms of implementation complexity, SVC MPEG technology.
ResolutionsThe above activities have led to the following resolutions and output document approval.
MPEG-4 part 9 related resolutions:No. Title TBP Available
14496-9 MPEG-4 Reference Hardware Description
177
N6585 Text of ISO/IEC TR 14496-9 Information Technology –Coding of Audio Visual Objects - Part 9: Reference Hardware Description
N 03/08/05
N6586 DoC of ISO/IEC DTR 14496-9 Information technology coding of audio visual Objects - Part 9: Reference hardware description
N 03/07/25
N6587 Working Draft of Amendment 1 to TR 14496-9 Information Technology – Coding of Audio Visual Objects - Part 9: Reference Hardware Description
N 03/08/25
The Implementation Studies subgroup recommends to establish the following Ad Hoc group:No. Title MtgN6588 AHG on MPEG-4 Part 9: Reference Hardware
Description Phase 1 and 2Phone conferences on. 21st Aug., 18th Sept., 16th Oct.
The Implementation studies subgroup recommends to use the Wildcard II as the platform for the further development and validation of MPEG-4 Part 9 Reference Hardware description integrated with Part 7 Optimized reference Software.
178
Annex 13Report of Liaisons meeting
Source: Jan Bormans
The Liaisons Group considered the following input documents:
Input Contrib. no.
Title
M9663 Liaison Statement from TV-Anytime ForumM9664 Liaison Statement from DVBM9665 Liaison Statement from ITU-R SG 6/WP 6MM9666 Liaison Statement from ITU-T SG 9 on MPEG 3DAVM9667 Liaison Statement from ITU-T SG 9 on Timed Text in MPEG-4 and the Brand
Name Issue of the File FormatM9670 IEC CDV 62360: Baseline Specifications of Satellite and Terrestrial Receivers for
ISDB (Integrated Service for Digital Broadcast)M9671 Liaison Statement from TV-Anytime ForumM9675 Statement from the Open Mobile Alliance (OMA)M9677 Liaison Statement from ITU-R SG 6/WP 6QM9718 Liaison Statement from ITU-T SG 16 on Development of ITU-T Metadata
RecommendationsM9719 Liaison Statement from ITU-T SG 16 on ISO/IEC 13818-1:2000/Amd.1/Cor.1M9720 Liaison Statement from ITU-T SG 16 on ITU-T Q9/16 Embedded Audio Coding
WorkM9726 Liaison Statement from the Content Reference Forum (CRF)M9727 IEC CD 60728-9/Amd.1 [SC 29 N 5420]M9930 Liaison Statement from 3GPP TSG SA WG4M9931 Liaison Statement from 3GPP TSG SA WG4M9932 Liaison Statement from 3GPP TSG SA WG4M9935 Liaison Statement from EDItEURM9914 Auditory Impairment and Digital Item AdaptationM9941 OeBF Liaison Statement to MPEG
The Liaisons subgroup accepted the request made by the Content Reference Forum to establish a formal liaison between our two organisations. The CRF is a not-for-profit, global consortium, which is developing specifications that will be available as standards to facilitate the implementation of P2P digital content distribution systems. The goal of the CRF is to facilitate the distribution of legitimate content in peered environments with the least friction possible. The CRF would like to enable the dynamic delivery of the right content with the right commercial terms for a given consumer and value chain context. It is expected that initially the new collaboration will focus on MPEG-7 and MPEG-21.
In addition to replying, when appropriate, to the incoming Liaison statements, it was agreed to take the initiative to send outgoing Liaison statements to: IEEE LTSC, the 3D consortium, 3GPP TSG SA WG4 (on Meta-Data in ISO Media Files, Streaming Text, Advanced Text and Graphics Amendment), ITU-R SG 6/WP 6M, ITU-T SG 9 (on MPEG 3DAV), ISO TC 46 SC 9, and DVB (on AVC professional level).
179
Also, as it was noted that ISO/IEC 21000-7 could benefit from additional input, mainly with respect auditory impairment (see also M9914), it was decided to request input and feedback from: the ETSI HF Committee, the Radio Frequency Hearing Impaired Committee, ITU-T SG16, W3C WAI, OeBF and the DAISY Consortium.
The responses for the non-technical National Body comments as well as an updated list of organisations with which MPEG entertains liaisons were completed.
The following recommendations were issued:
the approval of the following documents:
Title No.Liaison Statement to the Content Reference Forum (CRF) N5735Liaison Statement to EDItEUR N5737Liaison Statement to OMA N5738Liaison Statement to ITU-T SG 16 on ITU-T Q9/16 N5739Liaison Statement to ITU-T SG 16 on metadata recommendations N5740Liaison Statement to DVB on AVC N5741Liaison Statement to 3GPP TSG SA WG4 on AVC N5742Liaison Statement to 3GPP TSG SA WG4 on MPEG-4 Visual Profiles N5743Liaison Statement to TV-Anytime Forum N5744Liaison Statement to SC36 WG4 N5745Liaison Statement to ITU-T SG9 N5746Liaison Statement to OeBF N5747Liaison Statement to IEEE LTSC N5748Liaison Statement to 3D consortium N5749Liaison Statement to 3GPP TSG SA WG4 on Meta-Data in ISO Media Files, Streaming Text, Advanced Text and Graphics Amendment
N5750
Liaison Statement to ITU-R SG 6/WP 6M N5751Liaison Statement to ITU-T SG 9 on MPEG 3DAV N5752Liaison Statement to the ETSI HF Committee on Auditory Impairment and Digital Item Adaptation
N5753
Liaison Statement to ISO TC 46 SC 9 N5754Liaison Statement to DVB on AVC professional level N5755List of Organisations with which MPEG entertains liaisons N5756Responses to National Body Comments N5757Liaison Statement to the Radio Frequency Hearing Impaired Committee on Auditory Impairment and Digital Item Adaptation
N5828
Liaison Statement to ITU-T SG16 on Auditory Impairment and Digital Item Adaptation
N5829
Liaison Statement to W3C WAI on Auditory Impairment and Digital Item Adaptation
N5830
Liaison Statement to OeBF on Auditory Impairment and Digital Item Adaptation
N5831
Liaison Statement to the Daisy Consortium on Auditory Impairment and Digital Item Adaptation
N5832
The Liaison group recommends approval of the following statement of benefits:
180
Statement of benefits from establishing a class C liaison with the Content Reference Forum (CRF)
N5736
The Liaison group recommends the approval of the new class C Liaison with the Content Reference Forum (CRF).
181