international organisation for … · web viewit would do something similar to the dcf in oma. a...

INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATION

ISO/IEC JTC 1/SC 29/WG 11CODING OF MOVING PICTURES AND AUDIO

ISO/IEC JTC 1/SC 29/WG 11 N6701Palma de Mallorca – October 2004

Source Leonardo Chiariglione, Convenor

Title Report of the 70th meetingStatus

Report of the 70th meeting1 Opening The 70th WG11 meeting was held at Palma de Mallorca on 2004/10/17-21 at the kind invitation of AENOR, the Spanish National Body.

2 Roll call of participants Annex 1 gives the attendance list.

3 Approval of agenda Annex 2 gives the agenda approved.

4 Allocation of contributionsAnnex 3 gives the list of input contributions

5 Communications from Convenor

6 Report of previous meetingThis was approved.

7 Processing of NB Position PapersNational Body papers were considered and answers provided where appropriate.

8 Work plan

8.1 Media coding

8.1.1 MPEG-4 AudioThe following document was approved

6795 Draft 3rd Edition of 14496-3

8.1.2 New levels in MPEG-4 Simple profileThe following documents were approved

1

6708 Disposition of Comments on ISO/IEC 14496-2:2004 PDAM2

6709 Text of ISO/IEC 14496-2:2004 FPDAM2 New Levels in Simple Profile

8.1.3 New levels in MPEG-4 Simple profile conformanceThe following documents were approved6741 DoC on ISO/IEC 14496-4:200x/PDAM10 New Levels for Simple Profile Conformance6742 ISO/IEC 14496-4:200x/FPDAM10 New Levels for Simple Profile Conformance

8.1.4 Implementation of IDCTThe following documents were approved6707 Request for Sub-division of ISO/IEC 11172-66735 Text of ISO/IEC 11172-6 CD: Specification for Implementation of Inverse Discrete Cosine

Transform

8.2 Composition coding

8.2.1 Lightweight Scene RepresentationThe following documents were approved6852 DoC on ISO/IEC 14496-20/CD6853 Text of ISO/IEC

14496-20/FCD

8.3 Description coding

8.3.1 MPEG-7 ProfilesThe following documents were approved6826 DoC of FCD of ISO/IEC 15938-9

6827 Text of FDIS of ISO/IEC 15938-9

8.4 Systems support

8.4.1 Carriage of ISAN and V-ISAN metadataThe following documents were approved6846 DoC on ISO/IEC

13818-1:2000/FPDAM46847 Text of ISO/IEC 13818-1:2000/FDAM4

8.5 IPMP

8.5.1 MPEG-21 IPMP ComponentsThe following document was approved

6772 ISO/IEC CD 21000-4 MPEG-21 IPMP Components

8.6 Digital Item

8.6.1 Digital Item BinarisationThe following documents were approved6860 DoC on ISO/IEC 21000-16/CD6861 Text of ISO/IEC

2

21000-16/FCD

8.6.2 Event ReportingThe following document was approved

6783 ISO/IEC CD 21000-15 MPEG-21 Event Reporting

8.7 Multimedia architecture

8.7.1 MPEG-J extension for renderingThe following document was approved6751 Text of ISO/IEC 14496-21

CD

8.7.2 Digital Item ProcessingThe following documents were approved

6781 DoC for the CD of ISO/IEC 21000-10 MPEG-21 Digital Item Processing

6780 ISO/IEC FCD 21000-10 MPEG-21 Digital Item Processing

8.7.3 MPEG Multimedia MiddlewareThe following documents were approved6835 MPEG Multimedia Middleware Requirements v2.0

6836 Call for Proposals for MPEG Multimedia Middleware

8.8 Reference implementation

8.8.1 MPEG-2 Reference softwareThe following documents were approved

6737 ISO/IEC 13818-5 MPEG-2 Reference Software 2nd

edition

9 Liaison matters

10 Organisation of this meeting

10.1 Tasks for subgroupsTasks were assigned to achieve the goals of the work plan.

10.2 Joint meetings The following joint meetings were held

Groups What Where Day TimeReq, Sys M3W, Laser, Font, MP4 FF Sys Mon 16:00-

18:15Req, MDS MP7 Profiles, JPSearch Req Tue 09:00-

10:30Req, MDS MP21 promotion Req Tue 10:45-

11:30Req, Vid, Aud, MDS, Sys

MPEG-A, Streaming DI, MCF

Req Tue 11:30-13:00

3

Req, Vid IDCT, SVC, Omnidir video Req Tue 14:00-15:30

Req, Tst MP21 PAT Amd Req Tue 15:30-16:30

Req, Aud Profiles, ScAC Aud Tue 16:30-17:30

Aud, Sys Time stamps Aud Tue 17:30-18:30

Req + Communicating MPEG Req Tue 17:30-18:00

Sys, MDS Applic. spec. binary encod Sys Wed 14:00-14:30

Req, MDS MP21 promotion Req Wed 15:30-16:30

MDS, Int MP21 Ref SW and Reqs MDS Wed 16:00-17:00

Req, MDS MP21 MDS Wed 11:30-12:30

Req, Sys, Vid, Aud, MDS

MPEG-A Req Thu 09:00-10:15

Req, Sys Laser Sys Thu 10:15-10:30

Req, Sys M3W Req Thu 10:30-11:00

Req, MDS IPMP Scope Req Thu 12:00-13:00

Req, Vid 3DAV, SVC Vid Thu 14:00-15:00

Req, MDS MPEG-21 MAF MDS Thu 16:00-16:30

10.3 Administrative matters

10.3.1 Schedule of future MPEG meetings The following meeting schedule was approved

Meeting City Country

Yr.

Mo. Days

70th Palma de Mallorca

ES 04 10 18-22

71st Hong Kong CN 05 01 17-21

72nd Busan KR 05 04 18-22

73rd Poznań PL 05 07 25-29

74th ? FR 05 10 17-21

75th ? ? 06 01 23-27

4

10.3.2 Promotional activities An ad hoc group with this mandate was re-established.

11 Planning of future activities The following ad hoc groups were established6790 14496-3:2001/AMD 2:2004/DCOR 1 (SSC)

6749 AFX CE description

6750 AFX VM 16.0

6730 AHG on 3DAV Coding

6752 AHG on AFX documents, CEs, and software

6817 AHG on Audio Standards Maintenance

6734 AHG on Communicating MPEG to the business Community

6728 AHG on Core Experiments in Scalable Video Coding

6727 AHG on Description Tools for MPEG-7 New Visual Extensions

6842 AHG on Digital Item Serialization

6822 AHG On Exploration of Scalable Audio and Speech Coding

6840 AHG on Font Format Representation

6732 AHG on further Exploration in Wavelet Video Coding

6837 AHG on JPEG Liaison

6838 AHG on MAF Development

6725 AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

6726 AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software

6865 AHG on MPEG File Formats

6788 AHG on MPEG URI Fragment IDs

6787 AHG on MPEG-21 DIA

6785 AHG on MPEG-21 DIP& DID 2nd Edition

6786 AHG on MPEG-21 Event Reporting

6841 AHG on MPEG-21 Vision Update

6820 AHG on MPEG-4 Lossless Audio Coding

6755 AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2.

6818 AHG on MPEG-7 Audio

6753 AHG on MPEG-J extensions for rendering

6733 AHG on Organization of a Workshop on Future Directions in Video Compression

6839 AHG on Persistent Association

6729 AHG on Scalable Video Model and SVM Software

6864 AHG on Scene Representation

5

6819 AHG on Spatial Audio Coding

6821 AHG on Symbolic Music Representation

6731 AHG on Video Coding Tools Repository

6724 AHG on Video IDCT Specification

6863 AHG on XML Structure Binarization and Streaming

12 Resolutions of this meetingThese were approved (N6799)

13 A.O.B There was no other business

14 Closing The meeting closed at 2004/10/22T20:15.

6

Annex 1Attendance list

Given Name Family Name Company / Organization CountryMyriam Amielh CISRA AustraliaAxel Becker CISRA AustraliaDavid Scott Taubman The Univerity Of Nsw AustraliaGerrard Drury Titr University Of Wollongong/Enikos AustraliaShane Lauf University Of Wollongong AustraliaIan Burnett Uow/Enikos AustraliaKlaus Leopold University Klagenfurt AustriaChristian Timmerer University Klagenfurt AustriaAdrian Munteanu Etro Department, Vrije Universiteit Brussel BelgiumAlexandru Salomie Etro Department, Vrije Universiteit Brussel BelgiumFrederik De Keukelaere Ghent University BelgiumRobbie De Sutter Ghent University BelgiumSaar De Zutter Ghent University BelgiumRik Van De Walle Ghent University BelgiumJan Bormans Kapeldreef 75 BelgiumBoris Rogge Metanous BelgiumMaximiliam Barais Vrije Universiteit Brussel-Ibbt BelgiumPeteer Scholkens Vrije Universiteit Brussel-Ibbt BelgiumAlex Luccisano Scientific Atlanta Canada CanadaWen Gao Institute Of Computing Technology ChinaWen-Hsiao Peng National Chiao-Tung University ChinaYi-Shing Tung National Taiwan University ChinaChun-Jen Tsai NCTU/ITRI ChinaJani Lainema Nokia FinlandVaananen Mauri Nokia FinlandFx Nuttall CISAC FranceCyril Concolato ENST FranceJean-Claude Dufourd Enst/Streamezzo FranceClaude Seyrat Expway FranceAbdellatif Benjelloun Touimi France Telecom FranceAlexandre Cotarmanach France Telecom FranceFrederic Loras France Telecom FranceAvaro Olivier France Telecom FranceRoyan Jerome France-Telecom FranceIsabelle Amonou France-Télécom FrancePatrick Gioia France-Télécom FranceStephane Pateux France-Télécom FrancePierrick Philippe France-Télécom FranceJean-Bernard Rault France-Télécom FranceDavid Virette France-Télécom FranceBeatrice Pesquet-Popescu GET-ENST FranceMichel Barlaud I 3s.Laboratory FranceChristine Guillemot INRIA FranceMarius Preda INT FranceFrancoise Preteux INT FranceJerome Barthelemy IRCAM FranceGregoire Carpentier IRCAM FranceVincent Bottreau Irisa-Inria FranceStephane Valente Philips Digital Systems Labs FranceMarc Guez Vuche SCPP FranceJerome Vieron Thomson FranceOlawaletitus Abe Church Choir GambiaMartin Dietz Coding Technologies Gmbh GermanyAndreas Schneider Coding Technologies Gmbh GermanyBernhard Feiten Deutsche Telekom, T-Systems GermanyPeter List Deutsche Telekom, T-Systems GermanyChristoph Fehn FhG/HHI GermanyHeiko Schwarz Fraunhofer HHI GermanyAljoscha Smolic Fraunhofer HHI GermanyThomas Wiegand Fraunhofer HHI GermanyRalf Geiger Fraunhofer IDMT GermanyMatthias Gruhne Fraunhofer IDMT GermanyOliver Baum Fraunhofer IIS GermanyHarald Fuchs Fraunhofer IIS GermanyBernhard Grill Fraunhofer IIS GermanyJuergen Herre Fraunhofer IIS GermanyStefan Kraegeloh Fraunhofer IIS GermanyRalph Sperschneider Fraunhofer IIS GermanyHerbert Thoma Fraunhofer IIS GermanyDetlef Marpe Fraunhofer Institute HHI GermanyThomas Wedi Panasonic GermanyUlrich Benzler Robert Bosch Gmbh, Fv/Slh GermanyJens-Rainer Ohm Rwth Aachen University GermanyMathias Wien Rwth Aachen University GermanyGero Base Siemens GermanyAndreas Hutter Siemens GermanyPeter Amon Siemens AG GermanyGabriel Panis Siemens Ag GermanyTilman Liebchen Technical University Of Berlin GermanyTobias Oelbaum Technische Universitat Munchen GermanyHelge Drumm Tecnnische Universitaet GermanyCarsten Herpel Thomson GermanyJens Spille Thomson GermanyAndreas Graffunder T-Systems GermanyIngo Wolf T-Systems GermanyKlaus Diepold TUM-LDV GermanyJoern Ostermann Universität Hannover GermanyTillman Weyde University Of Osnabrük GermanyVasileios Mezaris Informatics And Telematics GreeceEdward Cooke Centre For Digital Video Processing IrelandValentin Muresan Centre For Digital Video Processing IrelandZvi Lifshitz Optibase Ltd. IsraelAharon Gill Zoran Microelectronics IsraelFilippo Chiariglione CEDEO ItalyMaurizio Campanai Exitech Srl ItalyVittorio Baroncini FUB ItalyMarco Tagliasacchi Politecnico Di Milano ItalyGiovanni Cordara Telecom Italia Lab ItalyRiccardo Leonardi University Of Brescia ItalyPierfrancesco Bellini University Of Florence ItalyPaolo Nesi University Of Florence ItalyAndrea Valotti University Of Florence ItalyMasatsugu Kitamura For More Convenient Av Life JapanKimihiko Kazui Fujitsu Laboratoires Ltd. JapanTomokazu Murakami Hitachi JapanYukiko Ogura Ipsj/Itscj JapanYoshinori Sugihara Japan Electronics & Information JapanTakafumi Ueno Matsushita Electric JapanTakeshi Norimatsu Matsushita Electric JapanKohtaro Asai Mitsubishi Electric Corporation JapanTokumichi Murakami Mitsubishi Electric Corporation JapanHirofumi Nishikawa Mitsubishi Electric Corporation JapanYoshihisa Yamada Mitsubishi Electric Corporation JapanCraig Schultz Multimedia Architectures JapanToshiaki Fujii Nagoya University JapanMasayuki Tanimoto Nagoya University Graduate School Of JapanHiromi Kinoshita Nara Institute Of Science And Technology JapanKazumasa Yamazawa Nara Institute Of Science And Technology JapanToshiyuki Nomura NEC JapanAkio Yamada NEC JapanTakahiro Kimoto NEC JapanMasanori Sano NHK JapanNoboru Harada NTT JapanMasaki Kitahara NTT JapanTakehiro Moriya NTT JapanSeishi Takamura NTT JapanThiow Keng Tan NTT Docomo, Inc. JapanYukihiro Bando NTT/ Cyber Space Lab. 1-1 Hikarino -Oka JapanHideaki Kimata NTT-At JapanTakashi Nishi Oki Electric Industry Co, Ltd JapanTakanori Senoh Panasonic JapanNaoya Tanaka Panasonic JapanTeruhiko Suzuki Sony Corp. JapanTakuyo Kogure The University Of Tokio JapanItaru Kaneko Tokyo Polytechnic University JapanTakeshi Chujoh Toshiba Corporation JapanSatoshi Ito Toshiba Corporation JapanSatoru Sakazume Victor Company Of Japan. Ltd JapanHideki Takehara Victor Company Of Japan. Ltd JapanHiroshi Watanabe Waseda University JapanJaejoon Kim Daegu University KoreaSangthoon Oh DCF KoreaJeho Nam ETRI KoreaChung-Hyun Ahn ETRI KoreaYongiu Cho ETRI KoreaSeyoon Jeong ETRI KoreaYe Sun Joung ETRI KoreaKyeheon Kim ETRI KoreaDaehee Kim ETRI KoreaJae Gong Kim ETRI KoreaWeon Geun Oh ETRI KoreaTae-Joon Park ETRI KoreaSoo-Jon Park ETRI KoreaJeongil Seo ETRI KoreaYoungioo Song ETRI KoreaWon Young Yoo ETRI KoreaEuee S Jang Hanyang University KoreaSun Young Lee Hanyang University KoreaHendry Hendry Information And Communications KoreaMunchurl Kim Information And Communications KoreaSeungli Yang Information And Communications KoreaIk-Hwan Cho Inha University KoreaDong-Seok Jeong Inha University KoreaJong Tae Kim KAIST KoreaYong-Soo Choi Kangwon National University KoreaKi Seob Kim Kangwon National University KoreaHyong Joong Kim Kangwon National University KoreaManbae Kim Kangwon National University KoreaHyukmin Kwon Kangwon National University KoreaKeun Soo Park KBS KoreaByeong Ho Choi KETI KoreaJung Ho Choi KT KoreaSeoung Jun Oh Kwangwoon University KoreaGwang-Hoon Park Kyung Hee Unniversity KoreaKwango Ko Kyunghee University KoreaKyungmo Park Kyunghee University KoreaDougyoung Suh Kyunghee University KoreaWon Ha Kim Kyunghee University KoreaByeong Moon Jeon LG Electronics Inc. KoreaHee-Suk Pang LG Electronics Inc. KoreaSueng-Wook Park LG Electronics Inc. KoreaSueng Hyun Kim Lg Electronics Inc. KoreaJi-Ho Park LG Electronics Inc. KoreaDoe Hyun Yoon LG Electronics Inc. KoreaCheon Seog Kim Movain Interjungbo Co.Lct KoreaYoung-Kwon Lim Net&Tv Inc. KoreaJong Jin Chae Netntv Inc. 1582-6 Hanseo Bldg. 8f. KoreaSangwook Kim Samsumg KoreaSang-Kyun Kim Samsung A.I.T. KoreaJeong Hwan Ahn Samsung Ait KoreaMahnjin Han Samsung Ait KoreaJoohee Kim Samsung Ait KoreaHye-Yun Kim Samsung Ait KoreaHi-Young Kim Samsung Ait KoreaEunmi Oh Samsung Ait KoreaHyun Mun Kim Samsung Ait KoreaWoo-Jin Han Samsung Electronics KoreaBae Keun Lee Samsung Electronics KoreaKim Jong Ryul Sejong University KoreaHae Kwang Kim Sejong University KoreaMinh Tuan Le Sejong University KoreaYung-Lyul Lee Sejong University KoreaHan-Gil Moon Seoul National University KoreaKyunghee Ji SIT KoreaNammee Moon SIT KoreaWoong Il Choi Sungkyunkwan University KoreaSeok Hoon Kim The Korea Digital Contents Forum KoreaWerner Oomen Philips NetherlandsJan Van Der Meer Philips NetherlandsLeon Van De Kerkhof Philips NetherlandsDirk Jeroen Breebaart Philips Research NetherlandsWilhelmus Ha Bruls Philips Research NetherlandsJean H.A. Gelissen Philips Research NetherlandsAndrew Alexander Tokmakoff Telematica Instituut NetherlandsNeil Mckencie Fbn Netherlans NetherlansGisle Bjontegaard Tandberg NorwayMarek Domanski Poznan University Of Technology PolandFernando Pereira Instituto Superior Tecnico PortugalAntonio Navarro Telecomunications Institute PortugalZhengguo Li Institue For Infocomm Research SingaporeSusanto Rahardja Institute For Infocomm Research SingaporeRongshan Yu Institute For Infocomm Research SingaporeXiao Lin Institute For Infocomm Research SingaporeSi Wei Ma Institute Of Computing Technology Singapore Chak Joo Lee Panasonic SingaporeShengmei Shen Panasonic SingaporeKok Seng Chong Panasonic Singapore Laboratoiries SingaporeVincent Diong Panasonic Singapore Laboratoiries SingaporeZhongyang Huang Panasonic Singapore Laboratoiries SingaporeMen Huang Lee Panasonic Singapore Laboratoiries SingaporeJiunn Bin Lim Panasonic Singapore Laboratoiries SingaporeSua Hong Neo Panasonic Singapore Laboratoiries SingaporeChong Soon Lim Panasonic Singapore Laboratoiries SingaporeThomas Kummer-Hardt Aio SpainMarc Gauvin Sdae SpainDavid Aparicio Telefonica SpainPaulo Villegas Telefonica I+D SpainFrancisco Moran Univ. Politecnica De Madrid SpainJose M Martinez Universidad Autonoma De Madrid SpainJaime Delgado Universitat Pompeu Fabra SpainEva Rodriguez Universitat Pompeu Fabra ( Upf) SpainKristopher Kjörling Coding Technologies Ab SwedenHeiko Purnhagen Coding Technologies Ab SwedenPer Fröjdh Ericsson SwedenTouradj Ebrahimi EPFL SwitzerlandChristof Faller EPFL SwitzerlandMarco Mattavelli EPFL SwitzerlandGiorgio Zoia EPFL SwitzerlandThomas Di Giacomo Miralab,University Of Geneva SwitzerlandJean-Claude Michelou Visiowave SwitzerlandDiego Santa Cruz Visiowave SwitzerlandFrancesco Ziliani Visiowave SwitzerlandFrederic Vexo Vrlab-Epfl SwitzerlandMike Nilsson BT UKMartin Russ BT UKKia Ng Icsrim-University Of Leeds UKPaul Jessop Ifpi UKMiroslaw Bober Mitsubishi Electric Ite-Vil UKLeszek Cieplinski Mitsubishi Electric Ite-Vil UKRobert James O'callaghan Mitsubishi Electric Ite-Vil-Lab UKRay Steven Taylor NDS UKCatherine Grant Nine Tiles UKGary James Calder Oxford Semiconductor Ltd UKCharith Abhayaratne Queen Mary University Of London UKChris Barlas Rightscom UKNiels Rump Rightscom UKPing Wu Tandberg Television Limited UKSimon Watt Universal Music International UKScott Foshee Adobe USAVladimir Levantovsky Agfa Monotype Corp. USABarry Haskell Apple Computer USATibet Mimar Atheros Communications USASchuyler Quackenbush Audio Research Labs. USAKatherine Cornog Avid Technology USASheng Zhong Broadcom USAFeng Che Wang Conesant Systems Inc USAThomas Demartini ContentGuard, Inc. USABradford Robert Gandee ContentGuard, Inc. USAXin Wang ContentGuard, Inc. USAFrank Bossen DoCoMo USA Labs. USAWalter C Gish Dolby Laboratories USAAlan Jeffrey Seefeldt Dolby Laboratories USAMark Stuart Vinton Dolby Laboratories USAThomas L Mcmahon Dolby Laboratories USAMajid Rabbani Eastman Kodak USAPankaj Topiwala Fast Vdo LLC USAMarco M Hurtado IBM USAPeter Schirling Ibm Research USAMunsi Alaul Haque Intel Corporation USARob Koenen Intertrust USATe Ming Chiu ITRI, Inc USAAndrew G. Tescher Microsoft USAJames D Johnston Microsoft USAFlorian Pestoni Microsoft Corp. USAGary J Sullivan Microsoft Corp. USAMichael Y. Ksar Microsoft/Us Nb USAMikael Bourges-Sevenier Mindego Inc. USAAnthony Vetro Mitsubishi Electric USAHuifang Sun Mitsubishi Electric Research L USASam Narasimhan Motorola USAAjay Luthra Motorola Inc. USAChris Russell MPAA USAMarina Bosi MPEG LA,LLC USAWo Chang NIST USACharles Fenimore NIST USAJustin Ridge Nokia USAMarta Karczewicz Nokia Inc. USAGerald Anthony Powell NTT DoCoMo, Inc. USAHsin-Hao Chen OES/ITRI USAViji Raveendran Qualcomm Inc. USAYuriy Reznik Realnetworks USABruce Block Recording Industry Assc. Of America USAJohn William, Woods Rensselaer Polytechnic Institute USAShawmin Lei Sharp Labs Of America USAShijun Sun Sharp Labs Of America USAMohammed Visharam Sony Electronics USAViswanathan Swaminathan Sun Microsystems Inc USAFelix Fernandes Texas Instruments USAJill M Boyce Thomson USAGregory William Cook Thomson USAHaoping Yu Thomson USAPeng Yin Thomson Inc USAMihaela Van Der Schaar UC Davis USATruong Q Nguyen Ucdsd USAJonathan Boley University Of Miami USANermin Osmanovic University Of Miami USARobert D Turney Xilinx USA

7

Annex 2Agenda

Agenda item1. Opening2. Roll call of participants3. Approval of agenda 4. Allocation of contributions 5. Communications from Convenor 6. Report of previous meeting 7. Processing of NB Position Papers 8. Work plan 1. 8.1 Media coding 1.1. AVC Fidelity Range Extensions Conformance 1.2. Scalable Video Coding 1.3. Audio Lossless Coding 1.4. Audio Scalable Lossless Coding 1.5. 1-bit Audio Lossless Coding 1.6. Spatial Audio Coding 1.7. AFX Extensions 1.8. Streaming Text Format 1.9. Video Coding Tool Repository 1.10

. 3D AV Coding

1.11 Scalable Audio and Speech Coding 1.12 Font Format Representation 8.2 Composition coding 2.1. XMT extensions 2.2. Lightweight Scene Representation 2.3. Symbolic Music Representation 8.3 Description coding 3.1. Video Descriptor Extensions 3.2. Audio Descriptor Extensions 3.3. MPEG-7 Profiles 8.4 Systems support 4.1. Carriage of ISAN and V-ISAN metadata 4.2. Timestamps and Audio Codec Behavior 8.5 IPMP 5.1. MPEG-21 IPMP Framework 8.6 Digital Item 6.1. Digital Item Declaration 6.2. Digital Item Binarisation 6.3. DIA Conversions and Permission 6.4. Event Reporting 6.5. MPEG-21 Conformance 8.7 Transport and File Format 7.1. MPEG-21 File Format 8.8 Multimedia architecture 8.1. MPEG-J extension for scene control

8

8.2. MPEG-J extension for rendering 8.2. Digital Item Processing 8.3. MPEG Multimedia Middleware 8.9 Reference implementation 9.1. AVC Fidelity Range Extensions Reference Software 9.2. MPEG-4 Visual Reference Hardware Description 9.3. MPEG-4 AVC Reference Hardware Description 9.4. MPEG-21 Reference Software 8.1

0 Application formats

10.1.

Music player Application Format

10.2.

Photo album Application Format

8.11

Maintenance

11.1 Systems coding standards 11.2 Video coding standards 11.1 Audio coding standards 11.2 Visual description coding standards 11.3 Audio description coding standards MDS standards 9. Liaison matters 10.

Organisation of this meeting

10.1

Tasks for subgroups

10.2

Joint meetings

11.

Administrative matters

11.1

Schedule of future MPEG meetings

11.2

Promotional activities

12.

Planning of future activities

13.

Resolutions of this meeting

14.

A.O.B

15.

Closing

9

Annex 3Input document list

Number Authors Title

11149 Wo Chang Document Register for SC29/WG11 Meeting Palma, ES

11150 Mike KsarVladimir Levantovsky

AHG on Font Format Representation

11151 Chris BarlasChris Russell

AHG on MPEG-21 Integration and Outreach

11152 Wo ChangOlivier Avaro

AHG on MAF

11153 Robert TurneyMarco Mattavelli

AHG on MPEG-4 Part 9 Reference Hardware Description Phase 1 and 2

11154 Claude SeyratAndreas HutterItaru Kaneko

AHG on XML Structure Binarization and Streaming

11155 Jean-Claude DufourdAlexandre Cotarmanac.hYoung-Kwon Lim

AHG on Scene Representation

11156 T. ChiangYi-Shin TungChung-Neng Wang

AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

11157 L. CieplinskiA. YamadaSang-Kyun KimStephan Herrmann

AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software

11158 Miroslaw BoberSang-Kyun Kim

AHG on Description Tools for New Visual Extensions

11159 Mihaela van der SchaarJustin Ridge

AHG on Core Experiments in Scalable Video Coding

11160 Heiko SchwarzJizheng XuMathias WienDavid Taubman

AHG on Scalable Video Model and SVC Software

11161 Aljoscha SmolicHideaki Kimata

AHG on 3DAV Coding

11162 Euee S. Jang Kohtaro Asai none

AHG on Video Coding Tools Repository

11163 Jean GelissenOlivier Avaro Martin Russ

AHG on MPEG Multimedia Middleware

11164 Myriam AmielhGerrard DruryYongJu Cho

AHG on MPEG 21 Media Locators

11165 Simon Watt AHG on MPEG-21 IPMP

11166 Christian TimmererThomas DeMartini

AHG on MPEG-21 DIA

10

http://mpeg.nist.gov/reg/_update.php?docnum=11166

mailto:[email protected]










http://mpeg.nist.gov/mpeg/docs/70_Palma/contrib/m11161.zip






























http://mpeg.nist.gov/reg/_list70.php?k=6,kv=1



11167 Gerrard DruryFrederik De Keukaleare Munchurl Kim

AHG on MPEG-21 DIP

11168 FX NuttallAndrew Tokmakoff

AHG on MPEG-21 Event Reporting

11169 Marius PredaMahnjin Han Patrick Gioia

AHG on AFX documents, CEs, and software

11170 Mikael Bourges-SevenierVishy Swaminathan Itaru Kaneko

AHG on MPEG-J extensions for rendering

11171 Ralph Sperschneider AHG on Audio Standard Maintenance

11172 Matthias Gruhne AHG on MPEG-7 Audio

11173 S. Quackenbush AHG on Spatial Audio Coding

11174 Tilman Liebchen AHG on MPEG-4 Lossless Audio Coding

11175 Paolo NesiGiorgio Zoia

AHG on Symbolic Music Representation

11176 Jim Johnston AHG on Exploration of Scalable Audio and Speech Coding

11177 Jean-Claude Dufourd Initial Reference Software for LASeR and SAF

11178 Zhongyang HuangMing JiShengmei ShenTaka SenohTakafumi Ueno

IPMP_Scheme Description for MPEG-21 IPMP

11179 Shane Lauf Examination of technology in IPMP WD 1.0

11180 TVA via SC 29 Secretariat

Liaison Statement from the TV-Anytime Forum [SC 29 N 6237]

11181 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 15938-9 [SC 29 N 6240]

11182 Niels Rump for the AhG Editor's input on possible 2nd Edition on PAT

11183 Mike Ksar Proposed Text - Open Font Format Specifications (OFFS) - Single Document - based on OpenType(R) v1.4

11184 on behalf of the MPEG-21 IPMP AdHoc group.

Notes from the Mountain View MPEG-21 IPMP AdHoc Meeting

11185 ITTF via SC 29 Secretariat

Table of Replies on ISO/IEC 14496-11/FPAM 4 [SC 29 N 6249]


Table of Replies on ISO/IEC FDIS 21000-7 [SC 29 N 6251]

11187 Zhengguo LIXiaokang YangKengpang LimXiao LinSusanto RahardjaFeng Pan

Customer Oriented Scalable Video Coding

11188 Akio Yamada Contribution to MPEG-7 Visual Conformance

11189 Shane LaufIan Burnett

Mobile MPEG-21 Peer Implementation

11








































































11190 Joerg HeuerAndreas Hutter

MPEG-7 BiM for Unidirectional Networks


Table of Replies on ISO/IEC 14496-4:200X/FDAM 7 [SC 29 N 6263]

11192 Jean H.A. Gelissen MPEG Multimedia Middleware Requirements v.2.0

11193 Niels Rump for the editors Editors' Input towards CD of 21000-15

11194 Thomas Di GiacomoNadia Magnenat-ThalmannMarius PredaFrancoise Preteux

CE Report for Physically-Based Animation of Cloth with PhysicsShapeProperties node

11195 Jong-Tae KimWeon-Geun OhWon-young YooHae-Kwang KimHeung-Kyu LeeYoung-Ho Suh

Objective Impairment Test Method for Video PAT Evaluation

11196 Thomas Di Giacomo Nadia Magnenat-Thalmann Marius Preda Francoise Preteux

Proposal of a PhysicsBoneProperties node

11197 Helge DrummThomas Di Giacomo

CE - Shadow: Final Results on Reference Software Implementation

11198 Jean-Claude Dufourd CE Study of LASeR and SAF CD

11199 Schuyler Quackenbush DRAFT Report on Spatial Audio Coding RM0 Selection Tests (v2)

11200 Schuyler Quackenbush 69th MPEG Audio Subgroup Report

11201 Ik-Hwan ChoWeon-Geun OhHae-Kwang KimDong-Seok Jeong

Guideline for the Selection of Standardized Test Stimuli in the Evaluation of Video Watermarking

11202 Jon Boley Spatial Audio Coding Listening Test Report- University of Miami

11203 Son TranMarius PredaFrancoise Preteux

Implementation issues in MPEG-4 Reference Software

11204 Son Tran Marius PredaFrancoise Preteux

MPEG-J for real case applications: design of a minimal and universal primitive class

11205 Marius PredaFrancoise Preteux

Enriching stream control in BBA

11206 Marius PredaOctavian Folea Françoise Preteux

XMT encoding issues for BBA

11207 Marius PredaSon Tran Francoise Preteux


11208 IEC TC 100 via SC 29 Secretariat

IEC CDV 62261-1 [SC 29 N 6286]

12










































































IEC CDV 62261-2 [SC 29 N 6287]

11210 Jerome RoyanPatrick Gioia

Results on the CE for multiresolution footprint-based representation

11211 Thomas DeMartiniVincent TieuXin Wang

Data Types and Methods for Implementing MPEG-21 REL Interpretation Reference Software

11212 Shane LaufGerrard DruryIan Burnett

Proposed extensible DIDL schema


Proposed IPMP DIDL schema

11214 Truong NguyenMin Li

New spatial transform in SVC

11215 Mark Vinton Testing Environment and Procedures for Spatial Coding Performed at Dolby Laboratories

11216 Akio Yamada Proposed Corrigendum item on ISO/IEC 15938-3:2002/Amd.1

11217 Eunmi OhMiyoung Kim

Fine Grain Scalability in MPEG-4 BSAC multi-channel audio coding

11218 Hyuk-Min KwonMan-Bae KimJeho NamRin-Chul KimHae-Kwang KimSeungji YangTruong Cong ThangYong Man Ro

Progress of MPEG-21 DIA Utility Software Modules C, D, F, G, L, M, N & AA.

11219 Wo Chang Draft for MPEG-7 Part 9 FDIS

11220 FX Nuttall MPEG 21 as a secure interoperable DRM ?

11221 Eva RodriguezHuang Zhongyang

IPMP Information Schema

11222 Jerome RoyanPatrick Gioia

New proposal for multi-resolution footprint-based representation

11223 Joohee KimHyeyeon KimDoohyun Kim

Responses to CE4 in SVC

11224 Gary Sullivan IDCT Specification: A Problem and Opportunity

11225 A. G. Tescher for USNB USNB Contribution: Replacement of IDCT Standard

11226 A. G. Tescher for USNB USNB Contribution: Issues for audio lossless coding

11227 A. G. Tescher for USNB USNB Contribution: Fine-grain scalable audio codec

11228 A. G. Tescher for USNB USNB Contribution: Preliminary comments on 14496-3:2001/PDAM 4&5

11229 A. G. Tescher for USNB USNB Contribution: JPSearch and MPEG-7

11230 Shun-ichi SekiguchiYoshihisa YamadaKohtaro Asai

Proposed corrections to visual part of MPEG-4 conformance text

11231 Hideaki Kimata Anchor bitstreams for preliminary Call for Evidence on multi-view video

13




























mailto:























mailto:




































Masaki Kitahara coding

11232 Hideaki KimataMasaki Kitahara

Framework on free-viewpoint video with shared memory video coding

11233 Ray Taylor Core experiment report for Fast Random Access into MPEG7 BiM streams

11234 Seishi TakamuraBandoh YukihiroYoshiyuki Yashima

Proposal of SNR Scalability Method with up to Lossless Enhancement

11235 Yukihiro BandohSeishi TakamuraYoshiyuki Yashima

Proposal of inter-band bit re-allocation for SVC

11236 Fabio VerdicchioAdrian MunteanuAugustin GavrilescuJan CornelisPeter Schelkens

Resilience in Scalable Video Coding using Embedded Multiple Description Scalar Quantization

11237 Hongkai XiongChen WangLi SongFeng Wu

CE Verification Report of HHI on CE2.3: Adaptive Block Transforms

11238 Eddie Cooke Multiple Image View Synthesis for Virtual Viewpoint Rendering

11239 José M. MartínezVíctor ValdésLuis HerranzJesús Bescós

A Simple Profile for MPEG-21 DIA Usage Environment description tools

11240 Aljoscha SmolicKarsten MuellerPhilipp MerkleMatthias KautznerThomas Wiegand

Predictive Compression of Dynamic 3D Meshes

11241 Peng YinJill BoycePurvin PanditAlexis Michael Tourapis

Complexity Scalable Video Codec

11242 Marco Boltz SVC CE7 - Non-linear adaptation results from Bosch and verification of HHI results

11243 Marco Boltz SVC CE1 - Bosch verification of HHI results for medium grain and combined scalability

11244 Heiko SchwarzTobias HinzHeiner KirchhofferDetlev MarpeThomas Wiegand

Technical description of the HHI proposal for SVC CE1

11245 Heiko SchwarzTobias HinzDetlev MarpeThomas Wiegand


11246 Heiko SchwarzJikun ShenDetlev MarpeThomas Wiegand


14


































































11247 Heiko SchwarzHeiner KirchhofferDetlev MarpeThomas Wiegand


11248 Heiko SchwarzKarsten SühringDetlev MarpeThomas Wiegand


11249 Chris Barlas Niels Rump

MPEG-21 - Comatose or Just Sleeping?

11250 David CrombieRoger lenoirNeil McKenzie

Accessible Information Processing in MPEG

11251 Johnston CFI proposed to AGH on Scalable coding

11252 Thomas DeMartiniMarco HurtadoMartha NalebuffPete SchirlingAnthony VetroXin Wang

Preliminary Comments on ISO/IEC 21000-2 2nd Edition FCD (Digital Item Declaration)


Preliminary Comments on ISO/IEC 21000-7 PDAM1 (Digital Item Adaptation)


Preliminary Comments on ISO/IEC FCD 21000-8 (Reference Software)

11255 Thomas DeMartiniMarco HurtadoMartha NalebuffPete SchirlingDavid SingerAnthony VetroMohammed Zubair VishramXin Wang

Preliminary comments on Text of ISO/IEC 21000-9 FCD (MPEG-21 File Format)


Preliminary Comments on ISO/IEC 21000-16 CD (Binary Format)

11257 Heiner KirchhofferHeiko Schwarz

Verification of the Samsung AIT proposal for SVC CE4

11258 Julien ReichelFrancesco ZilianiDiego Santa Cruz

SVC CE7: Verification of HHI results

15
























mailto:James























11259 Masayuki TanimotoToshiaki Fujii

FTV (Free Viewpoint Television): Achievements and Challenge

11260 Yongju ChoYoungkwon LimMoonsup SongHyoung-Joong KimJaegon KimJin-Woo Hong

Proposed URI scheme for mp4 file format


IPMP DIDL Reference Software Contribution

11262 Christian TimmererKlaus LeopoldDietmar JannachHermann HellwagnerMariam Kimiaei

Report of CE on Conversion Parameters

11263 Inseon JangJeongil SeoKyeongok Kang

Spatial Audio Coding RM0 Selection Test Report - ETRI

11264 Jeongil SeoHan-gil MoonSeungkwon BeackInseon JangKyeongok KangJinwoo Hong

A New Cue Parameter for Spatial Audio Coding

11265 Kyung Mo ParkKwang Oh Koh

LASER adaptive to time varying resources

11266 Yung-Lyul LeeWoo-chul Sung

Multi-view video coding using 2D direct mode

11267 Paul Jessop Comments on 'Software Copyright Licencing (sic) Disclaimer for MPEG Standards'

11268 Peter Schirling Joan L. Mitchell Arianne T. HindsNenad Rijavec

A new way to look at IDCT

11269 Masayuki MorimotoHayato

Report on the Evaluation Tests for Spatial Audio Coding Systems

11270 Teemu SaarinenArtur Lugmayr

Software implementation of a light-weight REL based DRM system for video streaming to mobile devices

11271 J. J. ChaeJeho NamJae-Gon Kim

IPMPTransfer Description for MPEG-21 IPMP

11272 Itaru KanekoMark Callow

Comment on MPEG-J extension for rendering

11273 Hiroshi YasudaTakuyo Kogure

Activity Report of DCCSDP&DCCSDC in Japan

11274 Itaru Kaneko Nobuyuki Kinoshita Spencer Cheng

Application Specific Binary Coding (ASBC) of MPEG-21 descriptors

11275 Woo-Jin Han SVC CE1 - Samsung verification of Univ. of Brescia (System I and II)

16
















































































11276 SuSan ImSangHoon OhSeokHoon KimSpencer Cheng

The reference conformance test model(based on Mpeg-21 dii&didl)

11277 Woo-Jin HanBae-Keun Lee

Technical description of Samsung proposal for SVC CE1

11278 Yoon Sung-Yeol Kim Daehee Kim Sukhee Cho Kugjin Yun Chunghyun Ahn Sooin Lee

Multi-view Video Coding using Layered Depth Image

11279 Yoon Sung-Yeol Kim Daehee Kim Sukhee Cho Kugjin Yun Chunghyun Ahn Sooin Lee

Coding of Layered Depth Image using Coherency between Point Samples

11280 Soo-Jun ParkMyung Gil Jang

CE Report for Situation/View-based Photo Clustering Experiment (VCE-1, Cross Check)


GT set proposed for situation/view based photo clustering experiment (VCE-1, Cross Check)


Photo EXIF modification report on Ground Truth set of Situation/View based photo clustering CE (VCE-1, Cross Check)


GT set proposed for category based photo classification experiment (VCE-2, Cross Check)


Dataset of VCE-1 and VCE-2

11285 Won Ha KimSeyoon Jung

Verfication of SAMSUNG SVC software for CE1

11286 Soo-Jun ParkMin-Sung RyuChee Sun Won

Proposal for a new CE: Query-by-ROI (region of interest)

11287 Jihun ChaYeSun JoungWon-sik CheongKyuheon KimYoung-kwon Lim

A Proposal to Improve Compression Efficiency of LASeR Binary Representation

11288 Ian Burnett Suggestion to create MPEG-A Part 4 – MPEG-21 Content Format (MCF)

11289 Ian Burnett Requirements for Streaming Digital Items

11290 Myriam Amielhon behalf of the AhG for MPEG-21 Medialocators

Classification of MPEG MIME types

11291 Myriam AmielhErnest Wan

A Framework for MPEG URI fragment Identifiers

11292 Sukhee ChoDaehee KimKugjin YunChunghyun AhnSoo In LeeYongtae KimKawnghoon Sohn

Multi-view video coding using image stitching

11293 Soo-Jun Park CE Report for Image Categorisation into Classes (VCE-2, Cross Check)

17




































































mailto:Seung-Uk

mailto:Seung-Uk

mailto:Seung-Uk



mailto:Seung-Uk

mailto:Seung-Uk

mailto:Seung-Uk












Myung Gil Jang

11294 Diego Santa-Cruz Verification of results for SVC on CE3: Low Delay

11295 Yoshihisa YamadaKazuo SugimotoKohtaro AsaiTokumichi Murakami

Coding performance of Intra-only coding in AVC High Profile

11296 Kyunghee JiYoungjoo SongNammee MoonJaegon Kim

Proposed Changes to MPEG-21 Event Reporting WD v.2.0

11297 Sang-Kyun KimSeungji YangYong Man RoJi-Yeun Kim

CE Report for Situation/View-based Photo Clustering Experiment (VCE-1)


GT set proposed for situation/view based photo clustering experiment (VCE-1)


Photo EXIF modification report on Ground Truth set of Situation/View based photo clustering CE (VCE-1)


A proposal of GT set determination where "Time" and "Visual" information conflict for Situation/View based photo clustering (VCE-1)


CE Report for Category-based Photo Clustering Experiment (VCE-2)


GT set proposed for category based photo classification experiment (VCE-2)


CE Report for Face-based Photo Clustering Experiment (VCE-3)


Photo contribution status for face-based photo clustering experiment (VCE-3)

11305 Sang-Kyun KimSang Hyun Kim

Software cross-check result of Dominant Color Temperature experiment (VCE-4)

11306 Joohee KimHyeyeon Kim

Motion-compensated temporal filtering under delay constraints

11307 Paolo NesiGiorgio ZoiaPierfrancesco BelliniJames Ingram

Proposed SMR Evaluation Model and Procedure

18






mailto:

















































Kia NgMaurizio CampanaiJerome BarthelemyGregoire Carpentier

11308 Akio YamadaSang-Kyun Kim

MPEG-7 Visual XM Document version 21.1

11309 Akio YamadaSang-Kyun Kim

WD 2.1 of MPEG-7 New Visual Extensions

11310 Kristofer Kjörling Additions to the profiles under consideration document.

11311 LEE Men HuangSHEN Sheng MeiYoshimasa HONDA

MCTF-based Scalable Video Coding in Low Delay Mode

11312 Kristofer KjörlingWerner OomenTakeshi NorimatsuToshiyuki NomuraJean-Bernard Rault

Company support for the proposed High Efficiency AAC v2 Profile

11313 Gregoire CarpentierJerome Barthelemy

Proposal for a Core Experiment on WeightedScalesDS

11314 Noboru HaradaTakehiro Moriya

Proposal of CE for improved floating-point compression using ACFC (Approximate-Common-Factor Coding) in ALS (Audio Lossless Coding)

11315 Senator JeongYeon-Jeong JeongWeon-Geun OhKi-Song Yoon

Proposed Common Event Descriptor and DataType

11316 Kyuheon Kim KNB comments on MPEG-4 BSAC multi-channel

11317 Sang-Wook Kim Report on verification of test bitstream submissions to Spatial Audio Coding RM0 test

11318 Maria TrocanGregoire PauBeatrice Pesquet-Popescu

Cross-Verification of RWTH Results on SVC CE-4

11319 Kohtaro AsaiYoshihisa Yamada

Intra coding tools for AVC High Profile

11320 Ruiqin Xiong Xiangyang Ji Jizheng Xu Feng Wu

MSRA scheme for SVC CE1

11321 Xiong Jizheng Xu Cross-Verification of DANAE+Thomson results on SVC CE1

11322 Euee S. JangSunyoung LeeJongWoo WonSungwon ParkYongHo ChoYoungRyul Lee

Hanyang/Humax Contribution to VCTR

11323 Naoya TanakaTakeshi Norimatsu

Report on the Listening Tests for the Spatial Audio RM0 Selection

11324 Karol WnukowiczWladyslaw Skarbek

Report on Dominant Color Temperature Descriptor CE (VCE-4)

19










mailto:none:

mailto:none:

mailto:none:

mailto:none:

mailto:none:

mailto:[email protected]:



mailto:Ruiqin




















































11325 Robbie De SutterChristian Timmerer Hermann HellwagnerRik Van de Walle

Using MPEG-21 Part 16 in Applications

11326 Karol WnukowiczWladyslaw Skarbek

Extension of Dominant Color Temperature Descriptor by Spatial Coherency field

11327 Yi-Shin TungChung-Neng WangTihao ChiangJens-Rainer Ohm

MPEG-4 Visual: List of Problems Reported, v.13.1

11328 Vincent BottreauChristine GuillemotRashid AnsariEdouard François

SVC CE5 - Spatial Transform using Three Lifting Steps filters

11329 Francesco Ziliani Coordinator's report on SVC's CE3: Low Delay

11330 Philippe LUCAS (Orange)A. COTARMANAC'H (France Télécom)

Mobile requirements for lightweight scene representation

11331 Jens-Rainer Ohm Draft Guidelines for the SVC CE Process and Elevation Procedure

11332 Cédric ThiénotGrégoire PauClaude Seyrat

Results of the Core Experiment on Laser Binarization

11333 Vittorio Baroncini Thiow Keng Tan Tobias Oelbaum

Suggested Test Method for SVC CE Visual Tests

11334 Xiangyang JiJizheng XuRuiqin XiongDebin ZhaoFeng Wu

An Architecture of Incorporating MPEG-4 AVC into 3D Subband Video Coding

11335 Claude Seyrat study of ISO/IEC 21000-16 CD

11336 Frederik De KeukelaereRik Van de Walle

Contribution to DID conformance

11337 Claude Seyrat Requirements for Laser Binarization

11338 Frederik De KeukelaereThomas DeMartiniJeroen BekaertRik Van de Walle

An object oriented approach for the DIBO APIs

11339 Saar De ZutterFrederik De KeukelaereRik Van de Walle

Proposal for DIP bootstrapping

11340 A. HoelzerC. SpengerD. WeningerJ. Herre

Report on Spatial Audio Coding Subjective Tests at FhG Test Site

11341 Alexandre Cotarmanac'hPierrick Philippe

MPEG General Audio Codecs

11342 Stephan Herrmann Improving the efficiency of a search and retrieval system using MPEG-7

20












































































Vasileios MezarisHaralambos DoulaverakisIoannis KompatsiarisMichael G. Strintzis

Visual descriptors

11343 Gregoire PauBeatrice Pesquet-Popescu

Response to the SVC CE-3 on coding efficiency with low-delay constraints

11344 Vasileios MezarisSymeon PapadopoulosIoannis KompatsiarisMichael G. Strintzis

On the potential use of machine learning for image categorization (VCE-2)

11345 Gregoire PauClaude Seyrat

MPEG-21 binarisation status with MPEG-7 BiM reference software

11346 Tilman Liebchen Proposed Text of Study on ISO/IEC 14496-3:2001/PDAM4 (Audio Lossless Coding)

11347 Tilman LiebchenPatrick Runge

Report on MPEG-4 ALS Core Experiment 8 (Multi-channel extension for ALS)

11348 HendryJeongyeon LimQonita M. ShahabKyung-Ae ChaMunchurl KimKeunsoo Park

An improved IPMP tool schema for Resource Protection

11349 Hendry Munchurl Kim Keunsoo Park

An improvement to the MPEG-21 IPMP Info Schema

11350 Kazumasa YamazawaHideaki KimataHitoshi Habe

Proposal for MPEG-A of omni-directional video

11351 Watt UKNB Comments on ISO/IEC FCD 21000-2 : Digital Item Declaration

11352 Mathias Wien SVC CE4: RWTH Verification of HHI contribution

11353 Holger Crysandt Verification Report of Core Experiment on Audio Rhythm Patterns

11354 Giorgio ZoiaPierfrancesco BelliniPaolo NesiJerome Barthelemy

MPEG-4 and SMR: report on available functionality for graphics

11355 BNB Preliminary BNB comments on ISO/IEC 21000-2 2nd edition FCD

11356 Jean-Claude Dufourd Report of work on the CE for LASeR Harmonization with SVG

11357 Jean-Claude Dufourd Report of work on the CE on LASeR Binary Representation

11358 Andrew KinaneValentin MuresanNoel O'Connor

Updated Status on Hardware Acceleration Module for SA-DCT

11359 Leszek Cieplinski Cross-verification of RPI results on SVC CE-4

11360 Jean-Charles GicquelStéphane PateuxIsabelle AmonouSylvain Kervadec

Subjective evaluation of CE1 results

11361 Jean-Claude Dufourd LASeR/SAF reference software: codec aligned with study

21






































mailto:S















































11362 Oliver Baum Proposed WD 0.1 of AudioBIFS v.3 Conformance

11363 V. Bottreau E. Francois S. Pateux G. PauB. Timmerman M. Wien

Technical description of the DANAE+Thomson proposal for SVC CE1

11364 V.Bottreau E. Francois S. Pateux G. PauB. Timmerman

SVC CE1: DANAE+Thomson verification of MSRA contribution

11365 Benoit TimmermanPeter AmonAndreas Hutter

Response to SVC CE5 - Optimization of tradeoff between motion information and texture

11366 Valentin MuresanNoel O'Connor

Updated Status on Hardware Acceleration Module for Motion Estimation

11367 Benoit TimmermanPeter Amon

SVC CE5 - Verification of IRISA results

11368 Nicola AdamiMichele BrescianiniRiccardo LeonardiAlberto Signoroni

SVC CE1: STool - a native spatially scalable approach to SVC

11369 Vincent Bottreau SVC CE5 - Verification of Siemens results

11370 Pierrick PhilippeJean Bernard Rault

France Telecom's contribution to the CFI on Scalable Audio and Speech Coding

11371 Christian TimmererJoerg HeuerGabriel PanisHermann HellwagnerAndreas Hutter

Comments on ISO/IEC 21000-7 COR/1 WD v.1

11372 Edouard FrancoisVincent BottreauJean Charles GicquelMathias WienJerome Vieron

Discussion on evaluation criteria for experts viewing tests in SVC CE1

11373 Juergen Herre On Evaluation Criteria for Spatial Audio Coding

11374 Cyril Concolato Implementation of LASeR (and of SVG) in the open-source GPAC project

11375 Cyril Concolato Analysis of the study of CD of LASeR

11376 Andreas HutterJoerg HeuerBernhard Reiterer

Results of the Core Experiment on Laser Binarization

11377 Rongshan Yu Proposed WD changes for Lazy Coding for MPEG-4 Audio Scalable Lossless (SLS) Coding

11378 Nicola AdamiMichele BrescianiniRiccardo LeonardiAlberto Signoroni

Fully embedded entropy coding with arbitrary multiple adaptation capabilities

11379 Rongshan Yu Proposed changes for ISO/IEC 14496-3/PDAM5 (Scalable Lossless Coding)

22














































































11380 Kristofer KjörlingHeiko PurnhagenAndreas SchneiderWerner Oomen

Working draft proposal for PS conformance

11381 Heiko PurnhagenKristofer KjörlingWerner Oomen

Spatial Audio Coding Listening Test Site Report - CT/Philips

11382 Dong-Yan HuangHaibin HuangRongshan YuXiao LinSusanto Rahardja

Proposal for Lossless Audio Coding

11383 Ralf Geiger Proposal for Reduced Complexity of SLS

11384 J. HerreA. HoelzerC. Spenger

Additional Information on Fraunhofer/Agere Spatial Audio Coding Submission

11385 Konstantin Hanke Response to SVC CE4 - Spatial Lowpass Transition Filtering

11386 Konstantin Hanke SVC CE3 - Verification of ENST results

11387 Robert O'CallaghanMiroslaw Bober

Update of Results in Situation/View-Based Clustering (VCE-1)


Proposal on Ground Truth for Situation/View-Based Clustering (VCE-1)

11389 werner oomenFrans de BontErik Schuijers

Working draft proposal for SSC conformance


Preliminary Results on Image Categorization (VCE-2)

11391 Markus BeermannMathias Wien

Quality-adaptive reconstruction-filtering: first results

11392 Heiko PurnhagenWerner Oomen

Proposed corrigenda to AMD2, (parametric)

11393 Kristofer KjörlingWerner OomenJeroen Breebaart

Analysis of spatial evaluation results

11394 Herbert Thoma Test Bitstreams for Shape Coding

11395 S. R. Quackenbush Cross-check on ALS Core Experiment

11396 Andrea Kofler-VogtJoerg HeuerHarald KoschAndreas Hutter

CE report on systems extension (Siemens Index)

11397 Heiko Schwarz Coordinators report on SVC CE5: Spatial Scalability

11398 Heiko SchwarzTobias HinzDetlev MarpeThomas Wiegand

Further improvements of the HHI proposal for SVC CE1

11399 Heiko SchwarzDetlev MarpeThomas Wiegand

Further results for the HHI proposal on combined scalability

23























































































11400 Andreas Schneider Proposed Addition to MPEG-2 AAC Corrigendum

11401 Yongjun WuJohn W. Woods

Directional Intra-prediction for CE4

11402 Yuriy A. ReznikTilman Liebchen

Revision of MPEG-4 ALS Core Experiment 7

11403 Heiko PurnhagenKristofer KjörlingWerner Oomen

Additional Information on CT/Philips Spatial Audio Coding System

11404 Yuriy A. Reznik Cross-Check of SLS CE4 (Lazy Bitplane Coding)

11405 Gabriel PanisChristian TimmererJoerg HeuerDebargha MukherjeeMichael RansburgIngo WolfAndreas HutterHermann Hellwagner

Report of CE on Bit-Stream Adaptation in Constrained and Streaming Environments

11406 Yuriy A. Reznik Status of Performance and Complexity of Lossless Audio Coding Architectures

11407 Yuriy A. Reznik Verification Report on ALS CE6 (Higher Predictor Orders)

11408 Daniel LarkinValentin Muresan

Updated Status of Shape Coding Binary Motion Estimation Hardware Acceleration Module

11409 Octavian Folea Marius PredaFrancoise Preteux

BBA implementation into AFX encoder: Donation to ISO

11410 Yuriy A. Reznik On Mostly-Lossless-Region Scalability

11411 Ihab AmerWael BadawyGraham Jullien

An IP Block for MPEG-4 Part 10 Context-Based Adaptive Variable Length Coding (CAVLC)


A Hardware Block for 2x2 Hadamard Transform and Quantization with Application to MPEG–4 Part 10


A SystemC model for 2x2 Hadamard Transform and Quantization with Application to MPEG–4 Part 10


A Hardware Block for 4x4 Hadamard Transform and Quantization in MPEG-4 Part 10


A SystemC model for 4x4 Hadamard Transform and Quantization with application to MPEG-4 Part 10


A Hardware Block for the MPEG-4 Part 10 4x4 Transformation and Quantization


A SystemC Model for the MPEG-4 Part 10 4x4 DCT-like Transformation and Quantization

11418 Blaszak Marek Domanski SVC CE6 results at Poznan University of Technology

24


mailto:Lukasz













































































Rafal Lange

11419 Wo Chang MAF Photo Repository and Player

11420 Wo Chang MPEG-7 for WG1 (JPEG) JPSearch Project

11421 Jean-Claude DufourdOlivier Avaro

LASeR web site and logo

11422 Mohammed Zubair VisharamAli TabatabaiDave Singer

Supporting the storage of MPEG-21: Part 13 Scalable Video by an extension of the ISO Base Media File Format

11423 Mikael Bourges-Sevenier Architecture updates and considerations for MPEG-4 Part 21

11424 Justin Ridge SVC CE6 co-ordinator report

11425 Mohammed Zubair VisharamAli TabatabaiDave Singer

Extending the AVC File Format (14496-15) to support FRExt

11426 Justin RidgeYiliang BaoYilong Liu

Verification of SVC CE2 contribution for HHI

11427 Justin RidgeYiliang BaoMarta KarczewiczXianglin Wang

FGS subband enhancements for scalable video coding

11428 Justin RidgeYiliang BaoMarta KarczewiczXianglin Wang

FGS block enhancements for scalable video coding

11429 Charles Fenimore Stefan LeighAlan Heckert

Comparison of statistical methods for assessment of subjective video quality

11430 Myriam AmielhGerrard Drury Shane Lauf Ian Burnett

Preliminary comments of DID v.2 FCD

11431 T. MohamedW. Badawy

Multiple IP-Core Hardware-Accelerated Software System Framework for MPEG4-Part9

11432 Wo Chang AHG on MPEG-7 Interoperability and Profiling


IEC TC 100 NP [SC 29 N 6299]

11434 Anthony VetroHanspeter PfisterWojciech MatusikJun Xin

Comments on Draft Call or Evidence on Multi-View Video Coding

11435 Wojciech Matusik Hanspeter Pfister Tim Weyrich Anthony Vetro

Calibration and Rectification Procedures for Multi-Camera Systems

11436 Jun Xin Anthony Vetro

Preliminary studies on view interpolation for multi-view video coding

25









































































mailto:Lukasz

Hanspeter Pfister Wojciech Matusik

11437 Marco Tagliasacchi Cross-verification of UNSW proposal for SVC CE1

11438 Davide MaestroniMarco TagliasacchiStefano Tubaro

Cross-verification of UNSW proposal for SVC CE1

11439 AUNB AUNB Contribution: Participation in core experiments

11440 Satoshi ItoToru Kambayashi

Usage scenarios for composition of motion picture and study of constraint description model for digital rights

11441 David TaubmanReji MathewDavide MaestroniStefano Tubaro

SVC Core Experiment 1, Description of UNSW Contribution

11442 Miljan Vuletic Laura Pozzi Paolo Ienne

Virtualisation Layer for Portable Hardware Accelerators Seamlessly Integrated into Software Applications

11443 Won-Young Yoo Weon-Geun Oh Young-Ho Suh

Watermarking attack technologies





11446 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-2:2004/PDAM 2

11447 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/PDAM 10

11448 SC 29 Secretariat Summary of Voting on ISO/IEC CD 14496-20

11449 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-1:2000/DCOR 3

11450 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-7:200X/DCOR 1

11451 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-1:200X/PDAM 1

11452 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-16/PDAM 1



11455 SC 29 Secretariat Summary of Voting on ISO/IEC 21000-7/PDAM 1

11456 SC 29 Secretariat Summary of Voting on ISO/IEC CD 21000-16

26

































































Annex 4Output document list

No. Source Title

6698 Convener List of Documents from the Palma, ES Meeting

6699 Convener Resolutions of the Palma, ES

6700 Convener List of AHGs Established at the 70th Meeting in Palma, ES

6701 Convener Report of the 70th Meeting in Palma, ES

6702 Convener Guidelines for Electronic Distribution of MPEG and WG 11 Documents

6703 Convener Press Release of the 70th Meeting in Palma, ES

6704 Convener Meeting Notice of the 71st Meeting in Hong Kong, China

6705 HoD Guide for WG 11 Meeting Hosts

6706 HoD MPEG 101

6707 Video Request for Sub-division of ISO/IEC 11172-6

6708 Video Disposition of Comments on ISO/IEC 14496-2:2004 PDAM2

6709 Video Text of ISO/IEC 14496-2:2004 FPDAM2 New Levels in Simple Profile

6710 Video MPEG-4 Visual: List of Problems Reported version 14.0

6711 Video Text of ISO/IEC 14496-10:2004/DCOR1

6712 Video Text of ISO/IEC 15938-3/Amd.1 DCOR1

6713 Video WD 3.0 of MPEG-7 New Visual Extensions

6714 Video MPEG-7 Visual XM Document version 22.0

6715 Video Description of Core Experiments for MPEG-7 New Visual Extensions

6716 Video Scalable Video Model Version 3.0

6717 Video SVM 3.0 Software

6718 Video Guidelines for the SVC CE Process and Elevation Procedure

6719 Video Description of Core Experiments in MPEG-21 Scalable Video Coding

6720 Video Call for Evidence on Multi-View Video Coding

6721 Video Requirements on Test Material for Multi-view Video Coding Experiments

6722 Video Study of Video Coding Tools Repository V2.0

6723 Video VCTR Textual Description V1.0

6724 Convenor AHG on Video IDCT Specification

6725 Convenor AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

6726 Convenor AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software

6727 Convenor AHG on Description Tools for MPEG-7 New Visual Extensions

6728 Convenor AHG on Core Experiments in Scalable Video Coding

27

http://mpeg.nist.gov/reg/_listwg11_69.php?k=3,kv=1

http://mpeg.nist.gov/reg/_listwg11_69.php?k=2,kv=1

6729 Convenor AHG on Scalable Video Model and SVM Software

6730 Convenor AHG on 3DAV Coding

6731 Convenor AHG on Video Coding Tools Repository

6732 Convenor AHG on further Exploration in Wavelet Video Coding

6733 Convenor AHG on Organization of a Workshop on Future Directions in Video Compression

6734 Convenor AHG on Communicating MPEG to the business Community

6735 Video Text of ISO/IEC 11172-6 CD: Specification for Implementation of Inverse Discrete Cosine Transform

6736 Testing Report of the Subjective Quality Evaluation for SVC CE1

6737 Integration ISO/IEC 13818-5 MPEG-2 Reference Software 2nd edition

6738 Integration Text of ISO/IEC 14496-4:200x/DCOR1 Visual Bitstreams

6739 Integration Text of ISO/IEC 14496-4:200x/Amd1/DCOR1 FGS and Studio Bitstreams

6740 Integration Study of ISO/IEC 14496-4:200x/FPDAM9 AVC FRext Conformance

6741 Integration DoC on ISO/IEC 14496-4:200x/PDAM10 New Levels for Simple Profile Conformance

6742 Integration ISO/IEC 14496-4:200x/FPDAM10 New Levels for Simple Profile Conformance

6743 Integration Study of ISO/IEC 14496-4:200x/PDAM8 AVC FRext Reference Software

6744 Integration Draft DoC on ISO/IEC 21000-8 FCD MPEG-21 Reference Software

6745 Integration Study of ISO/IEC 21000-8 FCD MPEG-21 Reference Software

6746 Integration Methodology under consideration for MPEG-21 conformance

6747 SNHC Study text of DoC on ISO/IEC 14496-16/PDAM1

6748 SNHC Study text on ISO/IEC 14496-16/PDAM1

6749 SNHC AFX CE description

6750 SNHC AFX VM 16.0

6751 SNHC Text of ISO/IEC 14496-21 CD

6752 Convenor AHG on AFX documents, CEs, and software

6753 Convenor AHG on MPEG-J extensions for rendering

6754 ISG Status of HDL submissions and commitments for MPEG-4 Part-9

6755 ISG AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2.

6756 ISG Updated status and Documentation on Hardware Acceleration Module for SA-DCT for MPEG-4 Part 2

6757 ISG Updated Status and documentation of the 4xPE Hardware Acceleration Module for Motion Estimation

6758 ISG Updated status and documentation of the 2-D IDCT Hardware Accelerator Module for MPEG-4 Part 2

28

6759 ISG Updated Status and documentation of the Shape Coding Binary Motion Estimation Hardware Acceleration Module

6760 ISG Updated status of Inverse Quantizer Hardware Accelerator Implementation for MPEG-4 Part 2

6761 Liaison Liaison Statement to DCSDC

6762 Liaison Liaison Statement to the TV-Anytime Forum on MPEG-7 MDS

6763 Liaison Liaison Statement to OMA on LASeR

6764 Liaison Liaison Statement to 3GPP

6765 Liaison Liaison Statement to W3C

6766 Liaison Liaison Statement to WG 1 on JPSearch

6767 Liaison Statement of benefits from establishing a Category A liaison with ATSC

6768 Liaison Responses to National Body Comments

6769 Liaison List of Organisations with which MPEG entertains liaisons

6770 MDS Study of ISO/IEC FCD 21000-2 DID 2nd edition

6771 MDS Study of Preliminary Comments on ISO/IEC FCD 21000-2 DID 2nd edition

6772 MDS ISO/IEC CD 21000-4 MPEG-21 IPMP Components

6773 MDS TuC for 21000-4 MPEG-21 IPMP Components

6774 MDS Workplan for MPEG-21 REL/RDD Reference Software v.8

6775 MDS Study of preliminary comments on MPEG-21 DIA ISO/IEC 21000-7 PDAM-1

6776 MDS Study of text of MPEG-21 DIA ISO/IEC 21000-7 PDAM-1

6777 MDS Workplan for Core Experiment on DIA Conversions

6778 MDS Workplan for Core Experiment on Bit-Stream Adaptation in Constrained and Streaming Environments

6779 MDS MPEG-21 DIA Software Implementation Plan v.9

6780 MDS ISO/IEC FCD 21000-10 MPEG-21 Digital Item Processing

6781 MDS DoC for the CD of ISO/IEC 21000-10 MPEG-21 Digital Item Processing

6782 MDS MPEG-21 DIP Software Implementation Plan v.4

6783 MDS ISO/IEC CD 21000-15 MPEG-21 Event Reporting

6784 MDS WD 1.0 of ISO/IEC CD 21000-17 Fragment ID for MPEG Media Types

6785 Convenor AHG on MPEG-21 DIP& DID 2nd Edition

6786 Convenor AHG on MPEG-21 Event Reporting

6787 Convenor AHG on MPEG-21 DIA

6788 Convenor AHG on MPEG URI Fragment IDs

6789 Audio Study on 13818-7:2004/DCOR 1 “AAC ADTS buffer fullness correction”

6790 Audio 14496-3:2001/AMD 2:2004/DCOR 1 (SSC)

6791 Audio Study on 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS), new audio

29

profiles and BSAC extensions.

6792 Audio Study on 14496-3:2001/PDAM 5, Scalable Lossless Coding (SLS)

6793 Audio Study on 14496-3:2001/PDAM 6, Lossless coding of 1-bit oversampled signals

6794 Audio Status of Performance and Complexity of MPEG Lossless Audio Coding Architectures

6795 Audio Draft 3rd Edition of 14496-3

6796 Audio Workplan for Audio Lossless Coding (ALS)

6797 Audio Workplan for Scalable Lossless Coding (SLS)

6798 Audio Proposed Clarification of Audio Codec Timestamp Behavior

6799 Audio Working Draft of High Quality Parametric Audio Conformance

6800 Convenor Terms of Reference

6801 Convenor MPEG Standards

6802 Convenor Table of unpublished standards at FDIS level

6803 Convenor Work plan and time line

6804 Convenor Work item assignment

6805 Audio Working Draft of Parametric Stereo Conformance

6806 Audio Working Draft of additional test sequences for BSAC Conformance

6807 Audio Working Draft 0.1 AudioBIFS v3 Conformance

6808 Audio Workplan for Audio contribution to MPEG-4 Conformance

6809 Audio Status of MPEG-4 Audio Conformance

6810 Audio Working Draft of 15938-4:2002/PDAM 2, High-Level Description Extensions

6811 Audio Workplan for Weighted Scale DS

6812 Audio SMR Evaluation Model and Procedure

6813 Audio Report on Spatial Audio Coding RM0 Selection Tests

6814 Audio Workplan for MPEG-4 Spatial Audio Coding

6815 Audio Workplan on CfI on Scalable Speech and Audio Coding

6816 Audio MPEG General Audio Codecs History and Tools

6817 Convenor AHG on Audio Standards Maintenance

6818 Convenor AHG on MPEG-7 Audio

6819 Convenor AHG on Spatial Audio Coding

6820 Convenor AHG on MPEG-4 Lossless Audio Coding

6821 Convenor AHG on Symbolic Music Representation

6822 Convenor AHG On Exploration of Scalable Audio and Speech Coding

6823 MDS Request for Subdivision of ISO/IEC 21000: Part 17 Fragment Identification for MPEG Media Types

6824 Requirements MPEG-4/2 Profiles under Consideration

30

6825 Requirements LASER Requirements Document

6826 Requirements DoC of FCD of ISO/IEC 15938-9

6827 Requirements Text of FDIS of ISO/IEC 15938-9

6828 Requirements MPEG-7 Overview

6829 Requirements Second Draft of PDTR for potential second edition of ISO/IEC 21000-11

6830 Requirements Requirements for Scalable Video Coding

6831 Requirements MPEG-21 Profiles under Consideration

6832 Requirements Multimedia Application Format Overview & Requirements v.2

6833 Requirements Description of Scenario for Digital Item MAF

6834 Requirements Requirements for Multi-view Video Coding

6835 Requirements MPEG Multimedia Middleware Requirements v2.0

6836 Requirements Call for Proposals for MPEG Multimedia Middleware

6837 Convenor AHG on JPEG Liaison

6838 Convenor AHG on MAF Development

6839 Convenor AHG on Persistent Association

6840 Convenor AHG on Font Format Representation

6841 Convenor AHG on MPEG-21 Vision Update

6842 Convenor AHG on Digital Item Serialization

6843 Liaison Liaison Statement to OMA on Base Media File Format

6844 Systems DoC on ISO/IEC 13818-1:2000/DCOR3

6845 Systems Text of ISO/IEC 13818-1:2000/COR3

6846 Systems DoC on ISO/IEC 13818-1:2000/FPDAM4

6847 Systems Text of ISO/IEC 13818-1:2000/FDAM4

6848 Systems Text of ISO/IEC 14496-1:2004/FPDAM1

6849 Systems ISO/IEC 14496-14:2003/DCOR1

6850 Systems WD 1.0 of ISO/IEC 14496-15 Support for FREXT

6851 Convenor Proposed New Text of Software Copyright Disclaimer

6852 Systems DoC on ISO/IEC 14496-20/CD

6853 Systems Text of ISO/IEC 14496-20/FCD

6854 Systems Core Experiment on LASeR Binary Representation

6855 Systems Core Experiment on LASeR Harmonization with SVG

6856 Systems WD2.0 of ISO/IEC 14496-20 Reference Software

6857 Systems WD 1.0 ISO/IEC 15938-1/Amd.2

6858 Systems Core Experiments for Systems Extensions

6859 Systems MPEG-7 Systems reference software workplan

31

6860 Systems DoC on ISO/IEC 21000-16/CD

6861 Systems Text of ISO/IEC 21000-16/FCD

6862 Systems Core Experiments on MPEG-21 Binary Format

6863 Convenor AHG on XML Structure Binarization and Streaming

6864 Convenor AHG on Scene Representation

6865 Convenor AHG on MPEG File Formats

6866 Liaison Liaison Statement to IEC TC 100 on NP: Multimedia home server systems

6867 Integration WD4.0 of ISO/IEC 21000-14 MPEG-21 Conformance

6868 Liaison Template Cover Letter for M3W Liaison

32

Annex 5Report of Requirements meeting

Source:

Rob Koenen

NB: this report does not duplicate the resolutions, but rather complements them. This implies that not all output documents and not all Ad Hoc Groups are explicitly listed in the report below.

Monday 9:00-13:30 opening plenary meeting 13:30-14:30 Lunch (ends one hour after plenary ends)

14:30-16:00 Open

16:00-16:30

Joint with Systems on M3W11163 AHG on MPEG Multimedia Middleware - Jean Gelissen, Olivier Avaro , Martin

Russ11192 MPEG Multimedia Middleware Requirements v.2.0 - Jean H.A. Gelissen

Discobolo (Systems)

16:30-17:00Joint with Systems on LASeR

11330 Mobile requirements for lightweight scene representation - Philippe Lucas, et.al.11337 Requirements for Laser Binarization - Claude Seyrat

Discobolo

17:00-17:30

Joint with Systems on Font Representation 11183 Proposed Text - OFFS - Single Document - based on OpenType(R) v1.4 - Mike

Ksar11150 AHG on Font Format Representation - Mike Ksar, Vladimir Levantovsky

Discobolo

17:30-18:00Joint with Systems on Accessible Information Processing in MPEG

11250 Accessible Information Processing in MPEG - David Crombie, Roger Lenoir, Neil McKenzie

Discobolo

18:00-18:15 Joint with Systems on MP411260 Proposed URI scheme for mp4 file format - Yongju Cho, e.al. Discobolo

Tuesday

09:00-10:30

MPEG-7 “Plenary”11219 Draft for MPEG-7 Part 9 FDIS - Wo Chang11229 USNB Contribution: JPSearch and MPEG-7 - A. G. Tescher for USNB11420 MPEG-7 for WG1 (JPEG) JPSearch Project - Wo Chang11432 AHG on MPEG-7 Interoperability and Profiling - Wo Chang11181 Summary of Voting on ISO/IEC FCD 15938-9 [SC 29 N 6240] - SC 29 Secretariat

Neptuno

10:45-11:30Joint meeting with MDS et.al. on MPEG-21 Purpose

11249 MPEG-21 - Comatose or Just Sleeping? – Chris Barlas , Niels Rump11151 AHG on MPEG-21 Integration and Outreach - Chris Barlas, Chris Russell

Neptuno

11:30-13:00Joint with Systems, Video, Audio and MDS on MPEG-A

11288 Suggestion to create MPEG-A Part 4 – MPEG-21 Content Format (MCF) - Ian Burnett, et.al.

Neptuno

13:00-14:00 Lunch

14:00-14:30

Joint with Video on IDCT Standardization11268 A new way to look at IDCT - Peter Schirling , et.al.11224 IDCT Specification: A Problem and Opportunity - Gary Sullivan11225 USNB Contribution: Replacement of IDCT Standard - A. G. Tescher for USNB

Neptuno

14:30-15:00 Joint with Video on omni-directional video11350 Proposal for MPEG-A of omni-directional video - Kazumasa Yamazawa, et.al. Neptuno

15:00-15:30 Joint with Video on Scalable Video CodingAHG report Neptuno

15:45-16:30

Joint with Test on Persistent Association Technologies11182 Editor's input on possible 2nd Edition on PAT - Niels Rump for the AhG 11195 Objective Impairment Test Method for Video PAT Evaluation - Jong-Tae Kim,

et.al.11201 Guideline for the Selection of Standardized Test Stimuli in the Evaluation of Video

Watermarking - Ik-Hwan Cho, Weon-Geun Oh, Hae-Kwang Kim, Dong-Seok Jeong

11443 Watermarking attack technologies - Won-Young Yoo , Weon-Geun Oh , Young-Ho Suh

Neptuno

33

16:30-17:30

Joint with Audio 11310 Additions to the profiles under consideration document. - Kristofer Kjörling11312 Company support for the proposed High Efficiency AAC v2 Profile - Kristofer

Kjörling, et.al.11251 CFI proposed to AGH on Scalable coding – Johnston11370 FT's contribution to the CFI on Scalable Audio and Speech Coding - Pierrick

Philippe, et.al.11227 USNB Contribution: Fine-grain scalable audio codec - A. G. Tescher for USNB

Urano(Audio)

17:30-18:00 Communicating MPEG to the Business Community NeptunoWednesday

09:00-11:00

Plenary meeting

11:30-12:30

Joint with MDS on MPEG-21 issues11220 MPEG 21 as a secure interoperable DRM ? - FX Nuttall11276 The reference conformance test model(based on Mpeg-21 dii&didl) - SuSan Im,

e.al.

Jupiter

12:30-13:00 Open 13:00-14:00 Lunch

14:00-15:30 Open

15:30-16:30MPEG-21 – next steps

11249 MPEG-21 - Comatose or Just Sleeping? – Chris Barlas , Niels Rump11289 Requirements for Streaming Digital Items - Ian Burnett

Neptuno

16:30-17:30 Joint with Systems - Review of M3W Requirements and Preliminary CFP Discobolo17:30-18:00 JPSearch Neptuno

Thursday

09:00-10:15

Joint with Systems, Video, Audio and MDS on MPEG-A11419 MAF Photo Repository and Player - Wo Chang11239 Simple Profile for MPEG-21 DIA Usage Environment description tools - José

Martínez, et.al.

Neptuno

10:15-10:30 Joint with Systems on LASeR Requirements Discobolo10:30-11:00 Joint with Systems - Review of M3W Requirements and Preliminary CFP Neptuno11:00-12:0012:00-13:00 MPEG-21 IPMP Scope discussion Neptuno13:00-14:00 Lunch 14:00-15:00 Joint with Video on 3DAV and SVC Video15:00-16:00 Open16:00-16:30 Joint with MDS on MPEG-21 MAF MDS16:30-17:30 JPSearch Liaison Neptuno17:30-18:00 MPEG-21 Vision Update Neptuno

Friday

08:00-08:30

Concluding MPEG-7 MPEG-7 p.9 FDIS (Wo) Disposition of Comments on MPEG-7 (Masa/Rob - done) Liaison to JPEG on JPSearch (Wo) AHG on JPSearch liaison

Neptuno

08:30-09:00

Concluding MPEG-A Multimedia Application Format Overview & Requirements v.2 (Rob) AHG on MAF development (Rob/Klaus)

A.1 J on 4 (Photo)A.2 DI MAF

Description of Scenario for DI MAF (Klaus)

Neptuno

09:00-09:10

Concluding MPEG-4 MPEG-2/4 Profiles under Consideration (Kristofer - done) AHG on Font Format Representation (Vlad) LASeR Rqs Document (Olivier)

Neptuno

09:10-09:30M3W

M3W Requirements (Jean) M3W Preliminary Call for Proposals (Jean)

Neptuno

34

09:30-10:00

Concluding MPEG-21 Applications and Requirements for Scalable Video Coding (Ulrich) AHG on Serialization of MPEG-21 DI’s (Ian) MPEG-21 Profiles under Consideration Draft 2 of new PAT TR edition (Niels) PAT outreach AHG (Niels) AHG on MPEG-21 Vision Update (Bruce)

Neptuno

10:00-10:01Explorations

Requirements on Multiview Video Coding, v.2 (already approved) Call for Evidence for Multiview Video Coding (already approved)

Neptuno

12:30-14:00 Lunch 14:00-20:37 Plenary meeting

1 MPEG-1, -2 and -4 IDCT Specification11268 A new way to look at IDCT - Peter Schirling , et.al.11224 IDCT Specification: A Problem and Opportunity - Gary Sullivan11225 USNB Contribution: Replacement of IDCT Standard - A. G. Tescher for USNB

The problem raised by IEEE removing the IDCT standard will be resolved by the Video Group.The desirability of specifying an integer transform as an alternative to the traditional IDCT was discussed. An AHG was started to study the issue, which was seen as separate from re-instating the IDCT in some way.

2 MPEG-4

2.1 Part 3: New Audio Profile?11310 Additions to the profiles under consideration document. - Kristofer Kjörling11312 Company support for the proposed High Efficiency AAC v2 Profile - Kristofer Kjörling, et.al.

A request was put forward in a joint meeting with Audio for the definition of a new MPEG-4 Audio profile that combines AAC, SBR and Parametric Stereo tools. At this meeting, enough support was gathered for the Requirements Group to give the go-ahead. There was no consensus on the name of this new Profile. The proposed name, HE AAC v.2, has advantages and disadvantages:

It could confuse market place It could also give the right message, indicating yet a further improvement.

Still, Profiles as a principle never get re-defined, which would mean that the name is not suitable.

A new Profiles under Consideration Document was issued, N6824

2.2 Part 18 (?): OpenType as MPEG-4 part?11183 Proposed Text - OFFS - Single Document - based on OpenType(R) v1.4 - Mike Ksar11150 AHG on Font Format Representation - Mike Ksar, Vladimir Levantovsky

Pending the submission to MPEG of the OpenType specification free of encumbrances, the work in MPEG cannot continue. MPEG was informed that individuals will continue editing work in anticipation of such a submission. MPEG was informed that a decision from relevant IP holders could be expected by the first week of December

An AHG continued to operate, it has number N6840

2.3 Part 14 - MP4 File Format11260 Proposed URI scheme for mp4 file format - Yongju Cho, e.al.

35

Add suggestion to add a URI addressing scheme for identifying individual Elementary Streams to ISO file format was added to the “Technologies under Consideration” document. The Requirements Group supported the idea; the question is where to carry it the work, i.e., in what amendment. This decision is left to the Systems Group.

2.4 Part 20 - LASeR11330 Mobile requirements for lightweight scene representation - Philippe Lucas, et.al.The Requirements and Systems Groups agreed that maximizing overlap between SVG and LASeR was a goal. The question was how far to take this, and how compatibility should be defined exactly. A break-out group edited the exact language which was added to the new version of the LASeR Requirements Document.

11337 Requirements for Laser Binarization - Claude SeyratRequirements for harmonization with BiM were added to the Requirements Document as well. They were phrased as “may”s, indicating that this would be a nice-to-have, but no absolute must.

A new LASeR Requirements document was issued as N6825.

3 MPEG-7

3.1 GeneralA new version of the MPEG-7 Overview was approved, with an editing period. If the respective group chair are good enough to contribute their parts, it may actually get released.

This document is N6828

3.2 Part 9 – Profiles and Levels11219 Draft for MPEG-7 Part 9 FDIS - Wo Chang11432 AHG on MPEG-7 Interoperability and Profiling - Wo Chang11181 Summary of Voting on ISO/IEC FCD 15938-9 [SC 29 N 6240] - SC 29 SecretariatFDIS was approved with very minor changes to what was developed in the AHG. The Requirements Group thanked Wo Chang as editor, en the Japanese National Body for its insightful and thorough comments, as well as its contributions to resolving those comments.

The FDIS and document on FCD were issued as N6827 and N6826 respectively.

3.3 JPsearch Liaison11229 USNB Contribution: JPSearch and MPEG-7 - A. G. Tescher for USNB11420 MPEG-7 for WG1 (JPEG) JPSearch Project - Wo ChangA liaison was written to the JPEG WG indicating how MPEG-7 technology can support the JPSearch requirements, and expressing MPEG’s availability to support JPEG in its work on JPSearch if MPEG-7 technology will be considered.

The liaison has number N6766.The AHG that completed the editing and may assist in the evaluation work if required is N6837

4 MPEG-21

4.1 General; Requirements 11289 Requirements for Streaming Digital Items - Ian BurnettThe meeting agreed with the notion that providing support for streaming (or, more in general, transport and storage) of DI’s is a good idea. To better understand the scope of such work, an AHG was created.

36

The AHG number is N6842

11239 Simple Profile for MPEG-21 DIA Usage Environment description tools - José Martínez, et.alThe contribution suggests to make simple Profile for DIA, which includes all UED tools. The meeting agreed that this could be a potential profile, and a version of the mPEG-21 Profiles under Consideration document was created.

The MPEG-21 PuC document has number N6831

4.2 Part 4: MPEG-21 IPMP11220 MPEG 21 as a secure interoperable DRM ? - FX NuttallFollowing this presentation, a discussion ensued on the goal of the DRM standardization work in MPEG-21. It appeared that there still is no real consensus on the IPMP work in MPEG-21. Different views exist over what mPEG-21 should do – standardize as much of an IPMP system as possible, or enable the communication between different DRMs? It was also noted that the uptake of the tools that do exist is relatively limited. This discussion was combined with two other discussions: the one on MPEG-21 Outreach (see below on concrete actions) and the one on and MPEG-21 MAF (also see below for conclusions).

4.3 Part 11: Persistent Association Technologies11182 Editor's input on possible 2nd Edition on PAT - Niels Rump for the AhG The AHG work has resulted in two names of people interested in the work. That is a too small number compared to the interest in Audio, and the meeting concluded that more support would be needed to successfully complete a second version of the PAT that includes Video. The meeting decided to give it one more AHG study period to gather more interest. AN AHG was set up to contact experts, among other things at a relevant international conference the week after the MPEG meeting, in Seoul. (LNCS International Workshop on Digital Watermarking conference.)

The remaining contributions on this issue were evaluated assuming the work would indeed take place.

11195 Objective Impairment Test Method for Video PAT Evaluation - Jong-Tae Kim, et.al.Extending objective measures is good idea. The meeting concluded that they would need to be tested and verified before MPEG can reference them in its technical report. It was unclear if such verification has actually taken place.

11201 Guideline for the Selection of Standardized Test Stimuli in the Evaluation of Video Watermarking - Ik-Hwan Cho, Weon-Geun Oh, Hae-Kwang Kim, Dong-Seok Jeong

Again the proposal looked interesting, and again the meeting noted that there needs to be scientific proof that the metrics have some predictive value. There is an ANSI standard that may be a good candidate.

11443 Watermarking attack technologies - Won-Young Yoo , Weon-Geun Oh , Young-Ho SuhThe same conclusion holds as for the previous two contributions. Potentially relevant work, the value of which needs to be scientifically documented.

The AHG has number N6839The second draft of PDTR for potential second edition of ISO/IEC 21000-11 is N6829

37

4.4 Part 13: SVCAfter discussing the results of the AHG, the meeting agreed that the Applications/Requirements document needs more focus, and a better understanding about required configurations, that can later be mapped onto profiles.

The requirements themselves are good, with the low delay requirement having been clarified at the meeting.

Application examples should guide the prioritization. Because application examples did not yet map onto requirements, the document was restructured as follows:

1. requirements2. application families3. application examples

The idea is that examples map onto families, and that these families are used to derive requirements.The SVC Requirements Document was revised thoroughly. All old examples that are not yet rewritten into the new template have been collected into an annex. Examples that have not been rewritten by the next meeting will be dropped.

The new Requirements Document has number N6830

4.5 Part 14 – Conformance11276 The reference conformance test model(based on Mpeg-21 dii&didl) - SuSan Im, e.al.This presentation, while registered for Requirements, was referred to the Integration and MDS groups.

4.6 MPEG-21 Outreach11249 MPEG-21 – Comatose or Just Sleeping? – Chris Barlas , Niels Rump11151 AHG on MPEG-21 Integration and Outreach – Chris Barlas, Chris Russell

Lively discussions ensued after the presentation of m11249. The contribution distinguishes:

technical reports – “scaffolding” parts that deal with content by reference parts that touch resources directly

… and questions whether the parts that deal with content directly should be there at all. MPEG-21’s Unique Selling Point, according to the authors of this contribution, is dealing with content by reference.

The following remarks were made on what could be problems and solutions facing MPEG-21 adoption:

“MPEG-21 deals with value chains … but has no integration method for value chains. “Many people, inside and outside of MPEG, consider MPEG-21 too complex for end-point

(consumer) delivery. It is targeted at no market in specific – so there is no specific interest. “In addition, and unlike the situation for other MPEG standards, there are no identified

subsets (Profiles) that manage complexity in MPEG-21. “Being hybrid not the real problem. What we miss is solving “my little problem”. Don’t do

anything top-down anymore, but start doing things bottom-up. “Is the Unique Selling Point in addressing content by reference? Or in the DI paradigm? “Need to concentrate on own constituency – end-point delivery.

38

“Framework is very generic for everything – but not suitable for any particular problem. MPEG-21 seems to rely on other standardization bodies to take MPEG-21 and constrain it – but industry has no time for such an additional cycle. Companies are not interested

“MPEG-21 has too much fat – we confused vision with application. Need to go bottom-up, and see what tools we can provide to solve problems.

o “Hard to imagine we would throw out the vision – it embodies what industry needs at this point

o “don’t want to throw that out, but rather not to focus on redefining it now “Vision of MPEG-21 as a conduit to deploy parts (2), 4 and 7 is still there. Need to get

down to detail. o “MPEG-21 should be “glue-y” product. MPEG-21. The Sticky Standard.

“Keep adding parts, and passing the message is becoming increasingly hard! “There are people out there that have taken MPEG-21 bits and built a solution around the

parts. We can learn from them. Most of these seem to be in the library space.o Some people would prefer looking at the end-delivery space.

In conclusion of the discussion, there was a feeling that MPEG needs to go back to the original vision and see how that was relevant in today’s market, 4 to 5 years after starting MPEG-21. An AHG was started to do that.

The number of the AHG is N6841

5 MAF (MPEG-A)

5.1 General; Requirements 11419 MAF Photo Repository and Player - Wo ChangThe meeting discussed the Jon4 MAF, and its value proposition. Jon4 must at least encompass all EXIF metadata, because that is what is already in common use today, and Jon4 shall not offer less. If need be, MPEG-7 shall be extended to include more EXIF metadata (v 2.2) than what is proposed now.

The meeting discussed the criteria for starting an MAF at some length. These criteria were capture in the MAF Overview and Requirements document, in the form of requirements for creating an MAF. The criteria (requirements) are aimed at making sure that everything is done to allow an MAF to become successful in the marketplace. The criteria are similar to those for establishing a profile (in MPEG-4, -7 or -21). One time added was the requirement that at least one white paper on the MAF should be available at the end the standardization process.

The new Multimedia Application Format Overview & Requirements v.2 is N6832

5.2 MPEG-21 MAF Session11288 Suggestion to create MPEG-A Part 4 – MPEG-21 Content Format (MCF) - Ian BurnettContribution contains proposal for MMPEG-21 Content Format. It would do something similar to the DCF in OMA. A discussion ensued on how complete the format should be. E.g., should it define encryption? Should binarization should be handled – or should it be handled separately? Some participatnts asked that this format unify existing approaches to, e.g., encryption (e.g., look at and use what ISMA has specified). It was agreed that the goal would be to focus at horizontal application domains, not just mobile. There was some opposition to doing this at all, allegedly because of the confusion it might cause with, e.g., pure mp3 or mp4 formats, but this opposition was not shared and not sustained.

39

Three phases were identified for the development; it was left to future decision if these would all be published.

1) Format with no DRM at all2) Only REL (binariized and profiled), but no further IPMP elements3) Adding IPMP elements form MPEG-21 IPMP when that is ready

A break-out group studied a scenario that would form the basis of this format.

The scenario is described in N6833The AHG to further study the scenario is N6838

5.3 Omni-directional Video 11350 Proposal for MPEG-A of omni-directional video - Kazumasa Yamazawa, et.al.

This contribution proposes an MAF for omni-directional video. The meeting looked at the proposed technologies and understood that almost all of them could be found in MPEG-4, with perhaps a few elements from MPEG-7.

Besides the issue of what would actually be the technologies in this MAF, the question came up of whether this would constitute an MAF in the way MAFs were intended. Will its use be wide enough?

After further discussion among the chairs meeting and in the requirements group, a set of general criteria were agreed (see above) and these were presented in a joint Video/Requirements meeting. Contributions are invited for a next meeting to allow the Requirements Group to judge if such requirements could be met for an omni-directional video MAF.

6 Explorations & Others

6.1 General11250 Accessible Information Processing in MPEG - David Crombie, Roger Lenoir, Neil McKenzieUnfortunately, no one appeared to be present to introduce the contribution.

6.2 Scalable Audio Coding11251 CFI proposed to AGH on Scalable coding – Johnston11370 FT's contribution to the CFI on Scalable Audio and Speech Coding - Pierrick Philippe, et.al.11227 USNB Contribution: Fine-grain scalable audio codec - A. G. Tescher for USNB

The Requirements and Audio Groups met jointly to discuss the proposed RFI. While the text of the RFI was largely OK, after this joint meeting, the audio group was left with the task to better define when a new technology would meet the requirements for a new standardization project to start. The Requirements Group later understood that the Audio Group decided not to issue an RFI at this point in time. The reader is referred to the report of the Audio Group for further discussion on this matter.

6.3 3DAVA Call for Evidence was approved and issued for Multiview Video Coding. The accompanying requirements (N6501), extracted from the general 3DA requirements, were approved as well.

The Requirements are found in N6834The Call for Evidence is N6720

40

6.4 M3W11163 AHG on MPEG Multimedia Middleware - Jean Gelissen, Olivier Avaro , Martin Russ11192 MPEG Multimedia Middleware Requirements v.2.0 - Jean H.A. Gelissen

A new version of the requirements document was approved (6835). A Call for Proposals was discussed and released in preliminary version. The final version will be issued in January 2005. Responses to the Call are due in March 2005

The Requirements Document is N6835The CfP is N6836

41

Annex 6Report of Systems meeting

Source:

Systems Chair and Break-out group Chairs

Title: Systems Meeting ReportStatus: DraftEditor: Olivier Avaro (Streamezzo)

Contributors: Claude Seyrat (Expway), Jean-Claude Dufourd (Streamezzo),

OverviewThe main outputs of the meeting from the Systems Sub-group perspective are:

No. Title TBP Available

X 13818-1:2000/DCOR.3 Correction for Field Picture6844 DoC on ISO/IEC 13818-1:2000/DCOR3 No 04/10/226845 Text of ISO/IEC 13818-1:2000/COR3 No 04/10/22X 13818-1:2000/Amd.4 Metadata Application Format CP6846 DoC on ISO/IEC 13818-1:2000/FPDAM4 No 04/10/226847 Text of ISO/IEC 13818-1:2000/FDAM4 No 04/10/22X 14496-1 :2003/Amd.1 Text Profile Descriptor6848 Study Text of ISO/IEC 14496-1:2004/PDAM1 No 04/10/22X 14496-14 MP4 File Format6849 ISO/IEC 14496-14:2003/DCOR1 No 04/10/22X 14496-15 AVC File Format6850 WD 1.0 of ISO/IEC 14496-15 Support for FREXT No 04/10/29X 14496-20 LASeR6852 DoC on ISO/IEC 14496-20/CD No 04/10/226853 Text of ISO/IEC 14496-20/FCD Yes 04/11/056854 Core Experiment on LASeR Binary Representation No 04/10/226855 Core Experiment on LASeR Harmonization with SVG No 04/10/226856 WD2.0 of ISO/IEC 14496-20 Reference Software No 04/11/25X 15938-1 Systems6857 WD 1.0 ISO/IEC 15938-1/Amd.2 No 04/10/226858 Core Experiments for Systems Extensions No 04/10/226859 MPEG-7 Systems reference software workplan No 04/10/22X 21000-16 MPEG-21 Binary Format6860 DoC on ISO/IEC 21000-16/CD No 04/10/226861 Text of ISO/IEC 21000-16/FCD No 04/10/296862 Core Experiments on MPEG-21 Binary Format No 04/10/22

42

General issues

GeneralThe meeting report from Redmond has been approved.

Discussion on the documentation of BiM across MPEG standards:- Option 1 : Separate MPEG Standard- Option 2 : Part of Generic Technology Standard with IDCT- Option 3 : Part of MPEG-21- Current : Part of MPEG-7 Systems

Décision will be made in January.

List of standards under development

Pr

Pt Edit.

Project

Description CfP WD CD FCD FDIS

4 1 2004 Amd.1 Text Profile Descriptors 04/07

04/10

05/04

4 11 2003 Amd.4 XMT and MPEG-J Extensions

03/10

03/12

04/07

05/01

4 14 2004 Cor.1 Correction on File-type Box 04/10

05/01

4 15 2004 Amd.1 Support for FREXT 04/10

05/01

05/07

06/01

4 17 2003 1st Ed. Streaming Text Format 03/03

03/07

03/12

05/01

4 20 2004 1st Ed. Lightweight Application Scene

04/03

04/07

04/10

05/04

7 1 2004 Amd.2 BiM Extension 04/10

05/01

05/07

06/01

21 9 200x 1st Ed. File Format 03/12

04/03

04/07

05/01

21 16 200x 1st Ed. Binary Format 04/03

04/07

04/10

05/04

Standing Documents

Pr Pt Documents No. Meeting4 13 MPEG IPMP Extensions Overview N6338 04/03

München21 xx MPEG Multimedia Middleware Context and

ObjectivesN6335 04/03

München

DemonstrationsThe following demonstrations were made:

- M11207 INT: MPEG-4 3D Player. - Fraunhofer: AVC / He-AAC Streaming.

43

- France Telecom R&D: Scalable representation of 3D content.

FAQThe FAQ were updated as needed.

AOBNone.

44

MPEG-2 Systems (13818-1)

13818-1:2000 Amd.4

Topics1. ISAN and VISAN Signaling.

ContributionsAll NB comments were addressed and the final text of this amendment was produced.

Technical Work Finalized.

13818-1:2000 Cor. 3

Topics1. Correction on Field Picture

ContributionsM11449: Summary of Voting on ISO/IEC 13818-1:2000/DCOR 3. All comments were addressed and the final text of this amendment was produced.

Technical Work Finalized.

MPEG-2 Exploratory Activities

TopicsNone.


14496-1:2003 Amd.1M11451: Summary of Voting on ISO/IEC 14496-1:200X/PDAM 1. All comments were addressed and text of ISO/IEC 14496-1:200X/FPDAM 1 was produced.

Technical Work in Progress.

MPEG-4 Scene Description (14496-11)

14496-11:2003 Amd.4

Topics1. XMT Extensions;2. MPEG-J Extensions.

45

ContributionsNone.


MPEG-4 AVC File Format (14496-15)

14496-15:2004 Amd.1

Topics1. Support for FREXT

Contributions

M11425: Proposed amendment to Part 15 to support FREXT (Decoder specific info. extensions and support for additional NAL Units). Accepted. Production of WD.


Streaming Text (14496-17)

Topics1. Coded Representation of Text Stream.

ContributionsNone. This specification is currently at FCD stage. The editors of the document have requested additional time to implement the editorial guidelines decided in the July Redmong meeting. Text will be promoted to FDIS at the January Honk-Kong meeting.


Font Compression and Streaming (14496-18)

Exploratory Activities

Topics1. OpenType Standardization

ContributionsM11183: Proposed Text - Open Font Format Specifications (OFFS) - Single Document - based on OpenType(R) v1.4.

Technical work will not be progressed before owners of the copyright of the specification have given their agreement to go forward. AHG will continue with appropriate mandate (Cf. Requirements report).

46


47

LASeR (14496-20)

Topics1. Lightweight Application Scene Representation

Contributions

Discussion on Requirements

M1130: Mobile requirements for lightweight scene representation. Agreement to add as a requirement that a profile of LASeR shall be compatible with SVGT1.2.

M11337: Requirements for Laser Binarization. Requirement 1a (Flexibility) is already here. Requirement 1b (Genericity) has bee taken into account. Requirement 2 (support MPEG-7 and MPEG-21) is only a nice to have and not a must have. Documented as such. Requirements 3 (extension with XML namespace) is supported through private data. Requirements 4 (Low footprint implementation) is already supported.

The LASER requirement document was updated accordingly. A discussion started on compatibility with SVG that did not reach conclusion. Current understanding is documented in the LASER Requirement document. These issues will be further studied in the CE on SVG Harmonization as well as on the LASER AHG reflector.

Input Contributions

M11448: All comments have been successfully addressed. See DoC.

M11198: CE Study of LASeR and SAF CDUsed as a starting point as recommended by the AHG. May need to add a drawing to explain LASeR position with respect to SVG. Decisions on study text: Decision to start with the study with the AHG recommended changes to create the FCD. All open issues recorded in the CE on Harmonization workplan

M11330: Mobile requirements for lightweight scene representationRequest document rendering model as SVG: accept (done). Remove switch from g and use restricted version of page/pageSet for that: to be investigated in the CE. Use restricted clip attribute instead of g extension: to be investigated in the CE. Xml events: already satisfied with study 4.7. LASeR should be able to encode ECMAScript in <script/>: to be investigated in the CE. Freeze should be renamed back to fill: to be investigated in the CE.

M11332b: Results of the Core Experiment on Laser BinarizationContribution was presented and discussed in the AHG meeting. It was again discussed as part of the elaboration of the workplan of the CE on Binarization.

M11356: Report of work on the CE for LASeR Harmonization with SVG Contribution was presented and discussed in the AHG meeting. It was again discussed as part of the elaboration of the workplan of the CE on Harmonization.

M11357: Report of work on the CE on LASeR Binary Representation Contribution was presented and discussed in the pre-meeting. It was again discussed as part of the elaboration of the workplan of the CE on Binarization.

48

M11356, M11357: Report of work on the CE for LASeR Harmonization with SVG and Report of work on the CE on LASeR Binary Representation.

M11376: Results of the Core Experiment on Laser BinarizationThe following results were presented to the group: on compression, one does not loose or gain much by using BiM. Clarification needed on what exactly is compared in terms of code size, first indication is that code size is similar: the numbers are for the J2SE codec including the XML serialization for both. Contribution was again discussed as part of the elaboration of the workplan of the CE on Binarization (see below).

Decisions on CE on Binarization:1. Discussions on how would we document the specification when using BiM for LASeR

- Normative text: the syntax is specified in SDL (normative) so as to allow extensions.- Informative annex: state that the normative syntax is compatible with BiM and can

be either implemented with a hard-wired decoder or with a BiM decoder.2. Further steps on the CE on binarisation

- improvement of the schemas for better binarisation- find configuration for BiM to optimize extensibility- generate SDL- generate Java for reference software and cross-check it- target end of CE by January meeting- decision about BiM usage will be made at the end of the CE

3. Established assertions:- BiM compression is equivalent to ad-hoc compression- Code size is strongly presumed to be similar, but this needs to be cross-checked

M11287: A Proposal to Improve Compression Efficiency of LASeR Binary Representation Contribution was presented and discussed in the AHG meeting. Type codec of ETRI and Net&TV to be cross-checked in the framework of the on-going CE on Binarization.

- test set needs updating;- results for the updated test set will be provided to validate the algorithm;- the spec will be cross-checked by an independent implementation in the reference

software;- decision to be made in January.

M11265: LASER adaptive to time varying resourcesContribution was presented and discussed in the AHG meeting. This will be discussed as part of the continuing CE on Harmonization together with the switch issues.

M11177: Initial Reference Software for LASeR and SAFThe document was delivered on time and used by four independent parties. There is already a partial update of it in M11361. There are different APIs in the J2SE part of the RS and the J2ME part. This has led to confusion and may do so again. Consequently, there is a need to put some information in the readme of the reference software. This explains the difficulty in interpreting the CE results. J2ME binary specific decoder is estimated around 16Kb (jar).

M11361: LASeR/SAF reference software: codec aligned with studyContribution contains the codec aligned with input study document. This work was presented as part of the result of the work on the 2 CEs.

M11374: Implementation of LASeR (and of SVG) in the open-source GPAC project

49

This document aims at informing the group of the existence of the software. ENST encourages interested parties to use the software and participate in its further development. The whole code is available on gpac.sourceforge.net (not mentioned in the documentation, and no public release yet, but present in the CVS base). The group acknowledges with enthusiasm the existence of a GPL Ansi C implementation of LASeR and SAF, which provides a testing framework for ideas on integration of LASeR and SAF in the existing MPEG-4 Systems framework.

M11375: Analysis of the study of CD of LASeRMost comments are accepted. Trigger structure: to be investigated in the CE.

M11421: Proposed LASeR logos and web site organizationThe logos and project for a web site are presented and discussed. A few suggestions are made, such as change “membership” to “interest group” and move the ahg reference to the links section, and add a list of implementations/products. A final logo is agreed (see Figure 1).

Figure 1: LASER LOGO

Discussions

Normativness of LASER-ML: LASeR XML is an intermediate step in the process of encoding SVG (or other languages) to binary. It is as well the reference format to specify conformance of LASeR. LASeR XML is also a possible authoring format. There is so far no real argument to make it normative. Decisions that LASeR XML remains informative.

Support of SVG Fonts: LASER supports SVG Fonts by converting them to Truetype and sending them as a separate stream. Additional compression is part 18.


50


General

M11233 - Core experiment report for Fast Random Access into MPEG7 BiM streamsThe contribution presents the result of the CE on indexing. The contribution presents results regarding length position codes (fixed and variable length). Both cases show advantages for different scenarios. However is it worth the complexity to have to encoding mode for the same feature. The contribution describes also that the B-tree approach is inferior to the B-Chop approach in all the agreed test cases. The group decided to adopt the technology as described in the 70 th

meeting CE document. A CE on indexing is set up to finalize the technical work.

M11396 - CE report on systems extension (Siemens Index)The contribution presents a proposal of differential coding of position codes which provides good compression ratio. The solution is partially adopted as presented in the WD Amd.2. Other items are evaluated in the CE.

M11190 - MPEG-7 BiM for Unidirectional NetworksThe contribution presents a solution to better cope with situation where fragmentation is fixed. A CE is established to demonstrate the results with an integrated software and to evaluate the similarities/differences with TV-Anytime. The contribution presents also a new command "locate" to add a new fragment based on ID (à la bifs). The mechanism rely on attribute carried in the payload. A more suited mechanism to place an ID would be preferable in order not to bind position in the context tree to content. Contributions on this subject are welcome at the next meeting.

M11345 - MPEG-21 binarisation status with MPEG-7 BiM reference softwareThis contribution presents the current status of the BiM reference software. Noted.


51





MPEG-21 File Format (21000-9)

21000-9

Topics1. MPEG-21 File Format

ContributionsM11422: Supporting the storage of MPEG-21: Part 13 Scalable Video by an extension of the ISO Base Media File Format. First study on how SVC scalability should be supported at the systems level. Analysis for the File Format Case. Discussion on the storage of the stream as a single stream or as separate elementary streams. Discussion of access units. Decision to start an activity on the transport of SVC. Will be further investigated in AHG (Revive the MP4 AHG).

M11255: Preliminary comments on Text of ISO/IEC 21000-9 FCD. Propose to remove editorial comments concerning the technology under consideration, and the registration of MIME types. Accepted. For the time being, the addressing mechanism in the technology under consideration will be further studied under the activity on fragment identifiers in MDS. Decision to be implemented at the next January MPEG meeting.


52

MPEG-21 Binary Format (21000-16)

21000-16

Topics1. Binarization of MPEG-21 Data

ContributionsM11456 - Summary of Voting on ISO/IEC CD 21000-16All comments from NB have been addressed. See DoC.

M11335 - study of ISO/IEC 21000-16 CDThe document presents a proposal for a study of ISO/IEC 21000-16 CD taking into account the comments that have been presented prior to the meeting. The document is adopted as a starting point for the FCD.

M11256 - Preliminary Comments on ISO/IEC 21000-16 CD (Binary Format)This contribution presents issues regarding MPEG-21 binarization CD. These comments have been taken into account in the study of MPEG-21 binarization (m11335).

M11325 - Using MPEG-21 Part 16 in ApplicationsAn informative contribution which presents a parser developed to deal transparently with BiM and XML. The demonstration showing the encoding and decoding of BiM or XML events, size and time comparison. Shows that BiM reference software which was intended to generate conformant bitstreams is slow. The reset command requires the decoder to keep the initial description in memory and might be subject to profiling. Proponents will contribute in the future to improve BiM reference software.

M11274 - Application Specific Binary Coding (ASBC) of MPEG-21 descriptors.Proposal to defined application specific MPEG-21 encoding using BiM. To be studied in CE.


53





Other Activities

Multimedia Middleware

Topics1. Use cases;2. Middleware Architecture;3. Multimedia APIs.

ContributionsM11192: MPEG Multimedia Middleware Requirements v.2.0. Requirements have been updated. Preliminary Call in October, Final Call in January, Submissions in April 2005.


Other Activities

URI Scheme in MPEGM11290, M11260, M11291: Classification of MPEG MIME types. Proposed URI scheme for mp4 file format. Authoritative Fragment Identifiers for MPEG. All proposals discussed. Assessment that it would make sense to harmonize them. This will be done within an AHG hosted by MDS. Production of a working draft. Discussion on what MPEG standard will host this specification. Decision to start within MPEG-21 for the time being and create a new part (Part 17).

MPEG Application FormatM11419: See Requirements report.

MPEG-J ExtensionsM11204: MPEG-J for real case applications: design of a minimal and universal primitive class. Issue noted and assessed to be valid. Assessment that it is too early to produce an amendment. More understanding on the technology and relation with existing technology would be needed.

Transport and Delivery of MPEG-21 DIDM11289, M11271: Requirements for Streaming Digital Items. IPMPTransfer Description for MPEG-21 IPMP. The issue was discussed jointly with requirements and MDS. An AHG will be created to study further the issue.

54

Latest References and Publication Status

Pr Pt Standard No. Issue Status Doc. with Purpose2 1 ISO/IEC 13818-1/Amd.7 Published 2000/122 1 ISO/IEC 13818-1:2000 (MPEG-2 Systems 2nd

Edition)00/12 Published 2000/12

2 1 ISO/IEC 13818-1:2000/COR1 (FlexMux Descr.) N3844 01/01 Pisa Published 2002/032 1 ISO/IEC 13818-1:2000/Amd.1 (Metadata on 2) + COR2 N5867 03/07

TrondheimPublished 2003/12

2 1 ISO/IEC 13818-1:2000/Amd.2 (Support for IPMP on 2) N5604 03/03 Pattaya Published 2004/032 1 ISO/IEC 13818-1:2000/Amd.3 (AVC Carriage on MPEG-

2)N5771 03/07

TrondheimAMD ITTF to be published

2 1 ISO/IEC 13818-1:2000/Amd.4 (Metadata Application CP) N6847 04/10 Palma FDAM ITTF Prepare for FDAM2 1 ISO/IEC 13818-1:2000/Amd.5 (New Audio P&L Sig.) N6585 04/07

RedmondFDAM ITTF FDAM by 04/11/02

2 1 ISO/IEC 13818-1:2000/COR3 (Correction for Field Picture)

N6845 04/10 Palma COR ITTF to be published

2 11 ISO/IEC 13818-1:2003 (IPMP on 2) N5607 03/03 Pattaya Published 2003/124 1 ISO/IEC 14496-1 (MPEG-4 Systems 1st Ed.) Published 1999/124 1 ISO/IEC 14496-1/Amd.1 (MP4, MPEG-J) Published 2001/114 1 ISO/IEC 14496-1/Cor.1 Published 2001/114 1 ISO/IEC 14496-1:2001 (MPEG-4 Systems 2nd Ed.) Published 2001/114 1 ISO/IEC 14496-1:2001/Amd.1 (Flextime) Published 2002/104 1 ISO/IEC 14496-1:2001/Cor.1 01/07/20 COR ITTF4 1 ISO/IEC 14496-1:2001/Cor.2 02/10/26 COR ITTF4 1 ISO/IEC 14496-1:2001/Cor.3 N6587 04/07

RedmondCOR ITTF

4 1 ISO/IEC 14496-1:2001/Amd.2 (Textual Format) 02/03 AMD ITTF4 1 ISO/IEC 14496-1:2001/Amd.3 (IPMP Extensions) Published 2004-054 1 ISO/IEC 14496-1:2001/Amd.4 (SL Extension) Published 2003/124 1 ISO/IEC 14496-1:2001/Amd.7 (AVC on 4) N5976 03/10 Published 2004-08

55

Brisbanne4 1 ISO/IEC 14496-1:2001/Amd.8 (ObjectType Code Points) N6202 03/12 Hawaii AMD ITTF to be published4 1 ISO/IEC 14496-1 (MPEG-4 Systems 3rd Ed.) N5277 02/10

ShanghaiIS ITTF to be published

4 6 ISO/IEC 14496-6:2000 Published 2000/124 8 ISO/IEC 14496-8 (MPEG-4 on IP Framework) N4712 02/03 Jeju Published 2004-054 11 ISO/IEC 14496-11/Cor.1 (Integrated in 3rd Edition) N6203 03/12 Hawaii COR SC294 11 ISO/IEC 14496-11 (MPEG-4 Scene

Description) N5279 02/10

ShanghaiFDIS SC29 Final Text Editing

4 11 ISO/IEC 14496-11/Amd.1 (AFX) N5480 02/10 Awaji FDAM Editor Integration in 1st

Ed.4 11 ISO/IEC 14496-11/Amd.2 (Advanced Text and Graphics) N6205 03/12 Hawaii FDAM Editor Integration in 1st

Ed.4 11 ISO/IEC 14496-11/Cor.3 Valuator/AFX related

correctionN6594 04/07

RedmondCOR Editor Integration in 1st

Ed.4 11 ISO/IEC 14496-11/Amd.3 Audio BIFS

ExtensionsN6591 04/07

RedmondFDAM Editor Integration in 1st

Ed.4 12 ISO/IEC 14496-12 (ISO Base Media File

Format) N5295 02/10

ShanghaiPublished 2004-02

4 12 ISO/IEC 14496-12/Amd.1 ISO FF Extension N6596 04/07 Redmond

FDAM ITTF FDAM 04/11/30

4 13 ISO/IEC 14496-13 (IPMP-X) N5284 02/10 Shanghai

IS ITTF to be published

4 14 ISO/IEC 14496-14 (MP4 File Format) N5298 02/10 Shanghai

Published 2003-11

4 15 ISO/IEC 14496-15 (AVC File Format) N5780 03/07 Trondheim

Published 2004-04

4 18 ISO/IEC 14496-18 (Font Compression and Streaming)

N6215 03/12 Hawaii Published 2004-07

4 19 ISO/IEC 14496-19 (Synthesized Texture Stream)

N6217 03/12 Hawaii Published 2004-07

7 1 ISO/IEC 15938-1 (MPEG-7 Systems) N4285 01/07 Sydney Published 2002/077 1 ISO/IEC 15938-1/Amd.1 (MPEG-7 Systems Extensions) N6326 04/03 Munich FDAM ITTF FDAM 04/11/28

56

7 1 ISO/IEC 15938-1/Cor.1 (MPEG-7 Systems Corrigedum) N6328 04/03 Munich COR Editor7 2 ISO/IEC 15938-2 (MPEG-7 DDL) N4288 01/07 Sydney Published 2002/02

57

Resolutions of Systems

Cf. WG11 resolution.

List of reviewed contribution

N° Title Authors11177 Initial Reference Software for LASeR and SAF Jean-Claude Dufourd11183 Proposed Text - Open Font Format Specifications (OFFS) -

Single Document - based on OpenType(R) v1.4Mike Ksar

11190 MPEG-7 BiM for Unidirectional Networks Joerg Heuer et al.11192 MPEG Multimedia Middleware Requirements v.2.0 Jean H.A. Gelissen11192 MPEG Multimedia Middleware Requirements v.2.0 Jean H.A. Gelissen11198 CE Study of LASeR and SAF CD Jean-Claude Dufourd11204 MPEG-J for real case applications: design of a minimal and

universal primitive classSon Tran et al.

11207 MPEG-4 Player3D @ work: demonstration of a weather forecast application

Marius Preda et al.

11233 Core experiment report for Fast Random Access into MPEG7 BiM streams

Ray Taylor

11255 Preliminary comments on Text of ISO/IEC 21000-9 FCD (MPEG-21 File Format)

Thomas DeMartini et al.

11256 Preliminary Comments on ISO/IEC 21000-16 CD (Binary Format)

Thomas DeMartini et al.

11260 Proposed URI scheme for mp4 file format Yongju Cho et al.11265 LASER adaptive to time varying resources Kyung Mo Park et al.11287 A Proposal to Improve Compression Efficiency of LASeR

Binary RepresentationJihun Cha et al.

11289 Requirements for Streaming Digital Items Ian Burnett11290 Classification of MPEG MIME types Myriam Amielh et al.11325 Using MPEG-21 Part 16 in Applications Robbie De Sutter et al.11330 Mobile requirements for lightweight scene representation Philippe Lucas et al.11330 Mobile requirements for lightweight scene representation Philippe Lucas et al.11332 Results of the Core Experiment on Laser Binarization Cédric Thiénot et al.11335 study of ISO/IEC 21000-16 CD Claude Seyrat11337 Requirements for Laser Binarization Claude Seyrat11337 Requirements for Laser Binarization Claude Seyrat11345 MPEG-21 binarisation status with MPEG-7 BiM reference

softwareGregoire Pau et al.

11356 Report of work on the CE on Harmonization with SVG Jean-Claude Dufourd11357 Report of work on the CE on LASeR Binary Representation Jean-Claude Dufourd11361 LASeR/SAF reference software: codec aligned with study Jean-Claude Dufourd11374 Implementation of LASeR (and of SVG) in the GPAC project Cyril Concolato11375 Analysis of the study of CD of LASeR Cyril Concolato11376 Results of the Core Experiment on Laser Binarization Andreas Hutter et al11396 CE report on systems extension (Siemens Index) Andrea Kofler-Vogt et al.11419 MAF Photo Repository and Player Wo Chang11421 LASeR web site and logo Jean-Claude Dufourd et al.11422 Supporting the storage of MPEG-21: Part 13 Scalable Video

by an extension of the ISO Base Media File FormatMohammed Zubair et al.

11425 Extending the AVC File Format (14496-15) to support FRExt Mohammed Zubair et al.11448 Summary of Voting on ISO/IEC CD 14496-20 SC 29 Secretariat11449 Summary of Voting on ISO/IEC 13818-1:2000/DCOR 3 SC 29 Secretariat11451 Summary of Voting on ISO/IEC 14496-1:200X/PDAM 1 SC 29 Secretariat11456 Summary of Voting on ISO/IEC CD 21000-16 SC 29 Secretariat

Annex 7Report of MDS meeting

Source: Ian S Burnett, PhD, Chair MDS Subgroup

1. General Information about MDS at the 70th MPEG meeting in PalmaThe MDS subgroup commenced with the following summarey, kick-off:

Overview of MDS activities:• Work items for MDS are only MPEG-21 related• Goals of the week

MDS schedule (m11466 on NIST site):• Joint meetings• Breakout groups• Continuously updated, check version number

Questions

Since there were no explicit MPEG-7 activities excepting some involvement in joint Profiles activities – see Requirements report, the workplan included:

MPEG-21:• DID 2nd Ed (FCD)• REL (“Profiles”)• RDD (COR/1)• DIA AMD/1 (PDAM, COR/1 WD)• DIP (FCD)• Ref SW (FCD)• Conformance (CD)• Event Reporting (WD)• IPMP (WD)

A further area of work was URI Fragment Identifiers for MPEG media types.

In further detail, the MPEG-21 activities were:

MPEG-21 Digital Item Declaration (Part 2):• Review proposals on IPMP reqts, Prelim. NB Comments on FCD• Output: MPEG-21 DID 2nd Ed à Study of FCD

MPEG-21 Rights Data Dictionary• Output: MPEG-21 RDD COR/1 à WD (no action taken in Palma due to

personal difficulties of a participant)

MPEG-21 Digital Item Adaptation (Part 7):• Output: MPEG-21 DIA AMD/1 à at PDAM – Study generated

MPEG-21 Reference SW (Part 8):• Review SW contributions, NB Comments• Output: MPEG-21 Ref. SW à Study on FCD

59

• MPEG-21 Digital Item Processing (Part 10):

• Review AHG report, Test results, NB Comments• Output: MPEG-21 DIP à FCD

MPEG-21 Conformance (Part 14):• REL Profile for conformance work – based on mobile/OMA• Output: MPEG-21 Conformance à WD continuing (see Integration report)

MPEG-21 Event Reporting (Part 15):• Review CE & AHG results• Output: MPEG-21 Event Reporting à CD

A further activity was undertaken on URI Fragment Indentifiers:

Fragment Identification for MPEG Media Types using a URI Fragment scheme based on MIME Types.

A full featured media pointer mechanism for URI access to fragments of MPEG media files.

Outputs: WD from the meeting and a new part (17) of MPEG-21 requested.

2. Notes on discussions on Input Documents

The MDS subgroup formed two permanent Break Out Groups:

IPMP (Chair: Simon Watt) and Event Reporting (Chair: FX Nuttall)

These two break out groups met throughout the week in preassigned rooms.Other, informal, Break Out Groups were formed during the week for the purposes of:

DIA Ammendment and Core Experiment discussionsDID 2nd edition editing and preliminary DoC workDIP FCD – continuing work on DoC of NB comments and completing the FCDREL – discussion of the referenec software.Fragment Identifiers – preparation of the WD.

The MDS group considered all input documents, or summaries (agreed with the contributors) of the contributions and their treatment from the Break out groups.

11338Frederik De Keukelaere,Thomas DeMartini,Jeroen Bekaert,Rik Van de Walle,


Input:Discussed in AHG/BoG.Proposes an object oriented API for DIBOs in DIP.API now fixed for all issues that were raised in discussions. The OO DOM API simplifies the current DIBO API and makes it much clearer.

Actions:

60



Updated input software based on discussions – MDS is happy that software meets change object criteriaAdopt OO API based on BNB comments. Proposal for DOM API to be adopted ‘by value’ but we need dicussions with FNB to see if meets NB comments. Informative text to be created for FCD about tracking mechanism and usage for Rights processing.

11339 Saar De Zutter,Frederik De Keukelaere,Rik Van de Walle, Proposal for DIP bootstrapping

Input:Proposal to include bootstrapping for DIs – using e.g. a Main DIBO

Actions:Produce text based on input (addresses FNB comments)Further discuss proposed mechanism for bootstrapping Main DIBO or Entry point for DIBOsConsider calling methods from methods – RunDIM DIBO proposed – text will be introduced to FCD.Entry point might allow launch of e.g a WWW page on DI loading.FNB to be consulted on possible solutions.

DIP discussions – new text to be created by various MPEG members. Monday pm – reviewed text on Profile signalling.

Tuesday

11212 Shane Lauf,Gerrard Drury,Ian Burnett, Proposed extensible DIDL schema

Input:Proposal from IPMP AHG to create a schema mechanism to have a ‘protected’ IPMP DID and be able to drop the unprotected DI into a ‘locked box’ in IPMP_DIDL. Proposal introduces alternate views of the DID model – IPMP now instead of just the DIDL as a starting point.

ActionsQuestion of style – separate Model schema or combine DIDL+Model. Some regard that it would be better to minimise number of namespaces and files.Details to be discussed during the week.

11213 Shane Lauf,Ian Burnett, Proposed IPMP DIDL schema

Input:Introduces proposed structure of IPMP DID elements and schema.

ActionsIPMP BoG using this during discussions and growing into the CD text

11252

Thomas DeMartini,Marco Hurtado,Martha Nalebuff,Pete Schirling,Anthony Vetro,Xin Wang,


Input:Comments being addressed in Study of FCD

Actions61






FCD changes recommended.

11351

Watt, UKNB Comments on ISO/IEC FCD 21000-2 : Digital Item Declaration

Input:Comment on the importance of the IPMP_DIDL work and that it needs to be considered by the DID activity. In particular bearing in mind the FCD of DID 2nd edition.

ActionsText to be created incorporating changes for the Study of FCD.

11355 BNB,

Preliminary BNB comments on ISO/IEC 21000-2 2nd edition FCD

Input:Comments on FCD being addressed in Study of FCD

ActionsFCD changes recommended.

11430 Myriam Amielh,Gerrard Drury ,Shane Lauf ,Ian Burnett,

Preliminary comments of DID v.2 FCD

Input:Comments on FCD being addressed in Study of FCD.

ActionsFCD changes recommended.7.2, 7.4 discussed in more detail

11193 Niels Rump for the editors,Editors' Input towards CD of 21000-15

11296 Kyunghee Ji,Youngjoo Song,Nammee Moon,Jaegon Kim,


11315 Senator Jeong,Yeon-Jeong Jeong,Weon-Geun Oh,Ki-Song Yoon,


Input:Comments on WD of ER

Actions11193: Significant issues taken from this input document. Structure of CD remains the same: 3 parts: ER Description, Event Conditions, ER Structure.11315: Incorporated but not presented – noone present in Palma.Connection with DIA to be exploredConnection with RDD to be exploredIdentification of Users: REL Principle ID approach

11249 Chris Barlas ,Niels Rump,

MPEG-21 - Comatose or Just Sleeping?

11419 Wo Chang, MAF Photo 62














mailto:S

mailto:S

Repository and Player

11288 Ian Burnett,

Suggestion to create MPEG-A Part 4 – MPEG-21 Content Format (MCF)

11289 Ian Burnett,

Requirements for Streaming Digital Items

Input:Inputs on Future directions of MPEG-21 and MAF. Dealt with fully in Reqts report.

ActionsSee Reqts report.

11440 Satoshi Ito,Toru Kambayashi,


Input:Four usage scenarios for Rights in Motion Pictures and missing elements in MPEG-21.Various scenarios for video delivery in Motion Picture industry. Suggests that there are some ‘lacking’ areas in REL functionality. Three solution approaches – Di structure/SMIL solutions but the best is to add extension of right – ‘playwithconstraint’ to REL.

ActionsSimilarity to inputs from the REL development phase.

11270 Teemu Saarinen,Artur Lugmayr,


Input:Simple implementation of light-weight REL system on mobile. Includes example license and explanation of the lightweight REL. Walkthrough of the application is provided. Propose solution as reference software.

ActionsPossibly utility software. Going to get a demo later this week.Update REL s/w plan and propose for utility module for part 8 (insert in study) We will need NB comments to support its inclusion.Part of discussion for MAF part 4.

11211 Thomas DeMartini,Vincent Tieu,Xin Wang,


Input:Datatypes and methods to achieve mapping from input to output for REL Interpretation Reference software.

Actions:

63
















Substantial work. We now believe that the way forward should be to take this to conclusion in April. Conformance will be in a constrained subset – perhaps suitable for the MAF 4.

11189 Shane Lauf,Ian Burnett,

Mobile MPEG-21 Peer Implementation

Input:

A demonstration of a complete MPEG-21 browser that includes IPMP etc. Operates on a mobile phone and the Sun WTK.

Actions:DID Parser to be reference s/w (including IPMP_DIDL parser).

11178 Zhongyang Huang,Ming Ji,Shengmei Shen,Taka Senoh,Takafumi Ueno,


11179 Shane Lauf,Examination of technology in IPMP WD 1.0

11184 on behalf of the MPEG-21 IPMP AdHoc group.,


11221 Eva Rodriguez,Huang Zhongyang, IPMP Information Schema

11271 J. J. Chae,Jeho Nam,Jae-Gon Kim,


11348Hendry,Jeongyeon Lim,Qonita M. Shahab,Kyung-Ae Cha,Munchurl Kim,Keunsoo Park,


11349 Hendry ,Munchurl Kim ,Keunsoo Park,


Inputs

11178-11184 – Mountain View AHG inputs and dealt with there

11221 11349 : These were considered and in discauusions two schemas were created to cover these spaces.

1127111348: Not yet addressed – will be addressed Wednesday .

ActionsDiscussions continued during the IPMP BoG which met independently throughout the week.

11262Christian Timmerer,Klaus Leopold,Dietmar Jannach,Hermann Hellwagner,Mariam Kimiaei,

Report of CE on Conversion Parameters

Input

Existing technologies – WSDL, SWRL, OWL-S evaluated. OWL-S descriptions can be included in PDAM.

Actions

DIA discussions with RDD – semanticsNew/continued CE using OWL-S 1.1 and WSDL syntatical description of parameters

64



















11405Gabriel Panis,Christian Timmerer,Joerg Heuer,Debargha Mukherjee,Michael Ransburg,Ingo Wolf,Andreas Hutter,Hermann Hellwagner,


Input

Detailed CE report. Design for Process Unit Architecture described. Transmmission of adaptation related metadata and media data discussed gBSD Transformation-Bitstream adpatation – 2 approaches examined and filesizes / processing times examined.

Actions:

Continue CE with strong focus on combined meta and media data processing. Aiming at inclusion in current ammendment.

11253Thomas DeMartini,Marco Hurtado,Martha Nalebuff,Pete Schirling,Anthony Vetro,Xin Wang,


Input

Preliminary NB comments. Conflicts on tools placements. Various editorial comments

Actions:

Discussions and incorporation into the Study document.

11371 Christian Timmerer,Joerg Heuer,Gabriel Panis,Hermann Hellwagner,Andreas Hutter,


Input

Proposal to correct bs1:length in DIA COR/1 WD but there is actually no error.

Actions:

Probably withdraw WD – wait for full consultation. AHG mandate.

11218Hyuk-Min Kwon,Man-Bae Kim,Jeho Nam,Rin-Chul Kim,Hae-Kwang Kim,Seungji Yang,Truong Cong Thang,Yong Man Ro,


Input

MPEG-21 DIA utility s/w on www.titr.uow.edu.au/mpeg/

Actions:

Update DIA software modules document and update reference software site (software uploaded). NB comments will be required to promote update to the FDIS

Joint with Reqts

65












11220 FX Nuttall,MPEG 21 as a secure interoperable DRM ?

Input

Points out that it is currently one player=one DRM in general. Asks if MPEG-21 could address DRM interoperability.

Discussion related to the scope of MPEG-21 IPMP. Full DRM or allow interoperability with a full DRM solution? What exactly does the industry need in terms of DRMs? Commercial input will dictate some of the DRM interoperability – but MPEG needs to provide the technical means. MPEG-21 should provide the framework to allow DRM interoperability when the industry getsto the point of needing that functionality. MPEG-21 will not create a complete DRM – just will have the containers in MPEG-21. Need to get into some of those issues or decide not to – we should consider the scope again.Could we have a MAF and inform IPMP from an MAF. In considering the scope we should work on what is ‘out of scope’. Must be commercially motivated - consumer wants to be able to buy ‘a device’ and then play ‘any content’. We need tools that will make the industry succesful in achieving these goals. Interoperability is the key word but the meaning is hard to define – if we define clearly the scope of IPMP we define interoperability for all MPEG-21. Should consider interworking as well as interoperability – a diversity of solutions but you can go from A to B to C and everything talks …. May need to specify the interworking glue.

Dichotomy in IPMP emphasised – one group an interoperable DRM, one group facilitating communication between different DRM systems.

Actions:Review scope of IPMP – what is out of scope, in particular.MAF to inform the IPMP – specify what it will be about and what it is not..

11276 SuSan Im,SangHoon Oh,SeokHoon Kim,Spencer Cheng,


Input:

Proposes a way of conformance testing MPEG-21.

Actions:

To be discussed further at Integration/MDS joint mtg.

Joint with Systems

11274 Itaru Kaneko ,Nobuyuki Kinoshita ,Spencer Cheng,


Input:ASBC-Application Specific Binary Coding – proposal for binary coding of MPEG-21 descriptors. Additional tool to increase performance on binarisation.

Discussion:Concern that the XSLT in evry decoder would be too complex.

Actions:66








Core Experiment with MPEG-21 binarisation

11291 Myriam Amielh,Ernest Wan, A Framework for MPEG URI fragment Identifiers

Input:Ongoing work on URI addressing schemes for MPEG MIME types.

Actions:Obviously a need for Fragment Identifiers across MPEGAHG working on itStandard part for specific technologies – possible options – new std or MPEG-21WD for end of the week

Joint meeting with Integration

MPEG-21 Ref. SW & Conformance (16h30 - 17h30) with Integration - TBD Marte (MDS Room)

11254

Thomas DeMartini,Marco Hurtado,Martha Nalebuff,Pete Schirling,Anthony Vetro,Xin Wang,


11261 Shane Lauf,Ian Burnett, IPMP DIDL Reference Software Contribution11336

Frederik De Keukelaere,Rik Van de Walle, Contribution to DID conformance

11211Thomas DeMartini,Vincent Tieu,Xin Wang,


11218

Hyuk-Min Kwon,Man-Bae Kim,Jeho Nam,Rin-Chul Kim,Hae-Kwang Kim,Seungji Yang,Truong Cong Thang,Yong Man Ro,


11276SuSan Im,SangHoon Oh,SeokHoon Kim,Spencer Cheng,


See Integration report for full details of these documents and treatment.

Resolution from MDS that proponents make an NB comment on inclusion

11276: Using such tools would allow us to test the coverage of our reference software. We should have this as a methodology under consideration.

Thursday

11271 J. J. Chae,Jeho Nam,Jae-Gon Kim, IPMPTransfer Description for MPEG-21 IPMP

Proposal that this should be extended to messaging in the full MPEG-21 scope. However, the problem seems to be that there are other envelope mechanisms – e.g. SOAP. Is this related to MPEG-4 IPMPx in terms of the architecture?

Consensus that we might possibly standardise messages – but which messages?

Resolution from MDS noting that messages may be required in the broader MPEG-21 standard parts and that we invite MPEG members to consider bringing inputs related to suggested requirements for messages to the 71st meeting. At that meeting requirements for messages in MPEG-21 will be discussed.

67














3. Summary of Outcomes on Part basis

The following outcomes were generated at the meeting:

MPEG-21 Digital Item Declaration (Part 2): Reviewed proposal on split DID schema from IPMP Several improvements from NBs for DID 2nd Edition Output:

MPEG-21 DID 2nd Edition Study of FCD Preliminary treatment of advance NB comments

MPEG-21 IPMP Components (Part 4) (Title changed to reflect the work) Substantial work to create a stable and mature IPMP Components CD, consisting

of IPMP DIDL IPMP INFO Schemas (2)

Initial discussions on areas not covered at this stage Output:

MPEG-21 IPMP ComponentsCD TuC for MPEG-21 IPMP

MPEG-21 Digital Item Adaptation (Part 7): Reviewed CE results on Conversion Parameters

New CE focusing on using OWL-S 1.1 and WSDL syntactical description of parameters

Reviewed CE results on Bit-Stream Adaptation in Constrained and Streaming Environments

Continue CE with strong focus on combined meta and media data processing.

Output: MPEG-21 DIA Study of PDAM 1, New CEs

MPEG-21 Reference SW (Part 8): Reviewed contributions for MPEG-21 Reference SW

Major contribution on complete REL Ref. SW Substantial integrated DIA s/w including a DIA adaptation engine (utility

s/w), many modules updated Output: Study on MPEG-21 Ref. SW CD & SW Implementation Plans

MPEG-21 Digital Item Processing (Part 10): Completed FCD – addressing all 151 NB comments Resolved issues on Rights and Base Operations Significant informative annexes and text added A number of complete informative examples added Harmonisation between DIMs and J-DIXOs OO API Adopted – broadened appeal by using DOM

Output: DoC for DIP CD

68

MPEG-21 DIP FCD Reference software workplan

MPEG-21 Event Reporting (Part 15): Completed the CD of the MPEG-21 ER Significant editing work and integration with other MPEG-21 parts was

succesfully completed.

Output: MPEG-21 Event Reporting CD

MPEG-21 Fragment Identifiers for MPEG Media Types (Part 17): New part of MPEG-21 requested Significant new WD created based on inputs at this and previous meetings.

Output: MPEG-21 Part 17 WD Request for new part 17 of MPEG-21

4. Output Documents and Resolutions from the MDS Subgroup

14.1 Multimedia Description Schemes group

14.1.1 The Multimedia Description Schemes subgroup recommends approval of the following documents

MPEG-7

None

MPEG-21


21000-2 MPEG-21 Digital Item Declaration6770 Study of ISO/IEC FCD 21000-2 DID 2nd edition N 04/11/14

6771 Study of Preliminary Comments on ISO/IEC FCD 21000-2 DID 2nd

editionN 04/10/22


21000-3 MPEG-21 Digital Item Identification


21000-4 MPEG-21 IPMP Components6772 ISO/IEC CD 21000-4 MPEG-21 IPMP Components Y 04/12/076773 TuC for 21000-4 MPEG-21 IPMP Components N 04/10/22

69


21000-5 MPEG-21 Rights Expression Language6774 Workplan for MPEG-21 REL/RDD Reference Software v.8 N 04/10/22


21000-6 MPEG-21 Rights Data Dictionary


21000-7 MPEG-21 Digital Item Adaptation

6775 Study of preliminary comments on MPEG-21 DIA ISO/IEC 21000-7 PDAM-1

N 04/10/22

6776 Study of text of MPEG-21 DIA ISO/IEC 21000-7 PDAM-1 N 04/11/246777 Workplan for Core Experiment on DIA Conversions N 04/10/22

6778 Workplan for Core Experiment on Bit-Stream Adaptation in Constrained and Streaming Environments

N 04/10/22

6779 MPEG-21 DIA Software Implementation Plan v.9 N 04/10/22


21000-8 MPEG-21 Reference Software


21000-10 MPEG-21 Digital Item Processing6780 ISO/IEC FCD 21000-10 MPEG-21 Digital Item Processing Y 04/11/30

6781 DoC for the CD of ISO/IEC 21000-10 MPEG-21 Digital Item Processing

N 04/10/22

6782 MPEG-21 DIP Software Implementation Plan v.4 N 04/10/22


21000-15 MPEG-21 Event reporting6783 ISO/IEC CD 21000-15 MPEG-21 Event Reporting Y 04/12/07


21000-17 Fragment Identification for MPEG Media Types6784 WD 1.0 of ISO/IEC 21000-17 Fragment ID for MPEG Media Types N 04/11/14

6823 Request for sub-division of ISO/IEC 21000: Part 17 Fragment Identification for MPEG Media Types

MPEG-21 related resolutions:

Part 4 Intellectual Property Management and Protection Components

70

14.1.2 a) The Multimedia Description Schemes subgroup requests that the name of ISO/IEC 21000-4 be changed to Intellectual Property Management and Protection Components.

14.1.3 b) The Multimedia Description Schemes subgroup notes that ‘messages’ may be required in the broader context of MPEG-21, rather than being a sole requirement of part 4. Thus, MPEG members are invited to submit suggested requirements on MPEG-21 messaging to the 71st meeting. At that meeting requirements for messages will be considered by the Requirements subgroup.

Part 10 Digital Item Processing

14.1.4 a) The Multimedia Description Schemes subgroup reminds members that new submissions to the Digital Item Processing Reference software, conformant to the FCD, are now required.

14.1.5 b) The Multimedia Description Schemes would like to thank the National Bodies of Australia, Austria, Belgium, France, Japan, republic of Korea, Singapore and US for their detailed comments on MPEG-21 Digital Item Processing CD and their assistance during the FCD editing activities.

Part 15 Event Reporting

14.1.6 a) The Multimedia Description Schemes subgroup reminds proponents of Event Reporting tools that integrated reference software implementations must be provided and that core experiments must be successfully completed in order for promotion of the tools.

Ad Hoc groups:

14.1.7 The Multimedia Description Schemes group recommends establishing the following Ad Hoc groups:

No. Title Mtg6785 AHG on MPEG-21 DIP& DID 2nd Edition Y6786 AHG on MPEG-21 Event Reporting Y6787 AHG on MPEG-21 DIA Y6788 AHG on MPEG URI Fragment IDs Y

5. Ad-Hoc Groups From MDS at the 70th MPEG meeting

N6785 14.1.8 AHG on MPEG-21 DIP & DID 2nd EditionMandates 1. Carry out editing of DIP FCD according to disposition of NB

comments on CD.2. Carry out editing of Study of DID FCD.3. Encourage contributions on improving MPEG-21 DIP FCD.4. Carry out further study of preliminary comments and encourage

further comments on DID FCD.5. Monitor implementation of the DIP software implementation plan.

71

Chairman Gerrard Drury ([email protected])Co Chair Frederik De Keukaleare ([email protected])Duration Until the 71st MeetingMeetings AhG Meeting to be held on the Sunday prior to 71st meeting.

Other business to be conducted by email or phone.Reflector [email protected] See http://mailinglists.uow.edu.au/mailman/listinfo/mpeg-21-dip

N6786 14.1.9 AhG on MPEG-21 Event ReportingMandate: 1. Continue developing the reference software, as to comply with CD

2. Produce CD 1.0 during editing periodChairs: FX Nuttall (fx at nuttall.org)

Andrew Tokmakoff (tokmakoff at telin.nl) Duration: Until the 70th MeetingMeetings: A pre- meeting will be held on the weekend before the Hong Kong meeting.

Other business will be conducted by E-mail or telephone conference.Reflector: [email protected] Subscribe: See http://lists.telin.nl/mailman/listinfo/mpeg-21-event-reporting

N6787 14.1.10 AHG on MPEG-21 DIAMandate: 1. Carry out Core Experiments on DIA and make recommendations to

modify and improve the MPEG-21 DIA AMD/1.2. Produce the Study of PDAM/1 by 2004/11/24.3. Produce an editors' input on Study of PDAM/1.4. Investigate possible issues in the existing MPEG-21 DIA

specification.5. Follow and maintain the MDS DIA reference software

implementation document, including tracking of the proposed deliveries of software to the Reference Software Web site.

Chairs Christian Timmerer (christian.timmerer_at_itec.uni-klu.ac.at)Thomas DeMartini (Thomas.DeMartini_at_CONTENTGUARD.COM)

Duration: Until the 71th Meeting.Meetings: AHG Meeting to be held on the weekend prior to 71 th meeting. Other business

will be conducted by e-mail or telephone conference.Reflector: mpeg21-uma_at_merl.comSubscribe: To subscribe send email to avetro_at_merl.com (Anthony Vetro).

NXXXX 14.1.11 AHG on MPEG-21 URI Fragment IDsMandates 1. Explore solutions for addressing fragments of ISO-based files

2. Investigate addressing of fragments of vector graphic images.3. Improve WD for 21000-174. Provide Reference Software for mp( )

Chair Myriam Amielh ([email protected])Co Chairs Gerrard Drury ([email protected])

YongJu Cho ([email protected])Duration Until the 71th MeetingMeetings Pre-meeting to be held in Hong-Kong prior to 71th meetingReflector [email protected]

Please use the prefix [medialoc]Subscribe Send email to [email protected]

72










6. MDS Schedule for the 70th MPEG meeting in Palma de Mallorca, ES

MPEG MDS Chair: Ian S Burnett MPEG-21 v.1.0

Number Source Title Monday Morning (9h00-13h00) MPEG Plenary Plenary room

Monday Afternoon (14h00-20h00)

Kick-off of MPEG MDS activities (14h00-14h30) Marte (MDS Room)

Agenda, Goals and Issues for the week for MDS Group Ian S Burnett

Review of AHG resolutions, CE results and action points (14h30-16h00) Marte (MDS Room)

11165 Simon Watt, AHG on MPEG-21 IPMP

11164

Myriam Amielh,Gerrard Drury,YongJu Cho, AHG on MPEG 21 Media Locators

11166

Christian Timmerer,Thomas DeMartini, AHG on MPEG-21 DIA

11167

Gerrard Drury,Frederik De Keukaleare ,Munchurl Kim, AHG on MPEG-21 DIP

11168 FX Nuttall,Andrew Tokmakoff, AHG on MPEG-21 Event Reporting

Define BoGs and Mandates (16h00-16h30) Marte (MDS Room)

REL, RDD, DID, DIA, DIP, ER, IPMP

BOG Room = Marte (IPMP), ER Saturno

MPEG-21 DIP (16h30 - 17h30) Marte (MDS Room)

11338Frederik De Keukelaere,Thomas DeMartini,Jeroen Bekaert,Rik Van de Walle,


11339Saar De Zutter,Frederik De Keukelaere,Rik Van de Walle, Proposal for DIP bootstrapping

Tuesday Morning (09h00-13h30) MPEG-21 IPMP & ER BoG (09h00- 19h00) Jupiter & Saturn

73

















MPEG-21 DID Comments (09h00 - 10h00)

DID Comments/Inputs (09h00 - 09h45) Marte (MDS Room)

11212 Shane Lauf,Gerrard Drury,Ian Burnett, Proposed extensible DIDL schema



11351 Watt,UKNB Comments on ISO/IEC FCD 21000-2 : Digital Item Declaration

11355 BNB,

Preliminary BNB comments on ISO/IEC 21000-2 2nd edition FCD

11430Myriam Amielh,Gerrard Drury ,Shane Lauf ,Ian Burnett, Preliminary comments of DID v.2 FCD

11213 Shane Lauf,Ian Burnett, Proposed IPMP DIDL schema

MPEG-21 DID Media Locators (10h00 - 10h15)

DID Media Locators (10h00 - 10h15) Marte (MDS Room)

11291 Myriam Amielh,Ernest Wan,

A Framework for MPEG URI fragment Identifiers

MPEG-21 RDD (12h00 - 12h30) ER (10h15 - 10h45) Marte (MDS Room)

11193 Niels Rump for the editors, Editors' Input towards CD of 21000-15

11296Kyunghee Ji,Youngjoo Song,Nammee Moon,Jaegon Kim,


11315Senator Jeong,Yeon-Jeong Jeong,Weon-Geun Oh,Ki-Song Yoon,


MPEG-21 with Reqts (10h45 - 11h30) Neptune (Reqts Room)

11249 Chris Barlas ,Niels Rump, MPEG-21 - Comatose or Just Sleeping?

MPEG-21 with Reqts/Audio etc(11h30 - 13h00) Neptune (Reqts Room)

11419 Wo Chang, MAF Photo Repository and Player

11288 Ian Burnett,Suggestion to create MPEG-A Part 4 – MPEG-21 Content Format (MCF)

11289 Ian Burnett, Requirements for Streaming Digital ItemsTuesday Afternoon (14h30-18h30) MPEG-21 REL s/w & s/w Inputs(14h30- 15h30) Marte (MDS Room)

11440 Satoshi Ito,Toru Kambayashi,


11270 Teemu Saarinen,Artur Lugmayr,




11189 Shane Lauf,Ian Burnett, Mobile MPEG-21 Peer Implementation

74




























mailto:S





MPEG-21 IPMP Inputs (15h30- 17h00) Marte (MDS Room)

11178Zhongyang Huang,Ming Ji,Shengmei Shen,Taka Senoh,Takafumi Ueno,


11179 Shane Lauf,Examination of technology in IPMP WD 1.0

11184 on behalf of the MPEG-21 IPMP AdHoc group.,


11221 Eva Rodriguez,Huang Zhongyang, IPMP Information Schema

11271 J. J. Chae,Jeho Nam,Jae-Gon Kim,


11348Hendry,Jeongyeon Lim,Qonita M. Shahab,Kyung-Ae Cha,Munchurl Kim,Keunsoo Park,


11349 Hendry ,Munchurl Kim ,Keunsoo Park,


MPEG-21 DIA Inputs(17h00- 18h00) Marte (MDS Room)



11262Christian Timmerer,Klaus Leopold,Dietmar Jannach,Hermann Hellwagner,Mariam Kimiaei, Report of CE on Conversion Parameters

11371Christian Timmerer,Joerg Heuer,Gabriel Panis,Hermann Hellwagner,Andreas Hutter,


11405Gabriel Panis,Christian Timmerer,Joerg Heuer,Debargha Mukherjee,Michael Ransburg,Ingo Wolf,Andreas Hutter,Hermann Hellwagner,


11218Hyuk-Min Kwon,Man-Bae Kim,Jeho Nam,Rin-Chul Kim,Hae-Kwang Kim,Seungji Yang,Truong Cong Thang,Yong Man Ro,


MPEG Social Event (19h30 - midnight) Wednesday Morning (09h00-13h30) MPEG Plenary (9h00-11h00) Plenary room MPEG-21 IPMP & ER BoG (11h00- 18h00) Jupiter & SaturnMPEG-21 Reqts Joint (11h30 - 12h30) Marte (MDS Room)

11220 FX Nuttall,MPEG 21 as a secure interoperable DRM ?



11239

José M. Martínez,Víctor Valdés,Luis Herranz,Jesús Bescós,

A Simple Profile for MPEG-21 DIA Usage Environment description tools

Wednesday 75


































Afternoon (14h30-19h00) MPEG-21 Systems Joint (14h00 - 14h30) SYSTEMS

11274 Itaru Kaneko ,Nobuyuki Kinoshita ,Spencer Cheng,


MPEG-21 MDS PLENARY/DISCUSSION (14h30 - 15h30) Marte (MDS Room)MPEG-21 with Reqts (15h30 - 16h30) Neptune (Reqts Room)

11249 Chris Barlas ,Niels Rump, MPEG-21 - Comatose or Just Sleeping?MPEG-21 Ref. SW & Conformance (16h30 - 17h30) with Integration - TBD Marte (MDS Room)



11261 Shane Lauf,Ian Burnett,

IPMP DIDL Reference Software Contribution

11336 Frederik De Keukelaere,Rik Van de Walle, Contribution to DID conformance





Thursday Morning (09h00-12h30) MPEG-21 IPMP & ER BoG (9h00- 16h00) Jupiter & SaturnMPEG-21 with Reqts/Audio etc(09h00 - 10h00) Neptune (Reqts Room)

11419 Wo Chang, MAF Photo Repository and Player

11288 Ian Burnett,Suggestion to create MPEG-A Part 4 – MPEG-21 Content Format (MCF)

11289 Ian Burnett, Requirements for Streaming Digital ItemsMPEG-21 DIP Status (10h15 - 11h00) Marte (MDS Room)MPEG-21 DIA Status (11h00 - 11h30) Marte (MDS Room) MPEG-21 ER Status (11h30 - 12h00) Marte (MDS Room)MPEG-21 with Reqts/Audio etc(12h00 - 13h00) Neptune (Reqts Room) Thursday Afternoon (14h30-19h00) MPEG-21 REL Status (14h30 - 15h00) Marte (MDS Room)

76

















MPEG-21 IPMP Status (15h00 - 16h00) Marte (MDS Room) Plenary MDS and Reports of BoG (16h00 - 17h00) Marte (MDS Room)Review of Output documents, AHGs, CEs, DoC, Std (17h00- 18h00) Marte (MDS Room) Friday Morning (09h00-13h00) Wrapping up (09h00 - 13h00) Marte (MDS Room)

Approval of resolutions, AHGs and Output documents

Friday Afternoon (14h00-21h00) MPEG Plenary Plenary roomContact: Ian S Burnett

77

Annex 8Report of Video meeting

Source: Jens-Rainer Ohm, Miroslaw Bober

IDCT in MPEG Standards

Recently, attention was brought to the fact that the ANSI/IEEE 1180 standard (DCT/IDCT implementation accuracy) had been withdrawn in 2003. As MPEG-1 and MPEG-2 Video, as well as MPEG-4 Visual take reference to this standard in terms of the required definition of IDCT precision, it is necessary to define an equivalent text in the framework of MPEG standards. It was therefore decided to request a sub-division of MPEG-1 and define a new part ISO/IEC 11172-6: Specification for Implementation of Inverse Discrete Cosine Transform. The CD was issued at the Palma meeting. (N6707/N6735). In a future meeting (most probably in January), corrigenda on 11172-2, 13818-2 and 14496-2 will be started to change references from ANSI/IEEE 1180 into 11172-6. An AHG was established to resolve the IDCT issue. In addition to the immediate replacement action, it will be explored if a new description of an IDCT (most probably non-normative, but different than what was

in IEEE 1180) needs to be developed in addition to the replacement of the IEEE description; and if yes,

to establish the requirements towards possibly issuing a call for contributions for the new IDCT description, to be issued at the January meeting, and develop the criteria to evaluate those contributions

If such an activity is started, it could later be amended to 11172-6.

Documents reviewed:

11224 Gary Sullivan IDCT Specification: A Problem and Opportunity

11225 A. G. Tescher for USNBUSNB Contribution: Replacement of IDCT Standard

11268 Peter Schirling, Joan L. Mitchell, Arianne T. Hinds, Nenad Rijavec A new way to look at IDCT


11172-6 MPEG-1 Implementation of IDCT 6707 Request for Sub-division of ISO/IEC 11172-6 No 04/10/22

6735 Text of ISO/IEC 11172-6 CD: Specification for Implementation of Inverse Discrete Cosine Transform

No 04/10/22

MPEG-4

New Levels in Visual Simple Profile

The FPDAM on the 'new levels in simple profile' amendment (FPDAM2) to MPEG-4 Visual (N6709 + N6708 DoC) was issued. Minor text modifications were made by request of the US NB. The conformance FPDAM10 was issued as well (N6742 + N6741 DoC). Conformance

78

streams were made available prior to the meeting, and will further be examined by the MPEG-4 Visual maintenance AHG.

Documents reviewed:

11446 SC 29 SecretariatSummary of Voting on ISO/IEC 14496-2:2004/PDAM 2

11447 SC 29 SecretariatSummary of Voting on ISO/IEC 14496-4:200X/PDAM 10

New Version of MPEG-4 Visual List of Problems Reported Version 14 of the document "MPEG-4 Visual List of Problems Reported" (N6710) was issued. One problem related to the text part (14496-2:2004) in the area of shape coding was added which was identified during the processing of new streams for the upcoming conformance corrigendum. This also is identified as a new bug in the software which will be fixed in the near future.

Documents reviewed:

11327 Yi-Shin Tung, Chung-Neng Wang, Tihao Chiang,Jens-Rainer Ohm

MPEG-4 Visual: List of Problems Reported, v.13.1

Conformance Corrigendum WD2.0

Two Draft Corrigenda on Visual bitstreams conformance were issued, one relating to the second (200X) edition (development status as of Visual version 2), and one relating to amendment 1 of the second edition (Studio and FGS profiles conformance). Many video conformance streams are presently removed by the DCORs, with exact reasons given in the appendix. As it is planned to have the ballot periods only ending after the Hongkong meeting, Study of DCOR documents will probably be issued in January to resolve all issues that will potentially be corrected until then. After approval of the COR (April 2005), profiles which would have lost conformance will be removed from 14496-2. After the corrigendum work will be finished, it is recommended by the Video Subgroup to produce a new edition of the conformance part of MPEG-4. To better maintain conformance and make it better usable, 14496-4 should clearly be structured into sub-parts (Video, Audio etc.) in this future edition. Documents reviewed:

11230 Yoshihisa Yamada, Shun-ichi Sekiguchi, Kohtaro Asai

Proposed corrections to visual part of MPEG-4 conformance text

11394 Herbert Thoma Test Bitstreams for Shape Coding

Software

The Video Subgroup recommends producing a new edition of 14496-5 in the near future. This could include all bug fixes done by the recent activities of the MPEG-4 maintenance AHG. To better maintain the software, 14496-5 should be structured into sub-parts (Video, Audio etc.) in this future edition

AVC

79

In Palma, a JVT meeting was held in parallel with the Video Subgroup. Main topics in MPEG-4 part 10 (AVC) were related to corrigendum issues (N6711), as well as conformance and software related to the Fidelity Range Extensions amendment. The video subgroup recommended approval of the JVT-related documents by MPEG.

Output documents related to MPEG-4 Video and AVC


14496-2 MPEG-4 Visual

6708 Disposition of Comments on ISO/IEC 14496-2:2004 PDAM2

No 04/10/22

6709 Text of ISO/IEC 14496-2:2004 FPDAM2 New Levels in Simple Profile

No 04/10/22

6710 MPEG-4 Visual: List of Problems Reported version 14.0 Yes 04/10/2214496-4 MPEG-4 Conformance

6738 Text of ISO/IEC 14496-4:200X DCOR1 Visual Bitstreams Conformance Corrigendum

No 04/11/30

6739 Text of ISO/IEC 14496-4:200X/Amd.1 DCOR1 Visual Bitstreams Conformance Corrigendum

No 04/11/30

6741 Disposition of Comments on ISO/IEC 14496-4:200X PDAM10

No 04/10/22

6742 Text of ISO/IEC 14496-4:200X FPDAM10 Conformance Extensions for New Levels of Visual Simple Profile

No 04/10/22

14496-10 MPEG-4 Advanced Video Coding 6711 Text of ISO/IEC 14496-10:2004/DCOR1 No 04/10/22

MPEG-7

MPEG-7 related work in Redmond

The MPEG-7 breakout group was active during the whole week. Input documents as reviewed are listed in the subsequent table.

11188 Akio Yamada Contribution to MPEG-7 Visual Conformance

11216 Akio Yamada Proposed Corrigendum item on ISO/IEC 15938-3:2002/Amd.1

11280 Soo-Jun Park, Myung Gil Jang

CE Report for Situation/View-based Photo Clustering Experiment (VCE-1, Cross Check)


GT set proposed for situation/view based photo clustering experiment (VCE-1, Cross Check)


Photo EXIF modification report on Ground Truth set of Situation/View based photo clustering CE (VCE-1, Cross Check)


GT set proposed for category based photo classification experiment (Cross Check)

11284 Soo-Jun Park, Myung Gil Jang Dataset of VCE-1 and VCE-2

11286 Soo-Jun Park,Min-Sung Ryu, Chee Sun Won

Proposal for a new CE: Query-by-ROI (region of interest)

80


CE Report for Image Categorisation into Classes (VCE-2, Cross Check)

11297Sang-Kyun Kim, Seungji Yang, Yong Man Ro, Ji-Yeun Kim

CE Report for Situation/View-based Photo Clustering Experiment (VCE-1)


GT set proposed for situation/view based photo clustering experiment (VCE-1)


Photo EXIF modification report on Ground Truth set of Situation/View based photo clustering CE (VCE-1)


A proposal of GT set determination where "Time" and "Visual" information conflict for Situation/View based photo clustering (VCE-1)


CE Report for Category-based Photo Clustering Experiment (VCE-2)


GT set proposed for category based photo classification experiment (VCE-2)


CE Report for Face-based Photo Clustering Experiment (VCE-3)


Photo contribution status for face-based photo clustering experiment (VCE-3)

11305 Sang-Kyun Kim, Sang Hyun Kim

Software cross-check result of Dominant Color Temperature experiment (VCE-4)

11308 Akio Yamada, Sang-Kyun Kim MPEG-7 Visual XM Document version 21.1

11309 Akio Yamada, Sang-Kyun Kim WD 2.1 of MPEG-7 New Visual Extensions

11324 Karol Wnukowicz, Wladyslaw Skarbek

Report on Dominant Color Temperature Descriptor CE (VCE-4)

11326 Karol Wnukowicz, Wladyslaw Skarbek

Extension of Dominant Color Temperature Descriptor by Spatial Coherency field

11342

Stephan Herrmann, Vasileios Mezaris, Haralambos Doulaverakis, Ioannis Kompatsiaris, Michael G. Strintzis

Improving the efficiency of a search and retrieval system using MPEG-7 Visual descriptors

11344

Vasileios Mezaris, Symeon Papadopoulos, Ioannis Kompatsiaris, Michael G. Strintzis

Preliminary image categorization results using Dominant Color and Edge Direction descriptors

11387 Robert O'Callaghan, Miroslaw Bober

Update of Results in Situation/View-Based Clustering (VCE-1)


Proposal on Ground Truth for Situation/View-Based Clustering (VCE-1)


Preliminary Results on Image Categorization (VCE-2)

11419 Wo Chang MAF Photo Repository81

11420 Wo Chang MAF Photo Player

11458 Krzysztof Kucharski, Wladyslaw Skarbek

Cross verification of the results in Situation/View-Based Clustering (VCE-1)

Work performed:- Core experiments- WD and XM- MAF- test materials collection- collection of ground truth for semantic clustering

Output documents related to MPEG-7 Visual


15938-3 MPEG-7 Visual6712 Text of ISO/IEC 15938-3/Amd.1 DCOR1 No 04/10/226713 WD 3.0 of MPEG-7 New Visual Extensions No 04/10/22

6714 MPEG-7 Visual XM Document version 22.0 No 04/10/226715 Description of Core Experiments for MPEG-7 New Visual

ExtensionsNo 04/10/22

MPEG-21

Scalable Video Coding Development Process

After the decision on the 21000-13 WD had been delayed by the last meeting, the process of SVC standardization has been clarified in detail. The document "Guidelines for the SVC CE Process and Elevation Procedure" (N6718) describes the process CE ® SVM ® WD. To establish a CE, a formal proposal is made which must be approved by the Video group. Verification by 2 independent parties is necessary in the CE, with independent software implementations written from scratch using a specification text. The Scalable Video model (SVM) has similar role as the VM in MPEG-4. It contains description of syntax, semantics, encoding and decoding processes of elements considered for later elevation into the WD. Unlike previous Core Experiments, only one consistent SVM reference software shall exist. In the whole process, each step shall provide description ready-to-add for the next step. To guarantee a stable standard, it is planned to define the WD 1.0 by the next meeting from the SVM defined in Palma. The decision of elevation into the SVM was made on the basis of CE 1 results as described below.

Core Experiment 1

It was decided by the Redmond meeting to conclude on technology elevation into the SVC standard mainly on the basis of results of Core Experiment 1. In terms of compression performance, this included cross-checked investigation of the previous "Munich" rate points, as well as additional rate points to investigate the performance for a scenario with finer granularity of scalability. A total of five different algorithm implementations was presented which fulfilled all formal delivery requirements (in particular, submission of bitstreams before determination of the random rate points). Conceptually, these algorithms can be clustered into AVC-based (respectively AVC-extended) solutions for bottom-up (layered) scalability, wavelet-based

82

solutions for top-down (embedded) scalability and hybrid (e.g. wavelet with AVC base layer) solutions. It was found that all algorithms equally fulfilled the general scalability requirements of CE 1. Further requirements (such as low delay, non-linear adaptation) were additionally tested in other CEs, but could likewise not be used as a differentiation criterion, as not being excluded by any of the algorithms. Therefore, the subjective evaluation became key factor. To establish a clear basis for algorithm performance under visual evaluation criteria, extensive experts viewing tests were performed jointly with the test group, which could be used to determine MOS-like performance measurements. The results are documented in the Report of the Subjective Quality Evaluation for SVC CE1 (N6736).In this, only one algorithm (proposed by FhG-HHI in M11245) showed consistently superior performance over all sequences and at all rate points. Even though, due to the lack of time, the visual evaluation was only performed for the 3-resolutions spatial scalability ("test 1" scenario), similar results were informally reported for the 2-resolutions spatial scalability ("test 2" scenario) in an input document (M11360). It was therefore decided to adopt this algorithm into the Scalable Video Model (SVM) 3.0 (N6716). The software which had previously been donated by FhG-HHI under usual MPEG licensing conditions will be used as the basis for the SVM implementation. The algorithm is an extension of AVC with an AVC-compatible base layer. It uses motion-compensated temporal filtering (MCTF) with adaptive prediction and update steps for efficient open-loop compression, a layered structure with "bottom-up" (switchable pyramid) prediction from lower layers. Only one decoder loop is necessary. FGS functionality is achieved as an extension of CABAC, bitstream scalability is possible at the level of NAL units.The other algorithms participating in the CE1 comparison were:- M11363 (Danae+Thomson): This algorithm extends from the Munich-Redmond CE1

"integrative" MSRA software, implementing spatial lowpass transition filters (SLTF), 3-step lifting filters, scalable encoding of motion vectors additionally. It is a "hybrid" solution with the Munich-Redmond CE2 (AVC-MCTF) codec as base layer, and could therefore also be made fully AVC base-layer compliant (only uses the decoded signal, no other information from base layer). Further results were shown with a low-delay implementation in CE 3.

- M11320 (MSRA): This algorithm also extends from the Munich-Redmond CE1 "integrative" MSRA software, implementing a spatial down/upsampling procedure to perform prediction from an AVC-compatible base layer. The signal fed into the base-layer encoder can be down-sampled by conventional filters or wavelet filters. For good FGS performance, R-D optimization information is conveyed with the bitstream (causes roughly 2% overhead). OBMC is used only on the Y component in the results presented for the visual tests.

- M11368 (University of Brescia): This algorithm is also developed from the MSRA software bases, but uses the "STool" an architecture for independent MCTF after 2D-DWT. For good compression performance, prediction residuals from the next-lower layer are encoded. STool is designed to avoid drift between the spatial layers in the MCTF process.

- M11441 (University of New South Wales): Based on the software provided by UNSW, this is a fully embedded wavelet codec with JPEG2000 compliant code syntax. To avoid drift, it uses "safe MC" with an up-/downsampling procedure where the MCTF process is build only on the scaled information available at the respective spatial resolution (conceptionally similar to overcomplete DWT approaches). No multiple decoder loops are used, but the memory overhead is 1 1/3 maximum. OBMC with 1 pixel overlap is used. Block-wise MC is similar (down to 4x4 pixels) as in other algorithms proposed. 16 bit integer implementation is possible.

One algorithm submitted to CE1 (M11277 by Samsung) was not considered due to late submission. This is a combination of AVC and Wavelet layers. Interleaving of AVC and wavelet layers is used at each spatial/temporal resolution. Intra prediction and SHTF are implemented. An adaptive spatial transform is used (9/7 or Haar filters). Multi-layer motion scalability is employed. The algorithm is implemented on top of HHI software (as provided for previous CE 2).

83

Properties and complexity of the different algorithms were roughly assessed as listed in the subsequent table:

HHI MSRA DANAE BRESCIA UNSWMCTF Yes Yes Yes Yes Yes1 MCTF per spatial layer

yes No no Yes Yes

Interlayer Prediction Intra + inter (single loop)

Intra + inter (based on reconstructed BL)

Intra+ inter (based on reconstructed BL)

Based on inverse entropy coding + some levels of IDWT

Blending from the higher layers

Accuracy ¼ pel 1/4pel ¼ pel 1/4pel 1/8 pelScalable MV Yes, spatially

predicted MVs

??? Yes, motion-accuracy scalability (SNR)

No Yes, spatial and SNR (multi-resolution)

# Decoder Loops Single MC to decode a layer

One at BLOne in enhancement-layer at target frame rate

1 loop per resolution (note above, no full decoding)

1 MCTF per resolution

Interpolation filter 6-tap for ½ pel + 2-tap bineair (Conforming to AVC)

8-tap windowed sinc

8-tap windowed sinc

8-tap windowed sinc

7-tap windowed spline (update)11-tap in-band (predict)

Updampling/downsampling filtering

6-tap ½ pel filter of AVC

9/7 filter 9/7 & 3-step lifting

9/7 & 3 step on single level

9/7

OBMCTF No Yes?? Yes (SHTF, SLTF)

Yes?? Yes, limited

Base layer Yes Yes?? HHI No NoBase layer feedback into MCTF

Yes Yes(upsampled reconstructed)

Yes(upsampled reconstructed)

no no

Spatial Transform Integer transform (conforming to AVC) – 4x4 and 8x8

DWT(AVC Base)

DWT(AVC base)

DWT DWT (JPEG 2000), integer-based

SNR scalability/bitplanes

Bitplane-like Bitplanes Bitplanes Bitplanes Bitplanes

Entropy Decoder CABAC with some new contexts (conforming to AVC)

3D EBCOT (more than EBCOT)

3D EBCOT(more than EBCOT)

3D-EBCOT & EMDC (Embedded morphological dilation coding)

18 binary contexts; MQ coder20 context for MVs; MQ

Delay 2.5s, low delay demonstrated

2.5s 2.5s, low delay demonstrated

2.5s 2.5s

CE 2-7 and other technical input:

84

CE2-7 results showed additional properties of algorithms under test in CE1, as well as other details of technology development. CE2 investigated fully-conformant AVC base layer solutions. CE3 explored the tradeoffs of low-delay functionality; in principle results imply that this is possible with acceptable degree of coding efficiency loss (10 % loss were reported when encoding delay is constrained to 150 ms, where however the definition of overall delay is required to be updated in the next round of CE). CE4 investigated improvements of the MCTF "update step", CE5 improvements of spatial scalability, CE6 improvements of SNR scalability and FGS. CE7 was dedicated to explore non-linear adaptation (capability of different "traces" for multiple adaptations with 1 dB coding efficiency loss was reported). For CE8 (Error resiliency and robustness) no results were reported.

More detailed presentation were made on the following input contributions: M11434: DANAE+Thomson algorithm under low-delay constraint (ENST). Skip forward

part of either prediction or update operator. Is only encoding or decoding delay of 150 ms. Effective delay may be 233 ms. Loss corresponds to less than 10% of data rate. Not fully satisfying the CE conditions.

M11385: DANAE+Thomson algorithm, SLTF component (RWTH). Shows PSNR losses as compared to EDU and no application of de-blocking. Visual results better in some cases, but not fully consistent yet. Complexity increased (number of hypotheses).

M11245: AVC-compatible base layer (HHI). Uses AVC-compliant UMCTF for the base (no update, no 8x8 transform). Results show sometimes decrease, sometimes increase over AVC base layer. Compared to AVC IPPPP.. this also sometimes increases and sometimes decreases performance.

M11246: Low-delay (HHI). Structure of "frame groups" with no update steps beyond boundaries. Not AVC compatibility. Loss of up to 1 dB for 150 ms (effective delay considering infinite processing power), depending on sequence. Is open loop in general, but a closed loop is run at the LLL.. frames. No modification of quantizers, may lead to more quality deviations.

M11247: Adaptive update (HHI). Nonlinear function dependent on energy that is derived during the derivation process of update motion vectors. Slight increase of PSNR, removes artifacts in cases of strong motion, e.g. football.

M11277: Combination of AVC and Wavelet layers (Samsung). Uses interleaving at each spatial/temporal resolution. Uses intra prediction and SHTF. Adaptive transform (9/7 or Haar). Multi-layer motion scalability. Implemented on HHI software. In some cases (City) PSNR improvement, but no visual difference. Soccer and Crew are worse. Performed visual tests. City slightly better, Harbour similar, Crew worse, Soccer similar to HHI uploads. For scenario 2, usually worse performance. Usually causes problems at lowest wavelet layer.

M11401: Directional intra blocks (RPI). Allows to do MC in a sub-section of an MB, and directional interpolation in another part. Only small PSNR improvement, no visual effect either.

M11328: DANAE+Thomson algorithm, Three-step lifting filters component (INRIA). Three encoding strategies: Use 3LS instead of MPEG-4 downsampling to generate the AVC base layer, use 3LS on both sides, use 3LS only for up-sampling. Has lowpass transition roughly between MPEG and 9/7 filters. Improvements at mid resolution where 3LS is used for 4CIF®CIF downsampling, no improvement for scenario 2. Corresponding length 29/40

M11365: tradeoff motion/texture (Siemens). Gives some improvement at low data rates, but results not complete yet.

M11248: Multiple non-linear adaptations (HHI). First approach "dead end" which is multiplexing of streams; second approach "multiple base layers" which gives better coding efficiency. In general, worse than the linear adaptation, mostly at the highest rate points (up to 1 dB). Tradeoff between motion and texture data has to be observed for more points - change of motion information changes residuals.

85

M11457: Reduced QCIF bit rate (Samsung). Shows tradeoff between quality at lower and higher layers (all higher rate points can be improved when the highest QCIF rate is improved). Layer-mixing technique: Partial down-sampling without changing the bitstream, only operation of extractor and decoder. Not allowing complexity scalability.

M11398: Improvements of CE1 (HHI). Problem: Block artifacts in highpass frames interfere with upsampling filters. Gives improvement mostly for Crew and Foreman, City gives up to 1 dB improvement.

M11399: Bit-rate underflow for highest QCIF rates was detected. Proposal to use test conditions with other range of rates without rate overlap, which would give more reasonable results for combined scalability.

M11427: FGS subband enhancements (Nokia). Take base layer information into account when selecting contexts. zero/nonzero base used as context selector for the FGS significance map. Relates also to AVC-characteristic rounding offset, e.g. sign is not necessarily guaranteed. Define a "coded region flag" to reduce the number of zeros. Define "spatial contexts" with coefficients from neighboring frequencies. Gives roughly ½ dB improvement over first HHI FGS implementation, in some sequences comes close to WGS case. In particular effective with MCTF base layer. Not clear how large the gain over present implementation is, may be additive gain.

M11428: FGS block enhancements (Nokia). Compromise between block-based (Poznan) and subband based (HHI) approaches. "Cyclical block coding" distributes loss over all macroblocks of one frame. "coded block flag" skips a bitplane of entire block.

M11418 (CE6 Univ. Poznan). SNR scalability using data partitioning, implemented in HHI software. Granularity is one macroblock. Spiral scan starting from center of image. Only subjective assessment possible: Works well in cases where people look at the center, e.g. City; worse on Crew where relevant content may appear all over the image.

M11187: Region of interest which could be at any place of the scene to decide about truncation of motion and texture information. Depending on amount of motion, at higher rates up to 2 dB SNR gain over HHI software (visibility?). Two encoder MC loops, but only one decoder loop.

M11234 (NTT). Proposes lossless enhancement in case of 4x4 transform. Bitplane coding not viable, because coefficient space is much coarser than image space. Uses restrictions of possible coefficient configurations even/odd, dividable by 10 etc. Compared to J2K and FRExt lossless variation (turning transform off). Intra coding comparable to J2K, 5% better than FRext (generally roughly ½ compression). Inter case 14% worse than FRExt; usually roughly ¼ to 1/3 compression. Question was raised where fine granularity is needed in applications between "visually lossless" and "lossless".

M11235 (NTT). Look up solution for general problem: how many bits are needed for low layer; how can bits be re-allocated between low layer and high layer? Experiment performed on 2-layer TS in CIF resolution; ESCOT used at each layer. Results presented averaging low/high layer PSNR for different re-allocation ratio. In principle, add an FGS layer for the low MCTF band

M11236 (Univ. Brussels on error resilience). UMCTF, Haar or 5/3 filtering; no intra blocks, no scalable motion; MDC, but here embedded MDC scalar quantizers, equivalent to usual J2K embedded quant.; as usually in MDC, redundancy is introduced, possible to adapt the amount of redundancy. Use configurations with up to 4 descriptions. Less quality in lossless case, but improves when channel losses are getting higher. Question raised: how does it compare to present SVC algorithms (e.g. from CE1)

M11241 (complexity scalability, Thomson). Purpose: decoders of different complexity level (both at low and high layer). "Reduced resolution update" proposed to AVC for improved coding performance: residue is downsampled before transformation step: has coding advantage at low to medium bitrates, in particular at low to medium rates. RRU bitstream could be used as lower-layer bitstream, motion vectors in base layer, but needs to be down-scaled. Has certain amount of drift, but not too serious; example: Spatial scalability with two

86

layers; EI, EP pictures. Intra blocks encoded at full resolution. Decoder similarity with the Redmond HHI proposal, but do not use update step. Encoder different, as mode decisions are made at high resolutions; this causes drift at the low resolution. This approach of complexity scalability leads to PSNR loss in particular at higher rates, but visually not that much distinguishable; for the lower resolution, gives slightly higher detail, but this has higher bitrate.

The following set of Core Experiments in SVC were newly defined (N6719): CE1: Low-delay constraints CE2: Coding efficiency in fine-granular SNR scalability CE3: Inter-layer prediction for motion and residual CE4: Complexity scalability CE5: Scan modes

Applications and Requirements of SVC

A breakout group was active during the week to discuss further improvements of the Applications and Requirements of SVC document (N6730). In particular, linking of applications with specific requirements was performed, and clustering of applications and application domains was started. It is expected that these improvements will be helpful in future CE evaluations, and also with regard to SVC profile definitions to be developed later. Therefore further discussion and development of applications-and-requirements related criteria will remain in the mandate of the CE AHG.Documents reviewed:

a) General

11331 Jens-Rainer Ohm Draft Guidelines for the SVC CE Process and Elevation Procedure

11267 Paul Jessop Comments on 'Software Copyright Licencing (sic) Disclaimer for MPEG Standards'

11463 Andreas Hutter on behalf of the GNB

GNB Comment on proposed new SW Copyright disclaimer for MPEG reference software

b) Core Experiments

CE1

11333 Vittorio Baroncini, Thiow Keng Tan, Tobias Oelbaum Suggested Test Method for SVC CE Visual Tests

11372

Edouard Francois, Vincent Bottreau, Jean Charles Gicquel, Mathias Wien, Jerome Vieron

Discussion on evaluation criteria for experts viewing tests in SVC CE1

11360Jean-Charles Gicquel, Stéphane Pateux, Isabelle Amonou, Sylvain Kervadec

Subjective evaluation of CE1 results

11243 Marco Boltz SVC CE1 - Bosch verification of HHI results for medium grain and combined scalability

11244

Heiko Schwarz, Tobias Hinz, Heiner Kirchhoffer, Detlev Marpe, Thomas Wiegand


87

11275 Woo-Jin Han SVC CE1 - Samsung verification of Univ. of Brescia (System I and II)

11320 Ruiqin Xiong, Xiangyang Ji. Jizheng Xu, Feng Wu MSRA scheme for SVC CE1

11321 Ruiqin Xiong, Jizheng Xu Cross-Verification of DANAE+Thomson results on SVC CE1

11363

Vincent Bottreau, Edouard Francois, Stephane Pateux Benoit Timmerman, M. Wien

Technical description of the DANAE+Thomson proposal for SVC CE1

11364

Vincent Bottreau, Edouard Francois, Stephane Pateux,Benoit Timmerman, M. Wien

SVC CE1: DANAE+Thomson verification of MSRA contribution

11368

Nicola Adami, Michele Brescianini, Riccardo Leonardi, Alberto Signoroni

SVC CE1: STool - a native spatially scalable approach to SVC

11437 Marco Tagliasacchi

Cross-verification of UNSW proposal for SVC CE1

11441David Taubman, Reji Mathew, Davide Maestroni, Stefano Tubaro

SVC Core Experiment 1, Description of UNSW Contribution

CEs 2-8

11245Heiko Schwarz, Tobias Hinz, Detlev Marpe, Thomas Wiegand


11426 Justin Ridge, Yiliang Bao, Yilong Liu Verification of SVC CE2 contribution for HHI

11237 Hongkai Xiong, Chen Wang, Li Song, Feng Wu

CE Verification Report of HHI on CE2.3: Adaptive Block Transforms

11329 Francesco Ziliani Coordinator's report on SVC's CE3: Low Delay

11343 Gregoire Pau, Beatrice Pesquet-Popescu

Response to the SVC CE-3 on coding efficiency with low-delay constraints

11246Heiko Schwarz, Jikun Shen, Detlev Marpe, Thomas Wiegand


11386 Konstantin Hanke SVC CE3 - Verification of ENST results11294 Diego Santa-Cruz Verification of results for SVC on CE3: Low Delay

11223 Joohee Kim, Hyeyeon Kim, Doohyun Kim Responses to CE4 in SVC

11247Heiko Schwarz, Heiner Kirchhoffer, Detlev Marpe, Thomas Wiegand


11385 Konstantin Hanke Response to SVC CE4 - Spatial Lowpass Transition Filtering

11401 Yongjun Wu, John W. Woods Directional Intra-prediction for CE4

11257 Heiner Kirchhoffer, Heiko Schwarz

Verification of the Samsung AIT proposal for SVC CE4

11318 Maria Trocan, Gregoire Cross-Verification of RWTH Results on SVC CE-488

Pau, Beatrice Pesquet-Popescu

11352 Mathias Wien SVC CE4: RWTH Verification of HHI contribution11359 Leszek Cieplinski Cross-verification of RPI results on SVC CE-4

11397 Heiko Schwarz Coordinators report on SVC CE5: Spatial Scalability

11328Vincent Bottreau, Christine Guillemot, Rashid Ansari, Edouard François

SVC CE5 - Precise Description of IRISA Proposal

11365 Benoit Timmerman, Peter Amon, Andreas Hutter

Response to SVC CE5 - Optimization of tradeoff between motion information and texture

11367 Benoit Timmerman, Peter Amon SVC CE5 - Verification of IRISA results

11424 Justin Ridge SVC CE6 co-ordinator report

11418 Lukas Blaszak, Marek Domanski, Rafal Lange

SVC CE6 results at Poznan University of Technology

11248Heiko Schwarz, Karsten Sühring, Detlev Marpe, Thomas Wiegand


11242 Marco Boltz SVC CE7 - Non-linear adaptation results from Bosch and verification of HHI results

11258 Julien Reichel, Francesco Ziliani, Diego Santa Cruz SVC CE7: Verification of HHI results

11457 Woo-Jin Han, Bae-Keun Lee

Performance analysis of reduced QCIF bit-rates in SVC CE1 based on HHI software

c) Technical inputRelated to CE

11277 Woo-Jin Han, Bae-Keun Lee

Technical description of Samsung proposal for SVC CE1

11285 Won Ha Kim, Seyoon Jung Verfication of SAMSUNG SVC software for CE1

11398Heiko Schwarz, Tobias Hinz, Detlev Marpe, Thomas Wiegand

Further improvements of the HHI proposal for SVC CE1

11399 Heiko Schwarz, Detlev Marpe, Thomas Wiegand

Further results for the HHI proposal on combined scalability

11427Justin Ridge, Yiliang Bao, Marta Karczewicz, Xianglin Wang

FGS subband enhancements for scalable video coding

11428Justin Ridge, Yiliang Bao, Marta Karczewicz, Xianglin Wang

FGS block enhancements for scalable video coding

Other

11187

Zhengguo Li, Xiaokang Yang, Kengpang Lim, Xiao Lin, Susanto Rahardja, Feng Pan

Customer Oriented Scalable Video Coding

11214 Truong Nguyen, Min Li New spatial transform in SVC11234 Seishi Takamura, Bandoh

Yukihiro, Yoshiyuki Proposal of SNR Scalability Method with up to Lossless Enhancement

89

Yashima

11235Yukihiro Bandoh, Seishi Takamura, Yoshiyuki Yashima

Proposal of inter-band bit re-allocation for SVC

11236

Fabio Verdicchio, Adrian Munteanu, Augustin Gavrilescu, Jan Cornelis, Peter Schelkens

Resilience in Scalable Video Coding using Embedded Multiple Description Scalar Quantization

11241 Peng Yin, Jill Boyce, Purvin Pandit Complexity Scalable Video Codec

11311Lee Men Huang, Shen Sheng Mei, Yoshimasa Honda

MCTF-based Scalable Video Coding in Low Delay Mode

11378

Nicola Adami, Michele Brescianini, Riccardo Leonardi, Alberto Signoroni

Fully embedded entropy coding with arbitrary multiple adaptation capabilities

11391 Markus Beermann, Mathias Wien

Quality-adaptive reconstruction-filtering - first results

Output documents related to MPEG-21 SVC


21000-13 Scalable Video Coding6716 Scalable Video Model Version 3.0 No 04/11/086717 SVM 3.0 Software No 04/11/08

6718 Guidelines for the SVC CE Process and Elevation Procedure

No 04/10/22

6719 Description of Core Experiments in MPEG-21 Scalable Video Coding

No 04/10/29

6736 Report of the Subjective Quality Evaluation for SVC CE1 No 04/10/226830 Applications and Requirements of Scalable Video Coding No 04/10/22

Explorations

3D AV Coding

As originally planned, the Call for Evidence on multi-view video coding (N6720) was issued at the Palma meeting, with responses expected in January. Beforehand, concerns had been raised that the test sequences presently available have been captured without recording the camera parameters. These would be necessary to achieve perfect rectification (to simplify encoding) and view interpolation. It was mentioned that some test sequences obviously also have misalignments in color between the different camerasThe CfE was not delayed nevertheless, because (according to the discussion of the breakout group Arguments for increased coding efficiency by doing rectification not fully evident at the

moment Proposals may or may not use camera parameters, rectification & color normalizationFor the CfE, it is therefore considered sufficient to use non-rectified, non-normalized sequences as input. For a possible subsequent CfP, more test sequences would be needed, including exact

90

specification of camera parameters. For the CfE, the sequence "objects1" which has strongest color artifacts was removed from the test set. To obtain new test materials, a request for more test material is made. The formats and required camera parameters are described in the document "Requirements on Test Material for Multi-view Video Coding Experiments" (N6721).The testing methodology in the CfE must be based on experts viewing similar to the SVC experience. As algorithms may use rectification, PSNR measurements versus original sequences would be useless. In such cases PSNR measured between "original rectified" and "decoded rectified" sequences should be provided as additional information to investigate the performance of proposals, e.g. in terms of constant reconstruction quality for different views. The technical input was reviewed as described in the AHG report. Contributions related to "Free Viewpoint Television" were considered useful to better specify the applications in the Applications and Requirements document. This includes description on more specific FTV systems, architectures and requirements. An update of the requirements documents was made including examples of system architectures. Separation into video-related and systems-related requirements is made, and the requirement to support camera parameters is included. This document "Requirements of Multi-View Video Coding" (N6834) is also referenced by the CfEDocuments reviewed:

11231 Hideaki Kimata, Masaki Kitahara

Anchor bitstreams for preliminary Call for Evidence on multi-view video coding

11232 Hideaki Kimata, Masaki Kitahara

Framework on free-viewpoint video with shared memory video coding

11238 Eddie Cooke Multiple Image View Synthesis for Virtual Viewpoint Rendering (S)

11240

Aljoscha Smolic, Karsten Mueller, Philipp Merkle, Matthias Kautzner, Thomas Wiegand

Predictive Compression of Dynamic 3D Meshes (S)

11259 Masayuki Tanimoto Free Viewpoint Television - FTV

11266 Yung-Lyul Lee, Woo-chul Sung Multi-view video coding using 2D direct mode

11278

Yoon, Sung-Yeol Kim, Daehee Kim, Sukhee Cho, Kugjin Yun, Chunghyun Ahn, Sooin Lee

Multi-view Video Coding using Layered Depth Image

11279

Yoon, Sung-Yeol Kim, Daehee Kim, Sukhee Cho, Kugjin Yun, Chunghyun Ahn, Sooin Lee

Coding of Layered Depth Image using Coherency between Point Samples

11292

Sukhee Cho, Daehee Kim, Kugjin Yun, Chunghyun Ahn, Soo In Lee, Yongtae Kim, Kawnghoon Sohn

Multi-view video coding using image stitching

11350Kazumasa Yamazawa, Hideaki Kimata, Hitoshi Habe

Proposal for MPEG-A of omni-directional video (R)

11434Anthony Vetro, Hanspeter Pfister, Wojciech Matusik, Jun Xin

Comments on Draft Call or Evidence on Multi-View Video Coding

11435Wojciech Matusik, Hanspeter Pfister, Tim Weyrich, Anthony Vetro

Calibration and Rectification Procedures for Multi-Camera Systems

11436 Jun Xin, Anthony Vetro, Preliminary studies on view interpolation for multi-

91

Hanspeter Pfister, Wojciech Matusik view video coding

Video Coding Tools Repository

Several breakout meetings were held to discuss VCTR matters during the MPEG week. Three contributions are reviewed. In addition to an update of the previous Study document, most work was contributed to the development of a precise description of the intra coding tool from MPEG-4 Visual Simple Profile according to the VCTR principles. The following functional units are defined: Parsing/Decoding FUs

o Variable length decoding (VLD) unit o Runlength decoding (RLD) unit o Macroblock generator (MBG) unit

MB-based FUso DC Reconstructor (DCR) unit o Inverse scan (IS) unit o Inverse AC prediction (IAP) unit o Inverse quantization (IQ) unit o Inverse transform (IT) unit

The inter-relationships with the global control unit are also precisely described. Details on VCTR can be found in Study 2.0 document (N6723). The specification of Simple Profile intra coding tool in terms of the VCTR concepts is contained in N6724. This could also be interpreted as an alternative (hardware/software independent, not C-syntax like) description of an MPEG-4 Visual tool.

Documents reviewed:

11295Yoshihisa Yamada, Kazuo Sugimoto, Kohtaro Asai, Tokumichi Murakami

Coding performance of Intra-only coding in AVC High Profile

11319 Kohtaro Asai Intra coding tools for AVC High Profile

11322

Euee S. Jang, Sunyoung Lee, JongWoo Won, Sungwon Park, YongHo Cho, YoungRyul Lee

Hanyang/Humax Contribution to VCTR

Wavelet Video Coding

It was discussed that results of SVC CE1 and other technical input shows further development potential of motion-compensated wavelet solutions, which may however not perfectly fit with the Scalable Video Model framework presently under development, and may also not converge with this in the near future. It was therefore decided to establish an AHG with mandates1. To explore further technical progress in the field of motion-compensated wavelet video coding under consistent evaluation criteria2. To study the relationship between wavelet technology and the emerging Scalable Video Model (SVM)

Workshop on Future Directions of Video Compression

Potentially, new video technology is developing outside MPEG (industry and academia) that may e.g. be interesting

92

To identify future application domains To identify newly developing approaches of video compression technology To identify whether our traditional standardization paradigms still hold It was therefore decided to establish an AHG which has the mandates to gather information and prepare a workshop on future video compression technology, to be held co-located with a future WG11 meeting.Output documents related to Explorations


3D AV6720 Call for Evidence on Multi-View Video Coding Yes 04/10/226721 Requirements on Test Material for Multi-view Video

Coding ExperimentsYes 04/10/22

6834 Requirements of Multi-View Video Coding Yes 04/10/22Video Coding Tools Repository

6722 Study of Video Coding Tools Repository V2.0 No 04/10/226723 VCTR Textual Description V1.0 No 04/10/25

AHGs established by the Video Subgroup

No. Title Mtg6724 AHG on Video IDCT Specification Y6725 AHG on Maintenance of MPEG-4 Visual related Documents, Reference

Software and ConformanceN

6726 AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software

N

6727 AHG on Description Tools for MPEG-7 New Visual Extensions Y6728 AHG on Core Experiments in Scalable Video Coding Y6729 AHG on Scalable Video Model and SVM Software N6730 AHG on 3DAV Coding Y6731 AHG on Video Coding Tools Repository Y6732 AHG on further Exploration in Wavelet Video Coding Y6733 AHG on Organization of a Workshop on Future Directions in Video

CompressionY

93

Annex 9Report of Audio meeting

Source: S. Quackenbush, Chair, Audio Subgroup

1 OPENING OF THE MEETING..........................................................................................................32 ADMINISTRATIVE MATTERS.........................................................................................................32.1 Approval of previous meeting report........................................................................................................ 32.2 Approval of agenda and allocation of contributions................................................................................32.3 Communications from the Chair.............................................................................................................. 32.4 Joint meetings............................................................................................................................................ 32.5 Received National Body Comments and Liaison matters........................................................................32.6 Task Groups.............................................................................................................................................. 33 AHG MEETINGS.............................................................................................................................. 33.1 Synthetic Music Representation (Sunday 0900 – 1800)............................................................................43.2 MPEG-4 Lossless Coding (Sunday 0900-1100).........................................................................................43.3 Spatial Audio Coding (Sunday 1100-1600)...............................................................................................43.4 Scalable Speech and Music Coding (Sunday 1600-1800)..........................................................................64 AUDIO PLENARY, JOINT MEETING AND TASK GROUP ACTIVITIES..........................................74.1 Review of AHG reports............................................................................................................................. 74.2 Received national body comments and liaison matters............................................................................74.3 Audio plenary discussions......................................................................................................................... 7

4.3.1 Proposed change to MPEG-2 AAC Corrigendum text..............................................................................74.3.2 Proposed profile HE-AAC Version 2.......................................................................................................74.3.3 Spatial Audio Coding.............................................................................................................................. 74.3.4 MPEG Audio Coders............................................................................................................................... 7

4.4 Joint Meetings........................................................................................................................................... 84.4.1 MAF and MPEG-21: MPEG-A Part 4 (Tue 1130-1300)...........................................................................84.4.2 Requirements at Audio on new audio profile, CfI on Scalable Coding / use cases....................................84.4.3 Timestamps and Backward-compatible Audio Decoders..........................................................................9

4.5 Task Group discussions............................................................................................................................. 94.5.1 MPEG-4 Audio Issues............................................................................................................................. 94.5.2 Lossless Coding....................................................................................................................................... 94.5.3 MPEG-7................................................................................................................................................ 114.5.4 Spatial Audio Coding............................................................................................................................ 114.5.5 Symbolic Music Representation.............................................................................................................114.5.6 Scalable Speech and Music Coding.......................................................................................................12

5 MEETING DELIVERABLES...........................................................................................................125.1 Press statement........................................................................................................................................ 125.2 Dispositions of Comments....................................................................................................................... 125.3 Responses to Liaison and NB comments.................................................................................................125.4 Recommendations for final plenary........................................................................................................125.5 Establishment of Ad-hoc Groups............................................................................................................ 125.6 Approval of output documents................................................................................................................ 126 FUTURE ACTIVITIES.................................................................................................................... 126.1 Schedule of future meetings.................................................................................................................... 126.2 Agenda for next meeting......................................................................................................................... 126.3 All other business..................................................................................................................................... 136.4 Closing of the meeting............................................................................................................................. 13ANNEX A PARTICIPANTS...............................................................................................................14LIST OF SYMBOLIC MUSIC REPRESENTATION PARTICIPANTS.....................................................16ANNEX B AUDIO CONTRIBUTIONS AND SCHEDULE...................................................................17ANNEX C TASK GROUPS...............................................................................................................22ANNEX D OUTPUT DOCUMENTS...................................................................................................23

94

Annex E Agenda for the 71st MPEG Audio Meeting........................................................................24

95

Opening of the meetingThe MPEG Audio Subgroup meeting was held during the 70th meeting of WG11, October 18-22, 2004 in Palma de Mallorca, ES. The list of participants is given in Annex B.

Administrative matters

Approval of previous meeting reportThe 69th Audio Subgroup meeting report had been previously distributed by e-mail and was approved.

Approval of agenda and allocation of contributionsThe agenda and schedule for the meeting was discussed, edited and approved. It shows the documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary. The Chair brought relevant documents from Requirements, Systems and MDS to the attention of the group. It was revised in the course of the week to reflect the progress of the meeting, and the final version is shown in Annex C.

Communications from the ChairThe Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary.

Joint meetingsThe joint meetings with Audio over the course of the week are listed here and are reported on below.

Groups What Where Day TimeRequirements, Systems, Video, Audio

MPEG-A(incl DRM functionality for MPEG-A)

Req Tue 1130-1300

Requirements, Audio

New audio profile, CfI on Scalable Coding and use cases

Audio Tue 1630-1730

Systems, Audio Timestamps and Backward-compatible Audio Decoders

Audio Tue 1730-1830

Requirements, Systems, Video, Audio

MPEG-A MPEG-21 Zeus Wed 1400-1500

Received National Body Comments and Liaison mattersThe NB Comments and Liaison documents for the meeting that require a response are as shown below.No. Title Response by11226 USNB Contribution: Issues for audio lossless coding S. R. Quackenbush11227 USNB Contribution: Fine-grain scalable audio codec S. R. Quackenbush11228 USNB Contribution: Preliminary comments on 14496-

3:2001/PDAM 4 and 5S. R. Quackenbush

11316 KNB comments on MPEG-4 BSAC multi-channel S. W. Kim

Task GroupsTask groups were convened for the duration of the MPEG meeting, as shown in Annex D Results of task group activities are reported below.

AhG meetings

96

In order to obtain a compete view of the business of this MPEG meeting, discussion of contributions in AhG meetings are recorded in this section of the Audio report.

Synthetic Music Representation (Sunday 0900 – 1800)Paulo Nesi and Giorgio Zoia chaired this meeting. The group activity was divided in three separate “sessions.” The first part of the morning was dedicated to two input presentations.Hartmut Ring and Hartmut Lemmel from Capella, Germany, made first two presentations on how and in which terms the CapXML format can meet or not, in its actual status, the major CfP requirements and implement some of the Test Cases under discussion.Giuseppe Nicotra from Arca, Italy, presented some issues and typical test cases for the representation of music through Braille; a short discussion followed after which it was decided to reintroduce one Test Case for Braille. Giuseppe Nicotra and Neil McKenzie was charged to propose this test case during the week.The second part of the morning was dedicated to the finalization of the table of weights for the evaluation process. The process has been carried on without remarkable problems; consensus was reached item by item either in unanimous way or by acceptance of voting results at majority. A few aspects being alternative to other ones and with the same weight were firstly considered for removal and after some discussion assigned to a low weight. Thus the identified aspects in the evaluation model have been maintained in the model, and weights have been finalized. Then the evaluation model has been finalized. The final session in the afternoon was dedicated to progress on the set of Test Cases for the different Requirements and Aspects. Like for the morning session, consensus was reached item by item and a relevant set of Test Cases to be retained as final has been selected.

MPEG-4 Lossless Coding (Sunday 0900-1100)Tillman Liebchen, TUB, chaired this meeting. He opened the meeting by presenting the draft AHG report. Tillman Liebchen, TUB, presented m11347, CE8 on multichannel compression. 11314 Noboru Harada, Takehiro

MoriyaProposal of CE for improved floating-point compression using ACFC (Approximate-Common-Factor Coding) in ALS (Audio Lossless Coding)

This CE produces modest improvement in performance, but with almost no increase in decoder complexity. He anticipates that this technology will be in a distinct profile.Noboru Harada, NTT, presented m11314.11314 Noboru Harada, Takehiro

MoriyaProposal of CE for improved floating-point compression using ACFC (Approximate-Common-Factor Coding) in ALS (Audio Lossless Coding)

This document proposes using approximate common factor coding as a means of improving compression of IEEE floating-point data. This imposes significant complexity on the encoder, but almost no additional complexity on the decoder. Rongshan Yu, I2R, presented m11382. This proposes a Core Experiment on a new predictor in the ALS architecture. 11382 Dong-Yan Huang, Haibin

Huang, Rongshan Yu, Xiao Lin, Susanto Rahardja


The predictor is backward-adaptive, such that no side information is transmitted for the predictor coefficients. Furthermore, the predictor is constructed as the cascade of four stages of either RLS or LMS adaptive FIR filters.Schuyler Quackenbush, Audio Research Labs, presented m11395.

97




















11395 S. R. Quackenbush Cross-check on ALS Core ExperimentThis document is a crosscheck on I2R m11382. All aspects of the I2R data were verified, except that there was a minor difference in the compression of one item, which was due to using an encoder that was slightly different (i.e. with bugfixes) from the I2R encoder.

Spatial Audio Coding (Sunday 1100-1600)Schuyler Quackenbush chaired this meeting. The agenda for the AHG was discussed and approved.Test Site ReportsSchuyler Quackenbush, Audio Research Labs, presented the test report from University of Miami on behalf of Jon Boley.11202 Jon Boley Spatial Audio Coding Listening Test

Report- University of Miami

Jeongil Seo, ETRI, presented the test report from the ETRI listening test site.11263 Inseon Jang, Jeongil Seo,

Kyeongok KangSpatial Audio Coding RM0 Selection Test Report - ETRI

Takeshi Norimatsu, Panasonic, presented on behalf of Kobe University11269 Masayuki Morimoto, Hayato Report on the Evaluation Tests for Spatial

Audio Coding Systems

Naoya Tanaka, Panasonic, presented11323 Naoya Tanaka, Takeshi

NorimatsuReport on the Listening Tests for the Spatial Audio RM0 Selection

Juergen Herre, FhG, presented11340 A. Hoelzer, C. Spenger, D.

Weninger, J. HerreReport on Spatial Audio Coding Subjective Tests at FhG Test Site

Heiko Purnhagen, Coding Technologies, presented11381 Heiko Purnhagen, Kristofer

Kjörling, Werner OomenSpatial Audio Coding Listening Test Site Report - CT/Philips

These tests were conducted in three listening rooms, two at Coding Technologies and one at Philips.Mart Vinton, Dolby Labs, presented11215 Mark Vinton Testing Environment and Procedures for

Spatial Coding Performed at Dolby Laboratories

These were conducted in two rooms, in which tests 1b and 2b were conducted in a separate room.Sang-Wook Kim, Samsung, presented11317 Kim Report on verification of test bitstream

submissions to Spatial Audio Coding RM0 test

Schuyler Quackenbush, Audio Research Labs, presented11199 Schuyler Quackenbush DRAFT Report on Spatial Audio Coding

RM0 Selection TestsThe data in the report, both tabular and graphical, was presented. It was suggested to additionally report average spatial audio coding side information per test per proponent, and whether the maximum side information rate of 32 kb/s was met for all coded items for all proponents.

98








mailto:Sang-Wook





































Finally, it was suggested to emphasise that in each of test 4a and 4b, all decoded items used common side information.Test report was discussed and experts agreed that the data presented was correct. The ranking of proponent systems, at the 95% level of significance, was agreed to be:Test System Ranking1 ctp = fhg > dol > pan2 ctp > fhg = dol >

pan3 ctp = fhg > dol >

panWhere “=” indicates equivalent to and “>” indicates better than.The Audio Chair noted that two systems (ctp and fhg) were best for each of tests 1 and 3, and amongst the best for test 2. He asked if there was consensus to not conduct the Evaluation Process, as documented in N6691, “Workplan for the Evaluation of Spatial Audio Coding Responses” but rather consider that RM0 will be the merger of the ctp and fhg systems. There was consensus on this proposition, and the proponents of the ctp and fhg systems came forward with a proposal for such a merge. Representative from the two systems gave a presentation. It advocated that merging the ctp and fhg systems would bring MPEG the best RM0 since the two systems have complementary strengths. It was agreed that the result would be assessed by a listening test prior to acceptance as RM0. By the time of the April MPEG meeting the following would be accomplished with respect to the merger activity:

1. Reference code and bitstreams availablea. Source code compiles and decodes submitted bitstreams to exactly tested

waveforms 2. Syntax description available3. WD text (may be preliminary)4. Listening test results available

a. Bitstreams and associated decoded waveforms availableb. Perhaps decoder executable to permit verification of bitstreams and waveformsc. Systems under test will be: RM0, ctp, fhg, hidden reference, lp35 anchord. Configurations tested will be 5-2-5 and 5-1-5 (as in Test 1 and Test 2)e. Listening tests will be conducted at least by Coding Technologies, Philips and

FhG, with a total of at least 30 listeners.

Juergen Herre, Fhg, presented11384 Juergen Herre Additional Information on

Fraunhofer/Agere Spatial Audio Coding Submission

This presentation information on proponent system side information bitrates, variability of performance across test items, and interpretation of test 4, “artistic side information.” The contribution draws information found in the test report as a means to make its points. Artistic downmix: in Test 4, a common side information sequence was used for multichannel decoding based on several different stereo mixes. The test results shows that all decodings have comparable performance, and that the performance is always rated as better than the stereo downmix.Heiko Purnhagen, Coding Technologies, presented11403 Heiko Purnhagen, Kristofer

Kjörling, Werner OomenAdditional Information on CT/Philips Spatial Audio Coding System

This presentation noted the following about the system proposed by CT/Philips It affords attractive computation efficiencies when used with an HE-AAC base coder. It builds upon tools that have already been standardized (i.e. tools from the parametric

stereo coder).99











Werner Oomen, Philips, presented11393 Kristofer Kjörling, Werner

Oomen, Jeroen BreebaartAnalysis of spatial evaluation results

This proposed that post-screening be done based on absolute score given to the hidden reference, specifically that listeners must score the hidden reference above 90 or else all data from that listener is removed from the test. The contribution in fact did such post-screening and presents the results.

Scalable Speech and Music Coding (Sunday 1600-1800)Pierrick Phillipe, France Telecom, presented11370 Pierrick Philippe, Jean Bernard

RaultContribution to requirements and use cases for Scalable Audio/Speech Coding

The conclusions of the contribution are that the CfI should Have greater focus on mobile applications. Incorporate some requirements from this contribution into the CfI. Specifically request additional information on mobile applications

Jim Johnston, Microsoft, presented11251 Johnston CFI proposed to AGH on Scalable codingThis is a draft of the CfI associated with the Scalable Speech and Audio exploration.

Audio plenary, joint meeting and task group activities

Review of AHG reportsThere were no requests to review any of the AHG reports.

Received national body comments and liaison mattersThe Audio Chair presented the USNB Comments and members of the Korean NB presented KNB Comments. Those NB Comments are listed in Section , which also indicates who will respond to those comments.

Audio plenary discussions

Proposed change to MPEG-2 AAC Corrigendum text

Andreas Schneider, Coding Technologies, presented11400 Andreas Schneider Proposed Addition to MPEG-2 AAC

CorrigendumThis contribution proposes extending the MPEG-2 AAC “Characterization” naming scheme to support the SBR tool, e.g. “5.1.1.1 channel AAC-LC + SBR level 5” decoder, where the “level 5” indicates a level in the MPEG-4 HE-AAC profile. The Audio Chair proposed that this be denoted as, e.g. “5.1.1.1 channel AAC-LC SBR/5” decoder and text be added to clarify that the “/5” indicates that the SBR tool has the same capabilities as does the SBR tool in a HE-AAC level 5 profile decoder.

Proposed profile HE-AAC Version 2

Kristofer Kjörling gave a presentation on the proposed HE-AAC V2 profile. This profile incorporates the parametric stereo tool, and is expected to have significant interest from industry. It will use the same hierarchical signalling scheme as is found in the HE-AAC profile.

Spatial Audio Coding

Jeongil Seo, ETRI, presented

100





mailto:James












11264 Jeongil Seo, Han-gil Moon, Seungkwon Beack, Inseon Jang, Kyeongok Kang, Jinwoo Hong


This contribution proposes a new parameter VSLI, Virtual Source Location Information, for the coding of spatial representations of multichannel audio signals. The proposed coding scheme achieves a resolution in the horizontal plane of as fine as 2 degrees. The authors believe that since their proposed coding scheme has a much higher dynamic range, it is more effective than ICLD. Since RM0 has been selected at this meeting (and there is a workplan in which RM0 is available at the 72nd MPEG meeting), this contribution is informative only. The authors anticipate submitting this as a core experiment at the 72nd meeting.Schuyler Quackenbush asked if proponent coded material could me made available to MPEG for informational purposes. There was no objection, so that material will be available with filenames “in the clear” (as contrasted to the double-blind naming of the test material) shortly after the close of this MPEG meeting.Sang Wook Kim, Samsung, expressed interest it the “in the clear” coded material.

MPEG Audio Coders

Pierrick Philippe, France Telecom, presented11341 Alexandre Cotarmanac'h,

Pierrick PhilippeMPEG General Audio Codecs

This document presents an overview of the functionality, history and description of the audio coding tools in MPEG. Experts familiar with particular MPEG technology are encouraged to review this document and add to it, especially with regard to relevant application scenarios, subjective performance data, and description of technology. The Audio Chair noted that at a future date this will a public document, and so it is in the interest of technology proponents to review and add to the document. Sang-Wook, Samsung, noted that an FTP site with material processed by MPEG technology at various bitrates would be very valuable.

Joint Meetings

MAF and MPEG-21: MPEG-A Part 4 (Tue 1130-1300)

MPEG-21 could be used in both media download and streaming. Ian Burnett, UoW, proposed that the following components of MPEG-21 are relevant to the problem:

a. MPEG-21 part 9 (MPEG-21 file format)b. Restrict the scope of DID such that it is compatible with target applications, i.e. that only

the necessary components are available and that it is compatible with low-complexity devices.

c. Binarization of MPEG-21 DID according to MPEG-21 part 16 (BiM)d. A profile of REL suitable for a given application spacee. Binarization of MPEG-21 REL according to MPEG-21 part 16 (BiM)

The problem is to specify a single package (MPEG-21 file format) that is able to express the relationship between or structure of the media components in the file (using DID). It was noted that MPEG does not currently specify a means for encryption. Bernhard Grill, FhG, expressed the opinion is that the MPEG-A effort should try to “invent” the minimum amount of technology and adopt the largest commonality with mechanisms that are currently in the marketplace.The stated goal of Part 4 is to use MPEG-21 technology to publish protected media for either download or steaming distribution, however there was extensive discussion on the problem that should be solved in this application format, and a clear consensus on the problem statement was not reached.

101












Requirements at Audio on new audio profile, CfI on Scalable Coding and Use Cases

New audio profileKristofer Kjörling, Coding Technologies, presented11310 Kristofer Kjörling Additions to the profiles under

consideration11312 Kristofer Kjörling, Werner

Oomen, Takeshi Norimatsu, Toshiyuki Nomura, Jean-Bernard Rault


The contribution reported on the performance of the proposed technology (30% additional compression of stereo signals with respect to the HE-AAC profile). There was consensus in the Audio Subgroup to create this new profileAction by Audio Subgroup is to attach this to the Lossless Audio Coding (ASL) amendment, and to discuss whether this it the best profile name.CfI on Scalable Coding with additional use casesJim Johnston, Microsoft, presented a document that represents the merger of the following documents11251 Johnston CFI proposed to AGH on Scalable coding11370 Pierrick Philippe, Jean Bernard

RaultContribution to requirements and use cases for Scalable Audio/Speech Coding

There was discussion of both the CfI and the additional use cases. It was agreed that the key functionality requested in the call was scalable coding for both speech and audio signals. The CfI should include the following sections:Application scenarios

These might include Scalable to lossless, including across sampling rates Low bit rate channels (e.g. 3gpp requirements)

Functionality and implied requirementsTimetable for submissionEvaluation of evidence

This should be with respect to existing MPEG technology (both scaleable and fixed-rate), such that the submitted technology is significantly better in performance (in a rate-distortion sense) that MPEG technology.

The Audio group will continue to discuss the target applications, desired functionality and evaluation of evidence.

Timestamps and Backward-compatible Audio Decoders

Schuyler Quackenbush, Audio Research Labs, presentedN6682 Timestamps and Audio Codec Behavior

There was discussion of the problem statement and a proposed solution, which will be reviewed by System experts.

Task Group discussions

MPEG-4 Audio Issues

Eunmi Oh, Samsung, presented11217 Eunmi Oh, Miyoung Kim Fine Grain Scalability in MPEG-4 BSAC

multi-channel audio codingAfter extensive discussion, it was the consensus of the Audio Subgroup that the proposal in this contribution be incorporated into the “Study on 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS), new audio profiles and BSAC extensions” document. Werner Oomen, Philips, presented

102



mailto:







mailto:James









11392 Heiko Purnhagen, Werner Oomen


The contribution proposes to add several changes that are editorial or clarifications changes to AMD 2, and the Audio Subgroup agreed to add them to the existing Proposed Corrigenda text, and to issue the Corrigenda at this meeting.Werner Oomen, Philips, presented11389 werner oomen, Frans de Bont,

Erik SchuijersWorking draft proposal for SSC conforma nce

This contribution proposes to do conformance on a “per-tool” basis, e.g. for each of sinusoidal, noise and transient coding tools, and also for the PS tool.Andreas Schneider, Coding Technologies, presented11380 Kristofer Kjörling, Heiko

Purnhagen, Andreas Schneider, Werner Oomen


This contribution proposes PS tool conformance as applied to both HE-AAC and SSC coders. The Working Draft specifies restrictions for conformant bitstreams. The conformance procedure removes the influence of the AAC decoder, so that only the behaviour of SBR+PS is tested. There will be bitstreams that test various aspects of the PS tool, and the figure of merit for some bitstreams may be more than just the normal criterion (i.e. RMS error and maximum difference with respect to the reference decoded waveform). The Working Draft defines 10 bitstreams, all of which are available, and all conformance-testing tools (e.g. conformance AAC decoder) are available.

Lossless Coding

The presentation of lossless coding related contributions began in Sunday’s AhG meeting, and continued during the MPEG meeting. Yuriy Resnik, RealNetworks, presented11407 Yuriy A. Reznik Verification Report on ALS CE6 (Higher

Predictor Orders)The crosscheck showed that, while peak complexity is proportional to predictor order, average complexity (averaged over the entire signal duration) is proportional to the square root of the predictor order. The task group agreed to incorporate the result of this CE into the ALS text.Yuriy Resnik, RealNetworks, presented11404 Yuriy A. Reznik Cross-Check of SLS CE4 ( Lazy Bitplane Coding) The task group agreed to incorporate the result of this CE into the SLS text.Rongshan Yu, I2R, presented11377 Rongshan Yu Proposed WD changes for Lazy Coding

for MPEG-4 Audio Scalable Lossless (SLS) Coding

This presented the integration of CE4 (Lazy bitplane coding) into the ALS PDAM text. This will form the basis of a “Study on PDAM” WG11 document.Rongshan Yu, I2R, presented11379 Rongshan Yu Proposed changes for ISO/IEC

14496-3/PDAM5 (Scalable Lossless Coding)

There was lengthy discussion on this contribution, much of which was to review the current status of the SLS text. One conclusion is that the SLS text must explicitly indicate that the SLS enhancement is added to AAC reconstruction values. The contribution proposes a deterministic rule to compute the bitplane in which to start the SLS enhancement. There was discussion as to whether this is the best rule, and there was no consensus on this point. The group agreed to get additional data on how often the use of the rule is required (information provided later in the

103































week indicates that the rule would be used for approximately 1% of all reconstructed time/frequency values).DiscussionASL CE 6 on Higher Order Prediction This CE is now completes, and the Audio Subgroup approves it to be incorporated into the Study on PDAM text.ASL CE 7 on New Control Parameter for Entropy Coding The technical content of this proposal is minor and not controversial. Takehiro Moriya, NTT, stated that he did a cross check during the MPEG meeting and that it was successful. Audio Subgroup approves it to be incorporated into the Study on PDAM text. Tillman Liebchen noted that he could integrate the technology into RM0 shortly after the close of this MPEG meeting.ASL CE 8 on Multichannel Extension for ALS During the meeting Tillman confirmed that when considering higher number of channels (e.g. higher than 8), the proposed technology continues to deliver increasing performance. The Audio Subgroup approved that this be incorporated into the Study on PDAM text.ALS CE 9 on floating point Approximate Common Factor. The technology promises to deliver up to 40% compression improvement relative to the existing floating-point compression. There was consensus on progressing this CE.ALS CE 10 on LMS Predictors The task group collected additional information during the week. The consensus of the Audio Subgroup is that this CE will be ongoing, that I2R will bring information on an integer implementation of the LMS predictor to the next meeting, and that all parties are encouraged to bring additional information concerning the performance and complexity of the proposed predictor and resulting system, relative to the current ALS predictor and system. The Audio Subgroup feels that this is promising technology that has demonstrated superior compression.SLS CE 4 Lazy Bitplane Coding The Audio Subgroup reviewed this work and accepted this CE as complete. The text for this CE will be incorporated into the Study on Document. The source code implementing CE 4 has already been integrated into the Reference Model.SLS CE 5 Alternate Error Mapping This fixes a potential quantization reconstruction divergence between encoder (with unconstrained AAC encoder) and deterministic SLS decoder. The Audio Subgroup Audio Subgroup approved that this be incorporated into the Study on PDAM text.SLS CE 6 Reduced Complexity of SLS (Lower Complexity IntIMDCT) This was discussed, considering issues both of complexity and accuracy. Ralf Geiger agreed to supply at the next MPEG meeting information on transform accuracy (as in the manner done in the “CE” that preceded RM0. A crosscheck on this CE was provided by I2R during the MPEG week. Position on US NB Comments The Audio Subgroup always desires to make the best use of technology that it has developed, and in this respect endorses that there be a “non-core” mode in the SLS specification. The Audio Chair notes that this was not a position of unanimous consensus. Jim Johnston, member of the US delegation, objected to this position, in that in his opinion, it does not represent an acceptable response to the US NB comment.Yuriy Reznik, RealNetworks, presented11406 Yuriy A. Reznik Status of Performance and Complexity of

Lossless Audio Coding ArchitecturesThis contribution contains a wealth of data concerning the performance and complexity of the various lossless coding architectures, and he highlighted some preliminary information on the performance and compression of the LMS predictor proposed by I2R. Later in the week the Audio Subgroup reviewed and revised the “Summary” section of this document. There was consensus on all of the bullet points, but performance figures are subject to revision.

MPEG-7

Mattias Wien, Aachen, presented

104





The first contribution is a cross-check on an ongoing Core Experiment. It showed results identical to that obtained by FhG. This concludes the CE, and the Audio Rhythm Pattern descriptors will be incorporated into the PDAM text.

Gregiore Carpenter, IRCAM, presented11313 Gregoire Carpentier, Jerome

BarthelemyProposal for a Core Experiment on WeightedScalesDS

This descriptor determines a base pitch, a transposing ratio per frequency sample and a vector of weights for use with the transposing ratio. This CE was accepted, and more information is expected at the next meeting.

Spatial Audio Coding

A workplan for the merger of the ctp and fhg systems was drafted. There was considerable discussion on the details of the listening test, particularly the criteria that the merged system must satisfy in order to become RM0.

Symbolic Music Representation

The SMR Task Group met in a plenary meeting during the whole day on Tuesday.The morning activity was spent to finalize the Test Cases. Test Case for Braille proposed by G. Nicotra and N. McKenzie, was discussed and finally approved in a slightly edited version. Further discussion took place on Test Case for requirement 31. Text has been amended and the final text and content were approved by the group.Discussion moved then to the finalization of the mathematical model inside the “Evaluation Model and Procedure” document. In particular, debate focused on the relative relevance to be given to MPEG integration requirements. After evaluation of different opinions and review of some expectations and heuristics on evaluations, a constant weight of 2/3 was included in the model. The SMR Evaluation Model and Procedure has been considered approved by the Task Group at this point, together with the Test Cases. An Excel sheet has been prepared to help self-assessment of proponents.During the Palma meeting some further discussion has been finally dedicated to the feedbacks, expressions of interest and contributions received by the Group so far, and to the expectations for the Call.The following day input document M11354 “MPEG-4 and SMR: report on available functionality for graphics” was presented and discussed at the SNHC plenary. Important suggestions and understanding were gained during this discussion with SNHC experts. Editing has been made on M11354 to reflect main conclusions, with the purpose of making this available to proponents as annex to the Evaluation document.Later on the current status of activity has been presented and discussed at the Audio plenary, where Paolo Nese, EPFL, presented11307 Paolo Nesi, Giorgio Zoia,

Pierfrancesco Bellini, James Ingram, Kia Ng, Maurizio Campanai, Jerome Barthelemy, Gregoire Carpentier


This document presents the process for evaluating the responses to the Call for Proposals for Symbolic Music Representation. The process consists of:

proponents evaluating their own submission with respect to a very detailed list of requirements or desired behaviour

MPEG experts evaluating the degree to which the submission is capable of being integrated into the existing MPEG framework of tools

Computation of a single numerical Figure of Merit base on all evaluations.105















The evaluation is done in conjunction with a database of test cases, which will be available via FTP.The rest of the work on Wednesday has been mainly editorial. Final editing on the Evaluation document has been made first by James Ingram and Giorgio Zoia based on the decisions taken on Tuesday. Final proofreading was carried on by Kia Ng, Tillmann Weyde and Paolo Nesi.

Scalable Speech and Music Coding

There were several editing sessions on the draft CfI. At the final editing session there was considerable discussion on the form of the CfI, and there was lack of consensus on issuing the CfI at this meeting. To insure that such issues would not further delay the CfI, a Workplan was drafted that clearly states what tasks must be completed to insure a adequate CfI and who would do the tasks, all of which should be completed prior to the next MPEG meeting.

Meeting deliverables

Press statementThe Audio part of the press statement was prepared.

Dispositions of CommentsThere were no DoC to prepare.

Responses to Liaison and NB commentsThere were no liaison responses. The responses to the NB comments were prepared and approved.

Recommendations for final plenaryThe Audio recommendations were presented and approved.

Establishment of Ad-hoc GroupsThe following ad-hoc groups were established by the Audio subgroup:

No. Title Mtg6817 AHG on Audio Standards Maintenance No6818 AHG on MPEG-7 Audio No6819 AHG on Spatial Audio Coding No6820 AHG on MPEG-4 Lossless Audio Coding Yes6821 AHG on Symbolic Music Representation Yes6822 AHG On Exploration of Scalable Audio and Speech Coding Yes

Approval of output documentsAll output documents, shown in Annex E, were presented in Audio plenary and were approved.

Future activities

Schedule of future meetingsAd Hoc group meetings are indicated in Section . Unless otherwise indicated, Ad Hoc group meetings will be held at the location of the next MPEG meeting on the weekend preceding that meeting.

Agenda for next meetingThe agenda for the next MPEG meeting is shown in Annex F

106

All other businessThere was none.

Closing of the meeting The 70th Audio Subgroup meeting was adjourned Friday at 13:30.

107

Annex B ParticipantsFirst Name Last Name Country Affiliation E-mail addressBenjelloun Abdellatib FR France Telecom R&D [email protected]'h Alexandre FR France Telecom R&D [email protected] Boley USA Univ. of Miami [email protected] Breebaart NL Philips [email protected] Bae Chon KR Seoul National Univ. [email protected] Seng Chong SG Panasonic Singapore [email protected] Dietz DE Coding Technologies [email protected] Faller CH EPFT [email protected] Feiten DE Deutsche Telekom [email protected] Geiger DE FhG IIS AEMT [email protected] Grill DE FhG IIS [email protected] Gruhne DE FhG IIS AEMT [email protected] Harada JP NTT [email protected]ürgen Herre DE FhG IIS [email protected] Johannes CE Thomson [email protected] Johnston USA Microsoft [email protected] Young Kim KR Samsung [email protected] Kim KR Samsung [email protected] Kim KR LG Electronics [email protected] Kjörling S Coding Technologies [email protected] Liebchen DE TU Berlin [email protected] Gil Moon KR Seoul National Univ. [email protected] Moriya JP NTT [email protected] Hong Neo SG Panasonic [email protected] Nesi I UNIFI – DSI [email protected] Nomura JP NEC [email protected] Norimatsu JP Panasonic [email protected] Oh KR Samsung [email protected] Oomen NL Philips [email protected] Pang KR LG Electronics [email protected] Philippe FR France Telecom R&D [email protected] Purnhagen S Coding Technologies [email protected] Quackenbush USA ARL [email protected] Rahardja SG I2R [email protected] Bernard Rault FR France Telecom R&D [email protected] Raveendian US Qualcomm [email protected] Reznik USA RealNetworks [email protected] Schneider DE Coding Technologies [email protected] Seefeldt USA Dolby [email protected] Seo KR ETRI [email protected] Sperschneider DE FhG IIS [email protected] Tanaka JP Panasonic [email protected] Väänänen FIN Nokia Res. Center [email protected] Vinton USA Dolby [email protected] Virette FR France Telecom R&D [email protected] Wolf DE Deutsche Telekom [email protected] Xiao SG I2R [email protected] Yu SG I2R [email protected] Zoia CH EPFL [email protected]

List of Symbolic Music Representation ParticipantsPaolo Nesi DSI, University of Florence Italy.Giorgio Zoia EPFL Switzerland.Pierfrancesco Bellini

DSI, University of Florence Italy.

Andrea Vallotti DSI, University of Florence Italy.Hartmut Ring Capella Germany.Hartmut Lemmel Capella Austria.Bernd Jungmann Capella GermanyNeil McKenzie FNB Netherlands

.Maurizio Campanai Exitech S.r.l/WEDELMUSIC Italy.James Ingram Germany.Jerome Barthelemy IRCAM France.Gregoire Carpentier IRCAM France.Kia Ng ICSRiM, University of

LeedsUK.

Tillman Weyde University of Osnabrueck Germany.Giuseppe Nicotra Arca Progetti Italy.Martin Russ British Telecom UK.

109

Annex C Audio Contributions and ScheduleTime Agenda Item MPEG-2/4/7 SMRNumber Title Source

Sunday0900-1800 AHG on Symbolic Music

Representation

11307 Paolo Nesi, Giorgio Zoia, Pierfrancesco Bellini, James Ingram, Kia Ng, Maurizio Campanai, Jerome Barthelemy, Gregoire Carpentier


X

0900-1100 AHG on Lossless Coding

11314 Noboru Harada, Takehiro Moriya

Proposal of CE for improved floating-point compression using ACFC (Approximate-Common-Factor Coding) in ALS (Audio Lossless Coding)

X

11347 Tilman Liebchen, Patrick Runge

Report on MPEG-4 ALS Core Experiment 8 (Multi-channel extension for ALS)

X

11382 Dong-Yan Huang, Haibin Huang, Rongshan Yu, Xiao Lin, Susanto Rahardja


X

11395 S. R. Quackenbush Cross-check on ALS Core Experiment

X

1100-1600 AHG on Spatial Audio Coding

11202 Jon Boley Spatial Audio Coding Listening Test Report- University of Miami

X

11215 Mark Vinton Testing Environment and Procedures for Spatial Coding Performed at Dolby Laboratories

X

11263 Inseon Jang, Jeongil Seo, Kyeongok Kang

Spatial Audio Coding RM0 Selection Test Report - ETRI

X

11269 Masayuki Morimoto, Hayato

Report on the Evaluation Tests for Spatial Audio Coding Systems

X

11323 Naoya Tanaka, Takeshi Norimatsu

Report on the Listening Tests for the Spatial Audio RM0 Selection

X

11340 A. Hoelzer, C. Spenger, D. Weninger, J. Herre

Report on Spatial Audio Coding Subjective Tests at FhG Test Site

X

11381 Heiko Purnhagen, Kristofer Kjörling, Werner Oomen

Spatial Audio Coding Listening Test Site Report - CT/Philips

X

110


































































Time Agenda Item MPEG-2/4/7 SMRNumber Title Source

11317 Kim Report on verification of test bitstream submissions to Spatial Audio Coding RM0 test

X

11199 Schuyler Quackenbush DRAFT Report on Spatial Audio Coding RM0 Se lection Tests

X

(lunch break)

11384 Juergen Herre Additional Information on Fraunhofer/Agere Spatial Audio Coding Submission

X

11393 Kristofer Kjörling, Werner Oomen, Jeroen Breebaart

Analysis of spatial evaluation results X

11403 Heiko Purnhagen, Kristofer Kjörling, Werner Oomen

Additional Information on CT/Philips Spatial Audio Coding Sys tem

X

1600-1800 AHG on Scalable Audio Coding


X

11370 Pierrick Philippe, Jean Bernard Rault

Contribution to requirements and use cases for Scalable Audio/Speech Coding

X

Monday0900-1300 MPEG Plenary1300-1400 Lunch1400-1800 Audio Plenary

Opening of the meetingAudio Chair

Administrative mattersApproval of agendaApproval of 69th MPEG meeting report

X

11200 Schuyler Quackenbush 69th MPEG Audio Subgroup Report

X

Communications from the Chair- Review of Sun Chairs meeting

X

Allocation of contributions to agenda and schedule

X

Joint meetings XReview of AhG reports X

11152 Wo Chang, Olivier Avaro

AHG on MAFX

11171 Ralph Sperschneider AHG on Audio Standard Maintenance

X

11172 Matthias Gruhne AHG on MPEG-7 Audio X

11173 S. Quackenbush AHG on Spatial Audio Coding

X

11174 Tilman Liebchen AHG on MPEG-4 Lossless Audio Coding

X

11175 Paolo Nesi, Giorgio Zoia

AHG on Symbolic Music Representation

X

111
































mailto:James

























mailto:Sang-Wook


11176 Jim Johnston AHG on Exploration of Scalable Audio and Spee ch Coding

X

Task groups and mandates XNational body comments

11226 A. G. Tescher for USNB

USNB Contribution: Issues for audio lossless coding

X


USNB Contribution: Fine-grain scalable audio codec

X


USNB Contribution: Preliminary comments on 14496-3:2001/PDAM 4& 5

X

11316 Kyuheon Kim KNB comments on MPEG-4 BSAC multi-channel

X

1400-1600Plenary discussions

11400 Andreas Schneider Proposed Addition to MPEG-2 AAC Corrigendum

X

11264 Jeongil Seo, Han-gil Moon, Seungkwon Beack, Inseon Jang, Kyeongok Kang, Jinwoo Hong


X

1800- HOD Meeting

Tuesday0900 Audio Plenary Audio Chair

Outline plan for the day

0900-1200 ALS / SLS

11402 Yuriy A. Reznik, Tilman Liebchen

Revision of MPEG-4 ALS Core Experiment 7

X

11407 Yuriy A. Reznik Verification Report on ALS CE6 (Higher Predictor Orders)

X

11377 Rongshan Yu Proposed WD changes for Lazy Coding for MPEG-4 Audio Scalable Lossless (SLS) Coding

X

11379 Rongshan Yu Proposed changes for ISO/IEC 14496-3/PDAM5 (Scalable Lossless Coding)

X

11383 Ralf Geiger Proposal for Reduced Complexity of SLS

11404 Yuriy A. Reznik Cross-Check of SLS CE4 ( Lazy Bitplane Coding)

X

112




























































11346 Tilman Liebchen Proposed Text of Study on ISO/IEC 14496-3:2001/PDAM4 (Audio Lossless Coding)

X

1130-1300 Requirements, Systems, Audio DRM functionality for MAF-MP

1300-1500 Lunch

1500-1630 MPEG-4

11217 Eunmi Oh, Miyoung Kim

Fine Grain Scalability in MPEG-4 BSAC multi-channel audio coding

X

1630-1730 Req at Audio New audio profile, CfI on Scalable Coding / use cases

11310 Kristofer Kjörling Additions to the profiles under consideration

X

11312 Kristofer Kjörling, Werner Oomen, Takeshi Norimatsu, Toshiyuki Nomura, Jean-Bernard Rault


X


X

11370 Pierrick Philippe, Jean Bernard Rault

Contribution to requirements and use cases for Scalable Audio/Speech Coding

X

1730-1830 Sys at Audio Timestamps and Backward-compatible Audio Decoders

(Alexandre from

Systems)

1930-2200 Social

Wednesday0900-1100 MPEG Plenary

1100-1200 MPEG-7

11313 Gregoire Carpentier, Jerome Barthelemy

Proposal for a Core Experiment on WeightedScalesDS

X


X

11392 Heiko Purnhagen, Werner Oomen


X

11380 Kristofer Kjörling, Heiko Purnhagen, Andreas Schneider, Werner Oomen


X

113





























mailto:James














mailto:






11389 werner oomen, Frans de Bont, Erik Schuijers

Working draft proposal for SSC conforma nce

X

1230-1300 SMR

11307 Paolo Nesi, Giorgio Zoia, Pierfrancesco Bellini, James Ingram, Kia Ng, Maurizio Campanai, Jerome Barthelemy, Gregoire Carpentier


X

1300-1500 Lunch

1400-1500 Requirements, Systems, Audio MPEG-21 and MAF

Lossless CodingReview and resolve CE issues X

Thursday

0900 Audio Plenary Audio Chair

0900-1130 Scalable Audio CfI

1130-1200 MPEG-4Review and resolve BSAC issues X

1200- Spatial Audio Coding Workplan for RM0 X

1300-1500 Lunch

Scalable Audio CfI

General

11341 Alexandre Cotarmanac'h, Pierrick Philippe

MPEG General Audio Codecs X

NB Comment Responses X

Lossless

11406 Yuriy A. Reznik Status of Performance and Complexity of Lossless Audio Coding Architectures

X

1730-1900 Audio PlenaryStatus for Chairs Meeting

1800- Chairs Meeting

Friday

0800-0900 Scalable Audio CfI

0900-1300 Audio PlenaryReport on Chairs meeting and outline of plan for the day Audio Chair

Discussion of unallocated contributionsMeeting deliverables Press statement Dispositions of comments Responses to NB comments

114
























Liaison statements Recommendations for final plenary Establishment of new Ad-hoc groups Approval of output documentsFuture activities Agenda for next meetingA.O.B.Closing of the Audio meeting

1300-1400 Lunch

1400- MPEG Plenary

115

Annex D Task Groups1. MPEG-4 Audio Issues

Chair: S. QuackenbushMandates:1.1. Review contributions1.2. Discuss proposed profile for HE-AAC

1.2.1. Draft amendment text if appropriate1.3. Review Proposed changes in MPEG-4 BSAC multi-channel audio coding1.4. Review and respond to KNB comment1.5. Review any proposed new edition documents

2. Lossless CodingChair: Y. ReznikMandates:2.1. Review contributions2.2. Review and respond to USNB comment2.3. Review CE status2.4. Review and revise latest performance results2.5. Produce study on documents as appropriate2.6. Produce workplan documents as appropriate

3. MPEG-7Chair: Matthias GruhneMandates:3.1. Review contributions3.2. Produce Text of 15938-4:2002/PDAM 2, High-Level Description Extensions3.3. Produce appropriate workplan documents

4. Spatial Audio CodingChair: S. QuackenbushMandates:4.1. Review submissions4.2. Review recommendations in AHG report4.3. Produce Report on Selection Test for Spatial Audio Coding System RM04.4. Produce workplan for RM0

5. Symbolic Music RepresentationChair: P. Nesi, G. ZoiaMandates:5.1. Review contributions5.2. Produce Procedures for the Evaluation of Symbolic Music Representation

6. Scalable Speech and Audio CodingChair: J. JohnstonMandates:6.1. Review and respond to USNB comment

6.1.1. Review contributions6.2. Recommend next steps in exploration

116

Annex E Output DocumentsNo. Title TBP Available

13818-7 MPEG-2 AAC

6789 Study on 13818-7:2004/DCOR 1 “AAC ADTS buffer fullness correction”

No 04/10/22

14496-3 MPEG-4 Audio6790 14496-3:2001/AMD 2:2004/DCOR 1 (SSC) No 04/11/05

6791 Study on 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS), new audio profiles and BSAC extensions.

No 04/11/05

6792 Study on 14496-3:2001/PDAM 5, Scalable Lossless Coding (SLS) No 04/10/22

6793 Study on 14496-3:2001/PDAM 6, Lossless coding of 1-bit oversampled signals

No 04/10/22

6794 Status of Performance and Complexity of MPEG Lossless Audio Coding Architectures

No 04/11/05

6795 Draft 3rd Edition of 14496-3 No 04/10/226796 Workplan for Audio Lossless Coding (ALS) No 04/10/226797 Workplan for Scalable Lossless Coding (SLS) No 04/10/226798 Proposed Clarification of Audio Codec Timestamp Behavior No 04/10/22

14496-4 MPEG-4 Conformance6799 Working Draft of High Quality Parametric Audio Conformance No 04/10/226805 Working Draft of Parametric Stereo Conformance No 04/10/226806 Working Draft of additional test sequences for BSAC Conformance No 04/10/226807 Working Draft 0.1 AudioBIFS v3 Conformance No 04/10/226808 Workplan for Audio contribution to MPEG-4 Conformance No 04/10/226809 Status of MPEG-4 Audio Conformance No 04/10/22

15938-4 MPEG-7 Audio

6810 Working Draft of 15938-4:2002/PDAM 2, High-Level Description Extensions

No 04/10/22

6811 Workplan for Weighted Scale DS No 04/10/22Music notation

6812 SMR Evaluation Model and Procedure YES 04/10/22Spatial audio coding

6813 Report on Spatial Audio Coding RM0 Selection Tests No 04/10/226814 Workplan for MPEG-4 Spatial Audio Coding No 04/10/22

Scalable Speech and Audio Coding6815 Workplan on CfI on Scalable Speech and Audio Coding No 04/10/22

Promotion6816 MPEG General Audio Codecs History and Tools No 04/10/22

117

Annex F Agenda for the 71st MPEG Audio Meeting

Agenda Item1. Opening of the meeting2. Administrative matters

2.1. Approval of agenda2.2. Approval of 70th meeting report2.3. Communications from the Chair2.4. Allocation of contributions2.5. Joint meetings2.6. Review of AhG reports2.7. Review of task groups and mandates2.8. Received national body comments and liaison matters2.9. Plenary issues

3. Task group activities3.1. MPEG Maintenance3.2. MPEG-4 Lossless Coding3.3. MPEG-7 Audio3.4. MPEG-Music Player Application Format3.5. Spatial Audio Coding3.6. Symbolic Music Notation3.7. CfI on Scalable Speech and Audio Coding

4. Discussion of unallocated contributions5. Meeting deliverables

5.1. Press statement5.2. Dispositions of comments5.3. Responses to NB comments5.4. Responses to Liaison statements5.5. Recommendations for final plenary5.6. Establishment of new Ad-hoc groups5.7. Approval of output documents

6. Future activities6.1. Agenda for next meeting

7. A.O.B.8. Closing of the meeting

118

Annex 10Report of SNHC meeting

Source: Mikaël Bourges-Sévenier (Mindego Inc.)

Opening of the Meeting

Approval of the agenda

Goals for the weekThe goals of this week are:

Review on-going AFX CE and explorations Review GFX proposals to answer last meeting's questions on the WD Issue GFX CD if technology is stable

120

ScheduleMonday Tuesday Wednesday Thursday Friday

:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30

14

15

08

09

10

11

20

21

22

Time

16

17

18

19

12

13

Lunch break

MPEG Plenary

Lunch break Lunch break Lunch break Lunch break

MPEG Plenary

MPEG Plenary

Roll call, agenda

112061140911205

11194

11196

GFX CD discussion and review

Document reviewPresentation reviewDocument number attribution… last items...

Liaison

ChairsChairs

1120311207112101122211197

11240

11354

11272

11423

Social event

Demos in Systems

11238

AFX CE review

AFX explorations review

121

Allocation of joint meetingsSub-Groups Monday Tuesday Wednesday Thursday Friday

SystemsRequirements

MPEG-7 Video

Video/3DAVMDS

Rooms allocationSNHC ErosSystems DiscobolosRequirementsChairs/HoD/Liaisons

Allocation of contributions

N° Title Schedule ActivityD1 Monday D1

MPEG Plenary D1 09h00-14h00

MPEG Gen.

Report of AhG on MPEG-J extensions Mikaël Bourges-Sévenier

SNHC D1 15h00-16h00

SNHC Gen.

Agenda, FAQ, Web site Mikaël Bourges-Sévenier

15:00

11203 Implementation issues in MPEG-4 Reference Software Marius PredaSon TranFrancoise Preteux

11207 MPEG-4 Player 3D @ Work: demonstration of a weather forecast Marius Preda 15:30

122



N° Title Schedule Activityapplication Son Tran

Francoise PreteuxSNHC D1 16h00-

18h30AFX

11210 Results on the CE for multi-resolution footprint-based representation Jerome RoyanPatrick Gioia

16:00

11222 New proposal for multi-resolution footprint-based representation Jerome RoyanPatrick Gioia

16:30

11197 CE - Shadow: Final Results on Reference Software Implementation Helge DrummThomas Di Giacomo

17:00

Systems D1 18h30-19h30

Graphics

Demos: INT and FT 18h30D2 Tuesday D2

SNHC D2 9:00 – 13:00 AFX11206 XMT encoding issues for BBA Marius Preda

Octavian Folea Françoise Preteux

9:00

11409 BBA implementation into AFX encoder: Donation to ISO Marius11205

Enriching stream control in BBA Marius PredaFrancoise Preteux

11194 CE Report for Physically-Based Animation of Cloth with PhysicsShapeProperties node

Thomas Di GiacomoNadia Magnenat-ThalmannMarius PredaFrancoise Preteux

11:00

11196 Proposal of a PhysicsBoneProperties node Thomas Di Giacomo Nadia Magnenat-ThalmannMarius Preda Francoise Preteux

SNHC D2 14:00 – GFX

123





















N° Title Schedule Activity17:00

11272 Comment on MPEG-J extension for rendering Itaru KanekoMark Callow

14:00

11423 Architecture updates and considerations for MPEG-4 Part 21 Mikael Bourges-Sevenier

15:00

D3 Wednesday D3MPEG Plenary D3 09h00-

11h00MPEG Gen.

SNHC D3 11h00-13h00

SNHC Gen.

11238 Multiple image view synthesis for virtual viewpoint rendering Eddie Cooke 11:0011354 MPEG-4 and SMR: report on available functionality for graphics 12:0011240 Predictive compression of dynamic 3D meshes Aljoscha 12:30

SNHC D3 14h00-16:00

AFX AMD1 + COR1 review 15:00D4 Thursday D4

SNHC D4 9h00-13h00 AFXAFX CE review 9:00AFX explorations review 11:00SNHC D4 14h00-

18h00GFX

GFX discussions and reviewD5 Friday D5

SNHC D5 9h00-11h00 SNHC Gen.

Document number attribution 9:00MPEG Plenary D5 14h00-

22h00MPEG Gen.

124









General issues

Web siteThe SNHC Web site is http://www.sait.samsung.co.kr/snhc/

AFX Reference softwareThe AFX Reference Software has been transferred to NIST and is available via CVS at

1. Register your login/password at http://mpeg.nist.gov/reg/login_new.php2. :pserver:<your login>@mpeg.nist.gov:/big/mpegcvs3. <your password>4. Checkout "MPEG-4/Systems2/IM1" module (case sensitive).

The AFX-related code is in OpenGL/AFX and conformance samples are in Tests/AFX.

http://www-artemis.int-every.fr/~preda showcases many technologies developed by SNHC. At this meeting, it was decided to update this web page with demonstrations companies will provide. It would be preferable to also provide our Player3D in binary form so that non-MPEG interested parties can play those contents. However, we have to check with ISO if this is possible.

AFX encoder and other toolsNew tools addedBBA encoder complements AFX encoder features, see section .

Miscellaneous Node templates up to v.7 uploaded. It contains node definitions of MPEG-4 Part 11 AMD4

and MPEG-4 Part 16 AMD1. XMT-A Schema updated with node definitions up to templates v.7 MPEG-J updated with node definitions up to templates v.7

Standards from SNHCIn red, status reached at this meeting. In yellow, status reached at next meeting. Projects that reached International Standard status have been removed.

Std

Pt Edit. Project Description CfP WD CDPDAMDCOR

FCDFPDA

M

FDISFDAMCOR

4 11 2003 Amd.4 XMT and MPEG-J extensions

03/12 04/07 05/01

4 16 2004 Cor.1 AFX Corrigendum 04/03

04/07 05/01

4 16 2004 Amd.1 AFX extension 03/07

04/07 05/01 05/07

4 21 2005 MPEG-J extensions for rendering

03/12

04/07

04/10 05/01 05/07

125

http://www-artemis.int-every.fr/~preda

http://www.sait.samsung.co.kr/snhc/src/index.html

AFX activities

Specifications updatesThe list of modifications for existing specifications handled by SNHC is as follows.

Part 16/COR1None

Part 16/AMD1National Body comments from the PDAM ballot have been answered in document w6747.

Part 21/CD 1.0Architecture has been updated and questions left in the working draft have been answered. The text is in w6751.

Conformance and reference software

M11203 – Implementation issues in MPEG-4 Reference SoftwareSon Tran solved many bugs in IM1. This contribution is only informational for SNHC as these modifications are handled by Systems group.

M11207 – MPEG-4 Player 3DINT made an impressive demonstration of a weather forecast application using Player3D (AFX reference software) with technologies such as BIFS, AFX, MPEG-J. SNHC is thrilled to see a Player3D that is now suitable for demonstration purposes.

The demonstration is available at http://www-artemis.int-every.fr/~preda/

Core experiments

M11210 – Results on the CE for multi-resolution footprint-based representationA 2D ½ representation for buildings is transmitted instead of a 3D representation. Modeling of the buildings uses a grammar to describe roofs, windows etc.During rendering, each node in the PBTree has a geometric error to determine if extra info is needed to refine the node. For texture mapping, metadata such as (number of floors, height of first floor etc.) are used to add windows and other exterior elements of a building.

ResultsThe CE shows the needs for a specific representation for buildings that is not available in MPEG-4 specification. It also shows that view-dependent multi-resolution streaming defined within AFX specification works.The technology demonstrates a linear decoding/reconstruction time vs. size of the building representation. The test was carried over city of Rennes, France, with real-time progressive reconstruction of 35000 buildings.

M11222 – New proposal for multi-resolution footprint-based representationMulti-resolution building representation was proposed at the previous meeting and the following issues were raised

Not generic enough No access to bounds of the geometry for collision detection or other applications

The proposal addresses these questions. A new decoder specific info for this new AFX decoder is proposed. It is defined so that footprint is separated from other descriptive information that may be

126

http://www-artemis.int-every.fr/~preda/

useful for one application or another. Likewise, the building parameters refer to the VRML/BIFS node ID so information reconstructed from the decoder can update the VRML node and hence be used for collision detection (or other behaviors defined in VRML/BIFS).

ResolutionSNHC VM is updated to record the technology.CE continues on integration of the technology within an MPEG-4 scene and within Player3D.

M11197 – CE shadow: final results on Reference Software implementationFor using this node, the scene graph must implement all traversal operations: identification of all nodes in the graph, go to left/right child, go to parent node etc… The technology has been implemented into the reference software but the code is not yet available in CVS.

ResolutionClose the CE. Techno is mature and go in the VM and later to AFX AMD2 when it will start.Integrate the technology into CVS.

M11194 – CE Physically-based animation of clothThe CE was started at the 68th meeting in Munich.A node for mass-spring systems is proposed. A spring is a link between 2 masses, each spring has a stiffness and a damping factor.

Experts in the field think that it is a simplistic way to represent mass-spring systems. For example, topology information may be useful but is not provided.

The issue is that this generic description doesn't guarantee a consistent behavior across players. Often, one creates such physics model and fine tune for a physics engine on a player. It seems that unless we mandate an algorithm on the player side, effects cannot be guaranteed.

How does collision detection in the standard work with this proposal?

ResolutionMass-spring systems seem working fine for specific class of models. The models need to be fine-tuned to produce the correct animation and it is often related to the algorithm used in the player.CE continues and should provide more results on the possibilities of this model and in particular that guarantees similar animations across players.

M11197 – Proposal of PhysicsBoneProperties nodeRagdoll dynamics is used heavily in games today. The PhysicsBoneProperties node link a bone (in the BBA tool already in AFX) to its physical properties (mass, damping, stiffness, external force applied to the bone).

ResolutionAdd to CE on Physics-based animation to study integration with BBA.

Demo session in SystemsSNHC demonstrated the following applications in Systems hosted demo session:

Demonstration of Weather forecast. Demonstration of city navigation

127

BBA updates

M11206 – XMT encoding issues for BBABugs corrected in XMT-A:

As <Bitwrapper> refers to its stream's encoding parameters, <SBVCAnimationType> needs to refer to BBA encoding parameters (changes in xmta-bifs.xsd)

<BBAEncodingParameters> had attribute <minmax>. It is proposed to use element <BBAMinMax> that provides more flexibility to modify these encoding values (changes in xmta-encoding.xsd)

Global quantization steps are present in the stream but were forgotten in XMT-A definition (changes in xmta-encoding.xsd)

BBA encoding hint forgotten in xmta-encoding.xsd

ResolutionAccepted

M11197 – BBA implementation into AFX encoderThe AFX encoder in the reference software has been updated with BBA stream generation directly from XMT encoding definition. The AFX encoder documentation has been updated.

NotesAFX encoder tool supports:

BBA, interpolator compression, 3DMC encoding directly from XMT And soon (next meeting?): wavelet subdivision surfaces and MeshGrid

ResolutionAccepted

M11197 – Enriching stream control in BBACurrently you can play BBA stream but it is not possible to use VCR-like control (play/pause/rewind etc.). It is proposed to add media capabilities following VRML definition of media nodes such as MovieTexture to SBVCAnimation node. A new field activeUrlIndex is added whose semantic is to be used to select pre-built animations (e.g. walking, running animations for a virtual character).

DiscussionAdding the possibility to choose between pre-built animations is useful but it is not clear how transitions between animations are controlled. Translations are linear interpolations, rotations uses slerp.transitionTime field is added to specify the time between transitions.BIFS also provides MediaControl node, which can work with the new definition.

ResolutionSince a FNB comment requests addition of this node in AFX AMD1 and the node is implemented, we accept it in AFX AMD1.

Explorations

M11238 – Multiple image view synthesis (MVS) for virtual viewpoint renderingFrom arbitrary views from any number of video inputs (camera setup independent), a 3D rendering of an object is created based on the viewpoint of the user. The virtual views contain holes i.e. missing information that need to be filled using algorithms proposed in this document.

128

The technology has the following advantages: Modular: any number of reference images/cameras Flexible: 3D scene surface definition

This method needs intrinsic camera parameters (i.e. property of the CCD chip) as well as extrinsic ones (i.e. where the camera is in the world and focal plane). These parameters must be carried along with the video stream as they may change over time; having them in a separate stream would make management more complex.

ResolutionIn AFX, we have a similar technology called Depth Image Based Representation (DIBR). The exploration continues in order to explore how DIBR can be used to render MVS and if any tool is missing.

M11354 – MPEG-4 and SMR: functionality for graphicsSo far, CfP on SMR has been issued to define a format to describe music notations, how it can be integrated in MPEG-4/-7/-21, and in sync with other media.

SMR needs the following features SMR decoder must estimate the notation based on what is played. SMR decoder receives AU containing parts of the score. The user may view parts of the score, the user may interact with playback, notes, transpose

score etc… 2D graphics for music symbols

BIFS may be sufficient and the group is analyzing if there are other possibilities.Display of notations, some animations may be rather demanding for BIFS so the exploration to new possibilities such as GFX.

ResolutionNone, this discussion was to help SMR group understands the different rendering possibilities in MPEG-4.

M11240 – Predictive compression of dynamic 3D meshes (D3DMC)This document shows tests made with MPEG-4 tools on dynamic 3D meshes, using 3DMC, textures H.264/AVC, and for rendering: view-dependent texture mapping in AFX.

The tests were run with different quality parameters to compare existing solutions and D3DMC: 3D mesh resolution (number of vertices), number of video textures, video quality, and mesh quality.

3DMC tool (ISO/IEC 14496-2) is for static meshes but here the idea is to use a sequence of static meshes and send a predictively encoded stream.

Test sequences: Microsoft Chicken crossing (400 time-consistent meshes with 3030 vertices). The test is

made for different group of meshes (i.e. 1 intra every N frames). Doo Young 3DVO, 220 time-consistent meshes with 1000 vertices

The results show that D3DMC significantly outperforms 3DMC.

129

ResolutionStart CE to validate these results and compare to coordinate interpolator compression tool and BIFS-Anim tool which is used for streaming data. Explore for other attributes like colors, textures coordinates…Goal: explore compression of static and dynamic meshes.

MPEG-4 Part 21

M11272 – Comments on MPEG-J extension for renderingIn Japan, each mobile manufacturer provides its own API. Each API provides mostly the same features. A content creator makes applications and provides them for each API/format.

Needs: Vendors need to have some way to protect their content uniquely (e.g. it works on player A

but not on player B) -> out of scope of MPEG-4 Part 21 Authoring development platform issues? We don't understand what the issues are. Beware of Java profiles used to develop Graphics API => try to be independent of the Java

profile

M11423 – Architecture updates and considerations for MPEG-4 Part 21Decoder

Add a state interface for the state of the decoder getCurrentMediaTime() returns in ms. getCompositionBuffer()

Architecture is better that in the WD as it allows more flexibility. It is also more efficient because it enables the Java side to have minimal work and the native side to do the heavy work in software or in hardware.

The proposal focuses on JSR-239, the architecture must be updated with JSR-184, as in the WD.

ResolutionGet rid of synchronization and use media time only (no equation)About synchronization of AV clock and internal clock, we believe at this time that it is an implementation matter.The Java binding to OpenGL ES must be proposed to JSR-239 expert group for review and comments.

DiscussionTiming and synchronizationIn this discussion we try to define the requirements for timing and synchronization, for lip-sync applications, graphics-video sync applications, and so on.

Q: What is the jitter (delay between Java call and response from native) on media time?A: Current estimate of implementers is that crossing JNI could be up to 10ms in worst case scenario. This heavily depends on JVM implementation, CPU etc., and on the implementation of the player on the terminal.

Q: Is it necessary to have the same frame-rate for video and graphics?A: No unless the graphics rate is unacceptably slow.

130

Q: Can you tell the renderer to render at a given time?A: You know the start time to render a frame. You know also the video frame rate, so the application knows how long it has to complete a video frame. Typically, it is content-dependent how long it takes to render a graphics frame. So it depends on the cleverness of the application to take into account these time delays. Therefore, do we leave it as implementation specific (e.g. to the MPEGlet) or do we specify it in this spec (e.g. in MPEG-J)? Answer: we leave it implementation specific and invite proposals/comments if inadequate.

Note: it is possible to query the media time from the decoder (getMediaTime() method) at any time during the lifecycle of an MPEGlet.

Resolutions of SNHC

Output documents

No. Title TBP

Available

Editor

14496-16 MPEG-4 Animation Framework eXtension (AFX)

6747 Study text of DoC on ISO/IEC 14496-16/PDAM1

No 04/10/22 Marius Preda

6748 Study text on ISO/IEC 14496-16/PDAM1 No 04/10/22 Marius Preda6749 AFX CE description No 04/10/22 Marius Preda6750 AFX VM 16.0 No 04/10/22 Marius Preda

14496-21 MPEG-J extensions for rendering6751 Text of ISO/IEC 14496-21 CD Yes 04/11/05 Mikaël Bourges-

Sévenier

ResolutionsMPEG-4Part 16

The SNHC subgroup would like to express its gratitude to all reviewers who submitted comments on AFX PDAM1.

The SNHC subgroup acknowledges demonstration of new applications using 3D graphics technologies developed by SNHC and would like to encourage companies using these technologies to provide demonstrations.

Part 21 The SNHC subgroup recommends approval of MPEG-4 Part 21 "GFX" CD. By making it

publicly available, the SNHC subgroup wishes to gather a wider industry support. The SNHC subgroup recommends a Java binding to OpenGL ES contained in GFX CD

text. It will be submitted to JSR-239 expert group for review and comments.

Establishment of SNHC Ad-Hoc groups

No. Title Meeting

Chair

6752 AhG on AFX documents, CEs, and 05/01/1 Marius Preda

131

software 66753 AhG on MPEG-J extensions for

rendering05/01/16

Mikaël Bourges-Sévenier

N6752 Ad Hoc Group on AFX documents, CEs, and softwareMandates: 1. Maintain and edit SNHC VM document.

2. Coordinate SNHC CE and EE activities.3. Coordinate collection of demonstration data set of SNHC tools

Chairman: Marius Preda (INT)Co-chairs: Mahnjin Han (Samsung AIT)

Patrick Gioia (France Telecom R&D)Duration: Until 71th meetingMeetings Sunday before 71th meetingReflector: mpeg-snhc AT gti. ssr. upm. esSubscribe: Send an email to mpeg-snhc-request AT gti. ssr. upm. es with the message

“subscribe” as the first line in the body.

N6753 Ad Hoc Group on MPEG-J extensions for renderingMandate: 1. Maintain and edit 14496-21 (GFX) documents

2. Harmonize Java bindings to OpenGL ES with JSR-239 expert group3. Investigate GFX implementation in IM1

Chairman: Mikaël Bourges-Sévenier (Mindego Inc.)Co-chairs: Vishy Swaminathan (Sun Microsystems)

Itaru Kaneko (Waseda University)Duration Until 71th meeting Meetings: Sunday before 71th meetingReflector: mpeg-j AT it-aru. comSubscribe: Send an email to mpeg-j-request AT it-aru. com with the message “subscribe”

as the first line in the body.

Closing of the MeetingSee you in Hong-Kong in January.

132

Annex 11Report of Integration meeting

Source: Jean-Claude Dufourd, ENST


Allocation of contributionsMonday Plenary

11169Marius PredaMahnjin Han Patrick Gioia

AHG on AFX documents, CEs, and software

Joint with MDS on Wednesday 16:00 – 17:00

11254 Thomas de Martini et al Preliminary Comments on ISO/IEC FCD 21000-8 (Reference Software)

11211 Thomas de Martini et al Data Types and Methods for Implementing MPEG-21 REL Interpretation Reference Software

11261 Shane Lauf et al IPMP DIDL Reference software contribution

11270 Teemu SaarinenArtur Lugmayr


11336 Frederik De KeukelaereRik Van de Walle Contribution to DID conformance

11218 Hyuk-Min Kwon et al Progress of MPEG-21 DIA Utility Software Modules C, D, F, G, L, M, N & AA.

11276

SuSan ImSangHoon OhSeokHoon KimSpencer Cheng


Integration Plenary on Thursday 14:00 – 16:00

11177 Jean-Claude Dufourd Initial Reference Software for LASeR and SAF

11361 Jean-Claude Dufourd LASeR/SAF reference software: codec aligned with study

11362 Oliver Baum Proposed WD 0.1 of AudioBIFS v.3 Conformance

11203Son TranMarius PredaFrancoise Preteux


11345 Gregoire PauClaude Seyrat MPEG-21 binarisation status with MPEG-7 BiM reference software

List of standards under developmentStd

Pt

Edit.

Project Description CfP WD CD FCD FDIS

4 4 200x Cor.1 Visual Bitstreams 04/03 04/10 05/044 4 200x Amd.1/

Cor.1FGS Bitstreams 04/10 05/04

4 4 200x Amd.9 AVC FRExt Conformance

04/03 04/07 05/01 05/07

4 4 200x Amd.10 New Levels of SP Conf

04/07 04/10 05/04

4 4 audio conf4 5 2004 Amd8 AVC FRExt + Audio

SBR Ref Soft04/07 05/01 05/07

21 8 200x 1st Ed. Reference software 03/03 04/03 05/01 05/0721 14 200x 1st Ed. Conformance 03/10 05/01 05/07 05/12

Latest references

133

Project P. Standard Issue No.MPEG-4 4 ISO/IEC 14496-4:2003 (MPEG-4

Conformance 2nd Ed.)02/12 Awaji N5457

MPEG-4 4 ISO/IEC 14496-4:2001/Amd.1 (FlexTime, Studio and Streaming Video Profile)

02/07 Klagenfurt

N5083

MPEG-4 5 ISO/IEC 14496-5:2001 (Ref. Soft 2nd Ed.) 01/07 Sydney N4368MPEG-4 5 ISO/IEC 14496-5:2001/Amd.1 (FlexTime) 02/03 Jeju N4711MPEG-4 5 ISO/IEC 14496-5:2001/Amd.2 (XMT) 02/05 Fairfax N4865MPEG-7 6 ISO/IEC 15938-6:2002 (Reference Software) 01/12 Pattaya N4475MPEG-7 7 ISO/IEC 15938-7:2002 (Conformance) 02/07

KlagenfurtN4937

Request documents

MPEG-2 Reference SoftwareThe text of the second edition is ready, the editor requests a two month editing period for gathering the software and checking everything once more.

MPEG-4 Conformance (14496-4) 11362 Oliver Baum Proposed WD 0.1 of AudioBIFS v.3 Conformance

This document presents a view of the audio BIFS conformance. It signals that there is no conformance for AudioBuffer. More higher-quality sound material is needed. 3 test scenarios are proposed, no bitstreams were generated yet. Subjective testing is discussed. The proponents are asking for help.

More work was done by Samsung on test sequences for BSAC to test PNS.

The editor for Audio conformance suggests to consider a new edition for MPEG-4 conformance.

MPEG-4 Reference Software (14496-5) It is suggested to consider a new edition for MPEG-4 reference software.

11203Son TranMarius PredaFrancoise Preteux


Some bugs were found in the MPEG-4 Systems reference software:- rotation parameter in an MPEG-J call- parser of BIFS encoder- missing instruction in the mux parser for video

Fixed files are attached to the document. The proponents recommend to update the reference software.

MPEG-21 ConformanceREL conformance will be restricted to a realistic use case.

134

11336 Frederik De KeukelaereRik Van de Walle Contribution to DID conformance

This results from the discussions in the plenary in Redmond. Ghent Univ. has packaged their 40+ examples of the reference software. The Integration subgroup wishes to thank Ghent University for their diligence in presenting a solution to this issue.

11276 Su San Im et al The reference conformance test model(based on Mpeg-21 dii&didl)

A selection of this contribution was presented, the part suggesting a methodology to create a conformance test suite for MPEG-21 DIDL. This is going into an output document from Integration, methodology under consideration for the creation of MPEG-21 conformance.

MPEG-21 Reference Software11254 Thomas de Martini et al Preliminary Comments on ISO/IEC FCD 21000-8 (Reference Software)

These preliminary comments have been discussed and a study of the reference software document, without the actual software, will be issued as an output of this meeting.

11211 Thomas de Martini et al Data Types and Methods for Implementing MPEG-21 REL Interpretation Reference Software

This constitutes a workplan to be fulfilled by ContentGuard, Inc. over the next two meetings. This requires a delay by one meeting on the reference software (FDIS by April).

11261 Shane Lauf et al IPMP DIDL Reference software contribution

Presentation and demo of the software contribution.

11270 Teemu Saarinen et al Software implementation of a lightweight REL based DRM system for video streaming to mobile devices

Presentation and demo of the software contribution. This is a candidate for inclusion in the reference software, so it will go to the Study document.

11218 Hyuk-Min Kwon et al Progress of MPEG-21 DIA Utility Software Modules C, D, F, G, L, M, N & AA.

Summary of the status of the DIA software modules: many modules were updated.

135

Resolutions of Integration

Resolutions1. The Integration subgroup recommends to start the work on a new edition of MPEG-4

conformance.2. The Integration subgroup recommends to start the work on a new edition of MPEG-4

reference software.

Documents

MPEG-2


13818-5 MPEG-2 Reference Software 6737 ISO/IEC 13818-5 MPEG-2 Reference Software 2nd edition Y 04/12/22

MPEG-4


14496-4 MPEG-4 Conformance 6738 Text of ISO/IEC 14496-4:200x/DCOR1 Visual Bitstreams N 04/10/22

6739 Text of ISO/IEC 14496-4:200x/Amd1/DCOR1 FGS and Studio Bitstreams

N 04/10/22

6740 Study of ISO/IEC 14496-4:200x/FPDAM9 AVC FRext Conformance N 04/11/30

6741 DoC on ISO/IEC 14496-4:200x/PDAM10 New Levels for Simple Profile Conformance

N 04/11/30

6742 ISO/IEC 14496-4:200x/FPDAM10 New Levels for Simple Profile Conformance

N 04/11/30


14496-5 MPEG-4 Reference Software

6743 Study of ISO/IEC 14496-5:200x/PDAM8 AVC FRext Reference Software

N 04/11/30

MPEG-21


21000-8 MPEG-21 Reference Software6744 Draft DoC on ISO/IEC 21000-8 FCD MPEG-21 Reference Software N 04/10/226745 Study of ISO/IEC 21000-8 FCD MPEG-21 Reference Software N 04/10/22


136

21000-14 MPEG-21 Conformance6746 Methodology under consideration for MPEG-21 conformance Y 04/10/296867 WD4.0 of MPEG-21 Conformance N 04/10/22

137

Annex 12Report of Test meeting

Source: Tobias Oelbaum


Goals for the weekThe goals of this week are:

Discussion about procedure for visual quality evaluation for SVC CE1 Conduction of the SVC CE1 test Processing of the results of the SVC CE1 tests; documentation of the results and the test

procedure Review and discuss input documents on objective quality metrics for impairment introduced

by watermarking Discussion on the validity of the “1sigma” method as a good approximation of the 95%

confidence intervall.

Joint MeetingsThe following joint meetings were scheduled

with Video - SVC CE1 testing with Requirements – Video PAT Evaluation

Contributions11195 Objective Impairment Test Method for Video PAT Evaluation11201 The Guideline for Selection of Test Stimuli in Evaluation of Video Watermarking11333 Suggested Test Method for SVC CE Visual Tests11360 Subjective evaluation of CE1 results11372 Discussion on evaluation criteria for experts viewing tests in SVC CE111429 Comparison of statistical methods for assessment of subjective video quality

Test Activities

SVC CE1 testingAfter discussion at the SVC AHG meeting it was decided to do a visual quality evaluation of the proposals to CE1. It was agreed to perform this quality evaluation on a reduced set of sequences (4 out of 8) and to do this quality evaluation using the SSMM (Single Stimulus Multi Media) method as used in the SVC CfP. The reason for selecting this method instead of the proposed expert testing method was the strong requirement of the group to have an indication about the size of the quality gap between the different proposals.Results were presented at a joint meeting with Video and are documented in N6736.A detailed description of the performed visual quality evaluation is documeted in N6736.

MPEG-21 Video PAT Evaluation11195 Proposes objective quality evaluation method for impairment introuced by watermarks. Though interesting ideas for the subjective evaluation of watermarks are presented, the

138

proposed method is not evaluated so far and references to similar work in this areas are not available. Encouraged to present the proposal in an extended form atthe next meeting.11201 Proposes a guideline for the selection of test stimuli for the evaluation of video watermarking. Guideline is based on objective image properties such as amount of motion or complexity of the image. Proponent is encouraged to present his method again with supporting results that prove the efficiency of the idea presented.

Statistical Analysis of Test Results11429 Compares different statistical methods to calculate a 95% confidence interval between two different coding methods under evaluation. Proposal seems to support the assumption that the “1sigma” method gives a good approximation of the 95% CI. Encouraged proponent to perform a deeper analysis based on available test data.

Test Resolutions

Output Documents N6737 Report of the Subjective Quality Evaluation for SVC CE1

AdHoc GroupsNo AdHoc Groups have been set up at this meeting.

Resolutions The Test subgroup would like to thank Vittorio Baroncini for providing a high end PC for

the subjective quality evaluation and help in the preparation of the subjective quality evaluation.

139

Annex 13Report of ISG meeting

Source: ISG ChairEditor: Marco Mattavelli (EPFL)

OverviewThe main work items of the Implementation Studies Subgroup in Palma de Mallorca are:

1. The advances in the development of the MPEG-4 “Part 9 Reference Hardware Description” Phase 2 concerning the integration of the MPEG-4 Optimized Reference software Part 7 and the Reference Hardware Part 9 so as to constitute a “mixed” software hardware description of MPEG-4 video using the concept of the virtual socket.

2. The planning and extension of supported features for the integrated framework, putting together in a single application MPEG-4 Part 9 with MPEG-7 Part 7 and AVC (MPEG-4 Part-9) software.

Input contributions w.r.t. the above items are summarized according to the following table:

Contributions

M11153 “Report of the AHG on MPEG-4 Part 9 "Reference Hardware Description"

Marco Mattavelli EPFL, Robert Turney Xilinx Research Lab.

M11459 2-D IDCT Hardware Accelerator Implementation for Virtex-II Devices

A. Navarro, A. Silva, O. Nunes, C. Aragao Telecommunications Institute-University of Aveiro-Portugal

M11460 MPEG-4 Inverse Quantizer Hardware Accelerator Implementation in Virtex II

A. Navarro, A. Silva, O. Nunes, C. Aragao Telecommunications Institute-University of Aveiro-Portugal

M11461 An Ip Block For Mpeg-4 Part 9 Block-Based Motion Estimation Architecture

Mohammed Sayed and Wael Badawy University of Calgary, Calgary, Alberta, Canada.

M11462 Update on Hardware Reference Code for DCT & its Specifications for MPEG-4 Decoder

Wael Badawy, and Graham Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada.

M11442 Virtualisation Layer for Portable Hardware Accelerators Seamlessly Integrated into Software Applications

Miljan Vuletić, Laura Pozzi, Paolo Ienne Processor Architecture Laboratory, EPFL

M11431 Multiple IP-Core Hardware-Accelerated Software System Framework for MPEG4-Part9

T. Mohamed W. Badawy University of Calgary, Calgary, Alberta, Canada.

M11411 An Ip Block For Mpeg-4 Part 10 Context-Based Daptive Variable Length Coding (Cavlc)

Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada.

140

M11412 A Hardware Block for 2x2 Hadamard Transform and Quantization with Application to MPEG–4 Part 10


M11413 A SystemC model for 2x2 Hadamard Transform and Quantization with Application to MPEG–4 Part 10


M11414 A Hardware Block for 4x4 Hadamard Transform and Quantization in MPEG-4 Part 10


M11415 A SystemC model for 4x4 Hadamard Transform and Quantization with application to MPEG-4 Part 10


M11416 A Hardware Block for THE MPEG-4 PART 10 4x4 DCT-LIKE

Ihab Amer, Wael Badawy, and Graham JullienAdvanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada.

M11417 A Systemc Model For The Mpeg-4 Part 10 4x4 Dct-Like Transformation And Quantization


M11408 Updated Status of Shape Coding Binary Motion Estimation Hardware Acceleration Module

Daniel Larkin, Valentin MuresanCentre for Digital Video Processing, Dublin City University, Dublin 9, Ireland

M11366 Updated Status on Hardware Acceleration Module for Motion Estimation

Daniel Larkin, Valentin MuresanCentre for Digital Video Processing, Dublin City University, Ireland

M11358 Updated Status on Hardware Acceleration Module for SA-DCT

Andrew Kinane, Valentin Muresan, Noel O’Connor Centre for Digital Video Processing, Dublin City University, Ireland

Detailed Report

The advances in the development of the MPEG-4 “Part 9 Reference Hardware Description”

141

The ISG activity at the Palma meeting has mainly been devoted to the review of the contributions and to the development of the guidelines for conformance documentation of modules submitted for Part 9. In more details the following topics have been the subject of the work:

the review of the contributions presenting updated HDL module submissions the review of contributions on the new proposed improvements to the API specification and

implementation improvements of the “Virtual Socket”, the specification of the advanced version of the demonstration, the distribution of the WILDCARDII platform supporting a faster accomplishment of the

verification of the conformance of Part 9 modules with the standard described in Part 2 and Part 10

the update of MPEG-4 Part 2 and Part 10 module submission status.

Almost all modules submitted so far are accompanied by documentation according to the template defined at Seattle meeting. Conformance part needs to be completed for most of the modules. During the meeting a clear procedure for the conformance has been defined.Five WILDCARDII modules have been distributed among the participants to the meeting that have submitted HDL modules. Therefore all can proceed with conformance testing of the submitted HDL modules using the integrated framework.The table of module submission commitment has been updated and reported in an specific output document (question marks indicate that the commitment is uncertain concerning the delivery date or that the module has not been selected for a submission commitment) (output document N6754).

An interesting proposition to extend the supported functionality of the integrated framework has been presented and discussed (Document M11442). The idea is to provide a virtual memory module that provided a access to the memory as seen by the software description also to the HW described co-processor described by Part 9. Such feature can result very attractive for simplifying the design of HDL co-processing modules that can be fully functional even when rarely used options needing access to the central memory are used or allowing a design without explicit specification of the data transfers.

The ad-hoc group on the development of MPEG-4 Part 9 has been re-established with updated mandates, including a specific mandate for the specification and development of the demonstration platform. The ad-hoc schedule includes 4 telephone conferences before next meeting. Phone conferences are planned on the 11th November,1st December, 13th January at 3 p.m. GMT. Tel: (from US 1-877-582-3182, from outside US 1-770-970-4161, participant code 9202060193).

ResolutionsThe above activities have led to the following resolutions and output document

approval.

MPEG-4


142

14496-9 MPEG-4 Reference Hardware Description 6754 Status of HDL submissions and commitments for MPEG-4 Part-9 N 04/10/22

6756 Updated status and Documentation of the Hardware Acceleration Module for SA-DCT for MPEG-4 Part 2

N 04/10/22

6757 Updated Status and documentation of the 4xPE Hardware Acceleration Module for Motion Estimation

N 04/10/22

6758 Updated status and documentation of the 2-D IDCT Hardware Accelerator Module for MPEG-4 Part 2

N 04/10/22

6759 Updated Status and documentation of the Shape Coding Binary Motion Estimation Hardware Acceleration Module for MPEG-4 Part 2

N 04/10/22

6760 Updated status and documentation of the Inverse Quantizer Hardware Accelerator Implementation for MPEG-4 Part 2

N 04/10/22

14.1.12 The Implementation Studies subgroup would like to thank all submitters of HDL code and contributors to the implementation of the virtual socket and encourages them to continue this fruitful effort and collaboration.

143

Annex 14Report of Liaisons meeting

Source: Jan Bormans

As a result of the increasing Liaison activity with ATSC, the Liaison Group received a request from ATSC to:

1. Extend the existing collaboration from the technical group level to the organisation level;2. Consequently change the Liaison Representative; and3. Consequently change the category of the Liaison from “C” to “A”.

After a presentation at Tuesday’s Liaison meeting, a consensus was reached to proceed as requested by ATSC.

Background: The Advanced Television Systems Committee, Inc. (ATSC) is an international, non-profit organization developing voluntary standards for digital television. The ATSC member organizations represent the broadcast, broadcast equipment, motion picture, consumer electronics, computer, cable, satellite, and semiconductor industries.

The ATSC DTV Standard has been adopted by the United States, Canada, South Korea, Argentina and Mexico. ATSC member is are currently included in several MPEG work items including amendments 1, 4 and 5 to ISO/IEC 13818-1:2000 and ATSC continues to utilize the new standards developed by WG 11 in its future specifications for broadcast and datacast applications.

The Liaisons Group considered the following input documents:

Input Contribution Number

Title

M11180 Liaison Statement from the TV-Anytime ForumM11208 IEC CDV 62261-1M11209 IEC CDV 62261-2M11273 Activity Report of DCCSDP&DCCSDC in JapanM11433 IEC TC 100 NPM11444 Liaison Statement from the TV-Anytime ForumM11445 Liaison Statement from the TV-Anytime ForumM11470 IEC CD 60728-1

An interesting presentation from Hiroshi Yasuda-san and Takuyo Kogure-san was given during the Liaison meeting about the DCCSDP&DCCSDC activities. In the discussion following this presentation MPEG documents relevant for the DCCSDP&DCCSDC were identified. This information has been included in the outgoing Liaison Statement to the DCCSDP&DCCSDC.

To give appropriate exposure to the Call for Proposals on M3W, it was decided to send this Call a wide range of organisations (also see the Liaison resolutions below).

In addition to replying, when appropriate, to the incoming Liaison Statements, it was agreed to take the initiative to send outgoing Liaison Statements to: OMA, 3GPP and W3C - on drawing the attention/updating the information on LASeR;

144

http://www.atsc.org/atscmembers.html

http://www.atsc.org/atscmembers.html

WG1 - on how existing MPEG-7 technology can fulfil requirements for JPEG’s CfP on JPSearch; and

OMA - on conformance to ISO 14496 Part 12.

MPEG was also informed during the course of the meeting of IEC TC100 activities focussing on home server technology (TA8). Their scope is to develop international publications relating to multimedia home server systems and software specifications addressing the total system connected in the network. This includes e.g. the system interface, the application programming interface, the modelling for system structure and system functionality specifications. Current work includes: PT 62328 multipart standard

Defines the volume and file structure adaptation required for interchanging multimedia data of a home server/broadcasting receiver which consist of a major stream and multiple associated objects. Part 3 is specific to Japanese broadcast systems ISDB, and further parts may provide similar specifications for other regions.

PT 61925Vocabulary of home server is specified from the viewpoint of equipment functions and home server technology.

New TA8 work items recently balloted/under ballot are: 100/808 Guidelines for privacy protection

Scope: Guidelines for protection of user’s private information stored in consumer equipment and systemsBackground: Increasing number of consumer products store user information which needs to be protected from illegal access and use. Mechanisms are also needed to ensure such information can be deleted (and not remain recoverable) when equipment sold on etc

100/849 Digital rights permission codeTo define permission-related identifiers and permission information (permission and condition descriptors) required to digitally manage content rights and permissions in the home server environment

100/863 Conceptual model for DRMModel of protocol specifications to exchange rights information between DRM modules, to define protocols, rights description format, encrypted content format and include requirements, security model, interconnection model, license information model, protected content format model.

100/864 Conceptual model for e-publishingModel clarifies e-publishing /e-book components and relationship between these and e-publishing services.

WG 11 was also informed of the existence of a presentation “Towards full

implementation of DRM” providing additional background on the above. See also

http://www.itu.int/ITU-T/worksem/hnhs/index.html

Finally, the responses for the non-technical National Body comments as well as an

updated list of organisations with which MPEG entertains liaisons were completed.

The following recommendations were issued:

The approval of the following documents (Liaison Statements):

No. Title TBP AvailableGeneral

6761 Liaison Statement to DCSDC No 04/10/226762 Liaison Statement to the TV-Anytime Forum on MPEG-7 MDS No 04/10/226763 Liaison Statement to OMA on LASer No 04/10/226764 Liaison Statement to 3GPP No 04/10/226765 Liaison Statement to W3C No 04/10/226766 Liaison Statement to WG 1 on JPSearch No 04/10/29

145

http://www.itu.int/ITU-T/worksem/hnhs/index.html

6843 Liaison Statement to OMA on Base Media File Format No 04/10/22

6866 Liaison Statement to IEC TC 100 on NP: Multimedia home server systems

No 04/10/22

6868 Template cover letter for M3W liaison No 04/10/29

The approval of the following documents (statement of benefits):


6767 Statement of benefits from establishing a Category A liaison with ATSC

No 04/10/22

The approval of the following documents (other Liaison documents):


6768 Responses to National Body Comments No 04/10/226769 List of Organisations with which MPEG entertains liaisons No 04/10/22

The Liaison group requests to change the ATSC liaison category from C to A

The Liaison group requests the SC29 Secretariat to send the M3W Call for Proposals using template N6868 to the following organisations: UPnP, ATSC, DVB, OCAP, CELF, DLNA.

146