international organisation for … · web vieworganisation internationale de normalisation iso/iec...

INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATION

ISO/IEC JTC 1/SC 29/WG 11CODING OF MOVING PICTURES AND AUDIO

ISO/IEC JTC 1/SC 29/WG 11 N6484Redmond, WA – July 2004

Source Leonardo Chiariglione, Convenor

Title Report of the 68th meetingStatus

Report of the 69th meeting1 Opening The 68th WG11 meeting was held at the Technical University of Munich on 2004/03/15-19 at the kind invitation of the German National Body (DIN).

2 Roll call of participants Annex 1 gives the attendance list.

3 Approval of agenda Annex 2 gives the agenda approved.

4 Allocation of contributionsAnnex 3 gives the list of input contributions

5 Communications from Convenor

6 Report of previous meetingThis was approved.

7 Processing of NB Position PapersNational Body papers were considered and answers provided where appropriate.

8 Work plan

8.1 Media coding

8.1.1 MPEG-2 AAC BW Extensions conformanceThe following documents were approved

6617 DoC on ISO/IEC13818-4:200X/FPDAM2 Audio Conformance Ext.

6618 ISO/IEC13818-4:2004/FDAM2 Audio Conformance Ext.

1

8.1.2 Parametric Audio CodingThe following document was approved

6675 Formal Verification Report on MPEG-4 Parametric Audio Coding

8.1.3 Advanced Video CodingThe following document was approved

6540 Text of ISO/IEC 14496-10 Advanced Video Coding 3rd Edition

8.1.4 AVC ConformanceThe following documents were approved

6532 DoC on ISO/IEC 14496-4/FPDAM6 AVC Conformance

6533 ISO/IEC 14496-4/FDAM6 AVC Conformance

8.1.5 AVC Fidelity Range Extensions

8.1.6 AVC Fidelity Range Extensions ConformanceThe following document was approved

6534 ISO/IEC 14496-4/PDAM9 AVC FRExt Conformance

8.1.7 New levels in MPEG-4 Simple profileThe following documents were approved

6495 Request for ISO/IEC 14496-2:2004 AMD26496 Text of ISO/IEC 14496-2:2004/PDAM 2 (New Levels in Simple

Profile)

8.1.8 New levels in MPEG-4 Simple profile conformanceThe following document was approved

N6497 Request for ISO/IEC 14496-4:2004 Amd.10N6498 Text of ISO/IEC 14496-4:2004 PDAM10 Conformance Extensions for New Levels of

Visual Simple Profile

8.1.9 AFX Conformance

8.1.10 AFX ExtensionsThe following document was approved

6544 ISO/IEC 14496-16/PDAM1

2

8.1.11 Audio Lossless CodingThe following documents were approved

6672 Text of 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS)

6680 Workplan for Audio Lossless Coding (ALS)

8.1.12 Audio Scalable Lossless CodingThe following documents were approved

6673 Text of 14496-3:2001/PDAM 5, Scalable Lossless Coding (SLS)

6681 Workplan for Scalable Lossless Coding (SLS)

8.1.13 1-bit Audio Lossless Coding The following document was approved

6674 Text of 14496-3:2001/FPDAM 6, Lossless coding of 1-bit oversampled signals

8.1.14 HE-AAC ConformanceThe following documents were approved

6622 DoC on ISO/IEC 14496-4/FPDAM8 HE-AAC, ABIFS and SA Conformance

6623 ISO/IEC 14496-4/FDAM8 HE-AAC, ABIFS and SA Conformance

8.1.15 SA ConformanceThe following documents were approved



8.1.16 Scalable Video Coding

8.1.17 Streaming Text Format

8.1.18 Spatial Audio Coding

8.1.19 Video Coding Tool Repository

8.1.20 3D AV Coding

8.2 Composition coding

8.2.1 Audio BIFS ExtensionsThe following documents were approved

6590 DoC on ISO/IEC

3

14496-11/FPDAM36591 Text of ISO/IEC 14496-11/FDAM3

8.2.2 Audio BIFS ConformanceThe following documents were approved



8.2.3 XMT extensionsThe following documents were approved

6592 DoC on ISO/IEC 14496-11/PDAM46593 Text of ISO/IEC

14496-11/FPDAM4

8.2.4 Lightweight Scene RepresentationThe following documents were approved

6499 Request of ISO/IEC 14496-206500 Text of ISO/IEC

14496-20/CD

8.2.5 Symbolic Music RepresentationThe following document was approved

6689 Call for Proposals for Symbolic Music Representation

8.3 Description coding

8.3.1 Efficient representation of descriptions

8.3.2 Video DescriptorsThe following document was approved

N6516 WD 2.0 of MPEG-7 New Visual Extensions

8.3.3 Audio Descriptors

8.3.4 MDS user preference extensionsThe following documents were approved

6633 DoC on ISO/IEC 15938-5 FPDAM/2

6634 ISO/IEC 15938-5 FDAM/2 “MDS User Preference Extensions”

4

8.3.5 MPEG-7 Conformance ExtensionsThe following documents were approved

6637 DoC on ISO/IEC 15938-7 FPDAM/1

6638 ISO/IEC 15938-7 FDAM/1

8.3.6 MPEG-7 Profiles

8.3.7 Schema definitionThe following documents were approved

6639 DoC on ISO/IEC 15938-10 FCD

6640 ISO/IEC 15938-10 FDIS “Schema Definition”

8.3.8 Extraction and use of MPEG-7 descriptions extensions

8.4 Systems support

8.4.1 Carriage of ISAN and V-ISAN metadata

8.4.2 New audio profile and level signaling

8.4.3 Text profile descriptorThe following documents were approved

6588 Request of ISO/IEC 14496-1:2004 Amd.1

6589 Text of ISO/IEC 14496-1:2004/PDAM1

8.4.4 MPEG-1 Audio access unitsThe following documents were approved

6670 DoC on 14496-3:2001/FPDAM 3, MPEG-1/2 Audio in MPEG-4

6671 Text of 14496-3:2001/FDAM 3, MPEG-1/2 Audio in MPEG-4

8.4.5 Streaming of MPEG-7 descriptions

8.4.6 Timestamps and Audio Codec BehaviorThe following document was approved

6682 Timestamps and Audio Codec Behavior

8.5 IPMP

8.5.1 MPEG-2 IPMP-X Conformance The following documents were approved

5

6624 DoC on ISO/IEC13818-4/FPDAM1 IPMP Conformance Ext.

6616 ISO/IEC13818-4/FDAM1 IPMP Conformance Ext.

8.5.2 MPEG-4 IPMP-X Conformance

8.5.3 Evaluation Tools for Persistent Association

8.5.4 MPEG-21 IPMP FrameworkThe following document was approved

6644 ISO/IEC 21000-4 WD v.1 “IPMP”

8.6 Digital Item

8.6.1 Digital Item DeclarationThe following documents were approved

6641 DoC on 21000-2 CD 2nd Edition – Digital Item Declaration

6642 ISO/IEC 21000-2 DID 2nd Edition FCD

8.6.2 Digital Item BinarisationThe following document was approved

6613 Text of ISO/IEC 21000-16/CD

8.6.3 DIA Conversions and PermissionThe following document was approved

6647 MPEG-21 DIA PDAM/1 “Conversions and Permissions”

8.6.4 Event ReportingThe following document was approved

6656 ISO/IEC 21000-15 WD v.2 “Event Reporting”

8.6.5 MPEG-21 Conformance

8.6.6 Vision, technologies and strategy

8.7 Transport and File Format

8.7.1 MPEG-2 SystemsThe following documents were approved:

6

6583 Study Text of ISO/IEC 13818-1:2000/FPDAM4

6584 DoC on ISO/IEC 13818-1:2000/FPDAM56585 Text of ISO/IEC 13818-1:2000/FDAM5

8.7.2 ISO File Format extensionsThe following documents were approved:

6595 Study Text of DoC on ISO/IEC 14496-12/FPDAM1

6596 Study Text of ISO/IEC 14496-12/FPDAM1

8.7.3 MPEG-21 File FormatThe following documents were approved:

6610 DoC on ISO/IEC 21000-9/CD6611 Text of ISO/IEC

21000-9/FCD

8.8 Multimedia architecture

8.8.1 MPEG-J extension for scene control

8.8.2 MPEG-J extension for renderingThe following document was approved

6549 ISO/IEC 14496-21 WD 1.0

8.8.3 Digital Item ProcessingThe following documents were approved

6653 Draft DoC on ISO/IEC 21000-10 CD

6654 Study on ISO/IEC 21000-10 CD “Digital Item Processing”

8.8.4 MPEG Multimedia Middleware

8.9 Reference implementation

8.9.1 AVC Reference SoftwareThe following documents were approved

6535 DoC on ISO/IEC 14496-5/FPDAM6 AVC and HE-AAC reference software

6536 ISO/IEC 14496-5/FDAM6 AVC and HE-AAC reference software

8.9.2 HE-AAC Reference SoftwareThe following documents were approved

7


6536 ISO/IEC 14496-5/FDAM6 AVC and HE-AAC reference software

8.9.3 MPEG-2 IPMP Reference SoftwareThe following documents were approved

6619 DoC on ISO/IEC 13818-5/DAM2 IPMP Reference Software Ext.

6620 ISO/IEC 13818-5/AMD2 IPMP Reference Software Ext

8.9.4 AFX Reference SoftwareThe following documents were approved

6625 DoC on ISO/IEC 14496-5/FPDAM7 AFX reference software

6626 ISO/IEC 14496-5/FDAM7 AFX reference software

8.9.5 AVC Fidelity Range Extensions Reference SoftwareThe following document was approved

6537 ISO/IEC 14496-5/PDAM8 AVC FRExt reference software

8.9.6 MPEG-4 Visual Reference Hardware Description

8.9.7 MPEG-4 AVC Reference Hardware DescriptionThe following documents were approved

6506 Updated Call for the Submission of Hardware Reference Code for MPEG-4 Part 9: Reference Hardware Description

6509 Status of HDL submissions and commitments for MPEG-4 Part-9

8.9.8 MPEG-7 Reference Software ExtensionsThe following documents were approved

6512 DoC of ISO/IEC 15938-6/FPDAM1 Information Technology -Multimedia Content Description Interface- part 6: Reference Software Extensions

6511 ISO/IEC 15938-6/FDAM1 Information Technology -Multimedia Content Description Interface- part 6: Reference Software Extensions

8.9.9 MPEG-21 Reference SoftwareThe following documents were approved

6627 DoC on ISO/IEC 21000-8/CD MPEG-21 reference software

6628 ISO/IEC 21000-8/FCD MPEG-21 reference software

8

8.9.10 Test Bed for MPEG-21 Resource DeliveryThe following documents were approved

6629 DoC on ISO/IEC 21000-12/PDTR Test Bed for MPEG-21 Resource Delivery

6630 ISO/IEC 21000-12/DTR Test Bed for MPEG-21 Resource Delivery

8.10 Application formats

8.10.1 Music player Application Format The following documents were approved

6687 DoC on 23001-1:200X CD, “Player Application Format”

6688 Text of 23001-1:200X FCD, “Player Application Format”

8.10.2 Photo album Application Format

8.11 Maintenance

8.11.1 Systems standardsThe following documents were approved

6582 Text of ISO/IEC 13818-1:2000/DCOR3

6586 DoC on ISO/IEC 14496-1/DCOR36587 Text of ISO/IEC 14496-1/COR36594 Text of ISO/IEC 14496-11/COR2

8.11.2 Video coding standardsThe following document was approved

N6514 MPEG-4 Visual: List of Problems Reported version 13.0

8.11.3 Audio coding standardsThe following documents were approved

6621 ISO/IEC 13818-5 :1997/Amd1:1999/COR2

6669 Text of 13818-7:2004/DCOR 1 “AAC ADTS buffer fullness correction”

6677 Proposed 3rd Edition of 14496-3

8.11.4 Synthetic coding standardsThe following document was approved

6545 ISO/IEC 14496-16/DCOR1

9

8.11.5 Visual description coding standards

8.11.6 Audio description coding standards

8.11.7 MDS standardsThe following documents were approved

6635 DoC on ISO/IEC 15938-5 DCOR/1

6636 ISO/IEC 15938-5 COR/1

8.11.8 IPMPThe following document was approved

6646 ISO/IEC 21000-6 DCOR/1

8.11.9 Digital ItemThe following document was approved

6648 ISO/IEC 21000-7 COR/1 WD v.1

9 Liaison matters

10 Organisation of this meeting

10.1 Tasks for subgroupsTasks were assigned to achieve the goals of the work plan.

10.2 Joint meetings The following joint meetings were held

Groups What Where Day TimeReq, JVT Profiles, DCinema, etc. JVT Mon 15:30-

16:30Req, MDS, Sys MPEG-21 IPMP Req Mon 17:00-

18:00HOD Lassen Mon 18:00-

19:00Req, Vid MPEG-4 Video Profiles,

SVCVid Tue 09:00-

11:00Req, Sys, Aud, Vid, MDS

MAF Req Tue 11:00-11:30

Vid, Tst SVC Experts viewing Vid Tue 11:00-12:00

DMP Lassen Tue 13:00-14:00

Req, Sys OpenType, M3W Req Tue 14:00-15:00

Req, MDS, Sys DID, binarisation Req Req Tue 15:00-16:30

10

Sys, Snh Laser, MPEG-j, XMT Sys Tue 17:00-18:00

Req, Aud Scalable Audio in MPEG-21 Aud Tue 11:30-12:00

Req, Sys, Aud, Vid, MDS

MP7 Profiles Req Wed 11:30-13:00

Req, Int, MDS MP21 integration & implem. Req Wed 14:00-15:00

Req, Sys M3W Req Wed 14:00-14:30

MDS, Int MP21 conform. MDS Wed 15:00-16:00

Vid, JPG Scalable Video Coding Vid Wed 15:00-16:00

Aud, Sys Audio codec behaviour Aud Wed 16:00-17:00

Sys, SNHC Laser Snh Wed 16:00-15:00

Vid, VCEG Scalable Video Coding Vid Wed 16:00-17:00

Req, MDS MP21 IPMP Req Wed 16:30-17:00

Vid, ISG VCTR Vid Wed 11:30-12:30

MDS, Sys MP21 FF Sys Thu 09:00-10:00

Req, Vide PAT, 3DAV, SVC Vid Thu 09:30-11:00

Sys, JPG ISO File Format ext Sys Thu 10:00-11:00

MDS, Int MP21 RSW MDS Thu 11:00-12:00

Req, Aud SMR reqs Req Thu 14:00-14:30

10.3 Administrative matters

10.3.1 Schedule of future MPEG meetings The following meeting schedule was approved

Meeting City Country

Yr.

Mo. Days

69th Redmond, WA US 04 07 19-23

70th Palma de Mallorca

ES 04 10 18-22

71st Hong Kong CN 05 01 17-21

72nd Busan KR 05 04 18-

11

2273rd Poznań PL 05 07 25-

2974th ? FR 05 10 17-

2175th ? ? 06 01 23-

27

10.3.2 Promotional activities An ad hoc group with this mandate was re-ablished.

11 Planning of future activities The following ad hoc groups were established

6528 AHG on 3DAV Coding6662 AHG on AFX documents, CEs, and software6664 AHG on Audio Standard Maintenance6526 AHG on Core Experiments in Scalable Video Coding6525 AHG on Description Tools for New Visual Extensions6668 AHG On Exploration of Scalable Audio and Speech Coding6502 AHG on Font Format Representation6531 AHG on M3W6504 AHG on MAF6523 AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and

Conformance6524 AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software6657 AHG on Media Locators6632 AHG on MPEG 1016659 AHG on MPEG-21 DIA6660 AHG on MPEG-21 DIP6661 AHG on MPEG-21 Event Reporting6503 AHG on MPEG-21 Integration and Outreach6658 AHG on MPEG-21 IPMP6666 AHG on MPEG-4 Lossless Audio Coding6510 AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2.6696 AHG on MPEG-7 Audio6692 AHG on MPEG-7 Interoperability and Profiling6663 AHG on MPEG-J extensions for rendering6527 AHG on Scalable Video Model and SVC Reference Software6615 AHG on Scene Representation6665 AHG on Spatial Audio Coding6667 AHG on Symbolic Music Representation6631 AHG on the Communicating MPEG to the business Community6529 AHG on Video Coding Tools Repository6614 AHG on XML Structure Binarization and Streaming

12 Resolutions of this meetingThese were approved (N6482)

12

13 A.O.B There was no other business

14 Closing The meeting closed at 2004/07/24T21:20.

13

Annex 1Attendance list

First Name Last Name Company CountryMyriam Amielh CISRA AustraliaGerrard Drury TITR / enikos AustraliaShane Lauf University of Wollongong/Enikos AustraliaAxel Becker CISRA AustraliaRobert Prandolini Defence Science & Technology Org AustraliaDavid Taubman The University of New South Wales AustraliaIan Burnett University of Wollongong/Enikos AustraliaChristian Timmerer University Klagenfurt AustriaJoeri Barbarien Vrije Universiteit Brussel BelgiumJan Bormans IMEC BelgiumFrederik De Keukelaere Ghent University BelgiumAlexandru Salomie Vrije Universiteit Brussel BelgiumPeter Schelkens Vrije Universiteit Brussel BelgiumRik Van de Walle Ghent University BelgiumAntonin Descampe Université Catholique de Louvain BelgiumSpencer Cheng Morphbius Technology CanadaJeremie Farret SGDL Systems Inc CanadaAlain Mignot SolideSpace CanadaDemin Wang Communications Research Centre CanadaPatrick Rault FastVDO CanadaLowell Winger LSI CanadaFeng Wu Microsoft ChinaJizheng Xu Microsoft Research Asia ChinaShiqiang Yang Tsinghua University ChinaChengwei Gao Anyka Cayman Corporation ChinaWang Baoai China Electronics Standardization Institute ChinaHsin-Hao Chen OES/ITRI ChinaHsueh-Ming Hang National Chiao Tung University ChinaTihao Chiang NCTU/MITSUBISHI ChinaChun-Jen Tsai National Chiao Tung University ChinaYi-Shin Tung National Taiwan University ChinaChung-Neng Wang National Chiao Tung University ChinaJan Achrenius Hybrid Graphics, Ltd. FinlandPetri Kero Hybrid Graphics, Ltd. FinlandMauri Vaananen Nokia FinlandHenrik Karppinen Nokia, Inc. FinlandMichel Allain SACEM FranceOlivier Avaro France Telecom R&D FranceAbdellatif Benjelloun Touimi France Telecom R&D FranceRenaud Cazoulat France Telecom R&D FranceCyril Concolato ENST FranceAlexandre Cotarmanac'h France Telecom FranceJean-Claude Dufourd ENST FranceMelanie Dulong de Rosnay Medialive FranceFrancois Edouard Thomson R&D FrancePatrick Gioia France Telecom R&D FranceMarc Guez Vucher SCPP FranceMariam Kimiaeiasadi ENST FranceFrederic Loras France Telecom FranceFX NUTTALL CISAC FranceMarius Preda Int FranceClaude Seyrat EXPWAY FranceJerome Vieron Thomson FranceDavid Virette France Telecom France

14

Jérôme Caporossi Medialive FranceVania Conan Thales FranceChristine Guillemot INRIA FranceFabrice Le Leannec Canon Research Centre France SAS FranceDidier Nicholson Thales FranceStéphane Pateux France Telecom R&D FranceStephane Valente Philips Digital Systems Labs - Paris FranceFrancoise Preteux Institute National de Telecommunication FrancePeter Amon Siemens AG GermanyOliver Baum Fraunhofer IIS GermanyJohannes Boehm Thomson GermanyMartin Dietz Coding Technologies GermanyIvan Dimkovic Ahead Software GermanyBernhard Feiten Deutsche Telekom T-Systems GermanyHarald Fuchs Fraunhofer IIS GermanyRalf Geiger Fraunhofer IDMT GermanyBernhard Grill Fraunhofer IIS GermanyMatthias Gruhne Fraunhofer IDMT GermanyJuergen Herre Fraunhofer IIS GermanyJoerg Heuer Siemens AG GermanyTilman Liebchen Technical University of Berlin GermanyJoern Ostermann Universität Hannover - Institut für Theoretische N GermanyThomas Rusert Aachen University GermanyJuergen Schmidt Thomson GermanyAndreas Schneider Coding Technologies GermanyAljoscha Smolic Fraunhofer HHI GermanyRalph Sperschneider Fraunhofer IIS GermanyMathias Wien Aachen University GermanyIngo Wolf T-Systems Germany GermanySiegfried Foessel Fraunhofer IIS GermanyGero Bäse Siemens AG GermanyUlrich Benzler Robert Bosch GmbH GermanyUlrich Fecker University of Erlangen-Nuremberg GermanyCarsten Herpel Thomson GermanyPeter List Deutsche Telekom T-Systems GermanyDetlev Marpe Fraunhofer HHI GermanyTobias Oelbaum Munich University of Technology GermanyJens-Rainer Ohm RWTH Aachen GermanyHeiko Schwarz Fraunhofer HHI GermanyHerbert Thoma Fraunhofer IIS GermanyThomas Wedi Panasonic European Laboratories GermanyThomas Wiegand Fraunhofer HHI GermanyAharon Gill Zoran Microelectronics, Ltd. IsraelZvi Lifshitz Optibase, Ltd. IsraelMarco Tagliasacchi Politechnico di Milano ItalyRiccardo Leonardi University of Brescia ItalyPaolo Nesi DSI-DISIT- University of Florence -

MUSICNETWORKItaly

Stefano Tubaro Politecnico di Milano ItalyGiovanni Cordara Telecom Italia LAB ItalyRoberto Flaiani Aethra ItalyLeonardo Chiariglione CEDEO ItalyTakashi Nishi Oki Electric Industry Company, Ltd. JapanKohtaro Asai Mitsubishi Electric Corporation JapanYukihiro Bandou NTT JapanToshiaki Fujii Nagoya University JapanKazuhiro Iida Panasonic JapanSatoshi Ito Toshiba JapanYutaka Kamamoto NTT Japan

15

Takahiro Kimoto NEC JapanMasaki Kitahara NTT JapanTakuyo Kogure Matsushita Electric JapanTakehiro Moriya NTT JapanTokumichi Murakami Mitsubishi Electric Corporation JapanHirofumi Nishikawa Mitsubishi Electric Corporation JapanToshiyuki Nomura NEC JapanTakeshi Norimatsu Matsushita Electric JapanMasanori Sano NHK JapanCraig Schultz Multimedia-Architectures JapanTakanori Senoh Matsushita JapanYoshinori Sugihara JEITA JapanSeishi Takamura NTT JapanNaoya Tanaka Panasonic JapanMasayuki Tanimoto Nagoya University JapanTakafumi Ueno Matsushita Electric JapanAkio Yamada NEC JapanHiroshi Yasuda The University of Tokyo JapanJunichi Hara RICOH JapanAkio Matsubara RICOH JapanNaoki Kobayashi Nippon Telegraph Telephone East Corporation JapanYukiko Ogura IPSJ/ITSCJ JapanTakeshi Chujoh Toshiba JapanHideaki Kimata NTT JapanMasaaki Kobayashi Oki Electric Industry Company, Ltd. JapanTomokazu Murakami Hitachi, Ltd. JapanSatoru Sakazume Victor Company of Japan, Ltd. JapanTeruhiko Suzuki Sony JapanToshiya Takahashi Panasonic JapanHideki Takehara Victor Company of Japan, Ltd. JapanThiow Keng Tan NTT DoCoMo, Inc. JapanYoshihisa Yamada Mitsubishi Electric Corporation JapanMasao Aizu Canon, Inc. JapanItaru Kaneko Tokyo Polytechnic University JapanHiroshi Watanabe Waseda University JapanChung-Hyun Ahn ETRI KoreaKyung-Ae Cha Information and Communications University KoreaSangchang Cha Samsung Electronics KoreaJong-Jin Chae net&tv Inc. KoreaYongju Cho ETRI KoreaIk-Hwan Cho In-ha University KoreaWoo-Jin Han Samsung Electronics KoreaMahnjin Han Samsung AIT KoreaHendry Hendry Information and Communications University KoreaKang Hogab Hersasu KoreaGyeong Ja Jang Samsung AIT KoreaEuee Seon Jang Hanyang University KoreaYe Sun Joung ETRI KoreaSang-Kyun Kim Samsung AIT KoreaHae Kwang Kim Sejong University KoreaKiseob Kim Kangwon National University KoreaHyoungJoong Kim Kangwon National University KoreaWook-Joong Kim ETRI KoreaRinchul Kim University of Seoul KoreaSangwook Kim Samsung AIT KoreaMunchurl Kim Information and Communications University KoreaKyuheon Kim ETRI KoreaHyun Mun Kim Samsung AIT KoreaWonha Kim Kyung Hee University Korea

16

JungHoe Kim Samsung AIT KoreaJaejoon Kim Daegu University KoreaJoohee Kim Samsung AIT KoreaSeok-Hoon Kim Korea Digital Content Forum KoreaHye Yun Kim Samsung-AIT KoreaDaijin Kim Postech KoreaJong-Tae Kim KAIST KoreaSun Young Lee Hanyang University KoreaJong won Lee Samsung KoreaJeho Nam ETRI KoreaEunmi Oh Samsung AIT KoreaWeon Geun Oh ETRI KoreaKeunsoo Park Korean Broadcasting System KoreaSoo Jun Park ETRI KoreaSeungho Park Kyung Hee University KoreaJeongil Seo ETRI KoreaYoungjoo Song ETRI KoreaHyung Sik Suh KwareSoft Inc. KoreaWon-Young Yoo ETRI KoreaKisong Yoon ETRI KoreaChee Sun Won Dongguk University KoreaDong-Seok Jeong INHA University KoreaJeon ByeongMoon LG Electronics Inc. KoreaWoong Il Choi Sungkyunkwan University KoreaYo-sung Ho GIST KoreaManbae Kim Kangwon National University KoreaHaksoo Kim Kangwon National University KoreaYong Han Kim University of Seoul KoreaYung-Lyul Lee Sejong University KoreaYoung-Kwon Lim net&tv, Inc. KoreaJi-Ho Park LG Electronics Inc. KoreaSang Yong Seo Korea Telecom KoreaJean H.A. Gelissen Philips Research NLWerner Oomen Philips PDSL-E NLAndrew Tokmakoff Telematica Instituut NLFons Bruls Philips NLJan van der Meer Philips NLGisle Bjontegaard Tandberg NorwayArild Fuldseth Tandberg NorwayEyvind Fossbakk Norwegian Broadcasting Corporation NorwayWladyslaw Skarbek Warsaw University of Technology PolandMarek Domanski Poznań University of Technology PolandFernando Pereira Instituto Superior Técnico PortugalKok Seng Chong Panasonic Singapore Laboratories SingaporeNeo Sua Hong Panasonic Singapore Laboratories SingaporeZhongyang Huang Panasonic Singapore Laboratories SingaporeMing Ji Panasonic Singapore Laboratories SingaporeMen Huang Lee Panasonic Singapore Laboratories SingaporeXiao Lin Institute for Infocomm Research SingaporeChin Phek Ong Panasonic Singapore Laboratories SingaporeSusanto Rahardja Institute for Infocomm Research SingaporeXiaokang Yang Institute for infocomm research SingaporeRongshan Yu Institute for Infocomm Research SingaporeVincent Diong Panasonic Singapore Laboratories SingaporeChakJoo Lee Panasonic Singapore Laboratories SingaporeJiunn Bin Lim Panasonic Singapore Laboratories SingaporeChong Soon Lim Panasonic Singapore Laboratories SingaporeJaime Delgado Universitat Pompeu Fabra SpainMarc Gauvin sDae Spain

17

Thomas Kummer-Hardt AIO SpainEva Rodriguez Universitat Pompeu Fabra SpainPaulo Villegas Telefonica I+D SpainKristofer Kjorling Coding Technologies SwedenHeiko Purnhagen Coding Technologies SwedenPer Fröjdh Ericsson SwedenMarco Mattavelli EPFL SwitzerlandJulien Reichel VisioWave SwitzerlandStephan Wuermlin ETH Zurich SwitzerlandFrancesco Ziliani VisioWave SwitzerlandGiorgio Zoia EPFL SwitzerlandTouradj Ebrahimi EPFL SwitzerlandChris Barlas Rightscom, Ltd. UKMiroslaw Bober Mitsubishi Electric ITE-VIL UKLeszek Cieplinski Mitsubishi Electric ITE-VIL UKNiels Rump Rightscom, Ltd. UKMartin Russ British Telecommunications plc UKRay Taylor NDS Limited UKSimon Watt Universal Music International UKSteve Appleby BT UKPing Wu Tandberg Television UKCatherine Grant Nine Tiles UKPaul Jessop IFPI UKThomas DeMartini ContentGuard, Inc. USWenlong Dong Microsoft Corporation USMichael Good Recordare llc USIgor Komir Analog Devices, Inc. USJose' Roberto Alvarez Mobilygen Corporation USHye-Yeon Cheong Columbia University USChad Fogg Pixonics USNeelesh Gokhale RealNetworks USMingning Gu QPixel Technology USMichael Horowitz CoVi Technologies USKarl Lillevold RealNetworks USDaniel Miner DirecTV USSteve Purcell Enmedia USRob Robinett Modulus Video USEric Viscito eV Consulting USHitoshi Watanabe QPixel Technology USHsi-Jung Wu Apple Computer, Inc. USDengzhi Zhang QPixel Technology USSheng Zhong Broadcom USJeroen Bekaert Ghent University / Los Alamos National Laboratory USBruce Block RIAA USJonathan Boley University of Miami USMarina Bosi MPEG LA LLC USMikael Bourges-Sevenier Mindego, Inc. USGeorge Chen STMicroelectronics USKatie Cornog Avid Technology USSachin Deshpande Sharp Laboratories of America USMatt Fellers Dolby Laboratories USChuck Fenimore NIST USBradford Gandee ContentGuard, Inc. USMarco Hurtado IBM USJames D. (jj) Johnston Microsoft Corporation USMukta Kar Cable Television Laboratories USRob Koenen InterTrust USMike Ksar Microsoft Corporation USKhosrow Lashkari DoCoMo USA Labs US

18

Vladimir Levantovsky Agfa Monotype Corporation USDebargha Mukherjee Hewlett-Packard USMartha Nalebuff Microsoft Corporation USFlorian Pestoni Microsoft Corporation USHanspeter Pfister Merl USSchuyler Quackenbush Audio Research Laboratories USMajid Rabbani Eastman Kodak USChris Russell MPAA USOfer Shapiro Quix USJohn Smith IBM T. J. Watson Research Center USAli Tabatabai Sony USMihaela Vander Schaar Uc Davis / Philips USAnthony Vetro Mitsubishi Electric USMark Vinton Dolby Laboratories USXin Wang ContentGuard, Inc. USS. Merrill Weiss Merrill Weiss Group LLC USThomas White MIDI Mfrs Assoc USDai Yang VidiatorTechnology (us) Inc. USWendy Aylsworth Warner Brothers USAli Bilgin University of Arizona USWo Chang NIST USWalter Husak Dolby USMichael Marcellin University of Arizona USSusie Wee Hewlett-Packard USLian Zhu Crowley-Davis Research USJohn Apostolopoulos Hewlett-Packard USMarta Karczewicz Nokia Research Center USTaek Kim Hewlett-Packard USDavid Lindbergh Polycom, Inc. USPankaj Topiwala FastVDO USAlexandros Tourapis Thomson - Corporate Research USMike Rubinfeld NIST USYiliang Bao Nokia, Inc. USFrank Bossen DoCoMo USA Labs USPeisong Chen Qualcomm, Inc. USSherman Chen Broadcom USCraig Demel CoWare Inc. USFelix Fernandes Texas Instruments USHarinath Garudadri Qualcomm, Inc. USWalter Gish Dolby Laboratories USStephen Gordon Broadcom USMunsi Haque Intel Corporation USBarry Haskell Apple Computer, Inc. USCaspar Horne Self-employed USLouis Kerofsky Sharp Laboratories of America USShawmin Lei Sharp Laboratories of America USMichael Lightstone Nvidia USJiuhuai Lu Panasonic USAjay Luthra Motorola USTom McMahon Dolby Laboratories USRaghavendra Nagaraj Vidiator Technoogly us inc USMandayam Narasimhan Motorola USAtul Puri RealNetworks USWei Qi Vweb Corporation USViji Raveendran Qualcomm, Inc. USYuriy Reznik RealNetworks USJustin Ridge Nokia, Inc. USPhoom Sagetong Qualcomm, Inc. USDavid Singer Apple Computer, Inc. US

19

Huifang Sun Mitsubishi Electric Research Laboratories USShijun Sun Sharp Laboratories of America USKumar Swaminathan Hughes Network Systems USVishwanathan Swaminathan Sun USYasser Syed Cable Television Laboratories USPeter Symes SMPTE USRobert Turney Xilinx Research Laboratories USFeng Chi Wang Conexant Systems, Inc. USGary Sullivan Microsoft Corporation USPeter Schirling IBM Research USAndy Tescher Microsoft Corporation US

20

Annex 2Agenda

Agenda item1. Opening2. Roll call of participants3. Approval of agenda 4. Allocation of contributions 5. Communications from Convenor 6. Report of previous meeting 7. Processing of NB Position Papers 8. Work plan 1. 8.1 Media coding 1.1. MPEG-2 AAC BW Extensions conformance 1.2. AVC Conformance 1.3. AVC Fidelity Range Extensions 1.4. AVC Fidelity Range Extensions Conformance 1.5. AFX Conformance 1.6. AFX Extensions 1.7. Audio Lossless Coding 1.8. Audio Scalable Lossless Coding 1.9. 1-bit Audio Lossless Coding 1.10

. HE-AAC Conformance

1.11.

SA Conformance

1.12.

Scalable Video Coding

1.13.

Streaming Text Format

1.14.

Spatial Audio Coding

1.15.

Video Coding Tool Repository

1.16.

3D AV Coding

8.2 Composition coding 2.1. Audio BIFS Extensions 2.2. Audio BIFS Conformance 2.3. XMT extensions 2.4. Lightweight Scene Representation 2.5. Symbolic Music Representation 8.3 Description coding 3.1. Efficient representation of descriptions 3.2. Video Descriptors 3.3. Audio Descriptors 3.4. MDS user preference extensions 3.5. MPEG-7 Conformance Extensions 3.6. MPEG-7 Profiles

21

3.7. Schema definition 3.8. Extraction and use of MPEG-7 descriptions

extensions 8.4 Systems support 4.1. Carriage of ISAN and V-ISAN metadata 4.2. New audio profile and level signaling 4.3. MPEG-1 Audio access units 4.4. Streaming of MPEG-7 descriptions 4.5. Timestamps and Audio Codec Behavior 8.5 IPMP 5.1. MPEG-2 IPMP-X Conformance 5.2. MPEG-4 IPMP-X Conformance 5.3. Evaluation Tools for Persistent Association 5.4. MPEG-21 IPMP Framework 8.6 Digital Item 6.1. Digital Item Declaration 6.2. Digital Item Binarisation 6.3. DIA Conversions and Permission 6.4. Event Reporting 6.5. MPEG-21 Conformance 6.6. Vision, technologies and strategy 8.7 Transport and File Format 7.1. ISO File Format extensions 7.2. MPEG-21 File Format 8.8 Multimedia architecture 8.1. MPEG-J extension for scene control 8.2. MPEG-J extension for rendering 8.2. Digital Item Processing 8.3. MPEG Multimedia Middleware 8.9 Reference implementation 9.1. AVC Reference Software 9.2. HE-AAC Reference Software 9.3. AFX Reference Software 9.4. AVC Fidelity Range Extensions Reference Software 9.5. MPEG-4 Visual Reference Hardware Description 9.6. MPEG-4 AVC Reference Hardware Description 9.7. MPEG-7 Reference Software Extensions 9.8. MPEG-21 Reference Software 9.9. Test Bed for MPEG-21 Resource Delivery 8.1

0 Application formats

10.1.

Music player Application Format

10.2.

Photo album Application Format

8.11

Maintenance

11.1 Video coding standards 11.2 Audio coding standards

22

11.1 Visual description coding standards 11.2 Audio description coding standards 11.3 MDS standards 9. Liaison matters 10.

Organisation of this meeting

10.1

Tasks for subgroups

10.2

Joint meetings

11.

Administrative matters

11.1

Schedule of future MPEG meetings

11.2

Promotional activities

12.

Planning of future activities

13.

Resolutions of this meeting

14.

A.O.B

15.

Closing

23

Annex 3Input document list

No. Authors Title

10751 Wo Chang Document Register for SC29/WG11 Meeting Redmond, USA

10752 Robert TurneyMarco Mattavelli AHG on MPEG-4 Part 9 Reference Hardware Description Phase 1 and 2

10753Marius PredaMahnjin HanMikael Bourges-Svenier

AHG on AFX documents, CEs, and software

10754Mikael Bourges-SvenierVishy SwaminathanItaru Kaneko

AHG on MPEG-J extensions for rendering

10755T. ChiangYi-Shin TungChung-Neng Wang

AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

10756

L. CieplinskiA. YamadaSang-Kyun KimStephan Herrmann

AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software

10757 Miroslaw BoberSang-Kyun Kim AHG on Description Tools for New Visual Extensions

10758

Mihaela van der SchaarA. BeckerJ. RidgeC.J. Tsai

AHG on Core Experiments in Scalable Video Coding

10759 Aljoscha SmolicHideaki Kimata AHG on 3DAV Coding

10760 Euee S. JangKohtaro Asai AHG on Video Coding Tools Repository

10761 Simon Watt AHG to evaluate responses to the MPEG-21 IPMP CfP

10762 Wo ChangOlivier Avaro AHG on Multimedia Application Format (MAF)

10763Wo ChangAkio YamadaAlan Melby

AHG on MPEG-7 Profiles

10764 Gerrard DruryFrederik De Keukalaere AHG on Core Experiments for MPEG-21 DID 2nd Edition

10765Gerrard DruryFrederik De KeukaleareMunchurl Kim

AHG on Core Experiments for MPEG-21 DIP

10766 FX NuttallAndrew Tokmakoff AHG on MPEG-21 Event Reporting

10767 S. Quackenbush AHG on Spatial Audio Coding

10768 Tilman Liebchen AHG on MPEG-4 Lossless Audio Coding

10769 Paolo NesiGiorgio Zoia AHG on Symbolic Music Representation

24

http://mpeg.nist.gov/reg/_update.php?docnum=10769

mailto:??


mailto:[email protected]

http://mpeg.nist.gov/mpeg/docs/69_Redmond/contrib/m10768.zip


mailto:??




















mailto:??


mailto:??


mailto:??



mailto:??


mailto:??










mailto:??









mailto:??




http://mpeg.nist.gov/reg/_list69.php?k=6,kv=1

http://mpeg.nist.gov/reg/_list69.php?k=5,kv=1

10770Claude SeyratAndreas HutterItaru Kaneko

AHG on XML Structure Binarization and Streaming

10771Jean-Claude DufourdAlexandre Cotarmanac.hJuergen Schmidt

AHG on Scene Representation

10772

Jean GelissenOlivier AvaroIan BurnettYoung-Kwon Lim

AHG on MPEG Multimedia Middleware

10773 P. Schirling AHG on Communicating MPEG to the business Community

10774 Thomas DeMartini Requirement for MPEG-21 Binarization

10775 IEC TC 100 via SC 29 Secretariat

IEC CDV 60728-9/Amd.1: Cable networks for television signals, sound signals and interactive services -- Part 9: Interfaces for cabled distribution systems for digitally modulated signals, Amendment 1 [SC 29 N 5891]

10776 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 15938-4/FDAM 1 [SC 29 N 5892]

10777 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-1:2001/FDAM 3 [SC 29 N 5954]

10778 SC 37 via SC 29 Secretariat

ISO/IEC FCD 19794-6: Information technology -- Biometric data interchange formats -- Part 6: Iris image data [SC 29 N 5958]

10779 SC 37 via SC 29 Secretariat SC 37 NP on Vascular Biometric Image Interchange Format [SC 29 N 5959]


ISO/IEC FCD 19794-5: Information technology -- Biometric data interchange formats -- Part 5: Face image data [SC 29 N 5960]


IEC CDV 62328-1: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 1: General description and architecture [SC 29 N 5961]


IEC CDV 62328-2: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 2: General recording structure [SC 29 N 5962]


IEC CDV 62328-3: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 3: Broadcasting system specific recording structure -- ISDB [SC 29 N 5963]

10784 ITU-T SG 17 via SC 29 Secretariat Liaison Statement from ITU-T SG 17 [SC 29 N 5968]


10786 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 21000-6 [SC 29 N 5981]

10787 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-11/PDAM 4 [SC 29 N 5982]

10788 SC 29 Secretariat Summary of Voting on ISO/IEC TR 13818-5:1997/Amd.1:1999/DCOR 2 [SC 29 N 5998]



10791 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/FPDAM 1 [SC 29 N 6002]

10792 SC 29 Secretariat Summary of Voting on ISO/IEC PDTR 21000-12 [SC 29 N 6008]

10793 TVA via SC 29 Secretariat Liaison Statement from the TV-Anytime Forum [SC 29 N 6015]

25
























































































mailto:??


mailto:??



IEC CDV 62298-1: Teleweb Application -- Part 1: General Description [SC 29 N 6016]


IEC CDV 62298-2: Teleweb application -- Part 2: Delivery methods [SC 29 N 6017]


10797 SC 29 Secretariat Summary of Voting on ISO/IEC CD 21000-10 [SC 29 N 6103]

10798 ITU-R SG 6/WP 6M via SC 29 Secretariat Liaison Statement from ITU-R SG 6/WP 6M [SC 29 N 6022]




10802 a MPEG-21 DIA

10803 Glenn Adams David Singer W3C Comments on the MPEG Timed Text specification

10804 Ralph Sperschneider Study on ISO/IEC 14496-3:2001/FPDAM 3 (MP3onMP4)

10805 Mikael Bourges-Sevenier AhG MPEG-J extensions for rendering, Tokyo meeting report

10806 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-7/FPDAM 1 [SC 29 N 6046]

10807 Niels RumpChris Barlas Relationship between Digital Items and Digital Item Declarations

10808

NavarroSilva Nunes Aragao

2-D IDCT Hardware Accelerator Implementation for Virtex-II Devices



10811 JTC 1 Secretariat via SC 29 Secretariat Summary of Voting on ISO/IEC TR 13818-5:1997/DAM 2 [SC 29 N 6049]

10812 Jean-Claude DufourdOlivier Avaro

Answer to the CfP on LASeR and SAF: Streamezzo format proposal overview

10813 Niels RumpSimon Watt Overview of responses to Call for Proposals for MPEG-21 IPMP

10814 Joerg HeuerAndreas Hutter Answer to Call for Proposal on Lightweight Scene Representation

10815 Jean-Claude DufourdOlivier Avaro Answer to the CfP on LASeR and SAF: Streamezzo LASeR format proposal

10816 Jean-Claude DufourdOlivier Avaro Answer to the CfP on LASeR and SAF: Streamezzo SAF format proposal

10817 Jean-Claude DufourdOlivier Avaro Answer to the CfP on LASeR and SAF: Streamezzo Test Set and Executables

10818 Alexandre CotarmanachRenaud Cazoulat Answer to the CfP on LASeR and SAF

10819 Renaud CazoulatAlexandre Cotarmanach Answer to the CfP on LASeR and SAF

26












































mailto:C.

mailto:O.

mailto:A.

mailto:A.




















mailto:a































10820Robin BerjonGregoire PauClaude Seyrat

Response to the CfP on LASeR : BiM SVG Profile for LASeR

10821J.Dubois L.PierrefeuM.Mattavelli

Motion estimation Hardware Accelerator Implementation for Virtex-II Devices

10822 Robert Prandolini Scalable Video Coding Requirements for Video Surveillance Systems

10823 Wael BadawyTamer Mohamed

An Integrated Hardware-Accelerated Software Framework for MPEG4 Hardware Reference Model

10824Ihab AmerWael BadawyGraham Jullien

AN IP BLOCK FOR MPEG-4 PART 10 CONTEXT-BASED DAPTIVE VARIABLE LENGTH CODING (CAVLC)


A Hardware Block for 2x2 Hadamard Transform and Quantization with Application to MPEG–4 Part 10


A SystemC Description for 2x2 Hadamard Transform and Quantization Block with Application to MPEG–4 Part 10


A Hardware Block for 4x4 Hadamard Transform and Quantization in MPEG-4 Part 10


A SystemC model for 4x4 Hadamard Transform and Quantization witj application to MPEG-4 Part 10


A Hardware Block for THE MPEG-4 PART 10 4x4 DCT-LIKE TRANSFORMATION AND QUANTIZATION


A SYSTEMC MODEL FOR THE MPEG-4 PART 10 4x4 DCT-LIKE TRANSFORMATION AND QUANTIZATION

10831 Thomas DeMartini Editor's Input: DIA AMD/1 WDv2.1

10832Eva RodriguezSilvia LlorenteJaime Delgado

DMAG answer to MPEG-21 Intellectual Property Management and Protection Call for Proposals

10833 Jean-Claude DufourdYoung-Kwon Lim Proposed WD 0.1 of ISO/IEC 14496-20, LASeR and SAF

10834 Olivier Avaroet alii Proposed Draft Core Experiment on LASeR Harmonization with SVG

10835 Olivier Avaroet alii Proposed Draft Core Experiment on LASeR Binary Representation

10836 Young-Kwon Lim Report of the LASeR evaluation meeting

10837 Olivier Avaroet alii LASeR software

10838 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 14496-17 [SC 29 N 6057]

10839Melanie Dulong de RosnayJérôme CaporossiDaniel Lecomte

Answer to the Call for Proposals for MPEG-21 IPMP: Medialiving technology

27






























































































10840 ITU-R SG 6/WP 6Q via SC 29 Secretariat Liaison Statement from ITU-R SG 6/WP 6Q [SC 29 N 6059]



10843 DMP via SC 29 Secretariat Liaison Statement from the Digital Media Project [SC 29 N 6060]

10844 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-1:2001/DCOR 3 [SC 29 N 6064]

10845 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-11/DCOR 2 [SC 29 N 6069]

10846 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-5:2003/DCOR 1 [SC 29 N 6072]


10848

Itaru Kaneko (Tokyo Polytechnic University)Nobuyuk Kinoshita (MMG)Spencer Cheng (Morphbius Technology)

Application Specific Binary Coding (ASBC) of MPEG-21 descriptors for better coding efficiency maintaining interoperability to regular MPEG-21 decoder

10849

Valentin MuresanNoel O’ConnorNoel MurphySean MarlowAlan Smeaton

Low-power hardware acceleration for motion estimation

10850 Carlos SerraoPanos Kudumakis ENTHRONE answer to the Call for Proposal for MPEG-21 IPMP

10851 Wo Chang testing

10852

Yongju ChoYoung-Kwon LimMoonsub SongHyung-Joon Kim

Proposed Resource Reference Box for addressing a sub-part of a media resource

10853 Mauri Väänänen Finnish NB comment: SVC requirements and directions

10854Panos Kudumakis Carlos Serrao Claudio Alberti

MOSES and ENTHRONE answer to the MPEG-21 IPMP CfP

10855

HendryKyung-Ae ChaMunchurl KimKeun Soo Park

Answer to the CfP on MPEG-21 IPMP : A Right Description Model on Resource Combinations

10856

Jeongyeon LimQonita ShahabHendryKyung-Ae ChaMunchurl KimKeun Soo Park

Answer to the CfP on MPEG-21 IPMP : An IPMP Decription Tool for Partial Encryption of Digital Items

10857HendryMunchurl KimKeun Soo Park

Answer to the CfP on MPEG-21 IPMP : REL DIBOs in MPEG-21 DIP for MPEG-21 IPMP

10858 Zhongyang HuangMing JiShengmei ShenTaka Senoh

Answer to the MPEG-21 IPMP CfP: IPMP_Scheme Descriptor and its Processing for Digital Item Protection

28




























































































Takafumi Ueno

10859 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 7 [SC 29 N 6080]

10860 Ian S BurnettGerrard Drury Response to CfP for MPEG-21 IPMP

10861

Sang-Hoon OhSeok-Hoon KimHyung-Sik SuhSang-Gyu LeeBon-Hong So

Response to CfP for MPEG-21 IPMP : Reference Model for IPMP Assessment

10862 Craig Schultz Answer to the CfP on MPEG-21 IPMP

10863 Silva O. Nunes C. Aragao MPEG-4 Inverse Quantizer Hardware Accelerator Implementation in Virtex II

10864Xin WangVenugopal VenkatramanThomas DeMartini

Simple Integration Reference Software for MPEG-21 REL, DID and DIA

10865

J. J. ChaeJ. NamB. J. KimJ. W. Hong

Answer to CfPs for MPEG-21 IPMP

10866

Bin LiLi ZhaoNanshan WuShiqiang Yang

The DRM Framework for Large-scale Broadcast

10867 Tom McMahon AVC FRExt Level Requirements for D-Cinema and High Quality SD/HD Distribution, Contribution, and Backhaul

10868David Taubman none Nagita Mehrseresht none Raymond Leung

SVC Technical Contribution: Overview of recent technology developments at UNSW

10869

Chris BarlasNiels RumpIan BurnettPaul JessopRik van de WalleFernando PereiraSimon WattKate GrantChris RussellBrian Green

MPEG-21 Integration and Outreach

10870 Marco Rittermann A Proposal for Testing Multi-View Video Coding

10871

Jeho NamHyuk-Min Kwon Man-Bae KimSeungji YangTruong Cong ThangRin-Chul KimHae-Kwang Kim

Updated Status of MPEG-21 DIA Utility Software Modules

10872 Ye-Kui Wang Finnish NB comments on 14496-12 Amd.1

10873Victor TorresJaime DelgadoEva Rodriguez

MPEG-21 DIP Core Experiments: A contribution to the implementation of DIBOs for REL

29


















mailto:m

mailto:m

mailto:m

mailto:m

mailto:m

mailto:m

mailto:m

mailto:m

mailto:m
































mailto:A.





















10874

Spencer ChengGene WenNickolay PakoulinVitaly Omelchenko Alexander KoptelovAlexandre Petrenko Alexander Kossatch

Improving MPEG-21 IPMP Conformance - Experience from MPEG-2/4 IPMPX

10875 Shijun Sun Temporal Scalable Coding Using AVC Coding Tools

10876 JTC 1 Secretariat via SC 29 Secretariat Summary of Voting on ISO/IEC DTR 21000-1 (2nd Edition) [SC 29 N 6093]


Liaison Statement from JTC 1/SC 37 on ISO/IEC FCD 19794-5 [SC 29 N 6094]

10878 SC 29 Secretariat Summary of Voting on NP MPEG-A [SC 29 N 6099]

10879 SC 29 Secretariat Summary of Voting on CD MPEG-A [SC 29 N 6101]

10880 Gyeong Ja JangJames D. K. Kim Update of XMT-A for AFX

10881 KNB KNB comment on 14496-11/PDAM4 (XMT & MPEG-J Extensions)

10882 Gyeong Ja JangJames D. K. Kim Updates on the reference software of AFX Encoder

10883

Andrew KinaneValentin MuresanNoel O’ConnorNoel MurphySeán MarlowAlan Smeaton

Hardware Acceleration Module for Shape Adaptive Discrete Cosine Transform

10884 Young-Kwon Lim Proposal on SL-compliant SAF packet headers

10885

Jong-Tae KimWeon-Geun OhHae-Kwang KimHeung-Kyu LeeYoung-Ho Seo

Video Extension to Evaluation Tools for Persistent Association Technologies

10886

Ik-Hwan ChoHae Kwang KimWeon-Geun OhDong-Seok Jeong

The Composition of Test Video Sequences for Evaluation of the robustness of Digital Video Watermarking

10887 JTC 1 Secretariat via SC 29 Secretariat Summary of Voting on ISO/IEC DTR 21000-11 [SC 29 N 6102]

10888 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/FPDAM 6 [SC 29 N 6106]


10890 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-4:200X/FDAM 5 [SC 29 N 6108]

10891Eva RodriguezJaime DelgadoSilvia Llorente

Revised REL Interpretation Conformance after verification of Test Cases

10892

Jeroen BekaertThomas DeMartiniRik Van de WalleHerbert Van de Sompel

Identification of a DIDL Document

10893 Wendy Aylsworth SMPTE Liaison to MPEG on OpenType® and ISO/IEC 14496-18

30






















































































Tom McMahonPeter SymesOliver Morgan

10894

Stephan WürmlinMichael WaschbüschEdouard LamborayPeter KaufmannAljoscha SmolicMarkus Gross

Image-space Free-viewpoint Video

10895

Won-Young YooWeon-Geun OhHae-Kwang KimYong-Seok SeoSung-Hwan Lee

Transaction Watermarking Model for Persistent Association Technologies

10896 AUNB via SC 29 Secretariat

AUNB Contribution on JPEG & MPEG Public Document Archive [SC 29 N 6112]

10897 TVA via SC 29 Secretariat Liaison Statement from the TV-Anytime Forum [SC 29 N 6114]

10898 Mahnjin Han Addition to PointTexture Compression for future extensions

10899

Gyeong Ja JangShinjun LeeJames D.K. KimMahnjin Han

Update on XMT-A specification for encoding parameter of PointTexture Compression

10900 Jean H.A.Gelissen Contribution to MPEG Multimedia Middleware Requirements v.1.0

10901 Francois EdouardVieron Jerome THOMSON requirements for Scalable Video Coding

10902

Francois EdouardBoisson GuillaumeVieron JeromeBottreau VincentGuillemot Christine

Evaluation of Motion accuracy scalability - SVC Core experiment 1a

10903 Boisson Guillaume Improvements of SVC CfP S18 proposal

10904

Vincent BottreauChristine GuillemotRashid AnsariEdouard Francois

SVC Technical Contribution to CE1b: Spatial Transform using Three Lifting Steps

10905 Alexandre Cotarmanac'hVladimir Levantovsky Proposal to amend ISO/IEC 14496-1:2004

10906 A. G. Tescher for USNB USNB Contribution: Proposed CfP for Scalable Audio under MPEG 21

10907 A. G. Tescher for USNB USNB Contribution: Response to Munich resolution 2.2.3

10908 A. G. Tescher for USNB USNB Contribution: "Fidelity Range Extensions" name change

10909 A. G. Tescher for USNB USNB Contribution: Response to Munich resolution 2.2.2

10910 A. G. Tescher for USNB USNB Contribution: The need for additional levels for Visual SP

10911 A. G. Tescher for USNB USNB Contribution: Suggested corrigendum to 13818-1:2000

10912 A. G. Tescher for USNB Proposed conversion of OpenType to an ISO/IEC standard

10913 A. G. Tescher for USNB USNB Contribution: ISO/IEC 14496-17/FCD concerns

10914 SC 29 Secretariat Summary of Voting on ISO/IEC CD 21000-9

31























































































10915 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3:2001/PDAM 6

10916 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-6:2003/FPDAM 1

10917 JTC 1 Secretariat Summary of Voting on ISO/IEC TR 15938-8/DAM 1





10922 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/FPDAM 2


10924 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-11/FPDAM 3


10926 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 15938-10

10927 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-12/FPDAM 1 & 15444-12/FPDAM 1

10928 Wook-Joong KimEuee. S. Jang Consideration on the MAF for omni-directional AV

10929 Ulrich FeckerAndre Kaup Transposed Picture Ordering for Dynamic Light Field Coding

10930 Vladimir Levantovsky Proposal for amendment of ISO/IEC 14496-14

10931 Ulrich BenzlerMathias Wien Results of SVC CE3 (Quality Evaluation)

10932 Ulrich Benzler Discussion on requirements and applications for Scalable Video Coding

10933 Karol WnukowiczWladyslaw Skarbek Dominant Color Temperature Descriptor

10934

Han-Kuang HsuChia-Yang TsaiHsiang-Cheh HuangHsueh-Ming HangTihao Chiang

Response to CE1b in SVC-- SB-Reach Method for Entropy Coding

10935 Vittorio BaronciniTobias Oelbaum

A Multimedia material Visual quality ranking procedure based on Single or Multiple Viewing

10936 Alain MignotPierre Garneau Simplification of AFX/SolidRep node

10937 Patrick GioiaJérôme Royan Proposal for multiresolution urban representation

10938 Robert O'CallaghanMiroslaw Bober Preliminary Results on Situation/View-Based Clustering

10939

HendryMunchurl KimKeunsoo ParkEva RodriguezTorres Jaime Delgado

CE report for Core Experiment on DIBOs for REL

10940 Peter van Beek MPEG-7 User Description Profile Update

10941 Sachin Deshpande HTTP Agent-Driven Content Negotiation for Scalable Video Coding

32









mailto:Victor











































































10942 Shane LaufIan S Burnett Mobile MPEG-21 browser implementation

10943

Zhang HuSun LifengYang ShiqiangCheng Xiaoyu

Results for EE3 on evaluation of MAC for stereoscopic video coding

10944 AUNB AUNB Comments on MPEG-A CD

10945

J. J. ChaeJ. H. NamB. J. KimJ. W. Hong

Comments of the proposed document M10865

10946 Takahiro KimotoYoshihiro Miyamoto Response to SVC Core Experiment 1d. Introduction of a Base-Layer

10947

Sang-Kyun KimSeungji YangYong Man RoJi-Yeun Kim

Consideration on the clustering evaluation method for situation/view based photo clustering experiment (VCE-1)

10948


CE Report for situation/view based photo clustering experiment (VCE-1)

10949


GT set proposed for situation/view based photo clustering experiment (VCE-1)

10950


Consideration on the photo categorization scheme (VCE-2)

10951


Model set and GT set for the photo categorization experiment (VCE-2)

10952

Sun LifengYang ShiqiangCheng XiaoyuLi Fang

Consideration on Quality Measure for Multiview Video

10953


Consideration of face based photo clustering and retrieval

10954 Tamer MohamedWael Badawy Multiple IP-Core Hardware-Accelerated Software System

10955 Akio Yamada Sang-Kyun Kim MPEG-7 Visual XM Document version 20.1

10956 Akio Yamada Sang-Kyun Kim WD 1.1 of MPEG-7 New Visual Extensions

10957 Myriam Amielh Final CE report on MPEG-21 Media Locator

10958 Yoshihiro Miyamoto Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd Edition

33


























mailto:(none)

mailto:(none)


























































10959 Jung Kyunheon Kim Interframe adaptive spatial transform

10960 Wo Chang Update M7ITB Testbed and Available Tools for MPEG-7 Bitstreams Repository

10961 Wo ChangSchuyler Quackenbush MAF Reference Software Workplan Proposal

10962 Wo Chang MAF File Format Proposal

10963

Myriam AmielhErnest WanGerrard DruryIan Burnett

Proposed DIBO for playing a Fragment

10964 AUNB AUNB Contribution: A DIBO for playing a DID fragment

10965 Euee S. JangJa Kim On the status of 3D Mesh Compression in MPEG-4

10966

Euee S. JangLeeChoLee

Initial thoughts on VCTR activity

10967 Euee S. JangAsai AHG on MPEG VCTR

10968 Noboru HaradaYongshan Yu

Proposal of CE for improved floating-point compression in ALS (Audio Lossless Coding)

10969 Yutaka KamamotoNoboru Harada Proposal of CE on Multi channel extension for ALS (Audio Lossless Coding)

10970 Li Fang Test Incomplete 3D Synthesis Method for Multiview Video

10971Christian Timmereron behalf of the Austrian NB

ANB comments on 21000-2 CD 2nd Edition


ANB comments on 21000-8 CD


ANB comments on 21000-10 CD

10974

Christian TimmererStephen DavisItaru KanekoSpencer ChengRobbie De Sutter

Report of CE on MPEG-21 Binarisation

10975 Hideaki KimataMasaki Kitahara Anchor bitstreams for experiments on multiple view video coding (3DAV)

10976 Hideaki KimataMasaki Kitahara Preliminary results on multiple view video coding (3DAV)

10977 Soo-Jun ParkMyung Gil Jang

Cross verification of Model set and GT set for the photo categorization experiment (VCE-2)

10978 Christian TimmererHermann Hellwagner Comments on DIA AMD1 WDv2

10979 Soo-Jun Park Cross verification of GT set proposed for situation/view based photo

34











































mailto:Kohtaro



mailto:Youngryul

mailto:Yongho

mailto:Sunyoung




mailto:Mi
























mailto:Seyoon

Myung Gil Jang clustering experiment (VCE-1)

10980 Soo-Jun ParkMyung Gil Jang

Cross verification reprot of situation/view based photo clustering experiment (VCE-1)

10981 Soo-Jun ParkMyung Gil Jang Dataset of VCE-1 and 2

10982

Yesun JoungWon-Sik CheongJihun ChaKyuheon KimYoung-Kwon Lim

Comments on LASeR Harmonization with SVG



10985 OMA via SC 29 Secretariat Liaison Statement from the Open Mobile Alliance (OMA) [SC 29 N 6121]

10986 Soo-Jun ParkChee Sun Won A proposal for a hierarchical grouping of digital photos CE

10987Julien ReichelGuillaume BaudFrancesco Ziliani

Responses of CE1e in SVC: Adaptive update step in MCTF

10988Diego Santa CruzJulien ReichelFrancesco Ziliani

Responses of CE1d: Base-Layer

10989 Francesco Ziliani Summary of responces to Ce1d: Inroduction of a Baser Layer

10990Ji MingHuang ZhongyangTaka Senoh

Suggestions on the scope of MPEG-21 IPMP Standardization

10991 LEE SgNB Comment on the Lossless Audio Coding Work

10992 SC 37 Liaison Officer Liaison Statement from SC 37 Biometrics

10993PateuxAmonouKervadec

A generic framework for MCTF-based coding

10994 Helge Drumm CE - Shadow: Preliminary Results on Reference Software Implementation

10995PateuxAmonouKervadec

France Telecom Requirements for Scalable Video Coding

10996

Ingo WolfBernhard FeitenTeodora Guenkova-LuyAndreas SchorrFranz HauckAndreas J. Kassler

MPEG-21 DIA based delivery using SDPng and RTP

10997Ihor KirenkoRene van der VleutenFons Bruls

Flexible Scalable Video Compression

10998Gero BäseAndreas HutterPeter Amon

Requirements for a scalable video coding standard

10999 Jean-Claude Dufourd Comments on LASeR and SVG

35






















mailto:[email protected]%C3%A9phane














mailto:CJ



















































Olivier Avaro

11000

Zhongyang HuangMing JiShengmei ShenTaka Senoh

Metadata protection in ISO Base File Format Amendment

11001 Heiko PurnhagenWerner Oomen CT/Philips contribution to CfP on spatial audio coding

11002 James Ingram Position Paper on the SMR Draft Call for Proposals

11003

Itaru Kaneko (Tokyo Polytechnic University)Mark Callow (HI Corporation)

Comments on MPEG-4 part 21 MPEG-J extension forrendering

11004 Ray Taylor MPEG-7 Systems extensions, TVAnytime indexing core experiments

11005 Martin Link Subjective results formal verification test MPEG4-Ext2. (Parametric)

11006 Adam Lindsay ID3v2 Tags in MPEG-A

11007 Kate Grant for UKNB UKNB position on patent statements

11008 Kristofer Kjörling New profile proposal combining HE-AAC and Parametric Stereo

11009Per EkstrandAndreas SchneiderKristofer Kjörling

Proposed additions to Sbr conformance testing

11010 Konstantin Hanke SVC CE1e - Verification of Visiowave Results on Adaptive Update Step in MCTF

11011 Konstantin Hanke Response to SVC CE1e - Spatial Highpass Transition Filtering

11012 DANAE Consortium Licensing status of software in SVC standardization

11013 Chris Barlas ISO/IEC 21000-6 COR/1 WD v.1 Editor's Input

11014 Masayuki TanimotoToshiaki Fujii Utilization of inter-view correlation for multiple view video coding

11015Naoya TanakaKok-Seng ChongKazuhiro Iida

Technical Description and Performance Test Results of Panasonic Spatial Audio Coding

11016

Joeri BarbarienAdrian MunteanuYiannis AndreopoulosFabio VerdicchioJan CornelisPeter Schelkens

Prediction-based scalable motion vector coding

11017

Thomas WediTeruhiko SuzukiYoshihisa YamadaTakuya ImaideTom McMahonStijn de WaeleByeong-Moon JeonStephen GordonNorio Ito

Definition of a 4:2:0 / 8-bit Profile for H.264/AVC FRExt

11018 Eunmi OhMiyoung Kim Proposed changes in MPEG-4 BSAC multi-channel audio coding

36













































































11019

Paolo NesiGiorgio ZoiaPierfrancesco BelliniJerome BarthelemyJames IngramDavid Crombie

Draft Evaluation Criteria for Assessing SMR Proposals

11020 Thomas Wedi Verification of HHI Results for Core Experiments on AVC-Based Scalable Video Coding

11021

Paolo NesiPierfrancesco BelliniJerome BarthelemyJames IngramNeil McKenzie

Examples of matching SMR aspects and available technologies

11022

Giorgio ZoiaPierfrancesco BelliniJerome BarthelemyPaolo NesiMikael Bourges-Sevenier

Graphic functionality in MPEG-4 and Symbolic Music Representation

11023 Masanori SANO Some thoughts on MPEG-7 Profiling

11024 Masanori SANO MPEG-7 Core Description Profile Update

11025

Paolo NesiGiorgio ZoiaJames IngramPiefrancesco Bellini

Study on Draft CfP on Symbolic Music Representation

11026JungHoe KimSangWook KimEunmi Oh

Comments on MPEG-4 BSAC Conformance

11027 van der Meer Inputs on study text of timed text FCD (part 17)

11028 Juergen SchmidtOliver Baum Study Text of ISO/IEC 14496-11/2003 FPDAM-3

11029 Juergen SchmidtKlaus Eilts-Grimm Simple Integration Reference Software for MPEG-4 AudioBIFS, version 3

11030 Mariam Kimiaei AsadiJean-claude Dufourd Possible missing features in MPEG-21 DIA

11031 Karsten MüllerAljoscha Smolic

View-Dependent Multi-Texturing for MPEG-4 AFX, Syntax and Se-mantics Specification Update

11032 John R. SmithAlan Melby

CE Results on Addressing Scheme for MPEG-21 using MPEG-7 Media Locators

11033 Matthias GruhneJan Rohden Proposed Core Experiment on Audio Rhythm Patterns

11034

Joerg HeuerAndreas HutterAndrea Kofler-VogtHarald Kosch

CE-Report on Evaluations of the Siemens Index System

11035 Werner OomenHeiko Purnhagen Proposed corrigenda to AMD2, (parametric)

11036 Joerg HeuerAndreas HutterAndrea Kofler-Vogt

Stream Reordering for Fast Random Access

37











































mailto:Jan











































Harald Kosch

11037 Werner Oomen Complementary information to Formal verification test parametric

11038

Stephan WürmlinChristopher LeeMatthias ZwickerMichael WaschbüschMarkus GrossHanspeter Pfister

Results on Reference Software Implementation on Point based Rendering for MPEG-4 AFX

11039 Leszek CieplinskiSoroush Ghanbari Preliminary Results of SVC CE1c

11040 Mathias Wien CE2.4 Adaptive Spatial Transforms: Verification of HHI results

11041

Joseph MeehanMinhua ZhouJennifer WebbFelix Fernandes

MPEG4 Simple-Profile Level 4 and 5 Proposal

11042 Woo-Jin Han Verification of SAIT results for SVC on CE1a Motion Scalability

11043Heiko SchwarzDetlev MarpeThomas Wiegand

SVC Core Experiment 2.1: Inter-layer prediction of motion and residual data

11044 Detlev MarpeThomas Wiegand SVC Core Experiment 2.1: Inter-layer prediction of motion and residual data

11045

Y. AndreopoulosA. MunteanuM. van der SchaarJ. CornelisP. Schelkens

Comparison Between t+2D and 2D+t Architectures with Advanced Motion Compensated Temporal Filtering

11046

Alexandru SalomieAdrian MunteanuRudi DeklerckPeter Schelkens

Proposal for the XMT-A specifications for MeshGrid

11047 Woo-Jin HanSang-Chang Cha Verification of OES/ITRI results for SVC on CE1c Intra Prediction


SVC Core Experiment 2.2: Influence of the update step on the coding efficiency

11049 Woo-Jin HanHo-Jin Ha Verification of VisioWave results for SVC on CE1d Base Layer

11050Woo-Jin HanSang-Chang ChaJae-Young Lee

Verification of MSRA results for SVC on CE1e Deblocking


SVC Core Experiment 2.3: Spatial interpolation


SVC Core Experiment 2.4: Adaptive Spatial Transforms

11053Woo-Jin HanHo-Jin HaBae-Keun Lee

Responses of SVC CE1a Motion Scalability; Interpolated motion layer

38

















































































11054 Woo-Jin HanSang-Chang Cha Responses of SVC CE1c Intra Predictionl; Pixel-interpolated prediction

11055 Woo-Jin HanHo-Jin Ha Responses of SVC CE1d Base Layer; R-D optimized base-layering

11056Woo-Jin HanSang-Chang ChaJae-Young Lee

Responses of SVC CE1e Deblocking; In-loop prediction smoothing

11057 Jean-Claude Dufourd FNB comment on LASeR

11058

Rongshan YuXiao LinSusanto RahardjaHaibin Huang

Proposed WD3 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable Lossless Coding (SLS)

11059 Rongshan Yu Crosscheck on FhG’s Proposed Core Experiment for MPEG-4 Audio Scalable to Lossless (SLS) Coding

11060 Tilman Liebchen Verification Report on MPEG-4 ALS Core Experiment 5 (Coding of LPC Coefficients)

11061 Tilman LiebchenYuriy A. Reznik

Proposed Text of ISO/IEC 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS)

11062

Rongshan YuSusanto RahardjaXiao LinHaibin Huang

Reduce Complexity for MPEG-4 Audio Scalable Lossless (SLS) Coding

11063 Tilman Liebchen Proposed Core Experiment on Higher Predictor Orders in MPEG-4 ALS

11064

Andrew TokmakoffYoungjoo SongKyunghee JiSenator Jeong

CE-Report on MPEG-21 Event Reporting

11065 Schuyler Quackenbush DRAFT Procedures for the Evaluation of Spatial Audio Coding Systems

11066Marius PredaFrançoise PreteuxOlivier Marre

Morphing Appearances

11067Julien ReichelFrancesco ZilianiJean Claude Michelou

Requirements for Scalable Video Coding for Video Surveillance Applications

11068 Marius PredaFrancoise Preteux Textual BBA

11069 Vatis Jörn Ostermann Verification of HHI Results for Core Experiment on Scalable Video Coding

11070 Vatis Jörn Ostermann verification of HHI results for core experiment on scalible video coding

11071 Ralph Sperschneider Problem with buffer fullness derivation in the case of number_of_raw_data_blocks_in_frame>0 and protection_absent=0

11072 Ralph Sperschneider Status on MPEG-4 Audio Conformance

11073 Ralph Sperschneider Proposed ISO/IEC 14496-3:2004 (Audio 3rd Edition)

11074Davide MaestroniMarco TagliasacchiStefano Tubaro

Responses of CE1d in SVC: Base Layer

11075 Juergen HerreChristof Faller

Fraunhofer/Agere Submission to Spatial Audio CfP

39



















mailto:Yuri


mailto:Yuri




























































C. SpengerJ. HilpertK. Linzmeier

11076 Juergen Herre Evaluation of Spatial Audio Coding Schemes

11077Thomas DeMartiniHerbert Van de SompelJeroen Bekaert

Status of mpegRA activity

11078 Ralf Geiger Proposed WD4 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable Lossless Coding (SLS)

11079 Ralf GeigerJuergen Herre On the Performance of MPEG-4 SLS RM4

11080 S. QuackenbushH. Purnhagen Description of Audio Codec Behavior

11081

Jeroen BekaertFrederik De KeukelaereHerbert Van de SompelRik Van de Walle

Requirement for MPEG-21 DID

11082 French National Body FNB Position on SVC Standardization

11083 Michael Good Response to Draft Call for Proposals N6457

11084

Gregoire Pau Beatrice Pesquet-PopescuMihaela van der SchaarJerome Vieron

Delay-Performance Trade-Offs in Motion-Compensated Scalable Subband Video Compression

11085 Gregoire PauBeatrice Pesquet-Popescu Cross-verification of RWTH results on SVC CE-1e

11086

Christian TimmererKlaus LeopoldDietmar JannachHermann Hellwagner

Contribution to DIA AMD1 WDv2

11087Joerg HeuerGabriel PanisAndreas Hutter

Considerations for efficient Resource Adaptation based on MPEG-21 DIA

11088 Charith Abhayaratne SVC Core Experiment CE1b - Summary

11089 Matt Fellers Proposed Test Items for MPEG Spatial Audio Coding

11090

Matt FellersMark VintonMark DavisGrant Davidson

Dolby Laboratories Submission to CfP on MPEG-4 Spatial Audio Coding

11091Debargha MukherjeeHuisheng WangSam Liu

On BSD Transformation Instructions - Streaming Implementation and updates

11092

Daniel LarkinValentin MuresanNoel E. O'ConnorNoel MurphySeán MarlowAlan Smeaton

Hardware Acceleration Module for MPEG-4 binary shape coding motion estimation

11093 Eric Gsell FRExt Extended Bit Depth Characterization

40














































































11094 Walter GishHyung-Suk Kim FRExt Bit Depth Interoperability

11095 Diego Santa CruzYukihiro Bandoh Cross-verification of results for SVC on CE1d

11096 Thomas RusertMathias Wien

Multi-Layered Motion Estimation with Constrained Enhancement (SVC CE1a)

11097 Ali TabatabaiRohit Puri Multiple description coding for generalized layering

11098BlaszakDomanskiLange

Results in SVC CE2: mode selection and spatial upsampling

11099 Rafal LangeMarek Domanski Response to SVC CE2 tasks: inter-layer motion information prediction

11100Deepak TuragaAli TabatabaiMinh Do

Multiresolution Representation of Motion Information for Scalable Video Coding

11101

Lukasz BlaszakMarek DomanskiRafal LangeAdam Luczak

Response to SVC CE2 tasks: testing of SNR scalability technologies

11102 FNB FNB Position Paper on MPEG applications, context and objectives

11103 Alexandre Cotarmanac'h Updated software for SL extension

11104

Valentin MuresanDaniel LarkinAndrew KinaneNoel O’Connor

Status of CDVP's contribution to MPEG-4 Part 9 - Implementation Study Group

11105 Hiroshi YasudaTakuyo Kogure Digital Cinema QOS and Conformance

11106

Justin RidgePer FröjdhJonathan TehWoo-Jin Han

Mobile communications industry comments on SVC requirements

11107

Justin RidgeMarta KarczewiczYiliang BaoShawn Wang

Extension to AVC-based scalable video coding

11108 Justin Ridge Comment regarding SVC software selection

11109 Mikael Bourges-Sevenier Update of XMT-A and MPEG-J standards

11110 Gerrard DruryIan Burnett Comments on Identification of DID a Document

11111 Mikael Bourges-SevenierVishy Swaminathan Considerations for MPEG-J extensions for rendering

11112 Yuriy A. Reznik Verification Report on MPEG-4 ALS Core Experiment 4 (Coding of Random Access Frames)

11113 Gerrard DruryIan Burnett Response to Comments on DIP CD

11114 Yuriy A. Reznik Proposed CE on Additional Enhancements for Lossless Audio Coding

41

































mailto:na

mailto:na

mailto:na





































mailto:Rafal

mailto:Marek

mailto:Lukasz


















11115 Wo Chang Testing

11116 BD Founders via SC 29 Secretariat Liaison Statement from Blu Ray Disk Founders

11117

Chun-Jen TsaiChung-Neng WangChih-Hung LiYin-Tzu ShihChen-Wei FanJien-Peng Ho

Scalable Multimedia Streaming Test Bed for Media Coding and Testing in Streaming Environments

11118 Myriam Amielh Issues relating to the use of URI Fragment Identifiers in MPEG-21

11119Hsin-Hao ChenGuo-Zua WuYi-Jung Wang

Responses of CE1c in SVC: Exploiting the Spatial Correlation within the Low-Pass Frames

11120 Edouard FrancoisThomas Rusert CE1a : cross verification of MSRA proposal

11121 John R. SmithAlan K. Melby Revised Logical Media Locator for MPEG-7 & MPEG-21

11122 Giovanni Cordara CE1a: TILAB-PdM solution

11123 Ji Jizheng Xu Verification of NCTU results for SVC on CE1b, entropy coding

11124 Xiong Jizheng Xu Verification of TILAB/PdM results for SVC on CE1a

11125 Song Jizheng Xu Verification of SUMSUNG results for SVC on CE1c

11126 Xiong Jizheng Xu Feng Wu

Spatial Scalability in 3D Wavelet Coding with Spatial Domain MCTF Encoder

11127 Ji Jizheng Xu Debin Zhao Feng Wu Responses of CE1d in SVC: Base layer

11128 Xiong Jizheng Xu Feng Wu Responses of CE1a in SVC: Scalable Motion

11129 Song Jizheng Xu Hongkai Xiong Feng Wu Responses of CE1e in SVC: Adaptive update based on human vision system

11130 Zhang Jizheng Xu Hongkai Xiong Feng Wu Sub-pixel phase over-complete sub-band transform

11131Zang Wenpeng Ding Jizheng Xu Hanqin Lu Feng Wu

Responses of CE1b in SVC: Direction prediction for spatial transform

11132Chen Jae Hoon Kim Joaquín López Antonio Ortega

Illumination compensation for inter view Multi View Video Compression

11133 Guillemot, Liebl, Stockhammer, Jenkac

Discussion on requirements and applications of Scalable Video Coding for MBMS

11134 Jeremie FarretOlivier Bellis Solid implementation into IM1

11135Chen Jae Hoon Kim Joaquín López and Antonio Ortega

Anchor encoding results for the ST and Aquarium multi view sequences

11136 Feng PanYin Sun

SVC CE1e - Verification of MSRA Results on MCTF adaptation in the temporal update step

42







mailto:George

mailto:George

mailto:George












mailto:George

mailto:George

mailto:George



mailto:Cunxun

mailto:Cunxun

mailto:Cunxun



mailto:Dongdong

mailto:Dongdong



mailto:Li

mailto:Li



mailto:Ruiqin

mailto:Ruiqin



mailto:Xiangyang

mailto:Xiangyang




mailto:Ruiqin

mailto:Ruiqin



mailto:Li



mailto:Ruiqin



mailto:Xiangyang





































11137 Joohee KimHyeyeon Kim Responses to SVC CE1a: scalable motion information coding

11138 HsinHao Chen Verification Report of Samsung results for SVC on CE1c: Intra-prediction

11139 Giovanni Cordara CE1a : cross verification of Samsung proposal

11140 Han-Kuang HsuHsueh-Ming Hang Verification of MSRA results for SVC on CE1b, entropy coding

43












Annex 4Output document list

No. Source Title6481 Convener List of Documents from the Redmond, USA Meeting6482 Convener Resolutions of the Redmond, USA Meeting6483 Convener List of AHGs Established at the 69th Meeting in Redmond, USA6484 Convener Report of the 68th Meeting in Redmond, USA6485 Convener Guidelines for Electronic Distribution of MPEG and WG 11 Documents6486 Convener Press Release of the 69th Meeting in Redmond, USA6487 Convener Meeting Notice of the 70th Meeting in Palma de Mallorca, ES6488 HoD Guide for WG 11 Meeting Hosts6489 HoD MPEG 1016490 Requirements MPEG-4/2 Profiles under Consideration6491 Requirements Study of FCD ISO/IEC 15938-96492 Requirements Requirements for MPEG-21 IPMP6493 Requirements Draft of PDTR for potential second edition of ISO/IEC 21000-116494 Requirements Call for Evidence for Multi-view Video Coding6495 Video Request for 14496-2:2004 Amd.2 6496 Video Text of 14496-2:2004 PDAM2 New Levels in Simple Profile6497 Video Request for 14496-4:2004 Amd.106498 Video Text of 14496-4:2004 PDAM10 New Levels in Simple Profile

Conformance6499 Systems Request for ISO/IEC 14496-20 Lightweight Application Scene

Representation and Simple Aggregation Format6500 Systems Text of ISO/IEC 14496-20 CD Lightweight Application Scene

Representation and Simple Aggregation Format6501 Requirements Requirements for Multi-view Video Coding6502 Convener AHG on Font Format Representation6503 Convener AHG on MPEG-21 Integration and Outreach6504 Convener AHG on MAF6505 Requirements Requirements for Scalable Video Coding6506 ISG Updated Call for the Submission of Hardware Reference Code for MPEG-4

Part 9: Reference Hardware Description6507 ISG Template for MPEG-4 Part 9 HDL module documentation6508 ISG CVS server user manual and code format specification for MPEG-4 Part-9

submissions and maintenance Rev. 0 6509 ISG Status of HDL submissions and commitments for MPEG-4 Part-96510 Convener AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2.6511 ISG ISO/IEC FPDAM 15938-6 Information Technology -Multimedia Content

Description Interface- part 6: Reference Software Extensions6512 ISG DoC of ISO/IEC PDAM 15938-6 Information Technology -Multimedia

Content Description Interface- part 6: Reference Software Extensions6513 Testing Results of the visual assesment of the results of the CEs on Scalable Video

Coding Technology6514 Video MPEG-4 Visual: List of Problems Reported version 13.06515 Video WD 2.0 of 14496-4 Visual Bitstreams Conformance Corrigendum6516 Video WD 2.0 of MPEG-7 New Visual Extensions

44

6517 Video MPEG-7 Visual XM Document version 21.06518 Video Description of Core Experiments for MPEG-7 New Visual Extensions6519 Video WD 1.0 of ISO/IEC 21000-13 Scalable Video Coding6520 Video Scalable Video Model Version 2.06521 Video Description of Core Experiments in MPEG-21 Scalable Video Coding6522 Video Study of Video Coding Tools Repository6523 Convener AHG on Maintenance of MPEG-4 Visual related Documents, Reference

Software and Conformance6524 Convener AHG on Maintenance of MPEG-7 Visual related Documents and Reference

Software6525 Convener AHG on Description Tools for New Visual Extensions6526 Convener AHG on Core Experiments in Scalable Video Coding6527 Convener AHG on Scalable Video Model and SVC Reference Software6528 Convener AHG on 3DAV Coding6529 Convener AHG on Video Coding Tools Repository6530 Requirements M3W Requirements6531 Convener AHG on M3W6532 JVT Disposition of NB Ballot Comments on ISO/IEC 14496 4/FPDAM6 AVC

Conformance6533 JVT Text of ISO/IEC 14496-4/FDAM6 AVC Conformance6534 JVT Text of ISO/IEC 14496-4/PDAM9 AVC Fidelity Range Extensions

Conformance6535 JVT Disposition of NB Ballot Comments on ISO/IEC 14496 5/FPDAM6 AVC

and HE AAC Reference Software6536 JVT Text of ISO/IEC 14496 5/FPDAM6 AVC and HE AAC Reference Software6537 JVT Text of ISO/IEC 14496-5/PDAM8 AVC Fidelity Range Extensions

Reference Software6538 JVT Disposition of NB Ballot Comments on ISO/IEC 14496 10/FPDAM1 AVC

Professional Extensions6539 JVT Text of ISO/IEC 14496 10/FDAM1 AVC Fidelity Range Extensions6540 JVT Text of ISO/IEC 14496 10 Advanced Video Coding 3rd Edition6541 JVT Request for Corrigendum for ISO/IEC 14496-10 Advanced Video Coding6542 JVT Working Draft 1 of Corrigendum for ISO/IEC 14496-10 Advanced Video

Coding6543 SNHC AFX Reference software FPDAM76544 SNHC ISO/IEC 14496-16/PDAM16545 SNHC ISO/IEC 14496-16/DCOR16546 SNHC AFX CE description6547 SNHC AFX VM 15.06548 SNHC SNHC FAQ 12.06549 SNHC ISO/IEC 14496-21 WD 1.06550 Requirements Summary of font format standardization activities in WG116551 Liaison Liaison Statement to the Digital Media Project6552 Liaison Liaison Statement to the DCCSDP6553 Liaison Liaison Statement to the OMA6554 Liaison Liaison Statement to JTC 1/SC 376555 Liaison Liaison Statement to ITU-T SG 176556 Liaison Liaison Statement to ITU-R SG 6/WP 6M 6557 Liaison Liaison Statement to W3C on MPEG Timed Text specification

45

6558 Liaison Liaison Statement to Blu Ray Disk Founders6559 Liaison Liaison Statement to IEEE LTSC6560 Liaison Liaison Statement to SMPTE on OpenType® and ISO/IEC 14496-186561 Liaison Liaison Statement to W3C on Public Workshop on Metadata for Content

Adaptation6562 Liaison Liaison Statement to VCEG6563 Liaison Liaison Statement to TVAF6564 Liaison Liaison Statement to JSR-2396565 Liaison Liaison Statement to IEC TC 1006566 Liaison Liaison Statement to SMPTE on Alpha Channel and AVC/H.264 Frext6567 Liaison Statement of benefits from establishing a class C liaison with the DMP6568 Liaison Statement of benefits from establishing a class C liaison with the DCCSDP6569 Liaison Statement of benefits from establishing a class C liaison with the OMA6570 Liaison Responses to NB Comments6571 Liaison List of WG11 Liaisons6572 SNHC Request for ISO/IEC 14496-16/AMD16573 JVT Liaison statement to ATSC on ISO/IEC 14496 10 FRExt amendment work6574 JVT Liaison statement to AVS China on ISO/IEC 14496 10 FRExt amendment

work6575 JVT Liaison statement to DVB on ISO/IEC 14496 10 FRExt amendment work6576 JVT Liaison statement to DVD Forum on ISO/IEC 14496 10 FRExt amendment

work6577 JVT Liaison statement to EBU on ISO/IEC 14496 10 FRExt amendment work6578 JVT Liaison statement to IMTC on ISO/IEC 14496 10 FRExt amendment work6579 JVT Liaison statement to ITU-R SG 6 on ISO/IEC 14496 10 FRExt amendment

work6580 JVT Liaison statement to ITU-T SG 9 on ISO/IEC 14496 10 FRExt amendment

work6581 JVT Liaison statement to MPEGIF on ISO/IEC 14496 10 FRExt amendment

work6582 Systems Text of ISO/IEC 13818-1:2000/DCOR36583 Systems Study Text of ISO/IEC 13818-1:2000/FPDAM46584 Systems DoC on ISO/IEC 13818-1:2000/FPDAM56585 Systems Text of ISO/IEC 13818-1:2000/FDAM56586 Systems DoC on ISO/IEC 14496-1/DCOR36587 Systems Text of ISO/IEC 14496-1/COR36588 Systems Request of ISO/IEC 14496-1:2004 Amd.16589 Systems Text of ISO/IEC 14496-1:2004/PDAM16590 Systems DoC on ISO/IEC 14496-11/FPDAM36591 Systems Text of ISO/IEC 14496-11/FDAM36592 Systems DoC on ISO/IEC 14496-11/PDAM46593 Systems Text of ISO/IEC 14496-11/FPDAM46594 Systems Text of ISO/IEC 14496-11/COR26595 Systems Study Text of DoC on ISO/IEC 14496-12/FPDAM16596 Systems Study Text of ISO/IEC 14496-12/FPDAM16597 Systems Study Text of DoC on ISO/IEC 14496-17/FCD6598 Systems Study Text of ISO/IEC 14496-17/FCD6599 Systems Core Experiment on LASeR Binary Representation6600 Convener Terms of Reference

46

6601 Convener MPEG Standards6602 Convener Table of unpublished standards at FDIS level6603 Convener Work plan and time line6604 Convener Work item assignment6605 Convener List of patent statements received6606 Systems Core Experiment on LASeR Harmonization with SVG6607 Systems WD1.0 of ISO/IEC 14496-20 Reference Software6608 Systems Core Experiments for Systems Extensions6609 Systems MPEG-7 Systems reference software workplan6610 Systems DoC on ISO/IEC 21000-9/CD6611 Systems Text of ISO/IEC 21000-9/FCD6612 Systems Technology under consideration for 21000-96613 Systems Text of ISO/IEC 21000-16/CD6614 Convener AHG on XML Structure Binarization and Streaming6615 Convener AHG on Scene Representation6616 Integration ISO/IEC13818-4/FDAM1 IPMP Conformance Ext.6617 Integration DoC on ISO/IEC13818-4:200X/FPDAM2 Audio Conformance Ext.6618 Integration ISO/IEC13818-4:2004/FDAM2 Audio Conformance Ext.6619 Integration DoC on ISO/IEC 13818-5/PDTR IPMP Reference Software Ext.6620 Integration ISO/IEC 13818-5/Dam1 IPMP Reference Software Ext6621 Integration ISO/IEC 13818-5:1997/Amd1:1999/COR26622 Integration DoC on ISO/IEC 14496-4/FPDAM8 HE-AAC, ABIFS and SA

Conformance6623 Integration ISO/IEC 14496-4/FDAM8 HE-AAC, ABIFS and SA Conformance6624 Integration DoC on ISO/IEC13818-4/FPDAM1 IPMP Conformance Ext6625 Integration DoC on ISO/IEC 14496-5/FPDAM7 AFX reference software6626 Integration ISO/IEC 14496-5/FDAM7 AFX reference software6627 Integration DoC on ISO/IEC 21000-8/CD MPEG-21 reference software6628 Integration ISO/IEC 21000-8/FCD MPEG-21 reference software6629 Integration DoC on ISO/IEC 21000-12/PDTR Test Bed for MPEG-21 Resource

Delivery6630 Integration ISO/IEC 21000-12/DTR Test Bed for MPEG-21 Resource Delivery6631 Convener AHG on the Communicating MPEG to the business Community6632 Convener AHG on MPEG 1016633 MDS DoC on ISO/IEC 15938-5 FPDAM/26634 MDS ISO/IEC 15938-5 FDAM/2 “MDS User Preference Extensions”6635 MDS DoC on ISO/IEC 15938-5 DCOR/16636 MDS ISO/IEC 15938-5 COR/16637 MDS DoC on ISO/IEC 15938-7 FPDAM/16638 MDS ISO/IEC 15938-7 FDAM/16639 MDS DoC on ISO/IEC 15938-10 FCD 6640 MDS ISO/IEC 15938-10 FDIS “Schema Definition”6641 MDS DoC on 21000-2 CD 2nd Edition – Digital Item Declaration6642 MDS ISO/IEC 21000-2 DID 2nd Edition FCD6643 MDS Status of Registration Authority for DII6644 MDS ISO/IEC 21000-4 WD v.1 “IPMP”6645 MDS MPEG-21 REL/RDD Software Implementation Plan v.76646 MDS ISO/IEC 21000-6 DCOR/1 6647 MDS MPEG-21 DIA PDAM/1 “Conversions and Permissions”

47

6648 MDS ISO/IEC 21000-7 COR/1 WD v.16649 MDS MPEG-21 DIA Software Implementation Plan v.86650 MDS Workplan for Core Experiment on Text Capabilities of Terminals6651 MDS Workplan for Core Experiment on Conversion Parameters6652 MDS Workplan for Core Experiment on Bitstream Adaptation in Constrained and

Streaming Environments6653 MDS DoC on ISO/IEC 21000-10 CD6654 MDS ISO/IEC 21000-10 FCD “Digital Item Processing”6655 MDS MPEG-21 DIP Software Implementation Plan v.36656 MDS ISO/IEC 21000-15 WD v.2 “Event Reporting”6657 Convener AHG on Media Locators6658 Convener AHG on MPEG-21 IPMP6659 Convener AHG on MPEG-21 DIA6660 Convener AHG on MPEG-21 DIP6661 Convener AHG on MPEG-21 Event Reporting6662 Convener AHG on AFX documents, CEs, and software6663 Convener AHG on MPEG-J extensions for rendering6664 Convener AHG on Audio Standard Maintenance6665 Convener AHG on Spatial Audio Coding6666 Convener AHG on MPEG-4 Lossless Audio Coding6667 Convener AHG on Symbolic Music Representation6668 Convener AHG On Exploration of Scalable Audio and Speech Coding6669 Audio Text of 13818-7:2004/DCOR 1 “AAC ADTS buffer fullness correction”6670 Audio DoC on 14496-3:2001/FPDAM 3, MPEG-1/2 Audio in MPEG-46671 Audio Text of 14496-3:2001/FDAM 3, MPEG-1/2 Audio in MPEG-46672 Audio Text of 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS)6673 Audio Text of 14496-3:2001/PDAM 5, Scalable Lossless Coding (SLS)6674 Audio Text of 14496-3:2001/FPDAM 6, Lossless coding of 1-bit oversampled

signals6675 Audio Formal Verification Report on MPEG-4 Parametric Audio Coding6676 Audio Status of Performance and Complexity of MPEG Lossless Audio Coding

Architectures6677 Audio Proposed 3rd Edition of 14496-36678 Audio Study on High-Sampling Rate for MPEG-1/2 Layer III6679 Audio Proposed Enhancements to MPEG-4 BSAC multi-channel6680 Audio Workplan for Audio Lossless Coding (ALS)6681 Audio Workplan for Scalable Lossless Coding (SLS)6682 Audio Timestamps and Audio Codec Behavior6683 Audio Status of MPEG-4 Audio Conformance6684 Audio Proposed New Audio Conformance Bitstreams for BSAC6685 Audio Workplan for Audio Rhythmic Pattern6686 Audio Application Formats Framework6687 Audio DoC on 23001-1:200X CD, “Player Application Format”6688 Audio Text of 23001-1:200X FCD, “Player Application Format”6689 Audio Call for Proposals for Symbolic Music Representation6690 Audio DRAFT SMR Evaluation Procedure6691 Audio Workplan for the Evaluation of Spatial Audio Coding Responses6692 Convener AHG on MPEG-7 Interoperability and Profiling6693 Convener MPEG Items Completed

48

6694 HoD MPEG General Audio Codecs6695 JVT Liaison statement to SCTE on ISO/IEC14496 10 FRExt amendment work6696 Convener AHG on MPEG-7 Audio6697 Audio Request for Subdivision to ISO/IEC 23000-1

49

Annex 5Report of Requirements meeting

Source: Rob Koenen, InterTrust Technologies

NB: this report does not duplicate the resolutions, but rather complements them. This implies that not all output documents and not all Ad Hoc Groups are explicitly listed in the report below.

Monday 9:00-13:00 opening plenary meeting 13:30-14:30 Lunch (ends one hour after plenary ends)

14:30-15:30

MPEG-21 Technical Reports – Requirements Plenary10876 Summary of Voting on ISO/IEC DTR 21000-1 (2nd Edition) - JTC 1 Secretariat 10887 Summary of Voting on ISO/IEC DTR 21000-11 [SC 29 N 6102] - JTC 1 Secretariat 10885 Video Extension to Evaluation Tools for PATs - Jong-Tae Kim, et,.al.10886 The Composition of Test Video Sequences for Evaluation of the robustness of Digital

Video Watermarking - Ik-Hwan Cho, Hae Kwang Kim, Weon-Geun Oh, Dong-Seok Jeong

10895 Transaction Watermarking Model for PAT - Won-Young Yoo, et.al.

Lassen

15:30-16:30

Joint with JVT10867 AVC FRExt Level Requirements for D-Cinema and High Quality […] - Tom McMahon11017 Definition of a 4:2:0 / 8-bit Profile for H.264/AVC FRExt - Thomas Wedi, et.al.11116 Liaison Statement from Blu Ray Disk Founders - BD Founders via SC 29

Cascade

17:00-18:00

IPMP Responses and Associated Submissions – Joint with MDS and Systems Transfer of the work from Requirements to standards development

10813 Overview of responses to Call for Proposals for 21 IPMP - Niels Rump, Simon Watt10860 Response to CfP for 21 IPMP - Ian S Burnett, Gerrard Drury10865 Answer to CfPs for 21 IPMP - J. J. Chae, J. Nam, B. J. Kim, J. W. Hong10866 The DRM Framework for Large-scale Broadcast - Bin Li, et.al. 10945 Comments of the proposed document M10865 - J. J. Chae et.al.10850 ENTHRONE answer to the Call for Proposal for 21 IPMP - Serrao, Kudumakis10858 IPMP_Scheme Descriptor and its Processing for DI Protection – ZY Huang et.al.10990 Suggestions on the scope of 21 IPMP Standardization - Ji Ming, e.al.10832 DMAG answer to 21 IPMP Call for Proposals - Eva Rodriguez, et.a.10839 Answer to […]: Medialiving technology - Melanie Dulong de Rosnay, e.al.10854 MOSES and ENTHRONE answer to the 21 IPMP CfP - Panos Kudumakis , et.al.10855 Answer […]: A Right Description Model on Resource Combinations - Hendry, e.al.10856 Answer […] An IPMP Description Tool for Partial Encryption of DI’s - Jeongyeon Lim,

et.al.10857 Answer to the CfP on 21 IPMP : REL DIBOs in 21 DIP for 21 IPMP - Hendry, et.al.10862 Answer to the CfP on 21 IPMP - Craig Schultz

Lassen

Tuesday

09:00-11:00

MPEG-4 Visual Profiles, joint with Video11041 MPEG4 Simple-Profile Level 4 and 5 Proposal - Joseph Meehan, e.al.10910 USNB Contribution: The need for additional levels for Visual SP - USNB

SVC Requirements – Joint with Video10822 Scalable Video Coding Requirements for Video Surveillance Systems - Robert

Prandolini10901 THOMSON requirements for Scalable Video Coding - Francois Edouard, Vieron

Jerome10995 France Telecom Requirements for Scalable Video Coding - Pateux, Amonou,

Kervadec10998 Requirements for a scalable video coding standard - Bäse, Hutter, Amon11067 Requirements for SVC for Video Surveillance Applications - Reichel, et.el.11106 Mobile communications industry comments on SVC requirements - Justin Ridge, et.al. 10932 Discussion on requirements and applications for Scalable Video Coding - Ulrich

Benzler11082 FNB Position on SVC Standardization - French National Body

Kodiak

50

11:00-11:45

MAF – joint with Systems, Audio, Video, MDS10762 AHG on Multimedia Application Format (MAF) - Wo Chang, Olivier Avaro10961 MAF Reference Software Workplan Proposal - Wo Chang, Schuyler Quackenbush10962 MAF File Format Proposal - Wo Chang

MAF Requirements

Audio

11:45-12:45 Joint with Audio10906 USNB Contribution: Proposed CfP for Scalable Audio under MPEG 21 - USNB Audio

13:00-14:00 Lunch

14:00-15:00

Joint with Systems10893 SMPTE Liaison to MPEG on OpenType® and ISO/IEC 14496-18 - Wendy Aylsworth,

et.al.10912 Proposed conversion of OpenType to an ISO/IEC standard - A. G. Tescher for USNB

Lassen

15:00-16:30

MPEG-21 Requirements – joint with MDS (and Systems for the Binarization)10774 Requirement for 21 Binarization - Thomas DeMartini10848 Application Specific Binary Coding (ASBC) of 21 descriptors for better coding

efficiency maintaining interoperability to regular 21 decoder - Itaru Kaneko et.al. (briefly)

10807 Relationship between Digital Items and Digital Item Declarations - Niels Rump, Chris Barlas

10892 Identification of a DIDL Document - Bekaert, DeMartini, Van de Walle, Van de Sompel11110 Comments on Identification of DID a Document - Gerrard Drury, Ian Burnett11081 Requirement for 21 DID - Bekaert, De Keukelaere, Van de Sompel, Van de Walle

Lassen

16:30-17:00

MPEG-21 Joint with Integration, MDS10869 21 Integration and Outreach - Chris Barlas, et.al.10874 Improving 21 IPMP Conformance - Experience from 2/4 IPMPX – Spencer Cheng,

et.al.

Lassen

17:00-18:00 Review of IPMP work (joint with MDS?) LassenWednesday

09:00-11:00

Plenary meeting

11:30-13:00

MPEG-7 Profiles etc. – joint with MDS, others10763 AHG on 7 Profiles - Wo Chang, Akio Yamada, Alan Melby10940 7 User Description Profile Update - Peter van Beek10960 Update M7ITB Testbed and Available Tools for 7 Bitstreams Repository - Wo Chang11023 Some thoughts on 7 Profiling - Masanori SANO11024 7 Core Description Profile Update - Masanori SANO11147 Liaison Statement from IEEE-LTSC - IEEE-LTSC

Lassen

13:00-14:00 Lunch

14:00-14:30M3W – Joint with Systems

10900 Contribution to MPEG Multimedia Middleware Requirements v.1.0 - Jean H.A.Gelissen

Lassen

14:30-16:30

16:30-17:00 Joint with MDS on MPEG-21 IPMP Progress10861 Response […]: Reference Model for IPMP Assessment - Sang-Hoon Oh, et.al. Lassen

17:00 - later Social Event Museum

Thursday09:00-09:15 OpenType as MPEG spec – joint with Systems Lassen

09:30-11:00Persistent Association Technologies, 3DAV, SVC and – joint with Video

(Final?) Approval of SVC Requirements Document (Final?) Approval of 3DAV Requirements Document

Kodiak

11:00-12:00 OpenType as MPEG spec – joint with Systems Lassen

12:30-13:00 Joint with JVT on FRExt Profiles (Naming and Levels) Cascade

13:00-14:00 Lunch 14:00-14:30 Symbolic Music Representation – joint with Audio

Approval of CfP Lassen

14:30-15:30MAF Joint Meeting with Audio, Video, MDS, Systems (and Wo)

MAF FCDMAF Requirements Document?

Lassen

15:30-16:45 Approval of Study of MPEG-7 Profiles FCD Lassen

51

Friday

09:00-10:00

ConcludingSVC Requirements – Ulrich BenzlerMPEG-4/2 Profiles under Consideration – Kristofer KjörlingM3W Requirements - Jean GelissenMPEG-21 IPMP Requirements document – Brad

Lassen

12:30-14:00 Lunch 14:00-22:10 Plenary meeting Audito

52

MPEG-4

Part 2: Adding Levels 4a and 5 to Simple Visual Profile11041 MPEG4 Simple-Profile Level 4 and 5 Proposal - Joseph Meehan, e.al.10910 USNB Contribution: The need for additional levels for Visual SP - USNB

Levels like these are already used in industry, without being based on an actual MPEG-defined conformance point. They extend the range of Simple Visual Profile to higher bitrates and resolutions. Adding them to MPEG-4 Visual as compliance points is a good idea. Enough support was shown from industry in m11041. Level 4a is slightly different than 4 in Advanced Simple because VGA resolution is the target. The Video group will start an Amendment.

Need to produce and cross-check the bitstreams: TI, Sarnoff, VBrick, Xilinx committed to doing this work. It was agreed that Advanced Simple @ Lx decoder should be able to decode Simple @Lx bitstreams to keep that part of the hierarchy.

Part 3: New Audio Profile?A request was put forward in a joint meeting with Audio for the definition of a new MPEG-4 Audio profile that combines AAC, SBR and Parametric Stereo tools. The proposed profile was added to the Profiles under Consideration document (N6490), and the requirements Group asked for support in a resolution.

Part 10: AVC FRExt Profiles (Joint discussions with JVT)11017 Definition of a 4:2:0 / 8-bit Profile for H.264/AVC FRExt - Thomas Wedi, et al.11116 Liaison Statement from Blu Ray Disk Founders - BD Founders via SC 29 Secretariat10867 AVC FRExt Level Requirements for D-Cinema and High Quality […] - Tom McMahon

The 4:2:2/8 profile was dropped. Several proposals were discussed for merging two profiles into one, possible addressing some factors in the Level definitions, but that approach was rejected. In the end, the following profiles were defined, with their names:

4:2:0/8 bit: High 4:2:0/10: High 10 4:2:2/10: High 4:2:2 4:4:4/12: High 4:4:4

Part 18 (?): OpenType as MPEG-4 part?10893 SMPTE Liaison to MPEG on OpenType® and ISO/IEC 14496-18 - Wendy Aylsworth, et.al.10912 Proposed conversion of OpenType to an ISO/IEC standard - A. G. Tescher for USNB

OpenType was selected a technology in the past, and met the requirements. At that point it could only be referenced by MPEG because necessary copyrights were not released to ISO for producing and ISO standard. Copyright. There is now a new desire to have this as a formal ISO standard. It is understood that MPEG usually does not rubberstamp external specifications, and also in this case a process would be followed starting with the past assessment in MPEG on font representation technology. There is a requirement to that this new part of the MPEG-4 standard do not break any references, when such references to OpenType are replaced by references to this MPEG-4 part (applies to both MPEG and non-MPEG standards).

53

An assessment (N6440) was written that summarizes the past work and lists past recommendations and conclusions. The new work would start from the past efforts.

MPEG-710763 AHG on 7 Profiles - Wo Chang, Akio Yamada, Alan Melby10940 7 User Description Profile Update - Peter van Beek10960 Update M7ITB Testbed and Available Tools for 7 Bitstreams Repository - Wo Chang11023 Some thoughts on 7 Profiling - Masanori SANO11024 7 Core Description Profile Update - Masanori SANO

A study of FCD (N6491) was created that corrects some inconsistencies in the FCD. It also clarified the difference between description profiling and systems profiling: description Profiles collect restrictions on the pure declarative XML. Systems Profiles collect restrictions on what will actually happen to them if they are binarized, transmitted, stored, etc.

11147 Liaison Statement from IEEE-LTSC - IEEE-LTSCMPEG looks forward to receiving the mapping of metadata as described in this liaison contribution.

MPEG-21

Part 2: ID for DID document?10807 Relationship between Digital Items and Digital Item Declarations - Niels Rump, Chris Barlas10892 Identification of a DIDL Document - Bekaert, DeMartini, Van de Walle, Van de Sompel11110 Comments on Identification of DID a Document - Gerrard Drury, Ian Burnett

The issue of having an ID for a DID document was resolved. The resolution is detailed in the MDS report.

Part 4: MPEG-21 IPMP10813 Overview of responses to Call for Proposals for 21 IPMP - Niels Rump, Simon Watt10860 Response to CfP for 21 IPMP - Ian S Burnett, Gerrard Drury10865 Answer to CfPs for 21 IPMP - J. J. Chae, J. Nam, B. J. Kim, J. W. Hong10866 The DRM Framework for Large-scale Broadcast - Bin Li, et.al. 10945 Comments of the proposed document M10865 - J. J. Chae et.al.10850 ENTHRONE answer to the Call for Proposal for 21 IPMP - Serrao, Kudumakis10858 IPMP_Scheme Descriptor and its Processing for DI Protection – ZY Huang et.al.10990 Suggestions on the scope of 21 IPMP Standardization - Ji Ming, e.al.10832 DMAG answer to 21 IPMP Call for Proposals - Eva Rodriguez, et.a.10839 Answer to […]: Medialiving technology - Melanie Dulong de Rosnay, e.al.10854 MOSES and ENTHRONE answer to the 21 IPMP CfP - Panos Kudumakis , et.al.10855 Answer […]: A Right Description Model on Resource Combinations - Hendry, e.al.10856 Answer […] An IPMP Description Tool for Partial Encryption of DI’s - Jeongyeon Lim, et.al.10857 Answer to the CfP on 21 IPMP : REL DIBOs in 21 DIP for 21 IPMP - Hendry, et.al.10862 Answer to the CfP on 21 IPMP - Craig Schultz

The MPEG-21 IPMP work was transferred to the MDS group. With relevant experts, this group started to look at integration, analyzing simple uses. That work will continue in an AHG meeting. Please see the MDS report for details.

10861 Response […]: Reference Model for IPMP Assessment - Sang-Hoon Oh, et.al.What was presented in this contribution would not be applicable to the current evaluation of proposals, but could become something along the lines of the PAT Technical Report, but now for IPMP tools. The group decided that more clarity on the nature of MPEG-21 IPMP was needed before the merit of the proposal could be discussed,

10874 Improving 21 IPMP Conformance - Experience from 2/4 IPMPX - Spencer Cheng, et.al.

54

Contribution presented interesting tools. Again, the group wanted to first see more clarity on what MPEG-21 IPMP is before making/discussing more concrete proposals.

Part 11: Persistent Association Technologies10876 Summary of Voting on ISO/IEC DTR 21000-1 (2nd Edition) - JTC 1 Secretariat 10887 Summary of Voting on ISO/IEC DTR 21000-11 [SC 29 N 6102] - JTC 1 Secretariat

Technical Reports of part 1 and 11 were approved as there were no comments in the respective ballots; both will now be published.

10885 Video Extension to Evaluation Tools for PATs - Jong-Tae Kim, et,.al.This contribution proposes to extend PAT with Video-specific information. See below for the discussion.

10886 The Composition of Test Video Sequences for Evaluation of the robustness of Digital Video Watermarking - Ik-Hwan Cho, Hae Kwang Kim, Weon-Geun Oh, Dong-Seok Jeong

Contribution suggests adapting choice of sequences for to watermarking techniques? Inclusion of recommendations on sequences seems a good idea. Individual sequences could be included or referenced depending on their copyright.

10895 Transaction Watermarking Model for PAT - Won-Young Yoo, et.al.No reference model for transactional watermarking yet in the PAT Technical Report (this is also called ‘active fingerprinting’). This was considered a good use case for both audio and video. The contribution provides test parameters for Video transactional watermarks

After hearing these contributions, the group discussed extending the PAT work towards video, as had been the original intention. The requirements Group thinks this is a good idea, and it could be done in a second edition if there are enough experts to complete the task. In a joint meeting with Video, this was discussed, and some support was given. The group decided to start the work in an AHG – but the AHG was unfortunately never approved in the final MPEG plenary due to an oversight (the work is now going to be done and contributed to the next meeting by individual MPEG members). A proposal for a Working Draft for a 2nd edition was approved (N6493)

At next meeting, we will assess the support for the activity and decide future actions.

Part 13: SVC10822 Scalable Video Coding Requirements for Video Surveillance Systems - Robert Prandolini10901 THOMSON requirements for Scalable Video Coding - Francois Edouard, Vieron Jerome10995 France Telecom Requirements for Scalable Video Coding - Pateux, Amonou, Kervadec10998 Requirements for a scalable video coding standard - Bäse, Hutter, Amon11067 Requirements for SVC for Video Surveillance Applications - Reichel, et.el.11106 Mobile communications industry comments on SVC requirements - Justin Ridge, et.al. 10932 Discussion on requirements and applications for Scalable Video Coding - Ulrich Benzler

There were many requirements contributions, which is a positive sign indicating interest for the work. Together, these present an analysis of requirements from the different viewpoints of various industries. The break-out group analyzed the requirements and derived an overall prioritization, denoted by ‘shall’, ‘should’, and ‘may’. There were some conflicting requirements; scalability was seen as more important to some than to others. The mobile industry seems to be ready to use it if it exists, but only if it doesn’t compromise efficiency. The surveillance industry seems to be willing to take some decrease in coding efficiency in return for scalability. A table was added to the Requirements Document (N6505) that summarizes the requirements from different constituencies. Wording was added to stress that different industries have different priorities, and that the codec will ideally accommodate these requirements as different modes.

55

10853 Finnish NB comment: SVC requirements and directions - Mauri VäänänenFinnish NB presented a contribution on requirements. It requests AVC as a base layer and calls attention to the importance of low delay (both are now adequately reflected in the Requirements Document) and remarks that some scenarios are unrealistic, but fails to mention which exactly.

11082 FNB Position on SVC Standardization - French National BodyThe French NB calls for the work not to be delayed. The meeting confirmed there are no plans to delay the work.

Binarization Tuesday 20 July 2004, 15:05 (Binarization)10774 Requirement for 21 Binarization - Thomas DeMartiniRequirement that (de)binarization process is neutral with respect to canonicalization was added to

requirements document (N6492)

10848 Application Specific Binary Coding (ASBC) of 21 descriptors for better coding efficiencyIt was suggested that this could be done using DIXO’s. MDS will study and revisit the request if this not the case

11081 Requirement for 21 DID - Bekaert, De Keukelaere, Van de Sompel, Van de WalleThe requirement was changed to

4.2.4.3 Support expressing the equivalence (including bit-equivalence) of Media resources in an unambiguous and interoperable way

and accepted in the MPEG-21 Requirements Document.

MPEG-21 Outreach10869 21 Integration and Outreach - Chris Barlas, et.al.The perception among some outside of MPEG (and even some insiders) is that “MPEG-21 is complicated set of specifications”. This work should mitigate that impression by mapping concrete MPEG-21 technologies on actual business practices. The activity would then explain how the different elements can be integrated to suit the needs of a particular industry. The group thought this was an excellent idea. It was decided to start with the motion pictures industries in an AHG.

MAF (MPEG-A)10762 AHG on Multimedia Application Format (MAF) - Wo Chang, Olivier Avaro10961 MAF Reference Software Workplan Proposal - Wo Chang, Schuyler Quackenbush10962 MAF File Format Proposal - Wo Chang

MAF Requirements The MAF’s are going to FCD at this meeting. We had a discussion on which file format to use, together with Systems, Video and Audio groups. It was decided that the ISO file format, with .mp4 extension, would be most appropriate. The file could contain MPEG-21 specific data and MPEG-4 players without knowledge of MPEG-21 would be able to understand that this is data they don’t understand – and to skip it. It was noted that play lists are more elegantly and compactly done in MPEG-21 than in MPEG-7. A remaining question is whether the MPEG-21 data should be XML or binary or if both would be allowed.

56

Explorations

Scalable Audio Coding10906 USNB Contribution: Proposed CfP for Scalable Audio under MPEG 21 - USNB A proposal for a new work item for scalable audio coding contained different elements. The discussion focused on whether this work would concentrate on:

Scalable coding, or Generic Coding, harmonizing Speech and Audio, or both simultaneously

Applications would include multicast scenarios, with truncation at points of replication, and applications that don’t know in advance what the source is going to be. Uses cases need to be developed and the desirable compression efficiency, functionality and other benchmarks need to be documented. Comparisons to the state of the art would be included in a requirement study.

It was considered too early to issue any public Call for Information at this meeting. MPEG should first get an internal understanding on the goal and merits of such a new work item before inviting external comments.,

3DAVA preliminary Call for Evidence (N6494) was approved and issued for Multiview Video Coding. The accompanying requirements (N6501), extracted from the general 3DA requirements, were approved as well.

Symbolic Music RepresentationThe Requirements group reviewed and approved the Call for Proposals for Symbolic Music Representation, edited by the Audio Group. The evaluation procedure was still draft, and was therefore put into a separate document.

M3WA new version of the requirements document was approved (N6530). It is worth noting that requirements were added for the management of multimedia resources.

57

Annex 6Report of Systems meeting

Source: Systems Chair and Break-out group ChairsTitle: Systems Meeting ReportEditor: Olivier Avaro (France Telecom R&D)

Contributors: Olivier Avaro (France Telecom R&D), Claude Seyrat (Expway), Oliver Baum (Fraunhofer IIS), David Singer (Apple)

OverviewThe main outputs of the meeting from the Systems Sub-group perspective are:

No. Title TBP Available

13818-1:2000/DCOR.3 Correction for Field Picture6582 Text of ISO/IEC 13818-1:2000/DCOR3 No 04/07/23

13818-1:2000/Amd.4 Metadata Application Format CP6583 Study Text of ISO/IEC 13818-1:2000/FPDAM4 No 04/07/23

13818-1:2000/Amd.5 New Audio P&L Signaling6584 DoC on ISO/IEC 13818-1:2000/FPDAM5 No 04/07/236585 Text of ISO/IEC 13818-1:2000/FDAM5 No 04/07/23

14496-1 :2003/Cor Items for Corrections6586 DoC on ISO/IEC 14496-1/DCOR3 No 04/07/236587 Text of ISO/IEC 14496-1/COR3 No 04/07/23

14496-1 :2003/Amd.1 Text Profile Descriptor6588 Request of ISO/IEC 14496-1:2004 Amd.1 No 04/07/236589 Text of ISO/IEC 14496-1:2004/PDAM1 No 04/07/23

14496-11 :2003/Amd.3 Audio BIFS Extensions6590 DoC on ISO/IEC 14496-11/FPDAM3 No 04/07/236591 Text of ISO/IEC 14496-11/FDAM3 No 04/07/23

14496-11:2003/Amd.4 XMT and MPEG-J Extensions6592 DoC on ISO/IEC 14496-11/PDAM4 No 04/07/236593 Text of ISO/IEC 14496-11/FPDAM4 No 04/08/136594 Text of ISO/IEC 14496-11/COR2 No 04/07/23

14496-12:2003/Amd.1 ISO File Format Extensions6595 Study Text of DoC on ISO/IEC 14496-12/FPDAM1 No 04/07/236596 Study Text of ISO/IEC 14496-12/FPDAM1 No 04/07/30

14496-17 Streaming Text Format6597 Study Text of DoC on ISO/IEC 14496-17/FCD No 04/07/236598 Study Text of ISO/IEC 14496-17/FCD No 04/07/30

14496-20 LASeR6499 Request of ISO/IEC 14496-20 No 04/07/236500 Text of ISO/IEC 14496-20/CD No 04/07/236599 Core Experiment on LASeR Binary Representation No 04/07/236606 Core Experiment on LASeR Harmonization with SVG No 04/07/236607 WD1.0 of ISO/IEC 14496-20 Reference Software No 04/07/23

58

15938-1 Systems6608 Core Experiments for Systems Extensions No 04/07/236609 MPEG-7 Systems reference software workplan No 04/07/23

21000-9 MPEG-21 File Format6610 DoC on ISO/IEC 21000-9/CD No 04/07/236611 Text of ISO/IEC 21000-9/FCD No 04/07/306612 Technology under consideration for 21000-9 No 04/07/30

21000-16 MPEG-21 Binary Format6613 Text of ISO/IEC 21000-16/CD No 04/07/23

Explorations and Support6530 Requirements on the MPEG Multimedia Middleware No 04/07/23

General issues

GeneralThe meeting report from München has been approved.

List of standards under development

Pr

Pt Edit.

Project

Description CfP WD CD FCD FDIS

2 1 2000 Amd.4 Metadata Application Format CP

03/10

04/03

04/10

2 1 2000 Cor.3 Correction for Field Picture 04/07

04/10

4 1 2004 Amd.1 Text Profile Descriptors 04/07

05/01

05/07

4 11 2003 Amd.4 XMT and MPEG-J Extensions

03/10

03/12

04/07

05/01

4 17 2003 1st Ed. Streaming Text Format 03/03

03/07

03/12

04/10

4 20 2004 1st Ed. Lightweight Application Scene

04/03

04/07

04/10

05/03

21 9 200x 1st Ed. File Format 03/12

04/03

04/07

05/01

21 16 200x 1st Ed. Binary Format 04/03

04/07

04/10

05/03

Standing Documents

Pr

Pt Documents No. Meeting

4 13 MPEG IPMP Extensions Overview N6338 04/03 München21 xx MPEG Multimedia Middleware Context and

ObjectivesN6335 04/03 München

59

DemonstrationsNone.

FAQThe FAQ were updated as needed.

AOBNone.

60

MPEG-2 Systems (13818-1)

13818-1:2000 Amd.4

Topics1. ISAN and VISAN Signaling.

ContributionsM10920: Document not available. In addition, WG11 received feed-back from its members that client bodies for this technology were preparing a thorough review of the current document. In order to benefit from this important feed-back and because there were no opposition, it is decided to delay the progression of this specification until the next meeting.

Technical Work in Progress.

13818-1:2000 Amd.5

Topics1. New Audio Profile and Level Indication; 2. Audio_Type Table split for ISO reserved and User Private

ContributionsM10921: See DoC and Text of Amd.

Technical Work Finalized.

13818-1:2000 Cor. 3

Topics1. Correction on Field Picture

ContributionsM10911: USNB Contribution: Suggested corrigendum to 13818-1:2000 related to MPEG-2 field pictures. Suggestion accepted and corrigendum started.


MPEG-2 Exploratory Activities

TopicsM10907: USNB Contribution: Response to Munich resolution 2.2.3. on the consideration of the potential for definition of a form of ISO/IEC 13818-1 (MPEG-2 Systems) operation in which the PCR requirement is relaxed. Concern regarding potential interoperability problems that could be caused by the relaxation of the PCR requirement (or the creation of a separate profile or similar domain-specific difference in MPEG-2 TS requirements for this purpose). Suggestion to use of the "Private Stream" feature (preferably with registration of the Private Stream type) to support the desired functionality, as the MPEG-2 TS PCR is optional for such streams. Noted.

61


14496-1:2003 Cor. 3M10844 : Summary of Voting on ISO/IEC 14496-1:2001/DCOR 3. GNB comment. Already taken into account in 3rd Ed (considered as editorial).


14496-1:2003 Amd.1M10905: Proposal to amend ISO/IEC 14496-1:2004. Proposition accepted. Production of request of CD and CD.


62

MPEG-4 Scene Description (14496-11)

14496-11:2003 Cor. 2

Topics1. Miscellaneous Corrigenda Item.

ContributionsM10845: No comment. Promotion to Cor.


14496-11:2003 Amd.3

Topics1. Advanced Audio Buffer Node;2. AudioChannelConfig;3. Pre-defined effects using ExterProto;4. Support for Ambisonic.

ContributionsM10924, M11028: See DoC and Text of FDAM.M11029: See Integration report.


14496-11:2003 Amd.4

Topics1. XMT Extensions;2. MPEG-J Extensions.

ContributionsM11109: Update of XMT-A and MPEG-J standards. Proposed re-organization of the XMT-A schema to facilitate maintenance of the specification. Accepted. Proposed updates of MPEG-J APIs. Accepted. Note that it would be good to have the template of the nodes made publicly available. Decision to make it available on the CVS under MPEG-4 Systems 2 as well as the executable that generates the various Systems documentation (Mikael).

M10881: KNB comment on 14496-11/PDAM4 (XMT & MPEG-J Extensions).

M10787: See DoC and Text of FPDAM.


63

ISO File Format (14496-12)

14496-12:2003 Amd.1

Topics1. Support for Static Metadata;2. Support for IPMP at the File Format Level.

ContributionsM10927, M10872, M1100: See DoC and Text of FDAM.

Considered NB Comments from Sweden, Finland, UK, US, Singapore on 14496-12, prepared DoCR, FDAM in one week. Request approval for the FDAM and a second edition now, contingent on (1) no more NB comments being received and (2) on the FDAM ballot passing.

M10930: Proposal for amendment of ISO/IEC 14496-14. Not needed. Registration will be done through the RA.


64

Streaming Text (14496-17)

Topics1. Coded Representation of Text Stream.

ContributionsM10913: USNB Contribution: ISO/IEC 14496-17/FCD concerns. Refers to comments made in M10838. See disposition of comments.

M10803, M10838: W3C Comments on the MPEG Timed Text specification, Summary of Voting on ISO/IEC FCD 14496-17. See disposition of comments.

M11027: Inputs on study text of timed text FCD (part 17). Taken into account in the production of Study text.


65

Font Compression and Streaming (14496-18)

Exploratory Activities

Topics1. OpenType Standardization

ContributionsM10893, M10912: SMPTE Liaison to MPEG on OpenType® and ISO/IEC 14496-18 and USNB. Proposed conversion of OpenType to an ISO/IEC standard. OpenType was already selected in response to the Call on Font Format Representation and Compression. OpenType was used as an external normative reference. Agreement that OpenType can be standardized if due process is followed. The technology already fit in the scope of the previous Call on Font Representation. Owners of the OpenType solutions shall propose it as an input contribution with appropriate copyright statement.


66

LASeR (14496-20)

Topics1. Lightweight Application Scene Representation

ContributionsM10812, M10814, M10815, M10816, M10817, M10818, M10819, M10820: Answers to the CfP on LASeR and SAF. All answers were processed at the Paris meeting and reviewed during the AHG in Redmond as well as in the Systems subgroup. Results of this evaluation process is reflected in M10836 (Report of the LASeR evaluation meeting ), M10833 (Proposed WD 0.1 of ISO/IEC 14496-20, LASeR and SAF), M10834 (Proposed Draft Core Experiment on LASeR Harmonization with SVG), M10835 (Proposed Draft Core Experiment on LASeR Binary Representation) and M10837 (LASeR software).

M10884: Proposal on SL-compliant SAF packet headers. This contribution was discussed and used to harmonized the draft WD as much as possible with 14496-1. Results of this discussion is reflected in the LASeR CD.

M10982, M10999: Comments on LASeR Harmonization with SVG. Comments on LASeR and SVG. Used to progress the harmonization process with SVG.

M11057: FNB comment on LASeR. Noted. The LASeR specification progressed as planned and the WD1.0 was promoted to CD.


67


GeneralJoint meeting about MPEG-7 profile

M11023: Some thoughts on MPEG-7 Profiling: Some very first proposal about MPEG-7 Systems profiles and levels have been proposed:

- levels: AU size, AU granularity, AU synchronization with the media. - Profiles: exclusive use of TeM and BiM, joint use of BiM and TeM.

M11004: MPEG-7 Systems extensions, TVAnytime indexing core experiments: Adapt TV-Anytime indexing solution to B-Tree indexing and evaluate options (index size and performance). Use the extended test set. The contribution shows that index list and B-tree indexes have complementary usage mostly dependent on application usage. Therefore the contribution recommends not dropping Index list in favour of B-Tree. Contribution m11004 is adopted as a base for a first draft which is included a core experiment about indexing. A core experiments is set up to evaluate the integration within the MPEG-7 Systems framework and to clarify use cases covered by this technology.

M11034: CE-Report on Evaluations of the Siemens Index System: The contribution presents results of the core experiments related to indexing BiM bitstreams.

M11036: Stream Reordering for Fast Random Access: The contribution presents possible improvements of the indexing framework to provide more random access functionalities. Further work on this item is welcome.


68

MPEG-21 File Format (21000-9)

21000-9

Topics1. MPEG-21 File Format

Contributions

M10914, M10852: Considered NB Comments from US, Korea on 21000-9, prepared DoCR, FCD available in a week. Request NBs to look at the technologies under consideration.

Given ongoing work on new tools in MPEG-21 such as IPMP, and Event Reporting, should the file format be delayed in case this work affects it? Or should it proceed on schedule as we expect little or no impact, or the delay would be unacceptable? The ad-hoc recommends proceeding.

Systems like the secretariat to be asked to include 14496-12 second edition (see below) with any purchase of 21000-9. See Systems res.

Realized, with MDS, that we need a URL fragment syntax for ISO-family files, would like contributions on requirements and solutions. We adjusted the fragment syntax for MPEG-21 files, to leave 'space' for this work. These fragments (the part after a "#" in a URL) might include stream selection, time selection, sub-scene or object selection, selection based on meta-data, and so on.

The current file format (Part 12) allows meta-data boxes within (and thus attached to) presentations (moov box) and streams (trak box). This is appropriate for meta-data attached to media-data. It also allows a meta-box at file level when the meta-box contains the primary entry point into the file, such as an MPEG-21 DID. MPEG-7 is currently allowed in all three places. Is there, however, meaning to MPEG-7 meta-data that is not attached to media data? Allowing this effectively defines an MPEG-7 packaged file format, which perhaps is not desired.


69

MPEG-21 Binary Format (21000-16)

21000-16

Topics1. Binarization of MPEG-21 Data

ContributionsM10774: Requirement for MPEG-21 Binarization. Contribution about schema based canonicalization requirements. This requirement is already satisfied by BiM. Accepted.

M10848: Application Specific Binary Coding (ASBC) of MPEG-21 descriptors for better coding efficiency maintaining interoperability to regular MPEG-21 decoder: The contribution proposes to use specific schema within the MPEG-21 framework assuming that mapping with MPEG-21 schemas is available. Further work is expected within DIP to understand the applicability of this proposal in MPEG-21. Application specific coding should be evaluated in relation with MPEG-21 DIP.

M10974: Report of CE on MPEG-21 Binarisation. This contribution presents the results of the MPEG-21 binarization. Significant testset has been gathered and binarization tests conducted. Several bugs have been identified.


70

Multimedia Application Formats (23000)

Topics1. Application specific format framework;2. Usage of MP3 in MP4 with metadata;3. Usage of JPEG in MP4 with metadata.

ContributionsM10961, M10962: See REQ and Audio meting report.


71

Other Exploratory Activities

Multimedia Middleware

Topics1. Use cases;2. Middleware Architecture;3. Multimedia APIs.

ContributionsM10900: Contribution to MPEG Multimedia Middleware Requirements v.1.0. Working session to complete the requirements document with multimedia specific requirements. Requirements updated.


72

Latest References and Publication Status

Pr Pt Standard No. Issue Status Doc. with Purpose2 1 ISO/IEC 13818-1/Amd.7 Published 2000/122 1 ISO/IEC 13818-1:2000 (MPEG-2 Systems 2nd

Edition)00/12 Published 2000/12

2 1 ISO/IEC 13818-1:2000/COR1 (FlexMux Descr.) N3844 01/01 Pisa Published 2002/032 1 ISO/IEC 13818-1:2000/Amd.1 (Metadata on 2) + COR2 N5867 03/07

TrondheimPublished 2003/12

2 1 ISO/IEC 13818-1:2000/Amd.2 (Support for IPMP on 2) N5604 03/03 Pattaya Published 2004/032 1 ISO/IEC 13818-1:2000/Amd.3 (AVC Carriage on MPEG-

2)N5771 03/07

TrondheimFDAM ITTF FDAM 04/04/26

2 1 ISO/IEC 13818-1:2000/Amd.5 (New Audio P&L Sig.) N6585 04/07 Redmond

FDAM ITTF FDAM Ballot

2 11 ISO/IEC 13818-1:2003 (IPMP on 2) N5607 03/03 Pattaya Published 2003/124 1 ISO/IEC 14496-1 (MPEG-4 Systems 1st Ed.) Published 1999/124 1 ISO/IEC 14496-1/Amd.1 (MP4, MPEG-J) Published 2001/114 1 ISO/IEC 14496-1/Cor.1 Published 2001/114 1 ISO/IEC 14496-1:2001 (MPEG-4 Systems 2nd Ed.) Published 2001/114 1 ISO/IEC 14496-1:2001/Amd.1 (Flextime) Published 2002/104 1 ISO/IEC 14496-1:2001/Cor.1 01/07/20 FDAM SC294 1 ISO/IEC 14496-1:2001/Cor.2 02/10/26 FDAM SC294 1 ISO/IEC 14496-1:2001/Amd.2 (Textual Format) 02/03 FDAM SC294 1 ISO/IEC 14496-1:2001/Amd.3 (IPMP Extensions) FDAM ITTF FDAM 04/03/224 1 ISO/IEC 14496-1:2001/Amd.4 (SL Extension) Published 2003/124 1 ISO/IEC 14496-1:2001/Amd.7 (AVC on 4) N5976 03/10

BrisbanneFDAM SC29 FDAM to be issued

4 1 ISO/IEC 14496-1:2001/Amd.8 (ObjectType Code Points) N6202 03/12 Hawaii FDAM SC29 Final Text Editing4 1 ISO/IEC 14496-1:2001/Cor.3 N6587 04/07

RedmondFDAM SC29 FDAM Ballot

73

4 1 ISO/IEC 14496-1 (MPEG-4 Systems 3rd Ed.) N5277 02/10 Shanghai

FDIS SC29 Final Text Editing

4 6 ISO/IEC 14496-6:2000 Published 2000/124 8 ISO/IEC 14496-8 (MPEG-4 on IP Framework) N4712 02/03 Jeju FDIS SC29 FDIS 04/04/124 11 ISO/IEC 14496-11/Cor.1 (Integrated in 3rd Edition) N6203 03/12 Hawaii COR SC294 11 ISO/IEC 14496-11 (MPEG-4 Scene

Description) N5279 02/10

ShanghaiFDIS SC29 Final Text Editing

4 11 ISO/IEC 14496-11/Amd.1 (AFX) N5480 02/10 Awaji FDAM Editor Integration in 1st

Ed.4 11 ISO/IEC 14496-11/Amd.2 (Advanced Text and Graphics) N6205 03/12 Hawaii FDAM Editor Integration in 1st

Ed.4 11 ISO/IEC 14496-11/Cor.3 Valuator/AFX related

correctionN6594 04/07

RedmondCOR Editor Integration in 1st

Ed.4 11 ISO/IEC 14496-11/Amd.3 Audio BIFS

ExtensionsN6591 04/07

RedmondFDAM Editor Integration in 1st

Ed.4 12 ISO/IEC 14496-12 (ISO Base Media File

Format) N5295 02/10

ShanghaiIS ITTF To be published

03/124 12 ISO/IEC 14496-12/Amd.1 ISO FF Extension N6596 04/07

RedmondFDAM ITTF Ballot to be issued

4 13 ISO/IEC 14496-13 (IPMP-X) N5284 02/10 Shanghai

FDIS ITTF

4 14 ISO/IEC 14496-14 (MP4 File Format) N5298 02/10 Shanghai

2004/01 Published

4 15 ISO/IEC 14496-15 (AVC File Format) N5780 03/07 Trondheim

FDIS ITTF Ballot to be issued

4 18 ISO/IEC 14496-18 (Font Compression and Streaming)

N6215 03/12 Hawaii FDIS ITTF FDIS by 04/05/11

4 19 ISO/IEC 14496-19 (Synthesized Texture Stream)

N6217 03/12 Hawaii FDIS ITTF FDIS to be issued

7 1 ISO/IEC 15938-1 (MPEG-7 Systems) N4285 01/07 Sydney Published 2002/077 1 ISO/IEC 15938-1/Amd.1 (MPEG-7 Systems Extensions) N6326 04/03 Munich FDAM Editor7 1 ISO/IEC 15938-1/Cor.1 (MPEG-7 Systems Corrigedum) N6328 04/03 Munich COR SC297 2 ISO/IEC 15938-2 (MPEG-7 DDL) N4288 01/07 Sydney Published 2002/02

74

Resolutions of Systems

Cf. WG11 resolution.

List of reviewed contribution

N° Title Authors10774 Requirement for MPEG-21 Binarization Thomas DeMartini10787 Summary of Voting on ISO/IEC 14496-11/PDAM 4 SC 29 Secretariat

10794 IEC CDV 62298-1: Teleweb Application -- Part 1: General Description [SC 29 N 6016]

IEC TC 100 via SC 29 Secretariat

10795 IEC CDV 62298-2: Teleweb application -- Part 2: Delivery methods [SC 29 N 6017]

IEC TC 100 via SC 29 Secretariat

10803 W3C Comments on the MPEG Timed Text specification Glenn Adams et al.

10812 Answer to the CfP on LASeR and SAF: Streamezzo format proposal overview Jean-Claude DufourdOlivier Avaro

10813 Overview of responses to Call for Proposals for MPEG-21 IPMP Niels RumpSimon Watt

10814 Answer to Call for Proposal on Lightweight Scene Representation Joerg Heuer et al.

10815 Answer to the CfP on LASeR and SAF: Streamezzo LASeR format proposal

Jean-Claude Dufourd et al.

10816 Answer to the CfP on LASeR and SAF: Streamezzo SAF format proposal


10817 Answer to the CfP on LASeR and SAF: Streamezzo Test Set and Executables


10818 Answer to the CfP on LASeR and SAF A. Cotarmanach et al.

10819 Answer to the CfP on LASeR and SAF Renaud Cazoulat et al.

10820 Response to the CfP on LASeR : BiM SVG Profile for LASeR Robin Berjon et al.

10833 Proposed WD 0.1 of ISO/IEC 14496-20, LASeR and SAF Jean-Claude Dufourd et al.

10834 Proposed Draft Core Experiment on LASeR Harmonization with SVG Olivier Avaro et alii

10835 Proposed Draft Core Experiment on LASeR Binary Representation Olivier Avaro et alii10836 Report of the LASeR evaluation meeting Young-Kwon Lim10837 LASeR software Olivier Avaro et alii10838 Summary of Voting on ISO/IEC FCD 14496-17 SC 29 Secretariat10844 Summary of Voting on ISO/IEC 14496-1:2001/DCOR 3 SC 29 Secretariat10845 Summary of Voting on ISO/IEC 14496-11/DCOR 2 SC 29 Secretariat

10848Application Specific Binary Coding (ASBC) of MPEG-21 descriptors for better coding efficiency maintaining interoperability to regular MPEG-21 decoder

Itaru Kaneko et al.

10852 Proposed Resource Reference Box for addressing a sub-part of a media resource Yongju Cho et al.

10862 Answer to the CfP on MPEG-21 IPMP Craig Schultz10872 Finnish NB comments on 14496-12 Amd.1 Ye-Kui Wang10872 Finnish NB comments on 14496-12 Amd.1 Ye-Kui Wang10881 KNB comment on 14496-11/PDAM4 (XMT & MPEG-J Extensions) KNB10884 Proposal on SL-compliant SAF packet headers Young-Kwon Lim

10893 SMPTE Liaison to MPEG on OpenType® and ISO/IEC 14496-18 Wendy Aylsworth et al.

76

10900 Contribution to MPEG Multimedia Middleware Requirements v.1.0 Jean H.A.Gelissen

10905 Proposal to amend ISO/IEC 14496-1:2004

Alexandre Cotarmanac'hVladimir Levantovsky

10907 USNB Contribution: Response to Munich resolution 2.2.3 A. G. Tescher for USNB

10911 USNB Contribution: Suggested corrigendum to 13818-1:2000 A. G. Tescher for USNB

10912 Proposed conversion of OpenType to an ISO/IEC standard A. G. Tescher for USNB

10913 USNB Contribution: ISO/IEC 14496-17/FCD concerns A. G. Tescher for USNB

10914 Summary of Voting on ISO/IEC CD 21000-9 SC 29 Secretariat10920 Summary of Voting on ISO/IEC 13818-1:2000/FPDAM 4 SC 29 Secretariat10921 Summary of Voting on ISO/IEC 13818-1:2000/FPDAM 5 SC 29 Secretariat10924 Summary of Voting on ISO/IEC 14496-11/FPDAM 3 SC 29 Secretariat

10927 Summary of Voting on ISO/IEC 14496-12/FPDAM 1 & 15444-12/FPDAM 1 SC 29 Secretariat

10930 Proposal for amendment of ISO/IEC 14496-14 Vladimir Levantovsky

10961 MAF Reference Software Workplan ProposalWo ChangSchuyler Quackenbush

10962 MAF File Format Proposal Wo Chang

10974 Report of CE on MPEG-21 Binarisation Christian Timmerer et al.

10982 Comments on LASeR Harmonization with SVG Yesun Joung et al.

10985 Liaison Statement from the Open Mobile Alliance (OMA) [SC 29 N 6121]

OMA via SC 29 Secretariat

10999 Comments on LASeR and SVG Jean-Claude DufourdOlivier Avaro

11000 Metadata protection in ISO Base File Format Amendment Zhongyang Huang et al.

11004 MPEG-7 Systems extensions, TVAnytime indexing core experiments Ray Taylor

11027 Inputs on study text of timed text FCD (part 17) van der Meer

11028 Study Text of ISO/IEC 14496-11/2003 FPDAM-3 Juergen SchmidtOliver Baum

11029 Simple Integration Reference Software for MPEG-4 AudioBIFS, version 3

Juergen SchmidtKlaus Eilts-Grimm

11034 CE-Report on Evaluations of the Siemens Index System Joerg Heuer et al.11036 Stream Reordering for Fast Random Access Joerg Heuer et al.11057 FNB comment on LASeR Jean-Claude Dufourd

11109 Update of XMT-A and MPEG-J standards Mikael Bourges-Sevenier

77

Annex 7Report of MDS meeting

Contact (MPEG Multimedia Description Schemes Sub-group Chair):John R. SmithIBM T. J. Watson Research Center19 Skyline DriveHawthorne, NY 10532 [email protected]

The MPEG Multimedia Description Schemes (MDS) sub-group’s activities included work items for MPEG-7 and MPEG-21 standards as shown in Figure 1.

MPEG- 21:• DI D 2nd Ed (FCD)• REL (“Profiles”)• RDD (COR/1)• DI A AMD/ 1 (PDAM)• DI P (FCD)• Ref SW (FCD)• Conformance (FCD)• Event Reporting (WD)

MPEG- 7 v.2:• MDS AMD/ 2

(FDAM)• MDS Cor/ 1(COR)• Conf . Ext. (FDAM)

MPEG- 7 v.1:• MDS (FDI S)• Profi les• Schema Def . (FDIS)

Figure 1. Overview of MPEG Multimedia Description Schemes Sub-Group work items for 68th Munich meeting.

The primary work items for the week included the following:

MPEG-7:o MPEG-7 Extensions (Part 5):

Review NB comments on MPEG-7 MDS FPDAM/2 MPEG-7 MDS AMD/2 FDAM Review NB comments on MPEG-7 MDS DCOR/1 MPEG-7 MDS COR/1 COR

o MPEG-7 Conformance (Part 7): Review NB comments on MPEG-7 Conformance FPDAM/1 AMD/1 (Version 2 bitstreams) FDAM

o MPEG-7 Schema Definition (Part 10): Review NB Comments on MPEG-7 Schema Definition FCD MPEG-7 Schema Definition FCD

78

Ed. Proj. Title CfP WD CD Study

FCD Study

FDIS

2002Amd.1 Systems extensions 02/03 02/07 02/12 02/03 03/072001 1st

Ed.Visual Descriptors Version 2 02/05 02/12 03/03 03/07

2001Amd.1 Extensions (Visual) 01/12 02/05 02/10 03/032001 1st

Ed.Multimedia Description Schemes 01/12 02/05 02/10 02/07

2002Amd.1 Multimedia Description Schemes Extensions

01/12 02/05 02/10 03/03

2003Amd.2 Multimedia Description Schemes Extensions

03/07 03/10 04/03 04/07 04/10

2003 Cor.1 Multimedia Description Schemes 03/12 04/03 04/072003 1st

Ed.Conformance 02/03 03/07

2004Amd.1 Conformance Extensions 03/03 03/07 03/12 04/03 04/072002 1st

Ed.Extraction and Use of MPEG-7

Descriptions01/07 02/03

2004 1st Ed.

Schema Definition 03/07 03/10 03/12 04/03 04/07 04/10

Table 2. MPEG-7 work items for MDS Sub-Group for 69th Meeting.

MPEG-21:o MPEG-21 Digital Item Declaration (Part 2):

Review NB Comments on MPEG-21 DID CD MPEG-21 DID 2nd Ed FCD

o MPEG-21 Rights Data Dictionary MPEG-21 RDD COR/1 DCOR

o MPEG-21 Digital Item Adaptation (Part 7): MPEG-21 DIA AMD/1 PDAM

o MPEG-21 Reference SW (Part 8): Review NB Comments on MPEG-21 Ref. SW CD MPEG-21 Ref. SW FCD

o MPEG-21 Digital Item Processing (Part 10): Review NB comments on MPEG-21 DIP CD MPEG-21 DIP FCD (Study of CD)

o MPEG-21 Conformance (Part 14): Review contributions MPEG-21 Conformance CD

o MPEG-21 Event Reporting (Part 15): Review CE results on MPEG-21 Event Reporting MPEG-21 Event Reporting WD v.2

Part

Ed. Proj. Title CfP WD CD / PDAM

Study

FCD / FPDAM

Study

FDIS / FDAM

2 20021st Ed.Digital Item Declaration 01/12 02/052 200x 2nd

Ed.Digital Item Declaration 03/10 04/03 04/07 05/01

3 20021st Ed.Digital Item Identification 01/07 01/12 02/03 02/074 200x1st Ed.IPMP Framework 01/07 02/05 02/10

79

5 200x1st Ed.Rights Expression Language 01/12 02/07 02/12 03/076 200x1st Ed.Rights Data Dictionary 01/12 02/07 02/12 03/076 200x Cor.1 Rights Data Dictionary7 200x1st Ed.Digital Item Adaptation 02/03 02/05 02/12 03/07 03/10 03/127 200x Amd.1MPEG-21 DIA AMD/1 WD: DIA Conversions

and Permissions03/12 04/07 04/10 05/03

8 200x1st Ed.Reference Software 03/03 04/03 04/07 05/0110I 200x1st Ed.Digital Item Processing 02/12 03/03 03/12 04/03 04/07 05/0114 200x1st Ed.Conformance 03/10 04/07 04/10 05/0115I 200x1st Ed.Event Reporting 04/03 04/10

Table 2. MPEG-21 work items for MDS Sub-Group for 69th Meeting.

MPEG Multimedia Description Schemes (MDS) Group activities

Num.

Contributions

Agenda, Goals and Issues for the Week for Multimedia Description Schemes (MDS) Sub-Group

Agenda, Goals and Issues for the Week for Multimedia Description Schemes (MDS) Group

John R. Smith

During the kick-off session, the workplan for the week for MPEG-7 and MPEG-21 development was discussed and approved. Furthermore, the following points were discussed:

Organization of work into main MDS track with BoGs (REL/RDD/DIA/DIP/ER/IPMP)

o All work held in main MDS track except where indicated for specific Break-out Groups (BoG)

Scheduling of MDS sub-group plenary meetings for Wednesday and Thursday

Plan for MPEG-7 Multimedia Description Schemes AMD/2 and COR/1 Plan for MPEG-21 Digital Item Declaration 2nd Edition Plan for MPEG-21 Rights Expression Language Plan for MPEG-21 Rights Data Dictionary Plan for MPEG-21 Digital Item Adaptation Plan for MPEG-21 Digital Item Processing Plan for MPEG-21 Event Reporting Plan for MPEG-21 IPMP Plan for software development for MPEG-21 Schedule of joint meetings

Joint Meetings (as of Monday): MPEG-7:

80

o Wed (11h30 - 13h00): MPEG-7 Profiles (with Requirements, Systems, Audio, Video)

MPEG-21:o Mon (17h00 - 18h00): MPEG-21 IPMP Handoff (with

Requirements, Systems)o Tues (11h00 - 11h30): Media Application Formats (with

Requirements, Systems)o Tues (15h00 - 16h30): MPEG-21 Requirements (with

Requirements)o Tues (14h00 - 15h00): MPEG-21 Integration (with Requirements)

Break-out Groups:

Event Reporting BoG:o Time: 09:00 – 11:30o Place: St. Helens 3 (other room to be announced)o Mandates:

Address specific recommendations from AHG and Core experiments

Create initial draft of ER v2.0 Start inter-MPEG-21 project communications for ER and its

relationship to DID, REL, DIA, IPMP, etc.o Chairs: Andrew Tokmakoff

Digital Item Processing (DIP) BoG:o Time: Tues, 11:30 – 15:00o Place: St. Helens 3o Mandates:

Review and develop initial recommendations for NB comments

Harmonize DIBOs for RELo Chairs: Gerrard Drury, Frederik

IPMP BoG:o Scope:

Interoperability across (and within) verticals Interoperability at what levels? Where to draw line (e.g., framework descriptions

systems/tools)?o Elements:

Framework Descriptions, IPMP information IPMP Systems (high-level) and IPMP Tools (bit-level) Solutions

o Start with framework: Enabling and prescriptive Draw together components of MPEG-21 Levels of flexibility (required) May need to support declaration of tools at multiple levels

(e.g., high-level, bit-level)

81

o Time: 10:30 – 17:00 Place: Baker 1

o Mandates: Start work on defining framework Interact with experts on DID, DII, REL/RDD, DIP, IPMP:

Show how elements work together (current views) – ungoverned DIs

Show how elements could work together to support IPMP (future view) – governed DIs

o What’s missing?o Identify what IPMP information is needed within

DID Re-examine input contributions related to framework Map to requirements, identify capabilities and gaps

o Output (Tues PM): Table identifying how proposals meet framework

requirements o Chairs: Simon Watt

MPEG-21 Media Locators BoGo Time: Wed, 13h00 - 16h00o Place: St. Helens 3 o Mandates:

Examine alternatives: Do not define generic fragment-id scheme – support

authoritative schemes only (+ activity to define scheme for MPEG mime-types in

context of file format) Define generic AV scheme using M21 URI syntax Define generic AV scheme using MPEG-7 XML media

locatorso Actions:

Create AhG with mandates mapping to BoG recommendations (TBD)

o Chairs: Myriam

Review of AHG resolutions and action points:

Doc No. Contribution Source

AHG on Core Experiments for MPEG-21 DID 2nd Edition Gerrard Drury, Frederik De Keukaleare

10957 Myriam Amielh Final CE report on MPEG-21 Media LocatorResults:

Developed media locator test suite – used to evaluate candidate schemes

CSIRA developed Java software for supporting URI-based fragments

URI uses XPath grammar for locating steps for logical units Demonstration of locating regions in space and time using URI-

82



based scheme Check ONYX (messaging structure) and Logical models (music

industry)Actions:

Review CE results during the meeting11032 John R. Smith, Alan Melby

CE Results on Addressing Scheme for MPEG-21 using MPEG-7 Media Locators

Results: Developed and evaluated test cases for using MPEG-7 media

locator for MPEG-21 Further improved syntax and semantics for including MPEG-7

media locator in MPEG-21 DID Further improved syntax and semantics of logical unit locator for

MPEG-7Actions:

BoG this week to determine best solution for MPEG-21 addressing requirements

AHG on Core Experiments for MPEG-21 DIPGerrard Drury, Frederik De Keukaleare, Munchurl Kim

10939Hendry, Munchurl Kim, Keunsoo Park, Eva Rodriguez, Torres , Jaime Delgado


10873 Victor Torres, Jaime Delgado, Eva Rodriguez


Results: Explored two solutions for REL related DIBOs

Actions: Need effort this week to harmonize two solutions Continue work as mandate of DIP BoG

10766 FX Nuttall, Andrew Tokmakoff AHG on MPEG-21 Event Reporting

11064Andrew Tokmakoff, Youngjoo Song, Kyunghee Ji, Senator Jeong CE-Report on MPEG-21 Event Reporting

Results: Improved Event Reporting working draft Elaborated on syntax and semantics of ER and ERR

Actions: Need more interaction with other parts of MPEG-21 Need to more completely define ER and ERR tools Continue in BoG mode this week – produce next version of WD

MPEG-21 IPMP


Results of Call on MPEG-21 IPMP RequirementsResults:

Completed handoff of MPEG-21 IPMP activities to MDS subgroup (from Requirements)

Questions: What shall be scope of MPEG-21 IPMP standardization –

framework, metadata, tools, end-to-end solutions?

83










Actions: Start intensive BoG activities this week – mandates to be

established first thing on Tues AM.

MPEG-21 DID Comments:


10889 SC 29 SecretariatSummary of Voting on ISO/IEC CD 21000-2 [SC 29 N 6107]

10971 Christian Timmerer, on behalf of the Austrian NB ANB comments on 21000-2 CD 2nd EditionResults:

NB comments on MPEG-21 DIDQuestions:

Media locator comments to be addressed in BoGActions:

Meet with NB members and resolve open issues Produce DID 2nd Edition FCD at this meeting

MPEG-21 DID Media Locators:

Doc No. Contribution Source10957 Myriam Amielh Final CE report on MPEG-21 Media Locator

11032 John R. Smith, Alan MelbyCE Results on Addressing Scheme for MPEG-21 using MPEG-7 Media Locators

11118 Myriam AmielhIssues relating to the use of URI Fragment Identifiers in MPEG-21

Results: Reviewed results of CE on Media locators for MPEG-21 using two

approaches – one using MPEG-7 standards based tools and the other using proprietary URI-based scheme.

Questions: Issues were raised about URI-based scheme because of

incompatibilities with existing W3C/IETF practices on URI-fragments

MPEG cannot define a URI-compatible fragment scheme for media types that are not under MPEG control, e.g., Quicktime

Actions: Adopt MPEG-7 based scheme into MPEG-21 DID specification Continue to explore URI-based schemes and applicability to

MPEG media types

MPEG-21 RDD


84













10786 ITTF via SC 29 SecretariatTable of Replies on ISO/IEC FDIS 21000-6 [SC 29 N 5981]


11077Thomas DeMartini, Herbert Van de Sompel, Jeroen Bekaert Status of mpegRA activity

Results: Minor issue on MPEG-21 RDD spec. – error and inconsistency in

Fig. 1Questions:

Questions about status of MPEG-21 registration authority – seemingly no actions have been taken by appointed RA

Actions: Correct figure for RDD COR/1 RA will respond and report on status

MPEG-21 DIA AMD/1 Editing


10831 Thomas DeMartini Editor's Input: DIA AMD/1 WDv2.1

10978 Christian Timmerer, Hermann Hellwagner Comments on DIA AMD1 WDv2Results:

Minor comments on DIA AMD/1Questions:

Not all editors present – release next draft with minor revisionsActions:

Produce DIA PDAM/1

MPEG-21 DIA AMD/1 Proposals


10996

Ingo Wolf, Bernhard Feiten, Teodora Guenkova-Luy, Andreas Schorr, Franz Hauck, Andreas J. Kassler


11030 Mariam Kimiaei Asadi, Jean-claude Dufourd Possible missing features in MPEG-21 DIA

11086Christian Timmerer, Klaus Leopold, Dietmar Jannach, Hermann Hellwagner Contribution to DIA AMD1 WDv2

Results: Delivery based contribution for DIA using SFPng and RTP

(relevant for testbed) Contribution for DIA tools for describing rich text capabilities

Actions: Continue to explore rich text DIA description in AHG following

this meeting – consider adopting for future DIA

MPEG-21 Requirements

85



















10807 Niels Rump, Chris BarlasRelationship between Digital Items and Digital Item Declarations

10892Jeroen Bekaert, Thomas DeMartini, Rik Van de Walle, Herbert Van de Sompel Identification of a DIDL Document

11081Jeroen Bekaert, Frederik De Keukelaere, Herbert Van de Sompel, Rik Van de Walle Requirement for MPEG-21 DID

11110 Gerrard Drury, Ian BurnettComments on Identification of DID a Document

Results: Issues raised about identification of DID XML documents (as

opposed to DII of Digital items) Very different points of view expressed from rights holder

community vs. library science/data management communityActions:

More discussion and possible compromise needed In end, compromise is to use DID metadata field for including

identifiers for DID XML documents

MPEG-21 BSD Proposals:Doc No. Contribution Source

11087 Joerg Heuer, Gabriel Panis, Andreas HutterConsiderations for efficient Resource Adaptation based on MPEG-21 DIA

11091Debargha Mukherjee, Huisheng Wang, Sam Liu


Results: Update on activities on DIA resource adaptations in streaming

environments and streaming implementations of BSD transformations

Actions: Explore further in form of CE and consider for future DIA

MPEG-21 DIP Proposals:


10873Victor Torres, Jaime Delgado, Eva Rodriguez


10939Hendry, Munchurl Kim, Keunsoo Park, Eva Rodriguez, Torres , Jaime Delgado


10963Myriam Amielh, Ernest Wan, Gerrard Drury, Ian Burnett Proposed DIBO for playing a Fragment

Results: Contributions for DIP including rights related DIBos

Questions: There may be some advantages for separating DIP into governed

86



















vs. ungoverned, similar to DIA; although, proponents of DIP rights related tools would not like to delay those tools

Actions: Adopt revisions into current draft

MPEG-21 DIP Editing:



10973 Christian Timmerer, on behalf of the Austrian NB ANB comments on 21000-10 CD

11113 Gerrard Drury, Ian Burnett Response to Comments on DIP CDResults:

Large number of NB comments in MPEG-21 DIP CD Some issues difficult to resolve such as the interface design for

DIP toolsActions:

BoG and NB representatives to continue working on open issues Final decision on DIP to be made at end of week

MPEG-21 Conformance:


10891Eva Rodriguez, Jaime Delgado, Silvia Llorente


Results: New contribution adopted for REL aspect of MPEG-21

conformanceQuestions:

Little effort has been made to date on DID, DIA conformance; although, conformance for these parts may not be very extensive, e.g., similar to MPEG-7 for XML metadata

Actions: Need more serious effort on MPEG-21 conformance – who?

87









Summary of Results on MPEG Multimedia Description Schemes (MDS) work items:

Results on MDS MPEG-7 work items:

1. MPEG-7 MDS (Part 5): MPEG-7 Multimedia Description Schemes (Part 5):

o Disposed of National Body comments on MDS DCOR/1 (clarification of semantics when multiple profile & level indicators are signaled)

o All National Bodies approved dispositiono Output: MPEG-7 MDS COR/1 COR

MPEG-7 MDS User Preference Extensions (Part 5):o Disposed of NB comments on FPDAM/2 (updates & corrections of

syntax)o All National Bodies approved dispositiono Output: MPEG-7 MDS AMD/2 FDAM

2. MPEG-7 Conformance (Part 7) Disposed of NB comments on FPDAM/1 (finalization of MPEG-7 AMD

conformance bit-streams) All National Bodies approved disposition Editing period requested to collect final bit-streams from respective

MPEG-7 groups Output: MPEG-7 Conformance FDAM/1

3. MPEG-7 Schema Definition (Part 10) Disposed of NB Comments on FCD (synchronization of tools across

MPEG-7 parts) All National Bodies approved disposition Output: MPEG-7 Schema Definition FDIS

Results on MDS MPEG-21 work items:

1. Analyzed recommendations of AHGs and Core Experiments.

2. MPEG-21 Part 2 – Digital Item Declaration: Disposed of NB comments on CD (all National Bodies approved) Adopted <Fragment> element for locating fragments of resources

using MPEG-7 media locators and URI-authoritative fragment-id schemes

Decision to support identifier for DIDL XML documents using DIDL metadata field – clearly distinct from the DII of the Digital Item

Established AHG on Media locators: Exploring URI-authoritative fragment-id schemes (e.g., for MPEG

mime-types; use within MPEG-21 and interaction with MPEG-7 media locator solutions)

Output: MPEG-21 DID 2nd Ed FCD

88

3. MPEG-21 Rights Data Dictionary (RDD): Bug fix to Figure 1 (not consistent with text) Output: MPEG-21 RDD COR/1 DCOR

4. MPEG-21 Part 7 – Digital Item Adaptation: Promoted DIA AMD/1 to PDAM (minor editorial revisions)

o Provides normative tools for describing conversion capabilities and suggested conversions for digital item (or component)

o Provides example informative set of conversions and their mapping & term specialization in RDD

Established new DIA Core Experiments:o CE on Text Capabilities of Terminals – description of font and

rich-text capabilities of terminals and use for adaptationo CE on Conversion Parameters – DIA support for multi-step

adaptationso CE on Bitstream Adaptation in Constrained and Streaming

Environments Output:

o MPEG-21 DIA AMD/1 PDAM, o MPEG-21 DIA COR/1 DCOR

5. MPEG-21 IPMP SW (Part 4): Extensive interaction of DID, DII, REL/RDD, DIP, IPMP experts:

o Examined how MPEG-21 elements work together (ungoverned view)

o Examined how MPEG-21 elements could to work together to support IPMP (governed view) – starting point of framework

Established initial basis for MPEG-21 IPMP framework:o Starting from DIDL extension proposal from m10860 – defines

governed-versions of DIDL constructs within MPEG-21 Digital Item Declaration, e.g., <Container> and <IPMP_Container>, etc.

o Starting point of IPMP descriptors from proposals m10832, m10858 and m10865

Established IPMP AHG:o Further developing IPMP DIDL extensions, schema for IPMP

informationo Revising MPEG-21 IPMP working draft – documenting initial

framework o AHG Meetings will be held on 24-26 Aug in Mountain View and

weekend prior to 70th MPEG meeting Output: MPEG-21 IPMP WD v.1

6. MPEG-21 Reference SW (Part 8): Disposed of NB comments on CD (all National Bodies approved) Adopted new SW contributions on Mobile MPEG-21 browser and

Integration SW for REL, DID and DIA Output: MPEG-21 Ref. SW FCD

7. MPEG-21 Part 10 – Digital Item Processing: Did not fully dispose of NB comments on CD (~150 comments)

89

o Proposed change of API too extensive to be evaluated in Redmond

o Produced Draft DoC and Study of CDo Delaying MPEG-21 DIP FCD until 70th meeting

Revising DIP to operate on DID entities (not DIDL XML elements) Harmonization of solutions for REL-related DIBOs Clarification of DIP text to better define its purpose and relationship to

other MPEG-21 parts Established DIP AHG to work on:

o Signaling of DIP profileso Evaluating API revisionso Implementing PlayResource DIBO and DIXOs

Output: MPEG-21 DIP Study of CD

8. MPEG-21 Part 15 – Event Reporting: Further developed Event Reporting and its relationship to DID, REL,

DIA, IPMP, etc. Developed solutions for representing Event Reports and Event Report

Requests in Digital Items using DIDL Descriptor element More fully defined data fields of Event Report and Event Report

Request elements Demonstrated of Event Reporting software integrated with DID, REL,

DIP Output: MPEG-21 Event Reporting WD v.2

9. Edited and approved output documents (WD, CD, AHGs, new CEs, etc.)

90

List of MDS Output documents:

MPEG-7:

No. Title TBP

Available

15938-5 MPEG-7 Multimedia Description Schemes

6633 DoC on ISO/IEC 15938-5 FPDAM/2 N 04/07/2

3663

4ISO/IEC 15938-5 FDAM/2 “MDS User Preference Extensions” N 04/07/2

3663

5 DoC on ISO/IEC 15938-5 DCOR/1 N 04/07/23

6636 ISO/IEC 15938-5 COR/1 N 04/08/0

9

No. Title TBP

Available

15938-7 MPEG-7 Conformance663

7DoC on ISO/IEC 15938-7 FPDAM/1 N 04/07/2

3663

8ISO/IEC 15938-7 FDAM/1 N 04/08/1

6

No. Title TBP

Available

15938-10 MPEG-7 Schema definition 663

9DoC on ISO/IEC 15938-10 FCD N 04/07/2

3664

0ISO/IEC 15938-10 FDIS “Schema Definition” N 04/09/1

3

MPEG-21:

No. Title TBP

Available

21000-2 MPEG-21 Digital Item Declaration664

1DoC on 21000-2 CD 2nd Edition – Digital Item Declaration

N 04/07/23

6642

ISO/IEC 21000-2 DID 2nd Edition FCD N 04/07/31

No. Title TBP

Available

91

21000-3 MPEG-21 Digital Item Identification 664

3 Status of Registration Authority for DII N 04/07/23

No. Title TBP

Available

21000-4 MPEG-21 IPMP664

4ISO/IEC 21000-4 WD v.1 “IPMP” N 04/07/2

3

No. Title TBP

Available

21000-5 MPEG-21 Rights Expression Language664

5MPEG-21 REL/RDD Software Implementation Plan v.7 N 04/07/2

3

No. Title TBP

Available

21000-6 MPEG-21 Rights Data Dictionary664

6 ISO/IEC 21000-6 DCOR/1 N 04/07/23

No. Title TBP

Available

21000-7 MPEG-21 Digital Item Adaptation664

7MPEG-21 DIA PDAM/1 “Conversions and Permissions” N 04/07/2

3664

8 ISO/IEC 21000-7 COR/1 WD v.1 N 04/07/23

6649 MPEG-21 DIA Software Implementation Plan v.8 N 04/07/2

3665

0Workplan for Core Experiment on Text Capabilities of Terminals N 04/07/2

3665

1Workplan for Core Experiment on Conversion Parameters N 04/07/2

3665

2Workplan for Core Experiment on Bitstream Adaptation in Constrained and Streaming Environments

N 04/07/23

No. Title TBP

Available

21000-10 MPEG-21 Digital Item Processing665

3Draft DoC on ISO/IEC 21000-10 CD N 04/07/2

3

92

6654

Study of ISO/IEC 21000-10 CD “Digital Item Processing”

N 04/09/03

6655 MPEG-21 DIP Software Implementation Plan v.3 N 04/07/2

3

No. Title TBP

Available

21000-15 MPEG-21 Event Reporting665

6ISO/IEC 21000-15 WD v.2 “Event Reporting” N 04/07/3

1

93

List of AHGs approved by the MDS group:

N6657AHG on MPEG-21 Media Locators

Mandates 1. Investigate solutions for an authoritative URI fragment identifier scheme for mpeg media types

2. Discuss and collect comments on the collaborative solution using MPEG-7 metadata-based and URI-based schemes for DID

3. Update the DID reference software to support <Fragment> element and study the impact of the new element

4. Explore requirements for addressing schemes for mpeg and non-mpeg mime types

5. Jointly explore conventions for describing slices of composites with MPEG 21, SMIL, X3D

Chairman Myriam Amielh ([email protected])Co Chairs Gerrard Drury ([email protected])

YongJu Cho ([email protected])Duration Until the 70th MeetingMeetings Pre-meeting to be held in Palma on the Saturday or Sunday

prior the 70th meeting.Reflector [email protected]

Please use the prefix [medialoc]Subscribe Send email to [email protected] AHG on MPEG-21 IPMP Mandate: 1. To further review the proposals to identify relevant

technologies for inclusion in the working draft.2. To further develop the IPMP_DIDL extensions3. To develop a schema for IPMP informationTo make recommendations on 1), 2) and 3) to the 70th Meeting

Chairman: Simon WattDuration: Until 70th meetingMeetings: Meetings will be held:

24-26 Aug in Mountain View in Palma on the day prior to the 70th Meeting

Reflector: [email protected] message titles prefixed [IPMP]Subscribe: To subscribe, go to

http://listserv.imec.be/mailman/listinfo/mpeg-21

N6659AHG on MPEG-21 DIA

Mandate: 1. Carry out Core Experiments on DIA and make recommendations to modify and improve the MPEG-21 DIA AMD/1 PDAM.

2. Investigate the integration of the PDAM schema into the ISO/IEC 21000-7 schema.

3. Produce the editor’s draft of PDAM.Chairs Christian Timmerer (christian.timmerer_at_itec.uni-klu.ac.at)

Thomas DeMartini

94




(Thomas.DeMartini_at_CONTENTGUARD.COM)Duration: Until the 70th Meeting.Meetings:

AHG Meeting to be held on the weekend prior to 70th meeting. Other business will be conducted by e-mail or telephone conference.

Reflector: mpeg21-uma_at_merl.comSubscribe: To subscribe send email to chairman.N6660

AHG on MPEG-21 DIPMandates 1. Carry out editing of DIP Study of CD according to draft

disposition NB comments on CD.2. Encourage contributions on improving MPEG-21 DIP Study

of CD.3. Develop mechanisms that allow signaling of MPEG-21 DIP

profile information.4. For use cases provided in the Draft DoC for demonstrate

implementations of the concepts of the PlayResource DIBO or DIXOs.

Chairman Gerrard Drury ([email protected])Co Chair Frederik De Keukaleare ([email protected])

Munchurl Kim ([email protected])Duration Until the 70th MeetingMeetings AhG Meeting to be held on the Sunday prior to 70th meeting.

Other business to be conducted by email or phone.Reflector [email protected] See http://mailinglists.uow.edu.au/mailman/listinfo/mpeg-21-

dipN6661

14.1.1 AhG on MPEG-21 Event ReportingMandate: 1. Finish the editing of WD 2.0

2. Continue developing the reference software, as to comply with WD 2.0

3. Make recommendations on possible improvements to WD 2.0

4. contribute an editors’ draft for the next meetingChairs: FX Nuttall (fx at nuttall.org)

Andrew Tokmakoff (tokmakoff at telin.nl) Duration: Until the 70th MeetingMeetings: A pre- meeting will be held on the weekend before the Palma

meeting.Other business will be conducted by E-mail or telephone conference.

Reflector: [email protected] Subscribe: See http://lists.telin.nl/mailman/listinfo/mpeg-21-event-

reporting

95








MPEG MDS group schedule for 69th meeting:

MDS Sub-Group Schedule MPEG MDS Chair: John R. Smith

MPEG-7 and MPEG-21 v.3.2 Numb

er Source Title STD NOTES

Monday Morning (9h00-13h00) MPEG Plenary Plenary room

Monday Afternoon (14h00-20h00)

Kick-off of MPEG MDS activities (14h00-14h30) Hood 2 (MDS Room) ALL JRS

Agenda, Goals and Issues for the Week for MDS Group John R. Smith

Review of AHG resolutions, CE results and action points (14h30-16h30) Hood 2 (MDS Room) ALL JRS

AHG on Core Experiments for MPEG-21 DID 2nd Edition Gerrard Drury, Frederik De Keukaleare



AHG on Core Experiments for MPEG-21 DIP

Gerrard Drury, Frederik De Keukaleare, Munchurl Kim

10939

Hendry, Munchurl Kim, Keunsoo Park, Eva Rodriguez, Torres , Jaime Delgado





11064Andrew Tokmakoff, Youngjoo Song, Kyunghee Ji, Senator Jeong CE-Report on MPEG-21 Event Reporting

Define BoGs and Mandates (16h30-17h00) Hood 2 (MDS Room) ALL JRS

MPEG-7, REL, RDD, DID, DIA, DIP, ER, IPMP BOG Room = St. Helens 3

MPEG-21 IPMP (17h00- 18h00) with Requirements,

Lassen Room (Requirements)

MPEG-21

JRS

96












Systems Tuesday Morning (09h00-13h00) MPEG-21 Event Reporting (ER) BoG (09h00- 11h30) St Helens 3

MPEG-21

MPEG-21 IPMP (09h00 - 09h30) Hood 2 (MDS Room)

MPEG-21 JRS

MPEG-21 DID Comments (09h30 - 10h00) Hood 2 (MDS Room)

MPEG-21 JRS


10971Christian Timmerer, on behalf of the Austrian NB ANB comments on 21000-2 CD 2nd Edition

MPEG-21 DID Media Locators (10h00 - 11h00) Hood 2 (MDS Room)

MPEG-21 JRS



11118 Myriam AmielhIssues relating to the use of URI Fragment Identifiers in MPEG-21

MPEG-21 IPMP BoG (10h30- 17h00) Baker 1

MPEG-21

Media Application Formats (11h00- 11h30) with Req., Video, Audio, Systems

Lassen Room (Requirements) MAF JRS

10961Wo Chang, Schuyler Quackenbush MAF Reference Software Workplan Proposal

10962 Wo Chang MAF File Format Proposal MPEG-21 Digital Item Processing (DIP) BoG (11h30- 15h00) St Helens 3

MPEG-21

MPEG-21 RDD (11h30 - 12h00) Hood 2 (MDS Room)

MPEG-21 JRS

10786 ITTF via SC 29 SecretariatTable of Replies on ISO/IEC FDIS 21000-6 [SC 29 N 5981]


11077Thomas DeMartini, Herbert Van de Sompel, Jeroen Bekaert Status of mpegRA activity

97























Tuesday Afternoon (14h00-20h00) MPEG-21 DIA AMD/1 Editing (13h00- 14h00) Hood 2 (MDS Room)

MPEG-21 JRS

10831 Thomas DeMartini Editor's Input: DIA AMD/1 WDv2.1 10978

Christian Timmerer, Hermann Hellwagner Comments on DIA AMD1 WDv2

MPEG-21 DIA AMD/1 Proposals (14h00- 15h00) Hood 2 (MDS Room)

MPEG-21 JRS

10996

Ingo Wolf, Bernhard Feiten, Teodora Guenkova-Luy, Andreas Schorr, Franz Hauck, Andreas J. Kassler


11030Mariam Kimiaei Asadi, Jean-claude Dufourd Possible missing features in MPEG-21 DIA

11086

Christian Timmerer, Klaus Leopold, Dietmar Jannach, Hermann Hellwagner Contribution to DIA AMD1 WDv2

MPEG-21 Requirements (15h00- 16h30) w. Requirements, Systems


MPEG-21 JRS


10807 Niels Rump, Chris BarlasRelationship between Digital Items and Digital Item Declarations

10892

Jeroen Bekaert, Thomas DeMartini, Rik Van de Walle, Herbert Van de Sompel Identification of a DIDL Document

11081

Jeroen Bekaert, Frederik De Keukelaere, Herbert Van de Sompel, Rik Van de Walle Requirement for MPEG-21 DID

11110 Gerrard Drury, Ian BurnettComments on Identification of DID a Document

MPEG-21 Event Reporting (16h30 - 17h00) Hood 2 (MDS Room)

MPEG-21 IB


11064

Andrew Tokmakoff, Youngjoo Song, Kyunghee Ji, Senator Jeong CE-Report on MPEG-21 Event Reporting

MPEG-21 IPMP (17h00 - 18h00)


MPEG-21 JRS

MPEG-21 DIA BSD Proposals (18h00- 18h30) Hood 2 (MDS Room)

MPEG-21 JRS

11087Joerg Heuer, Gabriel Panis, Andreas Hutter

Considerations for efficient Resource Adaptation based on MPEG-21 DIA

11091Debargha Mukherjee, Huisheng Wang, Sam Liu


98



























Wednesday Morning (09h00-13h00)

MPEG Plenary (9h00-11h00) Plenary roomMPEG Plenary


MPEG-21

MPEG-21 DIP Proposals (11h30 - 12h30) Hood 2 (MDS Room)

MPEG-21 IB



10939

Hendry, Munchurl Kim, Keunsoo Park, Eva Rodriguez, Torres , Jaime Delgado



MPEG-7 Profiles (11h30 - 13h00) with Req., Video, Audio, Systems


MPEG-7 JRS

10763 Wo Chang, Akio Yamada, Alan Melby AHG on MPEG-7 Profiles 10940 Peter van Beek MPEG-7 User Description Profile Update 11023 Masanori SANO Some thoughts on MPEG-7 Profiling 11024 Masanori SANO MPEG-7 Core Description Profile Update

Wednesday Afternoon (14h00-17h30) MPEG-21 DID Media Locators BoG (13h00 - 16h00) St. Helens 3 (BoG Room)

MPEG-21


MPEG-21

MPEG-21 DIP Editing (13h00 - 14h00) Hood 2 (MDS Room)

MPEG-21 IB


10973Christian Timmerer, on behalf of the Austrian NB ANB comments on 21000-10 CD

11113 Gerrard Drury, Ian Burnett Response to Comments on DIP CD MPEG-21 Integration (14h00 - 15h00) with Requirements, Integration


MPEG-21 IB

MPEG-21 Conformance (15h00 - 16h00) with

Hood 2 (MDS Room) MPEG-21

IB

99






















Integration

10891Eva Rodriguez, Jaime Delgado, Silvia Llorente


MPEG-21 DIP BoG (16h00 - 17h00) St. Helens 3 (BoG Room)

MPEG-21

MPEG-21 IPMP (16h30 - 17h00)


MPEG-21 JRS

MPEG Social Event (17h00 - midnight) Thursday Morning (09h00-12h30)


MPEG-21

MPEG-21 File Format (09h00 - 10h00) with Systems (Systems Room)

MPEG-21 IB

MPEG-21 DIP Editing (10h00 - 11h00) St. Helens 3 (BoG Room)

MPEG-21 IB



10973Christian Timmerer, on behalf of the Austrian NB ANB comments on 21000-10 CD

11113 Gerrard Drury, Ian Burnett Response to Comments on DIP CD

MPEG-7 MDS Extensions (09h00 - 10h00) Hood 2 (MDS Room)

MPEG-7 JRS

10790 ITTF via SC 29 SecretariatTable of Replies on ISO/IEC 15938-5:2003/FDAM 1 [SC 29 N 6001]

10925 SC 29 SecretariatSummary of Voting on ISO/IEC 15938-5:2003/FPDAM 2

11121 John R. Smith, Alan K. MelbyRevised Logical Media Locator for MPEG-7 & MPEG-21

MPEG-7 MDS COR/1 (10h00 - 10h30) Hood 2 (MDS Room)

MPEG-7 JRS

10846 SC 29 SecretariatSummary of Voting on ISO/IEC 15938-5:2003/DCOR 1 [SC 29 N 6072]

MPEG-7 Schema Definition (10h30 - 11h00) Hood 2 (MDS Room)

MPEG-7 JRS

10926 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 15938-10 MPEG-7 Conformance Hood 2 (MDS Room) MPEG JRS

100
























Extensions (10h30 - 11h00) -7

10806 SC 29 SecretariatSummary of Voting on ISO/IEC 15938-7/FPDAM 1 [SC 29 N 6046]

MPEG-21 Ref. SW (11h00 - 12h00) with Integration Hood 2 (MDS Room)

MPEG-21 JRS


10864Xin Wang, Venugopal Venkatraman, Thomas DeMartini

Simple Integration Reference Software for MPEG-21 REL, DID and DIA

10942 Shane Lauf, Ian S Burnett Mobile MPEG-21 browser implementation

10871

Jeho Nam, Hyuk-Min Kwon , Man-Bae Kim, Seungji Yang, Truong Cong Thang, Rin-Chul Kim, Hae-Kwang Kim

Updated Status of MPEG-21 DIA Utility Software Modules

Thursday Afternoon (14h00-19h00)

MDS Liaison Responses (13h00 - 14h00) Hood 2 (MDS Room)

MPEG-21 JRS


IEC CDV 62328-3: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 3: Broadcasting system specific recording structure -- ISDB [SC 29 N 5963]

10784 ITU-T SG 17 via SC 29 SecretariatLiaison Statement from ITU-T SG 17 [SC 29 N 5968]

10897 TVA via SC 29 SecretariatLiaison Statement from the TV-Anytime Forum [SC 29 N 6114]

11147 IEEE LTSC via SC 29 Secretariat Liaison Statement from IEEE LTSC Media Application Formats (14h00 - 15h00) with Requirements Requirements IB MPEG-21 DIP BoG (14h00 - 15h00) St. Helens 3 (BoG Room)

MPEG-21

MPEG-21 REL (14h00 - 15h00) Hood 2 (MDS Room)

MPEG-21 IB

10855Hendry, Kyung-Ae Cha, Munchurl Kim, Keun Soo Park

Answer to the CfP on MPEG-21 IPMP : A Right Description Model on Resource Combinations

Plenary MDS and Reports of BoG (15h00 - 16h00) Hood 2 (MDS Room) MDS Plenary Review of Output documents, AHGs, CEs, DoC, Std (16h00- 18h00) Hood 2 (MDS Room) Friday Morning (09h00-

101



























13h00)Wrapping up (09h00 - 13h00) Hood 2 (MDS Room) MDS Plenary

Approval of resolutions, AHGs and Output documents

Friday Afternoon (14h00-21h00)

MPEG Plenary Plenary roomMPEG Plenary

Contact: John R. Smithx

102

Annex 8Report of Video meeting

Source: Jens-Rainer Ohm, Miroslaw Bober

Source: Jens-Rainer OhmContributors: Miroslaw Bober, Aljoscha Smolic, Euee S. Jang

MPEG-4

New Levels in Visual Simple Profile

A request was made for two new levels in Visual Simple Profile. It was emphasized that actually solutions that use the SP for image resolutions larger than CIF presently already exist in the market, but are not actually supported as conformance points. In a joint meeting with the Requirements subgroup, it was therefore decided to start an amendment, both for the standard text (14496-2:2004 Amd.2) and conformance (14496-4:2004 Amd.10) parts. It is planned to go for FPDAM in October and to FDAM in January 2005 meetings. It was considered important that the new levels are defined as compatible with the Advanced Simple Profile, such that eg. SP@L4 could be decoded by an ASP@L4 device.

Documents reviewed: M10910 A. G. Tescher for USNB USNB Contribution: The need for

additional levels for Visual SPM11041 Joseph Meehan, Minhua Zhou, Jennifer

Webb, Felix FernandesMPEG4 Simple-Profile Level 4 and 5 Proposal

New Version of MPEG-4 Visual List of Problems Reported Version 13 of the document "MPEG-4 Visual List of Problems Reported" (N6514) was issued. One issue related to text part (14496-2:2004) was added which is a typo in symbolic code and may therefore lead to mis-interpretation. In general, all remaining issues are of low priority, to be resolved in a later corrigendum. All known bugs in Momusys and Microsoft parts of the reference software are fixed at this time.

Conformance Corrigendum WD2.0

Fixing of Conformance streams being listed as erroneous in the WD 1.0 from previous meeting is still at a very early stage. A website to upload and retrieve corrected bitstream has been installed, but only one additional contribution was made in this period. Therefore, only a small update was made towards WD 2.0 (N6515) The further procedure of this corrigendum is planned as follows:

– The DCOR will be issued October 2004;– All bitstreams that are not available until then will be flagged as to be removed from the

conformance part (14496-4);– As no conformance would exist any more, this would imply a follow-up action where the

related profiles and levels would have to be removed from the standard text (14496-2) at the time the conformance corrigendum is issued (Jan. 2005). As of today, this would affect all video profiles except for the two Studio Profiles. Simple Scalable and Error-resilient Simple

103

Scalable Profiles would not be affected directly, but they would not have a base layer after removal of Simple Profile, which would make them useless.

Documents reviewed:

M10958 Yoshihiro Miyamoto

Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd Edition

AVC

In Redmond, a JVT meeting took place in parallel with the Video Subgroup. Main topics in MPEG-4 part 10 (AVC) were related to the Fidelity Range Extensions amendment (FDAM in N6539), edition 3 (N6540), conformance (N6532, N6533, N6534) and software (N6535, N6536, N6537).The video subgroup recommended approval of all the JVT-related documents by MPEG.

Output documents related to MPEG-4 Video and AVC


14496-2 MPEG-4 VisualN6495 Request for ISO/IEC 14496-2:2004 Amd.2 No 04/07/21

N6496 Text of ISO/IEC 14496-2:2004 PDAM2 New Levels in Simple Profile

No 04/07/21

N6514 MPEG-4 Visual: List of Problems Reported version 13.0 Yes 04/07/2314496-4 MPEG-4 Conformance

N6497 Request for ISO/IEC 14496-4:2004 Amd.10 No 04/07/21

N6498 Text of ISO/IEC 14496-4:2004 PDAM10 Conformance Extensions for New Levels of Visual Simple Profile

No 04/07/21

N6532 Disposition of Comments on ISO/IEC 14496-4:2004 FPDAM6 No 04/09/15N6533 Text of ISO/IEC 14496-4:2004 FDAM6 AVC Conformance No 04/09/15N6534 Text of ISO/IEC 14496-4:2004 PDAM9 AVC FRExt Conformance No 04/09/15N6515 WD 2.0 of 14496-4 Visual Bitstreams Conformance Corrigendum Yes 04/07/23

14496-5 MPEG-4 Reference SoftwareN6535 Disposition of Comments on ISO/IEC 14496-5:2004 FPDAM6 No 04/09/15N6536 Text of ISO/IEC 14496-5:2004 FDAM6 AVC Reference Software No 04/09/15

N6537 Text of ISO/IEC 14496-5:2004 PDAM8 AVC FRExt Reference Software

No 04/09/15

14496-10 Advanced Video Coding N6538 Disposition of NB Ballot Comments on ISO/IEC

14496-10:2004/FPDAM1 AVC Professional ExtensionsYes 04/08/31

N6539 Text of ISO/IEC 14496-10:2004/FDAM1 AVC Fidelity Range Extensions

No 04/08/31

N6540 Text of ISO/IEC 14496-10 Advanced Video Coding 3rd Edition No 04/08/31

MPEG-7

MPEG-7 related work in Redmond

The MPEG-7 breakout group was active during the whole week. Input documents as reviewed are listed in the subsequent table.

104

M10778 SC 37 via SC 29 Secretariat ISO/IEC FCD 19794-6: Information technology -- Biometric data interchange formats -- Part 6: Iris image data [SC 29 N 5958]

M10779 SC 37 via SC 29 Secretariat SC 37 NP on Vascular Biometric Image Interchange Format [SC 29 N 5959]

M10806 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-7/FPDAM 1 [SC 29 N 6046]

M10842 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 15938-3:2002/FDAM 1 [SC 29 N 6063]

M10916 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-6:2003/FPDAM 1

M10917 JTC 1 Secretariat via SC 29 Secretariat

Summary of Voting on ISO/IEC TR 15938-8/DAM 1

M10933 Karol Wnukowicz, Wladyslaw Skarbek

Dominant Color Temperature Descriptor

M10938 Robert O'Callaghan, Miroslaw Bober

Preliminary Results on Situation/View-Based Clustering

M10947 Sang-Kyun Kim, Seungji Yang, Yong Man Ro, Ji-Yeun Kim

Consideration on the clustering evaluation method for situation/view based photo clustering experiment (VCE-1)


CE Report for situation/view based photo clustering experiment (VCE-1)


GT set proposed for situation/view based photo clustering experiment (VCE-1)


Consideration on the photo categorization scheme (VCE-2)


Model set and GT set for the photo categorization experiment (VCE-2)


Consideration of face based photo clustering and retrieval

M10955 Akio Yamada, Sang-Kyun Kim

MPEG-7 Visual XM Document version 20.1

M10956 Akio Yamada, Sang-Kyun Kim

WD 1.1 of MPEG-7 New Visual Extensions

M10977 Soo-Jun Park, Myung Gil Jang

Cross verification of Model set and GT set for the photo categorization experiment (VCE-2)


Cross verification of GT set proposed for situation/view based photo clustering experiment (VCE-1)


Cross verification reprot of situation/view based photo clustering experiment (VCE-1)


Dataset of VCE-1 and 2

M10986 Soo-Jun Park, Chee Sun Won A proposal for a hierarchical grouping of digital photos CE

105

M10778 SC 37 via SC 29 Secretariat ISO/IEC FCD 19794-6: Information technology -- Biometric data interchange formats -- Part 6: Iris image data [SC 29 N 5958]

The recommendations of the AHG were approved. Two Core Experiments (on Situation/view based image clustering and Categorisation of images) will continue. Two new Core Experiments will start: the first one on Dominant Colour Temperature descriptor and the second one on use of AFR descriptor for ID-based annotation of images. The description of CE is in the output document N6518. The library of images for experimentation was further extended.

Joint meeting was held on file formats for the Photo Album MAF – it was agreed that the latest ISO-based file format can support both media-centric and meta-centric items.

We reviewed updated and issued WD 2.0 of the MPEG-7 new visual extensions. Also, Visual XM document version 21 was reviewed, updated and issued.

Output documents related to MPEG-7 Visual


15938-3 MPEG-7 VisualN6516 WD 2.0 of MPEG-7 New Visual Extensions No 04/07/23N6517 MPEG-7 Visual XM Document version 21.0 No 04/07/23N6518 Description of Core Experiments for MPEG-7 New Visual

ExtensionsNo 04/07/23

MPEG-21

Scalable Video Coding

The first task was review and interpretation of CE results. It was inherently clear that Core Experiments 1 and 2 were mainly targeting the compression performance over wider ranges of spatial, temporal & SNR resolutions, while keeping the effort for encoding/decoding as low as possible. Therefore, the following conditions had been defined in Munich, to be equally used in CE 1 and CE 2:

• Test 1 scenario: 3 spatial & 3 temporal resolutions at 6 rate points• Test 2 scenario: 2 spatial & 3 temporal resolutions at 5 rate points• 4 sequences in each test

In addition, Core Experiment 3 investigated possible mappings of PSNR and visual perception by performing an in-depth analysis of the CfP results. As a result from this CE, it can be concluded that in cases where SVC algorithms of rather different nature are compared, a useful mapping of subjective and PSNR seems to be impossible. There may be some indicators that PSNR is useful for two different variants of the same algorithm, provided that a comparison can be made against a "high rate reference" (which should be free of visible distortions) as the optimum decoding result. This would, for example, not be useful for the comparison of de-blocking and other post-processing algorithms. Due to the result of this CE, it became clear that it would be necessary to perform subjective viewing tests, for which a new procedure of expert viewing had been proposed (M 10935).

106

The following CEs had been executed:• CE1: MCTF/2D Wavelet solutions. For each of the following sub-experiments, bitstreams were

provided for both Test 1 and Test 2 scenarios. Participants had agreed on one best solution for each sub-experiment during the AHG pre-meeting. All CE1 results were obtained by the software provided by MSRA, or extensions thereof (see AHG report M10758 for more details).

– 1a: Scalable motion information. The participants agreed that the improvement achieved is not significant in terms of visual quality, Therefore, 1a did not participate in the expert viewing tests. As scalable motion is partially integrated in the original MSRA algorithm, this was taken as a placeholder.

– 1b: Spatial transforms. Only one result was reported, which did not show any significant visual improvement yet, according to the participants' judgement. 1b was therefore skipped from the viewing tests.

– 1c: Intra coding. The participants selected a 'best choice' for visual improvement, which moderately applies over most rates.

– 1d: Introduction of base layer. In this CE, it was shown that the MCTF/2D Wavelet algorithm can be significantly improved by introduction of an AVC (compliant) base layer at the lowest QCIF rate. It was reported that also an improvement of the CIF resolutions is achieved, while no significant decrease in quality at the highest (4CIF) spatial resolution was observed. The participants were able to select a "best choice" of the different methods investigated.

– 1e: De-blocking in MC. The participants selected a 'best choice' for visual improvement, which moderately applies over most rates.

Unlike originally planned, it was not possible to combine the best results from the different sub-experiments. Therefore, these were compared against each other and against the CE2 methods in the experts viewing tests. It could however be assumed that a combination of the different best results would improve the overall performance of the MCTF/2DWT algorithms.

• CE2: AVC-based and -extending solutions. CE results were brought by using two different algorithms, one (2a) being an MCTF-extension of AVC without base-layer compatibility, the other two (2b and 2c) using a conformant AVC base layer with scalability extensions. Unfortunatelly, the 2c proponents still used the old rate/resolution settings from the previous CfP, such that it was not possible to compare with any other algorithms. Two different software implementations (HHI, University Póznan) were used in CE2.

– 2a: AVC+MCTF+Differential Pyramid (Test scenarios 1 and 2). Results were reported on sub-experiments 2.1-2.4, a combination of these was provided for the experts viewing tests.

– 2b: AVC+SNR scalability (Test Scenario 2). Results were reported on sub-experiments 2.5. AVC B-slice pyramid (UMCTF-like) was used.

It was decided to compare the results of 1a (original MSRA algorithm), 1c, 1d, 1e, 2a and 2b in the experts viewing tests. It was found that the best performance overall is achieved by the algorithm from 2a (AVC+MCTF+Differential Pyramid). This applies for the wide range of test points, however some detail loss can be observed in two sequences at 4-CIF resolution, as compared to the MCTF/2DWT algorithms. On the other hand, the latter ones produce significantly more artifacts, in particular at low rates. These artifacts are again reduced by the introduction of an AVC base layer (experiment 1d). 1c and 1e are at many points judged better than 1a (all three of them without base layer). 2a also outperformed 2b at most rate/resolution points that were available, where however the comparison is difficult due to the fact that 2b only provided results for Test Scenario 2. The Results of the visual assessment are documented in N6513.From the discussions during the Munich meeting, it was considered important to map the capabilities of scalable codecs with application requirements. A considerable number of input documents was received on this topic, which were summarized in a new version of the SVC

107

applications and requirements document (N6505), and used in the weighting of different algorithms' capabilities, for the purpose of the WD decision that was planned for the Redmond meeting. In general it was found, that different SVC application domains (such as surveillance and mobile services) emphasize different requirements to be of central focus (e.g. surveillance: Support for many combinations of spatial/temporal/SNR scalability; mobile: Compression performance must be comparable or better than single layer). Therefore, one main driving factors for the standardization of SVC is for sure the good compression performance, which should however come with minimum penalty when additional functionality is supported. A solution that performs good at some rate points, but significantly worse at others would not be a good choice. Exactly such behaviour had been the reason to reject other algorithms from the results of the CfP.Objections were raised that the CEs that were run prior to the Redmond meeting might not bring evidence about all possible/useful combinations of scalability, FGS or medium-grain scalability (MGS) capabilities, capabilities for ROI access etc. Proponents of all solutions claimed they can fulfill such additional functionalities. On the other hand, evidence is clearly shown from this reduced set of rate/resolution points that technology exists that can perform high-quality decoding from truncated bitstreams over wide ranges of rates. Therefore, from the results of the past round of Core Experiments, the solution 2a must be regarded as the current "benchmark" of the SVC standardization process. As it could however happen that another algorithm performs significantly better at intermediate rate points or more flexible combinations of spatial/temporal/SNR scalability (as to be proven by evidence from future Core Experiments), a certain danger exists that this benchmark might partially or completely be exchanged by another solution. It is however a part of the MPEG standards success comes due to the fact that stable solutions are developed (not exchanging complete concepts at stages of WD or beyond, as it may indeed be practice in other standardization bodies). Therefore, it was widely agreed in the closing plenary to describe the benchmark algorithm of CE 2a in a document entitled "Technologies under Consideration for Working Draft 1.0 of ISO/IEC 21000-13 Scalable Video Coding" (N6519) ("TuCfWD"). This describes the MCTF process and the differential encoding methods with reference to parts of AVC edition 3.

As a complement, the Scalable Video Model V 2.0 (N6520) was approved. This document• describes the requirements for and capabilities of the SVC software (to be used in core

experiments and later be developed into the standard reference software) • Describes the different capabilities of scalability combinations to be supported and to be

easily implemented (including known technical solutions at high level, such as 2D+t, t+2D, quantization, entropy coding etc.)

• describes the encoding and decoding processes assigned with specific tools of the benchmark ("TuCfWD") more precisely

It was agreed in the video group that presently, SVC CEs should be developed from the basis of the SVM document, i.e. to admit a CE it should fit into the high-level framework of the SVM. In a later stage, this can be developed into a description of non-normative processes related to SVC (similar to MPEG-4 Visual VM or MPEG-7 Visual XM).

The Software to be used in the CEs can be regarded as instantiation of the SVM. It should support easy implementation of the capabilities described in the SVM, as well as extensions thereof. As a part thereof, software exactly mapping the "TuCfWD" benchmark was donated by FhG-HHI under MPEG licensing rules. In fact, not all perspectives of the SVM may presently be supported by the software pacakages provided so far (MSRA, HHI). In the development of the standard, it will be necessary to further develop into one consistent reference software, which would however be premature to start before the WD decision is taken. Due to the importance of this, it was decided to establish an AHG responsible for maintenance of the SVM and the SVC software to be used in the

108

CEs, where already both packages will be run in combination in some activities. This AHG should also discuss concepts about possible integration of only one package.

The previous round of Core Experiments showed a number of deficiencies, which are only partially explainable by the fact that the SVC standardization process is just starting its transition into the convergence/collaboration phase. In particular, it must be stated that many timelines were missed, and the instability of the CE document could be the reason for some mis-interpretations that happened. The following guidelines for the CE document and the description of the single CEs were therefore agreed; it was furthermore agreed that a more precise document describing the SVC CE process will be developed by the next meeting.

The CE document shall describe precisely for each CE- a tool or combination of tools that shall be experimented- the purpose of this tool (or combination of tools) that is challenging the benchmark, shall

improve the benchmark or shall provide functionality that the benchmark is not supporting- the test sequences and test points used in the experimentation (mapping useful application

requirements)- the timeline and responsibilities, partners, cross-check parties etc.- the software configuration (e.g. providing configuration files) that shall be used- criteria to evaluate this CE

Interrelationship of different CEs must be considered, which can best be achieved by using common test sequences and test points (whenever possible) to make results comparable. These common experimental conditions with lowest possible number of test points must be kept fixed (if reasonable) to be able to track the progress that is made from one meeting to the next. For this purpose, it is reasonable to retain the sequence/rate/resolution definitions used in the Test 1 and 2 Scenarios of previous round. It is known that these provide operating points for viewing tests with distinguishable results. In addition, it was agreed that it will be necessary to add more test points. These will be used to explore the performance of algorithms for a wider variety of scalability combinations. To make this possible without being forced to compare a large number of results visually, additional points from a table (t.b.d. in the CE document) will be selected randomly. This selection will only be made after the bitstreams, bitstream extractors and decoders have been provided. Therefore, it is expected that it will not be possible to tune an algorithm for optimum performance only at pre-selected rate points. Core Experiments newly defined may use any of the software package that have been made available, combinations or extensions thereof. The CEs can be clustered into three different categories:

• CE 1: The purpose of this CE is to compare complete algorithms, layered combinations of algorithms or combinations of tools into algorithms. Only a complete solution that has brought evidence by participating CE 1 can be accepted into WD by the next meeting. If a solution from one of the other CEs (2-6) intends to be approved for WD, it must become readily integrated into an algorithm proposed in CE 1 and show CE 1 evidence in time for the next meeting. CE 1 should provide results from the fixed rate/resolution conditions (as from Munich) and the new procedure of randomly selected points. Results of CE 1 will again be compared by the same procedure of experts viewing tests.

• CE 2-6: The purpose of these CEs is to compare evidence of single tools, mostly in terms of compression performance improvement. The purpose of these CEs is to find promising techniques that are worthwhile to become integrated into CE 1 by the mid of the period, or need further investigation in future CEs. Whenever possible, these CEs should stick to the Test 1 and 2 Scenarios of previous round, to minimize the effort. When useful for the purpose of a specific CE, it might also be subsets or extensions thereof.

109

• CE 7-8: The purpose of these CEs is to explore additional functionality that are useful from specific application perspectives.

The list of second and third category CEs is as follows (see details in CE document, N6521):• CE 2: Base-layer investigation• CE 3: Coding efficiency vs. low-delay constraints• CE 4: Adaptation of MCTF update step• CE 5: Spatial scalability• CE 6: SNR scalability and FGS• CE 7: Non-linear adaptation

– Explores the capability of different "traces" of multiple adaptations (e.g. for erosion storage)

• CE 8: Error resiliency and robustness– Explores behaviour of SVC in presence of channel errors– Typically IP, 3G networks– Usage of MPEG-21 resource delivery testbed planned

Due to the lack of time during the meeting, N6521 needs further improvement, and a 2 weeks editing period is requested. It is consensus in the group that any experiments which do not provide the refined description with sufficient precision to guarantee success will be cancelled.

In addition to the reports about CE results, which were treated with highest priority, a number of technical input documents were reviewed, for which some notes are shortly summarized here. A complete list of titles can be found below under table c):M11131. Modify EBCOT such that not the directional correlation is used in temporal lowpass frame encoding, instead directional prediction is performed. Directional angles are estimated locally, each macroblock uses only one prediction direction. Gives up to 2 dB for Barbara in JPEG-2000 (less in others), and 0.5 dB in Foreman for MSRA MCTF. No other sequences investigated.M10904. Goal: Design better lowpass filters for aliasing cancellation. Used the filters only for SD->CIF conversion, CIF->QCIF was again done by 9/7. In City sequence, loss of 0.5 dB on SD, gain of 1 dB at CIF. M11096) Joint estimation for multiple rate points, some visual gain at highest QCIF rateM10902. Accuracy scalability of motion vectors, modification of the estimation. Gain of up to 0.75 dB at highest rate (City, other sequences much lower, usually 0.1..0.2)M11016. Motion coding based on prediction, differences handled by bit-plane coding. Rate distortion optimization, distortion criterion is difference between "true" H frame and H frame as generated by scalable motion representation. Implemented in SDMCTF of VUB. Gain of up to 2 dB at lowest rate for sequences with complex motion, less for sequences with simple motion. Also integrated into MSRA software; similar gain. All results only in context of quality scalability at CIF resolution.M11100. Coarse-to-fine and fine-to-coarse prediction of motion vectors, Laplacian pyramid approach. CotoFi: Slight increase of PSNR if QCIF motion vectors are used for interpolative prediction of CIF resolution. FitoCo: Usage of decimated CIF motion vectors improves performance at CIF (Foreman 1dB, other sequences less), but predictive coding from decimated vectors leads to some loss at CIF. However, a larger number of blocks is used at QCIF when the decimated vectors are used.M11039. Five different intra prediction or interpolation modes. Usually gain at low bit rates and in cases of complex motion (eventually already at near transition towards "bad quality"?).M10875. Propose different temporal scalability structures in AVC (p-frame, b-frame, hierarchical b-frame). Up to three layers, moderate loss as compared to non-lossless.M11126. 2D+t scheme: problems are high-subband leak and mismatch, non-exchangeability between s+t. Different methods are investigated (incl. ODWT). Approach that selects additional

110

highpass coefficient to prevent drift appears most promising. Additional buffers necessary for the upsampling to full resolution (overcomplete). Request for investigation in CE. M10993. MSRA barbell lifting uses bilinear interpolation in update step, in case of motion discontinuities artifacts can occur. In case of homogeneous motion, 2D+t and t+2D would be equivalent. In case of motion discontinuity, additional highpass coefficients would have to be transmitted to make it equivalent. Have implemented in reference software. Encoder not changed, only decoder, DWT interpolation used rather than sinc. Gain approx. 0.1 dB. Small gain visually at data rates testedM10997. Propose hybrid layered compression with AVC base and MCTF enhancement. Shows clear improvement, also in cases of low delay. "Should become basis approach in SVC".M11084. Investigate different structures wrt delay, e.g. 5/3, Haar etc. E.g. by not performing update, the delay can be bounded. Generally, performance increases with increased delay. Find that it is better to keep the update, usually gives better performance in case of equal delay. This is of course sequence dependent.M11045. spatial and temporal transforms not interchangeable. Use overcomplete representation to solve the problem. Tendency: At low rates IBMCTF better by up to 4 dB, at high rates usually 0.5 dB worse than SDMCTF.M11130. Problem in 2D+t: shift variance of wavelet transform. In principle similar to a complete-to-overcomplete transform. Use AVC codecs to code the single subbands. Loss as compared to t+2D relatively low (but SNR ??) Propose CE to study other structures such as 2D+t or 2D+t+2D.M10868. Application (JPIP, similar to the military surveillance) which cannot be done without scalability. Ghosting artifacts if motion trajectory is not appropriate. Adaptively adapt the update step to circumvent this problem, which even gives sometimes higher compression performance. Spatial scalability: No interchangeability. Efficient spatial scalability cannot be achieved without 2D+t. 2D+t shows higher aliasing than t+2D, but latter one is inferior when motion model fails. Best would be to combine both. Use MJPEG2000 variant which extends the blocks into the third dimension, such that adaptation becomes better.

Joint meetings were held with JPEG and VCEG, the purpose of which was to inform the other bodies about progress in the SVC standardization process. Unfortunately, when the meetings were held, it was not yet possible to give any concrete information about progress in technology selection. Therefore, only information about the status of CE results (including the algorithms behind) could be given, and the results of experts viewing were shortly imported. Both groups showed high interest in SVC, in particular raised by the fact that the solutions investigated are using or extending parts of their own standardization work.Documents reviewed:

a) GeneralM10935 Vittorio Barboncini, Tobias

OelbaumA Multimedia material Visual quality ranking procedure based on Single or Multiple Viewing

M11012 DANAE Consortium Licensing status of software in SVC standardizationM11108 Justin Ridge, Marta

Karczewicz, Yiliang Bao, Shawn Wang

Comment regarding SVC software selection

b) Core Experiments

M10931 Ulrich Benzler, Mathias Wien

Results of SVC CE3 (Quality Evaluation)

M10934 Han-Kuang Hsu, Chia-Yang Response to CE1b in SVC-- SB-Reach Method for

111

Tsai, Hsiang-Cheh Huang, Hsueh-Ming Hang, Tihao Chiang

Entropy Coding

M10946 Takahiro Kimoto, Yoshihiro Miyamoto

Response to SVC Core Experiment 1d. Introduction of a Base-Layer

M10987 Julien Reichel, Guillaume Baud, Francesco Ziliani

Responses of CE1e in SVC: Adaptive update step in MCTF

M10988 Diego Santa Cruz, Julien Reichel, Francesco Ziliani


M10989 Francesco Ziliani Summary of responces to Ce1d: Introduction of a Baser Layer

M11010 Konstantin Hanke SVC CE1e - Verification of Visiowave Results on Adaptive Update Step in MCTF

M11011 Konstantin Hanke Response to SVC CE1e - Spatial Highpass Transition Filtering

M11020 Thomas Wedi Verification of HHI Results for Core Experiments on AVC-Based Scalable Video Coding

M11040 Mathias Wien CE2.4 Adaptive Spatial Transforms: Verification of HHI results

M11042 Woo-Jin Han Verification of SAIT results for SVC on CE1a Motion Scalability

M11043 Heiko Schwarz, Detlev Marpe, Thomas Wiegand

SVC Core Experiment 2.1: Inter-layer prediction of motion and residual data

M11047 Woo-Jin Han, Sang-Chang Cha

Verification of OES/ITRI results for SVC on CE1c Intra Prediction


SVC Core Experiment 2.2: Influence of the update step on the coding efficiency

M11049 Woo-Jin Han, Ho-Jin Ha Verification of VisioWave results for SVC on CE1d Base Layer

M11050 Woo-Jin Han, Sang-Chang Cha, Jae-Young Lee

Verification of MSRA results for SVC on CE1e Deblocking


SVC Core Experiment 2.3: Spatial interpolation


SVC Core Experiment 2.4: Adaptive Spatial Transforms

M11054 Woo-Jin HanSang-Chang Cha

Responses of SVC CE1c Intra Predictionl; Pixel-interpolated prediction

M11055 Woo-Jin Han, Ho-Jin Ha Responses of SVC CE1d Base Layer; R-D optimized base-layering

M11056 Woo-Jin Han, Sang-Chang Cha, Jae-Young Lee

Responses of SVC CE1e Deblocking; In-loop prediction smoothing

M11069 Vatis Jörn Ostermann verification of HHI results for core experiment on scalible video coding

M11074 Davide Maestroni, Marco Tagliasacchi, Stefano Tubaro


M11085 Gregoire Pau, Beatrice Pesquet-Popescu

Cross-verification of RWTH results on SVC CE-1e

M11095 Diego Santa Cruz Cross-verification of results for SVC on CE1dM11099 Rafal Lange, Marek Response to SVC CE2: inter-layer motion

112

Domanski information predictionM11101 Laukasz Blaszak, Marek

Domanski, Rafal Lange, Adam Luczak

Response to SVC CE2: testing of SNR scalability technologies

M11107 Justin Ridge, Marta Karczewicz, Yiliang Bao, Shawn Wang

Extension to AVC-based scalable video coding

M11120 Francois Edouard CE1a : cross verification of MSRA proposalM11122 Giovanni Cordara CE1a: TILAB-PdM solutionM11123 Ji Jizheng Xu Verification of NCTU results for SVC on CE1b,

entropy codingM11124 Xiong Jizheng Xu Verification of TILAB/PdM results for SVC on

CE1aM11125 Song Jizheng Xu Verification of SUMSUNG results for SVC on CE1cM11127 Ji Jizheng Xu Debin Zhao

Feng WuResponses of CE1d in SVC: Base layer

M11128 Xiong Jizheng Xu Feng Wu Responses of CE1a in SVC: Scalable MotionM11129 Song Jizheng Xu Hongkai

Xiong Feng WuResponses of CE1e in SVC: Adaptive update based on human vision system

M11136 Feng Pan, Yin Sun SVC CE1e - Verification of MSRA Results on MCTF adaptation in the temporal update step

M11137 Joohee Kim, Hyeyeon Kim Responses to SVC CE1a: scalable motion information coding

M11138 HsinHao Chen Verification Report of Samsung results for SVC on CE1c: Intra-prediction

M11139 Giovanni Cordara CE1a : cross verification of Samsung proposal

c) Other technical input

M10868 David Taubman, Nagita Mehrseresht, Raymond Leung

SVC Technical Contribution: Overview of recent technology developments at UNSW

M10875 Shijun Sun Temporal Scalable Coding Using AVC Coding ToolsM10902 Francois Edouard,

Boisson Guillaume, Vieron Jerome, Bottreau Vincent, Guillemot Christine

Evaluation of Motion accuracy scalability - SVC Core experiment 1a

M10904 Vincent Bottreau, Christine Guillemot, Rashid Ansari, Edouard Francois

SVC Technical Contribution to CE1b: Spatial Transform using Three Lifting Steps

M10993 Pateux, Amonou, Kervadec

A generic framework for MCTF-based coding

M10997 Ihor Kirenko, Rene van der Vleuten, Fons Bruls

Flexible Scalable Video Compression

M11016 Joeri Barbarien, Adrian Munteanu, Yiannis Andreopoulos, Fabio

Prediction-based scalable motion vector coding

113

Verdicchio, Jan Cornelis, Peter Schelkens

M11039 Leszek Cieplinski, Soroush Ghanbari

Preliminary Results of SVC CE1c

M11045 Y. Andreopoulos, A. Munteanu, M. van der Schaar, J. Cornelis, P. Schelkens

Comparison Between t+2D and 2D+t Architectures with Advanced Motion Compensated Temporal Filtering

M11084 Gregoire Pau, Beatrice Pesquet-Popescu, Mihaela van der Schaar, Jerome Vieron

Delay-Performance Trade-Offs in Motion-Compensated Scalable Subband Video Compression

M11096 Thomas Rusert, Mathias Wien

Multi-Layered Motion Estimation with Constrained Enhancement (SVC CE1a)

M11100 Deepak Turaga, Ali Tabatabai, Minh Do

Multiresolution Representation of Motion Information for Scalable Video Coding

M11119 Hsin-Hao Chen, Guo-Zua Wu, Yi-Jung Wang

Proposed CE for Exploiting the Spatial Correlation within the Low-Pass Frames

M11126 Xiong, Jizheng Xu, Feng Wu

Spatial Scalability in 3D Wavelet Coding with Spatial Domain MCTF Encoder

M11130 Zhang, Jizheng Xu, Hongkai Xiong, Feng Wu

Sub-pixel phase over-complete sub-band transform

M11131 Zhang, Wenpeng Ding, Jizheng Xu, Hanqin Lu, Feng Wu

Responses of CE1b in SVC: Direction prediction for spatial transform

d) Requirements

M10822 Robert Prandolini Scalable Video Coding Requirements for Video Surveillance Systems

M10853 Mauri Väänänen Finnish NB comment: SVC requirements and directions

M10901 Francois Edouard, Vieron Jerome

Discussion on requirements and applications of Scalable Video Coding

M10909 A. G. Tescher for USNB USNB Contribution: Response to Munich resolution 2.2.2

M10932 Ulrich Benzler Discussion on requirements and applications for Scalable Video Coding

M10941 Sachin Deshpande HTTP Agent-Driven Content Negotiation for Scalable Video Coding

M10995 Pateux, Amonou, Kervadec France Telecom Requirements for Scalable Video Coding

M10998 Gero Bäse, Andreas Hutter, Peter Amon

Requirements for a scalable video coding standard

M11067 Julien Reichel, Francesco Ziliani

Requirements for Scalable Video Coding for Video Surveillance Applications

M11082 French National Body FNB Position on SVC StandardizationM11097 Ali Tabatabai, Rohit Puri Multiple description coding for generalized layeringM11106 Justin Ridge Mobile communications industry comments on SVC

114

requirementsM11133 Guillemot, Liebl,

Stockhammer, JenkacDiscussion on requirements and applications of Scalable Video Coding for MBMS

Output documents related to MPEG-21 SVC


21000-13 Scalable Video Coding

N6519 Technologies under Consideration for Working Draft of ISO/IEC 21000-13 Scalable Video Coding

No 04/07/23

N6520 Scalable Video Model Version 2.0 No 04/08/06

N6521 Description of Core Experiments in MPEG-21 Scalable Video Coding

No 04/08/06

N6513 Results of the visual assessment of the results of the CEs on Scalable Video Coding Technology

No 04/07/23

N6505 Applications and Requirements of Scalable Video Coding No 04/07/23

Explorations

3D AV Coding

Multiview video coding (MVC) is a “tool” needed for new and emerging applications such as Free Viewpoint Video (FVV) or 3D-TV. A straight-forward solution would be simulcast of AVC streams. By input brought to this and previous meetings, initial evidence is given that dedicated MVC methods could outperform AVC simulcast. To prove this, a formal Call for Evidence (CfE) shall be issued, which may lead to a subsequent CfP on MVC. Such new technology should expose significant improvement of coding efficiency compared to AVC simulcast, which means significant improvement of PSNR results and/or significant improvement of visual quality, to be measured most probably by expert viewing (similar to the procedure employed in SVC development) in the CfE. Elaboration of an appropriate testing methodology is of high importance in this context. A proposal was made in M10870 to use DSIS compared to original, which would give a scaled and quantified test result. This would however be difficult to perform in reviewing CfE results during an MPEG meeting (maybe later in formal subjective tests when it comes to a CfP). A-B comparison of anchors against proposals by a more coarse decision (better, equal, worse) would provide the evidence that is needed, and could easily be performed by an experts viewing procedure.It is of high importance also to judge the quality distribution over all camera views of a data set. This means that proponents shall provide detailed PSNR results such as

– Plots of PSNR over frame for each sequence of each data set– Mean PSNR over each sequence of each data set– Mean PSNR over all sequences of each data set

This needs to be produced also for the anchors. Results have to be made available for the complete test data set. The proponents shall report

– detailed PSNR results (as above)– algorithms– complexity in relation to AVC (informative, brief)– target application

For the purpose of the CfE, 10 test sequence sets with 5-16 views were provided and encoded using AVC simulcast anchors. If each set of sequences would have to be encoded at 3 bitrates, this would

115

make the comparison of » 210 sequences for each proposal necessary. To reduce this effort, only two views shall be selected randomly for the viewing. Additionally, results bringing evidence about the interrelation between compression and view interpolation could be submitted.The following timeline is planned

– Preliminary Call for Evidence issued in Redmond (public)– Preliminary results are requested for Palma meeting to further refine testing

methodology when necessary– Final Call for Evidence issued in October– Results expected for January 2005

Technical input was reviewed as follows:M10929 showed the effect of a spatio-temporal prediction scheme (kind-of multi-frame prediction), Flamenco and Xmas test sequences were chosen. Large gains are reported for Xmas. Subsampling is performed by omitting views, gain decreases with camera distance. No gain for Flamenco, gain increases with temporal subsampling.M10976 resumes the GoGOP proposal from last meeting, presents extended spatio-temporal prediction structure. Reports gain of over 1 dB for most sequences of Race2 data set, also visual quality is improved. M11014 uses the Aquarium sequence and evaluates spatial and temporal frame differences before and after compensation. It presents a projective transform (rectification) and evaluates residual error before and after transformation, which is reduced.M11132 proposes illumination compensation (IC) for MVC, compares ST method with and without IC and reports gain from IC in some (sparse) cases. It compares also to AVC simulcast and reports gain for some sequencesDocuments reviewed:M10870 Marco Rittermann A Proposal for Testing Multi-View

Video CodingM10894 Stephan Würmlin, Michael Waschbüsch,

Edouard Lamboray, Peter Kaufmann, Aljoscha Smolic, Markus Gross

Image-space Free-viewpoint Video

M10928 Wook-Joong Kim, Euee. S. Jang Consideration on the MAF for omni-directional AV

M10929 Ulrich Fecker, Andre Kaup Transposed Picture Ordering for Dynamic Light Field Coding

M10943 Sun Lifeng, Zhang Hu, Yang Shiqiang, Cheng Xiaoyu, Li Fang

Results for EE3 on evaluation of MAC for stereoscopic video coding (contributors not present)

M10952 Cheng Xiaoyu Consideration on Quality Measure for Multiview Video (contributors not present)

M10970 Li Fang, Sun Lifeng, Yang Shiqiang Consideration on Synthesis Method for Multiview Video

M10975 Hideaki Kimata, Masaki Kitahara Anchor bitstreams for experiments on multiple view video coding (3DAV)

M10976 Hideaki Kimata, Masaki Kitahara Preliminary results on multiple view video coding (3DAV)

M11014 Masayuki Tanimoto, Toshiaki Fujii Utilization of inter-view correlation for multiple view video coding

M11132 Chen Jae, Hoon Kim, Joaquín López, Antonio Ortega

Illumination Compensation for Multi View Compression

116

Video Coding Tools Repository

Two breakout meetings were held to discuss VCTR matters during the MPEG week. Three contributions are reviewed. A joint meeting with Implementation Study Group was also arranged to discuss issues regarding software and hardware implementation aspects of this work. Throughout the discussion, the updates are made to the Study 2.0 document as an output.

Some highlights of VCTR discussions are: What is the Repository? - Is a collection of decoding functional units extracted from

existing MPEG standards and updated with new tools whose addition has been considered beneficial by MPEG.

What is a Decoder Configuration? - A collection of functional units drawn from the repository. A decoder configuration may be an existing MPEG standard or a new standard that includes new functional units.

Intra-only video coding as a starting point – it is decided to pursue VCTR from intra-only video coding first. It is expected to extend VCTR further to encompass inter-frame coding and other functionalities in the future.

Remaining issues – There are some remaining open issues such as software implementation of VCTR and detailed picture of VCTR. These remaining issues will be discussed through the continuing AhG activity till October.

Details on VCTR can be found in Study 2.0 document (N6522).

Documents reviewed:M10966 Euee S. Jang, Lee, Cho, Lee Initial thoughts on VCTR activityM11142 C.J. Tsai Universal Video Codec Architecture

SuggestionsM11143 Kohtaro Asai Exercise of intra-only video coding tools

repository

Output documents related to Explorations

No. Title TBP Available3D AV

N6494 Preliminary Call for Evidence on Multiple View Video Coding Yes 04/07/23N6501 Applications and Requirements of Multiple View Video

Coding Yes 04/07/23

Video Coding Tools RepositoryN6522 Study of Video Coding Tools Repository No 04/07/23

Miscellanea

A joint meeting was held with Requirements on issues of Persistent Association Technologies (PAT). It was identified that some technical aspects fall for sure into the competence of the Video group; on the other hand, aspects such as visibility of watermarks that seem to be more important at this moment from a requirements perspective, should rather be discussed with the Test group.Documents reviewed

M10885 Jong-Tae Kim, Weon-Geun Oh, Hae- Video Extension to Evaluation Tools for

117

Kwang Kim, Heung-Kyu Lee, Young-Ho Seo

Persistent Association Technologies

M10886 Ik-Hwan Cho, Hae Kwang Kim, Weon-Geun Oh, Dong-Seok Jeong

Composition of Test Video Sequences for Evaluation of the robustness of PAT

AHGs established by the Video Subgroup No. Title Mtg652

3AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

N

6524

AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software

N

6525

AHG on Description Tools for New MPEG-7 Visual Extensions Y

6526

AHG on Core Experiments in Scalable Video Coding Y

6527

AHG on Scalable Video Model and SVC Software N

6528

AHG on 3DAV Coding Y

6529

AHG on Video Coding Tools Repository Y

118

Annex 9Report of Audio meeting

Source: S. Quackenbush, Chair, Audio Subgroup

1 OPENING OF THE MEETING..........................................................................................................3

2 ADMINISTRATIVE MATTERS.........................................................................................................3

2.1 Approval of previous meeting report........................................................................................................3

2.2 Approval of agenda and allocation of contributions................................................................................3

2.3 Communications from the Chair.............................................................................................................. 3

2.4 Joint meetings............................................................................................................................................ 3

2.5 Received National Body Comments and Liaison matters........................................................................3

2.6 Task Groups.............................................................................................................................................. 3

3 AHG MEETINGS.............................................................................................................................. 3

3.1 Synthetic Music Representation (Sunday 0900 – 1800)............................................................................3

3.2 MPEG-4 Lossless Coding (Sunday 1000-1200).........................................................................................4

3.3 Spatial Audio Coding (Sunday 1200-1800)...............................................................................................4

4 AUDIO PLENARY, JOINT MEETING AND TASK GROUP ACTIVITIES..........................................6

4.1 Review of AHG reports............................................................................................................................. 7

4.2 Received national body comments and liaison matters............................................................................7

4.3 Audio plenary discussions......................................................................................................................... 74.3.1 Parametric Stereo Verification Test Report..........................................................................................74.3.2 Spatial Audio Evaluation..................................................................................................................... 7

4.4 Joint Meetings........................................................................................................................................... 74.4.1 With Requirements, Systems and MDS on MAF Tue 1100-1130.........................................................74.4.2 With Requirements on US NB Comment Tue 1130-1200.....................................................................84.4.3 With Systems on Audio Codec Behavior, Wed 1600-1700...................................................................84.4.4 With Systems on AU ballot comments on MAF, Thu 1230-1400.........................................................84.4.5 With Requirements New Profiles and SMR CfP Thu 1400-1430..........................................................8

4.5 Task Group discussions............................................................................................................................. 84.5.1 HE-AAC.............................................................................................................................................. 84.5.2 Layer III.............................................................................................................................................. 9

119

4.5.3 MPEG-4 Lossless Audio Coding.......................................................................................................... 94.5.4 MPEG-7 Audio.................................................................................................................................. 104.5.5 MPEG-A............................................................................................................................................ 104.5.6 MPEG-4 Audio.................................................................................................................................. 104.5.7 Spatial Audio Coding......................................................................................................................... 114.5.8 Symbolic Music Representation......................................................................................................... 114.5.9 Scalable Audio Coding...................................................................................................................... 11

5 MEETING DELIVERABLES...........................................................................................................11

5.1 Press statement........................................................................................................................................ 11

5.2 Dispositions of Comments....................................................................................................................... 11

5.3 Responses to Liaison and NB comments.................................................................................................11

5.4 Recommendations for final plenary........................................................................................................ 11

5.5 Establishment of Ad-hoc Groups............................................................................................................ 11

5.6 Approval of output documents................................................................................................................ 11

6 FUTURE ACTIVITIES....................................................................................................................11

6.1 Schedule of future meetings.................................................................................................................... 11

6.2 Agenda for next meeting......................................................................................................................... 11

6.3 All other business..................................................................................................................................... 11

6.4 Closing of the meeting............................................................................................................................. 12

ANNEX A PARTICIPANTS...............................................................................................................13

ANNEX B AUDIO CONTRIBUTIONS AND SCHEDULE...................................................................14

ANNEX C TASK GROUPS...............................................................................................................18

ANNEX D OUTPUT DOCUMENTS...................................................................................................20

Annex E Agenda for the 70th MPEG Audio Meeting..........................................................................22

120

Opening of the meetingThe MPEG Audio Subgroup meeting was held during the 69th meeting of WG11, July 19-23, 2004, Redmond, WA, USA. The list of participants is given in Annex A.

Administrative matters

Approval of previous meeting reportThe 68th Audio Subgroup meeting report had been previously distributed by e-mail and was approved.

Approval of agenda and allocation of contributionsThe agenda and schedule for the meeting was discussed, edited and approved. It shows the documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary. The Chair brought relevant documents from Requirements, Systems and MDS to the attention of the group. It was revised in the course of the week to reflect the progress of the meeting, and the final version is shown in Annex B.

Communications from the ChairThe Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary.

Joint meetingsThe joint meetings with Audio over the course of the week are listed here and are reported on below.

Groups What Where Day TimeAudio, Req, Sys, MDS

10944, AUNB Comments10962, MAF file format

Audio Tue 1100-1130

Audio, Req USNB Comment Audio Tue 1130-1200Audio, Systems 11080, Audio Codec Behavior Audio Wed 1600-1700Audio, Req AUNB DoC Audio Thu 1230-1400Audio, Req Review SMR CfP requirements

Review new profile proposalsAudio Thu 1400-1430

Received National Body Comments and Liaison mattersThe NB Comments and Liaison documents for the meeting that require a response are as shown below.No. Title Response by

10906 USNB Contribution: Proposed CfP for Scalable Audio under MPEG 21 S. Quackenbush

10991 SgNB Comment on the Lossless Audio Coding Work S. Quackenbush11102 FNB Position Paper on MPEG applications, context and objective s S. Quackenbush

Task GroupsTask groups were convened for the duration of the MPEG meeting, as shown in Annex C Results of task group activities are reported below.

AhG meetings

121








In order to obtain a compete view of the business of this MPEG meeting, discussion of contributions in AhG meetings are recorded in this section of the Audio report.

Synthetic Music Representation (Sunday 0900 – 1800)Micheal Good, Recordare, presented

11083 Michael Good Response to Draft Call for Proposals N6457

There was considerable discussion of this document and of the CfP and the Evaluation document. Paolo Nesi presented the following documents:

11002 James Ingram Comments on Symbolic Music Representation requirements

11021



11019



11025



MPEG-4 Lossless Coding (Sunday 1000-1200)Ralf Geiger, FhG, presented

11079 Ralf GeigerJuergen Herre On the Performance of MPEG-4 SLS RM4

Rongshan Yu, I2R, presented

11059 Rongshan YuCrosscheck on FhG’s Proposed Core Experiment for MPEG-4 Audio Scalable to Lossless (SLS) Coding

The Audio Chair proposed that Audio Subgroup document the current performance and complexity of SLS and ALS as a Task Group activity. The various authors each presented:

11062

Rongshan YuSusanto RahardjaXiao LinHaibin Huang



11114 Yuriy A. Reznik Proposed CE on Additional Enhancements for Lo ssless Audio Coding

122



















































Spatial Audio Coding (Sunday 1200-1800)Werner Oomen presented

11001 Heiko PurnhagenWerner Oomen

CT/Philips contribution to CfP on spatial audio coding

Philips and CT presented their submission in response to the CfP on spatial audio coding (M11001). The Philips/CT architecture is completely based on the parametric strereo technology as standardised in Amd2. Philips/CT presented informal test results for all the 3 configurations that will be evaluated prior to the next meeting. Additionally, the document contained input on this evaluation process. Listening test participants were given careful instructions with respect to assessment of coding distortions and sound stage distortions. Three test results were presented for 5-1-5 and 5-2-5 with AAC core and 48 kb/s with HE-AAC core. Proposals for evaluation of multi-channel material

Use 5.0 material only Use 44.1 kHz material only

Evaluation of downmixed material Use band-limited ITU downmixes as lowpass anchors Use RMS values for normalization of downmixes

Selection criterion1. mean quality is paramount2. Consistency of individual items (select technology that maximizes the minimum

performance)3. Complexity4. Features

Spatial side information bitrate Higher for 5-1-5 and 5-2-5, e.g. 32 kb/s total Lower rates will be tested by 48 kb/s HE-AAC test scenario 48 kb/s test will use a single integrated bitstream (with side information muxed into the

main bitstream) so that one can insure that the AAC input buffer requirements are met.Test material categories

“orchestral” sound stage “synthetic” sound stage movie sound track (i.e. strong center channel dialog) “pathological” material (e.g. castpan or applause)

Jim Johnston, Microsoft, noted that it would be very good if some of the test items represented acoustic soundfields as result from actual recordings. Many currently available test items are mixed from discrete voices which may not represent a soundfield of an actual performance. Kok-Seng Chong presented



This document presented listening test results for 6-1-6 and 6-2-6 modes using an AAC core. It noted that the bandwidth of the proposed technology was limited due the bandwidth of the AAC core. Side information rate was less than 24 kb/s for 6-1-6 and less than 32 kb/s for 6-2-6. They matched the level of the Dolby Prologic II signal to that of the other processed test items via multi-listener subjective assessment.

123













Kazuhiro Iida presented comments on the evaluation process. The perception of multi-channel signals have three attributes:

Spatial (soundstage) Temporal (reverberation) Qualitative (e.g. timber)

He proposes that listening test responses try to capture Spatial attribute (e.g via a separate response panel) Timber (e.g. via a conventional MUSHRA response panel)

There was some very interesting discussion on low anchors: low “frequency” filtered or low “space” filtered. The Audio Chair suggested that it might be best if the Audio Subgroup not make the CfP evaluation into a research project on low anchors for spatial audio coding.Juergen Herre, FhG, presented

11075

Juergen HerreChristof FallerC. SpengerJ. HilpertK. Linzmeier


Proposed the following general system characteristics That the technology be “coder-agnostic.” One outcome of this position is that the technology needs to adapt

to a range of coder frame lengths. That the system does not depend on a given downmix procedure. One extreme of this position is that the

technology support arbitrary, externally generated downmixes of the multichannel signal, most significantly as done by an expert sound engineer.

Side information rate was less than 20 kb/s for 5-1-5 and below 24 kb/s for 5-2-5.

The presentation suggested that the evaluation might want to consider multiple technology solutions that may present complexity/quality tradeoffs.

Mark Vinton presented

11090

Matt FellersMark VintonMark DavisGrant Davidson


Listening test used 16 kb/s for side information and 64 kb/s AAC for encoding the downmix. The test evaluated two systems for n-1-n and one system for n-2-n. Dolby is able to make available a new 5.1 test item (“Stomp”) for this MPEG work.

Dolby’s only comment on evaluation process is that the currently proposed Test 3 should instead use a “black box” encoder rather than a “user-optimized” encoder.

Juergen Herre presented

11076 Juergen Herre

Evaluation of Spatial Audio Coding Schemes

This contribution made two points concerning evaluation. First point is that systems that exploit spatial coding may be optimal at one listener position but not another. Hence it proposes that systems be evaluated for “off-center” listening positions, or at least that a “sanity check” be conducted at off-center listening positions. This may be implemented as additional listener instructions and associated listener comments.

The second point is that support for external downmixes (e.g. hand-crafted stereo mixes) is very important for success in the marketplace. Potential customers that currently rely on such hand-crafted stereo mixes may be reluctant to adopt a technology that has been tested only on automatically generated stereo mixes. FhG has made available two sets of hand-crafted material, one stressing the instruments present in the downmix, the other stressing the soundstage of the downmix. The goal in using these downmixes is twofold: first to test that a “well-behaved” hand-crafted downmix can lead to a highly acceptable multichannel signal; the second is that a “pathological” hand-crafted

124
















downmix (e.g. missing an instrument) does not result in a multichannel signal with artefacts due to the missing instrument.

Finally, the contribution observes that certain test items will stress the core coder (i.e. AAC at 64 kb/s/channel) to the extent that the core coder distortion will dominate the spatial audio coder presentation.

FhG endorses evaluation using 5.1 (i.e. subwoofer) signals.

Discussion of evaluation

Paul Jessop, IFPI, stated that many respected mastering studios only produce separate hand-crafted stereo and multichannel mixes. He suspects that technology that can only present automated stereo downmix from the multichannel signal will not be endorsed by artists or mastering engineers and hence might not be accepted in the marketplace.

Werner Oomen, Philips, stated that a significant number of SACDs have their associated stereo mixes generated automatically. Furthermore, he noted that many hand-crafted downmixes may involve dubs to analog tape, such that they are no longer exactly time-aligned with the 5-channel mix.

This may argue for two use cases: Compatible with hand-crafted downmixes. Ultimate compression of 5-channel signal, in which case downmix signal does not have to be evaluated.

Jim Johnston, Microsoft, noted that he endorses off-axis evaluation. He also recommends that material be selected so that it is well-behaved in off-axis listening.

Schuyler Quackenbush, Audio Research Labs, presented

11065 Schuyler Quackenbush

DRAFT Procedures for the Evaluation of Spatial Audio Coding Systems

This draft document will be discussed during the MPEG week.

Audio plenary, joint meeting and task group activities

Review of AHG reportsThere were no requests to review any of the AHG reports.

Received national body comments and liaison mattersThe Audio Chair presented the NB Comments listed in Section .

Audio plenary discussions

Parametric Audio Coding Verification Test Report

Werner Oomen presented

11005 Martin Link

Subjective results formal verification test MPEG4-Ext2. (Parametric)

Martin Link from the IRT has conducted the formal verification test for Amd2 (parametric). FhG provided the AAC coded items. The tests have been performed for mono and stereo at bitrates around 20kbps total, using headphones with 26 subjects. The raw test results were submitted as an input document to the meeting (M11005). From these test results it could be concluded that the acceptance criteria were met for stereo. For mono, there were two items that performed statistically significant worse than AAC on the same bit-rate. It was noted that one of these items was bandlimited. Overall, the parametric coder performance was comparable to AAC when the latter was running at 25% higher bit-rate. Werner Oomen presented

125











11037 Werner Oomen

Complementary information to Formal verification test parametric

Philips brought informal test results (M11037) illustrating the relative performance of parametric at 24kbps stereo compared to AAC at 32kbps stereo. Furthermore, this input showed the capabilities of the parametric stereo tool. For the same bitrate there is only a slight decrease in quality for mono compared to stereo. The audio subgroup agreed to incorporate the information given in M11037 into the final test report (N6675) under the heading “discussion.”

Spatial Audio Evaluation

This was the most important work for the week, and the task group spent considerable time editing the text so that it expressed a consensus view. The result is in N6691, “Workplan for the Evaluation of Spatial Audio Coding.” Responses

Joint Meetings

With Requirements, Systems and MDS on MAF Tue 1100-1130

Review of AHG reportPart 1 will give an overview of the framework of the MPEG Application Format, while subsequent parts will specify the application formats themselves. It is envisioned that the reference code for this specification will be only the “glue” code that is required to integrate the various parts of the MPEG specifications (and there associated reference software). The file format could be MPEG-4 (*.mp4) or MPEG-21 (*.m21) or one file that is both.

On MAF

10961 Wo Chang, Schuyler Quackenbush

MAF Reference Software Workplan Proposal

10962 Wo Chang MAF File Format Proposal

We expect that there will be two MAF-1 implementations in October. A workplan was presented, and it was noted that either Osmo4 or mplayer player could be used as a playback vehicle.Quackenbush reviewed the anticipated DoC for the MAF Music Player CD text, which is summarized here:

MP4 file containing a song MP21 file containing a song MP21 file that is collection of songs (included as actual MP4 files in mdat area) MP21 DiD that declares a playlist Inclusion of binary metadata

Olivier Alvaro suggested that it might be interesting to include explicit presentation information as part of the document. There was some discussion, but the consensus was that it would be appropriate to keep things simple at this stage.

With Requirements on US NB Comment Tue 1130-1200

Jim Johnston, Microsoft, presented

10906 A. G. Tescher for USNB

USNB Contribution: Proposed CfP for Scalable Audio under MPEG 21

The goal of the proposed work item would be to see what performance could be achieved if there was No requirement for low-latency (i.e. the system would not be used for two-way interactive

communication) No requirement for MPEG-backward-compatability.

126











And to see if, given this scenario, there is a compression scheme that could approach the performance of the best speech coders and the best music coders. Because the MPEG week was very busy, a complete discussion of this task was deferred to an AhG 6668, AHG On Exploration of Scalable Audio and Speech Coding. It is envisioned that the evidence that would motivate a new work item would be:

Use case scenarioso one to many in radio broadcast networks

Compression efficiency required for success in the marketplace Compelling functionalities

o bandwidth shedding in the network via simple frame truncation

Yuriy Resnik, Realnetworks, noted that we must define “scalability,” For example, is it “mid-stream” (i.e. in-network) scalability or is it a scalable representation on “disk” by which a server could stream at various rates. Contact Voiceage/Erikson on whether AMR-WB+ can be made available for MPEG use

With Systems on Audio Codec Behavior, Wed 1600-1700

The group reviewed m11080, “Description of Audio Codec Behavior” and made some corrections to the text, which is available as

N6682, “Timestamps and Audio Codec Behavior.” The document concludes that Systems must adjust time stamps in the case that the audio decoder can operate in a regular (higher delay) or “backward compatible” (lower delay) modes.

With Systems on AU ballot comments on MAF, Thu 1230-1400

The group met over lunch and competed the DoC for the Music Player CD text. The following items will be incorporated in the FCD text:

MP4 file containing a song MP21 file containing a song MP21 file that is collection of songs (included as actual MP4 files in mdat area) MP21 DiD that declares a playlist

With Requirements New Profiles and SMR CfP Thu 1400-1430

Kristofer Kjörling presented the proposed HEAAC V2 profile, which was discussed. It is necessary to register statements of support in order to motivate creation of a new profile. Requirements will sponsor a resolution asking for statements of support as contributions to the next MPEG meeting.The Audio subgroup will document the proposal in a new version of N6384, “MPEG-4 profiles under consideration,” which will be an output of this meeting. The Requirements Chair noted that a request for amendment and associated amendment text must be approved at the Wednesday Plenary of the next MPEG meeting in order to progress as quickly as possible.Paulo Nesi presented CfP on SMR, which was approved by Requirements. However, the Requirements Chair requested that the WG11 IPR policy be explained in a short paragraph in the Call and also as an attachment to the Call.

Task Group discussions

HE-AAC

Kristofer Kjörling, Coding Technologies, presented

10842 ITTF via SC 29 Secretariat

Table of Replies on ISO/IEC 15938-3:2002/FDAM 1 [SC 29 N 6063]



127











The proposed profile was discussed, and the conclusion was to add it to the WG11 document “New Profiles under Consideration.”Andreas Schneider, Coding Technologies, presented


Proposed additions to Sbr conformance test ing

This was discussed. The Audio Chair noted that it is not possible for Conformance to modify a standard, which this seems to be doing. The consensus was that the Reference Code be modified to teach how to realize the filterbank options and that Conformance be modified as proposed to test the various filterbank realization options.

Layer III

Ralph Sperschneider, FhG, presented


10809 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3/FPDAM 3 [SC 29 N 6047]10922 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/FPDAM 2

10788 SC 29 Secretariat Summary of Voting on ISO/IEC TR 13818-5:1997/Amd.1:1999/DCOR 2 [SC 29 N 5998]

The proposed changes, except that the proposed 96 kHz sampling rate, were accepted into the MP3onMP4 FDAM text. This included a mechanism to extend the audioObjectType field.

MPEG-4 Lossless Audio Coding

ALS

The various authors each presented:

11060 Tilman Liebchen

Verification Report on MPEG-4 ALS Core Experiment 5 (Coding of LPC Coefficients)

11112 Yuriy A. Reznik Verification Report on MPEG-4 ALS Core Experiment 4 (Coding of Random Access Frames)



10969Yutaka KamamotoNoboru Harada

Proposal of CE on Multi channel extension for ALS (Audio Lossless Coding)

SLS

The various authors each presented:

11058

Rongshan YuXiao LinSusanto RahardjaHaibin Huang


11061

Tilman LiebchenYuriy A. Reznik


11078 Ralf Geiger Proposed WD4 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable Lossless Coding (SLS)

Oversampled Audio

128





















































At this meeting the Lossless coding of oversampled audio progressed to FPDAM (N6674). Since there were no ballot comments, there was no DoC. Discussion on ALS and SLS

The task group members did a huge amount of work during the MPEG week to gather information on performance and computational complexity. The results are found in N6676, “Status of Performance and Complexity of MPEG Lossless Audio Coding Architectures.”Compression performance of both systems is very similar, so that the data set does not permit us to resolve any differences between the performances of the two systems. Tillman wishes to reference performance of initial submissions. ALS might address very different markets, e.g. the professional digital audio workstation marketplace, in which processors are floating-point CISC, and the embedded processor market, in which processors are 32-bit integer RISC processors. SLS is envisioned to address the embedded market. It was agreed that the Performance Report will not sum the multiplies and additions into a “Total” column, since some platforms (e.g. RISC) may realize these as separate instructions, while other platforms (e.g. DSP chips) may realize these as a single instruction. In general, the document will refrain from drawing conclusions, but rather just present complexity numbers for various architecture and operating point configurations.Jim Johnston, Microsoft, presented a list of CDs that he felt would be appropriate for expanding the lossless coding data set. His proposal was that:

Everyone purchase CDs and rip them using “eac” (exact audio copy – freeware) and document rip using cksum.

Process using ALS and SLS technology using various parameter settings.

MPEG-7 Audio

Matthias Gruhne, FhG, presented

10806 SC 29 Secretariat

Summary of Voting on ISO/IEC 15938-7/FPDAM 1 [SC 29 N 6046]


11033 Matthias GruhneJan Rohden Proposed Core Experiment on Audio Rhythm Pattern s

The Audio subgroup agreed to accept the proposed core experiment.

MPEG-A

Schuyler Quackenbush, Audio Research Labs, presented


Summary of Voting on NP MPEG-A [SC 29 N 6099]


Summary of Voting on CD MPEG-A [SC 29 N 6101]

11006 Adam Lindsay ID3v2 Tags in M PEG-A Most of the discussion of this topic occurred in the joint meeting with Systems (see Section ).

MPEG-4 Audio

The various authors of each contribution presented:


11018 Eunmi OhMiyoung Kim Proposed changes in MPEG-4 BSAC multi-channel audio coding

129


































11029Juergen SchmidtKlaus Eilts-Grimm

Simple Integration Reference Software for MPEG-4 AudioBIFS, version 3

11035 Werner OomenHeiko Purnhagen Proposed corrigenda to AMD2, (parametric)

11071 Ralph Sperschneider

Problem with buffer fullness derivation in the case of number_of_raw_data_blocks_in_frame>0 and protection_absent=0



Due to the very full Audio schedule, there was not sufficient time to discuss and decide on the proposals made in m11018 or m11029.

Spatial Audio Coding

On Tuesday afternoon the task group listened to proponent submissions in the Microsoft 5.1 channel listening room.On Wednesday afternoon the task group selected test material for use in evaluating the Spatial Audio Coding Call for Proposals. The test items will be:Number

Name Category Remarks

1 pops music (back: direct)2 chostakovitch music (back: direct)3 poulenc music (back: direct)4 jackson1 music (back: ambience)5 rock concert music (back: ambience)6 indie2 movie sound7 Stomp movie sound LFE

available8 ARL applause pathological & ambience9 BBC applause pathological & ambience10 glock pathological & ambience11 fountain music pathological & ambience

Symbolic Music Representation

The SMR Call for Proposals document and the Draft Evaluation document both had extensive editing by the task group Tuesday and Wednesday in the MPEG week. This resulted in significantly better text in the CfP and a much clearer articulation of the evaluation process. The Draft Evaluation document will be included in the CfP public package.

Meeting deliverables

Press statementThe Audio part of the press statement was prepared, but there was not sufficient time for it to be reviewed.

Dispositions of CommentsAll DoC were prepared and reviewed.

130


























Responses to Liaison and NB commentsThere were no liaison responses. The response to the NB were prepared and approved.

Recommendations for final plenaryThe Audio recommendations were presented and approved.

Establishment of Ad-hoc GroupsThe following ad-hoc groups were established by the Audio subgroup:

No. Title Mtg6664 AHG on Audio Standards Maintenance No6696 AHG on MPEG-7 Audio No6665 AHG on Spatial Audio Coding Yes6666 AHG on MPEG-4 Lossless Audio Coding Yes6667 AHG on Symbolic Music Representation Yes6668 AHG On Exploration of Scalable Audio and Speech Coding Yes

Approval of output documentsAll output documents, shown in Annex D, were presented in Audio plenary and were approved.

Future activities

Schedule of future meetingsAd Hoc group meetings are indicated in Section . Unless otherwise indicated, Ad Hoc group meetings will be held at the location of the next MPEG meeting on the weekend preceding that meeting.

Agenda for next meetingThe agenda for the next MPEG meeting is shown in Annex E

All other businessThere was none.

Closing of the meeting The 69th Audio Subgroup meeting was adjourned Friday at 14:00.

131

Annex A ParticipantsFirst Name Last Name Country AffiliationSchuyler Quackenbush USA ARLKristofer Kjörling S Coding TechnologiesHeiko Purnhagen S Coding TechnologiesBernhard Feiten DE Deutsche TelekomIngo Wolf DE Deutsche TelekomKhosrow Lashkari USA DoCoMo USA Labs Matt Fellers USA DolbyMark Vinton USA DolbyGiorgio Zoia CH EPFLJeongil Seo KR ETRIBernhard Grill DE FhG IISJürgen Herre DE FhG IISRalph Sperschneider DE FhG IISRalf Geiger DE FhG IIS AEMTMatthias Gruhne DE FhG IIS AEMTCotarmanac’h Alexandre FR France Telecom R&DSusanto Rahardja SG I2RLin Xiao SG I2RRongshan Yu SG I2RJames Johnston USA MicrosoftMauri Väänänen FIN Nokia Res. CenterToshiyuki Nomura JP NECTakehiro Moriya JP NTTYutaka Kamamoto JP NTT/The Univ. of TokyoSua Hong Neo SG PanasonicWerner Oomen NL PhilipsYuriy Reznik USA RealNetworksSang-Wook Kim KR SamsungEunmi Oh KR SamsungBoehm Johannes CE ThomsonTilman Liebchen DE TU BerlinDai Yang USA Vidiator　TechnologyDai YANG USA Vidiator Technology

(US) Inc

Annex B Audio Contributions and Schedule

Time Agenda Item MPEG-2/4/7

SMR

Number Title Source

Sunday0900-1800 AHG on Symbolic Music

Representation

11083 Michael Good Response to Draft Call for Proposals N6457 X

11002 James Ingram Comments on Symbolic Music Representation requirements

X

11021



X

11019



X

11025



X

1000-1200 AHG on Lossless Coding

11079 Ralf GeigerJuergen Herre

On the Performance of MPEG-4 SLS RM4

X

11059 Rongshan YuCrosscheck on FhG’s Proposed Core Experiment for MPEG-4 Audio Scalable to Lossless (SLS) Coding

X

11062Rongshan YuSusanto RahardjaXiao LinHaibin Huang


X


X

11114 Yuriy A. Reznik Proposed CE on Additional Enhancements for Lo ssless Audio Coding

X

1300-1700 AHG on Spatial Audio Coding

11001 Heiko PurnhagenWerner Oomen

CT/Philips contribution to CfP on spatial audio coding

X



X

11075Juergen HerreChristof FallerC. SpengerJ. HilpertK. Linzmeier


X

133




































































SMR

Number Title Source

11090Matt FellersMark VintonMark DavisGrant Davidson


X

11076 Juergen Herre Evaluation of Spatial Audio Coding Schemes

X

11065 Schuyler Quackenbush

DRAFT Procedures for the Evaluation of Spatial Audio Coding Systems

X

Monday0900-1330 MPEG Plenary1330-1430 Lunch1430-1800 Audio Plenary

Opening of the meetingAudio Chair

Administrative mattersApproval of agenda XApproval of 68th MPEG meeting report

X

Communications from the Chair- Review of Sun Chairs meeting

X

Allocation of contributions to agenda and schedule

X

Joint meetings XReview of AhG reports

X

10767 S. Quackenbush AHG on Spatial Audio Coding X

10768 Tilman Liebchen AHG on MPEG-4 Lossless Audio Coding

X

10769 Paolo NesiGiorgio Zoia

AHG on Symbolic Music Representatio n X

Task groups and mandatesNational body comments X



X

10991 LEE SgNB Comment on the Lossless Audio Coding Work

X

11102 FNB FNB Position Paper on MPEG applications, context and objective s

X

1400-1600Plenary discussionsSGNB comment XFNB comment XUSNB comment X

1600-1630 MPEG-4 Issues

11005 Martin Link Subjective results formal verification test MPEG4-Ext2. (Parametric)

X

11037 Werner Oomen Complementary information to Formal verification test parametric

X

1700-1800 Spatial CfP Evaluation

1800- HOD Meeting

Tuesday0900 Audio Plenary Audio Chair

134















mailto:CJ








mailto:??





mailto:??


















SMR

Number Title SourceOutline plan for the day

0800-1230 Symbolic Music Representation

0900-1130 MPEG-4



X

11018 Eunmi OhMiyoung Kim

Proposed changes in MPEG-4 BSAC multi-channel audio coding

X



X

11029 Juergen SchmidtKlaus Eilts-Grimm


11035 Werner OomenHeiko Purnhagen

Proposed corrigenda to AMD2, (parametric)

X

11071 Ralph Sperschneider

Problem with buffer fullness derivation in the case of number_of_raw_data_blocks_in_frame>0 and protection_absent=0

X

11072 Ralph Sperschneider Status on MPEG-4 Audio Conformance X


X

1100-1130 Joint with Sys, MDS, Req Multimedia Application Format Req

10961 Wo Chang, Schuyler Quackenbush MAF Reference Software Workplan Proposal X

10962 Wo Chang MAF File Format Proposal X

1130-1200 Joint with Req US NB Comment Audio



X

1300-1700 Spatial Coding listening session Microsoft listening room

1200-1300 Lunch

1300-1500 Lossless Coding

11060 Tilman LiebchenVerification Report on MPEG-4 ALS Core Experiment 5 (Coding of LPC Coefficients)

X

11112 Yuriy A. ReznikVerification Report on MPEG-4 ALS Core Experiment 4 (Coding of Random Access Frames)

X



X

10969 Yutaka KamamotoNoboru Harada

Proposal of CE on Multi channel extension for ALS (Audio Lossless Coding)

X

11058Rongshan YuXiao LinSusanto RahardjaHaibin Huang


X

135




































































SMR

Number Title Source

11061 Tilman LiebchenYuriy A. Reznik


X

11078 Ralf GeigerProposed WD4 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable Lossless Coding (SLS)

X

1830-1900 Audio PlenaryStatus for Chairs Meeting

1800-1900 Liaison Meeting1900- Chairs Meeting

Wednesday0900-1100 MPEG Plenary1100-1130 Audio Plenary Audio Chair

Report on Chairs meeting and outline of plan for the day

1130-1300 Layer III


X


X


X

MPEG-2 AAC

10788 SC 29 SecretariatSummary of Voting on ISO/IEC TR 13818-5:1997/Amd.1:1999/DCOR 2 [SC 29 N 5998]

X

1300-1700 Spatial Coding listening session Microsoft listening room

1300-1400 Lunch

1400-1500 HE-AAC



X


X


X


Proposed additions to Sbr conformance test ing

X

1500-1600 MPEG-7


X


X

11033 Matthias GruhneJan Rohden

Proposed Core Experiment on Audio Rhythm Pattern s

X

1600-1700 MPEG-A

136

























































SMR

Number Title Source

10878 SC 29 Secretariat Summary of Voting on NP MPEG-A [SC 29 N 6099]

X

10879 SC 29 Secretariat Summary of Voting on CD MPEG-A [SC 29 N 6101]

X

11006 Adam Lindsay ID3v2 Tags in M PEG-A X

1600-1700 Joint with Systems Audio

11080 S. QuackenbushH. Purnhagen Description of Aud io Codec Behavior

X

1800-2200 Social

Thursday

1230-1400 Joint with Systems

10944 AUNB AUNB Comments on MPEG-A CD

1300-1400 Lunch

1400-1430 Joint with Req At Requirements (Lassen)Proposed new profilesSMR

1830-1900 Audio Plenary Audio ChairReview list of deliverablesReview list of AHGsStatus for Chairs Meeting

1900- Chairs Meeting 0938

Friday

0900-1300 Audio PlenaryReport on Chairs meeting and outline of plan for the day Audio Chair

Discussion of unallocated contributionsMeeting deliverables

Press statementDispositions of commentsResponses to NB commentsLiaison statementsRecommendations for final plenaryEstablishment of new Ad-hoc groupsApproval of output documents

Future activitiesAgenda for next meeting

A.O.B.Closing of the Audio meeting

1300-1400 Lunch

1400- MPEG Plenary

137



















Annex C Task Groups1. HE-AAC

Chair: Heiko Purnhagen13818-1:2000/AMD 5:200x FDAM14496-5:XXX/AMD 6 FDAMMandates:1.1. Review contributions1.2. Produce final text of 13818-1:2000/FDAM 5:2004 “New audio profile and level

signaling”1.3. Insure that HE-AAC code is available as part of 14496-5:XXX/AMD 6 “Advanced Video

Coding and HE-AAC Audio reference software”

2. Layer IIIChair: R. Sperschneider13818-4:200X/AMD 2:2000x FDAM14496-3:2001/AMD 3 FDAMMandates:2.1. Produce DoC on 13818-4:200X/ FPDAM 2:200x “Audio Conformance Extensions”2.2. Produce text of 13818-4:200X/ FDAM 2:200x “Audio Conformance Extensions”2.3. Produce final text of Draft 11172-3:xxxx/ FDAM 3 “MPEG-1 Access Units”2.4. Produce “Study on MPEG-1 LIII new sampling rates”

3. Lossless CodingChair: S. Quackenbush14496-3:2001/AMD 4 TBD14496-3:2001/AMD 5 TBDMandates:3.1. Review contributions3.2. Compile latest performance results3.3. Discuss next steps for work

4. MPEG-7Chair: Matthias Gruhne15938-6:200X/AMD 1 FDAM15938-7:200X/AMD 1 FDAMMandates:4.1. Review contributions4.2. Insure that reference software and conformance descriptions are available4.3. Produce final text of 15938-7:200X/ FDAM 1 “Audio conformance extensions”

5. MPEG-AChair: S. Quackenbush24736 FCDMandates:5.1. Review contributions5.2. Move to part 2 (part 1 is “Introduction”)5.3. Prepare DoC on 24736:200X CD, “Player Application Format”5.4. Prepare text of 24736:200X FCD, “Player Application Format”

6. MPEG-4 Audio Issues

139

Chair: S. QuackenbushMandates:6.1. Review contributions6.2. Produce “Formal Verification Report on MPEG-4 Parametric Audio Coding”6.3. Discuss MPEG-4 Audio conformance issues and revise status as necessary6.4. Discuss and possibly revise “Timestamps and Audio Codec Behavior”6.5. Discuss Proposed ISO/IEC 14496-3:2004 (Audio 3rd Edition)6.6. Discuss FNB comment on Audio overview

7. Spatial Audio CodingChair: S. QuackenbushMandates:7.1. Review submissions to the CfP7.2. Select Evaluation Test Material7.3. Produce “Workplan for the Evaluation of Spatial Audio Coding Systems”

8. Symbolic Music RepresentationChair: P. NesiMandates:8.1. Review contributions8.2. Produce “DRAFT Procedures for the Evaluation of Symbolic Music Representation”8.3. Produce “Call for Proposals for Symbolic Music Representation”

9. Scalable Audio CodingChair: J. JohnstonMandates:9.1. Review and respond to USNB comment9.2. Draft workplan for exploration

Standards under Development:Name Description Progress to13818-1:2000/AMD 5:200x New audio profile and level signaling and changes to audio type FDAM13818-4:200X/AMD 2:2000x Audio Conformance Extensions (new bitstreams for Audio LIII) FDAM14496-3:2001/AMD 3 MPEG-1 Access Units and New sampling rates FDAM14496-3:2001/AMD 4 ASL CD14496-3:2001/AMD 5 SLS CD14496-5:XXX/AMD 6 Advanced Video Coding and HE-AAC Audio reference software FDAM15938-6:200X/AMD 1 Audio software extensions FDAM15938-7:200X/AMD 1 Audio conformance extensions FDAM24736-1:200X MPEG-A: Music Player Application Format CD

Note: FDAM is final document (no more comments!)

140

Annex D Output DocumentsMPEG-2


13818-7 MPEG-2 AAC

6669 Text of 13818-7:2004/DCOR 1 “AAC ADTS buffer fullness correction”

23/7/04

MPEG-4


14496-3 MPEG-4 Audio6670 DoC on 14496-3:2001/FPDAM 3, MPEG-1/2 Audio in MPEG-4 23/7/046671 Text of 14496-3:2001/FDAM 3, MPEG-1/2 Audio in MPEG-4 23/9/046672 Text of 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS) 30/8/046673 Text of 14496-3:2001/PDAM 5, Scalable Lossless Coding (SLS) 30/8/04

6674 Text of 14496-3:2001/FPDAM 6, Lossless coding of 1-bit oversampled signals

6/8/04

6675 Formal Verification Report on MPEG-4 Parametric Audio Coding 23/7/04

6676 Status of Performance and Complexity of MPEG Lossless Audio Coding Architectures

23/7/04

6677 Proposed 3rd Edition of 14496-3 23/9/046678 Study on High-Sampling Rate for MPEG-1/2 Layer III 23/9/046679 Proposed Enhancements to MPEG-4 BSAC multi-channel 23/7/04 6680 Workplan for Audio Lossless Coding (ALS) 23/7/04 6681 Workplan for Scalable Lossless Coding (SLS) 23/7/04 6682 Timestamps and Audio Codec Behavior 23/9/04


14496-4 MPEG-4 Conformance6683 Status of MPEG-4 Audio Conformance 23/7/046684 Proposed New Audio Conformance Bitstreams for BSAC 23/7/04

MPEG-7


15938-4 MPEG-7 Audio6685 Workplan for Audio Rhythmic Pattern 23/7/04

MPEG Application Formats


23001-1 Application Formats: Introduction

141

6686 Introduction to MPEG Application Formats 23/7/04


23001-2 Application Formats: Music Player6687 DoC on 23001-1:200X CD, “Player Application Format” 23/7/046688 Text of 23001-1:200X FCD, “Player Application Format” Yes 23/9/04xxxx Request for Subdivision of ISO/IEC 23000-1 23/7/04

Explorations and support


Music notation6689 Call for Proposals for Symbolic Music Representation Yes 23/7/046690 DRAFT SMR Evaluation Procedure Yes 23/7/04


Spatial audio coding6691 Workplan for the Evaluation of Spatial Audio Coding Responses 6/8/04

142

Annex E Agenda for the 70th MPEG Audio MeetingAgenda Item1. Opening of the meeting2. Administrative matters

2.1. Approval of agenda2.2. Approval of 69th meeting report2.3. Communications from the Chair2.4. Allocation of contributions2.5. Joint meetings2.6. Review of AhG reports2.7. Review of task groups and mandates2.8. Received national body comments and liaison matters2.9. Plenary issues

3. Task group activities3.1. MPEG Maintenance3.2. MPEG-4 Lossless Coding3.3. MPEG-7 Audio3.4. MPEG-Music Player Application Format3.5. Spatial Audio Coding3.6. Music Notation

4. Discussion of unallocated contributions5. Meeting deliverables

5.1. Press statement5.2. Dispositions of comments5.3. Responses to NB comments5.4. Responses to Liaison statements5.5. Recommendations for final plenary5.6. Establishment of new Ad-hoc groups5.7. Approval of output documents

6. Future activities6.1. Agenda for next meeting

7. A.O.B.8. Closing of the meeting

143

Annex 10Report of SNHC meeting

Source: Mikaël Bourges-Sévenier (Mindego Inc.)

Opening of the Meeting

Approval of the agenda

Goals for the weekThe goals of this week are:

Finalize ISO/IEC 14496-5/FDAM7 AFX reference software Issue ISO/IEC 14496-16/PDAM1 with new tools available in reference software Start ISO/IEC 14496-21 WD 1.0 Update ISO/IEC 14496-11/FPDAM4 with XMT-A reorganized and augmented with all

AFX encoding tools represented in XML.

144

ScheduleMonday Tuesday Wednesday Thursday Friday

:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30

14

15

08

09

10

11

20

21

22

Time

16

17

18

19

12

13

Lunch break

MPEG Plenary

Lunch break Lunch break Lunch break Lunch break

MPEG Plenary

MPEG Plenary

Roll call, agendaFAQ, web site, ref sw, conf.

Graphics Arch.3DAV

10965 - 3DMC

10937 - urban rep

10994 - CE shadow11031 - CE multitex11038 - point

11066 - morphing appearances

Review of XMTReview of WDReview PDAM: ref. soft., AMD1

Document reviewPresentation reviewDocument number attribution… last items...

Social event

Liaison

Chairs Chairs

Liaison

Solids (2 contribs)XMT (6 contribs)

11109 + 10881

10898 - PointTexture

AFX document updatesGraphics APIArchitecture

Graphics APIArchitecture11022 - SMR

LaSeR overview(in SNHC)

Graphics APIMPEG-J extensions

XMT for AFXMPEG-J extensions

Graphics API

145

Allocation of joint meetingsSub-Groups Monday Tuesday Wednesday Thursday Friday

Systems 17:00-18:00XMT, MPEG-J

16:00-17:00LaSeR

RequirementsMPEG-7

VideoVideo/3DAV

MDS

Rooms allocationSNHC Rainier 1, Break-out (Graphics): Rainier 2Systems Hood 1Requirements LassenChairs/HoD/LiaisonsLassen

Allocation of contributions

N° Title Schedule ActivityD1 Monday D1

MPEG Plenary D1 09h00-14h00 MPEG Gen.

Report of AhG on MPEG-J extensions Mikaël Bourges-Sévenier

SNHC D1 15h00-16h00 SNHC Gen.

Agenda, FAQ, Web site Mikaël 15:00AFX Reference software, integration issues Patrick 15:30SNHC D1 16h00-19h00 AFX

10936 Simplification of AFX/SolidRep node Alain MignotPierre Garneau

16:00

11134 Solid implementation into IM1 Jeremie FarretOlivier Bellis

146

N° Title Schedule Activity10880 Update of XMT-A for AFX Gyeong Ja Jang

James D. K. Kim17:00

10882 Updates on the reference software of AFX Encoder

Gyeong Ja JangJames D. K. Kim

10899 Update on XMT-A specification for encoding parameter of PointTexture Compression

Gyeong Ja JangShinjun LeeJames D.K. KimMahnjin Han

11046 Proposal for the XMT-A specifications for MeshGrid

Alexandru SalomieAdrian MunteanuRudi DeklerckPeter Schelkens

11068 Textual BBA Marius PredaFrancoise Preteux

SNHC D1 16h00-19h00 Graphics

11003 Comments on MPEG-4 part 21 MPEG-J extension for rendering

Itaru KanekoMark Callow

16:00

11111 Considerations for MPEG-J extensions for rendering

Mikael Bourges-SevenierVishy Swaminathan

D2 Tuesday D2SNHC D2 9:00 – 13:00 AFX

10965 On the status of 3D Mesh Compression in MPEG-4 Euee S. Jang, Ja Kim 9:00

10937 Proposal for multi-resolution urban representation

Patrick GioiaJérôme Royan

10:00

10994 CE - Shadow: Preliminary Results on Reference Software Implementation Helge Drumm 11:00

11031View-Dependent Multi-Texturing for MPEG-4 AFX, Syntax and semantics specification update

Karsten MüllerAljoscha Smolic

12:00

147








N° Title Schedule Activity

11038Results on Reference Software Implementation on Point based Rendering for MPEG-4 AFX

Stephan WürmlinChristopher LeeMatthias ZwickerMichael WaschbüschMarkus GrossHanspeter Pfister

12:30

SNHC D2 14:00 – 17:00 AFX

11066 Morphing AppearancesMarius PredaFrançoise PreteuxOlivier Marre

14:00

11022 Graphic functionality in MPEG-4 and Symbolic Music Representation

Giorgio ZoiaPierfrancesco BelliniJerome BarthelemyPaolo Nesi

15:00

10898 Addition to PointTexture Compression for future extensions Mahnjin Han 16:00

Systems D2 17:00 – 18:00 Graphics

11109 XMT and MPEG-J updates Mikaël Bourges-Sévenier

10881 KNB on XMT and MPEG-J updates Mahnjin Han

D3 Wednesday D3MPEG Plenary D3 09h00-11h00 MPEG Gen.SNHC D3 11h00-16h00 GraphicsPart 21 architecture discussionsSNHC D3 16h00-17h00 General

LaSeR overview Olivier AvaroJean-Claude Dufourd

16:00

D4 Thursday D4SNHC D4 9h00-13h00 AFX

148


















N° Title Schedule ActivityPart 21 architecture discussionsSNHC D4 14h00-18h00 AFXAFX document review 14:00Part 21 architecture 15:00

D5 Friday D5SNHC D5 9h00-11h00 SNHC Gen.

Document number attribution 9:00

MPEG Plenary D5 14h00-22h00 MPEG Gen.

149

General issues

Web siteThe SNHC Web site is http://www.sait.samsung.co.kr/snhc/

AFX Reference softwareThe AFX Reference Software has been transferred to NIST and is available via CVS at

1. Register your login/password at http://mpeg.nist.gov/reg/login_new.php2. :pserver:<your login>@mpeg.nist.gov:/big/mpegcvs3. <your password>4. Checkout "MPEG-4/Systems2/IM1" module (case sensitive).

The AFX-related code is in OpenGL/AFX and conformance samples are in Tests/AFX.

AFX encoder and other toolsWe create MPEG-4/SNHC/AFX_Encoders repository in CVS server.Add an informative note in AFX/AMD1 Reference software document about this tool.

New tools added since March:DIBR v2 (splats), morphing, point-texture compression, multitexturing, Solids

Miscellaneous The MPEG node templates used to be maintained by MPEG-4 Systems editors. It has been

decided to upload them into CVS repository. Mikaël Bourges-Sévenier will upload into CVS the executables of his programs to generate

node coding tables and XMT-A Schema (BIFS part). XMT-A Schema organized in 4 parts will be uploaded into CVS.

Standards from SNHCIn red, status reached at this meeting. In yellow, status reached at next meeting. Projects that reached International Standard status have been removed.

Std

Pt Edit.

Project

Description CfP WD CDPDAMDCOR

FCDFPDA

M

FDISFDAMCOR

4 5 2003 Amd.7 AFX Reference SW 02/10

02/12 03/12 04/07

4 11 2003 Amd.4 XMT and MPEG-J extensions

03/12 04/07 05/01

4 16 2004 Cor.1 AFX Corrigendum 04/03

04/07 05/01

4 16 2004 Amd.1 AFX extension 03/07

04/07 05/01 05/07

4 21 2005 MPEG-J extensions for rendering

03/12

04/07

04/10 05/01 05/07

150

http://www.sait.samsung.co.kr/snhc/src/index.html

AFX activities

Specifications updatesThe list of modifications for existing specifications handled by SNHC is as follows.

Part 5/AMD7Solid Modeling framework has been added.

Part 11/AMD4Monolithic XMT-A schema reorganized in a modular manner.All nodes from MPEG-4 Part 11 and Part 16 have been added, up to Part 11 AMD6 and Part 16/AMD1.AFX node specific encoding hints and parameters added.

Part 16/COR1Light-field mapping and Particle systems have been removed.

Part 16/AMD1Finalized: Multitexturing framework, Point-based representation, Morphing

Part 21/WD 1.0Just started: uses JSR-184 and JSR-239. MPEG-J is augmented to support these APIs and interface with MPEG-4 Systems terminal.

Conformance and reference software

M: 10936 Simplification of AFX/SolidRep node Alain Mignot, Pierre GarneauProposal: - Reduce the complexity of using the SolidRep by adding support of solid operations directly at the scene graph node level; thus no need of using the script node.- keep only the logic operators (3) from the 45 operators currently standardized.- a new node proposed: SolidRepV2 which contains the solidOp field indicating the operation attached to the node.

Resolution: Create a CE on differences between script with SolidRepV1 and SolidRepV2 with the following goals: - What is the extra cost for using script node for solid?- What are the limitations when not using the script but having the SolidRepV2?

Jeremie (SGDL) and Alain (SolidSpace) participate to the CE and edit the CE description.

M11134: Solid implementation into IM1, Jeremie Farret, Olivier Bellis- renew involvement of SGDL in MPEG-4 normalization- implementation of Solid representation in AFX reference software- full support for script node (new java script library is available)

Resolution: validate the implementation and check that all the conformance bitstreams for all the AFX tools are working (action done on Thursday morning in the SNHC plenary)

Naming problem: change symbols for operators in strings; advantages: light update of the java script parser, solve ambiguities methods.

151

Resolution: update the DCOR with the operators names for the sake of the non-ambiguities.

M10880: Update of XMT-A for AFX, Gyeong Ja Jang, James KimProposal:

- add DIBR encoding hints in bitwrapper;- add DIBRDecoderInfo in AFXConfigType- change the place of the AFXConfigType; put it in the object descriptor part

Resolution:All the proposed modifications are accepted.

M10882: Updates on the reference software of AFX Encoder, Gyeong Ja Jang, James KimProposal:- add support for multiple BitWrapper parser- add support for octreeImage encoding

Resolution:Upload the software in the CVS as part of MPEG-4 reference software. Add the description of the tool and hints to be used and updated.

M10899: Updates on XMT-A specification for encoding parameter of PointTexture Compression, Gyeong Ja Jang, Shinjun Lee, James Kim, Mahnjin HanProposal:Add the element PointTextureEncodingParameter and the associated attribute in the BitWrapper encoding parameters section.

Resolution:Accepted

M10899: Proposal for the XMT-A specifications for MeshGrid, Alexandru Salomie, Adrian Munteanu, Rudi Deklerck, Peter SchelkensProposal:- Add the MeshGridEncodingParameters element in the BitWrapper encoding parameters section.- Add the MeshGridDecodingSpecificIndo element in the AFX decoder specific section.

Resolution:Accepted

M10899: Textual BBA, Marius Preda, Francoise PreteuxProposal:- Add the description of the BBA related elements in the XMT-A, including textual animation parameters and encoding parameters

Resolution:- Accepted

- Check the schema with Intellij

152

M10965 – On the status of 3DMC in MPEG-43DMC provides 30-40 times compression of IndexedFaceSet node. The major supporters were IBM and Samsung. 3DMC reached IS status since 2001 but no commercial application exists so far. IBM and Samsung said informally that they have no immediate plan to deploy this technology.

Technical issuesCoverage of 3D models3DMC cannot support non-manifolds or non-orientable meshes without breaking the model into multiple components.

Lossless/near lossless compressionHigh quality compression of 3D models for archiving and distribution is in high demands but this may not have been well understood in the original design of 3DMC.

Lossless feature is available in AFX VM but promotion unclear.

Vertex order changeFor non-rigid deformations of models, vertex order must be preserved. 3DMC does change vertex order.

Possible solutions1. 3DMC encoder could output the changed vertex order information so the compression of

interpolator etc. so 3DMC encoder would drive the encoding of the entire scene (BIFS, Scripts, MPEG-J)

2. Transmit the changed order of vertex. This is n log n information, so an overhead increase3. Use 3DMC only for rigid-body animation. Then vertex order doesn’t matter4. Redesign 3DMC

ResolutionGather industry interest before starting a new 3DMC. Contributions would be expected in further meetings.

M10937 – Proposal for multi-resolution urban representationWe need progressive transmission and adaptive rendering during navigation.

For such adaptation, the scene is really a polygon soup of building blocks that are refined at interactive frame rate.

With such contents, it is easy to navigate inside a city but much harder to have fly over views because in a city many occlusions enables less polygons to be sent to the card while on fly over, there are no such occlusions.

The scene is represented as a hierarchical representation of building blocks (i.e. real buildings). The leaves (buildings) are rendered. The refinement applies at the footprint of the buildings, which are contours represented as line segments (hence only position is needed). Messages are sent to the server to refine these contours during navigation. To represent the building, extra information such as height, textures are sent. As navigation progresses the root contours are split into multiple contours.

153

The proposal doesn’t expose geometry information that could be helpful to combine with other 3D models.

ResolutionStart a CE on this representation to understand how such contours could be used in a BIFS scene

M10994 – CE - Shadow: Preliminary Results on Reference Software Implementation, Helge DrummReport: - The work on implementation in the AFX reference software is not completed;- Implementation in Iavas MPEG-4 player (in Java)- Add in the AFX reference software some light related issues which were missing in the implementation;Proposal: Simplify the node interface in order to simplify the implementation.

Resolution:Keep the CE open with the following goal:- indicate which functionalities are not supported anymore by the simplified node;- what is the cost of keeping the initial node? Only an implementation issue or some theoretical aspects are also involved.

M11031 – View-Dependent Multi-Texturing for MPEG-4 AFX, Syntax and semantics specification update, Karsten Müller, Aljoscha SmolicProposal:

Update the Multitexturing node: Change the “weight” field with the “cameraVector”. Advantages: not need of using the script node but multitexturing directly implemented by the player.

Resolution: Adopt the new node as part of the CD of AFX Amd1.

M11038 – Results on Reference Software Implementation on Point based Rendering for MPEG-4 AFX, Stephan Würmlin, Christopher Lee, Matthias Zwicker, Michael Waschbüsch, Markus Gross, Hanspeter PfisterProposal:Implementation of the DIBRV2 nodes in the reference software

Resolution:Validate the implementation, DIBRv2 nodes go in CD of AFX Amd1

M11038 – Addition to PointTexture Compression for future extensions, Mahnjin HanProposal: add a flag isExtension in order to support future compression scheme.

Resolution:Accepted

M11066 – Morphing Appearances, Marius Preda, Françoise Preteux, Olivier MarreProposal:- Update the MorphShape node for supporting morphing for the appearance field by changing the type of the targetShapes from the MFGeometryNode into MFShapeNode

154




- Implemntation of the new node in the reference software

Resolution:- validate the implementation, MorphShape node go in the CD of AFX Amd1.

MPEG-4 Part 21

M11003 – Comments on MPEG-4 Part 21HI Corp. strongly supports standardization of MPEG-4 Part 21 or Graphics API.M3G has been found as the best starting point for Graphics API during 68 th meeting and the AhG meeting in Tokyo in May.MPEG-4 Part 21 should not be too attached to one specification. HI has about 30M devices and their experience is that each operator has strong control of the specification and they often prefer the latest version of the API. So every year a new version provides new features. Therefore, locking into one API is not a good idea.

HI Corp. proposed a simpler version of APIs that is not M3G but already publicly royalty-free available.

Conformance and reference softwareHI can provide a binary version of their optimized renderer.

Non-synthetic 3D renderingIn 3DAV, capture of 3D information from images is being worked on. In many apps, mixing synthetic and non-synthetic objects is useful and therefore the APIs should be unified.Fog and depth effects are needed, environment mapping

ProposalHI suggests looking at old version of the API, which still has many apps being developed. The new version of the API is M3G.Mobile manufacturers have embraced M3G, which is now available on phones shipping this summer. DiscussionM3G is the right starting point for this activity but M3G being controlled by its own standard body is an issue. MPEG/SNHC should establish liaison with M3G. However, M3G (JSR-184) is finished and hence the group is closed, so no liaison or working relationship is possible.

Many participants expressed concerned about M3G future because of Nokia’s licensing. Likewise, it is unclear if M3G will be updated in a near future even with basic features present in OpenGL ES but apparently forgotten in M3G. Informal conversion with JSR-184 Chairman seems to indicate extensions will happen but probably not this year.

In conclusion of this proposal, an M3G like graphics API is needed but not necessarily M3G itself alone. Commonality of various APIs in the market must be studied.

M11111 – Considerations for MPEG-4 Part 21This contribution details missing features in M3G and possible solutions. It also raises some issues related to the integration of MPEG-4 systems with M3G.

155

The proposal simply intends to start the discussion on these issues.

3DAV needsVideoTiming + synchronizationMulti-texturingPoint rendering

M11022 – Symbolic Music Representation (SMR)Needs to represent music notation:

Lines, path, curves Color support Text support Selection of notes or groups of notes according to rules of symbolic music. Synchronization of audio-visual elements: playback + animation sync’d etc…

ConclusionUsing Part 21, SMR can be easily rendered. This path seems easier to use than describing the complete framework in BIFS.

MPEG-4 Part 21 architecture

Supporting JSR-184 and JSR-239During 68th meeting, we selected JSR-184 as the starting point of MPEG-4 Part 21. During the AhG meeting in May, we found it was, technically-speaking a good choice even though some technologies were missing and the licensing model didn't seem to please many participants.

In the last 10-15 years, many high-level APIs (e.g. with a scene graph) have been proposed but almost none has survived more than 2 years in the market; developers and especially game developers seem to agree only at low-level. In other words, developers like to design their own scene graph, scene management and so on for their applications. JSR-184 (M3G) is one example of a high-level API and, if history repeats, may not survive long.

On the other hand, OpenGL ES is finalized and is becoming available in software and in hardware (chips) today. In the long run, OpenGL ES has better chance to survive as the long history of OpenGL suggests (almost 20 years!).

Therefore, it is important to support both M3G and Java bindings to OpenGL ES. Such bindings are not finalized yet but will be by the end of the year as part of JSR-239. Some participants believe that M3G will be used for simple applications but complex games will use JSR-239. It is also worth to mention that on desktops, a thin layer for OpenGL ES on top of OpenGL is already freely available, making applications using OpenGL ES working from embedded devices to desktops.

Finally, almost all implementations of JSR-184 are implemented on top of OpenGL ES. For devices with no OpenGL ES support (as there are already millions in Japanese market) JSR-184 can be implemented on top of a proprietary rasterizer.

In conclusion, JSR-184 must be supported for applications using its high-level API. For general applications, JSR-239 must be supported. The choice of using one or the other will be the responsibility of the application developer. We will establish a liaison to JSR-239 so to access its

156

specification and provide them feedback on the interfacing requirements we need, if any. Figure 1 summarizes this discussion.

Application (MPEGlet)

Other SG(incl. BIFS) JSR-184

Proprietaryrasterizer

JSR-239

OpenGL ES

MPEG-J(ISO/IEC 14496-11)

MPEG terminal(Systems / Decoders)

Java (in terminal)

Native (in terminal)

Java (sent to terminal)

Figure 1 – Block diagram of MPEG terminal with graphics enabled MPEGlets.

What remains to be done is the interfacing with an MPEG-4 terminal i.e. the so-called MPEG-J extensions. But first, we describe the architecture that enables all applications.

ArchitectureAfter many discussions, Figure 2 summarizes the MPEG terminal architecture using MPEGlets. Compare to MPEG-4 Systems (ISO/IEC 14496-1) architecture, Compositor and Renderer are arranged in a different manner albeit their definitions are the same:

A renderer is used to draw synthetic operations (2D/3D graphics) into an image (or pixels buffer),

A compositor is used to mix (or to compose) zero or more pixel buffers to create a final image.

As specified in ISO/IEC 14496-11, an MPEGlet is received from an MPEG-4 stream and placed into a decoding buffer (this is a Java class implementing MPEGlet interface alone or within a Java archive (jar)). From the decoding buffer (DB), the Java Virtual Machine (JVM) starts the MPEGlet.

In MPEG-4 Part 11, an MPEGlet has no access to graphic resources and has been thought as an application running in the background controlling the terminal. As such, it can access the BIFS scene graph, modify it, and receive events from it. The BIFS compositor then renders its scene graph and a final image is produced; this happens at every frame.

In MPEG-4 Part 21, we view an MPEGlet has a video decoder i.e. a component producing pixel buffers. The MPEGlet can draw into a pixel buffer using JSR-184 or JSR-239. The MPEGlet can also control the compositing process. In the simplest compositing case, the video buffer would be in the background and the MPEGlet pixel buffer will be drawn on top; transparent areas would show the video image underneath. The MPEGlet can also access composition buffers (i.e. pixel buffers) of other video decoders and use them as textures mapped onto synthetic 2D/3D objects.

DB

CompositingCompositing Final imageDeMux

DB

Video Dec

MPEGletGraphics operations

pixels

pixels(Composition Buffers)

RendererJSR-239/184

RendererJSR-239/184

(Decoding Buffers)

Figure 2 – MPEG terminal architecture with MPEGlets.

157

With this architecture in mind, the existing MPEG-J API defined in ISO/IEC 14496-11 can be reused with possibly minor modifications and more importantly with extensions for renderer, composition buffers, and compositing access. Since all media must be composed given time constraints, MPEG-J must also be extended with timing and synchronization.

MPEG-J extensionsTiming and synchronizationIn order to synchronize composition buffers with an MPEGlet, we need timing information from the buffers.

Q: Do we need to query time or be event triggered? A: Different scenarios are possible and it seems both features should be supported.We need CTS, an abstraction to media position (in time and in sample). It is not clear if decoding buffers (and hence DTS) is needed.Composition buffer accessIf we want to use pixels from a visual decoder, we need an abstraction to CBs.Efficient renderingRenderers need to be bound to a composition buffer for rendering. The compositor is the component managing the buffers to produce the final image. Therefore, an MPEGlet should ask the Compositor for one or more composition buffers, which in turn may provide a software or hardware accelerated buffer that match the MPEGlet requirements and the available resources in the terminal.

We need an abstraction from MpegjTerminal to access the compositor.We need a facility in the Compositor to create buffers with some configuration hints.

At each frame, an MPEGlet should be able to bind to a pixel buffer, draw whatever rendering commands, release this pixel buffer. This mechanism is already possible with JSR-184, we must ensure it is also the case with JSR-239.MPEGlets initializationThe MPEGlet interface (ISO/IEC 14496-11) is simply a Runnable. In other words, an MPEGlet is a task running in a thread. In order to initialize hardware accelerated pixel buffers, an application must access native rendering peers.In the last section, we described that through the MpegjTerminal, an MPEGlet can access the Compositor and create hardware accelerated buffers since the Compositor makes the final image and hence has access to native rendering peers.User interactionAn application wouldn't be interactive without keyboard, mouse or other devices access. Java provides such mechanisms for keyboard and mouse so there is no need to define anything if we support J2ME, J2SE, J2EE, and whatever profiles of each Java edition.Misc.From this discussion, it seems some areas must be queried by an MPEGlet in order to discover what a terminal supports. For example, one might want to know if the terminal supports JSR-184 and/or JSR-239. Rendering and Compositing properties should be queried so that an MPEGlet can adapt its processing. This remains to be discussed.

MPEG-4 Part 20 – LaSeR (overview)LaSeR stands for Lightweight scene representation.

158

LaSeR is based on W3C Scalar Vector Graphics but is much smaller. It has features such as being able to move from one scene to another and preserve the status of the scene.

Node features Laser shapes is just polygons (actually, 2D filled contours) and polylines. SVG path will be

added later. No picking at this moment but will be added during CE harmonizing Laser and SVG. AnimateXXX is like SVG without splines. AnimateActivate to animate ID of nodes like a

Switch with a sequence. Cursor is to emulate a stylus with keys on a phone. TextInput is an interface with character input in a phone. xxxKey nodes are configurations for other elements but may not remain for alignment with

SVG. No Inline (as with SVG Tiny) No script (conditional + action is enough)

File format and OD enhancementsThe binary syntax is like BIFS but without context. So you can decode a command without memory of previous scene.

Simple Aggregation Format (SAF) SAF is a way to package scene + audio + video to do cheap streaming over HTTP. Mapping to over transport mechanism is very easy with this format.

Cache mechanism: CacheObject Enables objects to remains in the cache of the phone for faster access.

End of stream signaling Missing in MPEG-4, used to reclaim memory and kill decoders

OD enhancements SimpleDecoderConfig = like DecoderConfig but simpler SimpleDecoderSpecificInfo = just the header of the stream

NotesJSR-226 is aligned with SVG 1.1 and would be useful for a Java access to LaSeR scene.

Main targeted applications portals, services (traffic, maps, weather…), database interrogation, stock quotes, decoration of video clips (e.g buttons to start/stop clips), news service (BBC trying this LaSeR application now) etc…Designed for mobiles applications.

ConclusionMPEG-4 Part 20 (LaSeR) is a simplified version of SVG Tiny with a binary representation simpler than BIFS. It is designed to be a sort of "Flash for mobiles" within a simplified MPEG-4 terminal implementation. Therefore, LaSeR is simplified 2D version of BIFS designed for mobiles harmonized with SVG.

159

Resolutions of SNHC

Output documentsNo. Title TBP Availabl

eEditor

14496-16 MPEG-4 Animation Framework eXtension (AFX)

6543

AFX Reference software FPDAM7 No 04/07/23 Patrick Gioia

14496-16 MPEG-4 Animation Framework eXtension (AFX)

6544

ISO/IEC 14496-16/PDAM1 No 04/07/23 Marius Preda

6545

ISO/IEC 14496-16/DCOR1 No 04/07/23 Marius Preda

6546

AFX CE description No 04/07/30 Marius Preda

6547

AFX VM 15.0 No 04/07/30 Marius Preda

6548

SNHC FAQ 12.0 Yes 04/07/23

6572

Request for ISO/IEC 14496-16/AMD1 No 04/07/23 Marius Preda

14496-21 MPEG-J extensions for rendering6549

ISO/IEC 14496-21 WD 1.0 No 04/08/06 Mikaël Bourges-Sévenier

ResolutionsMPEG-4Part 5

The SNHC subgroup approves the integration of Solid Modeling into the AFX reference software.

Part 16 The SNHC subgroup informs that, following 68th meeting resolutions, Solid Modeling

framework remains in ISO/IEC 14496-16 and Light-Field Mapping and Particle Systems are removed by corrigendum.

The SNHC subgroup informs that XMT and MPEG-J representations for AFX tools are available in ISO/IEC 14496-11/AMD4.

Part 21 The SNHC subgroup informs that, following 68th meeting resolutions, Solid Modeling

framework remains in ISO/IEC 14496-16 and Light-Field Mapping and Particle Systems are removed by corrigendum.

The SNHC subgroup informs that XMT and MPEG-J representations for AFX tools are available in ISO/IEC 14496-11/AMD4.

Establishment of SNHC Ad-Hoc groups

160

No. Title Meeting ChairN6662 AhG on AFX documents, CEs, and

softwareMarius Preda

N6663 AhG on MPEG-J extensions for rendering Mikaël Bourges-Sévenier

N6662 Ad Hoc Group on AFX documents, CEs, and softwareMandates: 1. Maintain and edit SNHC VM document.

2. Coordinate SNHC CE activities.3. Coordinate AFX/AMD1 software implementation

Chairman: Marius Preda (INT)Co-chairs: Mahnjin Han (Samsung AIT)

Patrick Gioia (France Telecom R&D)Duration: Until 70th meeting Meetings Sunday before 70th meetingReflector: mpeg-snhc AT gti. ssr. upm. esSubscribe: Send an email to mpeg-snhc-request AT gti. ssr. upm. es with the message

“subscribe” as the first line in the body.

N6663 Ad Hoc Group on MPEG-J extensions for renderingMandate: 1. Maintain and edit 14496-21 WD document

2. Harmonize MPEG-J systems interfaces for rendering needsChairman: Mikaël Bourges-Sévenier (Mindego Inc.)Co-chairs: Vishy Swaminathan (Sun Microsystems)

Itaru Kaneko (Waseda University)Duration Until 70th meeting Meetings: Sunday before 70th meetingReflector: mpgj-sys AT advent. ee. columbia. eduSubscribe: Send an email to mpegj-sys-request AT advent. ee. columbia. edu with the

message “subscribe” as the first line in the body.

Closing of the MeetingSee you in Palma de Mallorca in October (and bring your swim suits ).

161

Annex 11Report of Integration meeting

Source: Jean-Claude Dufourd, ENST


Allocation of contributionsMonday Plenary

10755 T. Chiang et al AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

10756 L. Cieplinski et al AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software

Joint with MDS on MPEG-21 Conformance, Wed 15:00 to 16:00

10874 Spencer Cheng et al Improving MPEG-21 IPMP Conformance - Experience from MPEG-2/4 IPMPX

10891 Eva Rodriguez et al Revised REL Interpretation Conformance after verification of Test Cases

Joint with MDS on MPEG-21 Reference Software, Thu 11:00 to 12:0010847 SC29 Secretariat Summary of Voting on CD of 21000-8

10864 Xin Wang et al Simple Integration Reference Software for MPEG-21 REL, DID and DIA

10942 Shane Lauf et al Mobile MPEG-21 browser implementationIntegration plenary, Thursday 14:00-16:00, Systems room

11117 Chun-Jen Tsai et al Scalable Multimedia Streaming Test Bed for Media Coding and Testing in Streaming Environments

10792 SC 29 Secretariat Summary of Voting on ISO/IEC PDTR 21000-12

11029 Juergen Schmidt et al


10882 Gyeong Ja Jang et al Updates on the reference software of AFX Encoder10918 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 6

11038 Stephan Würmlin et al

Results on Ref. Soft. Impl. on Point based Rendering for MPEG-4 AFX

11134 Jeremie Farret et al Solid implementation into IM1


10983 ITTF via SC 29 Sec. Table of Replies on ISO/IEC 14496-5:2001/FDAM 4 [SC 29 N 6078]10984 ITTF via SC 29 Sec. Table of Replies on ISO/IEC 14496-5:2001/FDAM 5 [SC 29 N 6079]Conformance10922 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/FPDAM 210923 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/FPDAM 810958 Yoshihiro Miyamoto Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd Edition

162


List of standards under developmentStd

Pt

Edit.

Project

Description CfP

WD CD FCD FDIS

2 4 2004 Amd.1 IPMP Conformance Ext. 03/03

03/07

03/12 04/07

2 4 2004 Amd.2 Audio Conformance Ext. 03/10

03/12

04/03 04/07

2 5 2004 Dam1 IPMP Ref.Soft. Ext. 03/07

04/07

4 4 2004 Cor.1 Visual Bitstreams 04/03

04/10

05/01

4 4 2004 Amd.6 AVC 03/07

03/12 04/07

4 4 2004 Amd.8 HE-AAC, ABIFS and SA 03/10

03/12

04/03 04/07

4 4 2004 Amd.9 AVC FRExt Conformance 04/03

04/07

05/01 05/07

4 4 2004 Amd.10 New Levels of SP Conf 04/07

05/01 05/07

4 5 2004 Amd.6 AVC and HE-AAC 03/03

03/07

03/12 04/07

4 5 2003 Amd.7 AFX Reference SW 02/10

02/12

03/12 04/07

4 5 2004 Amd8 AVC FRExt Ref Soft 04/07

04/10 05/04

7 6 2001 Amd.1 Reference software extensions 01/12

03/03

03/12 04/07

7 7 2004 Amd.1 Conformance extensions 03/03

03/07

03/12 04/07

21 8 200x 1st Ed. Reference software 03/03

04/03

04/07 05/01

21 12 200x 1st Ed. Test Bed for MPEG-21 Resource Delivery

02/12

03/12

04/07

21 14 200x 1st Ed. Conformance 03/10

04/10

05/04 05/07

Latest references

Project P.

Standard Issue No.

MPEG-4

4 ISO/IEC 14496-4:2003 (MPEG-4 Conformance 2nd

Ed.)02/12 Awaji N5457

MPEG-4

4 ISO/IEC 14496-4:2001/Amd.1 (FlexTime, Studio and Streaming Video Profile)

02/07 Klagenfurt

N5083

MPEG-4

5 ISO/IEC 14496-5:2001 (Ref. Soft 2nd Ed.) 01/07 Sydney N4368

MPEG-4

5 ISO/IEC 14496-5:2001/Amd.1 (FlexTime) 02/03 Jeju N4711

MPEG-4

5 ISO/IEC 14496-5:2001/Amd.2 (XMT) 02/05 Fairfax N4865

MPEG-7

6 ISO/IEC 15938-6:2002 (Reference Software) 01/12 Pattaya N4475

MPEG-7

7 ISO/IEC 15938-7:2002 (Conformance) 02/07 Klagenfurt

N4937

163

Request documents

MPEG-2 Conformance10922 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/FPDAM 2Usual « please fix all bugs » comment

MPEG-2 Reference Software

MPEG-4 Conformance (14496-4) 10923 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/FPDAM 8Usual « please fix all bugs » comment, and the rest was dealt with in Audio

10958 Yoshihiro Miyamoto Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd EditionNo one presented the contribution

11072 Ralph Sperschneider Status on MPEG-4 Audio ConformanceThis document was presented in Audio, and only one issue was brought to Integration: all mp4 test sequences in Audio need to be made compliant with the filetype requirement of the latest MP4 file format amendment. After some verification, it is optional to bring all sequences to mp4 v2, not mandatory.

MPEG-4 Reference Software (14496-5) 10882 Gyeong Ja Jang et al Updates on the reference software of AFX EncoderNo one presented the contribution

10918 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 6Usual « please fix bugs » comments

10983 ITTF via SC 29 Sec. Table of Replies on ISO/IEC 14496-5:2001/FDAM 4 [SC 29 N 6078]

Only YES votes

10984 ITTF via SC 29 Sec. Table of Replies on ISO/IEC 14496-5:2001/FDAM 5 [SC 29 N 6079]

Only YES votes

11029 Juergen Schmidt et al Simple Integration Reference Software for MPEG-4 AudioBIFS, version 3

This document reports on the implementation of the version 3 of AudioBifs in IM1. This implementation uses manually generated files, it needs to be brought in sync with the automatically

164

generated templates. This does composition. Rendering is under discussion with Systems: is it required and how?

11038 Stephan Würmlin et al

Results on Ref. Soft. Impl. on Point based Rendering for MPEG-4 AFX

No one presented the contribution



11134 Jeremie Farret et al Solid implementation into IM1No one presented the contribution

Issue: no reference software for part 15: “AVC file format”. This is on Dave Singer’s todo list.

Issue: do we need reference software for part 17: “Streaming Text”. Jan Van der Meer acknowledged that presence of reference software is a prerequisite to promotion to FDIS of the specification.

MPEG-21 Conformance

10874 Spencer Cheng et al Improving MPEG-21 IPMP Conformance - Experience from MPEG-2/4 IPMPX


10891 Eva Rodriguez et al Revised REL Interpretation Conformance after verification of Test Cases

This document was presented: it presents work on the conformance “streams”.Discussion of the state of the M21 Conformance: the WD is pretty skimpy, and we do not think it should be progressed. In general, REL is the “good student” for conformance, but this does not say much…

MPEG-21 Reference Software

10864 Xin Wang et al Simple Integration Reference Software for MPEG-21 REL, DID and DIA

The document was presented : it describes a software, extended from previous version with a DIA functionality. The DIA functionality is provided by a piece of DIA reference software. This falls into the category of integrated utility software.

10847 SC29 Secretariat Summary of Voting on CD of 21000-8AU nb comment : « update to FDIS status » is acceptedUS nb comments:

- clarify introduction: accepted- clarify content of each section: accepted- use consistent presentation: accepted

165

- use consistent organisation of the software: acceptedKR nb comment:

- test bed: acknowledged, another solution is proposed (normative reference to the TR)- integrated software plan for new parts: acknowledged, these parts are out of scope of the

current document (because no FDIS yet)- comment on FF software: not relevant for this document- list of DIA utility module: accepted

10942 Shane Lauf et al Mobile MPEG-21 browser implementationThe document presents a J2ME implementation of a M21 browser, with an impressive demo on a phone.

Multimedia Test Bed10792 SC 29 Secretariat Summary of Voting on ISO/IEC PDTR 21000-12 Discussion of the responses to the various votes. The US comments are accepted. The AU and UK comments are not really technical and do not address shortcomings of the document, but evoke higher level issues.

11117 Chun-Jen Tsai et al Scalable Multimedia Streaming Test Bed for Media Coding and Testing in Streaming Environments

Presentation of small changes to the test bed software.

MPEG Reference Software Guide

166

Resolutions of Integration

Resolutions

Documents

MPEG-2


13818-4 MPEG-2 Conformance 6624 DoC on ISO/IEC13818-4/FPDAM1 IPMP Conformance Ext. N 04/07/236616 ISO/IEC13818-4/FDAM1 IPMP Conformance Ext. N 04/07/236617 DoC on ISO/IEC13818-4:200X/FPDAM2 Audio Conformance Ext. N 04/07/236618 ISO/IEC13818-4:2004/FDAM2 Audio Conformance Ext. N 04/09/23

13818-5 MPEG-2 Reference Software 6619 DoC on ISO/IEC 13818-5/Dam2 IPMP Reference Software Ext. N 04/07/236620 ISO/IEC 13818-5/AMD2 IPMP Reference Software Ext N 04/07/236621 ISO/IEC 13818-5:1997/Amd1:1999/COR2 N 04/07/23

MPEG-4


14496-4 MPEG-4 Conformance 6532 DoC on ISO/IEC 14496-4/FPDAM6 AVC Conformance Y 04/09/156533 ISO/IEC 14496-4/FDAM6 AVC Conformance Y 04/09/15


N 04/07/23

6623 ISO/IEC 14496-4/FDAM8 HE-AAC, ABIFS and SA Conformance N 04/09/236534 ISO/IEC 14496-4/PDAM9 AVC FRExt Conformance Y 04/09/156498 ISO/IEC 14496-4/PDAM10 New levels of Simple Profile Conformance N 04/07/19

14496-5 MPEG-4 Reference Software


N 04/09/15

6536 ISO/IEC 14496-5/FDAM6 AVC and HE-AAC reference software N 04/09/236625 DoC on ISO/IEC 14496-5/FPDAM7 AFX reference software N 04/07/236626 ISO/IEC 14496-5/FDAM7 AFX reference software N 04/07/236537 ISO/IEC 14496-5/PDAM8 AVC FRExt reference software Y 04/09/15

MPEG-21


21000-8 MPEG-21 Reference Software6627 DoC on ISO/IEC 21000-8/CD MPEG-21 reference software N 04/07/23

167

6628 ISO/IEC 21000-8/FCD MPEG-21 reference software N 04/09/10


21000-12 MPEG-21 Test Bed for MPEG-21 Resource Delivery

6629 DoC on ISO/IEC 21000-12/PDTR Test Bed for MPEG-21 Resource Delivery

N 04/07/23

6630 ISO/IEC 21000-12/DTR Test Bed for MPEG-21 Resource Delivery N 04/07/23

AHG

168

Annex 12Report of Test meeting

Source: Tobias Oelbaum


Goals for the weekThe goals of this week are:

Conduct “Expert testing” for SVC CE Processing the results of the SVC CE tests and presentation of the results Discussion about testing for the 3DAV CfE, review of selected bitrates for 3DAV CfE

Joint MeetingsThe following joint meetings were scheduled

with Video - SVC CE testing with Video – 3DAV CfE preparation

Contributions10935 A Multimedia material Visual quality ranking procedure based on Single or Multiple Viewing (Baroncini / Tan / Oelbaum)

Test Activities

SVC CE testingResults of the CEs were evaluated at the meeting using the new “Expert viewing” method described in 10935. Five different test sessions with spatial resolutions ranging from QCIF to 4CIF were conducted with five experts participating at each test session.Results were presented at a joint meeting with Video and are documented in Nxxxx

3DAV, preperation of the CfE First discussions about possibilities to test 3DAV proposals. It was proposed to use the same “Expert viewing” method for 3DAV that was used for the SVC CE tests.Bitrates selected for the CfE were reviewed and modified to allow meaningful tests at the next meeting.It was agreed that for MVC (Multible Viewpoint Videocoding) two different views that will be tested will be selected randomly by the test subgroup.

Test Resolutions

Output Documents W6513 Results of the visual assesment of the results of the CEs on Scalable Video Coding

Technology

169

AdHoc GroupsNo AdHoc Groups have been set up at this meeting. The video group has setup the AhG for the “SVC call for proposal”.

Resolutions The test subgroup would like to thank Charles Fenimore for his valuable help preparing the

SVC CE tests. The test subgroup would like to thank videatis for making available the HD sequence

“Soccer” for the SVC CE testing and further testing within MPEG.

170

Annex 13Report of ISG meeting

Source: ISG ChairEditor: Marco Mattavelli (EPFL)

OverviewThe main work items of the Implementation Studies Subgroup in Redmond are:

1. The advances in the development of the MPEG-4 “Part 9 Reference Hardware Description” Phase 2 concerning the integration of the MPEG-4 Optimized Reference software Part 7 and the Reference Hardware Part 9 so as to constitute a “mixed” software hardware description of MPEG-4 video using the concept of the virtual socket.

2. The planning and extensions of the integrated framework for the support to the development of MPEG-4 Part 9 with MPEG-7 Part 7 and AVC (MPEG-4 Part-9) software.

3. The contribution to the definition of the Video Coding Tools repository4. The approval of the FDAM of MPEG-7 reference software.

Input contributions w.r.t. the above items are summarized according to the following table:

Contributions

M10751 “Report of the AHG on MPEG-4 Part 9 "Reference Hardware Description"

Marco Mattavelli EPFL, Robert Turney Xilinx Research Lab.

M10808 2-D IDCT Hardware Accelerator Implementation for Virtex-II Devices

A. Navarro, A. Silva, O. Nunes, C. Aragao Telecommunications Institute-University of Aveiro-Portugal

M10821 Motion Estimation Hardware Accelerator Implementation for Virtex-II Devices

J.Dubois, L.Pierrefeu, M.Mattavelli Laboratoire Electronique Informatique et Image of Dijon University – France, LTS-3 EPFL

M10823 An Integrated Hardware-Accelerated Software Framework for MPEG-4 Hardware Reference Model

Tamer S. Mohamed and Wael Badawy University of Calgary, Calgary, AB, Canada.

M10824 An IP Block For MPEG-4 Part 10 Context-Based Adptive Variable Length Coding (CAVLC)

Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada.

M10825 A Hardware Block for 2x2 Hadamard Transform and Quantization with Application to MPEG–4 Part 10


M10826 A SystemC model for 2x2 Hadamard Transform and Quantization with Application to MPEG–4 Part 10


M10827 A Hardware Block for 4x4 Hadamard Transform and

Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing

171

Quantization in MPEG-4 Part 10 Systems (ATIPS), Calgary, Alberta, Canada.M10828 A SystemC model for 4x4 Hadamard

Transform and Quantization with application to MPEG-4 Part 10


M10829 A Hardware Block For The MPEG-4 Part 10 4x4 DCT-Like Transformation And Quantization


M10830 A SystemC Model For The MPEG-4 Part 10 4x4 DCT-Like Transformation And Quantization


M10849 Low-power hardware acceleration for motion estimation

Valentin Muresan, Noel O’Connor, Noel Murphy, Sean Marlow, Alan SmeatonCentre for Digital Video Processing, Dublin City University, Dublin 9, Ireland.

M10863 MPEG-4 Inverse Quantizer Hardware Accelerator Implementation in Virtex II

A. Navarro, A. Silva, O. Nunes, C. Aragao Telecommunications Institute-University of Aveiro-Portugal

M10883 Hardware Acceleration Module for Shape Adaptive Discrete Cosine Transform

Andrew Kinane, Valentin Muresan, Noel O’Connor, Noel Murphy, Seán Marlow, Alan Smeaton Centre for Digital Video Processing, Dublin City University, Dublin 9, Ireland

M10954 Multiple IP-Core Hardware-Accelerated Software System Framework for MPEG4-Part9

Tamer S. Mohamed and Wael Badawy University of Calgary, Calgary, AB, Canada.

M11092 Hardware Acceleration Module for MPEG-4 Binary Shape Coding Motion Estimation Tool

Daniel Larkin, Valentin Muresan, Noel O’Connor, Noel Murphy, Seán Marlow, Alan Smeaton Centre for Digital Video Processing, Dublin City University, Dublin 9, Ireland

M11104 Status of CDVP's contribution to MPEG-4 Part 9 - Implementation Study Group

Valentin Muresan, Daniel Larkin, Andrew Kinane, Noel O’ConnorCentre for Digital Video Processing, Dublin City University, Dublin 9, Ireland.

Detailed Report

Reference hardware description for MPEG-4

The ISG activity at the Redmond meeting has mainly been devoted to the review of the contribution and to the preparation of guideline documents:

the review of the contributions presenting new HDL module submissions the review of contributions on the proposed improvements to the API specification and

implementation improvements of the “Virtual Socket”,

172

the planning of the releases of the integrated framework based on the Wildcard II supporting the virtual socket,

on the drafting of new guidelines for module and documentation submissions, on the specification of the advanced version of the demonstration, on the update of MPEG-4 Part 2 and Part 10 module submission status.

The high number of HDL number received and the several new commitments made necessary several action points to coordinate the work and to uniform the documentation that will be included in the technical report. The first was to update the call for submissions so as to include and make available for current and new submitters all the information and developments made so far (output document N6506). The new call updates the status of the submissions the goals of each phase and provides references to documents providing detailed information on the integrated framework that support the virtual socket API, on the format for the documentation to be submitted together with the module HDL code and to the instruction on how to access the CVS server for HDL code submission and maintenance. With this purpose two output documents have been prepared, one provides the CVS access conditions and instructions (output document N6508), the other is a template for the preparation of the documentation of each HDL module (output document N6507).

The table of module submission commitment has been updated and reported in an specific output document (question marks indicate that the commitment is uncertain concerning the delivery date or that the module has not been selected for a submission commitment) (output document N6509) .

The ad-hoc group on the development of MPEG-4 Part 9 has been re-established with updated mandates, including a specific mandate for the specification and development of the demonstration platform. The ad-hoc schedule includes 4 telephone conferences before next meeting. Phone conferences are planned on the 19th August, 9th September, 30th September, 14th October at 3 p.m. GMT. Tel: (from US 1-877-582-3182, from outside US 1-706-679-1128, participant code 9202060193).

Contribution to the definition of a video tools repository.

Two joint meeting with the video group have been held to discuss the issue related to the development of a video tool repository. The implementation study group has contributed to put in evidence all formalism aspects that are essential for an efficient usage of the library so as to be able to define new module interconnections, new control signals and new modules. Such formalism definition should be further developed so as to be able to define new ways of using the standard blocks and define “new standards”.

The promotion to FDAM of the MPEG-7 reference software extensions.

The MPEG-7 reference software extension has been approved to FDAM answering to the US national body comments requiring for a correct abstract summaries for the audio descriptors. The document will be ready for ballot one week after the end of the meeting.

ResolutionsThe above activities have led to the following resolutions and output document

173

approval.

MPEG-4 part 9 related resolutions:

14.1.2 The Implementation Studies subgroup recommends to approve the following documents:

MPEG-4


14496-9 MPEG-4 Reference Hardware Description

6506 Updated Call for the Submission of Hardware Reference Code for MPEG-4 Part 9: Reference Hardware Description

Y Y

6507 Template for MPEG-4 Part 9 HDL module documentation N 7/27/04

6508 CVS server user manual and code format specification for MPEG-4 Part-9 submissions and maintenance Rev. 0

N 7/30/04

6509 Status of HDL submissions and commitments for MPEG-4 Part-9 N Y

MPEG-7


15938-6 MPEG-7 Reference Software

6511 ISO/IEC FDAM 15938-6 Information Technology -Multimedia Content Description Interface- part 6: Reference Software Extensions

N 7/30/04

6512 DoC of ISO/IEC PDAM 15938-6 Information Technology -Multimedia Content Description Interface- part 6: Reference Software Extensions

N Y

14.1.3 The Implementation Studies subgroup would like to thank all submitters of HDL code and contributors to the implementation of the virtual socket and encourages them to continue this fruitful effort and collaboration.

174

Annex 14Report of Liaisons meeting

Source: Jan Bormans

The Liaison Group received three requests to establish a class C relationship, all of which were granted after consideration at the Redmond meeting:

The Digital Media Project (DMP) is a non-for-profit organisation registered in Geneva in December 2003 with the mission to “promote continuing successful development, deployment and use of Digital Media that respect the rights of creators and rights holders to exploit their works, the wish of end users to fully enjoy the benefits of Digital Media and the interests of various value-chain players to provide products and services, according to the principles laid down in the Digital Media Manifesto”.

DMP has assessed the urgent need for Technical Specifications of devices that possess a subset of features of fully-fledged Interoperable End-user Devices, the ability to deal with governed content in an interoperable way being the most important. DMP has called such devices “Portable Audio and Video Devices” (PAV) and decided that it will develop the relevant Technical Specifications on a fast track, namely by April 2005. These DMP activities are complementary to WG 11’s work, especially within the field of MPEG-21.

The Digital Cinema Specification Development Committee (DCSDC) as Broadband Networks are now widely spreading throughout the world and high quality video distribution is getting easier and easier, new content business concepts based on the mental sense or culture base are considered becoming key to industry. Considering these trends - and in order to raise-up Japanese cinema industry to the international level on its quality and quantity - the Japanese National Project named Digital Cinema Common Specification Development Project (DCCSDP) has been started on July 1st 2004. To conduct DCCSDP, Digital Cinema Common Specification Development Committee (DCCSDC) was established. Object of this DCCSDP is to create the cinema technology up to and above the film based cinema industry which is mainly conducted by Hollywood, and furthermore, create value chain based on current digital technology and keep technology level consistency from scenario creation to cinema presentation and then, to standardize these established concepts and technologies.

This new liaison relationship will enable efficient information exchange and collaboration in the field of normative technology for Digital Cinema Contents. DCCSP will consequently have access to MPEG technology and will provide feedback on its usability for DCCSP’s application domain. Immediate topics of interaction are foreseen to include MPEG-4 AVC, MPEG-7 and MPEG-21 REL and RDD.

The Open Mobile Alliance (OMA) was formed in June 2002 by nearly 200 companies representing the world's leading mobile operators, device & network suppliers, information technology companies and content providers. The Open Mobile Alliance is designed to be the centre of mobile service enabler specification work, helping the creation of interoperable services across countries, operators and mobile terminals that will meet the needs of the user (http://www.openmobilealliance.org).

175

The Open Mobile Alliance (OMA) expresses it desire to explore these activities jointly. OMA proposes the exchange of technical working documents and specifications via designated liaison representatives of each organization. The Liaisons Group considered the following input documents:

Input Contrib No.

Title

M10843 Liaison Statement from the Digital Media ProjectM11105 Digital Cinema QOS and ConformanceM10877 Liaison Statement from JTC 1/SC 37 on ISO/IEC FCD 197945M10985 Liaison Statement from the Open Mobile Alliance (OMA)

M10775IEC CDV 60728-9/Amd.1: Cable networks for television signals, sound signals and interactive services -- Part 9: Interfaces for cabled distribution systems for digitally modulated signals, Amendment 1

M10778 ISO/IEC FCD 19794-6: Information technology -- Biometric data interchange formats -- Part 6: Iris image data

M10779 SC 37 NP on Vascular Biometric Image Interchange Format

M10781IEC CDV 62328-1: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 1: General description and architecture

M10782 IEC CDV 62328-2: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 2: General recording structure

M10783IEC CDV 62328-3: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 3: Broadcasting system specific recording structure – ISDB

M10784 Liaison Statement from ITU-T SG 17M10785 Liaison Statement from ITU-T SG 12M10793 Liaison Statement from the TV-Anytime ForumM10794 IEC CDV 62298-1: Teleweb Application -- Part 1: General DescriptionM10795 IEC CDV 62298-2: Teleweb application -- Part 2: Delivery methodsM10798 Liaison Statement from ITU-R SG 6/WP 6MM10799 Liaison Statement from ITU-T SG 9M10803 W3C Comments on the MPEG Timed Text specificationM10840 Liaison Statement from ITU-R SG 6/WP 6QM10893 SMPTE Liaison to MPEG on OpenType® and ISO/IEC 14496-18M10897 Liaison Statement from the TV-Anytime ForumM10992 Liaison Statement from SC 37 BiometricsM11116 Liaison Statement from Blu Ray Disk FoundersM11147 Liaison Statement from IEEE LTSC

In addition to replying, when appropriate, to the incoming Liaison Statements, it was agreed to take the initiative to send outgoing Liaison Statements to: W3C - on drawing the attention of W3C’s Device Independence Working Group to existing

MPEG technology that addresses parts of the topics they intend to cover in their upcoming Workshop on Metadata for Content Adaptation;

VCEG - informing ITU-T SG 16 Q.6 on our progress in the field of Scalable Video Coding (SVC) and links with AVC;

JSR-239 – regarding the usage by MPEG-4 part 21 of low-level graphic operations and the use of JSR-239 for its Java bindings to OpenGL ES.

176

The JVT has sent out Liaison Statements to various organizations describing the general status and content of the ISO/IEC 14496-10 FRExt amendment work, expect for BDF and SMPTE, which were sent out by WG 11 as they answer a request by these bodies addressed to WG 11.

The responses for the non-technical National Body comments as well as an updated list

of organisations with which MPEG entertains liaisons were completed.

The following recommendations were issued:

The approval of the following documents (Liaison Statements):

No. Title TBP AvailableGeneral

N6551 Liaison Statement to the Digital Media Project No 2004/07/23

N6552 Liaison Statement to the DCSDC No 2004/07/23

N6553 Liaison Statement to the OMA No 2004/07/23

N6554 Liaison Statement to JTC 1/SC 37 No 2004/07/23

N6555 Liaison Statement to ITU-T SG 17 No 2004/07/23

N6556 Liaison Statement to ITU-R SG 6/WP 6M No 2004/07/23

N6557 Liaison Statement to W3C on MPEG Timed Text specification No 2004/07/23

N6558 Liaison Statement to Blu Ray Disk Founders No 2004/07/23

N6559 Liaison Statement to IEEE LTSC No 2004/07/23

N6560 Liaison Statement to SMPTE on OpenType® and ISO/IEC 14496-18

No 2004/07/23

N6561 Liaison Statement to W3C on Public Workshop on Metadata for Content Adaptation

No 2004/07/23

N6562 Liaison Statement to VCEG No 2004/07/23

N6563 Liaison Statement to TVAF No 2004/07/23

N6564 Liaison Statement to JSR-239 No 2004/07/23

N6565 Liaison Statement to IEC TC 100 No 2004/07/23

N6566 Liaison Statement to SMPTE on Alpha Channel and AVC/H.264 Frext

No 2004/07/23

The approval of the following documents (statement of benefits):


177

General

N6567 Statement of benefits from establishing a class C liaison with the DMP

No 2004/07/23

N6568 Statement of benefits from establishing a class C liaison with the DCSDC

No 2004/07/23

N6569 Statement of benefits from establishing a class C liaison with the OMA

No 2004/07/23

The approval of the following documents (other Liaison documents):

No. Title TBP AvailableGeneral

N6570 Responses to NB Comments

No 2004/07/23

N6571 List of WG11 Liaisons No 2004/07/23

The Liaison group recommends the approval of the new Class C Liaisons with the OMA, the DMP and the DCSDC.

Nomination of liaison representatives:o Pete Schirling to the OMAo Marc Gauvin to the DMPo Miroslaw Bober to JTC1/SC37o Jean-Claude Dufourd to W3C

178