10/27/07

AVS Standard - Status and Future Plan

Wen Gao, Tiejun HuangPeking University

Oct.26 2007 Shenzhen

Workshop on Multimedia New Technologies and Application

10/27/07

Outline

• Status of AVS（GB/T 20090）• Status of AVS production• Summary

10/27/07

Status of AVS（GB/T20090）

10/27/07

AVS Working Group

• Set up by MII (Ministry of InformationIndustry) in June of 2002

• In charge of national standardization ofaudio-video coding for Chinese A/Vindustry

• Also in charge of organizing the delegationof China National Body to MPEG(ISO/IECJTC1/SC29/WG11)

10/27/07

AVS membership

0

20

40

60

80

100

120

140

160

180

2002 2003 2004 2005 2006 2007

Total

New

End

10/27/07

AVS members• AVS members by area

– CE, 11%；– Com, 12%；– Comp and Soft, 44%；– IC, 14%；

• Local research entities, 24%• Worldwide research entities, 30%

10/27/07

国内企业 Local Members

10/27/07

MNC or Out of China外资企业和国外企业

10/27/07

AVS Subgroups

• System• Video• Audio• Digital Media Rights Management• Requirement• Conformance• IPR

10/27/07

AVS IPR Experts Group formation

• Late 2003 the President of AVS asked that a group ofexperts be assembled to create a recommendation for anIPR policy for AVS

• Create policies that:– reflect and respect China law and culture– reflect WTO requirements– reflect successful global practices– balance the rights of the inventor and needs of the implementers– innovative and forward looking– evolves with practice and law in China

10/27/07

Mission of AVS IPR Group

• Make a friendly environment for technicalsociety (standard body), industry, and enduser

• Key issue to work out– Reforming the IPR policy making by only IP

holder, to by IP holder + industry + consumer

10/27/07

AVS IPR Experts Group• Experienced members:经验丰富的成员

– Patent Attorneys专利律师– Technical Experts技术专家– Contract Attorneys处理合同的律师– Previous experience in setting up patent pools具有建立专利池相关经验的成员

• Members are from:成员来自– Asia 亚洲– Europe 欧洲– North America 北美

• Members represent: 成员代表了– Consumer Electronics 消费电子产品界– Information Technology 信息技术界– Microelectronics微电子产业界

10/27/07

AVS IPR Experts group

• Members– Broadcom– IBM– Intel– Matsushita/Panasonic– Microsoft– Nokia– Sony– Sun Microsystems

10/27/07

AVS StandardsParticipant by SUBGROUP

(Audio, Video, …)

Contributor

Member default IP selection

Non- Contributor

Patent Pool Licensing

RAND

Royalty Free

RAND

(RoW only)

Non-subgroupparticipant

Non-participantelected defaultapplies

VoluntaryDisclosure

no

Elected option

yes

Participantelected defaultapplies

Disclosure

no

Elected option

yes

Member IPR Obligations成员知识产权义务

Participant:• Patent Pool• RAND RF•RAND

Non-Participant:• Patent Pool• RAND RF• RAND• No-license

10/27/07

Licensing ObligationsJoin AVS

• Sign Member Agreement•Declare default option

Participate in Subgroup• Commit to license

• License options

Submit Contribution• Disclose patents

•Declare license option

Non-Participant: • RAND RF• POOL• RAND• No License

• RAND RF• POOL• RAND

China Patent:• RAND RF• POOL

Worldwide Patent: • RAND RF• POOL• RAND

Participant: • RAND RF• POOL• RAND

10/27/07

Disclosure Obligations

• When making a contribution– Unpublished, published and granted patents

• Ongoing– When a patent is discovered– When a Patent Application is published

• During Final Draft Standard Review– 90 days to declare licensing option, OR:– Default applies

10/27/07

AVS meeting• 1st AVS Meeting, Aug. 23-24, 2002, Beijing, Tiejun Huang• 2nd AVS Meeting, Oct.23-24, Shanghai, Yongqin Zeng• 3rd AVS Meeting, Dec.19-20, Beijing, Shiqiang Yang• 4th AVS Meeting, March 27-28, 2003, Wuhan, Guangxi Zhu• 5th AVS Meeting, July 28-29, 2003, Beijing, Bo Li• 6th AVS Meeting, Oct. 8-10, Hangzhou, Lu Yu• 7th AVS Meeting, Dec.18-20, 2003, Beijing, Tiejun Huang• 8th AVS Meeting, March 30-31, 2004, Shenzhen, Lianhuan Xiong• 9th AVS Meeting, June 18-20, 2004, Beijing, Tiejun Huang• 10th AVS Meeting, Sept. 10-12, 2004, Suzhou, Xi Chen• 11th AVS Meeting, Dec. 10-12, 2004, Beijing, Tiejun Huang• 12th AVS Meeting, March 9-11, 2005, Chengdu• 13th AVS Meeting, June 9-11, Beijing, Tiejun Huang• 14th AVS Meeting, Sept. 22-24, 2005, Shanghai, Haiwu Zhao• 15th AVS Meeting, Dec. 9-11, 2005, Qingdao• 16th AVS Meeting, March 16-18, 2006, Beijing, Bo Li• 17th AVS Meeting, June 7-9, 2006, Huangshan, Houqiang Li• 18th AVS Meeting, Sept 21-23, 2006, Beijing, Shiqiang Yang• 19th AVS Meeting, Dec 7-9, 2006, Zhuhai, Fan Liang• 20th AVS Meeting, March 15-17, 2007, Beijing, Tiejun Huang• 21st AVS Meeting, June 14-16, 2007, Harbin, Debin Zhao• 22nd AVS Meeting, Sept 19-21, 2007, Beijing, Lei Wang

10/27/07

AVS parts

2007.122007.92006.32006.120074555-T-469AVS1-P9.2（File Format）

2008.32007.112007.3TBDAVS1-P10（Mobile Speechand Audio）

2007.122005.122005.92005.320074555-T-469AVS1-P9.1（File Format）

2007.62006.32006.120074554-T469AVS1-P8.2（System-IP）

2006.32005.122005.92005.320074554-T469AVS1-P8.1（System-IP）

2006.42004.122004.92004.620051309-T-339AVS1-P7（Mobility Video)

2007.32006.122005.122005.320051308-T-339AVS1-P6（DRM）

2007.620051307-T-339AVS1-P5（Ref. Software）

2007.31006.122006.920051306-T-339AVS1-P4（Conformance）

2006.42005.122005.122005.920051305-T-339AVS1-P3（M-profile）

2006.42005.122005.32004.1220051305-T-339AVS1-P3 (Audio-Stereo)

2008.92008.62008.32007.1220051305-T-339AVS1-P2（S-profile）

2007.122006.32005.920032265-T-339AVS1-P2（X-profile）

2006.22004.82004.42003.122003.1020032265-T-339AVS1-P2（J-profile）

2007.032006.102003.122003.1020051304-T-339AVS1-P1（系统-广播）

国家标准发布实施（GB）

标准送审稿（FD）

最终草案(FCD)

工作组草案(CD)

小组草案（WD）

国家标准计划号STD Number

AVS Parts

10/27/07

AVS video parts

• Application oriented tool sets– AVS-Part 2

• AVS Jizhun Profile– For HDTV, SDTV

• AVS Zengqiang Profile– For Storage media

– AVS-Part 7• AVS Jiben Profile

– For Mobile application

– AVS-S• AVS ??? Profile

– For video surveillance

10/27/07

AVS1-P2 technical contributions

42Total

Transform, 变换1Changxinjia

４２２coding, 色度编码1Zhongshan U

Start codes, 起始码1SVA

Loop-filtering, intra-frame interpolation, 环路滤波、桢内插值2BIT

Loop-filtering, 环路滤波3HUST

Entropy coding,熵编码3Huawei

Interlace, video structure6Tsinghua U

Motion estimation, sub-pel, transform, entropy coding9Zhejiang U

Bi-direction prediction, motion extimation, sub-pel, transform, entropycoding, loop-filtering

16ICT

ContributionNumberCompany

10/27/07

AVS-P7 technical contributions

Transform, intra prediction entropy coding, high level syntax9Zhejiang U

Intra prediction, loop filtering, rate control9HUST

52Total

Entropy coding, high level syntax2Panasonic

Intra prediction、HRD2CUHK

P-frame not for reference, high level syntax, rate control3USTC

Requirement, intra prediction, entropy coding3Huawei

Sub-pel interpolation4BIT

Framework, transform, intra prediction motion estimation,entropy coding

8ICT

IDR、flexible reference frames, high level syntax, HDR,definition of levels

12Nokia

ContributionsNumberCompany

10/27/07

AVS1-P2 and AVS1-P7• In AVS system part, AVS descriptor is defined as，

AVS_video_descriptor () {descriptor_tag 8bitsdescriptor_length 8bitsprofile_id 8bits

level_id 8bitsmultiple_frame_rate_flag 1bitframe_rate_code 4bitsAVS_still_present 1bitchroma_format 2bitssample_precision 3bitsreserved 5bits

}

10/27/07

• AVS1-P2 and/or AVS1-P7 can be identified byprofile_id– AVS1-P2

• profile_id=0x00 disable0x20 Jizhun profileother reserve

– AVS1-P7• profile_id=

0x00 disable0x10 Jiben profileother reserve

AVS1-P2 and AVS1-P7 (cont’)

10/27/07

Main differences between AVS, 264, MPEG-2

<=2<=16<=2Referenceframe

16x16,16x8(interlace)

16x16, 16x8, 8x168x8,8x4,4x8,4x4

16x16, 16x8, 8x168x8

Block-size forMC

Coding twomotion vectors

Coding two motionvectors

Coding front motionvector, andcomputing backmotion vector

B framemicro-blockbi-directionprediction

4x4, 9 modes for Yprediction, 4 modesfor UV prediction

H.264Prediction onlyto DC coefficient

8x8, 5 modes for Yprediction, 4 modesfor UV prediction

Intra-interpolation

MPEG-2AVS1-P2tools

10/27/07

½ pixels 2-tap½ pixels 6-tap¼ pixels 2-tap

½ pixels 4-tap¼ pixels 4-tap

¼ pixel MC

VLCCAVLCCABAC

Adaptive 2D VLCEntropycoding

N/A4x4 basedMore boundariesMore BS-levels (0..4),More pixels filtered(p0..p3,q0..q3)

8x8 basedLess boundariesLess BS-levels (0..2), Lesspixels filtered (p0, p1,q0,q1)

Loop filter

4x4 integer transform,both encoding anddecoding sites need tonormalize

H.264

8x8 float DCT8x8 integer transform，encoding sitenormalization only

Transformandquantization

MPEG-2AVS1-P2tools

Main differences between AVS, 264, MPEG-2(cont’d)

10/27/07

AVS1-P2 Subjective Testing• April-Sept., 2005, AVS subjective testing has been

executed by SARFT testing center• The testing is based on GY/T 134-1998 standard as

well as related ITU testing standard

A-ABATesting result

6101.53AVS bit-rate (Mbps)

204~6MPEG-2 typical bit-rate(Mbps)

HD resolution(1125/50i)

SD resolution(625/50i)

Compressed testing videostream bit-rate

10/27/07

Major Tools in Zengqiang Profile

• Macroblock-level Adaptive Frame/Field coding（MBAFF）

• Adaptive weighting quantization• Adaptive scan order of transform coefficients• Arithmetic coding of most syntax elements

10/27/07

Features of AVS

• Compare to MPEG-4 and H.264– Reasonable IPR policy for Chinese market– Higher efficiency for target application– Lower complexity for implementation and

production with reasonable quality– Compatible with MPEG-2 in system layer

10/27/07

Status of AVS production

10/27/07

AVS Industry Alliance (AVSIA)

May 25, 2005, announced at People’s Great Hall

10/27/07

AVSIA membership

• 23 members (up to Sept. 2006)• TCL、Changhong(长虹)、Haier(海尔)、Hiesense(海信)、SVA(上广电)、创维、Huawei(华为)、ZTE(中兴)、浪潮、联合信源、中关村高技术企业协会、浦东移动多媒体协会、华聚基金会、泰宇科技、芯晟、宏景、龙晶、Sunnywell(朝歌数码)、英华达、厦华、UT斯达康、网立信、博通（Broadcom）

10/27/07

AVS product chain

• End to End system– Encoder

• Real time encoder• Off-line encoder• Transcoder

– Decoder• Set Top Box

– Chip– Software– Device

• Software decoder– Other value chain

10/27/07

AVS Professional Encoder vendor

• NSCC• SVA• Envivoi

10/27/07

Current AVS STB solutions

• DSP– TI

• DMP642• DMP644x

– Philips– ADI

10/27/07

AVS Chip

• Shanghai Spectrum Communication (展讯)– AVS HD SoC, mass product

• Shanghai Longjing Semiconductor(龙晶)– AVS Core, mass product

• Broadcom– AVS HD SoC, 2008 Q1

• ST– AVS HD SoC, ready

• Philips– AVS HD SoC, ready

10/27/07

Status of AVS application

10/27/07

AVS adopted by operators

• China Netcom IPTV• Sichuan 703 CMB-T• Hangzhou CMB-T• Heilongjiang CMB-T• …

10/27/07

Performance testing using PQA by CNC Lab and MII Lab

RTnet实验网PQA300 AVS/H.264

Encoder

STB1

电视机

SDI 输出快速以太

网输出

测试环境拓扑图

模拟复合

输出

项目 1M 1.5M 2M

最小值 13.10 12.79 12.59

最大值 22.21 22.23 22.21

平均值 17.32 17.14 17.04

所有平均值

17.17

AVS STB Test Results项目 1M 1.5M 2M

最小值 15.24 14.59 14.43

最大值 23.28 22.91 22.89

平均值 19.18 18.67 18.55

所有平均值

18.80

H.264 STB Test Results

10/27/07

CNC AVS-IPTV Trial Status• Location: Dalian city(4M population)• Vendors

– Content provider：SMG(上海文广)– IPTV system：

• Huawei• ZTE• Shanghai-Bell-Alcatel-Lucent

– Encoder：NSCC（北京联合信源）– STB：ZTE、Huawei、Sunnywell、…

• Scale：5000 node/system• Trial completed at Oct. 10, 2007

10/27/07

Programs are broadcasted directly from SMG via internet to Shenyang CityAVS-IPTV Center node, then through delay to Dalian City local network, thatdistributes the program.

沈阳AVS-IPTV核心中心节点通过DCN与BOSS系统相连。

Trial Network for AVS-IPTV

10/27/07

Technical analysis of trail network

Average MDI:DF value：It can be seen from the curves thatMIDI:DF jitter value within 1 second at 1.65 Mbps, i.e. use of 1second buffer is enough to eliminate the jitter effect.

BAS download MDI:MLR value：

Under BAS（SE800) data quality of three companies was monitored, there was nopacket loss within 30 minutes. Networks link Shanghai Media Group, ShanghaiNetcom, Shenyang IP Center, Dalian IP Center. Test results have shown the systemsatisfied the reliability requirements.

10/27/07

User feedback Analysis of trial network______

____ __ __ __

____ 87.84 86.87 87.69

____ 87.93 88.96 87.70

____ 89.22 86.41 87.41

_____ 90.00 91.22 89.33

____ 79.33 76.22 78.06

______

______

____ __ __ __

____ 77.48 78.94 77.13

____ 78.01 78.90 78.36

____ 81.29 78.07 79.71

_____ 78.32 78.21 71.07

______

__________

______ __ __ __

____ 49.5 43.75 61.5

____ 63.75 55 65.75

____ 60.75 59.5 63.75

____ 59.25 59.5 67

________ 67.75 45 73.75

_________ 58.75 61.25 66.25

______

__________

______ __ __ __

____ 90.40 89.00 90.60

____ 88.00 89.60 91.80

______ 91.60 91.20 92.40

_______ 89.60 91.80 91.00

______ 88.80 91.40 95.80

______ 89.80 92.80 90.80

_______ 93.60 91.00 87.00

_______ 90.00 89.80 93.00

______

______

____ __ __ __

____ 87.84 86.87 87.69

____ 87.93 88.96 87.70

____ 89.22 86.41 87.41

_____ 90.00 91.22 89.33

____ 79.33 76.22 78.06

______

Data distributions of threesystems are almost same, whichindicate that end-users satisfythe services provided by threesystems.

10/27/07

Compatibility test of STB with system

Huawei(__ ) ZTE(__ ) SBA(__ ) UT

ZTE(__) !

UT !

Sunnywell(__ ) ! ! ! !

Daxian(__) ! ! !

Changhong(__ ) ! !

Usee !

Hanchen(_ _ ) !

Kanka(_ _ ) !

Hisense(__)(single chip) ! !

Hisense(__)(double chips) !

STB

IPTV System

10/27/07

AVS called by other standard

• ITU-T FG IPTV– One of 4 video codec(MPEG2、AVC/H.264、

VC-1、AVS) in toolbox• HD-DVD (sometime known as CHD-DVD)• BDA (Blu-ray Disc Association)• IGRS (闪联)

10/27/07

AVS Collaboration with MPEG

• Reconfigurable Video Coding– Platform （MPEG-B）– Toolboxes （MPEG-C)

10/27/07

Summary

• AVS reaches the stage for real applicationin China

• Standard is a good engine to drive thedevelopment of both technology andproduction

• Balance between efficiency and cost,always happened in standardization

10/27/07

Thanks