- by naveen siddaraju [email protected] [email protected] - under the...

44
- By Naveen Siddaraju [email protected] - Under the guidance of Dr K R Rao Study and comparison between H.264 /MPEG4 AVC and AVS China

Upload: ralf-wilson

Post on 04-Jan-2016

221 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

- By Naveen Siddaraju

[email protected]

- Under the guidance of

Dr K R Rao

Study and comparison between H.264 /MPEG4 AVC and AVS China

Page 2: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

Contents Introduction Brief overview of H.264 Brief overview of AVS ChinaComparison Results

Page 3: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

Introduction

Page 4: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

H.264 / MPEG 4 AVCLatest video coding standardBasic design architecture is similar to

previous MPEG standards Better compression efficiency

Page 5: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

Motion compensated coding structure Picture slices MBs subMBs blocks

pixelsI , P and B slices Derived slices SI and SP

Page 6: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

Different YUV systems in H.264 [16]

Page 7: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

Profiles and levels in H.264 Baseline profile Main profile Extended profile High profiles

Page 8: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

H.264 Profiles – Coding parts [1]

Page 9: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

Intra prediction in H.264Uses adaptive spatial prediction to reduce

spatial redundancy. 4 X 4 luma, 8X8 luma( used in high profile)

– 9 modes 16 X 16 luma – 4 modes 4 X 4 chroma - 4 modes

Page 10: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

H.264 intra prediction modes for 4X4 luma

Page 11: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

H.264 inter prediction Uses Motion estimation and Motion compensation (MC). Used to reduce temporal correlation.

0

Sub-macroblock partitions

0

1 0 1

0 1

2 3

0 0

1 0 1

0

2

1

3

1 macroblock partition of 16*16 luma samples and

associated chroma samples

Macroblock partitions

2 macroblock partitions of 16*8 luma samples and

associated chroma samples

4 sub-macroblocks of 8*8 luma samples and

associated chroma samples

2 macroblock partitions of 8*16 luma samples and

associated chroma samples

1 sub-macroblock partition of 8*8 luma samples and

associated chroma samples

2 sub-macroblock partitions of 8*4 luma samples and

associated chroma samples

4 sub-macroblock partitions of 4*4 luma samples and

associated chroma samples

2 sub-macroblock partitions of 4*8 luma samples and

associated chroma samples

Page 12: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

H.264 encoder [1]

Page 13: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

H.264 decoder [1]

Page 14: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

De-blocking filterIs used to reduce the blocking artifacts.Two sources of the blocking arifacts. - 4 X 4 transform - motion compensated prediction since the filter is present in the loop , it

prevents the propagation of the blocking artifacts.

Page 15: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

Entropy codingquantized values and other syntax

elements into actual bits.CAVLC and CABAC for quantized

coefficients.Exp- Golomb codes for syntax elements

which are not coded by CABAC or CAVLC.

Page 16: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

AVS – China Latest audio video coding standard from

China Standardization includes system, audio,

video and digital copyright management. Goal – to achieve coding efficiency with

reduced complexity.

Page 17: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

AVS Parts [3]

Page 18: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

AVS layered data structure [3] for 4:2:0 video sequence

Page 19: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

AVS P2 encoder [5]

Page 20: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

AVS decoder

Page 21: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

AVS motion estimation and intra prediction: AVS uses adaptive modes for motion compensation at the

picture layer and the macroblock layer. The modes in picture layer are :

Forward prediction from the most recent reference frame

Forward prediction from the second most recent prediction frame

Interpolative prediction between the most recent reference frame and a future reference frame.

Intra coding

Page 22: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

AVS motion estimation and intra prediction (cont..)

At the macroblock layer, the modes depend on the picture mode.

In Intra pictures, all macroblocks are intra coded.

In Predicted pictures, macroblocks may be forward predicted or intra coded.

In interpolated pictures, macroblocks may be forward predicted, backward predicted, interpolated or intra coded.

Page 23: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

Predicted pictures (P – pictures):

Page 24: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

Interpolated Pictures (B-Pictures):

Page 25: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

AVS intra prediction [7]

Page 26: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

Comparison H.264 and AVS video

Page 27: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

Rate control Block:A rate control algorithm dynamically

adjusts encoder parameters to achieve a target bitrate.

quantization parameter QP

Page 28: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

Encoder with and without rate control block

Page 29: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

Bitrate Vs QP

Page 30: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

results: H.264 – JM 16.1 used [9]AVS – RM09.01[10]Input sequence – QCIF foreman 90 frames

[20]

Page 31: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

JM 16.1 output

Page 32: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

JM 16.1 output

Page 33: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

JM 16.1 output

Page 34: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

AVS ref software output

Page 35: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

AVS ref software output

Page 36: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

Bitrates Vs psnr

Page 37: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

Plot: PSNR vs. bit rate

Page 38: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

Conclusion AVS – P2 jizhun profile is comparable with

the main profile of H.264 . Reduced complexity , reduced costs. Performance difference is mainly due to

absence of tools such as CABAC.

Page 39: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

List of acronyms used

Page 40: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

Thank you

Page 41: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

References [1] Soon-kak Kwon et al. “Overview of H.264 / MPEG-4 Part 10 (pp.186-216)”, Special

issue on “ Emerging H.264/AVC video coding standard”, J. Visual Communication and Image Representation, vol. 17, pp.183-552, April 2006.

[2] A. Puri et al. “Video coding using the H.264/MPEG-4 AVC compression standard”, Signal Processing: Image Communication, vol.19, pp 793-849, Oct 2004.

[3] W. GAO et al. “AVS - The Chinese next-generation video coding standard” NAB, Las Vegas, 2004.

[4] X. Wang et.al “Performance comparison of AVS and H.264/AVC video coding standards” J. Comput. Sci. & Technol., Vol.21, No.3, pp.310-314 J, May 2006.

[5] L. Yu et al. “An Overview of AVS-Video: tools, performance and complexity”, Visual Communications and Image Processing 2005, Proc. of SPIE, vol. 5960, pp.596021, July 31, 2006.

[6] D Chang “MPEG 4, H.264 compression standards” ppt, http://mmlab.snu.ac.kr/

[7] L. Yu et al. “An area-efficient VLSI architecture for AVS intra frame encoder” Visual Communications and Image Processing 2007, Proc. of SPIE-IS & T Electronic Imaging, SPIE vol. 6508, pp. 650822, Jan. 29, 2007.

Page 42: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

[8]Introduction to codecs: http://gizmodo.com/5093670/giz-explains-every-video-format-you-need-to-know

[9] H.264/AVC JM Software http://bs.hhi.de/~ suehring/tml/download new version of the H.264/AVCreference software http://iphome.hhi.de/suehring/tml/download/.

[10] AVS reference software, ftp://159.226.42.57/public/avs_docs/avs_software. 

[11] MPEG website: http://www.mpeg.org. 

[12]MPEG-1: ISO/IEC JTC1/SC29, Coding of moving pictures and associated audio for digital storage media up to about ARTICLE IN PRESS A. Puri et al. / Signal Processing: Image Communication 19 (2004) 793–849 847 1.5 Mbit/s, ISO/IEC 11172-2, International Standard, November 1992.

[13] MPEG-2: ISO/IEC JTC1/SC29/WG11 and ITU-T, ISO/IEC 13818-2: Information Technology-

Generic Coding of Moving Pictures and Associated Audio Information: Video, ISO/IEC and ITU-T,1994.

[14] MPEG-4: ISO/IEC JTCI/SC29/WG11, ISO/IEC 14 496:2000-2: Information on Technology-Coding

of Audio-Visual Objects-Part 2: Visual, ISO/IEC, 2000.

 

Page 43: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

[15] H.264 Standard 2007.pdf, http://ee.uta.edu/Dip/Courses/EE5359/H.264%20Standard2007.pdf 

[17] JVT ”Draft ITU-T recommendation and final draft international standard of joint video specification (ITU-T rec. H.264– ISO/IEC 14496-10 AVC),” March 2003,JVT-G050 available on http://ip.hhi.de/imagecom_G1/assets/pdfs/JVT-G050.pdf. 

[18] R. Schäfer, et al, “The emerging H.264/AVC standard”, EBU Technical Review, Jan. 2003. 

[19] Rate Control and H.264, link: http://www.pixeltools.com/rate_control_paper.html 

[20] UTA digital image processing course website, link: http://www-ee.uta.edu/dip/Courses/EE5356/ee_5356.htm

[21] H.264/14496-10 AVC Reference Software Manual link: http://iphome.hhi.de/suehring/tml/JM%20Reference%20Software%20Manual%20%28JVT-AE010%29.pdf

[22] T. Wiegand, et al, “Overview of the H.264/AVC Video Coding Standard” IEEE Trans.Circuits and Systems for Video Technology, vol. 13, pp. 560-576, June 2003.

 

 

Page 44: - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison between H.264

[23] AVS Video Expert Group, “Information Technology – Advanced coding of audio and video – Part 2: Video (AVS1-P2 JQP FCD 1.0),” Audio Video Coding Standard Group of China (AVS), Doc. AVS-N1538, Sep. 2008.