study and performance comparison of h.264/avc, dirac and avs china part 7 ee5359 project fall 2010...
Post on 19-Jan-2016
226 Views
Preview:
TRANSCRIPT
Study and Performance Study and Performance Comparison of H.264/AVC, Comparison of H.264/AVC, Dirac and AVS China Part 7Dirac and AVS China Part 7
EE5359 Project
Fall 2010
Touseef Khan
1000676051
General Video Coding and General Video Coding and Decoding Process [1]Decoding Process [1]
An optional preprocessing step, the sender might choose to preprocess the video using format conversion or enhancement techniques.
The encoder encodes the video and represents the video as a bit stream.
The decoder decodes the video which gets displayed after an optional post-processing step which might include format conversion, filtering to suppress coding artifacts, error concealment, or video enhancement
H.264/AVC [1]H.264/AVC [1] H.264/MPEG-4 AVC is a block-oriented motion-compensation-
based codec standard developed by the ITU-T Video Coding
Experts Group (VCEG) together with the ISO/IEC Moving
Picture Experts Group (MPEG). It was the product of a
partnership effort known as the Joint Video Team (JVT).
H.264/AVC provides gains in compression efficiency of up to
50% over a wide range of bit rates and video resolutions
compared to previous standards.
Supports various applications such as video broadcasting,
video streaming, and video conferencing over fixed and
wireless networks and over different transport protocols and
results better than MPEG-2.
Dirac[24]Dirac[24]Hybrid motion-compensated video codec
developed by BBC Research, BBC. Uses modern techniques – discrete
wavelet transforms, arithmetic coding. Dirac is a general-purpose video
compression family suitable for everything from internet streaming to HDTV and electronic cinema.
It offers good quality at low bit rates, leading to lower costs. It offers good quality with low delay - ideal for live broadcast applications in studios and outside broadcasts.
AVS China Part 7 (AVS AVS China Part 7 (AVS Mobile)[13]Mobile)[13] Audio-video coding standard (AVS) is a working group of
audio and video coding standard in China, which was established in 2002.
AVS is a set of integrity standard system – system, video, audio and media copyright management.
AVS China has a coding efficiency similar to that of H.264 except that it has a lower computational complexity.
AVS M is the 7th part of the video coding standard developed by the AVS Workgroup of China which aims for mobile systems and devices.
In AVS M, a Jiben Profile out of the 10 different profiles of AVS.
AVS follows a layered structure for the data and this representation is seen in the coded bit stream.
H.264 Layers[1]H.264 Layers[1] The video coding layer (VCL) defines the efficient
representation of the video. The network adaptation layer (NAL) converts the VCL
representation into a format suitable for specific transport layers or storage media.
H.264 Encoder[3]H.264 Encoder[3]
H.264 Decoder[3]H.264 Decoder[3]
Dirac Encoder and Dirac Encoder and Decoder[13]Decoder[13]
AVS-M Encoder[18]AVS-M Encoder[18]
AVS-M Decoder[18]AVS-M Decoder[18]
H.264/AVC introduces the following changes:[1]In order to reduce the block-artifacts an adaptive deblocking filter is used in the prediction loop. The deblocked macroblock is stored in the memory and can be used to predict future macroblocks.The memory contains one video frame in previous standards, H.264/AVC allows storing multiple video frames in the memory.In H.264/AVC a prediction scheme is used also in Intra mode that uses the image signal of already transmitted macroblocks of the same image in order to predict the block to code.The discrete cosine transform (DCT) used in former standards is replaced by an integer transform.
H.264 Profiles[1]H.264 Profiles[1] A profile is defined as a subset of the entire bit stream syntax or in
other terms as a subset of the coding tools.
There are three profiles in the first version: Baseline, Main and Extended. There are four High profiles defined in the fidelity range extensions .
AVS China Profiles[13]AVS China Profiles[13]
Dirac – Wavelet Dirac – Wavelet Transforms[8]Transforms[8] More efficient than block transforms with still images. Operates on entire picture. Logarithmic frequency decomposition into sub-bands
at each stage, the filter produces for sub-bands called Low-Low (LL), Low-High (LH), High-Low (HL) and High-High (HH). The LL band is iteratively encoded to gain the required data.
Wavelet transforms have been proven to provide a more efficient technique than block transforms with still images and is currently used in JPEG2000.
Horizontal and vertical filtering for 2D signals.
Parametric ComparisonParametric Comparison Algorithmic Element
H.264/AVC [1]
Dirac[9]
AVS China Part 7[14]
Intra Prediction
4x4spatial,16x16 spatial, I-PCM
4x4 spatial
9 modes, simple 4x4 intra prediction and direct intra prediction
Transform
4×4 integer DCT, 8×8 integer DCT
4×4 wavelet transform
4x4 ICT without scaling in decoder
In-Loop Filters
Deblocking
None
Deblocking
Entropy Coding
CAVLC(Context Adaptive Variable Length)CABAC(Context Adaptive Binary Arithmetic)VLC
VLC
2D-VLC .E.g.:-Golomb code
P-Frame Type
Single referenceMultiple references
Single referenceMultiple references
Single referenceMultiple references(maximum of 2 reference frames)
Motion compensation block size
16×16, 16×8, 8×16, 8×8, 8×4, 4×8, 4×4
4×4
16×16, 16×8, 8×16, 8×8
CIF and QCIF formats [3]CIF and QCIF formats [3]
Fig(a) : Common Intermediate Format(CIF) 4:2:0 chroma sampling
Fig (b): Quadrature Common Intermediate Format (QCIF) 4:2:0 chroma sampling
Performance Analysis of Performance Analysis of Dirac Video CodecDirac Video Codec
Original File: News.yuvFormat : 4:2:0
Quality Factor (QF)
Compressed File Size (KB)
Bit rate(KBps)
Y-PSNR(dB)
Y-MSE Y-SSIM Compression Ratio
0 18 4.58 23.0236 326.68 0.6933
206:1
3 32 8.152 27.965 104.713
0.8544
116:1
5 59 14.989 32.364 38.027 0.925 63:1
8 166 42.426 41.949 4.184 0.9849
22:1
10 373 95.388 46.699 1.401 0.993 10:1
DIRAC Codec QCIF sequence : news_qcif.yuvHeight:176 , Width: 144Total no. of frames : 300Frames used : 100Original File size : 3713KBFrame Rate = 25 fps
Video Quality at different values of Quality Factor (QF)
QF = 0 QF = 5
QF = 10
DIRAC codecFile: news.yuvFormat: QCIF
Quality Factor (QF)
Compressed File Size (KB)
Bit rate(KBps)
Y-PSNR(dB)
Y-MSE Y-SSIM Compression Ratio
0 38 9.473 25.383 189.73 0.78 390:1
3 81 20.66 30.675 56.104 0.8973 183:1
5 159 40.567 35.248 19.573 0.946 93:1
8 524 134.44 42.611 3.592 0.9802 28:1
10 1379 352.95 46.67 1.41 0.99 10:1
DIRAC CodecCIF sequence : news_cif.yuvHeight:352, Width: 288Total no. of frames : 300Frames used : 100Original File size : 14,850KBFrame Rate : 25 fps
Video Quality at different values of Quality Factor (QF)
QF = 0 QF = 5
QF = 10
DIRAC codecFile: news.yuvFormat: CIF
DIRAC Codec - File : News.yuv ; Format : 4:2:0
DIRAC Codec - File : News.yuv ; Format : 4:2:0
Original File: Foreman.yuvFormat : 4:2:0
Quality Factor (QF)
Compressed File Size (KB)
Bit rate(KBps)
Y-PSNR(dB)
Y-MSE Y-SSIM Compression Ratio
0 24 6.1125 23.4 299.55 0.6837
155:1
3 43 10.984 27.73 110.48 0.8316
86:1
5 81 20.673 32.458 37.207 0.9179
46:1
8 256 65.418 41.019 5.183 0.9795
14.5:1
10 570 145.766 46.259 1.5507 0.993 6.5:1
DIRAC Codec QCIF sequence : foreman_qcif.yuvHeight:176 , Width: 144Total no. of frames : 300Frames used : 100Original File size : 3713KBFrame Rate = 25 fps
Video Quality at different values of Quality Factor (QF)
QF = 0 QF = 5
QF = 10
DIRAC codecFile: foreman.yuvFormat: QCIF
Quality Factor (QF)
Compressed File Size (KB)
Bit rate(KBps)
Y-PSNR(dB)
Y-MSE Y-SSIM Compression Ratio
0 62 15.669 24.891 212.515
0.7253 239.5:1
3 116 29.639 30.154 63.252 0.8486 128:1
5 241 61.679 34.584 22.81 0.9146 62:1
8 918 234.86 41.392 4.756 0.972 16:1
10 2343 599.63 46.189 1.576 0.9899 6:1
DIRAC CodecCIF sequence : foreman_cif.yuvHeight:352, Width: 288Total no. of frames : 300Frames used : 100Original File size : 14,850KBFrame Rate : 25 fps
Video Quality at different values of Quality Factor (QF)
QF = 0 QF = 5
QF = 10
DIRAC codecFile: foreman.yuvFormat: CIF
DIRAC codec - File : Foreman.yuv ; Format : 4:2:0
DIRAC codec - File : Foreman.yuv ; Format : 4:2:0
Performance Analysis of Performance Analysis of H.264 Video CodecH.264 Video Codec
Original File: News.yuvFormat : 4:2:0
QP Compressed File Size (KB)
Bit rate(KBps)
Y-PSNR(dB)
Y-MSE Y-SSIM Compression Ratio
0 887 226.92 66.767 0.0138 0.999 4:1
10 358 91.395 51.357 0.4794 0.997 10:1
25 52 13.176 39.473 7.399 0.978 71:1
40 8 1.972 28.089 101.74 0.8534
464:1
50 3 0.6812 21.78 434.99 0.6204
1237:1
H.264 CodecQCIF sequence : news_qcif.yuvHeight:176, Width: 144Total no. of frames : 300Frames used : 100Original File size : 3713KBFrame Rate = 25 fps
Video Quality at different values of Quantization Parameter (QP)
QP = 0 QP = 25
QP = 50
H.264 codecFile: news.yuvFormat: QCIF
QP Compressed File Size (KB)
Bit rate(KBps)
Y-PSNR(dB)
Y-MSE Y-SSIM Compression Ratio
0 3763 963.13 67.63 0.0113 0.999 4:1
10 1569 401.65 51.455 0.4688 0.996 9:1
25 151 38.624 40.648 5.644 0.976 98:1
40 23 5.826 30.079 64.348 0.8847 645:1
50 9 2.06 23.978 262.193
0.7379 1650:1
H.264 CodecCIF sequence : news_cif.yuvHeight:352, Width: 288Total no. of frames : 300Frames used : 100Original File size : 14,850KBFrame Rate : 25 fps
Video Quality at different values of Quantization Parameter (QP)
QP = 0 QP = 25
QP = 50
H.264 codecFile: news.yuvFormat: CIF
H.264 codec - File :News.yuv ; Format : 4:2:0
H.264 codec - File :News.yuv ; Format : 4:2:0
Original File: Foreman.yuvFormat : 4:2:0
QP Compressed File Size (KB)
Bit rate(KBps)
Y-PSNR(dB)
Y-MSE Y-SSIM Compression Ratio
0 1518 388.48 69.182 0.0079 0.999 2.4:1
10 673 172.25 51.563 0.4573 0.9975
5.5:1
25 93 23.794 39.134 7.999 0.9708
40:1
40 16 3.896 28.609 90.264 0.8457
232:1
50 5 1.1475 21.821 430.874
0.6 743:1
H.264 CodecQCIF sequence : foreman_qcif.yuvHeight:176, Width: 144Total no. of frames : 300Frames used : 100Original File size : 3713KBFrame Rate = 25 fps
Video Quality at different values of Quantization Parameter (QP)
QP = 0 QP = 25
QP = 50
H.264 codecFile: foreman.yuvFormat: QCIF
QP Compressed File Size (KB)
Bit rate(KBps)
Y-PSNR(dB)
Y-MSE Y-SSIM Compression Ratio
0 6818 1745.19 69.804 0.00686
0.999 2:1
10 3274 838 51.614 0.4519 0.9965
4.5:1
25 296 75.654 39.206 7.868 0.9566
50:1
40 47 11.821 30.1608 63.153 0.8412
316:1
50 18 4.584 23.953 263.737
0.6963
825:1
H.264 CodecQCIF sequence : foreman_cif.yuvHeight:352, Width: 288Total no. of frames : 300Frames used : 100Original File size : 14,850KBFrame Rate = 25 fps
Video Quality at different values of Quantization Parameter (QP)
QP = 0 QP = 25
QP = 50
H.264 codecFile: foreman.yuvFormat: CIF
H.264 codec - File : Foreman.yuv ; Format : 4:2:0
H.264 codec - File : Foreman.yuv ; Format : 4:2:0
Performance Analysis of AVS Performance Analysis of AVS China-M Video CodecChina-M Video Codec
Original File: News.yuvFormat : 4:2:0
QP Compressed File Size (KB)
Bit rate(KBps)
Y-PSNR(dB)
Y-MSE Y-SSIM Compression Ratio
0 564 173.02 53.918 0.2659 0.9984
6.5:1
15 145 44.216 45.588 1.8099 0.9923
25.5:1
31 40 12.216 36.636 14.219 0.965 93:1
45 15 4.493 28.924 83.954 0.8706
247.5:1
63 8 2.294 19.431 747.14 0.5363
464:1
AVS China-M CodecQCIF sequence : news_qcif.yuvHeight:176, Width: 144Total no. of frames : 300Frames used : 100Original File size : 3713KBFrame Rate = 25 fps
Video Quality at different values of Quantization Parameter (QP)
QP = 0 QP = 31
QP = 63
AVS China-M codecFile: news.yuvFormat: QCIF
Quality Factor (QF)
Compressed File Size (KB)
Bit rate(KBps)
Y-PSNR(dB)
Y-MSE Y-SSIM Compression Ratio
0 2581 792.64 54.17 0.2509 0.9979 5.75:1
15 499 153.135
45.585 1.811 0.987 29.75:1
31 124 37.914 38.047 10.276 0.9635 120:1
45 52 15.9 30.706 55.704 0.8919 285.5:1
63 30 9.156 20.188 627.54 0.6015 495:1
AVS China-M CodecCIF sequence : news_cif.yuvHeight:352, Width: 288Total no. of frames : 300Frames used : 100Original File size : 14,850KBFrame Rate : 25 fps
Video Quality at different values of Quantization Parameter (QP)
QP = 0 QP = 31
QP = 63
AVS China-M codecFile: news.yuvFormat: CIF
AVS China-M codec - File : News.yuv ; Format : 4:2:0
AVS China-M codec - File : News.yuv ; Format : 4:2:0
Original File: Foreman.yuvFormat : 4:2:0
QP Compressed File Size (KB)
Bit rate(KBps)
Y-PSNR(dB)
Y-MSE Y-SSIM Compression Ratio
0 1133 347.88 53.658 0.2823 0.9985
3:1
15 312 95.623 44.894 2.124 0.9905
12:1
31 71 21.73 36.038 16.319 0.9493
52:1
45 25 7.464 29.161 79.499 0.855 148.5:1
63 9 2.605 20.357 603.59 0.5187
412.5:1
AVS China-M CodecQCIF sequence : foreman_qcif.yuvHeight:176, Width: 144Total no. of frames : 300Frames used : 100Original File size : 3713KBFrame Rate = 25 fps
Video Quality at different values of Quantization Parameter (QP)
QP = 0 QP = 31
QP = 63
AVS China-M codecFile: foreman.yuvFormat: QCIF
QP Compressed File Size (KB)
Bit rate(KBps)
Y-PSNR(dB)
Y-MSE Y-SSIM Compression Ratio
0 5286 1623.52 53.724 0.278 0.9979
2.8:1
15 1240 380.813 44.642 2.25 0.9846
12:1
31 223 68.267 36.538 14.544 0.9309
66.5:1
45 83 25.368 30.824 54.215 0.8456
179:1
63 35 10.643 21.1 508.71 0.5667
424:1
AVS China-M CodecQCIF sequence : foreman_cif.yuvHeight:352, Width: 288Total no. of frames : 300Frames used : 100Original File size : 14,850KBFrame Rate = 25 fps
Video Quality at different values of Quantization Parameter (QP)
QP = 0 QP = 31
QP = 63
AVS China-M codecFile: foreman.yuvFormat: CIF
AVS China-M codec - File : Foreman.yuv ; Format : 4:2:0
AVS China-M codec - File : Foreman.yuv ; Format : 4:2:0
PSNR(dB) vs. Bitrate(KBps)
File : News.yuv ; Format: QCIF 4:2:0
PSNR(dB) vs. Bitrate(KBps)
File : Foreman.yuv ; Format: QCIF 4:2:0
PSNR(dB) vs. Bitrate(KBps)
File : News.yuv ; Format: CIF 4:2:0
PSNR(dB) vs. Bitrate(KBps)
File : Foreman.yuv ; Format: CIF 4:2:0
MSE vs. Bitrate (KBps)
File : News.yuv ; Format: QCIF 4:2:0
MSE vs. Bitrate(KBps)
File : Foreman.yuv ; Format: QCIF 4:2:0
File : News.yuv ; Format: CIF 4:2:0
MSE vs. Bitrate(KBps)
MSE vs. Bitrate(KBps)
File : Foreman.yuv ; Format: CIF 4:2:0
MSU Video Quality Measurement MSU Video Quality Measurement Tool[20]Tool[20]
ConclusionsConclusions It can be concluded from the results
that H.264 stands out in terms of performance with respect to compression ratio, quality and applications over AVS China part 7 and Dirac. The graphs and tabulations clearly show that the PSNR, MSE and SSIM[21] of the video sequences improve as the bit rate increases, while the bit rate is varied using the quantization parameter.
Future WorkFuture Work
Further work can be carried out in studying and comparing video coding standards: H.264/AVC, Dirac and AVS China Part 7(AVS Mobile) for all profiles i.e. main, baseline and high profiles. Test video sequences of SD and HD formats can also be used at various bit rates for better analysis of performance of the video coding standards.
References:1. J.Ostermann et al, “Video coding with H.264/AVC: Tools, Performance, and
Complexity”, IEEE Circuits and Systems Magazine, vol. 4, Issue:1, pp. 7 – 28, Aug. 2004.
2. D. Marpe, T. Wiegand and G.J. Sullivan, “The H.264/MPEG4 Advanced Video Coding Standard and its Applications” , IEEE Communications magazine, vol. 44, Issue: 8,pp: 134 –143, Aug. 2006.
3. S.Kwon, A. Tamhankar and K.R. Rao, “Overview of H.264 / MPEG-4 Part 10”, J. Visual Communication and Image Representation, vol. 17, pp.186-216, April 2006.
4. I. Richardson, “Vcodex White Paper: An overview of H.264”, www.vcodex.com.
5. I. Richardson, “The H.264 advanced video compression standard ”, Wiley, 2nd edition,2010.
6. T. Wiegand and G.J. Sullivan, “The H.264/AVC Video Coding Standard [Standards in a Nutshell]”, IEEE Signal processing magazine, vol. 24, Issue: 2, pp. 148 – 153,March 2007.
7. H.264/AVC reference software: http://iphome.hhi.de/suehring/tml/download/
8. The Dirac web page: http://www.bbc.co.uk/rd/projects/dirac/technology.shtml
9. S.Issa and O.O.Khalifa, “Performance analysis of Dirac video codec with H.264/AVC”, International conference on computer and communication engineering, pp:1-6,Aug. 2010
10. K. Onthriar, K.K. Loo and Z.Xue, “Performance Comparison of Emerging Dirac Video Codec with H.264/AVC”, International Conference on Digital Telecommunications, pp. 22 – 22, Aug. 2006.
11. Dirac Specifications: http://diracvideo.org/download/specification/dirac-spec-latest.pdf
12. Dirac video download: http://diracvideo.org/download/
13. K. R. Rao and D.N. Kim, “Current Video Coding Standards: H.264/AVC, Dirac, AVS China and VC-1”, IEEE 42nd Southeastern symposium on system theory (SSST), pp. 1-8,March 2010.
14. L.Fan et al,“Overview of AVS Video Standard”, IEEE International conference on multimedia and expo, pp. 423 - 426 ,vol. 1, June 2004.
15. S. Pasqualini et al, “Comparison of H.264/AVC, H.264 with AIF, and AVS based on different video quality metrics”, International conference on telecommunications, pp.190 – 195, May 2009.
16. AVS China software : ftp://159.226.42.57/public/avsdoc/avs_software
17. L.Yu, S.Chen and J.Wang, “Overview of AVS-video coding standards”, Signal processing : Image communication, pp. 247-262,vol. 24, Issue: 4, Apr. 2009.
18. L.Fan, “Mobile Multimedia Broadcasting Standards”, ISBN: 978-0-387-78263-8, Springer US, 2009.
19. YUV Video Sequences: http://trace.eas.asu.edu/yuv
20. MSU video quality measurement tool : http://compression.ru/video/quality_measure/video_measurement_tool_en.html
21. Z. Wang , E.P. Simoncelli and A.C. Bovik, “Multi-scale structural similarity for image quality assessment” , Proceedings of IEEE Asilomar Conference on Signals, Systems and Computers, (Asimolar), vol. 2, pp. 1398 -1402, Nov. 2003.
22. S Srinivasan, et al, “Windows media video 9: overview and applications”, Signal Processing: Image Communication, Vol. 19, Issue 9, pp. 851-875, Oct. 2004.
23. W.Gao and T.Huang, “AVS Standard -Status and Future Plan”, Workshop on Multimedia New Technologies and Application, Shenzhen, China, Oct. 2007.
24. A.Ravi ‘Performance analysis and comparison of the Dirac video codec with H.264 / MPEG-4 Part 10 AVC”.
25. Ravi and K.R. Rao, “Performance analysis and comparison of the Dirac video codec with H.264/ MPEG- 4, Part 10”, for the book "Advances in reasoning-based image processing, analysis and intelligent systems: Conventional and intelligent paradigms", 2011.
THANK YOU
top related