[ieee 2010 data compression conference - snowbird, ut, usa (2010.03.24-2010.03.26)] 2010 data...

1
Two-Step Coding For High Definition Video Compression Wenfei Jiang 1 , Wenyu Liu 1 , Longin Jan Latecki 2 , Hui Liang 1 , Changqing Wang 1 , Bing Feng 1 1 Huazhong University of Science and Technology 2 Temple University 1 High definition (HD) video has come into people’s life from movie theaters to HDTV. However, the compression of HD videos is a challenging problem due to flicker noise, caused by film grain. The flicker noise significantly limits the applicability of motion estimation (ME), which is a key factor of the efficient video compression in block-based coding standards. Due to the flicker noise, it is difficult to obtain a perfect match between a current block and a reference block. Consequently, we suggest to first denoise the HD pictures by averaging, generating downsampled pictures called DC frames, on which ME becomes very efficient. The proposed Two-Step Coding (TSC) encodes the HD frames in intra mode; then generates the DC frames with the DC coefficients of DCT and compresses them with inter-frame techniques. Suppose we DCT encode a 4×4 block {x ij (i, j=0~3)} in intra mode, DCT({x ij }) = {X mn | m, n=0~3}, where X 0,0 is the DC coefficient. Unlike ordinary codecs simply coding all the 16 coefficients, TSC only codes the 15 AC coefficients in the first step, since we set X 0,0 =0. The AC coefficients can be decoded into {x’ ij }, IDCT({X mn }) = {x’ ij }, where (X 0,0 =0) and IDCT is the inverse DCT. The original X 0,0 is regarded as color values forming a DC frame, which is inter-frame coded in the second step. The decoder gets X 0,0 and x’ ij computed by the two steps and recovers the original picture as x ij = x’ ij +X 0,0 . In essence, all TSC does is to re-encode the DC coefficients of the intra-frame coded HD frames with inter-frame techniques. Intra prediction is made available to improve the compression of intra-frame coding. The key benefit of TSC in comparison to the most popular standards, in particular, in comparison to H.264 lies in better utilization of inter-frame coding. Due to flicker noise, H.264 mostly employs intra block coding on HD videos. However, it is well-known that inter-frame coding significantly outperforms intra coding in video compression rate if the temporal correlation is correctly utilized. By downsampling each frame to DC frame, TSC makes it possible to apply inter-frame coding. We provide experimental data and analysis to illustrate this fact. Index Terms—High Definition Video, H.264, Film grain, flicker noise, SVC Email: [email protected], [email protected] This work received supports from National 863 project of China (grant No. 2007AA01Z223), National Natural Science Foundation of China (grant No. 60873127, 60903096, 60903172) and The National Science & Technology Pillar Program of China (grant No. 2006BAH02A24). 2010 Data Compression Conference 1068-0314/10 $26.00 © 2010 IEEE DOI 10.1109/DCC.2010.54 535

Upload: bing

Post on 24-Mar-2017

218 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: [IEEE 2010 Data Compression Conference - Snowbird, UT, USA (2010.03.24-2010.03.26)] 2010 Data Compression Conference - Two-Step Coding for High Definition Video Compression

Two-Step Coding For High Definition Video Compression

Wenfei Jiang1, Wenyu Liu1, Longin Jan Latecki2, Hui Liang1,

Changqing Wang1, Bing Feng1

1 Huazhong University of Science and Technology

2 Temple University1

High definition (HD) video has come into people’s life from movie theaters to HDTV. However, the compression of HD videos is a challenging problem due to flicker noise, caused by film grain. The flicker noise significantly limits the applicability of motion estimation (ME), which is a key factor of the efficient video compression in block-based coding standards. Due to the flicker noise, it is difficult to obtain a perfect match between a current block and a reference block. Consequently, we suggest to first denoise the HD pictures by averaging, generating downsampled pictures called DC frames, on which ME becomes very efficient. The proposed Two-Step Coding (TSC) encodes the HD frames in intra mode; then generates the DC frames with the DC coefficients of DCT and compresses them with inter-frame techniques.

Suppose we DCT encode a 4×4 block {xij (i, j=0~3)} in intra mode, DCT({xij}) = {Xmn |m, n=0~3}, where X0,0 is the DC coefficient. Unlike ordinary codecs simply coding all the 16 coefficients, TSC only codes the 15 AC coefficients in the first step, since we set X0,0=0. The AC coefficients can be decoded into {x’ij}, IDCT({Xmn}) = {x’ij}, where (X0,0=0) and IDCT is the inverse DCT. The original X0,0 is regarded as color values forming a DC frame, which is inter-frame coded in the second step. The decoder gets X0,0

and x’ij computed by the two steps and recovers the original picture as xij = x’ij +X0,0. In essence, all TSC does is to re-encode the DC coefficients of the intra-frame coded

HD frames with inter-frame techniques. Intra prediction is made available to improve the compression of intra-frame coding. The key benefit of TSC in comparison to the most popular standards, in particular, in comparison to H.264 lies in better utilization of inter-frame coding. Due to flicker noise, H.264 mostly employs intra block coding on HD videos. However, it is well-known that inter-frame coding significantly outperforms intra coding in video compression rate if the temporal correlation is correctly utilized. By downsampling each frame to DC frame, TSC makes it possible to apply inter-frame coding. We provide experimental data and analysis to illustrate this fact.

Index Terms—High Definition Video, H.264, Film grain, flicker noise, SVC Email: [email protected], [email protected]

This work received supports from National 863 project of China (grant No. 2007AA01Z223), National Natural Science Foundation of China (grant No. 60873127, 60903096, 60903172) and The National Science & Technology Pillar Program of China (grant No. 2006BAH02A24).

2010 Data Compression Conference

1068-0314/10 $26.00 © 2010 IEEE

DOI 10.1109/DCC.2010.54

535