ai- mei huang and truong nguyen
DESCRIPTION
Motion vector processing using bidirectional frame difference in motion compensated frame interpolation . Ai- mei Huang And Truong Nguyen IEEE, world of Wireless, Mobile and Multimedia Networks . ( WoWMoM ) , 2008. Motion compensated frame interpolation(1/3). - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Ai- mei Huang And Truong Nguyen](https://reader033.vdocument.in/reader033/viewer/2022051518/56815eed550346895dcda8c7/html5/thumbnails/1.jpg)
A i - m e i H u a n g A n d Tr u o n g N g u y e n
I E E E , W O R L D O F W I R E L E S S , M O B I L E A N D M U LT I M E D I A N ET W O R K S . (
W O W M O M) , 2 0 0 8
Motion vector processing using bidirectional frame difference in
motioncompensated frame interpolation
![Page 2: Ai- mei Huang And Truong Nguyen](https://reader033.vdocument.in/reader033/viewer/2022051518/56815eed550346895dcda8c7/html5/thumbnails/2.jpg)
Motion compensated frame interpolation(1/3)
![Page 3: Ai- mei Huang And Truong Nguyen](https://reader033.vdocument.in/reader033/viewer/2022051518/56815eed550346895dcda8c7/html5/thumbnails/3.jpg)
Motion compensated frame interpolation(2/3)
• A example
![Page 4: Ai- mei Huang And Truong Nguyen](https://reader033.vdocument.in/reader033/viewer/2022051518/56815eed550346895dcda8c7/html5/thumbnails/4.jpg)
Motion compensated frame interpolation(3/3)
• Although the MV is measured reliably in [4]• Still have some potential issues• In Fig 2 and 3 , the moving object is composed of four
blocks, {B1,B2,B3,B4}• Fig. 3 shows that even MVs are correctly estimated, the
moving object still cannot be reconstructed successfully.• the simplest way to reduce these visual artifacts
is to find the best matches bi-directionally by minimizing the difference between bidirectional predictions.
[4]A.-M. Huang and T. Nguyen. Motion vector processing basedon residual energy information for motion compensated frameinterpolation. in Proc. ICIP’06, pages 2721–2724, 2006.
![Page 5: Ai- mei Huang And Truong Nguyen](https://reader033.vdocument.in/reader033/viewer/2022051518/56815eed550346895dcda8c7/html5/thumbnails/5.jpg)
Bidirectional motion vector processing forMCFI(1/2)
• Use bidirectional MV processing for the received MVF in the current decoder frame ft+1.• we select the best MV from a set of MV candidates
• Vb* , is selected based on the minimum difference between forward and backward predictions.
![Page 6: Ai- mei Huang And Truong Nguyen](https://reader033.vdocument.in/reader033/viewer/2022051518/56815eed550346895dcda8c7/html5/thumbnails/6.jpg)
(2/2)
• Eliminate the ghost artifacts• due to unmatched bidirectional predictions
• Computation is greatly reduced• Use the integer-pixel frame interpolation• affect MV precision .• modify eq. (4) to allow MVs have small deviation from -1 to 1.
![Page 7: Ai- mei Huang And Truong Nguyen](https://reader033.vdocument.in/reader033/viewer/2022051518/56815eed550346895dcda8c7/html5/thumbnails/7.jpg)
SIMULATIONS
• Compare our method with direct MCFI, and vector median filter (VMF).• Test sequence• QVGA size: FORMULA 1, TABLE, and STEFAN• CIF size: FOREMAN, FORMULA 1, FAST FOOD, WALK, and
SILENT• Encode using H.264 , avg. bitrate: 384kbps• even frames are skipped.
![Page 8: Ai- mei Huang And Truong Nguyen](https://reader033.vdocument.in/reader033/viewer/2022051518/56815eed550346895dcda8c7/html5/thumbnails/8.jpg)
• Adopt structure similarity (SSIM)index for qualityassessment.
• luminance• contrast• Structure
![Page 9: Ai- mei Huang And Truong Nguyen](https://reader033.vdocument.in/reader033/viewer/2022051518/56815eed550346895dcda8c7/html5/thumbnails/9.jpg)
![Page 10: Ai- mei Huang And Truong Nguyen](https://reader033.vdocument.in/reader033/viewer/2022051518/56815eed550346895dcda8c7/html5/thumbnails/10.jpg)
Performance
![Page 11: Ai- mei Huang And Truong Nguyen](https://reader033.vdocument.in/reader033/viewer/2022051518/56815eed550346895dcda8c7/html5/thumbnails/11.jpg)
CONCLUSIONS
• The motion vector reliability is analyzed and classified.• we examine how the MV precision affect the
quality of the interpolated frame in the bidirectional MCFI scheme.• we propose a bidirectional MV processing method
by selecting the best MV from neighboring MVs