the mpeg-4 fine-grained scalable video coding method for multimedia streaming over ip
DESCRIPTION
The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP. Hayder Radha ,Mihaela van der Schaar and Yingwei Chen. IEEE TRANSACTIONS ON MULTIMEDIA, VOL.3, NO.1,MARCH 2001. Outline. Introduction SNR FGS Video Coding Method FGS Coding with Adaptive Quantization - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/1.jpg)
The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP
Hayder Radha ,Mihaela van der Schaar
and Yingwei Chen
IEEE TRANSACTIONS ON MULTIMEDIA, VOL.3, NO.1,MARCH 2001
![Page 2: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/2.jpg)
Outline
Introduction SNR FGS Video Coding Method FGS Coding with Adaptive
Quantization Hybrid Temporal-SNR Scalability with
an All FGS Structure Conclusions
![Page 3: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/3.jpg)
Introduction
Video-Coding and Networking Minimal real-time processing and rate
control when large number of unicast Highly adaptable to unpredictable
bandwidth Low-complexity decoding and low-
memory requirements
![Page 4: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/4.jpg)
Introduction(2)
Able to support both multicast and unicast applications
Scalable bitstream must be resilient to packet loss events
![Page 5: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/5.jpg)
SNR FGS Video Coding
[ Rmin = Rb , Rmax = Rb + Re ]
![Page 6: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/6.jpg)
SNR FGS Video Coding(2)
![Page 7: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/7.jpg)
SNR FGS Video Coding -encoder
Two encoders
base layer->motion compensation
enhancement layer->fine-granular Each DCT FGS-residual frame
consists of NBP bitplanes
![Page 8: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/8.jpg)
SNR FGS Video Coding -scanning order
![Page 9: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/9.jpg)
![Page 10: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/10.jpg)
Architecture for the SNR FGS Video Coding -decoder
![Page 11: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/11.jpg)
SNR FGS Video Coding -performance
Compared with traditional SNR scalability video coding
![Page 12: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/12.jpg)
SNR FGS Video Coding -performance(2)
![Page 13: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/13.jpg)
SNR FGS Video Coding -performance(3)
![Page 14: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/14.jpg)
SNR FGS Video Coding -conclusions
FGS exploits temporal redundancy only at the base layer
FGS is good for high motion sequences such as “movie trailers”,certain commercials and news clips with high-action content
![Page 15: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/15.jpg)
SNR FGS Video Coding -conclusions
Base-layer could have a major impact on the overall performance of FGS
[R2,Rmax] could be significantly better than the average performance over the wider range[R1,Rmax]
![Page 16: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/16.jpg)
FGS Coding with Adaptive Quantization
FGS-based AQ is achieved through bitplane shifting
Selected macroblocks within an FGS enhancement layer frame
Selected coefficients within the 8 * 8 blocks
![Page 17: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/17.jpg)
Adaptive Quantization-Selective Enhancement
![Page 18: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/18.jpg)
Adaptive Quantization-frequency weighting
![Page 19: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/19.jpg)
Adaptive Quantization-combine SE with FW
![Page 20: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/20.jpg)
Adaptive Quantization-notice
SE : macroblock-by-macroblock basis FW : use the same FW matrix Selective enhancement is a relative
operation Up-shifting operation does not
guarantee that a particular SE macroblock gets scanned earlier(MSB)
![Page 21: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/21.jpg)
Adaptive Quantization-evaluation
Not improve the rate-distortion performance ,but rather to improve the visual quality
SE can be used to enhance a particular region
FW can reduce some of blockiness, but may softening some of the sharp edges and other finedetails
![Page 22: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/22.jpg)
Adaptive Quantization-evaluation(2)
![Page 23: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/23.jpg)
Hybrid Temporal-SNR Scalability
Temporal scalability : Enhance the motion smoothness of compressed video
F = FBL + FEL
Provide the flexibility of choosing between temporal scalability and SNR scalability (Users’ performance and real-time bandwidth)
![Page 24: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/24.jpg)
all-FGS hybrid temporal-SNR scalability structure
![Page 25: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/25.jpg)
Architecture for the all-FGS hybrid temporal-SNR scalability encoder
![Page 26: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/26.jpg)
Architecture for the all-FGS hybrid temporal-SNR scalability decoder
![Page 27: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/27.jpg)
Performance Evaluation of the Hybrid FGS Scalability Method
![Page 28: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/28.jpg)
Performance Evaluation of the Hybrid FGS Scalability Method
![Page 29: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.vdocument.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/29.jpg)
Conclusions
MPEG-4 FGS framework Supporting unicast and multicast
Internet video application Adaptive quantization Hybrid temporal-SNR scalability
method