rate-distortion analysis and streaming of sp and si frames eric setton and bernd girod csvt, 2006
Post on 19-Dec-2015
222 views
TRANSCRIPT
Rate-Distortion Analysis and Streaming of SP and SI Frames
Eric Setton and Bernd Girod
CSVT, 2006
Outline
• Introduction• RD Analysis of SP and SI Frames• Rate-Distortion Performance• Optimal Setting for Streaming• Performance Analysis
Introduction
• SP/SI frame– Part of H.264 Ext Profile.– Reconstructed without drift by using different pr
edictors.• Drift-free bitstream switching.
P P SP P P SP 1 P
SI
P SP 2 P
SP 12
Bitstream 1
Bitstream 2
P
Primary SP Secondary SP
1 2
3
MV12
Referenceframe
Currentframe
http://vc.cs.nthu.edu.tw/home/paper/codfiles/cycho/200402181718/The_SP-_and_SI-Frames_Design_for_H.264_AVC.ppt by CYCho
RD Analysis of SP and SI Frames (1)
• RD function of an ideal video encoder–
– Y. Wang, J. Ostermann, and Y.-Q. Zhang, Video Processing And Communications. Prentice Hall, 2002, pp.233-234.
Power spectral density (PSD) of zero-mean Gaussian signal a.
Intermediate parameter
Spatial frequency
Input zero-mean Gaussian signal
RD Analysis of SP and SI Frames (2)
• RD analysis of primary SP picturesRate
DistortionAssumptions
DSP1 = D1 + D2
(at high rates)
D1
D2
RD Analysis of SP and SI Frames (3)
• RD analysis of SI and secondary SP pictures
Rate
Distortion
3
3>1 if switching up3<1 if switching down
Rate-Distortion Performance
• Theoretical vs. experimental RD performance
2 = 0.91, 3 = 1.21 for switching up, and3 = 0.51 for switching down.
QCIF, Foreman, 30fps
SP 1.9P≒ SI 1.35I≒
Optimal Setting for Streaming (1)
• Minimize
s.t.
• Minimize
s.t.
P P SP P
SI
P
x: The probability of transmitting an SI frame
D: The distortion of rest stream
At high rates,
Solution:
D = DSP1 = D1 + D2
Optimal Setting for Streaming (2)
=
=SI
SI
dR
dD
1
1
SP
SP
dR
dD
1.
2. 3.
5.
4.
Performance Analysis
SP B B B P B B B P B B B P B B B SP
I B B B P B B B P B B B P B B B I
SI B B B P B B B P B B B P B B B SI
Streaming of SP and SI Pictures
• http://vc.cs.nthu.edu.tw/home/paper/codfiles/cycho/200507272027/Video_streaming_with_SP_and_SI_frames.ppt