h.264 overview - addpacno.9 addpac video solution addpac technology confidential h.264 profiles...
TRANSCRIPT
![Page 1: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/1.jpg)
AddPac Technology Co. Ltd Feb. 12, 2004
H.264 Overview
Video TeamR&D Center
AddPac Technology Co. [email protected]
![Page 2: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/2.jpg)
No.2
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
Contents
History of Video Coding Standards
H.264 Features
H.264 Technical Tools
![Page 3: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/3.jpg)
No.3
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
Video Codec Applications
Codec (Encoder & Decoder)
Digital Video Applications
VideoEncoder
VideoDecoder
Networkbitstream bitstream
inputvideo
outputvideo
Video monitoring and recording system Web camera Network cameraPVR: Personal Video Recorder(PVR: Personal Video Recorder)
Video Monitoring System
Cellular/ mobile phone, PDA, DMB terminal Mobile Multimedia Terminal
H.320, H.323, SIP based products IP Video Phone &Video Conferencing
Voice & Video over IP products V2oIP Gateway
Satellite network Broadband network (Cable, xDSL)ATM network
Set-top box
![Page 4: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/4.jpg)
No.4
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
History of Video Standards
ITU VCEGH.26L H.264
ISO MPEGMPEG-4 AVC (advanced video coding) or MPEG-4 Part 10
VCEG-MPEGJVT (joint video team)JMx.x (joint model: reference software)
![Page 5: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/5.jpg)
No.5
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
H.264 Features
High compression performanceMany advanced compression techniques are adopted.
Advanced Intra-PredictionStrong Motion Isolation (4x4, ¼-pel resolution)Multiple Reference FramesWeighted Bi-PredictionContext-adaptive VLC/BAC
Average bit rate reduction of 50% given fixed fidelity compared to any other video standard
Exact match decodingInteger Transform
Improved Perceptual QualityIn-Loop Deblocking Filter
Network friendlinessNAL (Network abstraction layer)
Enhanced Error Resilience
Very High Complexity!
![Page 6: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/6.jpg)
No.6
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
Comparison to Other Standards
27282930313233343536373839
0 50 100 150 200 250Bit-rate [Kbps]
Foreman QCIF (at 10 frames/s)Q
uality
-PSN
R [
dB]
MPEG-2
MPEG-4H.264
H.263
27282930313233343536373839
0 50 100 150 200 250Bit-rate [Kbps]
Foreman QCIF (at 10 frames/s)Q
uality
-PSN
R [
dB]
MPEG-2
MPEG-4H.264
H.263
![Page 7: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/7.jpg)
No.7
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
Comparison to MPEG-4
EnvironmentMatrix 20sec
320x240
30fps
128Kbps (Low Bit-rate)
MPEGMPEG--44371:1371:1
H.264H.264404:1404:1
OriginalOriginal
![Page 8: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/8.jpg)
No.8
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
H.264 - Technical Tools
Sequence GOP Picture Slice MB Block
Chroma format – 4:2:0
Picture type – I, P, B, SI, SP
Frame structure – Interlaced, Progressive
Adaptive frame/field – per picture, per MB
Deblocking filter – in-loop
MV resolution – ¼ pixel
Tree-like motion segmentation – 16x16 to 4x4
Entropy coding – EG and CAVLC/CABAC
Data partitioning – NAL_unit, priority
ASO (arbitrary slice order) – independently decodable
FMO (flexible macroblock order) – map
Redundant slice
ABP (adaptive bi-prediction) – adaptive weighting
![Page 9: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/9.jpg)
No.9
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
H.264 ProfilesBaseline (Videoconferencing & Wireless)
I and P picture types (not B)
Interlace
Per-picture adaptive frame/field
In-loop deblocking filter
1/4-sample motion compensation
Tree-structured motion segmentation down to 4x4 block size
VLC-based entropy coding (CAVLC)
Some enhanced error resilience features: FMO, ASO, Redundant slices
Main Profile (esp. Broadcast)All Baseline features except enhanced error resilience features
B pictures
CABAC (context-adaptive binary arithmetic coding)
MB-level frame/field switching
Adaptive weighting for B and P picture prediction
Interlace
Profile X (esp. Streaming)All Baseline features
B pictures
More error resilience: Data partitioning
SP/SI switching pictures
![Page 10: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/10.jpg)
No.10
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
H.264: Encoder Structure
Scaling & Inv. Transform
Motion-Compensation
Quant.Transf. coeffs
Intra/Inter
Decoder Loop-
Intra-frame Prediction
De-blockingFilter
OutputVideoSignal
EntropyCoding
CoderControl
InputVideoSignal
Split intoMacroblocks(16x16 pixels)
ControlData
Transform/Scal./Quant.
MotionData
MotionEstimation
![Page 11: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/11.jpg)
No.11
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
H.264: Motion Compensation Accuracy
MPEG-2• 16x16 block size• Square shape• ½ pel motion vector
Weak Motion Isolation !
MPEG-4• 8x8 block size• Square shapes• ½ pel motion vector
Moderate Motion Isolation !!
H.264• 4x4 block size• Arbitrary shapes• ¼ pel motion vector
Strong Motion Isolation !!!
Motion vector accuracy ¼ pixel
8x8
0
4x8
0 10 12 3
4x48x4
108x8
Types
0
16x16
0 1
8x16MB
Types
8x80 12 3
16x8
10
Macroblock Partitioning
![Page 12: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/12.jpg)
No.12
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
H.264: Multiple Reference Frames
Per-MB reference control
Generalized B(bi-predictive) picture
Weighted Bi-Prediction
![Page 13: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/13.jpg)
No.13
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
H.264: 4x4 Intra-Prediction
(horizontal)1
0(v
ert
ical)
3(dia
gonal
/lef
t)(diagonal/right)4
7(v
ert
ical/
left
)
(vertica
l/rig
ht)5
(horizontal/down)6
(horizontal/up)8
9 prediction modes
2(DC)
![Page 14: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/14.jpg)
No.14
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
H.264: 16x16 Intra-Prediction
4 prediction modes
0(Vertical)
1(Horizontal)
3(Plane)2(DC)
![Page 15: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/15.jpg)
No.15
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
H.264: Transform
EXACT MATCH Simplified TransformBased primarily on 4x4 transform
Requires only 16 bit arithmetic (including intermediate values)
Expanded to 8x8 for chroma by 2x2 transform of the DC values
1 1 1 12 1 -1 -21 -1 -1 11 -2 2 -1
H =
where a = 1/2, b = 1/2 cos( / 8),
and 1/2 cos(3 / 8).
a a a ab c -c -ba -a -a ac -b b -c
H =
c
ππ
×
= ×
H.2644x4 DCT
![Page 16: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/16.jpg)
No.16
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
H.264: Quantization
Quantization of transform coefficients• Logarithmic step size control
• Extended range of step sizes
• Smaller step size for chroma (cf. H.263 Annex T)
• Table-driven (12.5%-increase in QStep per 1-QP increase)2-times in QStep for every 6th increment in QP
• Reconstruction is 16-bit multiply, add, shift
• Actual definition is very complicated due to• The non-orthonormality of the integer transform
position dependent scaling
• Reconstruction simplicity
224…160…80…40…20…10…5…qStep51…48…42…36…30…24…18…QP…2.52.2521.751.6251.6751.251.12510.8750.81250.68750.625qStep…1211109876543210QP
![Page 17: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/17.jpg)
No.17
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
H.264: In-loop DeblockingFilter
Improves subjective visual qualityMuch better than post filteringHighly context adaptive
1) Without Filter 2) With H264/AVC Deblocking
![Page 18: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/18.jpg)
No.18
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
H.264: Entropy Coding
Exp-Golomb CodeUniversally for all symbols except for transform coefficients
CAVLC (Context adaptive VLC)For transform coefficients
No end-of-block, but number of coefficients is decoded
Coefficients are scanned backwards
Contexts are built dependent on transform coefficients
CABAC (Context-based binary arithmetic coding)For transform coefficients
Usage of adaptive probability models for most symbols
Exploiting symbol correlations by using contexts
Average bit-rate saving over CAVLC 10-15%
![Page 19: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/19.jpg)
No.19
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
H.264: Network Abstraction Layer (1)
![Page 20: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/20.jpg)
No.20
Ad
dP
ac
Vid
eo
So
luti
on
AddPac Technology Confidential
H.264: Network Abstraction Layer (2)
NAL unit: transport entity, e.g., contain one slice
H.264/AVC standard defines a byte-stream format to transmit a sequence of NAL units as an ordered stream of bytes
NAL unit boundaries need to be identified to obtain NAL units with correct size to guarantee integrity
A byte-oriented HDLC-like framing including start codes (1or 2 bytes) and emulation prevention is specified
For simplified gateway operation, the emulation prevention on byte basis is applied to all raw byte sequence payloads (RBSPs).
MPEG-2 systems support!
![Page 21: H.264 Overview - AddPacNo.9 AddPac Video Solution AddPac Technology Confidential H.264 Profiles Baseline (Videoconferencing & Wireless)}I and P pic ture types (no B)}Interlace}P er-p](https://reader035.vdocument.in/reader035/viewer/2022070922/5fba745190c9ec53b4716fc5/html5/thumbnails/21.jpg)
AddPac Technology Confidential
Thank You!www.addpac.com
Technical Sales and Marketing
Phone : +82 2 568 3848Fax : +82 2 568 [email protected]