video compression: principles, practice, and standards
TRANSCRIPT
![Page 1: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/1.jpg)
September 27, 2005 Page 1John G. Apostolopoulos
VideoCoding
Video Compression:Principles, Practice, and Standards
John G. ApostolopoulosStreaming Media Systems Group
HP Labs, Palo Alto, [email protected]
![Page 2: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/2.jpg)
John G. ApostolopoulosPage 2
VideoCoding
September 27, 2005
Goals for Today’s Talk
Goals:• Provide brief overview of image & video coding and key
standards• Assume no prior knowledge of compression• Explain the “alphabets soup” of coding standards, acronyms,
etc
![Page 3: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/3.jpg)
John G. ApostolopoulosPage 3
VideoCoding
September 27, 2005
Outline
• Why do we need compression?• Image compression
– Color processing, DCT, etc• Video compression
– Exploit temporal dimension of video signal • Prediction– Generic (MPEG-type) video coder architecture
• Current video compression standards– What are they?– What do the standards specify?
• Brief overview of H.264 / MPEG-4 AVC video coding standard
![Page 4: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/4.jpg)
John G. ApostolopoulosPage 4
VideoCoding
September 27, 2005
Motivation for Compression:Example of HDTV Video Signal
• Problem:– Raw video contains an immense amount of data– Communication and storage capabilities are limited & expensive
• Example HDTV video signal:– 720x1280 pixels/frame, progressive scanning at 60 frames/s:
– 20 Mb/s HDTV channel bandwidth→ Requires compression by a factor of 70
(equivalent to 0.35 bits/pixel)
sGbcolor
bitspixelcolorsframes
framepixels /3.183
sec601280720 =
×
![Page 5: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/5.jpg)
John G. ApostolopoulosPage 5
VideoCoding
September 27, 2005
Example Video Applicationsand Required Compression Ratios
~ 190384 kb/s (3G)73 Mb/s2430288 x 352CIF
~ 14064 kb/s (3G)9 Mb/s2415144 x 176QCIF
~ 505 Mb/s (DVD)250 Mb/s2430480 x 720SDTV
~ 7020 Mb/s (HDTV)1.3 Gb/s2460720 x 1280HDTV
Required compression
ratio
Channel bit rate
Raw bit rate
bits/pixelFpsPixels/frameVideo Format
Wireless video soon
Wireless video today Lots of compression required!!!
![Page 6: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/6.jpg)
John G. ApostolopoulosPage 6
VideoCoding
September 27, 2005
Achieving Compression
• Reduce redundant or repeated information– Temporal: Adjacent frames highly correlated– Spatial: Nearby pixels are often correlated– Color space: RGB components are correlated→ Relatively straightforward to exploit
• Reduce irrelevant information– Perceptually unimportant information, i.e. what the
human visual system (HVS) can not see→ Difficult to model and exploit
![Page 7: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/7.jpg)
John G. ApostolopoulosPage 7
VideoCoding
September 27, 2005
Spatial and Temporal Redundancy
• Why can video be compressed?– Video contains much spatial and temporal redundancy.
• Spatial redundancy: Neighboring pixels are similar• Temporal redundancy: Adjacent frames are similar
Compression is achieved by exploiting the spatial and temporal redundancy inherent to video
![Page 8: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/8.jpg)
John G. ApostolopoulosPage 8
VideoCoding
September 27, 2005
Outline
• Why do we need compression?• Image compression
– Color processing, DCT, etc• Video compression
– Exploit temporal dimension of video signal • Prediction– Generic (MPEG-type) video coder architecture
• Current video compression standards– What are they?– What do the standards specify?
• Brief overview of H.264 / MPEG-4 AVC video coding standard
![Page 9: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/9.jpg)
John G. ApostolopoulosPage 9
VideoCoding
September 27, 2005
Image Compression: Overview
• Coding an image (single frame):– RGB to YUV color-space conversion– Partition image into 8x8-pixel blocks– 2-D DCT of each block– Quantize each DCT coefficient– Runlength and Huffman code the nonzero quantized DCT
coefficients→ Basis for the JPEG Image Compression Standard→ JPEG-2000 uses wavelet transform and arithmetic coding
Quantization
CompressedBitstream
OriginalImage Runlength &
HuffmanCoding
RGBto
YUVBlock DCT
![Page 10: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/10.jpg)
John G. ApostolopoulosPage 10
VideoCoding
September 27, 2005
Color Space Processing
• Important properties– RGB components are highly correlated– HVS perception differs for luminance than for
chrominance• Goal: Convert RGB to a different color space where
these properties can be exploited• 3x3 Linear color-space transformation:
– R G B → Y U V– Y: Luminance– U & V: Chrominance
−−−−=
BGR
VUY
100.515.615.436.289.147.114.587.299.
![Page 11: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/11.jpg)
John G. ApostolopoulosPage 11
VideoCoding
September 27, 2005
Color Space Processing (cont.)
Advantages of color space conversion:• HVS has lower spatial frequency response to U and V
than to Y→ Reduce sampling density for U and V
• HVS has lower sensitivity to U and V than to Y→ Quantize U and V more coarsely
• Reasonable assumption: An RGB image requires 3x bit rate of B&W image (single-color image)
• Key result: RGB image only requires ~1.25x bit rate
![Page 12: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/12.jpg)
John G. ApostolopoulosPage 12
VideoCoding
September 27, 2005
Color Space Processing (cont.)RGB color components are: 1) Converted to YUV2) U and V components are subsampled by 2x2
RGBto
YUV
Y
U V144x176 pixels
144x176
72x88 72x88
![Page 13: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/13.jpg)
John G. ApostolopoulosPage 13
VideoCoding
September 27, 2005
Transform Image Coding
• Goal: Transform image so that most of the information (energy) is concentrated into only a small fraction of the coefficients
– Coding only these small fraction of the coefficients and discarding the rest can often lead to excellent reconstructed quality
→ The more energy compaction the better!• Enables perceptual processing (exploiting HVS response to different
frequency components)
First frame of Foreman Sequence Magnitude of FFT of Foreman
![Page 14: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/14.jpg)
John G. ApostolopoulosPage 14
VideoCoding
September 27, 2005
Spatial Processing: Block DCT
• Block Discrete Cosine Transform (DCT)– Split image into 8x8 pixel blocks– Each block independently transformed and processed
– Compute 8x8 2-D DCT of each block– Quantize and encode each block
• Advantages:– Enables simple, spatially-adaptive processing– Reduces computation and memory requirements– Suitable for parallel processing
• Basic building block for most current image and video compression standards including:
– JPEG, MPEG-1/2/4, H.261/3/4
![Page 15: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/15.jpg)
John G. ApostolopoulosPage 15
VideoCoding
September 27, 2005
Image Compression: Summary
• Coding an image (single frame):– RGB to YUV color-space conversion– Partition image into 8x8-pixel blocks– 2-D DCT of each block– Quantize each DCT coefficient– Runlength and Huffman code the nonzero quantized DCT
coefficients→ Basis for the JPEG Image Compression Standard→ JPEG-2000 uses wavelet transform and arithmetic coding
Quantization
CompressedBitstream
OriginalImage Runlength &
HuffmanCoding
RGBto
YUVBlock DCT
![Page 16: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/16.jpg)
John G. ApostolopoulosPage 16
VideoCoding
September 27, 2005
Outline
• Why do we need compression?• Image compression
– Color processing, DCT, etc• Video compression
– Exploit temporal dimension of video signal • Prediction– Generic (MPEG-type) video coder architecture
• Current video compression standards– What are they?– What do the standards specify?
• Brief overview of H.264 / MPEG-4 AVC video coding standard
![Page 17: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/17.jpg)
John G. ApostolopoulosPage 17
VideoCoding
September 27, 2005
Example Video Encoder
DCT HuffmanCoding
MotionEstimation
MotionCompensation
BufferRGB
toYUV
Motion Vectors
Motion Vectors
MC-Prediction
ErrorInputVideoSignal
OutputBitstream
Quantize
InverseDCT
InverseQuantize
PreviousReconstructedFrame
Buffer fullness
Frame Store
![Page 18: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/18.jpg)
John G. ApostolopoulosPage 18
VideoCoding
September 27, 2005
Video Compression
• Video: Sequence of frames (images) that are related– Related along the temporal dimension
• Main addition over image compression– Temporal redundancy– Usually high frame rate: Significant temporal
redundancy→ Video coder must exploit the temporal redundancy
![Page 19: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/19.jpg)
John G. ApostolopoulosPage 19
VideoCoding
September 27, 2005
Video Compression
• Goal: Exploit the temporal redundancy • Predict current frame based on previously coded frames• Three types of coded frames:
– I-frame: Intra-coded frame, coded independently of all other frames
– P-frame: Predictively coded frame, coded based on previously coded frame
– B-frame: Bi-directionally predicted frame, coded based on both previous and future coded frames
I frame P-frame B-frame
![Page 20: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/20.jpg)
John G. ApostolopoulosPage 20
VideoCoding
September 27, 2005
Prediction for Two Consecutive Frames:Block-Matching Motion Estimation & Motion-Compensated Prediction
Previously Coded Frame(Reference Frame)
Current Frame(To be Predicted)
161514
13
1211
109
876
5
432
1
1615
1413
1211
109
87
65
43
21
Reference Frame Predicted Frame
Block-matching overview:1) Split current frame into
16x16-pixel blocks2) Find best match for
each block from prior frame
![Page 21: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/21.jpg)
John G. ApostolopoulosPage 21
VideoCoding
September 27, 2005
Example: MC-Prediction for Two Consecutive Frames (cont.)
Prediction of Current Frame
Prediction Error(Residual)
![Page 22: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/22.jpg)
John G. ApostolopoulosPage 22
VideoCoding
September 27, 2005
MC-Prediction and Bi-Directional MC-Prediction (P- and B-frames)
• Motion compensated prediction: Predict the current frame based on reference frame(s) while compensating for the motion
• Examples of block-based motion-compensated prediction (P-frame) and bi-directional prediction (B-frame):
161514
13
1211
109
876
5
432
1
1615
1413
1211
109
87
65
43
21
Previous Frame B-Frame
161514
13
121110
9
876
5
4
321
Future Frame
161514
13
1211
109
876
5
432
1
1615
1413
1211
109
87
65
43
21
Previous Frame P-Frame
![Page 23: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/23.jpg)
John G. ApostolopoulosPage 23
VideoCoding
September 27, 2005
Video Compression
• Main addition over image compression: – Exploit the temporal redundancy
• Predict current frame based on previously coded frames• Three types of coded frames:
– I-frame: Intra-coded frame, coded independently of all other frames
– P-frame: Predictively coded frame, coded based on previously coded frame
– B-frame: Bi-directionally predicted frame, coded based on both previous and future coded frames
I frame P-frame B-frame
![Page 24: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/24.jpg)
John G. ApostolopoulosPage 24
VideoCoding
September 27, 2005
Example Use of I-,P-,B-frames: MPEG Group of Pictures (GOP)
• Arrows show prediction dependencies between frames
MPEG GOP
I0 B1 B2 P3 B4 B5 P6 B7 B8 I9
![Page 25: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/25.jpg)
John G. ApostolopoulosPage 25
VideoCoding
September 27, 2005
Summary of Temporal Processing
• Use MC-prediction (P & B frames) to reduce temporal redundancy• MC-prediction yields:
1) Motion vectors2) MC-prediction error → Code with conventional image coder
• Sometimes MC-prediction may perform badly– Examples: Complex motion, new imagery (occlusions)– Approach:
1. Identify frame or individual blocks where prediction fails 2. Code without prediction
![Page 26: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/26.jpg)
John G. ApostolopoulosPage 26
VideoCoding
September 27, 2005
Basic Video Compression Architecture
• Exploiting the redundancies:– Temporal: MC-prediction (P and B frames)– Spatial: Block DCT– Color: Color space conversion
• Scalar quantization of DCT coefficients• Zigzag scanning, runlength and Huffman coding of the
nonzero quantized DCT coefficients
![Page 27: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/27.jpg)
John G. ApostolopoulosPage 27
VideoCoding
September 27, 2005
Example Video Encoder
DCT HuffmanCoding
MotionEstimation
MotionCompensation
BufferRGB
toYUV
Motion Vectors
Motion Vectors
MC-Prediction
ErrorInputVideoSignal
OutputBitstream
Quantize
InverseDCT
InverseQuantize
PreviousReconstructedFrame
Buffer fullness
Frame Store
![Page 28: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/28.jpg)
John G. ApostolopoulosPage 28
VideoCoding
September 27, 2005
Example Video Decoder
HuffmanDecoder
MotionCompensation
Buffer YUV to RGB
Motion Vectors
ReconstructedFrame
OutputVideoSignal
InputBitstream
MC-Prediction
ErrorInverse
DCTInverse
Quantize
Frame Store
PreviousReconstructedFrame
![Page 29: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/29.jpg)
John G. ApostolopoulosPage 29
VideoCoding
September 27, 2005
Outline
• Why do we need compression?• Image compression
– Color processing, DCT, etc• Video compression
– Exploit temporal dimension of video signal • Prediction– Generic (MPEG-type) video coder architecture
• Current video compression standards– What are they?– What do the standards specify?
• Brief overview of H.264 / MPEG-4 AVC video coding standard
![Page 30: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/30.jpg)
John G. ApostolopoulosPage 30
VideoCoding
September 27, 2005
Motivation for Standards
• Goal of standards: – Ensuring interoperability: Enabling communication
between devices made by different manufacturers– Promoting a technology or industry– Reducing costs
![Page 31: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/31.jpg)
John G. ApostolopoulosPage 31
VideoCoding
September 27, 2005
What do the Standards Specify?
Encoder Bitstream Decoder
![Page 32: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/32.jpg)
John G. ApostolopoulosPage 32
VideoCoding
September 27, 2005
What do the Standards Specify?
• Not the encoder• Not the decoder• Just the bitstream syntax and the decoding process (e.g. use IDCT,
but not how to implement the IDCT)→ Enables improved encoding & decoding strategies to be
employed in a standard-compatible manner
Encoder Bitstream Decoder
Scope of Standardization
(Decoding Process)
![Page 33: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/33.jpg)
John G. ApostolopoulosPage 33
VideoCoding
September 27, 2005
Current Image and VideoCompression Standards
Standard Application Bit Rate
JPEG Continuous-tone still-image compression
Variable
H.261 Video telephony and teleconferencing over ISDN
p x 64 kb/s
MPEG-1 Video on digital storage media (CD-ROM)
1.5 Mb/s
MPEG-2 Digital Television 2-20 Mb/s
H.263 Video telephony over PSTN 33.6-? kb/sMPEG-4 Object-based coding, synthetic
content, interactivityVariable
JPEG-2000 Improved still image compression Variable
H.264 / MPEG-4 AVC
Improved video compression 10’s kb/s to Mb/s
ISO: JPEG & MPEG family of standardsITU : H.26x family of standards
![Page 34: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/34.jpg)
John G. ApostolopoulosPage 34
VideoCoding
September 27, 2005
MPEG Group of Pictures (GOP) Structure• Composed of I, P, and B frames• Arrows show prediction dependencies
MPEG GOP
I0 B1 B2 P3 B4 B5 P6 B7 B8 I9
• Periodic I-frames enable random access into the coded bitstream• Parameters: (1) Spacing between I frames, (2) number of B frames
between I and P frames
![Page 35: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/35.jpg)
John G. ApostolopoulosPage 35
VideoCoding
September 27, 2005
![Page 36: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/36.jpg)
John G. ApostolopoulosPage 36
VideoCoding
September 27, 2005
Outline
• Why do we need compression?• Image compression
– Color processing, DCT, etc• Video compression
– Exploit temporal dimension of video signal • Prediction– Generic (MPEG-type) video coder architecture
• Current video compression standards– What are they?– What do the standards specify?
• Brief overview of H.264 / MPEG-4 AVC video coding standard
![Page 37: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/37.jpg)
John G. ApostolopoulosPage 37
VideoCoding
September 27, 2005
H.264 / MPEG-4 Part-10 Advanced Video Coding (AVC)
Jointly designed by ISO and ITU standards bodies• Known by different names: H.264, MPEG-4 Part-10 Advanced
Video Coding (AVC), Joint Video Team (JVT), etc.
Goals:• Significant improvement in compression• Network friendliness from ground up:
– Packet-based delivery– Carry over RTP/UDP/IP, MPEG-2 TS, H.324M, MPEG-4 file
format, etc.• Error & loss resilience• Exact match decoding (e.g. integer transforms)Additional recent goals:• Professional applications, e.g. > 8 bits per sample, 4:4:4 color
sampling, …
![Page 38: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/38.jpg)
John G. ApostolopoulosPage 38
VideoCoding
September 27, 2005
H.264 / MPEG-4 AVC:Enhancements over Prior Standards
Improved temporal prediction:• Adaptive block-size MC-prediction (16x16 to 4x4 pixels)• Multiple reference frames stored for possible use for
prediction• ¼-pixel motion vector accuracy• Deblocking filter within prediction loopImproved spatial prediction:• Directional spatial prediction of pixels• Integer DCT-like transform (4x4 pixel blocks)Improved entropy coding (probability prediction):• Context-based adaptive binary arithmetic coder (CABAC)Enhanced features:• Improved error-resilience techniques• SP & SI switching pictures
![Page 39: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/39.jpg)
John G. ApostolopoulosPage 39
VideoCoding
September 27, 2005
H.264 / AVC Profiles & Levels
• Profile: Subset of tools applicable to specific application(s)• H.264 version 1 defined 3 profiles:
– Baseline (e.g., videoconferencing & wireless)– Main (e.g., broadcast, entertainment)– Extended (e.g., streaming) [Superset of Baseline]
XSP & SI slicesXMore Error ResilienceXXError Resilience
XCABACXXInterlacedXXB slicesXXXI & P slices
ExtendedMainBaselineCoding Tools
• Levels specify constraints on maximum computation and memory– Pixels per second, coded bit rate, # reference frames
![Page 40: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/40.jpg)
John G. ApostolopoulosPage 40
VideoCoding
September 27, 2005
H.264 / MPEG-4 AVC Amendment 1: Fidelity Range Extensions (FRExt)
• Designed for professional applications which require higher quality in terms of bits/pixel, bit rates, spatial resolutions, etc.
• New “High” profiles:– High: Added 8x8 transform, improved quantization– High 10: Above plus support for 10 bits/pixel– High 4:2:2 : Above plus 4:2:2 format– High 4:4:4 : Above plus 4:4:4 format & 12 bits/pixel
• High profile likely for broadcast & entertainment quality apps• High 4:2:2 for studio environments
![Page 41: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/41.jpg)
John G. ApostolopoulosPage 41
VideoCoding
September 27, 2005
~50 % reduction(H.264 vs MPEG-2)
Example Comparison: Results depend stronglyon specific sequence & coding tools employed!
![Page 42: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/42.jpg)
John G. ApostolopoulosPage 42
VideoCoding
September 27, 2005
Summary
• Overview of basic principles & practice of image and video coding, and key standards
• Video coding is critical enabler for many applications:– Digital TV– DVD– Video streaming– Wireless video, e.g. over 3G cellular networks
• Future of video coding:– Continued improvements in compression– New or improved functionalities
e.g. Scalable Video Coding (SVC) standard underway– Cross-layer design
e.g. Coding and packetization or transmission
![Page 43: Video Compression: Principles, Practice, and Standards](https://reader035.vdocument.in/reader035/viewer/2022071601/613d315e736caf36b75a6ace/html5/thumbnails/43.jpg)
John G. ApostolopoulosPage 43
VideoCoding
September 27, 2005
Additional Information
• “Video Streaming: Concepts, Algorithms, and Systems”, HPL Tech Report HPL-2002-260www.hpl.hp.com/techreports/2002/HPL-2002-260.html
• “Video Compression and Video Streaming”, lectures at MIT 6.344, Spring 2004www.mit.edu/~6.344/Spring2004/Spring2004.html
• “Enterprise Streaming: Different Challenges from Internet Streaming”, HPL Tech Report HPL-2005-98www.hpl.hp.com/techreports/2005/HPL-2005-98.html