folie 1 · some compatibility to h.263 of the itu (same basic ideas, transcoding is possible for...

25
© Fraunhofer IDMT 1 Multimedia Standards SS 2017 Lecture 6 Prof. Dr.-Ing. Karlheinz Brandenburg [email protected] Contact: Dipl.-Inf. Thomas Köllmer [email protected]

Upload: others

Post on 21-Sep-2019

3 views

Category:

Documents


0 download

TRANSCRIPT

© Fraunhofer IDMT

1

Multimedia Standards

SS 2017

Lecture 6

Prof. Dr.-Ing. Karlheinz Brandenburg

[email protected]

Contact:

Dipl.-Inf. Thomas Köllmer [email protected]

© Fraunhofer IDMT

2

Video Coding Standards III

MPEG 4 Video• Part 2 / Part 10

HEVCContainer Formats

• DivX• Matroška

© Fraunhofer IDMT

3

MPEG-4 Video

ISO / IEC IS 14496: Coding of audio-visual objects

Video coding in MPEG-4:

ISO/IEC 14496-2: Visual (1999)

ISO/IEC 14496-10: Advanced Video Coding (AVC) (2003)

© Fraunhofer IDMT

4

Basic block diagram of MPEG-4 Video Coder

http://mpeg.chiariglione.org/technologies.htm

© Fraunhofer IDMT

5

MPEG-4 Video: Part 2 (Visual) / H.263

Part 2 (Visual) specifies beside video coding the coding of other visual objects

Some compatibility to H.263 of the ITU (same basic ideas, transcoding is possible for some profiles to simple H.263 (no options) )

Used e.g. in DivX / Xvid

Basic values

data rates: 5kBit/sec…1GBit/s (typical: 5kBit/s…10MBit/s)

formats: progressive and interlaced video

resolutions: sub QCIF… 4k*4k (studio)

Special formats: e.g. for arbitrarily shaped video

© Fraunhofer IDMT

6

MPEG-4 Video: Part 2

Profiles in MPEG-4 Part 2 (selection)

© Fraunhofer IDMT

7

MPEG-4 Video: Part 2

Levels in MPEG-4 Part 2 (selection)

© Fraunhofer IDMT

Prof. Dr.-Ing. Karlheinz Brandenburg, [email protected] Seite 8

AVC / H.264

© Fraunhofer IDMT

Prof. Dr.-Ing. Karlheinz Brandenburg, [email protected] Seite 9

MPEG-4 Video: Part 10 (AVC) / H.264

Advanced video coding for generic audiovisual services, Final draft: 2003

Advanced Video Coding (AVC) is identical with H.264 of ITU

Developed in cooperation of the ITU and the MPEG within in the Joint Video Team (JVT)

Applications:

BluRay

HDTV via DVB-X2

Mobile TV: DVB-H T-DMB

Video Streaming

© Fraunhofer IDMT

Prof. Dr.-Ing. Karlheinz Brandenburg, [email protected] Seite 10

MPEG-4 Video: Part 10 (AVC) / H.264

Allows either much higher quality or lower bit rates

In SDTV mostly a halving of the bit rate with comparable quality possible

Increasingly replaces older video coding standards

Basis for further developments:

SVC: Scalable Video Coding

MVC: Multi View Coding

© Fraunhofer IDMT

Prof. Dr.-Ing. Karlheinz Brandenburg, [email protected] Seite 11

MPEG-4 Video: Part 10 (AVC) / H.264

Many detail improvements, performance roughly doubled compared to H.263

New functions:

Enhanced motion estimation with variable block size

¼ Pixel precision

„Weighted prediction“ for better support of fades

Integer block transform

Improved in-loop deblocking filter

Enhanced entropy coding

CABAC Entropy Coding (Context-adaptive binary arithmetic coding) for coefficients

UVLC (Universal variable length coding)

Exponential Golomb Code für syntax elements

© Fraunhofer IDMT

12

MPEG-4 Video: Part 10 (AVC) / H.264

New functions (contd.)

Slices

Allow parallelization (intraframe coding is only done within a slice, not across slices)

Allows redundant coding with overlapping slices

Precision for DCT specified (avoids decoder drift)

Fidelity Range Extensions (High Profile)

E.g., 4:4:4 color "sub"sampling

Network Abstraction Layer (NAL)

Simplifies transmission (IP, MPEG-TS, Files)

© Fraunhofer IDMT

Prof. Dr.-Ing. Karlheinz Brandenburg, [email protected] Seite 13

MPEG-4 Video: Part 10 (AVC) Profiles

© Fraunhofer IDMT

14

MPEG-4 Video: Part 10 (AVC) Profiles und Levels

Tables from: Poynton, Charles. Digital video and HD: Algorithms and Interfaces, 2012, S. 48ff

© Fraunhofer IDMT

Prof. Dr.-Ing. Karlheinz Brandenburg, [email protected] Seite 15

MPEG-4 Video: Part 10 (AVC) / H.264

AVC comparison

Test sequence:

CIF 30 frames/sec

© Fraunhofer IDMT

16

High Efficiency Video Coding (HEVC) / H.265

Further halves the bitrate compared to H.264

Standardized in January 2013

Applications:

DVB-T2 (Start: 31th of May in Germany)

Ultra HD BluRay (available since April)

Profiles, Levels and Tiers

Main and High-Tiers define maximum bitrate for certain level

Default: Progressive Mode

No explicit support of interlaced video anymore

© Fraunhofer IDMT

17

High Efficiency Video Coding (HEVC) / H.265

Macroblocks Coding Tree Units (CTU) of flexible size(8, 16, 32, 64)

Further division in CBs (Code Blocks) and TB (Transform Blocks)

More information: Han, G. J., et al. "Overview of the high efficiency video coding (HEVC) standard." (2012)

http://iphome.hhi.de/wiegand/assets/pdfs/2012_12_IEEE-HEVC-Overview.pdf

© Fraunhofer IDMT

18

Container Formats

© Fraunhofer IDMT

19

DivX Container Formats:

AVI:

Audio Video Interleave (developed by Microsoft)

Based on RIFF (Resource Interchange File Format) by Microsoft that in turn is based on IFF (Interchange File Format)

RIFF divides the file’s data into chunks.

The first chunk of a AVI-file is the RIFF header, it contains:

RIFF signature (FourCC)

file size (FourCC)

RIFF type (FourCC)

Application Example: DivX Container Formats

© Fraunhofer IDMT

20

DivX Container Formats

© Fraunhofer IDMT

21

RIFF Header(‘AVI’)1

LIST (‘hdrl)2

Main AVI Header (‘avih’)3

LIST (‘strl’)4

Stream Header(‘strh’)5

Stream Header(‘strh’)6

Stream Header(‘strh’)7

LIST (‘movi’)8

LIST (‘rec’)9

Sub-chunk 1…n10

Sub-chunk 1…n

Sub-chunk 1…n12

AVI – chunk structure

DivX Container Formats

© Fraunhofer IDMT

22

DivX Media Format, allows e.g. :

multiple subtitles

multiple audio/video streams

interactive menus

addition of metadata

chapter points, etc.

Using DivX Media File XML for description

(introduced with DivX 6)

DivX Container Formats

Source: DivxDivXMuxCommand Line Reference Release Date: November 28, 2005

© Fraunhofer IDMT

23

Matroska

Open source project licenced under GNU LGPL

Used in DivX as a container for HD content (introduced with DivX 7)

Based on EBML (Extensible Binary Meta Language), a binary derive of XML

DivX Container Formats

Source: https://www.matroska.org/technical/diagram/index.html

© Fraunhofer IDMT

24

KW 21 Tuesday 23.05., 17:00 K-HS1

KW 22 Tuesday 30.05., 17:00 K-HS1

Next Lectures…

© Fraunhofer IDMT

25

Organisational issues

Preliminary list of lectures – updated version is on the website

* ISO 8601 Representation of dates and times ch. 2.2.10 : calendar week number: ordinal number which identifies a calendar week within its calendar year according to the rule that the first calendar week of a year is that one which includes the first Thursday of t hat year and that the last calendar week of a calendar year is the week immediately preceding the first calendar week of the next calendar year

Tuesday, 17:00, K-Hs1 Thursday, 13:00, K-Hs2

CW* 14 Introduction

CW15 Standardization I Standardization II

CW16

CW17

CW18 Video Coding I

CW19 Video Coding II Video Coding III

CW20

CW21 MPEG Systems

CW22 Metadata Standards

CW23 Psychoacoustic Fundamentals MPEG Audio

CW24 Speech Coding

CW25

CW26

CW27 MPEG Systems

CW28 System Standards I System Standards II

Regular Date Alternate Date