file format for scalable video coding outline

File Format for Scalable Video Coding

Outline

I. SVC Introduction

II. Review of File Format Basics

III.SVC File Format

IV.Examples of Use

CMPT 820 – 2008 Summer Presented by Jeff Jiang


SVC Introduction

SVC Scalabilities and the Cube Model

Bit-Stream Representation

Usage and Application Scenarios

SVC High-Level Syntax



SVC Introduction – Scalability & Data Model

SVC Scalabilities and the Cube Model

Temporal, Spatial, and SNR (Fidelity/Quality) scalability

Cube data model

SVC Syntax Elements – PDTQ Priority-id Dependency_id Temporal_id Quality_id



SVC Introduction – Bit-Stream Representation

• Flexible Combined Scalability

• Layered Scalability



SVC Introduction – Usage and Application

• Direct File Access• Adaptation Operation

• Erosion Storage - Surveillance



SVC Introduction – SVC High-Level Syntax



Outline

I. SVC Introduction


III.SVC File Format

IV.Examples of Use



File Format Review – ISO Base Media File Format

• The file structure is object-oriented and can be decomposed into

its constituent objects easily

• The files have

• Logical structure – a set of time parallel tracks, “movie”

• Time structure – sequence samples in time

• Physical structure – separate logical and time structure data from media data

themselves




• Tracks alternative to each other – using the same nonzero alternate group

number

• Special samples:

• Synchronization point ( I-frame)

• Track sample dependency

• Sample groups – used in SVC file format

• File type box

• The specifications to which the file complies

• Permission for a reader



File Format Review – AVC File Format

A sequence of access unit, each divided into a number of NAL units



Outline

I. SVC Introduction


III.SVC File Format

IV.Examples of Use



SVC File Format – Design Principles

• Extractor – Extract subsets that will be often extracted

easily

• Grouped into tiers which contain one or more

scalability layers (Sample groups)

• Have time-parallel data (Time parallel metadata track)



SVC File Format – Extractor Tracks

Allow “Cookbook” construction, take the forms of tracks within the alternate group

3 different ways to represent subset



SVC File Format – Extractor Tracks ‘Continue



SVC File Format – Sample Groups

• Using sample groups• Structure of sample groups

• A number of sets of description tables• A number of mapping tables



SVC File Format – Metadata

• Structured as a sequence of file format samples, just

like a video track

• Each metadata sample is structured as a metadata

statement

• Empty statement

• Group of statements

• Sequence of statements



SVC File Format – Metadata ‘Continue

some statement about the whole samplesequenceOfStatements { empty statement about SEI NALu groupOfStatements: { NALu header 1 statement; some other statement about NALu 1 } groupOfStatements { aggregator statement sequenceOfStatements { NALu header 2.1 statement; groupOfStatements: { NALu header 2.2 statement another statement about NALu 2.2 } } } some statement about NALu 3}

SEI NALuBase-layer Slice NALu 1aggregator NALu 2 containing { enhancement NALu 2.1, enhancement NALu 2.2}another enhancement NALu 3



SVC File Format – AVC Compatibility

• AVC compatibility can be divided into two major areas:

• File Format Compatibility

• Video coding compatibility

• Sample-entry name used by SVC track

• Avc1 – Define for AVC, use no data extraction, fully back-ward compatible

• Avc2 – use data extraction

• Svc1 – No AVC compatible

• It is recommended to store AVC base layer in a separated AVC base track.

SVC enhancement layer data reference the AVC base track



Outline

I. SVC Introduction


III.SVC File Format

IV.Examples of Use



Example I – Simple Extractor Tracks



Example II – Base Track



Example III – Aggregator Uasge

• Including NAL units in an aggregator

• Referencing NAL units by an aggregator



Example IV – Reading Map and Group Information




Tiers Tier T0: H.264/AVC base layer (QCIF at 15 fps). Tier T1: spatial enhancement of T0 to CIF. Tier T2: temporal enhancement of T1 to 30 fps. Tier T3: spatial enhancement of T2 to 4CIF (including the MGS

enhancement). Groups

Group G0 Tier T0, primary definition; Group G1 Tier T0, tier IDR; Group G2 Tier T1, primary definition; Group G3 Tier T1, tier IDR; Group G4 Tier T2, primary definition; Group G5 Tier T3, primary definition; Group G6 Tier T3, tier IDR.




Maps Map M0: G1, G3, G3, G6, G6, G5, G5 (as in sample 0); Map M1: G0, G2, G5, G5 (as in samples 1 and 2); Map M2: G4, G5, G5 (as in samples 3 and 4).

Samples Sample 0: M0; Sample 1: M1; Sample 2: M1; Sample 3: M2; Sample 4: M2.



Summary

• The SVC File Format defines techniques to describe operation

points and the resulting grouping of bit stream elements

• It describes the bit stream structure and the dependencies exited

between bit stream elements

• Defines 3 types of scalability assisance

• Precomputed scalability assistance

• Scalability assistance through tiers (mainly assistance for layered

scalability)

• Scalability assistance with parallel metadata


file format for scalable video coding outline

Documents

jeff jiangfile format

file compliespermission

time structure data

media data themselvescmpt

set of time parallel

forms of tracks

cube modeltemporal

number of nal unitscmpt