high definition in the archive domain

May 5, 2010High Definition in the Archive Domain

Joint Technical Symposium - 2010

Introduction – HDTV some key points

01

HD in the Archive Domain | May 5, 2010 3

A quick comparison HD/SD

Offer better and more attractive programmes to the viewer. It is done through:A better picture resolution allowing a new viewing distance (3H versus 6H)

A better sound quality : 5.1 versus mono or stereoA 16/9 aspect ratio wide screen versus 4/3More scanning modes: Progressive or interleaved versus interleaved.

720 pixels per line576 Active lines( from 200 000

to 400 000 pixels)

1280 or 1920 pixels per line

720 or 1080 active lines

( from 900 000 to 2 000 000 pixels)

Image definition

Audio Mono or Stereo Sound 5.1Digital Dolby

6 tracks

Scanning

Interleaved(i)

50 or 60 Hz

Interleaved ( i)

Progressive (p)

Progressive Segmented Frame (PSF)

50 , 60 ,24 Hz

SD HD

Aspect ratio 4/3 or 16/9 16/9


HDTV formatsInternational formats and standards are well defined and adopted but they are numerous:

Number of active pixels

per line

Number of active lines

per frame

Frame rates

Formats are described by:

Picture aspect ratio

Scanning mode

1920

1440

1280

1080

720

60

59,94

30

29,97

25

24

23,98

16/9interleaved

progressive

psf


HDTV formats and standards

Most popular formats are:

1920x1080i 1280x720p

50i,60i,25p,25 psf,30p,30 psf,50p and 60 p) and (24 p and 24 psf)

at

Going from one format to another requires cross conversion.

Calculation ofpixels

and lines

Frame rate conversion

Interleave or de-interleave


But there are as many practices as televisions….

There is a great variety of formats and compressions used in production postproduction and broadcast.The production standard for TV programs is not necessarily the same as the broadcast standard Though “labelled HD”, The “real quality” may vary in a wide range.


A wide range of shooting solutions and qualityHD shooting

Low end solutions Broadcast solutions

HDVMPEG2 25Mb/s

long GOP 6 or 12

AVCHDH264 21Mb/s

long GOP

Sony’s HDXDCAMMPEG2 422 up to 50Mb/s

on 50GBoptical disk

Panasonic’s DVCPRO HD AVC intra up to 100Mb/s

on 64 GB P2 cards

Sony’s’ XDCAM EX MPEG2 up to 35 Mb/s

on 32 GB SxS cards

Grass Valley Infinity JPEG2000 up to 100 Mb/s

on Hard drive

High quality capture

HDCAM SRup to 880Mb/s in high speed mode

on tape


Main used compression types

MPEG2 HD

DV HD

H264 HD MJPEG

DNx(AVID)

Pro res (Apple)

JPEG2000

DVC pro HD

HD compressions


Most used compression schemes

Shooting Post Production Play out

MPEG2 HD long GOP

MPEG2 HD short GOP

DV HDAVC long GOP

AVC intra

Base band 1,5GB/sMPEG2 HD :up to 300Mb/s

DV HD up to 100Mb/sProprietary formats:

Pro Res (Apple)DNx (Avid)

Others...

MPEG2 HD20 to 80Mb/s

Broadcast

MPEG2 HD15 to 20Mb/s

H2648 to 16Mb/s

Archiving

?

JPEG20

00

DPX D10

AVC-Intra

The Challenges

02


The challenges

More and more televisions are producing and broadcasting HDTV.The ratio of SD programmes versus HD programmes is decreasing rapidlyArchivists must face and manage 2 new challenges:

How to collect, store and make

accessible these new HD digital programmes?

How could SD archives be re-used in

a HD environment?

and


Archiving HD

Standard definition video(uncompressed)

720 pixels 576 lines

1- hour programme file size : 72 GB

High definition video(uncompressed)

1980 pixels 1080 lines

1- hour programme file size : from 374 GB to 673 GB*

according to frame rates

To archive HD, Compression “could” be required.

?

JPEG20

00

DPX D10

AVC-Intra

? ?

??


Using SD in HD programs

Sometimes, archivists have already digitised their original analogue archives in SD.

Questions …

How could these SD preservation masters be used and match the quality requirements of HDTV?

When will we need to reuse original media?

What kind of process do we need,to try to match HD quality requirements?


Using SD in HD programs : video and film archives...

SD video program

Up conversion HD program

Film programs16/S16/35 mm

Up conversion

SD telecine

HD telecine

HD program

?


Using SD in HD programs : About up conversion...

The quality of the HD output depends very much on the quality of up conversion.

The main functions that an up converter must achieve, are:Calculation of missing pixels and linesFrame rate conversionResizing

Interleaving or de-interleaving

Frame rate conversion (cross conversion) could also degrade the picture.


Using SD in HD programs : About resizing...

4:3 16:9

Top/ Bottom Crop

4:3 16:9

Side Panel

There are several possibilities to show 4/3 pictures in 16/9 programs

4:3 16:9

Stretching

Zoom,and stretching

?

Current practices

03


The questionnaire

In 2009 a short questionnaire about HDTV current practices has been sent to FIAT/IFTA members.This questionnaire has 4 chapters: 1-General information and current situation about HD of the company or television.2-Technical information about formats and standards used in the company for :>shooting>production and post production>Mastering >broadcasting3-HD programs archiving >Volumes, media ,storage>expected evolutions or plans in the company about HD archiving?4-Use of SD archives in HD programs.


The questionnaire

12 companies have answered to the questionnaire:> Sound and Vision National Dutch Broadcast archives for Public Broadcast> ORF Austrian Broadcasting Corporation> SBS Korea> TFO French educational channel Toronto (Canada)> Televisio de Catalunya TVC (Spain)> CBS News> TSR Télévision Suisse Romande > SVT> CBC radio Canada> NBC news /NBC universal> NHK> CCTV


Production: from shooting to broadcastingshooting Format1920x 1980 61280x 720p 21440x1080 1other 3

HDCAM/HDCAM SR 5HDXDCAM 3 DVCpro P2 3DNX HD 1D5 1ohter 1

ProductionHDCAM HDCAM SR 2HDXDCAM 3DnX HD 4Pro res 1DVCpro HD 2

MasteringHDCAM/HDCAM SR 5XDCAM HD 3D10? 1D5 1DVCpro HD 2

BroadcastingMPEG2 10H264 2

It seems that shooting full HD is predominantAlmost all televisions use all formats and shooting solutions :

Most used media are HDCAM HDXDCAM and DVCPro HD

For postproduction, most of the companies use AVID DNx file format either 120 or 185. For mastering HDCAM/HDCAM SR is preferred

MPEG2 broadcasting is still far ahead compared to H264.


Archiving

Most companies archive original format on the shelves, but most of them intend to go file

MPEG2 HD seems to be the file format in use (or most expected)

H264 HD seems too young to be considered as a file format for archives

JPEG2000 that is standardised for digital cinema, is not well known and considered in televisions.

Current archivingOn the shelves 8archiving as files 2

intend to archive as filesYes 7not yet chosen 3

files MPEG2 and XDCAM 4DVCPro HD 2JPEG2000 1 on film onlyDNx 1


4/3 use policy

Generally televisions perform up conversion indoor while independent archivists prefer to let end users to achieve the transformation.

The use of pillar box presentation has the preference of the televisions and archivists. When the choice is made by the end user, any kind of transform may happen….

resizePilar box 6 no resizetop bottom crop 3stretch/zoom 0choice by end user 3

up conversionindoor 9end user 2

Our projects …..

04


From our archives (SD) …..

We have now 450 000 hours of digitalized videos, mainly on the MPEG2 (8 Mb/s) format.

Fortunatly we went through a phase of dubbing on numeric Betacam, and we store hundreds thousands of numeric tapes.

The goal is to transfert the tape on files :To enable an easy use of archivesTo enable an easy use of upscaling and restoration for video and

film(… with some new HD transfert for the 35 mm film)

But we want to forget the tape without regrets …


From our archives (SD) ….. A new format

We want a new formatWith complete specifications and documentation

Without impact of Patents (preferably) We store the national heritage!

With a very hight qualityIntraFrame, 4:2:2, 10 bits, 8 audio channels etcFrom 50 Mb/s to 100 Mb/s or more

This year we build a model to help us make the choice between : Several competitors AVC-Intra, D10, DPX and … JPEG2000

For our SD archives and for the new incoming HD programs.


Model ...

STORAGE

Tape Library Scalar 10K

LTO 5

HSM

HDCAMHDCAM SR

BetacamNumeric Beta

Encoding in « NewFormat » wrapping in MXF

Encoding in « NewFormat » wrapping in MXF

Encoding orTranscoding

in « NewFormat » wrapping in MXF

Clipping

TranscodingUpscaling

x N

DV, MPEG HD, H264, DNx On demand !

RestitutionSDI/HDSDI

Clipping TranscodingUpscaling

RestitutionFTP

Transcoding

H264Proxy

Serveur NAS

x N

FilesPublic TV

SDI

SDI

SAN


Thank you for your attention

[email protected]

high definition in the archive domain

Documents

hd programmes

5gbsmpeg2 hd

labelled hd

mbsdv hd

hd environment

archiving hd

hd programssometimes

hd output