Juergen Enge 1

media/art/library

media/art/librarycontent, structure and use of digital media libraries

Dipl. Inform. Jürgen Engejuergen@info-age.net

Juergen Enge 2

media/art/library

Arndt, Olaf; Moonen, RobCamera Silens (1994)

Where is the wisdom we have lost in knowledge? Where is the knowledge we have lost in information? T.S. Eliot, The Rock(1934)

Juergen Enge 3

media/art/library

BjörkAll is Full of Love

(2000)

Juergen Enge 4

media/art/library

Bubbles (2000)Wolfgang MünchKiyochi Furukawa

Juergen Enge 5

media/art/library

Interactive Plant Growing (1993)Christa Sommerer

Laurent Mignonneau

Juergen Enge 6

media/art/library

Cathartic user interface (1995)Perry Hoberman

Juergen Enge 7

media/art/library

Traditional Institutions for Archiving

• Libraries• books

• atlas, maps and cartographical drawings

• Museums• plaster mold collections

• collection of prints and drawings

• collection of photography

Juergen Enge 8

media/art/library

Aby Warburg:Mnemosyne Atlas (1925-29)

Juergen Enge 9

media/art/library

Aby Warburg:File-Card Box System

Juergen Enge 10

media/art/library

The Rumbling of ArchivesOrder from Disorder (2002)

Juergen Enge 11

media/art/library

“The archive is no longer a matter of discrete objects (files, books, art works, etc.) stored and retrieved in specific places (libraries, museums, etc.). Now the archive is also a continuous stream of data, without geography or container, continuously transmitted and therefore without temporal restriction (always available in the here and now).”

(Geoffrey Batchen, "The Art of Archiving")

Juergen Enge 12

media/art/library

Challenges for Contemporary Archives

Juergen Enge 13

media/art/library

Digital Media Collections @ ZHdK (excerpt)

• Medien- und Informationszentrum MIZ

• Several thousand TV recordings

• Institute for Computer Music and Sound Technology

•IDEAMA archive

•Bourges festival archive

• ZHdK Collections for Teaching and Research

• Image archive

• Diploma archives

• Additional collections

Juergen Enge 14

media/art/library

IDEAMA

Juergen Enge 15

media/art/library

Karlheinz Stockhausen, »Mikrophonie I«, 1966

Presentation of Mikrophonie 1 at WDR Cologne, June 1965; VLNR: Johannes Fritsch, Aloys Kontarsky, Bernhard Kontarsky, Alfred Alings

Juergen Enge 16

media/art/library

IDEAMA

Juergen Enge 17

media/art/library

IDEAMA

Juergen Enge 18

media/art/library

Work

Composer

Bio [fr]

Bio [de]

Bio [en]

Set 1Set n

Track 1 Track n

Desc [fr]

Desc [de]

Desc [en]

Juergen Enge 19

media/art/library

IMEB Institut de Musique Electroacoustique de Bourges

Juergen Enge 20

media/art/library

IMEB Institut de Musique Electroacoustique de Bourges

Juergen Enge 21

media/art/library

IMEBInstitut de Musique

Electroacoustique de Bourges

Juergen Enge 22

media/art/library

Biography

Work 1

Work n

Description

Medium 1 Medium n

Digital Master

Juergen Enge 23

media/art/library

MIZ Medien- und Informationszentrum

Juergen Enge 24

media/art/library

MIZ – TV Recordings

Juergen Enge 25

media/art/library

Modern Times (1936)Charlie Chaplin

Ingest

Juergen Enge 26

media/art/library

Modern Times (1936)Charlie Chaplin

Juergen Enge 27

media/art/library

Painting and DrawingsSculpturePhotographyDesign ObjectsAudio and Video etc.

Painting and DrawingsSculpturePhotographyDesign ObjectsAudio and Video etc.

Stream of data

ImagesTextAudio and VideoAnimation and 3D GraphicsSoftwareetc.

ImagesTextAudio and VideoAnimation and 3D GraphicsSoftwareetc.

Digital Master

Digital Master

Physical Object

Born Digital DataD

igitisation

Copy

ArchiveArchiveIngest

MetadataMetadata

Context

Technical Metadata

Juergen Enge 28

media/art/library

Digitisation

Sign in Korean TV Station SBS (Seoul)

Juergen Enge 29

media/art/library

Digitising - Video

Juergen Enge 30

media/art/library

Johannes Gfeller - AktiveArchive

Juergen Enge 31

media/art/library

Cleaning Process

Fotos: Patricia Falcao / Tabea Lurk

Juergen Enge 32

media/art/library

Time Base Correctors and Video Player

Foto: Johannes Gfeller

Juergen Enge 33

media/art/library

Software Interface

AJA IO Box

Juergen Enge 34

media/art/library

Player

TBC

A/D Converter

Video

Digital Tape Recorder

Computer + Film Editing ProgramA

udio

Audio Mixer

Tape

Digital File Storage System

Digitisation Process

Diagram: Patricia Falcao

Juergen Enge 35

media/art/library

Digital Preservation

• Long-term, error-free storage of digital information

• “long enough to be concerned with the impacts of changing technologies, including support for new media and data formats, or with a changing user community. Long Term may extend indefinitely” (Consultative Committee for Space Data Systems. OAIS, 2002)

• Preservation metadata

• Preservation metadata stores technical details on the format, structure and use of the digital content, the history of all actions performed on the resource including changes and decisions, the authenticity information such as technical features or custody history, and the responsibilities and rights information applicable to preservation actions (National Library of Australia. Preserving Acces to Digital Information)

Juergen Enge 36

media/art/library

Storage Systems

Juergen Enge 37

media/art/library

Artistic Concept of Preservation

Pickled Film (1973/2005)Tony Conrad

Juergen Enge 38

media/art/library

Ingest

Juergen Enge 39

media/art/library

Ingest Process• Transfer of digital master to long-term-storage

• Creation of transcoded derivates

• Connection of digital master and its derivates with metadata

• Insertion of metadata

• Technical metadata (automatic)

• Content based indexing (automatic)

• Preservation metadata

• Edited metadata (based on predefined conventions)

Juergen Enge 40

media/art/library

Sync. Ingest Process

Juergen Enge 41

media/art/library

Async. Ingest Process

• ACID

• Atomicity

• Consistency

• Isolation

• Durability

Juergen Enge 42

media/art/library

ZHdK Video Transcoding Grid

2008-02-17: 122 Transcodings (Gesamtlänge: 78:52, Durchschnitt: 00:38, Speedup/CPU: 5.46, CPU time: 431:04)2008-02-16: 126 Transcodings (Gesamtlänge: 124:01, Durchschnitt: 00:59, Speedup/CPU: 5.39, CPU time: 668:21)2007-12-13: 233 Transcodings (Gesamtlänge: 148:52, Durchschnitt: 00:38, Speedup/CPU: 4.07, CPU time: 605:38)2007-12-09: 57 Transcodings (Gesamtlänge: 75:43, Durchschnitt: 01:19, Speedup/CPU: 3.81, CPU time: 288:49)2007-12-08: 191 Transcodings (Gesamtlänge: 104:07, Durchschnitt: 00:32, Speedup/CPU: 3.98, CPU time: 414:34)2007-12-07: 271 Transcodings (Gesamtlänge: 156:56, Durchschnitt: 00:34, Speedup/CPU: 4.03, CPU time: 632:37)2007-12-06: 227 Transcodings (Gesamtlänge: 203:39, Durchschnitt: 00:53, Speedup/CPU: 3.92, CPU time: 797:26)2007-12-05: 163 Transcodings (Gesamtlänge: 157:24, Durchschnitt: 00:57, Speedup/CPU: 3.94, CPU time: 619:28)2007-12-04: 168 Transcodings (Gesamtlänge: 213:55, Durchschnitt: 01:16, Speedup/CPU: 3.88, CPU time: 829:31)2007-12-03: 143 Transcodings (Gesamtlänge: 192:13, Durchschnitt: 01:20, Speedup/CPU: 3.82, CPU time: 733:55)2007-12-02: 139 Transcodings (Gesamtlänge: 177:34, Durchschnitt: 01:16, Speedup/CPU: 3.88, CPU time: 689:41)2007-12-01: 98 Transcodings (Gesamtlänge: 121:33, Durchschnitt: 01:14, Speedup/CPU: 3.97, CPU time: 482:28)2007-11-30: 157 Transcodings (Gesamtlänge: 192:48, Durchschnitt: 01:13, Speedup/CPU: 3.92, CPU time: 756:25)2007-11-29: 89 Transcodings (Gesamtlänge: 108:13, Durchschnitt: 01:12, Speedup/CPU: 3.87, CPU time: 419:00)2007-11-28: 118 Transcodings (Gesamtlänge: 158:24, Durchschnitt: 01:20, Speedup/CPU: 4.64, CPU time: 735:32)2007-11-27: 110 Transcodings (Gesamtlänge: 141:19, Durchschnitt: 01:17, Speedup/CPU: 4.71, CPU time: 665:25)2007-11-26: 71 Transcodings (Gesamtlänge: 85:02, Durchschnitt: 01:11, Speedup/CPU: 4.87, CPU time: 414:07)2007-11-25: 125 Transcodings (Gesamtlänge: 123:59, Durchschnitt: 00:59, Speedup/CPU: 4.92, CPU time: 610:20)2007-11-24: 104 Transcodings (Gesamtlänge: 123:31, Durchschnitt: 01:11, Speedup/CPU: 4.79, CPU time: 591:13)

Juergen Enge 43

media/art/library

Juergen Enge 44

media/art/library

Metadata

Juergen Enge 45

media/art/library

Metadata – Dublin Core

Juergen Enge 46

media/art/library

Metadata – IFLA

Juergen Enge 47

media/art/library

Archival Systems @ ZHdK

• DILPS - Distributed Image Library Processing System (Open Source)

• Wiki Based Systems

• Audio Archives

• Specialised Systems

• Video Library

Juergen Enge 48

media/art/library

DILPS 2.0

Juergen Enge 49

media/art/library

• Item centric• Structural

elements– Collection– Item– Resource– Media

• Variable metadata set

Collection

Item

Juergen Enge 50

media/art/library

Item Resource

Juergen Enge 51

media/art/library

Resource

Main MediumURN

PreviewURN

(Thumbnail)

PreviewURN

(QVGA)

PreviewURN

(VGA)

URN:

urn:zhdk:library/2789/00:00:05/masterurn:zhdk:library/2789/00:00:05/thumb…

Juergen Enge 52

media/art/library

Arrangement by groups

Group Resource

Juergen Enge 53

media/art/library

Metadata

• Core metadata set (fixed)

• Extended metadata set (free, depends on object type)

• Versioning (no changes to metadata. Only new sets will be attached and old ones will reside on database)

• Metadata view depends on object type (label and fields)

Juergen Enge 54

media/art/library

• Special data type: Date– Every date is an interval– Datestrings are parsed with predefined regular

expressions• „Around 1950“• „17th century“• „Middle ages“• „2007-11-04“• „1973-1977“

– Searching means interval search on two intervals

Juergen Enge 55

media/art/library

URN / Storage• URN resolves to URL based on

– Location– Access protocol– urn:hgkz:design/8:2332/9014/thumb

• file:///data/dilps/design/lib01/d/c/120x90_9014.jpg (direct file system access)

• http://media3.hgkz.ch/dilps2/resource.php/design/lib01/d/c/120x90_9014.jpg?__SID__ (access via http protocol)

Juergen Enge 56

media/art/library

Authentication

• Domain based authentication model• Every domain uses its own authentication

subsystem• Authentication Entities

• User (z.B. zhdk/enge)• Group (z.B. zhdk/DDE_ITE.dozierende)• Location (z.B. 192.168.10.12)

Juergen Enge 57

media/art/library

AAI Integration

• The DILPS backend is able to accept users from Switch AAI domain

• Granularity of group information sufficient for many cases

• Web2.0 Interface doesn‘t allow seemless AAI login (due to redirect)

• Excellent possibility for cooperation projects with other institution based on shared media storage• Eventually additional need for group management tool

Juergen Enge 58

media/art/library

• Access Control Lists are available for all structural elements– Collection– Item– Resource– URN– Group

• Rights– Read– Write– Execute– Create– Permission– Revoke

Authorisation

Juergen Enge 59

media/art/library

Playout of digital Media

Juergen Enge 60

media/art/library

Juergen Enge 61

media/art/library

Juergen Enge 62

media/art/library

Juergen Enge 63

media/art/library

Juergen Enge 64

media/art/library

Eigenwelt der Apparatewelt.The Net Edition (1992/2006)

Vasulka/Dunn/Weibel/Enge

Juergen Enge 65

media/art/library

Infoscreen Playout

Juergen Enge 66

media/art/library

Fallende Scheibe 3 (1986)Dieter Kiessling

Denis_Beaubois___Amnesia_.flv

Juergen Enge 67

media/art/library

Amnesia (2002)Denis Boubeaubois

Juergen Enge 68

media/art/library

Amnesia (2002), Denis Beaubois