database management and innovative applications for imaging museum laboratories ruven pillay, c2rmf...

24
Database Management and Database Management and Innovative Applications for Innovative Applications for Imaging Museum Laboratories Imaging Museum Laboratories Ruven Pillay, C2RMF Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

Upload: heather-fowler

Post on 02-Jan-2016

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

Database Management and Database Management and Innovative Applications for Innovative Applications for

Imaging Museum LaboratoriesImaging Museum Laboratories

Ruven Pillay, C2RMFRuven Pillay, C2RMF

SauveurPrague, 31 May – 2 June 2006

Page 2: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

C2RMF

● Research and Restoration Centre

● Created in 1931● Mission to

scientifically study, document and preserve works of art from all French museums

Page 3: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

EU Projects

● 11 projects within the ESPRIT, IMPACT, RAPHAEL, IST and e-CULTURE frameworks since 1989

1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007VASARI

NARCISSE VISEUM

MENHIRACOHIR

CRISTALARTISTE

CRISATELdatabase management CHERI

image digitisation and analysis SCULPTEURe Culture Net

Art3D, CNRS masse de donnéesMétamorphose, CNRS

1Gbytes 5Gbytes10Gbytes 100Gbytes/ jukebox 1000Gbytes

TEXTO / SUN INFLUX / SUN MySQL / Linux

Page 4: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

Project Themes

● Advanced Digital Imaging● Image Analysis● 3D Imaging/Modeling● Technical Vocabularies and Ontologies● Database Management

Page 5: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

Digital Imaging

● Large historical scientific photo-archive dating back to 1931

● NARCISSE project in 1989: scanning of photographic archives at 6,000 x 8,000 pixels

Page 6: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

Multispectral Imaging

● VASARI project● 7 filter camera (400-700nm)● 10,000 x 10,000 pixel resolution● High colour accuracy of ~1dE in

CIEL*a*b* colour space● Custom image processing software,

VIPS, developed to handle large images – resused in subsequant projects

Page 7: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

Multispectral Imaging

● CRISATEL project● Portable camera● Higher resolution

20,000 x 12,000 pixels

● Sweeping light system minimizes damage to painting

Page 8: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

Multispectral Imaging

● 13 interferential dichroic filters 400nm - 1000nm

Page 9: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

Spectral Reconstruction

● Pigment Identification

● Illuminant simulation

Page 10: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

3D Imaging

● ACOHIR project● Panoramic view● Colour calibrated

Page 11: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

Panoramic Sequences

● Visible panorama● X-ray panorama

Page 12: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

3D Modeling

● SCULPEUR project● Hardware from ACOHIR● Volumetric mapping via silhouette

extrusion

Page 13: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

High Definition Models

Page 14: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

3D Scanning of Paintings

● Laser-based

Page 15: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

3D Scanning of Paintings

Page 16: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

Visualization

● VISEUM project● Exchange of images

between institutions● Tiled Pyramidal TIFF● Client only requests

viewable area● Tiles dynamically JPEG

compressed and then sent to viewer

● Fast viewing with low memory requirements

Page 17: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

How it works

Page 18: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

How it works

Page 19: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

Content Based Retreival

● ARTISTE project● Image recognition● Classification by colour coherence, spatial

distribution etc● Possible Uses:

Correlate artists to colours used or shapes Analysis of artist styles Technique analysis eg knife, brush Inscription characterisation eg signatures, motifs Ageing features eg lacuna, cracks, repaints

● Extended to 3D models in SCULPTEUR project

Page 20: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

Ontologies & Semantic Web

● NARCISSE – first database● CRISTAL – technical vocabulary definitions

and translations into 10 languages● SCULPTEUR – CIDOC mapping

Page 21: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

Project Fusion

● Bring project results together● EROS Multilingual and semantically

mapped Database● Remote viewing of

multispectral images 3D panoramas 3D models

● Search by image similarity● Database itself becomes a scientific

tool for original research

Page 22: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

EROS Database

20,000 paintings

40,000 objects

10,000 reports, articles etc

15,000 chemical analyses

Page 23: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

Dissemination

● Open Source software licenced under GPL where possible

● Allows the work to live on after end of project

● VIPS Image processing http://vips.sf.net

● IIPImage Remote visualization http://iipimage.sf.net

Page 24: Database Management and Innovative Applications for Imaging Museum Laboratories Ruven Pillay, C2RMF Sauveur Prague, 31 May – 2 June 2006

Thank You