amsterdam museum as edm linked open data

17
www.europeanaconnect.eu Amsterdam Museum as EDM LOD Victor de Boer -- VU University Amsterdam With input from Antoine Isaac, Jan Wielemaker, Jacco van Ossenbruggen and Guus Schreiber

Upload: victor-de-boer

Post on 06-May-2015

1.375 views

Category:

Technology


3 download

DESCRIPTION

Talk about conversion of Amsterdam Museum metadata to Europeana Data Model, linking it to other data sources and publishing it as Linked Open Data

TRANSCRIPT

Page 1: Amsterdam Museum as EDM Linked Open Data

www.europeanaconnect.eu

Amsterdam Museum as EDM LOD

Victor de Boer -- VU University Amsterdam

With input from Antoine Isaac, Jan Wielemaker, Jacco van

Ossenbruggen and Guus Schreiber

Page 2: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Amsterdam Museum

• Formerly Amsterdam Historic Museum

• “The rich collection of works of art, objects and archaeological finds brings to life the fortunes of Amsterdammers of days gone by and today.”

• In March 2010 published their entire

collection online

• 70.000 objects

• CC license

• We converted their data to EDM / RDF and

published it as Linked Open Data

Page 3: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Page 4: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

AM metadata

• Adlib database XML API

• Object metadata

• 73.000 objects, 256MB

• Nested XML

• Concept Thesaurus

• 27.000, 9MB

• Different types (geo,motif, event)

• Person „Thesaurus‟

• 67.000 persons, 10MB

• Consolidated from object metadata fields

• Creators, annotators, reproduction creators,

institutions

<record priref="10541“ >

<acquisition.date>1997</acquisition.date>

<dimension>

<dimension.type>hoogte</dimension.type>

<dimension.unit>cm</dimension.unit>

<dimension.value>6</dimension.value>

</dimension>

</record>

<record priref="28024“ >

<term>Kalverstraat 124</term>

<broader_term>Kalverstraat</broader_term>

<term.type>GEOKEYW </term.type>

</record>

<record priref="6" >

<biography>boekverkoper en uitgever van

cartografie</biography>

<birth.date.start>1659</birth.date.start>

<death.date.start>1733</death.date.start>

<name>Aa, Pieter van der</name>

<nationality>Nederlands</nationality>

<use>Aa, Pieter van der (I)</use>

</record>

Page 5: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Cliopatria

Conversion and alignment process

1. pure syntactic transformation to RDF

2. map to EDM classes/properties

(mapping table -> schema file)

3. conversion rules to restructure,

generate uris and do complex stuff

(XMLRDF tool)

4. align with Europeana and external

sources

5. publish as LOD

XMLRDF

Amalgame

Page 6: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Direct RDF conversion

<record priref="10541“ >

<acq.date>1997</acqdate>

<dimension>

<dimension.type>hoogte</dimension.type>

<dimension.unit>cm</dimension.unit>

<dimension.value>6</dimension.value>

</dimension>

</record>

am:Record

_:bn1am:Dimension

_:bn2

“10541”

“1997”

am:priref

am:acq.date

am:dimension

am:dim.type

am:dim.value

“hoogte”

“6”

Page 7: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Mapping schema file

• Turtle schema files

• rdfs:subClassOf + rdfs:subPropertyOf: Keep

original (specific) data, interoperability on EDM

level

• For object metadata

• Dcterms: creator, date, description

• EDM-specific properties: event, agent

• Thesaurus concepts

• SKOS + some dcterms

• Persons

• RDA Group 2 elements

• http://metadataregistry.org/schema/show/id/1

5.html

am:creditLine a rdf:Property ;

rdfs:subPropertyOf dcterms:rights .

am:dimension a rdf:Property ;

rdfs:subPropertyOf dcterms:extent .

am:documentation a rdf:Property ;

rdfs:subPropertyOf dcterms:description.

am:objectCategory a rdf:Property ;

rdfs:subPropertyOf dcterms:description.

am:scopeNote a rdf:Property ;

rdfs:subPropertyOf skos:scopeNote.

am:priref a rdf:Property ;

rdfs:subPropertyOf dcterms:identifier.

am:Person a rdfs:Class ;

rdfs:subClassOf ens:Agent.

am:equivalentName a rdf:Property ;

rdfs:subPropertyOf rda:variantNameForThePerson.

am:name a rdf:Property ;

rdfs:subPropertyOf rda:preferredNameForThePerson.

Page 8: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

XMLRDF Conversion

• RDF interpretation of the data. Minimal enrichment

• Refer to resources rather then to terms

• Identify the resource and replace literals by URIs

• Clean up (remove empty vals)

• Some blank node structures retained

• Mint URIs

• PURL basename: purl.org/collections/nl/am/

• Use prirefs, prefixed by “proxy-”, “aggregation-”, “p-” or “t-”

• Make EDM

• Establish Proxy-Aggregation-PhysObject triangle

• Move predicates to appropriate resource

• Images (ens:object)

dimensions @@

{ _S, am:dimension, B},

{ B, am:dimensionValue, literal(Val)},

{ B, am:dimensionUnit, literal(Unit)}?,

{ B, am:dimensionType, literal(Type)}?

concat ([Type,Val,Unit], ConcatVal),

{B, rdfs:label, literal(ConcatVal)}.

< am:proxy1, am:maker, _:bnode1>

< _:bnode1, am:creator, am:p-001>

< _:bnode1, am:creatorRole, am:t-printer>

< _:bnode1, am: creatorQual, “copy after”>

Page 9: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

XMLRDF Conversion

• Conversion rules are simple for flat record structures but more

complex for richer data.

• APEnet

• Amsterdam Museum

• (Initial) rules can be generated from other visual ingestion

tools.

• Simple rules, but with the full expressivity of programming language

• ~ 6 Million Amsterdam Museum RDF triples

Page 10: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Amalgame Alignment: Thesaurus

• 143 links to

GeoNames NL

• 2498 AM concepts

linked to AATNed.

• 1322 links to be

checked

http://semanticweb.cs.vu.nl/amalgame/

Page 11: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Amalgame Alignment: Persons

• 1076 AM persons

matched to ULAN

(VIAF)

• 34 matched to

DBPedia

• More for human

check

Page 12: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Serving the Data

• PURL redirects to semantic layer

• http://purl.org/collections/nl/am/proxy-63432

• http://semanticweb.cs.vu.nl/europeana/browse/list_resource?r=http://purl.org/collections/nl/am/proxy-63432

• HTTP request HTML:

• Condensed Local view

• Full Local view

• HTTP request RDF/XML

• rdf/xml “describe”

• SPARQL endpoint

Page 13: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Page 14: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Page 15: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

http://semanticweb.cs.vu.nl/europeana/user/query

Page 16: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

Linked Open Data

• Registered on CKAN

• More links

• to Amsterdam Rijksmonumenten

• to Amsterdam Stadsarchief

• to DBPedia (SILK): LATC

• Used by external parties/projects

• Oneindig NH

• Apps for Amsterdam

• Europeana Hackathon this friday/saturday

Page 17: Amsterdam Museum as EDM Linked Open Data

Amsterdam Museum as EDM LOD

Victor de Boer

Europeana v.1 WP3 Meeting

Vienna 28-29 March 2011

www.europeanaconnect.eu

URL pointers

• Amsterdam Museum in EDM LOD

• http://semanticweb.cs.vu.nl/lod/am/

• http://ckan.net/package/amsterdam-museum-as-edm-lod

• Thoughtlab

• Semantic layer

• [Browse] http://semanticweb.cs.vu.nl/europeana/

• [SPARQL] http://semanticweb.cs.vu.nl/europeana/user/query

• Tools

• [ClioPatria] http://e-culture.multimedian.nl/software/ClioPatria.shtml

• [xmlrdf] http://semanticweb.cs.vu.nl/Connect/xmlrdf.pdf

• [Amalgame] http://semanticweb.cs.vu.nl/amalgame/