ontology-based multi-domain metadata for research data management using triple stores

Ontology-based multi-domain metadata for research data

management using triple stores

João Rocha da Silva joaorosilva@gmail.com

Faculdade de Engenharia da

Universidade do Porto / INESC TEC

Cristina Ribeiro mcr@fe.up.pt DEI—Faculdade de

Engenharia da Universidade do

Porto / INESC TECJoão Correia Lopes jlopes@fe.up.pt

IDEAS '14, July 07 - 09 2014, Porto, Portugal

Contents• Diverse metadata: relational modeling challenges

• Current approaches built on relational databases

• Dendro: graph-based research data management

• Live demo

• Conclusions

Problem: diverse metadataRelational modeling challenges

Analytical Chemistry Dataset

Mechanical Engineering Dataset …

GenericAuthor

Description Creation date

Author Description

Creation date …

Domain Specific

Sample Count Analysed Substance

Initial Crack Length Specimen Type

Common challenges in RDB schema modeling

• Entities with unknown attributes at time of modeling

• Time-variant attribute values

• Inheritance / sub-class mapping

• Resource hierarchies (parents of parents…)

• Schemas rely on external documentation5

Data management and description platforms

Study of relational models

DSpace

• Academic publications management platform

• Not targeted specifically at data

• More than 1000 active installations

• Mature open-source codebase

DSpace

• Designed for self-deposit by common users

• Good deposit workflow (validation, licensing…)

U.Porto Open Repository Homepage (http://repositorio-aberto.up.pt)

Powered by DSpace

A thesis record in the repository (http://repositorio-aberto.up.pt/handle/10216/58508) 10

Bitstream Metadata Schema

Metadata Descriptor

metadata value

DSpace

• Metadata profiles for objects other than Items

• Descriptor hierarchy for specialization

• Collaborative schema derivation

• Validation of metadata completeness against different schemas

• Restricting possible metadata for each type of resource

New requirements

• Open-source data publishing platform

• Deposit requires minimal metadata at first

• Flexible metadata model

• Open-Source

!source CKAN 18

Entity with variable, time-dependent

attributes

!source CKAN 18

attributes

Fixed attrs.

!source CKAN 18

Attribute name

attributes

Fixed attrs.

!source CKAN 18

Attribute name

Value (always varchar)

attributes

Fixed attrs.

!source CKAN 18

Attribute name

Timestamps

Value (always varchar)

attributes

Fixed attrs.

!source CKAN 18

Invenio• Software behing Zenodo, a data publishing portal

• Static metadata model

• Very complex relational schema generated by business logic code

• Tight coupling between DB and code

• Open-Source

541 Tables

No FKs

OntologiesSemantic annotation for richer metadata

!!!!!!

http://dendro.fe.up.pt/project/datanotes/data/base

%20data.xls

http://dendro.fe.up.pt/project/datanotes/data

nie:isLogicalPartOf

!!!!!!

%20data.xls

nie:isLogicalPartOf

rdf:type

nie:File

!!!!!!

%20data.xls

nie:isLogicalPartOf

“Base data of the DCB experiments”

dc:titlerdf:type

nie:File

!!!!!!

%20data.xls

nie:isLogicalPartOf

dc:title

base data.xls

nie:title

rdf:type

nie:File

!!!!!!

%20data.xls

nie:isLogicalPartOf

dc:title

base data.xls

nie:title

rdf:type

nie:File

base data.xls

dcb:initialCrackLength

!!!!!!

%20data.xls

Semantic MediaWiki• Semantic extension of MediaWiki, the code behind

Wikipedia

• Semantic Links between pages

• Uses ontologies

• Strong emphasis on page versioning

• DB schema built around the time dimension

Loading an ontology

Describing a resource

Semantic Forms

From DataNotes + UPBox http://purl.pt/24107/1/iPres2013_PDF/UPBox%20and%20DataNotes%20a%20collaborative%20data%20management%20environment%20for%20the%20long%20tail%20of%20research%20data.pdf

Semantic Forms

source MediaWiki

“Old Versions” aka “copy everything and add a timestamp” 31

!source MediaWiki

now imagine we want images of different kinds, with different attributes…

Redundancy…

Relational Database (MySQL)

Triple Store (Apache

Jena)Mapping Logic

DSpace

Invenio

Semantic MediaWiki

Flexible attributes

Wide use

DB-code coupling

Issues review• Entities with unknown attributes at time of modeling

• Time-variant attribute values

• Inheritance / sub-classing

• Hierarchies (parents of parents of parents…)

• Need for external documentation

Dendroa graph-based data management platform

Graph databases • Represent entities (Users, Products, Places…) as

vertexes (entity types are called classes)

• Connections between them are directed graph edges (edge types are called properties)

• The meaning of these connections is expressed in ontologies that can be shared and reused

Getting all my Projects

• Will fetch all the projects created by the user

• Will also return their attributes (“database columns”)

• Different projects may have different attributes38

Inference

• Transitive Properties

• Subclasses

• Multiple Inheritance

•Resource can be a Folder and a Dataset at the same time)

Loading an ontology

• Load ontology straight from the web

• No platform-specific syntax (like in SMW)

Nothing comes for free• Aggregation operators slow

• No ACID properties

• Transactions are not supported in standard SPARQL

• (“SPARQL 1.1 Query/Update Services should be atomic but that they are not required to be atomic.”)

• Graph DBMS Solutions are in early stages (many bugs, many “beta”s, many mailing lists…)

Dendro • Dropbox and File/Folder description platform

• Variable descriptions

• Time-dependent values

• Directory structures (hierarchy)

• Need for simple querying…

nie:isLogicalPartOf

“DCB Base Data”

dc:title

dcb:specimenWidth

dc:isReferencedBy

dc:title

dcb:specimenWidth

dc:isVersionOf

Added propertyinstance

01/01/2014^^xsd:date

dc:created

01/01/2014^^xsd:date

dc:modified

Changedmodificationtimestamp

Revision creation

timestamp

dc:creator

Current dataset version Past Revisions

ddr:pertainsTo

Change recording

ddr:initialCrackLen

ddr:changedDescriptor

“add”

ddr:operation

“DCB Base Data”

nie:isLogicalPartOf

“DCB Base Data”

dc:title

dcb:specimenWidth

dc:isReferencedBy

dc:title

dcb:specimenWidth

dc:isVersionOf

01/01/2014^^xsd:date

dc:created

01/01/2014^^xsd:date

dc:modified

Revision creation

timestamp

dc:creator

ddr:pertainsTo

Change recording

ddr:initialCrackLen

“add”

ddr:operation

“DCB Base Data”

nie:isLogicalPartOf

“DCB Base Data”

dc:title

dcb:specimenWidth

dc:isReferencedBy

dc:title

dcb:specimenWidth

dc:isVersionOf

01/01/2014^^xsd:date

dc:created

01/01/2014^^xsd:date

dc:modified

Revision creation

timestamp

dc:creator

ddr:pertainsTo

Change recording

ddr:initialCrackLen

“add”

ddr:operation

“DCB Base Data”

nie:isLogicalPartOf

“DCB Base Data”

dc:title

dcb:specimenWidth

dc:isReferencedBy

dc:title

dcb:specimenWidth

dc:isVersionOf

01/01/2014^^xsd:date

dc:created

01/01/2014^^xsd:date

dc:modified

Revision creation

timestamp

dc:creator

ddr:pertainsTo

Change recording

ddr:initialCrackLen

“add”

ddr:operation

“DCB Base Data”

nie:isLogicalPartOf

“DCB Base Data”

dc:title

dcb:specimenWidth

dc:isReferencedBy

dc:title

dcb:specimenWidth

dc:isVersionOf

01/01/2014^^xsd:date

dc:created

01/01/2014^^xsd:date

dc:modified

Revision creation

timestamp

dc:creator

ddr:pertainsTo

Change recording

ddr:initialCrackLen

“add”

ddr:operation

“DCB Base Data”

nie:isLogicalPartOf

“DCB Base Data”

dc:title

dcb:specimenWidth

dc:isReferencedBy

dc:title

dcb:specimenWidth

dc:isVersionOf

01/01/2014^^xsd:date

dc:created

01/01/2014^^xsd:date

dc:modified

Revision creation

timestamp

dc:creator

ddr:pertainsTo

Change recording

ddr:initialCrackLen

“add”

ddr:operation

“DCB Base Data”

Dendroβ

Conclusions• Recording rich metadata requires data model

flexibility

• Unknown attributes, time-variant information or hierarchies can be hard to model in a relational database

• Several current solutions make compromises due to their relational database layer

Conclusions (cont’d)• Graph-based models are more flexible and easily

expansible through ontology loading

• Ontologies are shareable on the web, and document the database “schema”

• Queries become simpler due to the graph model’s ability to easily model challenging scenarios for RDBs

• Dendro is a collaborative data management platform fully built on a graph model

João Rocha da Silva is an Informatics Engineering PhD student at the Faculty of Engineering of the University of Porto. He specializes on research data management, applying the latest Semantic Web Technologies to the adequate preservation and discovery of research data assets.!!He is also an experienced freelancer iOS Developer with several Apps published on the App Store, and a self-taught DIY mechanic with a special interest in classic cars, particularly his 1987 Toyota Corolla GT Twin Cam, also known as Hachi-Roku or AE86.!

Research Data Management and Semantic Web Researcher, Web & iPhone DeveloperJoão Rocha da Silva!

João Correia Lopes is an Assistant Professor in Informatics Engineering at Universidade do Porto and a researcher at INESC TEC. He has graduated in Electrical Engineering in the University of Porto in 1984 and holds a PhD in Computing Science by Glasgow University in1997. His teaching includes undergraduate and graduate courses in databases and web applications, software engineering and object-oriented programming, markup languages and semantic web. He has been involved in research projects in the area of long-term preservation, service-oriented architectures and e-Science. Currently his main research interests are e-Science and the management of research data.

Cristina Ribeiro is an Assistant Professor in Informatics Engineering at Universidade do Porto and a researcher at INESC TEC. She has graduated in Electrical Engineering, holds a Master in Electrical and Computer Engineering and a Ph.D. in Informatics. Her teaching includes undergraduate and graduate courses in information retrieval, digital libraries, knowledge representation and markup languages. She has been involved in research projects in the areas of cultural heritage, multimedia databases and information retrieval. Currently her main research interests are information retrieval, digital preservation and the management of research data.

Assistant Professor in Informatics Engineering at Universidade do Porto, Researcher at INESC TECCristina Ribeiro!

Assistant Professor in Informatics Engineering at Universidade do Porto, Researcher at INESC TECJoão Correia Lopes!

ontology-based multi-domain metadata for research data management using triple stores

source ckan

upbox http

source mediawiki

repository http

type nie

metadata value

projectdatanotesdata

domain metadata

Software

jena based implementation of a iso 11179 metadata...

the medred ontology for representing clinical data...

ontology metadata in ncbo bioportal: requirements and...

21-sep-07food and agriculture organization of the united...

ontology-focused crawling of documents and relational...

a controlled crowdsourcing approach for practical ontology...

image driven ontology editing - university of texas at...

ontology alignment. ontology alignment ontology alignment...

part 2: ontology development, tools and languages€¦ ·...

the omv ontology metadata vocabulary -...

omv ontology metadata vocabulary april 10, 2008 peter haase

o m v ontology metadata vocabulary for the semantic...

fibo metadata in ontology mapping -...

clinical metadata ontology: a simple classification scheme...

modeling the complexity of music metadata in semantic...

ontology, metadata, and semiotics - sowa

package ‘annotationdbi’ - bioconductor · ontology: for...

a non-authoritative educational metadata ontology

clustering ontology-based metadata in the semantic web ·...

evaluation of the ontosoft ontology for describing metadata...