hatana tmra 2010

TMRA  2010  

Hatana  A  virtual  merging  engine  

Uta  Schulze  Topic  Maps  Lab  at  the  University  of  Leipzig  

Uta.Schulze@informaBk.uni-­‐leipzig.de  

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

"Accessing the island of Hatana is a complicated process."

http://en.wikipedia.org/wiki/Hatana

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

MoBvaBon  -­‐  Not  that  complicated  

Several data sources

One view?

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

MoBvaBon  -­‐  Not  that  complicated  

Several data sources

One query language?

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

MoBvaBon  -­‐  Not  that  complicated  

Several data sources

?

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Why  puJng  data  into  topic  maps?  

Because we can.

MaJorToM-JLI

ARNotations

Coming soon

Maiana

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Why  puJng  data  into  topic  maps?  

Because we can.

Because information wants to be a topic map.

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Why  puJng  data  into  topic  maps?  

Because we can.

Because information wants to be a topic map.

Because we’d like to merge…

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Why  don‘t  we  just  put  everything  into  one  big  topic  map  and  are  done  with?  

Information

1.  changes over time

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Why  don‘t  we  just  put  everything  into  one  big  topic  map  and  are  done  with?  

Information

1.  changes over time

2.  has copyright issues

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Why  don‘t  we  just  put  everything  into  one  big  topic  map  and  are  done  with?  

Information

1.  changes over time

2.  has copyright issues

3.  has an origin that would get lost

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Why  don‘t  we  just  put  everything  into  one  big  topic  map  and  are  done  with?  

Information

1.  changes over time

2.  has copyright issues

3.  has an origin that would get lost

4.  should sometimes remain in its database

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Another  soluBon:  Hatana  

Hatana creates a layer over several data sources.

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Another  soluBon:  Hatana  

This layer behaves as a topic map!

Hatana creates a layer over several data sources.

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Example  1:  TMRA  ParBcipants  (Java  Live  IntegraBon)  

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Hatana  merges  ...  

•  strictly according to the TMDM’s equality rules of constructs

•  on demand

•  and creates „virtual” topics, associations, …

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Equality  rules  for  topics  

Graham Moore,

Vice Admiral

Graham Moore,

Footballer

Graham Moore,

Topic Mapper

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Graham Moore,

Vice Admiral

Graham Moore,

Footballer

Graham Moore,

Topic Mapper

Equality  rules  for  topics  

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Graham Moore,

Vice Admiral

Graham Moore,

Footballer

NAME EQUALITY

Graham Moore,

Topic Mapper

Equality  rules  for  topics  

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Graham Moore,

Vice Admiral

Graham Moore,

Footballer

Graham Moore,

Topic Mapper

http://en.wikipedia.org/wiki/Graham_Moore

http://www.topicmapslab.de/people/Graham_Moore

http://en.wikipedia.org/wiki/Graham_Moore_(footballer)

Equality  rules  for  topics  

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Graham Moore,

Vice Admiral

Graham Moore,

Footballer

Graham Moore,

Topic Mapper

http://en.wikipedia.org/wiki/Graham_Moore

http://www.topicmapslab.de/people/Graham_Moore

http://en.wikipedia.org/wiki/Graham_Moore_(footballer)

Equality  rules  for  topics  

IDENTIFIER EQUALITY

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Virtual  on  demand  merging    

http://www.topicmapslab.de/people/Graham_Moore

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Virtual  on  demand  merging    

http://www.topicmapslab.de/people/Graham_Moore

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Virtual  on  demand  merging    

http://www.topicmapslab.de/people/Graham_Moore

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Virtual  on  demand  merging    

http://www.topicmapslab.de/people/Graham_Moore

http://www.topicmapslab.de/people/Graham_Moore http://psi.ontopedia.net/Graham_Moore

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Virtual  on  demand  merging    

http://www.topicmapslab.de/people/Graham_Moore

http://www.topicmapslab.de/people/Graham_Moore http://psi.ontopedia.net/Graham_Moore

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Virtual  on  demand  merging    

http://www.topicmapslab.de/people/Graham_Moore

http://www.topicmapslab.de/people/Graham_Moore http://psi.ontopedia.net/Graham_Moore

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Virtual  on  demand  merging    

http://www.topicmapslab.de/people/Graham_Moore

http://www.topicmapslab.de/people/Graham_Moore http://psi.ontopedia.net/Graham_Moore

http://psi.ontopedia.net/Graham_Moore

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Virtual  on  demand  merging    

http://www.topicmapslab.de/people/Graham_Moore

http://www.topicmapslab.de/people/Graham_Moore http://psi.ontopedia.net/Graham_Moore

http://psi.ontopedia.net/Graham_Moore

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Virtual  on  demand  merging    

http://www.topicmapslab.de/people/Graham_Moore

virtual topic

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Virtual  on  demand  merging    

virtual topic

get all names

virtual names

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Virtual topic

•  empty

•  wrapper that

•  acts as topic ...

•  but stores ids of equal source topics

Virtual  on  demand  merging    

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Example  2:  Merging  the  Italian  and  Norwegian  Opera  

Problem

•  only 20 out of 2767 topics with equal identifiers

•  http://psi.ontopia.net/music/opera vs. http://psi.ontopedia.net/Opera

•  no editing of sources

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Example  2:  Merging  the  Italian  and  Norwegian  Opera  

Problem

•  Only 20 out of 2767 topics with same identifiers

•  http://psi.ontopia.net/music/opera vs. http://psi.ontopedia.net/Opera

•  No editing of sources

Possible solution

•  topic map with topic containing e.g. both „Opera“ identifiers

•  source: expert knowledge, Subj3ct, ...

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Advantages  of  virtual  merging  

•  Combining read-only topic maps

•  Combining private with public available topic maps (Maiana feature)

•  Information about the origin

•  On demand merging

•  Playing around with identities

•  Validating topic map against a schema, database backend

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Performance  

•  There is runtime

•  Highly dependent of the underlying engine

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Performance  

•  There is runtime

•  Highly dependent of the underlying engine

•  Validation of the opera map against the TMCL Meta Schema:

•  hard merge using Ontopia: instantly

•  improved Hatana version: took quite some time

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Performance  

•  There is runtime

•  Highly dependent of the underlying engine

•  Validation of the opera map against the TMCL Meta Schema:

•  hard merge using Ontopia: instantly

•  more improved Hatana version: a moment

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Performance  

•  There is runtime

•  Highly dependent of the underlying engine

•  Validation of the opera map against the TMCL Meta Schema:

•  hard merge using Ontopia: instantly

•  future Hatana version: ?

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

ImplementaBon  

•  read-only Java topic maps engine (TMAPI)

•  Topic Map System containing virtual topic maps

•  Virtual construct: empty layer storing the ids of its source constructs

•  Caching: Id-Storing

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

I  did  not  talk  about  

•  Merging topics that reify e.g. equal names

•  Merging associations and roles

•  most time consuming

•  Cache invalidation

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Next  steps  

•  Learning from Jack Park’s merge assertions

•  Implementing the Container in Container feature

•  Increasing performance

•  Improving the Container view in Maiana

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<Uta.Schulze@informatik.uni-leipzig.de>

Thank you for your attention!