hatana tmra 2010

43
TMRA 2010 Hatana A virtual merging engine Uta Schulze Topic Maps Lab at the University of Leipzig [email protected]

Upload: tmra

Post on 21-Dec-2014

170 views

Category:

Documents


1 download

DESCRIPTION

 

TRANSCRIPT

Page 1: Hatana tmra 2010

TMRA  2010  

Hatana  A  virtual  merging  engine  

Uta  Schulze  Topic  Maps  Lab  at  the  University  of  Leipzig  

[email protected]­‐leipzig.de  

Page 2: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

"Accessing the island of Hatana is a complicated process."

http://en.wikipedia.org/wiki/Hatana

Page 3: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

MoBvaBon  -­‐  Not  that  complicated  

Several data sources

One view?

Page 4: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

MoBvaBon  -­‐  Not  that  complicated  

Several data sources

One query language?

Page 5: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

MoBvaBon  -­‐  Not  that  complicated  

Several data sources

?

Page 6: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Why  puJng  data  into  topic  maps?  

Because we can.

MaJorToM-JLI

ARNotations

Coming soon

Maiana

Page 7: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Why  puJng  data  into  topic  maps?  

Because we can.

Because information wants to be a topic map.

Page 8: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Why  puJng  data  into  topic  maps?  

Because we can.

Because information wants to be a topic map.

Because we’d like to merge…

Page 9: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Why  don‘t  we  just  put  everything  into  one  big  topic  map  and  are  done  with?  

Information

1.  changes over time

Page 10: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Why  don‘t  we  just  put  everything  into  one  big  topic  map  and  are  done  with?  

Information

1.  changes over time

2.  has copyright issues

Page 11: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Why  don‘t  we  just  put  everything  into  one  big  topic  map  and  are  done  with?  

Information

1.  changes over time

2.  has copyright issues

3.  has an origin that would get lost

Page 12: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Why  don‘t  we  just  put  everything  into  one  big  topic  map  and  are  done  with?  

Information

1.  changes over time

2.  has copyright issues

3.  has an origin that would get lost

4.  should sometimes remain in its database

Page 13: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Another  soluBon:  Hatana  

Hatana creates a layer over several data sources.

Page 14: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Another  soluBon:  Hatana  

This layer behaves as a topic map!

Hatana creates a layer over several data sources.

Page 15: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Example  1:  TMRA  ParBcipants  (Java  Live  IntegraBon)  

Page 16: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Hatana  merges  ...  

•  strictly according to the TMDM’s equality rules of constructs

•  on demand

•  and creates „virtual” topics, associations, …

Page 17: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Equality  rules  for  topics  

Graham Moore,

Vice Admiral

Graham Moore,

Footballer

Graham Moore,

Topic Mapper

Page 18: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Graham Moore,

Vice Admiral

Graham Moore,

Footballer

Graham Moore,

Topic Mapper

Equality  rules  for  topics  

Page 19: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Graham Moore,

Vice Admiral

Graham Moore,

Footballer

NAME EQUALITY

Graham Moore,

Topic Mapper

Equality  rules  for  topics  

Page 20: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Graham Moore,

Vice Admiral

Graham Moore,

Footballer

Graham Moore,

Topic Mapper

http://en.wikipedia.org/wiki/Graham_Moore

http://www.topicmapslab.de/people/Graham_Moore

http://en.wikipedia.org/wiki/Graham_Moore_(footballer)

Equality  rules  for  topics  

Page 21: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Graham Moore,

Vice Admiral

Graham Moore,

Footballer

Graham Moore,

Topic Mapper

http://en.wikipedia.org/wiki/Graham_Moore

http://www.topicmapslab.de/people/Graham_Moore

http://en.wikipedia.org/wiki/Graham_Moore_(footballer)

Equality  rules  for  topics  

IDENTIFIER EQUALITY

Page 22: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Virtual  on  demand  merging    

http://www.topicmapslab.de/people/Graham_Moore

Page 23: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Virtual  on  demand  merging    

http://www.topicmapslab.de/people/Graham_Moore

Page 24: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Virtual  on  demand  merging    

http://www.topicmapslab.de/people/Graham_Moore

Page 25: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Virtual  on  demand  merging    

http://www.topicmapslab.de/people/Graham_Moore

http://www.topicmapslab.de/people/Graham_Moore http://psi.ontopedia.net/Graham_Moore

Page 26: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Virtual  on  demand  merging    

http://www.topicmapslab.de/people/Graham_Moore

http://www.topicmapslab.de/people/Graham_Moore http://psi.ontopedia.net/Graham_Moore

Page 27: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Virtual  on  demand  merging    

http://www.topicmapslab.de/people/Graham_Moore

http://www.topicmapslab.de/people/Graham_Moore http://psi.ontopedia.net/Graham_Moore

Page 28: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Virtual  on  demand  merging    

http://www.topicmapslab.de/people/Graham_Moore

http://www.topicmapslab.de/people/Graham_Moore http://psi.ontopedia.net/Graham_Moore

http://psi.ontopedia.net/Graham_Moore

Page 29: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Virtual  on  demand  merging    

http://www.topicmapslab.de/people/Graham_Moore

http://www.topicmapslab.de/people/Graham_Moore http://psi.ontopedia.net/Graham_Moore

http://psi.ontopedia.net/Graham_Moore

Page 30: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Virtual  on  demand  merging    

http://www.topicmapslab.de/people/Graham_Moore

virtual topic

Page 31: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Virtual  on  demand  merging    

virtual topic

get all names

virtual names

Page 32: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Virtual topic

•  empty

•  wrapper that

•  acts as topic ...

•  but stores ids of equal source topics

Virtual  on  demand  merging    

Page 33: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Example  2:  Merging  the  Italian  and  Norwegian  Opera  

Problem

•  only 20 out of 2767 topics with equal identifiers

•  http://psi.ontopia.net/music/opera vs. http://psi.ontopedia.net/Opera

•  no editing of sources

Page 34: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Example  2:  Merging  the  Italian  and  Norwegian  Opera  

Problem

•  Only 20 out of 2767 topics with same identifiers

•  http://psi.ontopia.net/music/opera vs. http://psi.ontopedia.net/Opera

•  No editing of sources

Possible solution

•  topic map with topic containing e.g. both „Opera“ identifiers

•  source: expert knowledge, Subj3ct, ...

Page 35: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Advantages  of  virtual  merging  

•  Combining read-only topic maps

•  Combining private with public available topic maps (Maiana feature)

•  Information about the origin

•  On demand merging

•  Playing around with identities

•  Validating topic map against a schema, database backend

Page 36: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Performance  

•  There is runtime

•  Highly dependent of the underlying engine

Page 37: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Performance  

•  There is runtime

•  Highly dependent of the underlying engine

•  Validation of the opera map against the TMCL Meta Schema:

•  hard merge using Ontopia: instantly

•  improved Hatana version: took quite some time

Page 38: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Performance  

•  There is runtime

•  Highly dependent of the underlying engine

•  Validation of the opera map against the TMCL Meta Schema:

•  hard merge using Ontopia: instantly

•  more improved Hatana version: a moment

Page 39: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Performance  

•  There is runtime

•  Highly dependent of the underlying engine

•  Validation of the opera map against the TMCL Meta Schema:

•  hard merge using Ontopia: instantly

•  future Hatana version: ?

Page 40: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

ImplementaBon  

•  read-only Java topic maps engine (TMAPI)

•  Topic Map System containing virtual topic maps

•  Virtual construct: empty layer storing the ids of its source constructs

•  Caching: Id-Storing

Page 41: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

I  did  not  talk  about  

•  Merging topics that reify e.g. equal names

•  Merging associations and roles

•  most time consuming

•  Cache invalidation

Page 42: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Next  steps  

•  Learning from Jack Park’s merge assertions

•  Implementing the Container in Container feature

•  Increasing performance

•  Improving the Container view in Maiana

Page 43: Hatana tmra 2010

Einführung  in  Topic  Maps  

Uta Schulze, Topic Maps Lab

<[email protected]>

Thank you for your attention!