Download - Hatana tmra 2010
TMRA 2010
Hatana A virtual merging engine
Uta Schulze Topic Maps Lab at the University of Leipzig
[email protected]‐leipzig.de
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
"Accessing the island of Hatana is a complicated process."
http://en.wikipedia.org/wiki/Hatana
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
MoBvaBon -‐ Not that complicated
Several data sources
One view?
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
MoBvaBon -‐ Not that complicated
Several data sources
One query language?
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
MoBvaBon -‐ Not that complicated
Several data sources
?
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Why puJng data into topic maps?
Because we can.
MaJorToM-JLI
ARNotations
Coming soon
Maiana
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Why puJng data into topic maps?
Because we can.
Because information wants to be a topic map.
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Why puJng data into topic maps?
Because we can.
Because information wants to be a topic map.
Because we’d like to merge…
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Why don‘t we just put everything into one big topic map and are done with?
Information
1. changes over time
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Why don‘t we just put everything into one big topic map and are done with?
Information
1. changes over time
2. has copyright issues
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Why don‘t we just put everything into one big topic map and are done with?
Information
1. changes over time
2. has copyright issues
3. has an origin that would get lost
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Why don‘t we just put everything into one big topic map and are done with?
Information
1. changes over time
2. has copyright issues
3. has an origin that would get lost
4. should sometimes remain in its database
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Another soluBon: Hatana
Hatana creates a layer over several data sources.
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Another soluBon: Hatana
This layer behaves as a topic map!
Hatana creates a layer over several data sources.
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Example 1: TMRA ParBcipants (Java Live IntegraBon)
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Hatana merges ...
• strictly according to the TMDM’s equality rules of constructs
• on demand
• and creates „virtual” topics, associations, …
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Equality rules for topics
Graham Moore,
Vice Admiral
Graham Moore,
Footballer
Graham Moore,
Topic Mapper
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Graham Moore,
Vice Admiral
Graham Moore,
Footballer
Graham Moore,
Topic Mapper
Equality rules for topics
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Graham Moore,
Vice Admiral
Graham Moore,
Footballer
NAME EQUALITY
Graham Moore,
Topic Mapper
Equality rules for topics
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Graham Moore,
Vice Admiral
Graham Moore,
Footballer
Graham Moore,
Topic Mapper
http://en.wikipedia.org/wiki/Graham_Moore
http://www.topicmapslab.de/people/Graham_Moore
http://en.wikipedia.org/wiki/Graham_Moore_(footballer)
Equality rules for topics
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Graham Moore,
Vice Admiral
Graham Moore,
Footballer
Graham Moore,
Topic Mapper
http://en.wikipedia.org/wiki/Graham_Moore
http://www.topicmapslab.de/people/Graham_Moore
http://en.wikipedia.org/wiki/Graham_Moore_(footballer)
Equality rules for topics
IDENTIFIER EQUALITY
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Virtual on demand merging
http://www.topicmapslab.de/people/Graham_Moore
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Virtual on demand merging
http://www.topicmapslab.de/people/Graham_Moore
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Virtual on demand merging
http://www.topicmapslab.de/people/Graham_Moore
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Virtual on demand merging
http://www.topicmapslab.de/people/Graham_Moore
http://www.topicmapslab.de/people/Graham_Moore http://psi.ontopedia.net/Graham_Moore
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Virtual on demand merging
http://www.topicmapslab.de/people/Graham_Moore
http://www.topicmapslab.de/people/Graham_Moore http://psi.ontopedia.net/Graham_Moore
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Virtual on demand merging
http://www.topicmapslab.de/people/Graham_Moore
http://www.topicmapslab.de/people/Graham_Moore http://psi.ontopedia.net/Graham_Moore
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Virtual on demand merging
http://www.topicmapslab.de/people/Graham_Moore
http://www.topicmapslab.de/people/Graham_Moore http://psi.ontopedia.net/Graham_Moore
http://psi.ontopedia.net/Graham_Moore
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Virtual on demand merging
http://www.topicmapslab.de/people/Graham_Moore
http://www.topicmapslab.de/people/Graham_Moore http://psi.ontopedia.net/Graham_Moore
http://psi.ontopedia.net/Graham_Moore
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Virtual on demand merging
http://www.topicmapslab.de/people/Graham_Moore
virtual topic
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Virtual on demand merging
virtual topic
get all names
virtual names
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Virtual topic
• empty
• wrapper that
• acts as topic ...
• but stores ids of equal source topics
Virtual on demand merging
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Example 2: Merging the Italian and Norwegian Opera
Problem
• only 20 out of 2767 topics with equal identifiers
• http://psi.ontopia.net/music/opera vs. http://psi.ontopedia.net/Opera
• no editing of sources
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Example 2: Merging the Italian and Norwegian Opera
Problem
• Only 20 out of 2767 topics with same identifiers
• http://psi.ontopia.net/music/opera vs. http://psi.ontopedia.net/Opera
• No editing of sources
Possible solution
• topic map with topic containing e.g. both „Opera“ identifiers
• source: expert knowledge, Subj3ct, ...
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Advantages of virtual merging
• Combining read-only topic maps
• Combining private with public available topic maps (Maiana feature)
• Information about the origin
• On demand merging
• Playing around with identities
• Validating topic map against a schema, database backend
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Performance
• There is runtime
• Highly dependent of the underlying engine
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Performance
• There is runtime
• Highly dependent of the underlying engine
• Validation of the opera map against the TMCL Meta Schema:
• hard merge using Ontopia: instantly
• improved Hatana version: took quite some time
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Performance
• There is runtime
• Highly dependent of the underlying engine
• Validation of the opera map against the TMCL Meta Schema:
• hard merge using Ontopia: instantly
• more improved Hatana version: a moment
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Performance
• There is runtime
• Highly dependent of the underlying engine
• Validation of the opera map against the TMCL Meta Schema:
• hard merge using Ontopia: instantly
• future Hatana version: ?
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
ImplementaBon
• read-only Java topic maps engine (TMAPI)
• Topic Map System containing virtual topic maps
• Virtual construct: empty layer storing the ids of its source constructs
• Caching: Id-Storing
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
I did not talk about
• Merging topics that reify e.g. equal names
• Merging associations and roles
• most time consuming
• Cache invalidation
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Next steps
• Learning from Jack Park’s merge assertions
• Implementing the Container in Container feature
• Increasing performance
• Improving the Container view in Maiana
Einführung in Topic Maps
Uta Schulze, Topic Maps Lab
Thank you for your attention!