M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
A Specification Language and System for the Three-Dimensional Visualisation of
Knowledge Bases
El Mustapha EL ATIFI and Gilles FALQUET
Information System Interfaces
Department of Information Systems
University of Geneva
2M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
Context
Study the 3D visualisation of knowledge bases
– Design – Metaphors – Effectiveness
knowledge base
3D scene
3M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
Outline
Introduction Knowledge and Interface Models Abstract Interface Specification Concrete Interface Specification Conclusion and perspectives.
4M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
Visualisation of Knowledge Bases in 3D
Difficulties• Represent abstract concepts, facts, rules• Represent formalized and non-formalized knowledge
• Hard to program 3D interfaces
=> few prototyping and usability testing
Simplify 3D interface generation
5M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
Approach
• Declarative specification• Specify the interface structure• Specify mappings KB entities interface objects
• Two Levels (reduce the semantic gap)• Abstract interface• Concrete interface
6M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
Specifications
Interfaces
AbstractSpecification
Generator
OpenGL
Java3D
X3D
AbstractInterface
ConcreteSpecification
Generator TranslatorConcreteInterface
Principles
KnowledgeBase
7M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
Formalized knowledge • Classes, semantic
relations, objects• Expressed in RDF/RDFS
• Non Formalized knowledge• Documents • Connected to the formal
description
Knowledge Base Model
8M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
RDF Formalism
Knowledge base = set of triples
(subject predicate object)Markup Language
HTML
type
Language
subClassOf
a.html
example
ProgrammingLanguage
subClassOf
a.b.c/prog
definition
html.html
description
9M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
?x
H. Bersini
auteur
éditeur
?e
SPARQL: W3C recommandation Based on triple patterns
Selection in a RDF/S KB
10M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
Abstract interface model
Abstract spatial hypertext
Nodes• subnodes
Links• hypertext navigation• inclusion (node to subnode)• semantic links
11M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
loc=frontloc=left
attribut
Inclusion
Sémantique
Navigation
attribut
attribut
Example
12M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
Abstract specification
• Set of node schemas
• Node schema
Selection from the KB (SPARQL expression)
Content specification• Hierarchy of XML elements• Values from the KB
Link specifications
13M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
abstract-node: ConceptPresentation [c]selection: (c rdf:type rdfs:Class)(c term ?t)content:
<label> t </label>inclusion link: to: ExamplesOf[c] attributes: (position: "left")inclusion link: to: DescriptionsOf[c] attributes: (position: "right")
An Abstract Node Specification
14M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
Generated abstract interface
Instances of node schemas
ConceptPresentation [123]<label>Language</label>
ExamplesOf[123]<..> ... </...> DescriptionsOf[123]
<..> ... </...>
Panel[1]<..> ... </...>
Panel[6]<..> ... </...>
ConceptPresentation [56]<label>Programming language</label>
ConceptPresentation [19584]<label>Markup language</label>
15M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
Concrete interface
• Spatial Hypertext
Nodes• shape• layout manager
Links• inclusion• navigation• semantic ==> layout constraints
16M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
attributesattributes
attributes
attributes
attributes
Layout Mgr 3
Layout Mgr 4
Layout Mgr 2
Layout Mgr 1
Concrete interface model
17M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
Concrete specification
• Associate a concrete node to each abstract node
concrete-node: ExamplesOf [c]
shape: Wall
layout-manager: Sequence
18M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
Example
Knowledge base : course on information technologies• Concepts and semantic relationships• Documents
• Illustrations, examples, descriptions
Visualisation• Exhibition metaphor• Concept ==> Stand
• Documents ==> posters on the walls• Navigation links to other concepts
19M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
tile
term
C-158
Markup language
termC-162
XHTML
CSS sheet
reference
N-682N-682
C-160
XML languageterm
refexam
ple
N-623N-623
N-622N-622
Analyse d’XMLUtilisation d’XML
titletitle
N-644N-644
def.
Example: Knowledge Base
20M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
Exhibition
ExamplesOf[c]
ConceptPresentation[c]
LabelAndSupCof[c]DescriptionsOf[c]
TextPanel[?d’]TextPanel[?d]
Example: abstract node
**
*
21M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
Exhibition
ExamplesOf[c]
ConceptPresentation[c]{ }
LabelAndSupCof[c]DescriptionsOf[c]
TextPanel[?d’]{ }TextPanel[?d]{ }
abstract-node: LabelAndSupCsofparameters: cselection: (c rdfs:label ?l).(c rdfs:supClasseOf ?c2).(c lzy:definition ?d)content: // label + a subsumption link to every related conceptl attributes: (position: "center"; type:"text"),d attributes: (position: "right"; type:"ext-link"; object:"Def"){navigation link: to: ConceptPresentation[c2] type: "subsumption "} attributes: (position: "top")
Example
22M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
Exhibition
ExamplesOf[c]
ConceptPresentation[c]{ }
LabelAndSupCof[c]DescriptionsOf[c]
TextPanel[?d’]{ }TextPanel[?d]{ }
layout-clrtbpanel
concrete-node: LabelAndSupCsofparameters: cshape: panellayout-manager: layout-clrtb
Example
23M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
Exhibition
ExamplesOf[c]
ConceptPresentation[c]{ }
LabelAndSupCof[c]DescriptionsOf[c]
TextPanel[?d’]{ }TextPanel[?d]{ }
VRML Interface
26M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
Spécifications déclaratives Deux niveaux de spécification Une spécification abstraite peut servir pour plusieurs BC À partir d’une spécification abstraite possibilité de générer
plusieurs interfaces concrètes
Conclusion
27M. El Atifi, G. Falquet - University of Geneva
DSVIS'05: 3D Visualisation KB
Étudier les positionneurs Étudier l’interaction Méthodologie de conception
Perspectives