M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

A Specification Language and System for the Three-Dimensional Visualisation of

Knowledge Bases

El Mustapha EL ATIFI and Gilles FALQUET

Information System Interfaces

Department of Information Systems

University of Geneva

2M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Context

Study the 3D visualisation of knowledge bases

– Design – Metaphors – Effectiveness

knowledge base

3D scene

3M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Outline

Introduction Knowledge and Interface Models Abstract Interface Specification Concrete Interface Specification Conclusion and perspectives.

4M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Visualisation of Knowledge Bases in 3D

Difficulties• Represent abstract concepts, facts, rules• Represent formalized and non-formalized knowledge

• Hard to program 3D interfaces

=> few prototyping and usability testing

Simplify 3D interface generation

5M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Approach

• Declarative specification• Specify the interface structure• Specify mappings KB entities interface objects

• Two Levels (reduce the semantic gap)• Abstract interface• Concrete interface

6M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Specifications

Interfaces

AbstractSpecification

Generator

OpenGL

Java3D

X3D

AbstractInterface

ConcreteSpecification

Generator TranslatorConcreteInterface

Principles

KnowledgeBase

7M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Formalized knowledge • Classes, semantic

relations, objects• Expressed in RDF/RDFS

• Non Formalized knowledge• Documents • Connected to the formal

description

Knowledge Base Model

8M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

RDF Formalism

Knowledge base = set of triples

(subject predicate object)Markup Language

HTML

type

Language

subClassOf

a.html

example

ProgrammingLanguage

subClassOf

a.b.c/prog

definition

html.html

description

9M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

?x

H. Bersini

auteur

éditeur

?e

SPARQL: W3C recommandation Based on triple patterns

Selection in a RDF/S KB

10M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Abstract interface model

Abstract spatial hypertext

Nodes• subnodes

Links• hypertext navigation• inclusion (node to subnode)• semantic links

11M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

loc=frontloc=left

attribut

Inclusion

Sémantique

Navigation

attribut

attribut

Example

12M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Abstract specification

• Set of node schemas

• Node schema

Selection from the KB (SPARQL expression)

Content specification• Hierarchy of XML elements• Values from the KB

Link specifications

13M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

abstract-node: ConceptPresentation [c]selection: (c rdf:type rdfs:Class)(c term ?t)content:

<label> t </label>inclusion link: to: ExamplesOf[c] attributes: (position: "left")inclusion link: to: DescriptionsOf[c] attributes: (position: "right")

An Abstract Node Specification

14M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Generated abstract interface

Instances of node schemas

ConceptPresentation [123]<label>Language</label>

ExamplesOf[123]<..> ... </...> DescriptionsOf[123]

<..> ... </...>

Panel[1]<..> ... </...>

Panel[6]<..> ... </...>

ConceptPresentation [56]<label>Programming language</label>

ConceptPresentation [19584]<label>Markup language</label>

15M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Concrete interface

• Spatial Hypertext

Nodes• shape• layout manager

Links• inclusion• navigation• semantic ==> layout constraints

16M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

attributesattributes

attributes

attributes

attributes

Layout Mgr 3

Layout Mgr 4

Layout Mgr 2

Layout Mgr 1

Concrete interface model

17M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Concrete specification

• Associate a concrete node to each abstract node

concrete-node: ExamplesOf [c]

shape: Wall

layout-manager: Sequence

18M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Example

Knowledge base : course on information technologies• Concepts and semantic relationships• Documents

• Illustrations, examples, descriptions

Visualisation• Exhibition metaphor• Concept ==> Stand

• Documents ==> posters on the walls• Navigation links to other concepts

19M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

tile

term

C-158

Markup language

termC-162

XHTML

CSS sheet

reference

N-682N-682

C-160

XML languageterm

refexam

ple

N-623N-623

N-622N-622

Analyse d’XMLUtilisation d’XML

titletitle

N-644N-644

def.

Example: Knowledge Base

20M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Exhibition

ExamplesOf[c]

ConceptPresentation[c]

LabelAndSupCof[c]DescriptionsOf[c]

TextPanel[?d’]TextPanel[?d]

Example: abstract node

**

*

21M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Exhibition

ExamplesOf[c]

ConceptPresentation[c]{ }

LabelAndSupCof[c]DescriptionsOf[c]

TextPanel[?d’]{ }TextPanel[?d]{ }

abstract-node: LabelAndSupCsofparameters: cselection: (c rdfs:label ?l).(c rdfs:supClasseOf ?c2).(c lzy:definition ?d)content: // label + a subsumption link to every related conceptl attributes: (position: "center"; type:"text"),d attributes: (position: "right"; type:"ext-link"; object:"Def"){navigation link: to: ConceptPresentation[c2] type: "subsumption "} attributes: (position: "top")

Example

22M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Exhibition

ExamplesOf[c]

ConceptPresentation[c]{ }

LabelAndSupCof[c]DescriptionsOf[c]

TextPanel[?d’]{ }TextPanel[?d]{ }

layout-clrtbpanel

concrete-node: LabelAndSupCsofparameters: cshape: panellayout-manager: layout-clrtb

Example

23M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Exhibition

ExamplesOf[c]

ConceptPresentation[c]{ }

LabelAndSupCof[c]DescriptionsOf[c]

TextPanel[?d’]{ }TextPanel[?d]{ }

VRML Interface

24M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

25M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Example

26M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Spécifications déclaratives Deux niveaux de spécification Une spécification abstraite peut servir pour plusieurs BC À partir d’une spécification abstraite possibilité de générer

plusieurs interfaces concrètes

Conclusion

27M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

Étudier les positionneurs Étudier l’interaction Méthodologie de conception

Perspectives

M. El Atifi, G. Falquet - University of Geneva

DSVIS'05: 3D Visualisation KB

ThanksThanks

El Mustapha EL ATIFI & Gilles FALQUET

{ Elmustapha.Elatifi; Gilles.Falquet }@cui.unige.ch

Questions ? ? ?Questions ? ? ?