SEMANTIC MEDIAWIKI AND APPLICATIONS

ASWC 2009 Tutorial

ABOUT THE SPEAKERS

Jesse Wang Architect, Research Program Manager Vulcan Inc., Seattle, WA, USA

Yaron Koren Seasoned hacker, Entrepreneur, Web

Visionary WikiWorks.com, New York, NY, USA

2

AGENDA

Introduction to Semantic Wikis Examples of Semantic Wikis Semantic MediaWiki Useful Extensions of Semantic

MediaWiki Fun and Real Applications

3

INTRODUCTION

Wiki – the web in small Definition, Examples, Usage

Problems to Solve Why, What, Where

A Brief History Perspectives

4

WIKIS AS WE KNOW

Wikipedia http://en.wikipedia.org/wiki/Wikipedia 14 million articles (3.1 million in English) Deutschsprachige Wikipedia: 900,000+ articles

(2009/5) ウィキペディア日本語版 : 600,000+ articles (2009/7)

Chinese Wiki-like Encyclopedia 互动百科 3.9 million articles, 4.3 billion chars

(2009/12) 百度百科 1900430 articles (2009/12)

5

SOME POPULAR WIKIS

AboutUs.org – Intenet Directory: > 14,000,000

City wikis – umbrella wikis for cities

GeoNames – places: 8,000,000 +

OpenStreetMap – the Free Wiki World Map: > 100,000 USERS

Wikitravel – travel guides

LyricWiki - Lyrics Wikileaks – leak info

anonymously wikiHow – how to … ShopWiki – you know SNPedia – you’ll

know

6

EVEN MORE “WIKIS”

WetPaint lets you build a rich, online community around the

whatever-it-is that you’re really into. Utilizing the best features of wikis, blogs, forums and social networks, Wetpaint mixes everything you need so you can create, collect, and organize content on your own social website.

Ning Ning offers an easy-to-use service that allows people to

join and create Ning Networks. To explore and express their interests, discover new

passions, and meet new people around shared pursuits.

7

Wikia Wiki communities for everyone

PBWiki/PBWorks Online Collaboration that just Works

TWiki the Open Source Enterprise Wiki and Web 2.0

Application Platform MoinMoin

advanced, easy to use and extensible WikiEngine

SOME WIKI PLATFORMS

8

SO WHAT IS A WIKI

By Wikipedia: A wiki (pronounced /ˈwɪki/ WIK-ee) is a website

 that allows the easy[1] creation and editing of any number of interlinked web pages via a web browser using a simplified markup language or a WYSIWYG text editor.[2][3]

 Wikis are typically powered by wiki software and are often used to createcollaborative websites, to power community websites, for personal note taking, in corporate intranets, and in knowledge management systems.

9

WHAT WIKI REALLY IS ABOUT

Quick and Easy – no need of extra software

Collaborative Community Authoring Interlinked Content Version Control Notification

10

WIKI AS PRODUCTIVITY PLATFORM

Wiki is not only a wiki engine, web site, hosting service…

It is a social, collaborative productivity tool

It is a platform where people can build web applications

It marries the web of computers with the web of people

It is a great indicator of human Civilization! 11

WIKI : THE WEB IN THE SMALL

12

The Small Web is just like the Whole Web

WIKIS ARE NOT PERFECT

13

WIKIS ARE GREAT …

Enable new scale of human collaboration

Everyone can read Everyone can write Everyone can edit Everyone is accountable for everything

But some things are better left to machines…

14

WIKI CLOCK ?

15

LIMITS OF THE WIKI: WIKIPEDIA

•Wikipedia has articles about…

• … all cities• … their

populations• … their mayors• … the skyscrapers

So can I ask for a list of the world’s 10 largest cities with a female mayor?Or Skyscrapers in Shanghai with 50+ floors and built after 2000?

16

WILL SEARCH HELP?Not something you can do now…

17

WIKIPEDIA’S ANSWER: LISTS

18

19

20

21

Will you get your answers?

22

WIKI ANSWERS?

23

COMPUTERS ARE STUPIDCOMPUTERS NEED OUR HELP

What computers can understand (powered by programs) is simple named entities, such as:... 43285812... 2009-12-07... 400 Guoding Road, Shanghai, China... Jesse WangStill not always correct with all the possible variations of formats...

24

HOW TO GET THE ANSWERS IN THE WIKIS?

The female majors of top 10 cities, sorted by population, starting year, age…

All skyscrapers in China (Japan, Thailand,…) of 50 (40/60/70) floors or more, and built in year 2000 (2001/2002) and after, sorted by built year, floors…, grouped by cities, regions…

Median (average) base annual salary of CEOs of Fortune 100 companies in America (Europe, Asian,…)

(And so on…)Semantic Wiki

25

Semantic Wiki

A BRIEF HISTORY

26

1995: THE FIRST WIKI

Wiki – Hawaiian word for “quick and easy” First developed by Ward Cunningham as an add-on to the Portland

Pattern Repository on 1995.03.25 http://c2.com/cgi/wiki?WikiDesignPrinciples our interpretation

Incremental - Pages can cite other pages, including pages that have not been written yet. network of pages

Organic - The structure and text content of the site is open to editing and evolution. different from classical content management systems

Universal - The mechanisms of editing and organizing are the same as those of writing so that any writer is automatically an editor and organizer. integrated creation and organization of content

Unified - Page names will be drawn from a flat space so that no additional context is required to interpret them. humans can remember names

Precise - Pages will be titled with sufficient precision to avoid most name clashes, typically by forming noun phrases. names are quasi-unique

Tolerant - Interpretable (even if undesirable) behavior is preferred to error messages. usability: novice users have less fear to start using it

Observable - Activity within the site can be watched and reviewed by any other visitor to the site. exchange of meta-information

Convergent - Duplication can be discouraged or removed by finding and citing similar or related content.

27

2004/2005: FIRST SEMANTIC WIKIS

Platypus Wiki from Stefano Campanini, Paolo Castagna, Roberto Tazzoli presented at ISWC2004

WikSAR from David Aumüller wins best Demo award at ESWC2005

Semantic MediaWiki http://semantic-mediawiki.org released in 2005 as well

28

WIKIPEDIA BECAME POPULAR IN 2005

Wiki is following and growing

29

2006: WIKI BECAME POPULAR

30

SEMANTIC WIKI KEEPS GOING STRONG

31

2006-NOW: A MAJOR RESEARCH TOPIC

2005: [swikig] mailing list launched 2006: First Workshop on Semantic Wikis: From Wiki to

Semantics [SemWiki2006] at ESWC2006, Budva, Montenrego

2006: Second Workshop on Semantic Wikis: Wiki-based Knowledge-Engineering [WibKe2006] at WikiSym 2006 in Odense, Denmark

2008: Third Workshop on Semantic Wikis: The Wiki Way of Semantics [SemWiki2008] at ESWC2008, Tenerife

2009: Semantic Wiki session in SemTech Conference, San Jose, CA

2008-2009: Semantic MediaWiki user group meetings in Boston, USA, Stanford, USA, and Karlsruhe, DE

32http://semwiki.org

Semantic Wiki

VIEWS FROM ALL ANGLES

33

DEFINITION: SEMANTIC WIKIS

Semantic Wiki is a wiki that has an underlying model of the knowledge described in its pages.

The knowledge model found in a semantic wiki is typically available in a formal language, so that machines can process it into an entity-relationship or relational database.

Semantic Web compatibility

34

TO VIEW IT IN DIFFERENT WAYS

 To allow users to make their internal knowledge more explicit and more formal, so that the information in a wiki can be searched and presented in better ways

More Structure Knowledge Management Data in RDF Ontology Reasoning

Two Perspectives Wikis for Metadata Metadata for Wikis

35

NOVA SPIVACK: METAWEB

Semantic Wikis

36

SEMANTIC WIKIS BENEFITS

Annotation of existing structures with machine readable metadatalinks carry meaning, typing of links, typing of pages

Context dependent adaptation and presentationdifferent domains have different ways of presenting content, personal preferences, etc.

Improved, „intelligent“, search and navigationqueries to the structure, visualisation of structure, derived information

Improved interoperability between systemsexchange of content, integration of different systems, agents, etc

37

SEMANTIC WIKI ILLUSTRATED

38

BASICS OF SEMANTIC WIKIS

Still a wiki, with regular wiki features Category/Tags, Namespaces, Title,

Versioning, ... Typed Content

Page/Card, Date, Number, URL/Email, String, …

Typed Links “capital_of”, “contains”, “born_in”…

Querying Interface Support “[[Category:Member]] [[Age::<30]]”

39

ADVANCED SEMANTIC WIKI FEATURES

Semantic forms or templates Auto-completion based on semantics Powerful visualizations based on

semantics/structures/types Rules and reasoning support Advanced search and queries (faceted

search, SPARQL, etc.) Import and Export of Semantic Data

40

SEMANTIC WEB IN THE SMALL

Semantic Wikis* try to combine the strengths of Semantic Web

machine process-able data integration complex queries

Wiki easy to use and contribute, strongly interconnected, collaborative.

Emergence of Semantic Wikis from to sources: A) Semantic technologies for wikis

i.e. better navigation, better queries Most semantic wiki engines are here

B) Wikis for semantic technologies i.e. Ontology engineering, ontology learning E.g. Many papers on mining wikipedia

41

LIST OF SEMANTIC WIKIS

AceWiki ArtificialMemory Wagn - Ruby on Rails-

based KiWi – Knowledge in a Wiki Knoodl – Semantic

Collaboration tool and application platform

Metaweb - the software that powers Freebase

OntoWiki OpenRecord PhpWiki

Semantic MediaWiki - an extension to MediaWiki that turns it into a semantic wiki

Swirrl - a spreadsheet-based semantic wiki application

TaOPis - has a semantic wiki subsystem based on Frame logic

TikiWiki CMS/Groupware integrates Semantic links as a core feature

zAgile Wikidsmart - semantically enables Confluence

42

Some Examples

POPULAR SEMANTIC WIKIS

43

KIWI: KNOWLEDGE IN A WIKI

A European Community Project Collaborative Knowledge Management,

powered by the Semantic Web Vision: "convention over configuration"

paradigm of wikis combined with semantic technologies can lead to flexible and problem-oriented knowledge management

website: http://www.kiwi-project.eu44

45

KIWI – TECHNOLOGY

KiWi addresses personalisation KiWi allows arbitrary resources to tag

other resources KiWi partly addresses reason maintenance KiWi addresses rule-based reasoning in

Semantic Wikis KiWi has a proposal for versioning and

transactions (implemented but undocumented)

Trends

46

KIWI – APPLICATIONS

Software Knowledge Management: Supporting Software Engineers in sharing knowledge (Sun Microsystems)

Project Knowledge Management: Supporting Project Managers in documenting project knowledge (Logica)

KiWi Showcase: “KiWi PhotoStories”, a social networking and story and image sharing platform

KNOODL BY REVELYTIX

Standards-Based Collaborative Vocabulary Management Using a Semantic Wiki

Cloud-based application ( Amazon EC2 )

Ontology Editing, Import/Export, Search SPARQL query wizard Role-based security Semantic technology development

platform 47

SEE THE WEBCAST (OR SCREENSHOTS) http://knoodl.com/ui/site/webcast/intro.j

sp

48

49

A web-based tool that gives communities of modelers and domain experts the ability to collaboratively develop, manage, and use Vocabularies and Knowledgebases

Browser UI

AJAX Java APIs

Secu

rity

Ontology Editor

WIKI Visualization RSS Feed

Data StorageSPARQL Query

ProcessorSearch Engine Rules EngineReasoner

Use

r A

cco

un

t M

ana

ger

Ro

le-b

ased

P

erm

issi

on

s

RDF Triple Store Database

SPARQL Query Wizard

COMMUNITY PAGE

50

Content defined by wiki markup language

Community-owned vocabularies

Community news

51

ROLES

52

ONTOLOGY PAGE

53

Documentation, defined by wiki markup language

List of classes and properties in ontology

Dependencies on other ontologies(hyperlinked if resolved)

Ontology information

Page contents

Actions

Tabs to view, edit, discuss, see history, view RDF

ONTOLOGY CLASS PAGE

54

Documentation, defined by wiki markup languagePage

contents

Annotations on this class

Tabs to edit, discuss, history, view RDF, and see instances

More at the bottom of the page …

Dependencies on other ontologies(hyperlinked if resolved)

ONTOLOGY CLASS PAGE: EDITING

55

Documentation is edited using wikitext markup language

Formal semantics are edited more like a web form

Toolbar to aid with wikitext markup language

More at the bottom of the page …

56

57

58

59

FREEBASE

A structured database Designed to store the amorphous data 5 million inter-connected topics More than 3000 types – user

expandable More than 30,000 properties A collection of web services (API) and

hosting platform

60

EVERYTHING HAS A URL AND A UUID

61

FREEBASE: WRITE-ABLE, EXTENSIBLE

62

GREAT USABILITY AND DYNAMIC VIEWSTyped data, Auto-completion, structured views, Ajax UI

63

MQL: QUERYING FREEBASE

[{  "name": null,  "type": "/film/film",  "directed_by": {    "id": "/en/john_woo"  }}]

{ "code": "/api/status/ok", "result": [ { "directed_by": { "id": "/en/john_woo" }, "name": "A Better Tomorrow", "type": "/film/film" }, { "directed_by": { "id": "/en/john_woo" }, "name": "BMW films", "type": "/film/film" }, { "directed_by": { "id": "/en/john_woo" }, "name": "Mission: Impossible II", "type": "/film/film" },

…

64

THE FREEBASE ARCHITECTUREAcre is Freebase’s hosted development environment. Free, open, hosted, code reusable and cloneable. More at http://wiki.freebase.com/wiki/Acre

65

SEMANTIC MEDIAWIKI (SMW)

An extension of MediaWiki – the wiki application best known for powering Wikipedia – that helps to search, organize, tag, browse, evaluate, and share the wiki's content.

Most popular Semantic Wiki Powering hundreds public sites

Even more private sites (some very large)

66

67

Rudi Studer -- Semantic MediaWiki6868 68

VISION OF SMW

Very flexible system for knowledge management

Soft introductionUsable as a normal wikiImmediate added value

“The simplest database that could work”Semantic Web is not a vision any more --

it is there

69

SMW ONGOING DEVELOPMENT

70

Extension for MediaWiki If MediaWiki gets better, so do we

Open Source Well documented Active mailing list World wide community

In usage, research, and development Commercial Support available Semantic MediaWiki Core

Mostly stable, not planned to grow anymore