linked open data and applications
DESCRIPTION
Intelligent Web Applications guest lecture about LOD and how to use it for applications. Includes pointers and demos for MultimediaN Eculture, Verrijkt Koninkrijk, Dutch Ships and Sailors, IATI 2LOD and RadioMarcheTRANSCRIPT
![Page 1: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/1.jpg)
Linked Open Data and Applications
Victor de BoerIntelligent Web Applications
24/2/2014
With slides from Rinke Hoekstra
![Page 2: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/2.jpg)
Victor de BoerAssistant professor at VU University Amsterdam
Domain-driven Semantic Technologies, Linked Data
Cultural HeritageDigital History
Linked Data for Development
![Page 3: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/3.jpg)
Today
• What is LOD?– What’s in it for me (the developer)?
• What can I do with LOD– Examples
• My LOD projects and applications
• Pointers, examples, inspiration
![Page 4: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/4.jpg)
What is Linked Open Data?
![Page 5: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/5.jpg)
Open Datais about licenses to allow reuse
Linked Datais about technology for interoperability
![Page 6: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/6.jpg)
★ Available on the web (whatever format), but with an open license
★★Available as machine-readable structured data (e.g. excel instead of image scan of a table)
★★★ as (2) plus non-proprietary format (e.g. CSV instead of excel)
★★★★
All the above plus, Use open standards from W3C (RDF and SPARQL) to identify things, so that people can point at your stuff
★★★★★All the above, plus: Link your data to other people’s data to provide context
www.w3.org/designissues/linkeddata.html
Linked Data five star system
![Page 7: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/7.jpg)
“Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod-cloud.net/”
![Page 8: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/8.jpg)
Where can I get it?• http://datahub.io/• http://datadryad.org/• https://easy.dans.knaw.nl• http://datacatalogs.org/• http://www.openstreetmap.org/• http://www.w3.org/wiki/DataSetRDFDumps• http://www.freebase.com/• https://data.overheid.nl/• http://data.gov.uk/• http://www.data.gov/• http://publicdata.eu/• http://doc.metalex.eu
• http://linkeddata.few.vu.nl/ Rinke Hoekstra
![Page 9: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/9.jpg)
What can I do with it?
![Page 10: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/10.jpg)
Web of Documents (WWW)Linked Documents
![Page 11: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/11.jpg)
Web of DataLinked Data
![Page 12: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/12.jpg)
Slide stolen from Christophe Gueret
Without…
![Page 13: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/13.jpg)
Slide stolen from Christophe Gueret
With Linked Data
![Page 14: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/14.jpg)
So how do I do it?
![Page 15: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/15.jpg)
Three main ways of accessing remote Linked Data
1. Through HTTP request on the resource URI
2. Through SPARQL queries
3. Get a copy of a dataset
(Linked Data Platform, Linked Data API)
![Page 16: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/16.jpg)
1. Through HTTP request on the resource URI
• HTTP GET on resource, parse, follow links– Simple HTTP requests and RDF parsing– One request per resource: may require many
requests
• Local caching can be done• Crawling
![Page 17: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/17.jpg)
2. Through SPARQL queries
• Full-blown query language
• Needs SPARQL endpoint
$query = "SELECT distinct ?title ?description WHERE {?x <http://data.open.ac.uk/podcast/ontology/relatesToCourse> <http://data.open.ac.uk/course/t209>.?x <http://purl.org/dc/terms/title> ?title.?x <http://www.w3.org/TR/2010/WD-mediaont-10-20100608/description> ?description } LIMIT 10";
$requestURL = 'http://data.open.ac.uk/query?query='.urlencode($query);$response = request($requestURL);
SPARQL in PHP example http://www.greenhughes.com/content/approach-consuming-linked-data-php
![Page 18: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/18.jpg)
3. Get a local copy of a dataset
• through SPARQL CONSTRUCT,• crawling or• direct file download
• Save in triple store – or convert to something else
![Page 19: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/19.jpg)
RDF Libraries
Redland: http://www.librdf.org/ Perl, Python, PHP, Ruby, C#, Objective-C
Jena: http://jena.sourceforge.net/ Java
RDFLib: http://www.rdflib.net/ Python
ARC2: http://arc2.semsol.net/ PHP
ActiveRDF: http://www.activerdf.org/ Ruby
![Page 20: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/20.jpg)
What can I do with it?
![Page 21: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/21.jpg)
Examples: Linked Data BrowsersAllow you to browse remote linked data, clicking
through linked resources and visualising images etc.
TimBL's Tabulatorhttp://dig.csail.mit.edu/2005/ajar/ajaw/tab.html
DiscoMarblesOpenLink data browser
Explore more!• http://sig.ma• http://mspace.fm/• http://www.google.com/publicdata• http://datamarket.com/• http://www.wolframalpha.com/
![Page 22: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/22.jpg)
OpenPhacts explorer
http://www.openphacts.org/
![Page 23: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/23.jpg)
Fancy mashups
www.bbc.co.uk/music
![Page 24: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/24.jpg)
Intelligent Web Apps!
• http://mashupbreakdown.com/• http://conflicthistory.com/• http://traintimes.org.uk/map/tube/• http://bikes.oobrien.com/• http://www.nomenest.info/• http://www.sandbag.org.uk/maps/offsetmap/• http://www.sandbag.org.uk/maps/emissionsmap/
• http://www.data-art.net/locus/
• http://wheredoesmymoneygo.org/• http://openspending.org/• http://energy.publicdata.eu/• http://www.fearsquare.com• http://energielabelapp.nl/• http://register.ocistimo.si/• http://epdb.eu/eulegislation/• http://www.travelschecklist.com/
Rinke Hoekstra
![Page 25: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/25.jpg)
Enough about me, let’s talk about me.
![Page 26: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/26.jpg)
Multimedia E-culture Demonstrator
![Page 27: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/27.jpg)
MultimediaN E-Culture project
• Museums have increasingly nice websites • But: most of them are driven by stand-alone collection
databases
• Data is isolated, both syntactically and semantically
• If users can do cross-collection search, the individual collections become more valuable!
• Semantic Search
![Page 28: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/28.jpg)
MultimediaN E-Culture
2003-2008: UvA, VU, CWI, DEN, ICN
“Use Semantic Web techniques to facilitate interoperability between cultural heritage institutes”
![Page 29: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/29.jpg)
29
![Page 30: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/30.jpg)
Semantic search
30
• Search for via annotations with concepts (semantic links)
• Use the type of semantic link to provide meaningful presentation of the search results
Paris
Montmartre
PartOf
Query“Paris”
![Page 31: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/31.jpg)
vocabulary alignment
31
“Tokugawa”
SVCN period Edo
SVCN is local in-house ethnology thesaurus
AAT style/period Edo (Japanese period) Tokugawa
AAT is Getty’s Art & Architecture Thesaurus
![Page 32: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/32.jpg)
Search, Show and Annotate
32
Multiple search/browse/result interfacesGoogle-likeLocal viewMapGraph displayFacet browser
Split up data based on attribute-valuesMultiple criteria
Annotation InterfaceUse of semantic autocompletionExperts Laypeople?
![Page 34: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/34.jpg)
Verrijkt Koninkrijk
![Page 35: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/35.jpg)
History of German occupied Dutch society (1940-1945)
Published between 1969 and 1991 in 14 volumes, 30 parts, 18.000 pages
1. Digitization, 2. Open Data, 3. Enriched access with Linked Open Data
Het Koninkrijk der Nederlanden in de Tweede Wereldoorlog
![Page 36: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/36.jpg)
country, collection, doc-type, volume, chapter, section, sub-section, paragraph
![Page 37: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/37.jpg)
SKOS vocabularies as stepping stones
Back-of-the-book index (SKOS)
15.234 Concepts121.525 references
Named Entities (SKOS)
88.249 Concepts364,924 references
![Page 38: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/38.jpg)
niod:Blitzkrieg
niod:oai_wo2_niod_nl_rec_102045 dct:subjec
t
http://resolver.verrijktkoninkrijk.nl/nl.vk.d.reg.4.1386
botb:Blitzkrieg
skos:exactMatch
![Page 39: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/39.jpg)
skos:exactMatch
skos:exactMatch
![Page 40: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/40.jpg)
http://semanticweb.cs.vu.nl/verrijktkoninkrijk/
http://purl.org/collections/nl/niod/V-wapens.rdfDereferenceable URIs!
![Page 41: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/41.jpg)
SELECT * WHERE{ ?s skos:prefLabel ?pl.?s skos:closeMatch ?geo.?geo gn:parentADM1 ?prov.?prov gn:name ?provname.?s niod:pageRef ?pref. }
0
2000
4000
6000
8000
10000
12000NE indexBotB index
Geographical analysis using background knowledge from
GeoNames
SPARQL for Rhttp://linkedscience.org/tools/sparql-package-for-r/
![Page 42: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/42.jpg)
Results are links to paragraphs
![Page 43: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/43.jpg)
National-Socialist29%
Social-Democrat21%
Protestant13%
Liberal12%
R-Catholic12%
Com
munist8%
Jewish5%
Pillar1 Pillar2 CoLiber. Protestant 0.29Protestant R-Cath. 0.22Liber. R-Cath. 0.21Comm Soc-dem 0.20Liber. Soc-dem 0.15
Quick analysis, inspiring researchers
![Page 44: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/44.jpg)
Hackathon
![Page 45: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/45.jpg)
Dutch Ships and Sailors
![Page 46: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/46.jpg)
Dutch Ships and Sailors
VOC Opvarenden
Dutch Asiatic Shipping
Generale Zeemonsterrollen
Noordelijke Monsterrollen
KB Newspapers
![Page 47: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/47.jpg)
gz:Mercuur
1782
gz:Buijksloot
gz:Batavia
gz:Claas Roem
voc:Claas Roem
voc:Buijksloot
1752das:Mercuur
das:Departure
das:Roem, Klaas
19-12-1780 das:Texel
das:Arrival
20-7-1781 das:Batavia
das:Voyage1
Web of Data
![Page 48: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/48.jpg)
Example web application?
VOC Opvarenden
Dutch Asiatic Shipping
Generale Zeemonsterrollen
Noordelijke Monsterrollen
KB Newspapers
http://semanticweb.cs.vu.nl/dsshttp://dutchshipsandsailors.nl/
![Page 49: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/49.jpg)
Linked Data 4 DevelopmentDevelopment
![Page 50: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/50.jpg)
Linked Data for International Aid Transparency Initiative
Msc. Thesis by Kasper Brandt Victor de Boer
![Page 51: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/51.jpg)
Introduction - IATI
“IATI is a voluntary, multi-stakeholder initiative that seeks to improve the transparency of aid in order to increase its effectiveness in tackling poverty.”
-- http://www.aidtransparency.net/
![Page 52: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/52.jpg)
IATI datamodelActivities Organisations
Aid TypeCountryCurrencyGeographical precisionLanguageLocation typeOrganisation rolePolicy markerRegionSectorTransaction type
Vocabularies
![Page 53: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/53.jpg)
Model and links based on requirements elicitated from experts
Iterative Requirements Engineering Process Model by Loucopoulos and Karakostas
![Page 54: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/54.jpg)
Linking datasets and Applications User questions
1. In total, how much does a given country receive in aid?
2. A comparative index of aid versus the Human Development Index.
3. What is the geographic location of a project? How much aid went to a given province, constituency or village?o Is the aid spent in places where the need is
highest? Is it well distributed across the country?
o Can we attribute sub-national breakdowns for aid so we can see how much goes to different parts of recipient countries?
4. How does violent conflict in recipient countries affect aid activities?
5. How does aid spending as registered in the IATI standard compare to World Bank indicators?
![Page 55: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/55.jpg)
IATI 2 LOD application
http://iati2lod.appspot.com/applications
![Page 56: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/56.jpg)
http://iati2lod.appspot.com/1. In total, how much does a given country receive in aid?
![Page 57: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/57.jpg)
2. A comparative index of aid versus the Human Development Index.
http://iati2lod.appspot.com/
![Page 58: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/58.jpg)
http://iati2lod.appspot.com/4. How does violent conflict in recipient countries affect aid activities?5. How does aid spending as registered in the IATI standard compare to World
Bank indicators?
![Page 59: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/59.jpg)
Talking to Linked Data
![Page 60: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/60.jpg)
Local market data
Communiqué
GSM/Voice interface
Web Interface Text-To-Speech
Community radio
RadioMarché
Sahel Eco operativeBuyers
![Page 61: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/61.jpg)
EcoMash
[M.Sc. thesis by Henk Kroon]
![Page 62: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/62.jpg)
Linked Data for Development (LD4D)
Web applications
<VoiceXML> to SPARQL*
Voice browserTel: +31208080855
Skype: +990009369996162208
RadioMarché Linked market data
‘Allo, Linked Data?
DBpediaGeoNames
Agrovoc
![Page 63: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/63.jpg)
Linked Open Data…
…should make it easier for developers to develop IWAs
… from distributed datasources
… with heterogeneous data
Go build stuff!
![Page 64: Linked Open Data and Applications](https://reader034.vdocument.in/reader034/viewer/2022052410/5549769eb4c90595518b581c/html5/thumbnails/64.jpg)
Links to datasets and applications
• http://semanticweb.cs.vu.nl/verrijktkoninkrijk• http://semanticweb.cs.vu.nl/dss• http://semanticweb.cs.vu.nl/radiomarche• http://semanticweb.cs.vu.nl/iati• http://eculture.multimedian.nl/demo
• http://iati2lod.appspot.com/• http://eculture.multimedian.nl
• http://Worldwidesemanticweb.org
/sparql/query=/user/query/yasgui/index.html