dive+: explorative search for digital humanities
TRANSCRIPT
DIVE+INTO THE EVENT-ENRICHED
LINKED OPEN CULTURAL HERITAGE
@johanoomen
#lodlam2017
Venice, June 28 2017
how can we describe
heritage data better?
machine computation can do a lot
recognise objects & concepts
unlock rich semantics from their metadata
link similar heritage objects
all this will make
cultural heritage search
better
but we need more …
SEARCH vs. EXPLORATION
/ helps only when you know what to search for
/ assumes you understand a topic
/ accuracy driven
/ click-through driven
/ helps when you don’t know what to search for
/ helps you understand & deepen in a topic
/ serendipity driven
/ focused on engagement
Access to Integrated Online Multimedia collectionsusing Linked Open Data to integrate metadata of various heritage collections
Interactive Exploration & Discovery in Contextlinking objects to events and entitiesbuilding automatic storylines (narratives)
DIVE+
• Digital Hermeneutics: 3 user studies with historians
• Narratives: 3 user studies with historians
• Infinite User Interface: 6 user studies
– second prize Semantic Web Challenge (2014)
• testing of the LOD usefulness enriched with events
• provision of cultural heritage data to lay people, professionals and scholars
Towards DIVE+: user studies
OPENIMAGES.EU
3,220 news broadcasts
Netherlands Institute for Sound & Vision
GTAA thesaurus
DELPHER.NL
197,199 Scans of Radio bulletins
1937 – 1984
AMSTERDAM MUSEUM
73,447 cultural heritage objects
AM Thesaurus
TROPENMUSEUM
78,270 cultural heritage objects
SVNC thesaurus
Collections and Vocabularies
Enrichment (Case: news broadcasts)
ENTITY EXTRACTION
EVENTS CROWDSOURCING AND LINKING
TO CONCEPTS THROUGH
CROWDTRUTH.ORG
SEGMENTATION & KEYFRAMES
LINKING EVENTS AND
CONCEPTS TO
KEYFRAMES
Crowdsourcing for Events in Texts & Videos
CrowdTruth.org
DIVE:MediaObject
Nieuws uit Indonesië:
opheffing van het KNIL
dive:depictedBy
sem:hasTimestamp
sem:Event
ANP:1950-08-11:50
dive:isRelatedTodive:relatedPlacesem:hasPlace
dive:isRelatedTodive:relatedActorsem:hasActor
dive:isRelatedTodive:relatedPlacesem:hasPlace
sem:Time
25 Juli 1950
dive:depictedBy
sem:hasTimestamp
DIVE:MediaObject
Mannen bij het huis van Paul Spies
aan de Parapattan 42, Djakarta
dive:depictedBy
dive:depictedBy
dive:depictedBy
DIVE:MediaObject
ANP:1950-08-11:50DIVE:MediaObject
Schaal
sem:Time
11 Augustus 1950
sem:Event
ontbindingsceremonie
sem:Place
Djakarta
sem:Place
Indonesië
sem:Actor
Mohammad Hatta
Integration of Heterogeneous Collections
4 Collections, 3 Thesauri274,831 Media Objects199,264 Events439,158 Event-Actor relations219,669 Event-Place relations…
15 Million+ RDF Triples
In DIVE+ triple Store
DIVE+ UI: INFINITY OF EXPLORATION
/ Support exploration and serendipity /
/ Visual inspection of media objects and entities /
/ Lets user build, save and share storylines/
filters
results ordering
filter on media objects
order media
objects by date
filter on events
explore
event
related
entities
explore
event
event
related
entities
place entity
exploration
narrative
bookmarking
/ makes heterogeneous cultural heritage
material available as linked open data
/ showcases various data enrichment
strategies to construct explorable knowledge
graphs
/ features innovative UI for deep exploration by
DH experts
DIVE+
/ is based on extensive user studies with various users
/ has impact through the national research infrastructure
CLARIAH and relations to DH initiatives and media
professionals
