dive+: explorative search for digital humanities

DIVE+INTO THE EVENT-ENRICHED

LINKED OPEN CULTURAL HERITAGE

@johanoomen

#lodlam2017

Venice, June 28 2017

how can we describe

heritage data better?

machine computation can do a lot

recognise objects & concepts

unlock rich semantics from their metadata

link similar heritage objects

all this will make

cultural heritage search

better

but we need more …

SEARCH vs. EXPLORATION

/ helps only when you know what to search for

/ assumes you understand a topic

/ accuracy driven

/ click-through driven

/ helps when you don’t know what to search for

/ helps you understand & deepen in a topic

/ serendipity driven

/ focused on engagement

Access to Integrated Online Multimedia collectionsusing Linked Open Data to integrate metadata of various heritage collections

Interactive Exploration & Discovery in Contextlinking objects to events and entitiesbuilding automatic storylines (narratives)

DIVE+

• Digital Hermeneutics: 3 user studies with historians

• Narratives: 3 user studies with historians

• Infinite User Interface: 6 user studies

– second prize Semantic Web Challenge (2014)

• testing of the LOD usefulness enriched with events

• provision of cultural heritage data to lay people, professionals and scholars

Towards DIVE+: user studies

OPENIMAGES.EU

3,220 news broadcasts

Netherlands Institute for Sound & Vision

GTAA thesaurus

DELPHER.NL

197,199 Scans of Radio bulletins

1937 – 1984

AMSTERDAM MUSEUM

73,447 cultural heritage objects

AM Thesaurus

TROPENMUSEUM

78,270 cultural heritage objects

SVNC thesaurus

Collections and Vocabularies

Enrichment (Case: news broadcasts)

ENTITY EXTRACTION

EVENTS CROWDSOURCING AND LINKING

TO CONCEPTS THROUGH

CROWDTRUTH.ORG

SEGMENTATION & KEYFRAMES

LINKING EVENTS AND

CONCEPTS TO

KEYFRAMES

Crowdsourcing for Events in Texts & Videos

CrowdTruth.org

DIVE:MediaObject

Nieuws uit Indonesië:

opheffing van het KNIL

dive:depictedBy

sem:hasTimestamp

sem:Event

ANP:1950-08-11:50

dive:isRelatedTodive:relatedPlacesem:hasPlace

dive:isRelatedTodive:relatedActorsem:hasActor

dive:isRelatedTodive:relatedPlacesem:hasPlace

sem:Time

25 Juli 1950

dive:depictedBy

sem:hasTimestamp

DIVE:MediaObject

Mannen bij het huis van Paul Spies

aan de Parapattan 42, Djakarta

dive:depictedBy

dive:depictedBy

dive:depictedBy

DIVE:MediaObject

ANP:1950-08-11:50DIVE:MediaObject

Schaal

sem:Time

11 Augustus 1950

sem:Event

ontbindingsceremonie

sem:Place

Djakarta

sem:Place

Indonesië

sem:Actor

Mohammad Hatta

Integration of Heterogeneous Collections

4 Collections, 3 Thesauri274,831 Media Objects199,264 Events439,158 Event-Actor relations219,669 Event-Place relations…

15 Million+ RDF Triples

In DIVE+ triple Store

DIVE+ UI: INFINITY OF EXPLORATION

/ Support exploration and serendipity /

/ Visual inspection of media objects and entities /

/ Lets user build, save and share storylines/

filters

results ordering

filter on media objects

order media

objects by date

filter on events

explore

event

related

entities

explore

event

event

related

entities

place entity

exploration

narrative

bookmarking

/ makes heterogeneous cultural heritage

material available as linked open data

/ showcases various data enrichment

strategies to construct explorable knowledge

graphs

/ features innovative UI for deep exploration by

DH experts

DIVE+

/ is based on extensive user studies with various users

/ has impact through the national research infrastructure

CLARIAH and relations to DH initiatives and media

professionals

/ http://diveproject.beeldengeluid.nl

/ http://diveplus.beeldengeluid.nl

/ joomen@beeldengeluid.nl

DIVE+