Download - Presentation 17 may keynote lara aroyo
![Page 1: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/1.jpg)
use cases with semantics & user
interaction in TV & cultural heritage
collections
Lora Aroyo@laroyo
HUMANS & MACHINES TOGETHER
Friday, May 17, 13
![Page 2: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/2.jpg)
Time-consuming:5 time the video duration
Coarse grained: refer to entire video
Professional vocabulary:experts use a specific vocabulary
that is unknown to general audiences
OBSERVATION I:VIDEO ANNOTATIONS
Friday, May 17, 13
![Page 3: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/3.jpg)
People request fragments:broadcast (33%), stories (17%),
fragments (49%)
Finding fragments longer:stories (2x), fragment (3x)
Not finding:35% of clicked results
not found by title or term
OBSERVATION II:SEARCH BEHAVIOR
Friday, May 17, 13
![Page 4: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/4.jpg)
Improve support for fragment search
time-based annotations
bridging vocabulary gap between searcher
& cataloguer
crowdsourcing?
OBSERVATION III:CHANGE NEEDED
Friday, May 17, 13
![Page 5: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/5.jpg)
CULTURAL HERITAGE WITH INVOLVED CONSUMERS &
PROVIDERS
data: open, shared & accessible
infrastructures: interoperable
smart services: relevant content in right context
PART I
Friday, May 17, 13
![Page 6: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/6.jpg)
http://chip-project.org
http://agora.cs.vu.nl
Rijksmuseum Amsterdam
Friday, May 17, 13
![Page 7: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/7.jpg)
http://openimages.eu
http://academia.nl
MUNCH project
CHOICE project
Netherlands Institute for Sound & Vision
Friday, May 17, 13
![Page 8: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/8.jpg)
EuropeanaCultural Search
http://e-culture.multimedian.nl
http://europeana.eu/portal/thoughtlab.html
http://europeana.eu
Friday, May 17, 13
![Page 9: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/9.jpg)
How to use the Crowd
Friday, May 17, 13
![Page 10: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/10.jpg)
http://waisda.nlhttp://www.prestoprime.org/
@waisda
Friday, May 17, 13
![Page 11: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/11.jpg)
Friday, May 17, 13
![Page 12: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/12.jpg)
Friday, May 17, 13
![Page 13: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/13.jpg)
Friday, May 17, 13
![Page 14: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/14.jpg)
Friday, May 17, 13
![Page 15: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/15.jpg)
Two PilotsPilot I Pilot II
months 8 2
videos 612 1544
players 2000 438
tags 420000 172000
Friday, May 17, 13
![Page 16: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/16.jpg)
On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011
Friday, May 17, 13
![Page 17: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/17.jpg)
time-basedbernhard
just “tags”
On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011
Friday, May 17, 13
![Page 18: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/18.jpg)
user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Google
objects (57%)
westminsterabbeyabbeypriestergeestelijken
hekpaardentochtaankomst
koetskroningmensenmassaparadekroon regen
On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011
Friday, May 17, 13
![Page 19: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/19.jpg)
user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Google
persons (31%)
bernhard
juliana
objects (57%)
On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011
Friday, May 17, 13
![Page 20: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/20.jpg)
user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Google
locations (7%)
engeland persons (31%)
objects (57%)
On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011
Friday, May 17, 13
![Page 21: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/21.jpg)
user vocabulary8% in professional vocabulary23% in Dutch lexicon89% found on Google
locations (7%)
persons (31%)
objects (57%) no events
no scenes
On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011
Friday, May 17, 13
![Page 22: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/22.jpg)
just “tags”
On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011
Friday, May 17, 13
![Page 23: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/23.jpg)
hye park just “tags”
typos
On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011
Friday, May 17, 13
![Page 24: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/24.jpg)
just “tags”
typos
no unique references
bernhard
On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011
Friday, May 17, 13
![Page 25: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/25.jpg)
just “tags”
typos
no unique references
beefeater
no synonyms
On the Role of User-Generated Metadata in A/V CollectionsRiste Gligorov et al. KCAP Int. Conference on Knowledge Capture 2011
Friday, May 17, 13
![Page 26: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/26.jpg)
THE QUALITY OF TAGS?
Friday, May 17, 13
![Page 27: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/27.jpg)
Tag gardeningannotations for video, fragments & scenes
adding types & roles to user tags
mapping tags to concepts, disambiguationspelling corrections
single & batch tags/video editing
Friday, May 17, 13
![Page 28: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/28.jpg)
Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012
Friday, May 17, 13
![Page 29: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/29.jpg)
Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012
group by type (faceted)
Friday, May 17, 13
![Page 30: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/30.jpg)
Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012
Friday, May 17, 13
![Page 31: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/31.jpg)
Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012
concepts uniquely identified
Friday, May 17, 13
![Page 32: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/32.jpg)
Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012
Friday, May 17, 13
![Page 33: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/33.jpg)
Linking user-generated video annotations to the web of dataMichiel Hildebrand et al. International Conference on Multimedia Modeling 2012
background info
Friday, May 17, 13
![Page 34: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/34.jpg)
Friday, May 17, 13
![Page 35: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/35.jpg)
Friday, May 17, 13
![Page 36: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/36.jpg)
Friday, May 17, 13
![Page 37: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/37.jpg)
Install Your Own Waisda?
Friday, May 17, 13
![Page 38: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/38.jpg)
TV WITH INVOLVED CONSUMERS & PROVIDERS
42% UK adults discuss/comment on TV programs while watching (YouGov Deloitte report, Aug 2010)
49% of UK Twitter users use Twitter regularly when watching TV (BBC Audience Research Twitter survey, Aug 2010)
PART II
Friday, May 17, 13
![Page 39: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/39.jpg)
but ...
© VickyBuser, BBC
Friday, May 17, 13
![Page 40: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/40.jpg)
lost in space© RedBee Slides at MIPCube2012
Friday, May 17, 13
![Page 41: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/41.jpg)
demand for new experienceFriday, May 17, 13
![Page 42: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/42.jpg)
http://notube.tv http://www.slideshare.net/NoTubeProject
@notubeproject
© Dan Brickley
Friday, May 17, 13
![Page 43: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/43.jpg)
NoTube’s N-Screen
N-Screendrag & drop, sharing & TV control
drag & drop, shuffle, sharing & TV control
Friday, May 17, 13
![Page 44: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/44.jpg)
NoTube’s User Activitiesaggregate
Friday, May 17, 13
![Page 45: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/45.jpg)
NoTube’s User Interestsprofile
Friday, May 17, 13
![Page 46: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/46.jpg)
NoTube’s Beancounteraggregate, analyze & profile
Friday, May 17, 13
![Page 47: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/47.jpg)
Recommendations in NoTube
• surface interesting, new & relevant programs to individual and group users• combine in a complementary way different statistical & semantic approaches• define metrics for, e.g. serendipity, diversity, relevance
© Dan Brickley
Friday, May 17, 13
![Page 48: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/48.jpg)
• access to basic metadata about programs • links are the basic currency of social media
• URIs for the things you watch • links to related Web entities
• even a small amount of metadata enables interesting apps
Open Web Standards & Data
Friday, May 17, 13
![Page 49: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/49.jpg)
• The move to IP - opportunity to discover what people watch in greater breadth and depth• gather consumers’ viewing behavior & video streams• combine them with enhanced EPG as input for a holistic live-stream data mining analysis
• generate a high-quality linked open dataset (LOD) describing live TV programming• market research on viewing behavior
Friday, May 17, 13
![Page 50: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/50.jpg)
Michiel Hildebrand
Lotte Belice BaltussenJacco van Ossenbruggen
Marteen Brinkerink
Johan OomenGuus Schreiber
Riste Gligorov
Lora Aroyo
THE TEAM
@lottebelice
@johanoomen
@mbrinkerink
@laroyo
@jrvosse
@GuusSchreiber
@McHildebrand
Friday, May 17, 13
![Page 51: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/51.jpg)
THE TEAM
Friday, May 17, 13
![Page 52: Presentation 17 may keynote lara aroyo](https://reader035.vdocument.in/reader035/viewer/2022070319/5582ee68d8b42a32168b48b5/html5/thumbnails/52.jpg)
• http://waida.nl• http://prestoprime.org• http://notube.tv• http://vista-tv.eu• http://lora-aroyo.org
• @waisda• @prestocenter• @notubeproject• @vistatv• @laroyo
Questions
Friday, May 17, 13