crowdsourcing video annotation
DESCRIPTION
Presentation at the final showcase of the European project PrestoPRIME: Waisda video labeling game, the analysis of the collected tags and tag gardening.TRANSCRIPT
Final Showcase PrestoPRIMEFP7-ICT-2007-3 231161
Crowdsourcing video annotationMichiel Hildebrand, VU University Amsterdam
and Lora Aroyo, Riste Gligorov, Jacco van Ossenbruggen, Guus Schreiber
and Maarten Brinkerink, Lotte Baltussen, Johan Oomen, Erwin Verbruggen
FP7-ICT-2007-3 231161 PrestoPRIME 2Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Enrichment
Video Quality assessment
Fingerprint content tracking
Rights Ontology and RightsDraw
Crowdsourcing video annotation; Waisda
Planning/Checking-in/Ingest
Preservation Planning Metadata Mapping and
Validating Storage and Master
Levels
Access
Multivalent
framework
Access for
Master level
materials
Monitoring and Running Preservation
Managing Archive Services
Policy based Long- term Data Management
PRODUCER
CONSUMER
Knowledge and Services: PrestoCentre
Integration Platforms: Rosetta – P4
FP7-ICT-2007-3 231161 PrestoPRIME 3Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Motivation
Goal 1: Collect time-based video annotations
Goal 2: Improve access to video fragments
Goal 3: Connect with the public
FP7-ICT-2007-3 231161 PrestoPRIME 4Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
FP7-ICT-2007-3 231161 PrestoPRIME 5Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Results
2010 EuroITV Winner Grand Challenge
2010 ArchivesNext Best Archives on the Web Award
2009 TIMAF European Best Practices Award
2012 Nominated for Dutch Game Award
FP7-ICT-2007-3 231161 PrestoPRIME 6Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Results Goal 1 : annotationNumber of tags collected in 4 months by semi-professionals from NCRV and Waisda users
FP7-ICT-2007-3 231161 PrestoPRIME 7Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Results Goal 1 : annotationPercentage of tags found in GTAA (Professional), WordNet (Dutch Dictionary), Google
FP7-ICT-2007-3 231161 PrestoPRIME 8Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Results Goal 1 : annotationPanofsky-Shatford matrix for 1,313 Waisda tags from 1st Waisda pilot
Abstract General Specific Total
Who 10 166 177 31%
What 73 563 12 57%
Where 0 68 8 7%
When 4 31 6 5%
Total 7% 74% 9%
FP7-ICT-2007-3 231161 PrestoPRIME 9Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Results Goal 2 : search
FP7-ICT-2007-3 231161 PrestoPRIME 10Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Results Goal 2 : searchMean Average Precision of fragment retrieval using 50 queries and 198 videos
FP7-ICT-2007-3 231161 PrestoPRIME 11Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Results Goal 3: user engagmentNumber of users 2nd pilot Waisda
735registered
1000sanonymous
FP7-ICT-2007-3 231161 PrestoPRIME 12Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Results goal 3: user engagmentUser visits for Waisda 1st pilot
FP7-ICT-2007-3 231161 PrestoPRIME 13Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Lessons learned
Use short video fragments Expect tags:
in a user vocabulary mainly general descriptions of What and Who
Time-based annotations enable: within-video search high recall fragment retrieval
Large number of contributors provide additional motivation (short term goal)
FP7-ICT-2007-3 231161 PrestoPRIME 14Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Outcomes
http://github.com/beeldengeluid/waisda
Waisda white label available under GPL open source license
FP7-ICT-2007-3 231161 PrestoPRIME 15Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Outcomes : student projectsDetecting emotions in Waisda tags (Master project Wouter Meys)
FP7-ICT-2007-3 231161 PrestoPRIME 16Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Outcomes : student projectsShort term goals within Waisda through missions (master project Olga Beza)
FP7-ICT-2007-3 231161 PrestoPRIME 17Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Outcomes : student projectsWaisda for fictional movies (PhD research Liliana Melgar)
FP7-ICT-2007-3 231161 PrestoPRIME 18Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Outcomes : new collections
Film institute Netherlands
Dutch broadcaster
Europeana V2
FP7-ICT-2007-3 231161 PrestoPRIME 19Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Install your own Waisda?
1. git clone https://github.com/beeldengeluid/waisda.git
2. setup MySQL database
3. add videos identifier title duration URL video source URL key frame
4. style user interface Logo color scheme static pages
5. deploy in Jetty or Tomcat
FP7-ICT-2007-3 231161 PrestoPRIME 20Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Integration : Waisda API
videos• submit• update
tags• export• sync
FP7-ICT-2007-3 231161 PrestoPRIME 21Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Integration : Tag Gardening
videos
tags
annotations
FP7-ICT-2007-3 231161 PrestoPRIME 22Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
Integration : Tag Gardening
FP7-ICT-2007-3 231161 PrestoPRIME 23Michiel Hildebrand (VUA)
FINALSHOWCASE
21.- 22.11.2012VIENNA
challenges
Maintain Waisda? white label
Improve quality of tags Waisda: collect specific types of tags Processing: filter tags to improve precision