mediaeval 2016 - tud-mmc predicting media interestingness task
TRANSCRIPT
1WIS
Web InformationSystems
TUD-MMC at MediaEval 2016Predicting Media Interestingness Task
Cynthia C. S. LiemMultimedia Computing GroupDelft University of Technology
2WIS
Web InformationSystems
Why I was interested in this task• Narrative arcs in stories [Liem et al., IJMIR, 2013]
• Arcs of intensity in concerts [in preparation]
3WIS
Web InformationSystems
Oops.• I did not manage joining preparation L
• The acquired labels did not take temporal dynamics into account L
• As a human, I did not understand the ground truth rankings L
4WIS
Web InformationSystems
Swapping ground truth• Are criteria for the image & video tasks consistent?
• Image task ≠ video task
5WIS
Web InformationSystems
Some heuristic considerations• Labels acquired through comparison of within-trailer pairs à no between-trailer data
• VoD scenario: excerpts should be reasonably representative
• Multiple shots may belong to single scene or setting
• Binary relevance added afterwards: focus on ranking
6WIS
Web InformationSystems
Two basic features• Faces: if people are clearly framed, the audience should probably emphatize
[Marin-Jimenez et al., IJCV, 2014]
7WIS
Web InformationSystems
Two basic features• HSV histograms: rough but straightforward
8WIS
Web InformationSystems
Results