about multimedia presentation generation and multimedia metadata: from synthesis to analysis, and...
TRANSCRIPT
Multimedia Presentation Generation and Multimedia Metadata: From Synthesis to Analysis, and Back?
Ansgar Scherp
ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 2
Multimedia Presentation Generation
Ansgar Scherp, Susanne Boll: Paving the Last Mile for Multi-Channel Multimedia Presentation Generation. MMM 2005: 190-197 (Best Paper Award)
It is all about the media metadatanot the media content itself ...
• Dynamic generation• Multi-channel output
ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 3
Authoring Tool xSMART• First to enable
context-driven multimediaauthoring
• Using mediametadata anduser profileinformation
Ansgar Scherp, Susanne Boll: Context-driven smart authoring of multimedia content with xSMART. ACM Multimedia 2005: 802-803
ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 4
We Care So Much About Metadata!• Really? So how can it be that we ...
… almost loose all metadata after assemle?
Semantics Barrier!
ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 5
Idea: Emergent Semantics• Semantics that emerges from putting the single
pieces of media content together• “Sum is more than just the set of its pieces”
• Wait a minute: how to describe the semantics?
ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 6
Example: Emergent Semantics
S. Boll, P. Sandhaus, A. Scherp, U. Westermann: Semantics, content, and structure of many for the creation of personal photo albums. ACM Multimedia 2007: 641-650
Ansgar Scherp: Canonical processes for creating personalized semantically rich multimedia presentations. Multimedia Syst. 14(6): 415-425 (2008)
• Rule-based• Customizable• Multi-channel
Slide 7ACM Multimedia 2016 Ansgar Scherp – [email protected]
Embedding Metadata in SMIL<smil xmlns="http://w3.org/2006/SMIL30/..."><head><!-- Metadata --><metadata id="meta-rdf"> </metadata><!-- layout --></head><body> <!-- Presentation content --> <seq id="mainPresentation"> <par xml:id=“achievements">...</par> <par xml:id=“risks">...</par> </seq></body></smil>
???
Slide 8ACM Multimedia 2016 Ansgar Scherp – [email protected]
Solution Approach
Formal modeling framework for representing and integrating multimedia metadata
Multimedia Metadata Ontology (M3O)
Carsten Saathoff, Ansgar Scherp: Unlocking the semantics of multimedia presentations in the web with the multimedia metadata ontology. WWW 2010: 831-840
ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 10
Some Cool Semantics Analyses ...
Text
Cancer (18899-3)Research (10436-6)USA (17829-1)…
Smart Photo Selection (CHI'14)
Gaze Analysis in Search (IUI'14)
Document Classification (KCAP'15)(Nomination for Best Paper Award)
Text Extraction from Images (DocEng'15)
ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 11
MOVING back to the roots?!How to deal with the vast information
in research and innovation?
Generating cMOOCsPersonalized advise (log analyses)Advanced search and retrieval
EU H2020 project since April 2016, budget: 3.5 M €, URL: http://moving-project.eu/
ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 12
Use Cases• Research on business information
by public administrators– Understand complex situations– Increase compliance with current
laws and regulations
• Managing & mining research information
– Reduce information overload– Assist in evaluating and selecting
relevant information resources
ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 13
Example: EconBiz's Guided Walk
• URL: http://www.econbiz.de/eb/gw/
ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 14
Thank you ...... for giving me a good reason and the fun to burrow in my own paper archive!
Contact me!Email: [email protected]• Twitter: https://twitter.com/ansgarscherp• Slideshare: http://de.slideshare.net/ascherp• KD-Website:
http://www.zbw.eu/en/research/knowledge-discovery/http://www.kd.informatik.uni-kiel.de/en/