r&d bbc 2012 multimedia classification sam davies, research engineer bbc research &...
TRANSCRIPT
R&D BBC 2012
Multimedia Classification
Sam Davies, Research Engineer
BBC Research & Development
R&D BBC MMVIII
British Broadcasting Corporation Archive
• BBC I&A– Perivale, London– >1,000,000 items
• ~ 650,000 TV• ~ 350,000 Radio• ~ 1.5 million hours
– Since 1922• BBC Redux
– online– 300,000 hours of TV and radio– Since 2007
• BBC Written Archive– 4 ½ miles of documents– Caversham, Reading
R&D BBC MMVIII
Current Programme Retrieval
• Infax
– > 1,500,000 programmes
• LonClasss
– > 52,000 concepts
• “pop music”, “Iraq”, “criticism of growing plants for biofuels”, “Dover Castle communications centre”, “fake psychics”, “posters of Ariel Sharon”.
R&D BBC MMVIII
Current Programme Retrieval
• Infax
– > 1,500,000 programmes
• LonClasss
– > 52,000 concepts
• “pop music”, “Iraq”, “criticism of growing plants for biofuels”, “Dover Castle communications centre”, “fake psychics”, “posters of Ariel Sharon”.
– BBC Redux
R&D BBC MMVIII
Multimedia Entertainment Retrieval
• “The BBC’s main activities should be the promotion of its Public Purposes through the
• provision of output which consists of information, education and entertainment”
– Royal Charter for the continuance of the British Broadcasting Corporation 2006
R&D BBC MMVIII
Multimedia Entertainment Retrieval
R&D BBC MMVIII
Mood Based Classification
R&D BBC MMVIII
Mood Based Classification
• Inter-programme classification using extracted metadata.
• Redux based ( >2,500 programmes classified)
• Prototyping iPlayer version
– Available soon
R&D BBC MMVIII
Mood Based Classification
R&D BBC MMVIII
Mood Based Classification
• Ground Truth Collection
– Video
• 200 members of public from varied demographic
• 250 programmes
R&D BBC MMVIII
Mood Based Classification
• Ground Truth Collection
– Video
• 200 members of public from varied demographic
• 250 programmes
– Music
• MusicalMoods
– 20,000 members of public
– 60 theme tunes
R&D BBC MMVIII
Publications & more info
• Davies, S., Bland, D. & Grafton R (2010) “A Framework for Automatic Mood Classification of TV Programmes” presented at SAMT 2010.
• Davies, S. (2010) “Interestingness Detection in Sports Audio Broadcasts” presented at IEEE ICMLA 2010
• Knoiusz, P. & Mikolajcyzk, K. (2011) “Soft Assignment Of Visual Words As Linear Coordinate Coding And Optimisation Of Its Reconstruction Error” presented at ICIP 2011
• Knoiusz, P. & Mikolajcyzk, K. (2011) “Spatial Coordinate Coding To Reduce Histogram Representations, Dominant Angle and Colour Pyramid Match” presented at ICIP 2011
• Davies, S. & Bland, D. (2011) “An Improved Framework for Affective Classification and Browsing of Large Scale Broadcast Archives” presented at ACM SIGIR 2011
• Mann, M. & Cox, T. (2011) “Music Mood Classification of Television Theme Tunes” presented at ISMIR 2011
• Davies, S., Mann, M., Cox, T. & Allen, P. (2011) “Musical Moods: A Mass Participation Experiment for Affective Music Classification” presented at ISMIR 2011
• Eggink, J. Allen, P. & Bland, D. (2011) “A Pilot Study for Mood-Based Classification of TV programmes” presented at ACM SIGAC 2011
• Eggink, J. & Bland, D. (2012) “A Large Scale Experiment for Mood-Based Classification of TV Programmes” presented at ICME 2012
• Available at http://www.bbc.co.uk/rd/publications/whitepapers.shtml
