watermarking and fingerprinting for global broadcast ... · watermarking & fingerprinting video...
TRANSCRIPT
1
Watermarking and Fingerprinting for Global Broadcast Monitoring
Presentation for: Bits by the Bay, SMPTE 2014 Technology Conference
Presenter: Wim J.C.M. Bus
Title: SVP Product Management
2
1. CONTENT IDENTIFICATION
2. GLOBAL BROADCAST MONITORING PLATFORM
3. QUESTIONS
PRESENTATION OVERVIEW
3
1. CONTENT IDENTIFICATION
WATERMARKING & FINGERPRINTING
4
Watermarking & Fingerprinting
Video Watermarking(VWM)
Audio Fingerprinting(AFP)
Audio Watermarking(AWM)
Video Fingerprinting(VFP)
Embedding a unique identifier in audio and/or video, imperceptible to the human ear and eye, but can be detected by special software tools.
Watermarks make each content copy unique when embedding unique data, allowing to track unique content copies or the source of (illegal) content copies.
Identifying content by extracting unique features from audio and/or video, which are compared with features previously stored in a database
Fingerprints give content assets and copies thereof a unique identity, allowing efficient high volume and real-time identification of content assets and copies thereof.
Fingerprinting (matching)Watermarking (embedding)
detectionUnique watermark
Media content
Insertion of unique ID tag to individual pieces of content
Distribution
UsageRe-distribution
WM
Metadata
Metadatadatabase
Assetregistration
DistributionMedia content Distributedmedia content
Identification of fingerprintsNbr. 6538964212556….Comparison and matching
of fingerprints against fingerprints stored into the database
5
Watermarking Parameters
Optimized for
application
Perceptual QualityImperceptibility of the
embedded information
RobustnessRobustness against further
modifications of the content
Capacity (Payload)How much retrievable
Information can be transmitted
Original image
115 154 180 …
158 183 174 …
177 168 144 …
After embedding
114 150 180 …
156 186 172 …
177 170 144 …
6
Fingerprint Parameters
• Robustness (False Negative)“Can a clip still be identified after (severe) degradation?”
• Reliability (False positive)“How often is a clip falsely identified?”
• Fingerprint SizeStorage needed for a fingerprint
Bandwidth needed to send fingerprints to a fingerprint server
• GranularityHow many seconds of content is needed to identify a clip
• 50-80 times per second a 32 bit sub-fingerprint is extracted
• Bits are determined by looking at characteristic features of a video and
audio (e.g. luminance changes for video and spectrum changes for audio)
• A group of sub-fingerprints form a fingerprint.
Tim
e
32 bits
7
Fingerprinting Matching
4.6
s
• 256 sub fingerprints ( a fingerprint block)
are compared by counting bit-errors
• If less than 35% of the bits are in error
fingerprint blocks are said to be derived
from the same clip.
Reference Fingerprint
Extracted from the
reference content
Fingerprint extracted
from unknown content
Difference
8
Watermarking vs Fingerprinting
Watermarking (Granularity 1 sec)
(+) Different identifiers in copies of the same content(+) Stand alone(-) Modification of the content (active)(-) Watermark not present in legacy content
Fingerprinting (Granularity 3-5 sec)
(+) Content is not modified (passive)(+) Works for legacy content (-) Connection to database required(-) Cannot distinguish distribution path/source
9
2. GLOBAL BROADCAST MONITORING PLATFORM
MEDIA INTELLIGENCE
10
Teletrax - Key Characteristics
Technology:
– Video Watermark & Video Fingerprinting based broadcast monitoring service
– Optimized for Short-Form and Long-Form content tracking
Network:
– A consistent Global monitoring network
– Over 2,200 TV channels in more than 60 countries incl. all 210 US DMA’s
Platform:
– Flexible server farm running in a High-Grade professional colocation in New Jersey.
– World wide TV content monitoring information delivered to the desktop within 15 minutes
11
• Government/NGO’s (Watermarking/Fingerprinting)
– (Non) Government organisations that create content and have a need to both monitor domestically and/or internationally.
– Global Monitoring of third content in case of incidents/ crisis.
– What , Where and how long is content being used (Exposure).
– In which context is the content being used (video, EPG).
• News agencies (Watermarking)
– News agencies distribute stories to and need track the actual usage and billing of its clients.
• Entertainment (Fingerprinting)
– Large studios that distribute high value content and want to track for contract compliancy.
– Track illegal usage of non licensed content.
• Advertisement (Watermarking/Fingerprinting)
– Campaign verification (Watermarking /Fingerprinting)
– Competitive intelligence, which competitive brands are/where running campaigns on TV (Fingerprinting)
Teletrax – Application areas
12
Broadcast Monitoring – Watermarking workflow
Identification of
unique watermark
Watermarking
Insert ID tag to
individual pieces
of content
DistributionMedia content
metadata
Monitoring network
Data-Centre
Content owner
Content identified
and reported
via online portal
TV
Channel
13
Broadcast Monitoring – Fingerprinting workflow
Distribution
Monitoring network
Data-Centre
Content owner
Content identified
and reported
via online portal
TV
Channel
Fingerprint
extraction
Reference
fingerprint
registration
Matching
Analysis
Media content
Channel-FP
storage
Reference-FP
Database
14
ConfidentialConfidential
Broadcast Monitoring – Platform Architecture
IdentificationHits Engine
Data collection
Rep
ort
Sch
edu
ler
Analytics Engine Analytics
Data MarriageCustom
MetadataGRPData
Program Data
Detectors
VWMAudio CCVFP
Embedders / Ingest
VWMmetadata
VFPAudio
Custom ReportingStandardMarketIndividual Customer
Network
Management
FP-Reference Database
Channel-FPStorage
Video clips
15
Raw data for per TV channel
16
Comparison
17
Retro-Track – Boston Marathon
18
3. QUESTIONS
19
www.civolution.comTwitter: @Civolution
Solutions for content identification and value creation