harnessing machine learning, ai & metadata to power-up content … · 2017. 6. 1. ·...

Harnessing Machine Learning, AI & Metadata to Power-up Content Discovery

Scott MadduxVP, Business [email protected] a y 2 0 1 7

2 © 2016 Company confidential.© 2017 TiVo

The Revolution will be Televised… and Powered by AI & ML

*AI: ”The capability of a machine to imitate intelligent human behavior.”

Very Large

DatasetsAI*

Cheap & Plentiful

CPU Cycles

Sophisticated Machine Learning

Algorithms


Content Providers

Broadcast & Cable

Telco

SVOD, TVOD & PVOD

OTT

TVE

Web Portals

IPTV(streamers)

CE(smart TVs)

Social Media

YouTube

Game Consoles

Other (Auto,

Aviation)

Content Owners’ Ecosystem Has Changed Dramatically

ContentOwners

Broadcast& Cable

Televisions

(This model held for 60+ years)

Fragmented Distribution Channels, Advertising & Viewers

>> Today


TiVo Delivers The Complete Discovery UX

1. Set-Top Boxes2. Next-Gen Guides3. Voice Interface4. Search Solutions5. Recommendations6. Ad Targeting7. Metadata

• Film, TV & Digital• Rich Images• Schedule Data• Sports• Music• Games


Search & Recommendations Ads & AnalyticsUX, STBs & Guides

Metadata is Foundational to the TiVo Portfolio

Factual • Descriptive • Graph • Image • Trending • Social

Video Sports Music Games Books


MetadataFactual Metadata

• Cast, Writer, Producer, Director etc.• Air data / Season:Episode• Summary / Bio

Image Metadata• Poster Art• Cast (Headshot)• Character• Scene• In-Era• Red Carpet• Production

Attributes• Format• Type• Language• Duration• Popularity Score• Cast/Character Pair• Trend Scores & Ratings• Studio/Network• Awards

Entertainment Graph• Cross-category links (people & works)

Distribution Channels• Distribution Windows & Schedules• OTT Availability

Deep Descriptors & Keywords• Theme• Tone• Mood• Story


ML Applications Enrich Metadata

AI

Natural Language Processing (NLP) Signal ProcessingMachine Learning

Ingest

Extraction & Enrichment

Graphed Relationships

NLU(Understanding)

NLG(Generation)

Audio

Video(aka Computer Vision)

Image

• Object Identification• Facial Recognition• Program Identification• Ad Detection• Brand (logo) Identification

• Voice Recognition• Excitement Metering• Ad Detection

• Face detection• Text detection• Image extraction from Video• Auto cropping

• Semantic Analysis• Deep Descriptor

Extraction

• Celebrity Bios• Descriptions• Play by Play• Game Recaps

• Continuous ingest from 1000’s of structured and unstructured data sources

• Data Parsing• Normalization• Matching• Deduplication• TiVO Unique ID

• Cross Category Links• Entity Relationships• Weighting• AKAs


sanctuary{17} westernamerican{20} rebels{17}barter{16}blooddonor{70} postapocalyptic{85}

cultleader{20}exodus{20} warboy{32}godofwar{16} peopleeater{58} sandstorm{68}

citadel{54}tyrannical{16}

nuclearholocaust{20} transfuses{35}ontherun{15}

bloodbag{43} wasteland{47}

spiritualsequel{20} highoctane{19}developmenthell{20} ozploitation{20}


Trending Data + Knowledge Graph

JordanPeele’ssatiricalhorrorfilm“GetOut”gainedverystrongsocialmediamomentumandbecameoneofthehighest-grossingoriginaldebutsever.

Horror

Comedy

Satire

Genre

Daniel Kaluuya

Suspense Thriller

Cast

Allison Williams

Storks

Jordan Peele

Keegan-Michael

Key

MadTV

Key & Peele

Keanu

Get Out


Next-Gen Scene Level Metadata

Actor/Character

Object

Mood/Tone

Location

Event

Brand

Music

Grandeur Romance Lust Threat Drunk Team Conflict Loss Terror Nostalgia Power Retro

ElizabethDebicki ChrisPrattZoeSaldana MichaelRooker HowardtheDuck KurtRussel Sylvestor Stallone

Throne Batteries Headphones Mohawk Arrow Martini Robe LeatherJacket Blob Spaceship

Utopia Forest DesolatePlanet Galaxy IceWorld Prison Earth Missouri Bar Spaceship

Theft Escape Chase Attack Mutiny Reunited TruthRevealed Explosion

SonyWalkman Funko Vinyl DairyQueen FordTruck MicrosoftZune

ELO Sweet FleetwoodMac SamCooke CheapTrick CatStevens Parliament DavidHasselhoff


Next-Gen Scene Level Metadata

Actor/Character

Object

Mood/Tone

Location

Event

Brand

Music








SceneLevel(timebased)Metadata


ML & AI Tech Behind the Scenes








FACIALRECOGNITION(videosignalprocessing/computervision)

OBJECTIDENTIFICATION(videosignalprocessing/computervision)

VOICERECOGNITION(audiosignalprocessing+naturallanguageunderstating– NLU)DEEPDESCRIPTOREXTRACTION(naturallanguageprocessing– NLP)GRAPHRELATIONSHIPS(namedentityrecognition– NER)WEIGHTEDSCORES(latentsemanticanalysis– LSA)EVENTSUMMARIES(naturallanguagegeneration– NLG)

OBJECTIDENTIFICATION(videosignalprocessing/computervision)

SONG/ARTISTIDENTIFICATION(audiosignalprocessing)

Actor/Character

Object

Mood/Tone

Location

Event

Brand

Music


Content Providers

Broadcast & Cable

Telco

SVOD, TVOD & PVOD

OTT

TVE

Mobile Web & Apps

IPTV

CE

Social Media

YouTube

Game Consoles

Other (Auto,

Aviation)

ML + Metadata Drive Discovery & Monetization

• Production

• Distribution

• Ad Ops & Sales

• Targeting

• Search

• Recommendations

TiVo metadata solutions help package & deliver your content to the right audience.

Thank You

Scott MadduxVP, Business [email protected]

harnessing machine learning, ai & metadata to power-up content … · 2017. 6. 1. ·...

Documents