first annual meeting of participantseidr.org/documents/eidr_annual_meeting_1-18-2012_v5.5.pdf ·...

37
March 2010 First Annual Meeting Of Participants January 18, 2012

Upload: others

Post on 20-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

March 2010 First Annual Meeting Of Participants January 18, 2012

Page 2: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Agenda

•  Welcome & Introductions •  Annual Meeting Business - Announcement of 2012 EIDR Board •  Year in Review - 2011 •  Looking Forward to 2012 •  Working Discussion – 2012 POC Opportunities •  Working Discussion – Onboarding & Matching

–  Onboarding overview – what we’ve learned –  Matching framework - key challenge –  Matching service providers

•  Working Discussion - Data Model for Digital Encodings •  Close – Transition to DEG/HITS Steering Committee Meeting

1/18/2012 EIDR Confidential 2

Page 3: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Introductions

Please Welcome our Newest EIDR Members •  V2 Solutions •  Argo Systems •  BUFVC (British University Film & Video

Council •  Prime Focus Technologies •  Exactuals •  MediaMorph

1/18/2012 EIDR Confidential 3

Page 4: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Annual Meeting Business - Board Election

•  2011 –  7 directors/9 authorized –  4 founding promoters + 3 elected industry

promoters •  2012

–  9 directors/11 authorized –  Increase to 5 elected industry promoters –  2 expansion seats remaining

•  5 promoter nominations for the 5 seats

1/18/2012 EIDR Confidential 4

Page 5: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

2012 EIDR Board of Directors

•  CableLabs – Jud Cary •  Comcast – Steve Heeb •  Deluxe – Greg Gewickey •  Disney – Arnaud Robert •  MovieLabs – Kip Welch •  Neustar – Tim Dodd •  Rovi – John Moakley •  Sony – Eric Iverson •  Warner Bros – Darcy Antonellis

1/18/2012 EIDR Confidential 5

Page 6: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Year in Review – 2011

1/18/2012 EIDR Confidential 6

Page 7: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Membership – Strong & Growing

1/18/2012 EIDR Confidential 7

Promoters  Contributors 

CableLabs  Argo Systems Comcast  Avail‐TVN Cox  Baseline 

Deluxe  BUFVC Disney  Charter Communica@ons 

MovieLabs  Civolu@on NBCU  Digimarc Neustar  Exactuals Rovi Corp  iNDEMAND 

Shaw Communica@ons  Internet Video Archive Sony Pictures  Prime Focus Technologies 

Verance Corpora@on   Rentrak Warner Bros (Time Warner)   V2 Solu@ons 

Vobile 

Page 8: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Seeded Records – Steady Expansion

1/18/2012 EIDR Confidential 8

Titles: 2,010,335 (Year Range: 1888 - 2016)

Record type  Sept  Net Oct Adds  Net Nov Adds  Net Dec Adds  Current 

Movies   50967  1724  108  467  53266 

Series  7617  1113  41  27  8798 

Seasons  7844  1339  106  208  9497 

Episodes  105961  17940  1927  4547  130375 

One‐Time TV  11059  3986  266  138  15449 

Shorts  776  44  2  12  834 

Movie Edits & Encodings  1403  343  87  1928  3761 

Totals   185627  26489  2537  7327  221980 

Page 9: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

2011 POC/Deployment Projects

1/18/2012 EIDR Confidential 9

Descrip9on  Par9cipants  Status 

Digital distribu9on infrastructure with EIDR API; ini9al registra9on of ~1.5K records   Disney  Done 

Online retail workflow integra@on with EIDR API  WB/MSFT  Ongoing 

Title management workflow integra@on with EIDR API  NBCU  Ongoing 

Ini9al registra9on of ~1.5K records  Sony  Done 

UltraViolet workflow integra@on  WB, NBCU, Sony, Neustar  Ongoing 

VOD workflow integra@on NBCU, Comcast, 

iNDEMAND, Avail‐TVN, Rentrak 

Ongoing 

Linking VOD & linear metadata  Comcast, Rovi  Ongoing 

Matching internal records to EIDR IDs  Disney, WB, NBCU, Sony, Rovi, Baseline Research  Ongoing 

Monthly seeding process for new movie/TV records  Rovi  Done 

Supplemental seeding of movie records; adding alternate ID’s 

WB/Flixster, Baseline Research  Ongoing 

Page 10: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

2011 Development Overview

•  Q1 Release - 1.01 –  Maintenance release

•  Q2 Release - 1.02 –  Maintenance release –  Features – party DOIs,

user-provided tokens

1/18/2012 EIDR Confidential 10

Q1: Maintenance Release  Q2: Feature Release  Q3   Q4: Two Releases 

•  Q4 Release - 1.0.3 –  Maintenance release

•  Q4 Release - 1.0.4 –  Maintenance release –  Feature – Video Services ID

beta

Page 11: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

2011 Expenses

12/7/2011 EIDR Confidential 11

Category of Expense   2011 Totals 

Research & Development       Opera@ons   $329,300    New development   $137,375  Total R&D Services  $466,675  Hardware  $37,500  Marke9ng & Bus Dev  $86,812  G&A  $148,644  Total 2011 Expenditure   $739,631  

Page 12: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Looking Forward – 2012

1/18/2012 EIDR Confidential 12

Page 13: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

2012 Development Roadmap

•  Q1 Release - 1.1 –  Maintenance release –  Features - Video Services ID;

versions/edits & ancillary functionality

–  March 2012 (Alpha Jan)

•  Q2 Release - 1.1.x –  Maintenance release

1/18/2012 EIDR Confidential 13

Q1: Feature Release  Q2: Maintenance Release  Q3: Feature Release  Q4: Maintenance 

Release 

•  Q3 Release -1.2 –  Maintenance release –  Features - digital asset data

model improvements; metadata harmonization

•  Q4 Release - 1.2.x –  Maintenance release

Page 14: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Video Service ID

•  EIDR 1.1 Alpha now up and running on a new instance of Sandbox (Sandbox 2)

•  Independent of the Sandbox running the production EIDR instance

•  Sandbox 2 will allow initial seeding and testing of the Video Services ID functionality

•  David Agranoff of CableLabs is leading feature testing and seeding

1/18/2012 EIDR Confidential 14

Page 15: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

2012 Projected Expenses

12/7/2011 EIDR Confidential 15

Category of Expense   2012 Totals Research & Development       Opera@ons   $638,000    New development   $342,798  Total R&D Services  $980,798  Hardware  $37,500  Marke9ng & Bus Dev  $120,000  G&A  $298,495  Total 2012 Projected Expenditure   $1,436,793  

Higher 2012 spending driven by planned hiring, full ops cost, member consulting services, 2 major releases, SDK & documentation updates.

Page 16: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Membership – Need to Double in 2012

1/18/2012 EIDR Confidential 16

Adobe  Fox  Neblix Amazon  FreeWheel  SAG Apple  Google/YT  Samsung AT&T  Harris  Summit BBC  Hulu  Technicolor BSkyB  ITV  TF1 BestBuy  Jinni  Time Warner Cable 

Black Arrow  Lionsgate  Tivo Brighthouse  Liberty Global/UPC  Tribune Media Services 

Canoe  Microsoh  Verizon CBS  Neblix  Viacom/Paramount/MTV 

DigitalSmiths  Nielsen  Virgin Dish/Blockbuster  NTT Labs  Vivendi/Canal Plus/UMG 

DirecTV  Orange/France Telecom  Walmart/Vudu DGA  RedBee  West10 

Ericsson  RTL Group  WGA 

Page 17: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Discussion of 2012 POC Opportunities

1/18/2012 EIDR Confidential 17

Type of POC  Possible Par9cipants 

Trailers  Internet Video Archive 

Repor@ng  Rentrak, MediaMorph, Exactuals, Argo Systems 

Content Recogni@on  Verance, Vobile, Civolu@on, Digimarc 

Video Service ID  Comcast, Cox, Shaw, Charter, CL 

Broadcast TV  NBC, ABC, ESPN 

Adver@sing  Broadcasters, MSO’s, Ad‐ID, Avail‐TVN, Black Arrow, FreeWheel 

Produc@on /Distribu@on Services 

Deluxe, V2 Solu@ons, Technicolor 

Satellite TV & IPTV  DIRECTV, DISH, AT&T, Verizon 

Live – Sports & News  Broadcasters, MSO’s, Prime Focus, NBA, MLB, NFL, NHL 

Archives  BUFVC, BFI, AFI, INA 

Page 18: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Working Discussion - Onboarding & Matching

1/18/2012 EIDR Confidential 18

Page 19: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Onboarding Overview – Cycle for New Registrants

Choose category of records  Support & 

Documenta@on 

Sohware Tools 

 Preliminaries 

Match 

Register gap records 

Update matched records 

Register edits and children 

1/18/2012 EIDR Confidential 19

Repeat for each new type of record – movie, episodic, etc.

Page 20: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

EDIR Support & Documentation

•  EIDR web page – general business & technical documentation •  API guide, schema, field guide, best practices, technical notes, etc. •  http://eidr.org/resources

•  Zendesk – all members will have user accounts •  Help desk tickets, outage and other notifications, etc. •  SDK & other software tools •  Member forum coming soon

•  Basecamp – project management site for POCs •  Central and secure location to share files, project information and status •  All members working on a POCs will have access to Basecamp

•  Training – Support staff available for Q&A sessions •  EIDR support number/e-mail

•  877-620-EIDR •  [email protected]

1/18/2012 EIDR Confidential 20

Page 21: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Software - SDK Libraries

•  SDK libraries –  Calls for all the basic EIDR functions

•  Support both XML and Object based models –  Available for both Java and .NET

•  Updates planned for each new rev of registry •  Currently posted on Zendesk:

–  1.0.4 Java SDK - Beta (Windows installers) •  With Java Docs

–  1.0.4 .NET SDK – Alpha (Windows installers) –  Coming soon (Q1)

•  Mac installers •  1.1 will have Video Service ID support

1/18/2012 EIDR Confidential 21

Page 22: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Software – Tools

•  Command line tools –  Simple search, lookup, register, modify, etc. –  Easy to hook together in scripts or batch files

•  Automate jobs that would be tedious or error prone through UI –  Bundled with SDK –  Provide source code examples of each library function

•  Party matching tool –  Helps generate lists of possible matching parties

•  Catalog matching tool –  Helps automate catalog matching –  In development by PDG

1/18/2012 EIDR Confidential 22

Page 23: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Prelims – Preparation for Matching & Registration

•  Most work for any new member •  Necessary steps before matching can

begin: – Hierarchy & data model alignment – Field mapping – Data quality assessment – Party mapping (for EIDR Principal Agent field)

• Match lists of production and distribution companies

1/18/2012 EIDR Confidential 23

Page 24: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Core Matching & Registration Framework

Hierarchy & field mapping  

Data quality 

evalua@on Party 

mapping  Matching Register gap 

records 

Update matched records 

1/18/2012 EIDR Confidential 24

While not specifically stated, consider data quality checks as the mortar between each block above

Page 25: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Hierarchy & Field Mapping

•  Evaluate compatibility of record hierarchy and granularity –  Title vs. Edit and original vs. derivative items

•  Map registrant fields to EIDR fields •  Determine availability of required fields

–  Create or extrapolate missing fields if possible •  Determine compatibility of data practices

–  Release date, title strings, country of origin, etc.

1/18/2012 EIDR Confidential 25

Hierarchy & field mapping 

Data quality evalua@on  Party mapping  Matching  Register gap 

records Update matched 

records 

Page 26: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Data Quality Evaluation

•  Quality and consistency of each data field –  Identify ways to improve and normalize where needed

•  Ability to identify original title items vs. derivative –  Confirm country of origin & original titles for title-level records

•  Availability of optional fields for improved matching –  Alternate IDs, alternate titles, director, two cast

•  Decide whether sufficient to ensure accurate matching

1/18/2012 EIDR Confidential 26

Hierarchy & field mapping 

Data quality evalua@on  Party mapping  Matching  Register gap 

records Update matched 

records 

Page 27: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Party Mapping

•  Match registrant list of production & distribution companies to EIDR’s list –  Retrieve party IDs for matched parties

•  Identify missing (gap) parties & create new party IDs •  Fix incorrect parties (incorrect spelling, punctuation,

duplicates, etc.) •  Every registration needs one or more valid party IDs

1/18/2012 EIDR Confidential 27

Hierarchy & field mapping 

Data quality evalua@on  Party mapping  Matching  Register gap 

records Update matched 

records 

Page 28: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Matching

•  Focus on getting title-level matches right •  Be prepared for some level of manual review •  Hire matching vendor if necessary •  Matching tool approach: score possible matches

–  High scoring matches – use the matched EIDR IDs –  No (or low scoring) matches – gap items, queue for registration –  Middle scoring matches – review manually –  Metadata differences – flag for quality review and correction

•  Ingest the matched EIDR IDs 1/18/2012 EIDR Confidential 28

Hierarchy & field mapping 

Data quality evalua@on  Party mapping  Matching  Register gap 

records Update matched 

records 

Page 29: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Register Gap Records

•  Register confirmed gap records •  Registration paths:

–  Use matching tool or other API integration –  Generate XML for bulk registration –  Register manually through UI

•  Ingest new EIDR IDs

1/18/2012 EIDR Confidential 29

Hierarchy & field mapping 

Data quality evalua@on  Party mapping  Matching  Register gap 

records Update matched 

records 

Page 30: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Update Matched Records

•  Fix incorrect parties (incorrect spelling, punctuation, duplicates, etc.)

•  Add alternate IDs •  Correct mistakes or fill in missing fields

–  Improves uniqueness & subsequent matching

•  Add registrant to Access Control List

1/18/2012 EIDR Confidential 30

Hierarchy & field mapping 

Data quality evalua@on  Party mapping  Matching  Register gap 

records Update matched 

records 

Page 31: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Onboarding Overview – Cycle for New Registrants

Choose category of records  Support & 

Documenta@on 

Sohware Tools 

 Preliminaries 

Match 

Register Gap Records 

Update matched records 

Register edits and children 

1/18/2012 EIDR Confidential 31

Repeat for each new type of record – movie, episodic, etc.

Page 32: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Matching Service Providers – Rovi & Deluxe

•  Rovi – Todd Dietz •  Deluxe – Josh Kline

1/18/2012 EIDR Confidential 32

Page 33: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

EIDR Automated Matching Tool

•  Purpose: Aid match and ingest of catalog registrations •  Use Model:

–  Ingest catalog metadata –  Automate “easy” match and gap determination

•  Flag data differences on matches for review and later correction –  Facilitate manual determination of matches and gaps for the rest –  Register gap records –  Update matched records

•  Implementation: –  Relational database (MySQL) w/procedures for data transformation –  Java components for API integration and converting to EIDR XML –  A pluggable component framework for added matching modules

•  Software available to matching service providers

1/18/2012 EIDR Confidential 33

Page 34: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

EIDR Automated Matching Tool Workflow

•  Ingests catalog from registrant database, XML or Excel –  Translates into EIDR data model

•  Scores matches using EIDR’s dedupe engine in a sandbox –  High scoring single matches -> confirmed match –  No (or low) scoring matches -> confirmed gap –  Mid scoring records reviewed manually or sent to EIDR for

registration w/review •  Ingests mappings of Alt IDs to EIDR IDs (if available)

–  Low scores used to flag possible Alt ID errors •  Flags data discrepancies for review and record update •  Registers gap records •  Updates records (alternate IDs, ACL additions)

1/18/2012 EIDR Confidential 34

Page 35: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Working Discussion – Data Model Updates for Digital Encodings

1/18/2012 EIDR Confidential 35

Page 36: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Digital Encodings

•  Design Point: Represent actual digital files –  Technical metadata (tracks, codecs, bitrates, etc.) –  File size and/or hash –  Individual audio or video tracks can have their own EIDRs

•  Problems: –  Files often disposable, e.g. Mezzanine file –  Often file is not what is to be identified

•  UV – container may be updated with metadata, not a new APID •  UV – distributor may rev APID w/o file change •  Mezzanine – identifying the “version” or profile given a vendor

–  Lacking some cable metadata, e.g. SCTE-35 signalling –  No longer fully aligned with MovieLabs Common Metadata

•  Proposing to update in 1.2

1/18/2012 EIDR Confidential 36

Page 37: First Annual Meeting Of Participantseidr.org/documents/EIDR_Annual_Meeting_1-18-2012_v5.5.pdf · 1/18/2012  · – Identify ways to improve and normalize where needed • Ability

Digital Encoding – Designing for 1.2

•  Use cases –  UV APIDs –  Mezzanine files –  Cable encodings

•  Other possible use cases –  Individual audio and video tracks –  DVD/BD images –  Others?

•  Discussion –  Use cases –  IDing encoding “profiles” vs. actual files

1/18/2012 EIDR Confidential 37