andreas pongratz ceo x-art. © x-art pro division 2006 military, security and surveillance...

Andreas Pongratz

CEO X-Art

© X-Art Pro Division 2006

Military, security and surveillance technologies in the realm of

media and entertainment, education and corporate communication

Patra 15.6.2006


Facts!

Object detection

Object tracking

people tracking

On screen text detection

Speech to text transformation

Face detection


Statement 1


More Statements!

• Apple to sell videos TV fans bought about 8 million videos in the first three months of the service. (January 2006)

• Walt Disney Co.'s board of directors has given its approval to buy Pixar Animation Studios (January 2006)

• Murdoch Plans MySpace VideosNews Corporation chairman wants to expand social-networking site into a venue for downloadable video, VoIP, and IM. (January 10, 2006)

• AOL Buys Video Search StartupAccording to sources, the No. 3 web portal pays $50 million for Truveo, ending months of speculation. (January, 2006)

• Yahoo, Google Add New ChoicesLeading search companies give users more control over content in the living room and

on the cell phone. (January 2006)

• Disney launches broadband channel for preschoolers (January 2006)


What does this mean

Users do not care about HD, SD, MPEG, AVI, D…..

They want:

what ? info/content they are interested in!!!

when ? anytime

where ? anywhere

how ? On everything that is currently availabe

BUT?


80% Unstructured80% Unstructured

80% Unstructured80% Unstructured

20% Structured20% Structured

OracleOracle

DB2DB2

MS SQLMS SQL


definitions!

Aquisition Transformation

Signal data Information Knowledge

Content!

Metadata!

Digitisation of source material

Info on content like who/what is in the picture

SmartEncode = realtime generation of Content and Metadata.

RealTime

Index! Collection of metadata

•key Concept IDOL


Todays leading supplier ofVideo , “Rich Media”

and communication software solutions


SmartEncode Dataflow


Workflow

EncodingEncoding AnalysysAnalysys

assemblingassembling

AquisitionAquisition

IndexingIndexing

collaborationcollaboration

distributiondistribution

Portal, WCM, Etc.Portal, WCM, Etc.

Traditional sourcesTraditional sources

Different sourcesDifferent sources


SmartEncode “Tracks”

Zeit

Metadaten Spuren:

Sehen

Hören

Lesen

Gesichts ID

Sprecher ID

Anwender Annotierungen

Sprache in Text

Timecode

Keyframes

Teletext

Lynne Russell Hillary Clinton

“Clinton spoke with reporters” “Arrived in New York”

“Older citizens who have”

Improving Medicare

Speaking at rally

Clinton auf dem Wegin den Senat

Hillary ClintonLynne Russell

00:08:40:0000:08:26:12 00:08:34:29

Encodiertes Video

>>Hillary Clinton Spoke with reporters when she arrived in New York about her proposal for older citizens...

Audio KlassifizierungSprache Applaus Sprache

On-Screen TextSpecial Report Medicare Issues


Automatisches Indexing

Module des VideoLogger

• Keyframe (Bild) Erkennung

• Spracherkennung (in Text)

• Audio Klassifizierung

• Sprecher Identifikation

• Gesichts Erkennung

• On-Screen Text Extraktion

• AutoClip Identifikation

• Themen Erkennung

• Namen Extraktion

• Shot Erkennung (Szenen)

• Externe Quellen zur Verfeinerung

– Skripts

– Video Schnitt Listen (EDLs)

– GPS Daten (Standort)

– Statistische Informationen

– PPT Folien Präsentation und Text (MediaSync)

• Manuell eingegebene Daten

– Schema Information

– Clip Markierungen

• Sekundäre Indizierungsprozesse

– Semantik Web


Blue Chip customers


Centers for Disease Control (CDC)

DARPA (Defense Advanced Research Program Agency)

Federal Bureau of Investigation (FBI)

Department of Defense (DOD)

NASA

United Nations

Customers by segments!

Government customers! Education customers!

M&E customers!

Eduhi Linz

Harvard Business School

Oxford University

Princeton University

Stanford University

University of Montreal

University of Southern California

MIT

New York University

ABC, ORF, BBC, CNN, MGM, Reuters, Warner, Sony, CBS, Fox Sports, Major League Baseball,

LA Times, New York Times, Discovery Networks, BMG, Mediaset, Telecinco


News Monitoring


Corporate Communication

adaptable web- interface

Synchronise slides

Search within one or all presentations

Related documents

Windows Media and RealVideo

Formate

Interactive content directory

with slides preview


LIVE samples

http://vss.ivs.tv:81/vss-bin/vss_SR/Deutsche_Wochenschau/Pilotprojekt

http://www.aon.tv/

http://www.pbs.org/juliachild/video.html

http://edumediacenter.schule.at/

http://www.blinkx.tv/

http://area51.x-art.at/vsx/XART/dashboard/dashboard

http://www.cnet.com/2001-10107_1-0.html?tag=navtab


Case Study: Harvard Business School

Online Lectures & Events• Guest lectures & special events available

to students and alumni on-demand

• Promotes alumni involvement & giving

• Video case studies available as prep-work for classroom

• Automated processes gets content online rapidly

• Seamless integration with HBS systems


Case Study: General Motors

Focus Groups

• Situation:

– 1000s of hours of focus group video/month

– Multiple departments involved in review

• Challenges:

– Inefficient manual process of documenting and sharing information

– Paper trail and wide distribution meant difficulty reaching consensus

• Objectives:

– Offer efficient way to review video and prepare reports

– Achieve uniform consensus easily

• Results:

– Improved communications

– 50% less time preparing video for review

– Decision makers have access to same material, on demand


New opportunities!


questions?

[email protected]

Thank you!


Statistics Generation Statistics Generation from The Corpusfrom The Corpus

The DRE, using Bayesian The DRE, using Bayesian Inference and Shannon’s Inference and Shannon’s Information Theory, builds Information Theory, builds “Bags” of statistics from a “Bags” of statistics from a corpus of documentscorpus of documents


The DRE Identifies Key The DRE Identifies Key ConceptsConcepts


And Stores Statistics And Stores Statistics on Documenton Document


To Form a Conceptual To Form a Conceptual UnderstandingUnderstanding


Natural Language Natural Language ResponseResponse

““Tell me about the Tell me about the golden labrador...”golden labrador...”


Natural Language Natural Language ResponseResponse


Conceptual RelationsConceptual Relations

•key Concept IDOL


Case Study: Structural GroupCase Study: Structural Group

Training• Situation:

– Complex projects require efficient access to step-by-step information

– 450 training videos, 40 minutes each

• Challenges:

– Critical training info buried on tape

– Time-consuming, frustrating learning process

• Objectives:

– Provide efficient access to information

– Train employees on new techniques

• Results:

– Operational performance improved

– Learning curve reduced

– New opportunities in recruitment, sales & marketing, partner communications


Viele Lösungen-Eine Kerntechnologie

SmartEncode Virage Solution Server

Virage Content Management Platform


ABC News Agence de Presse AltaVista Asahi Broadcasting Athens Olympic Broadcasting Austrian Broadcasting Corporation (ORF) BBC Bloomberg BMG Entertainment C-SPAN Canadian Broadcasting Corp.(CBC) Carlton Communications Castillia de la Mancha CBS Channel 4 China Central TV Click2learn.com CNET Networks

CNN

Danish Broadcasting (Corporation) DES Digital Ranch Discovery Networks E! Networks

e.Biscom Enel.it SpA Etelvaz European Broadcasting Union (EBU) EXPN FOX Sports Georgia Public Television Globe Interactive Globovision Hong Kong Cable Infoseek iViTech.com Korean Broadcast Systems Lifetime Entertainment Los Angeles Times Major League Baseball Mediaset MGM MITV NASCAR Nat'l Academy of TV Arts & Sciences National Geographic Network Espana New York Times

ME Kunden

PBS Promontora de Video SA RealNetworks Reuters SCETV Scripps Network Sekani (formerly FootageNow) Sistema Brasileiro de Televisao Sony Music ST3 StreaMedia Communications StreamSearch.com TBS Ad Sales Technology Media Group TechTV(formerly ZDTV) Telecinco The Economist The WB Network Thomas Cook TV Turner Broadcasting Turner Classic Movies TV Azteca Warner Bros. WashingtonPost.com Yahoo!


Education Kunden

Harvard Business School Oxford University

Princeton University Stanford University

University of Montreal University of Southern California

MIT New York University

Pro Quest ,SCETV , Seiko University, Southwest Prepatory School, St. Petersburg College, Sunburst Technology Corp.,University Center Rochester, University of Arizona, University of California, Santa Barbara, University of Georgia, University of Illinois at Chicago, University of Iowa, University of Massachusetts Medical, University of Michigan, University of North Carolina, University of North Texas, University of Pennsylvania, University of Quebec, Welearnhere.com Yokohama University, Ball State University, Bowling Green State University, Cal State Fullerton, CAL State University at Los Angeles, Case Western Reserve University (Weatherhead School of Management), Center for the Advancement of Distance Education, University of Illinois, Coast Community College, Delmar Thomson Learning, Florida Department of Education, Indiana Higher Education Telecommunication System, Instituto Latino Americano de la Communicacion Educativo, Kansas State University, Keio University, Lawrence Berkeley National Laboratory, Los Angeles County Office of Education, Marshall University, Michigan State University, National Institute for Japanese Language, National Library of Medicine, Nippon Institute for Educational Research


Webcasting - Applications

• Internal

– CEO speeches (corp)

– Sales training (corp)

– HR, compliance & safety training (corp)

– Business updates (corp)

– Classroom lectures (higher ed)

– Guest speakers (higher ed)

– Distance learning (higher ed)

– Employee communications (gov)

– Legislative hearings (gov)

– Employee training (gov)

– Seminars, Speeches

• External

– Product launches (corp)

– Product training 4 channel (corp)

– Manuals/product descriptions

– Direct marketing (corp)

– Channel communications/training (corp)

– Shareholder meetings (corp)

– Earnings calls (corp)

– Public lectures (higher ed)

– Alumni outreach (higher ed)

– Intercollegiate sports (higher ed)

– Public meetings (gov)

– Press conferences


Online Lectures and Events

• Objective: integrate video and rich media content into variety of university applications

• Requirements:

– Content: 200 hours of class lectures, reference video and campus events recorded per semester

– Distribution: need secure way to distribute different libraries of content to students and to alumni

– Playback: ability to view high- or low-bandwidth versions of content

– Slide synchronization: lecture video from six classrooms must be automatically sync’d w/ PowerPoint slides

– Robustness and reliability: about 2,000 users view content per week; usage peaks just before exams


Government Kunden!

Anatel Autometric Broadcast Microwave Services Centers for Disease Control (CDC) County of San Bernadino DARPA (Defense Advanced Research Program Agency)

Defense Logistics Agency Department of Defense Department of the Army Department of the Navy Federal Bureau of Investigation (FBI) Federal Judicial Center Florida Hillsborough County Commissioners Office Goodfellow Air Force Base Joint Combat Camera Center

LA County Library of Congress Lockheed Martin March Air Force Base Ministero Interno Ministry of Post and Telecommunications NASA NIMA Office of the Secretary of Defense Other Classified Agencies Sandia National Labs Singapore Government Singapore Ministry of Home Affairs State of Iowa U.S. Senate U.S. Special Operations Command United Nations


Corporate Archive:

• Typically huge body of work is accumulated

• Accessing desired content is difficult with little or no opportunity to browse across archive

• Current distribution systems are laborious, manual and slow

• It is difficult and costly to repurpose for other uses

Challenges:

Solution:

• Digital archive is very efficient for mining 1000s of hours of video assets

• Online access gives controlled desktop access to specific individuals and groups

• Bottom line: Virage solution results in better marketing campaigns, stronger brands and new revenue opportunities


Webcasting–Event Operation

Monitor event attendance in

real-time

Review audience questions

and respond to them privately

or publicly

Push documents or links to your audience in real time including, images MS Office documents, PDF’s and Flash

Show polls to audience and review poll results in real-time


Webcasting - Reporting

View reports by event summary, polls, questions

and answers and participants

See a list of attendees, their viewing time and their submitted questions and

polls

Print the report or

download it as a CSV file for

export into Microsoft

Excel


Who is webcasting?

Corporations

High-tech

Financial Services

Pharma/Healthcare

Manufacturing

Consumer/Retail

Services

Higher Education

Large state universities

Elite colleges and universities

Adult education providers

Community colleges

Government

Legislatures – Senate/Parliament

Civilian agencies - Health, Energy

Military and Intelligence

County and local governments


Case Study: Case Study: The Coca-Cola CompanyThe Coca-Cola Company

Commercials Archive

• Situation:

– Illustrious history of branding, advertising

– Over 24,000 TV commercials in archives

– Ongoing creation of new ads worldwide

• Challenges:

– Difficulty gaining access to and sharing past ads for recapture of best ideas

• Objectives:

– Find inspiration in previous works

– Improve branding consistency

– Leverage existing assets

– Increase production efficiencies

– Build searchable video archive to be accessible by 2,200 associates worldwide


Case Study: Case Study: Cisco SystemsCisco Systems

Corporate Webcasting• Cisco’s Internet Learning Solutions Group

• 2 classrooms x 8 hours per day

• Multi-format encoding

• Integrated PowerPoint presentations

• Immediate on-demand availability

• Major savings in production costs


VideoLogger Interface

SteuerungstastenKeyframe

Sensitivität Abspielen des Videos

Markieren und Annotieren von clips um Video zu segmentieren

Teletext Info automatisch extrahiert

Keyframes ermöglichen ein

visuelles Storyboard

Timecode aus externer Quelle

Abspielfenster des analogen oder digitalen

Video

Schlüsselworte, Sprecher und Art des Audio aus dem Audio Gesichts, on-screen text und AutoClip Indizes

andreas pongratz ceo x-art. © x-art pro division 2006 military, security and surveillance...

Documents