a network oriented perspective on the personalization of media streaming

A network oriented perspective on the personalization of media streaming

A network oriented perspective on the

personalization of media streaming

Mario Serafim Nunes, Senior Member IEEECharalampos Z. Patrikakis, Senior Member IEEENikos Papaoulakis


2

My-e-Director2012 Concept

The concept of My-e-Director 2012 will research and develop a unique interactive broadcasting service which will enable the end-users to select focal actors and points of interest within real-time broadcasted scenes. ( focus on athletic venues )

My-e-Director 2012 will resemble an automated ambient

intelligent director that will operate with minimal or even without human intervention.

At My-e-Director 2012 the end-user is the director of his stream

Great challenges as regards network support


3

My-e-Director 2012 General System Architecture


Four different layers

• Media content: Multimedia input from different sources

• Semantic metadata and accompanying data: content is enriched through characterization

• Reasoning/Personalization: Reasoning algorithms for personalized streaming

• User centric networking: Heterogeneous internetworking architectures.

4


Issues to be addressed

• QoS support• Coding –

Bandwidth adaptation

• Personalized, user centric media streaming

• Three different scenarios– Terminal centric– Network centric– Hybrid

5


My-eDirector Personalized VoD System Architecture 1-Terminal Centric

Content Provider

IP network

AN n

IP access network

Scene Analysis/ Person Tracking

Service PlatformAAA, DRM, Web Server

Users Profile DB

AN 1

PlaylistPlaylist

Video Streaming Server(s)

Video MetadataDB

21 3a,b,c4a,b,c

5a,b,c

Signalling

Video

Video DB(BBC)

Best Videos Selection

1'2'

Phase 2:1) User defines Preferences Event K, Athlete A, Action: English league, C.Ronaldo, goals

2) BVS selects Video sections that comply with User pref., Send Play List to Terminal: URL_MatchK, Range:x-y; Range:z-w; …

3) Terminal request Video_i to VSS (a,b,c..N) 4) VSS confims 5) VSS sends Video_i to Terminal(Repeat cycle 3-5 until end of Playlist: a,b,c…N)

PROs: Simple and Scalable architecture; uses standard VSS, already deployed;

CONs: Possible Video switching delay; Specific application in Terminal

Phase 1 (offline) :Movie classification/Video Metadata DB building;


Terminal Centric Signalling example (Unicast)


Terminal Centric Signalling example (Multicast)


My-eDirector Personalized VoD System Architecture 2-Network Centric

IP network

Content Provider

AN n

IP access network



Users Profile DB

Metadata

AN 1

Playlistsof active users

Video MetadataDB

21

3

4

Video Stream. Server 2

5


Video Streaming Server 1

Video DB(BBC)

3a,b,c...

4a,b,c...5a,b,c...

1' 2'

Phase 2 1) User defines Preferences

Event K, Athlete A, Action: English league, C.Ronaldo goals

2) BVS selects Video sections that comply with User pref., Send PlayList to VSS2: URL_MatchK, Range:x-y; Range:z-w; …

3) Terminal Request URL of video selection to VSS24,5) VSS2 requests Video(s) to VSS1 and relays them to Terminal (Repeat 3-5 until end of Playlist)

PROs: Simple standard terminals; Controlled Advertising (e.g. between clips)

CONs: Not scalable: high BW at VSS2 (2 x 1000 * 1Mbps = 2 Gbps) Special design streaming server (VSS2)

Phase 1 (offline) :Movie classification/Video Metadata DB building;


Network Centric Signalling example (Unicast)


Network Centric Signalling example (Multicast)


Service Provider n

Content Provider

IP network

Scene Analysis/Person Tracking

Best Camera Selection

Video Streaming Server

Service PlatformAAA, DRM, user

profile

270 Mbps SD1 Gbps HD

Compressed video:H.264, Windows, Real, Flash

Cam1: Long jump, Athlete A, BCam2: Race100m, Athlete C, D

Profile 1: Cam jProfile 2: Cam n

Video Stream ServerMux with MPEG7

Video Aquisition(BBC)

User k: Athlete A or BUser m: Long jump User n: spanish athletes

Video Encoders

Profile 1: spanish ath.Profile 2: Long jump::

Metadata

DB

Metadata (MPEG7)Service Provider 1

(1-n) (1-n) (1-k)

EncodingDV/MJPEG

60 Mbps

User ProfilesDB

Profile 1: User i, User j...Profile 2: User x, User y…::

SISMetadata

My-eDirector System Architecture 2-Hybrid (Terminal/Network) Centric

PROs: Terminals simplicity, low signalling for multicast. Bitrate=2Mbps*Cam

CONs: High signalling traffic for unicast, clustered preferences

1) Users defines Preferences;2) BCS defines User Profiles and add User to User Profiles DB;3) BCS gets Metadata and updates best Camera to all Profiles;4) For Profiles that changed Camera, BCS sends “Redirect”/mIP to all Users of that profile, with new camera/stream;5) Terminals that receive “Redirect” request new camera/stream (in case of multicast just change to new multicast IP)


Hybrid Signalling example (Unicast)


Hybrid Signalling example (Multicast)


My-eDirector Personalized VoD System Architecture 1A -Terminal Centric using Third Party

ContentMyspace

Content Provider

Myspace

IP network

AN n

IP access network



Users Profile DB

AN 1

PlaylistPlaylist

YouTube

Video MetadataDB

21 3a,b,c4a,b,c

5a,b,c

Signalling

Video


1'2'

5a,b,c

PROs: Simple and Scalable architecture; uses standard VSS, already deployed; Access to large video DBs, for free.

CONs: Possible Video switching delay; Specific application in Terminal Low quality videos, mostly Flash codec

Phase 1 (offline) :Movie classification of Third party Video DBsVideo Metadata DB building;


Traffic analysis and discussion (network centric & hybrid)

• In the network centric scenario the main difference is that the number of different streams increases significantly when compared with the previous scenarios, as the total number of different streams increases from the number of cameras to the number of profiles, which can be much higher.

• In the hybrid unicast or multicast scenarios the main difference is that the terminals do not receive periodic Metadata messages (possibly big XML messages), only receive specific non periodic short messages when there is the need to change the stream.

16


Comparison of the scenarios

17

SCENARIOBest camera selection

functionalityStream

activationNeed for application

development

terminal centric unicast

Decentralised(terminals)

By the terminal At the terminals

terminal centric multicast

Decentralised(terminals)

By the terminal At the terminals

network centric unicast

Centralised (Service provider)

By the server At the servers

network centric multicast

Centralised (Service provider)

By the server At the servers

hybrid unicastCentralised (Service

provider)By the terminal

At the servers and at the terminals

hybrid multicastCentralised (Service

provider)By the terminal

At the servers and at the terminals


Thank you !

Charalampos Z. Patrikakis [email protected]

a network oriented perspective on the personalization of media streaming

Documents