2012.08 apan sdn-media-v01

NETWORKed Computing Systems LAB.

Realizing Media-centric Services

with Software-Defined Networking

- 1 -

August 26th, 2012

HDTV WG Session Talk

@ APAN Colombo Meeting, Colombo, Sri Lanka

Dr. JongWon Kim

([email protected])

Networked Computing Systems Lab.,

School of Information and Communications, GIST

mailto:[email protected]


Media-Centric Service Composition with

Programmable SmartX Computing/Networking Nodes

MediaX node

NetOpen switch

MediaXCloud node

MediaXCloud

node

SmartX

(Networking)

RA

Mobile

MediaX node

Mobile

MediaX node

MediaX node

MediaX node

NetTD MediaX node

NetTD MediaX node

Networking Service Computing Service

MediaXCloud RA

Multi-party Visual Sharing with Mashup Experiment

MediaX node

Media

Mashup

Video

Producer

Video

Producer

Video Decoder

Video Decoder Video

Consumer

Shortest Path

Connection C

Shortest Path

Connection C Shortest Path

Connection C

Video

Transcoder G

NeTD

Displayer

NeTD

Pixel Slicer G

Shortest Path

Connection C

Video

Producer

Shortest Path

Connection C Video Decoder

NeTD

Displayer

NeTD

Pixel Slicer G

Shortest Path

Connection C

Video

Consumer

Shortest Path

Connection C

Video

Transcoder G


Toward Balanced Service Composition based on Programmable (and Virtualized) Resources


Contents

ResourcesFlowsServices (in Hosts, i.e., (Computing/

Smart Devices) Networking)

Linking Resources contained in Hosts with

Flows (tied with Services) to Share Contents


OpenFlow-based Software-

Defined Networking (SDN)

- 6 -


Why Internet (Current Networking)

Closed for Innovation?

Specialized Packet Forwarding Hardware

Operating System

App App App

Million of lines

of source code

500M gates

10Gbytes RAM

5400 RFCs

Bloated Power Hungry

Many complex functions baked into the infrastructure OSPF, BGP, multicast, differentiated services, Traffic Engineering, NAT, firewalls, MPLS, redundant layers, …

An industry with a “mainframe-mentality”

Routing, management, mobility management,

access control, VPNs, …

7

Modified from Stanford OpenFlow Slides

NETWORKed Computing Systems LAB. 8

Controller

OpenFlow Switch

Flow

Table

Secure

Channel

PC

hw

sw

OpenFlow: Enable Innovations

“within” the Infrastructure

• Add/delete flow entries

• Encapsulated packets

• Controller discovery

API

Net Services



• Separate data from control

– A standard protocol between data and control

• Define a “generalized flow” based data path

– Very flexible and generalized flow abstraction

• Hierarchically logically-centralized “open” controller with API

– For control and management appl.

• Virtualization of data and control planes

• Backward compatible

– Though allows completely new header

OpenFlow: Architecture Concepts

9



• ONF’s Board of Directors

– Deutsche Tele.

– Facebook

– Google

– Microsoft

– Verizon

– Yahoo!

Open Networking Foundation (ONF) http://opennetworkingfoundation.org

• A nonprofit organization dedicated to promote Software-Defined Networking (SDN) Through simplified smart management, OpenFlow seeks to improve network functionality while lowering the cost associated with operating networks.

10


OpenFlow-enabled Equipments

NEC IP8800

HP Procurve 5400

WiFi

Juniper MX-series (prototype) Cisco Catalyst 6k

(prototype) Core Router

Enterprise Campus Data Center

Circuit Switch

Wireless

Quanta LB4G

Prototype Product

Ciena CoreDirector

WiMAX (NEC)

Cisco Catalyst 3750 (prototype) Arista 7100 series (Q4

2010)

11

PC-based

Early

Prototype

(NetOpen,

…)



SDN (Software-Defined Networking)? Separate control from datapath

– i.e. separate policy from mechanism

Datapath: Define minimal network instruction set

– A set of “plumbing primitives”

– A vendor-agnostic interface: OpenFlow

Control: Define a network-wide OS

– An API that others can develop on

12


Feature Feature





OperatingSystem

OperatingSystem

OperatingSystem

OperatingSystem

OperatingSystem

Network OS

Feature Feature

Feature Feature

Feature Feature

Feature Feature

Feature Feature

Feature Feature

Network OS

1. Open interface to hardware

3. Well-defined open API

2. At least one Network OS probably many.

Open- and closed-source

OpenFlow

Simple Packet Forwarding Hardware







Windows (OS)

Windows (OS)

Linux Mac OS

x86 (Computer)

Windows (OS)

App App

Linux Linux Mac OS

Mac OS

Virtualization layer

App

Controller 1

App App

Controller 2

FlowSpace Virtualization or “Slicing”

App

OpenFlow

Controller 1

NOX (Network OS)

Controller 2 Network OS

Computing Networking

13


OpenFlow: Adding FlowSpace

Virtualization to Programmability


OpenFlow FlowVisor for FlowSpace

Virtualization

14

OpenFlow Switches

NOX

OpenFlow

FlowVisor

Network Operating System 2

Network Operating System 3

NOX

App App App App App App App App

Research Slices

Open interface to hardware

Production “slices”

OpenFlow Swithes

OpenFlow Switches

OpenFlow Switches

OpenFlow Switches

Packet and Circuit: Electronic and Optical



OpenFlow Demo Infrastructure

with Slicing

15



OpenFlow Demo Examples (1/2)

16

OpenPipes Partition hardware designs across a network

Load-balancing as Network Primitive Minimize http response time over campus network

Intercontinental VM Migration Moved a VM from Stanford to Japan without changing its IP.

Converging Packet and Circuit Networks Moved a VM from Stanford to Japan

without changing its IP.



OpenFlow Demo Examples (2/2) - GEC9 Plenary Demo (Nov. 2010)

Aster*x: Load Balancing

as a Network Primitive

OpenFlow Wireless: WiMax, WiFi

17


OpenFlow: Example Networking

Services

• VLAN management

• New routing protocol: unicast, multicast, multipath, load-balancing

• Network access control

• Mobile VM management

• Mobility and handoff management

• Energy management

• Packet processor (in controller)

• Network measurement and visualization

• IPvX

• …

18



Media-centric Services

over

Futuristic SDN-enabled

Infrastructure

- 19 -


Toward Balanced Service Composition based on Programmable (and Virtualized) Resources


Service Composition: Definition Thomas Erl, SOA Principles of Service Design, Prentice hall, 2008

• SOA (service-oriented architecture) is a form of

technology architecture optimized in support of

services, service compositions, and service

inventories.

• A service composition is comprised of services that

have been assembled to provide the functionality

required to automate a specific task.

• A collection of standardized services can form the

basis of a service inventory that can be independently

administered within its own physical deployment

environment.


Resource Preparation and Service Control

for Media-centric Service Composition

Experiments (Design)

NETWORKed Computing Systems LAB. - 23 -


Resource

monitoring

Resource

tuning

Resource

inventory

Resource

matchmaking

Resource

allocation

Slice

Provisioning phase Execution phase

Experiment description

Service

descriptions

Content

descriptions

Resource

descriptions

Service composition description

(template-based service dependency graph)

Topology

decision

Node

selection Network

stitching

(IP/VLAN/OF)

Service

matchmaking

Service

placement

Service

stitching

Service

monitoring

Service

tuning

Service

inventory

Service

Servicedescription

Service

discovery

Resource

Resourcedescription

Content

Contentdescription

Content

selection

Content

inventory

Content

matchmaking

Content

interfacing

authorized

content pool

authorized

service pool

authorized

resource pool

Primitives

Resource-aware Media-centric Service

Composition Process

Control of service composition process

Resource awareness


Media-Centric Service Composition

Example


FIRST@PC Platform Design (v0.9r6)

- 26 -

NetOpen Networking SW MediaX Computing Service SW

FIRST@PC OMX SW

NetOpen Switching SW

FIRST@PC MobileCloud SW

NetOpen/MediaX QoS Control

Experiment SW


FIRST@PC Integrated Testbed (NetOpen RA

v0.3 + MediaXCloud RA v0.2 + OMX Service Control v0.3 +

OpenCF O&M v0.0)

MediaX RA: Display nodes, Camera

Networked Tiled Display 1080i HD Camera

NetOpen RA: Switche nodes MediaX RA: Media Processing nodes


TP

MP

Experiment Control Plane

Measurement Plane

TP MPTuning Point Measurement Point

SP

SP Stitching Point

OMX UI

OMX Service Agent

. . .SP

TP

MPExperiment Data Plane

OMX Controller

Service Code

OMX Control Agent

Service Code

OMX-enabled Service

ServiceTuning

ServicePlacement

ServiceStitching

ServiceMatchmaking

ServiceDiscovery

OMX-enabled Service

OMX Service Agent

ServiceMonitoring

Experiment description

Centralized Coordination for Media-Centric Service Composition and OMX (Open Media

eXperiment) Tool

Service discovery,

matchmaking

Service placement,

stitching

Service monitoring,

tuning

Centralized coordinator for service composition User interfaces

OMX interpreter for service composition

Measurement

(OML)

Operation &

Management (OMF)

Resource

Management

Server

(OMF)

Resource

Measurement

Server (OML)

Service

composition

Flows

Resources

Composable

service

Composable

service

Composable

service

Composable

service Mediator

Experimenter Experimen

t

Descriptio

n

Monitoring Feedback

NETWORKed Computing Systems LAB. OpenFlow Switch

End host (with HD camera)

End host (traffic generator)

End host

OF@KOREN

KAIST ICC

(Daejeon) SKKU

(Suwon)

NIA(seoul)

KPU(Daegu)

PKU (Busan)

JNU (Gwangju)

VoD

OpenFlow@Korea Open Networking Summit Demo

(Stanford Univ., Oct. 2011)

Gwangju Seoul

Daejeon

Networked Tiled Display

POSTECH

(Pohang)

CNU

(Daejeon)

KHU

(Suwon)

GIST

(Gwangju)

ETRI

(Daejeon)

OF@KREONET

KOREN

OF@FIRST

KOREN

Live HD Video

Live HD Video

Live HD Video

VoD

VoD

OpenFlow Production Switch

OpenFlow Switch with NetFPGA

FlowVisor

OpenFlow Controller

Stanford (USA)

NetOpen UI

OMX UI

GIST

Visual


H1

OF

H3 H2

O

F O

F

OF@KOREN

OF@KOREN RA UI

OF@KOREN

Aggregation

Manager

NOX Core

H1

OF

H3 H2

OF OF

OF@KREON

ET

OF@KREONET RA UI

OF@KREONET

Aggregation

Manager

NOX Core

H1

OF

H3

H2

OF OF

H1 OF

NF

OF+Click +

CPU/GPU

H4

H3

H2

H5

NF

OF@FIRST

NOX Core

Slice #1

App 1

NOX Core

Networking Service

Slice #2

NOX Core

Networking Service

Slice #3

NetOpen

Service

NetOpen Connection

Service

NOX Core

Application Application

ETRI

App2 App3

GIST Others

NOX Core

OF@Korea Portal

Interface

OF@Korea

Flow Space

Manager

Virtual FlowVisor Linking

Resource

allocation

via

FlowSpace Slice

NOX Core

NetOpen RA UI

OMNI

Slice NetOpen

Aggregation

Manager

OF@Korea

Integration

FlowSpace

Slices


CNU

(Daejeon)

GIST

(Gwangju)

ETRI

(Daejeon)

KOREN

NetOpen RA

KOREN/KREONET

OpenFlow Switch

End host (with HD camera)

End host (traffic generator)

End host OpenFlow Production Switch


FlowVisor

OpenFlow Controller

CNU

video

KHU

video

GIST

video POSTECH

(Pohang)

KHU

(Suwon)

VM #1

FiRSTcloud

mobility server

FiRSTcloud

RA manager OF@KOREN

OF@KRENET

GFIW (Seoul)

NetOpen UI OMX UI

GIST View

MediaX RA

MediaX RA

MediaX RA

MediaX RA

FIRST@PC MediaXCloud: OF@Korea GFI Week

Demo (Dec. 2011)

DXp

DXc DXc DXc

DXp

DXp

M2p

ND

M2c

VP

VC

VM #2

DXp

MPEG2 video consuming service

DXp

ND

VP

VC

DXT video producing service

Networked display service

VNC graphics producing service

VNC graphics consuming service

M2p MPEG2 video producing service

DXc

M2c

DXT video consuming service

OF@FIRST


GFI Week Demo. (Dec. 1-2, 2011)


Futuristic SDN-enabled Issues

with

Heterogeneous SmartX Nodes

- 33 -


Media-Centric Service Composition with

Programmable SmartX Nodes

MediaX node

NetOpen switch

MediaXCloud node

MediaXCloud

node

SmartX

(Networking)

RA

Mobile

MediaX node

Mobile

MediaX node

MediaX node

MediaX node

NetTD MediaX node

NetTD MediaX node

Networking Service Computing Service

MediaXCloud RA

Multi-party Visual Sharing with Mashup Experiment

MediaX node

Media

Mashup

Video

Producer

Video

Producer

Video Decoder

Video Decoder Video

Consumer

Shortest Path

Connection C

Shortest Path

Connection C Shortest Path

Connection C

Video

Transcoder G

NeTD

Displayer

NeTD

Pixel Slicer G

Shortest Path

Connection C

Video

Producer

Shortest Path

Connection C Video Decoder

NeTD

Displayer

NeTD

Pixel Slicer G

Shortest Path

Connection C

Video

Consumer

Shortest Path

Connection C

Video

Transcoder G


Heterogeneous SmartX Nodes

• SmartX (Cloud) Center

• SmartX Racks (MediaX_VT + NetOpen, …)

• SmartX Mobile Nodes (wireless + mobility)

• SmartX-aware Mobile Nodes


NetOpen Node v1.1

NetOpen Node v1.0

SmartX (NetOpen + MediaX)

Center/ Rack/Node

PC-based MediaX Node

v1.0

MediaX Nodes

OF + NetFPGA

OF + Click

OF + Click + GPU

NetOpen Switch Nodes

A Road Map to Build SmartX nodes

Mobile SmartX Nodes

Mobile MediaX Node with GPU (tablet, netbook,

laptop)

PC-based MediaX Node with GPU v1.1

NetOpen Node v2.0

August 26, 2012 36

MediaX Cloud Node

Wireless NetOpen Node v1.1 (wallBox)

+ networking

OF + Click + GPU + Storage + 10G NIC

Cloud-based MediaX Node

v1.2

OpenVSwitch+Cloud

Mobile SmartX Node v0.9

(tablet, netbook, laptop)

OF + Click

NetOpen Node v1.3

NetOpen Node v1.2


NetOpen Switch Node (v1.2)

• A Programmable Networking Switch Node with In-

network Processing Support

37

Networking Service

SDN

Network Substrate

flows

CPU GPU

Commodity Processors

• Design issues – Independent processing

module for a service functionality

– For each flow, a customized data plane can be built by selectively combining processing modules

– This buildup can be controlled by a logically centralized controller


Flow

Table

GPUEthernet WiFi Ethernet

Task Manager

Forwarding

ElementProcessing

Element

CPU

Visual-sharing

Controller

Task

Output Task

QueueTaskTask

Input Task

Queue

PacketSegment

Computing ResourcesNetworking Resources

Segmentation

HandlerTask

Dispatcher

Task

Visual-sharing Switching Device

Control

Channel

Processing

Element

Segement

Shader

SmartX Node Early Prototype (NetOpen node v1.2)

HD Video

Server

HD Video

Client 02

HD Video

Client 01

Visual-sharing

Switching Device

UCHD

(1080i)

HD Camera

Visual-sharing

Controller

V

How to make it

mobile? (SDN +

SDR)


SDN-Coordinated NetOpen Networking Service

39

Programmable Network Substrate

NetOpen RA Manager

SmartX

Node

G

SmartX

Node

N

SmartX

Node

Media-centric

Service Composition

H1

H2

Computing Service

H3

H4

Computing Service

Computing Service

Computing Service

SmartX

Node

NetOpen RA

(Current)

Computing Service

NetOpen Networking Service

Computing Service

SmartX RA

(Future)

G

C

Gateway-type

Connection-type

N

G

NetFPGA

GPU

Primitive

Service

Resource

Flow


SDN-Coordinated NetOpen Networking

Services

• A NetOpen networking

service is built by

linking a set of

primitives

– How to verify formal

correctness of linking

primitives

– Is it possible to describe

the performance of

NetOpen networking

services based on the

primitives they use?

P1

S

P2

P3

P2,C P2,N

P12

NetOpen RA

Good for VoD

flows

Good for TCP

flows

Good for

Visual Sharing flows

RS RC RN


Tools for

NetOpen Networking Service

41


NetOpen RA Manager & UI

August 26, 2012 42


NetOpen Networking Supplement &

Experimenter UI

43


OF@TEIN Infrastructure (Planned, 2012~2013)

OF@KOREN

KAIST ICC

(Daejeon)

SKKU

(Suwon

)

KPU(Daegu) PKU

(Busan)

JNU

(Gwangju) NIA(seoul

) VoD

Indonesia

Malaysia

SmartX Rack

Vietnam

OF@TEIN

Philippines

OpenFlow Switch

Exp. Node (with HD camera)

Exp Node (traffic generator)

Exp. Node

OpenFlow Production Switch

(NariNet, HP)


OpenFlow FlowVisor

OpenFlow Controller

Thailand

SmartX Rack

SmartX Rack

SmartX Rack

SmartX Rack

SmartX Rack

HongKong

SmartX Rack

Laos

SmartX

Rack

India

SmartX Rack

Singapore

Networked

Tiled Display

CNU

(Daejeon

)

ETRI

(Daejeon)

Live HD

Video

VoD KHU

(Suwon) Live HD Video

OF@FIRST

OF@KOREA

SmartX Rack

VoD

VoD

VoD

VoD

VoD

VoD

VoD

Portal Server

OMX Server

Live HD Video

Live HD Video

EU (Ofelia, …)

USA (OS3E-NDDI,

…)

VoD

VoD

GIST

(Gwangju)

44


OF@TEIN SmartX Rack & SDN Tools (2012)

45

Networking Resource

NOXCore NOXCore NOXCore NOXCore

SmartX

Resource Aggregation

Manager

Slice#1 Slice#2 Slice#3

VirtualFlowVisorLinking

ProvisioningforUsers

FlowSpaceSlices

OF@KOREA

OF@TEIN

FlowSpace Li

nking

FlowVisor FlowVisor

Supplement Supplement Supplement Supplement

Service(S2) Service(S3)

OMX (Open Media eXperiment for service compositi

on)

SDN Experiment UI

Service(S12

)

Computing Resource

Service(S11

)

OFSwitch OFSwitch

OFSwitch MediaXAM FOAM

SmartXRack

Exp.1

Exp.2

OFSwitch Exp.1

Exp.2

OFSwitch

SmartXRack

Exp.1

Exp.2

OFSwitch

SmartXRack Exp.1

Exp.2

OFSwitch

SmartXRack

Exp.1

Exp.2

OFSwitch

SmartXRack

SmartXRack

Exp.1

Exp.2

OFSwitch

FlowSpace

OF@TEIN Portal Interf

ace

OMNI


Thank you! Send Inquiry to [email protected]

http://nm.gist.ac.kr

Gwangju Institute of

Science & Technology

mailto:[email protected]