sponsored by the national science foundation software defined exchanges: new opportunities for...

Sponsored by the National Science Foundation

Software Defined Exchanges:New Opportunities for

Future Internet Research

Mike Zink GREE-SC2014

July 21st 2014, Iowa State University

Sponsored by the National Science Foundation 2GEC20

Overview

• Motivation• What is an SDX?• SDN Domains• Prototypes• Opportunities

– Cyber-physical System– Adaptive Streaming

• Instrumentation and Measurement• Routing• Education• Conclusions


Emerging SDN Capabilities are VirtuallyCertain to Require Multi-Domain Infrastructure

• OpenFlow and software defined networking play an important role in GENI– GENI is deploying a multi-domain SDN federation at ~50

campuses nationwide– Key technology for enabling GENI’s deep programmability

capability

• Because GENI is built as a federation, there’s a clear need for SDN infrastructure to span multiple operating domains– GENI infrastructure is owned and operated by the host institutions– Experiments and services need to exert control across these

borders in a consistent and controlled way– These needs are repeated at a larger scale when GENI federates

with other peer infrastructure, nationally and internationally


Multi-Domain SDN GENI Projects

Prototype GENI Multi-

Services Network

Exchange (GMNE)

Shakedown Experimentations

and Prototype Services on

Scalable, Agile, Robust, and

Secure Multi-Domain Software

Defined Networks

A Software Defined

Exchange for Engaging

Commercial Partners in a

Self-sustaining GENI


What is an SDX?

It’s for adv.BGP

It’s OF on steroids

It’s software everything It’s an

adv.IXP

It’s multi-domain SDN

It’s only for research


What do I believe it is!

• First and foremost: Connecting several independent SDN domains

• But only networking?• Chip Elliot: “If we would built the Internet from

scratch today it would have routers with lots of storage and computation added”

• SDX: Interconnect of SDN domains, storage & computation


Taking the next step

Create SDX’s to bridge “SDN islands”

SDN

SDNSDN

SDN SDN

SDN

SDN

SDN

SDNSDN

SDN SDN

SDN

SDN

SDX

SDX

Today: “SDN islands”GENI slices & VLAN stitchinghelp point the way

Next Step: Add SDX’sBuild a “Rev 0” control plane,run native next-gen appsand scientific instrumentsspanning multi-domain SDNs

SDI


SDX’s build the human community

• Working together . . .– US Industry– Network operators– Next-gen app developers– Scientific Instrument

developers and users– Researchers

• Basic concept– “SDN Exchange”– Open meeting point– Support end-to-end applications

across multiple SDN domains

• Key benefit: Very OPEN– Good way to rapidly build / grow

tech community– Good way to create & share

open-source tool chains– Good way to try out different

approaches, perhaps vendor specific, in early days

– Later, we can move to private peering points


SDN Domains

• What is an SDN domain?• Example: Internet Advanced Layer 2 Service

(AL2S)

• Google’s B4• In this talk I will focus on

the research network/academic side of SDN Domains.


SDX Prototypes

• Exchange points that connect several SDN domains

• StarLight, SOX, MAX, iMinds in Europe, …• Most of them also include computation and

storage• StarLight and SOX SDXes open for researchers• GENI racks at both locations!

Sponsored by the National Science Foundation

StarLightQXF3500

Switch

StarLightOpenflow

Switch

StarLightCienaSwitch

StarLightE1200Switch

AL2S

ORNL1650

16

50

,16

51

17

09

1709

Other GENI Racks

1750

1750

1750

17

50

1750

1709

ESnet1651

SL GENI AM

60

50

1

2

4

52

16

55

17

50

SDX

NU Rack

SLRack

StarLightOF

switch

StarLight Network Diagram for SDX

StarLight SDX


Where can we go?

• Lot’s of things we cannot do (or at least only in complicated ways) in today’s Internet

• NDN• Cyber-physical systems• Clean slate• In-network computation and storage• …


GENI: Infrastructure for Experimentation

GENI is a large multi-domain SDN testbed


GENI: Infrastructure for Experimentation

GENI is the largest multi-domain SDN testbed


Setting up an SDX Experiment

Deploy it on a GENI slice

Study the benefits of SDX on NowCast, a time-critical short-

term weather forecast application


Conceptual diagram

GECfloor

SDX SDX

SDN

(SDN)

SDN SDN

SimulatedRadar Traffic

Middlebox


GENI Slice

StarLightOF

switch

NU-IGRack

end hosts(radar traffic)

SoX OF

switch

sdxsdx

SoX-IGRack

middlebox(processing

host)

GT-IGRack

end hosts(view results)

AL2S Switch

AL2S Switch

Resource reservation with standard GENI tools

demo floor


SDN Control

StarLightOF

switch

NU-IGRack

SoX OF

switch

sdxsdx

SoX-IGRack

GT-IGRack

AL2S Switch

AL2S Switch

Experiment choice how to manage SDN resources

Load Balancer Controller

Learning Controller


Nowcast – Processing

Grid & Merge

DARTS

Post-process

Webserver

Dynamically provisioned

SDN

Nowcast VM

New nowcast every one minute!


Nowcast – Experiment

GECfloor

SDX SDX

SDN

(SDN)

SDN SDN


Middlebox

OF Controller

Monitoring with GIMI tools


Nowcast – Data Flow

GECfloor

SDX SDX

SDN

(SDN)

SDN SDN


Middlebox

Monitoring with GIMI tools


Example: Adaptive Streaming

Steps:● Video is chunked (broken into segments of equal length)● Each chunk is represented in different quality segments - encoded in 5

different bitrates● Bitrate (quality) of content streamed to client is chosen based on

bandwidth between server and client. ● Client decides the quality which is to be played● Every chunk requested is a new HTTP connection

Features:● Quality of the video “adapts”

to the client’s bandwidth requirements

● Fewer video freezes● Highly likely that client

receives better quality as video progressesRequirements:

● High/consistent bandwidth connection

● Compute-intensive Operation - Live transcoding

● Content availability

SOLUTION : SDX


Instrumentation and Measurement

• Perform repeatable experiment– Automate experiment– Archive data– Share experiments

• Outfit SDXes with measurement infrastructure and tools that can be used by research community– Important for initial research stages– Analysis, verification, validation

• More on the basics in tomorrow’s tutorial


Some wild ideas

• Can you use measurement data for OF controller behavior

• Send measurement data on different flow than production traffic– Isolation– Measurement data collection will not interfere with

production traffic


Separating Measurement & Production

• Inherent in GENI but imposes limitations


Routing

• In between GENI Racks we can implement, test, and evaluate our own routing protocols

• Inter-domain routing not possible• SDXes will allow research in new inter-domain

routing protocols.• E.g. work on BGP:

– SDX: A Software Defined Internet Exchange. Arpit Gupta, Laurent Vanbever, Muhammad Shahbaz, Sean P. Donovan, Brandon Schlinker, Nick Feamster, Jennifer Rexford, Scott Shenker, Russ Clark, Ethan Katz-Bassett


Routing 2.0

• OpenFlow: Flow rules based not only on IP but also type-of-service, port, VLAN priority and so on

• BGP policy• Even BGP traffic could be treated differently• Routing without IP• Routing to avoid DDoS attacks• Routing based on available storage and compute

resources


Education

• Use SDX in the classroom and computer networks/distributed systems labs

• E.g., students can study inter-domain routing in real testbed (not sure if this is possible anywhere else?)


Conclusions

• SDX: They are here (to stay?)• New vehicle for “at-scale”, next-generation

Internet research• Examples for SDX use• Meaningful experimentation• How could you use them for your routing ideas?


Further Reading

• NRTDI SDX Workshop: http://www.nitrd.gov/nitrdgroups/images/3/3d/SDN_Workshop_for_OnVector_Monga_v2.pdf

• NSF SDX Workshop: http://groups.geni.net/geni/wiki/SDXandSDIWorkshop

• Paper on Google B4:http://cseweb.ucsd.edu/~vahdat/papers/b4-sigcomm13.pdf

http://groups.geni.net/geni/wiki/SDXandSDIWorkshop




Acknowledgements

• Niky Riga• Mark Berman• Chip Elliott• Divyashri Bhat• Joe Mambretti• Russ Clark


StarLight SDX

sponsored by the national science foundation software defined exchanges: new opportunities for...

Documents

multi domain sdn

gec20 sdn domains

sdn infrastructure

geni geni

sdn islands sdn sdx

multidomain sdn federation

interconnect of sdn

independent sdn domains