sponsored by the national science foundation software defined exchanges: new opportunities for...
Post on 25-Dec-2015
214 Views
Preview:
TRANSCRIPT
Sponsored by the National Science Foundation
Software Defined Exchanges:New Opportunities for
Future Internet Research
Mike Zink GREE-SC2014
July 21st 2014, Iowa State University
Sponsored by the National Science Foundation 2GEC20
Overview
• Motivation• What is an SDX?• SDN Domains• Prototypes• Opportunities
– Cyber-physical System– Adaptive Streaming
• Instrumentation and Measurement• Routing• Education• Conclusions
Sponsored by the National Science Foundation 3GEC20
Emerging SDN Capabilities are VirtuallyCertain to Require Multi-Domain Infrastructure
• OpenFlow and software defined networking play an important role in GENI– GENI is deploying a multi-domain SDN federation at ~50
campuses nationwide– Key technology for enabling GENI’s deep programmability
capability
• Because GENI is built as a federation, there’s a clear need for SDN infrastructure to span multiple operating domains– GENI infrastructure is owned and operated by the host institutions– Experiments and services need to exert control across these
borders in a consistent and controlled way– These needs are repeated at a larger scale when GENI federates
with other peer infrastructure, nationally and internationally
Sponsored by the National Science Foundation 4GEC20
Multi-Domain SDN GENI Projects
Prototype GENI Multi-
Services Network
Exchange (GMNE)
Shakedown Experimentations
and Prototype Services on
Scalable, Agile, Robust, and
Secure Multi-Domain Software
Defined Networks
A Software Defined
Exchange for Engaging
Commercial Partners in a
Self-sustaining GENI
Sponsored by the National Science Foundation 5GEC20
What is an SDX?
It’s for adv.BGP
It’s OF on steroids
It’s software everything It’s an
adv.IXP
It’s multi-domain SDN
It’s only for research
Sponsored by the National Science Foundation 6GEC20
What do I believe it is!
• First and foremost: Connecting several independent SDN domains
• But only networking?• Chip Elliot: “If we would built the Internet from
scratch today it would have routers with lots of storage and computation added”
• SDX: Interconnect of SDN domains, storage & computation
Sponsored by the National Science Foundation 7GEC20
Taking the next step
Create SDX’s to bridge “SDN islands”
SDN
SDNSDN
SDN SDN
SDN
SDN
SDN
SDNSDN
SDN SDN
SDN
SDN
SDX
SDX
Today: “SDN islands”GENI slices & VLAN stitchinghelp point the way
Next Step: Add SDX’sBuild a “Rev 0” control plane,run native next-gen appsand scientific instrumentsspanning multi-domain SDNs
SDI
Sponsored by the National Science Foundation 8GEC20
SDX’s build the human community
• Working together . . .– US Industry– Network operators– Next-gen app developers– Scientific Instrument
developers and users– Researchers
• Basic concept– “SDN Exchange”– Open meeting point– Support end-to-end applications
across multiple SDN domains
• Key benefit: Very OPEN– Good way to rapidly build / grow
tech community– Good way to create & share
open-source tool chains– Good way to try out different
approaches, perhaps vendor specific, in early days
– Later, we can move to private peering points
Sponsored by the National Science Foundation 9GEC20
SDN Domains
• What is an SDN domain?• Example: Internet Advanced Layer 2 Service
(AL2S)
• Google’s B4• In this talk I will focus on
the research network/academic side of SDN Domains.
Sponsored by the National Science Foundation 10GEC20
SDX Prototypes
• Exchange points that connect several SDN domains
• StarLight, SOX, MAX, iMinds in Europe, …• Most of them also include computation and
storage• StarLight and SOX SDXes open for researchers• GENI racks at both locations!
Sponsored by the National Science Foundation
StarLightQXF3500
Switch
StarLightOpenflow
Switch
StarLightCienaSwitch
StarLightE1200Switch
AL2S
ORNL1650
16
50
,16
51
17
09
1709
Other GENI Racks
1750
1750
1750
17
50
1750
1709
ESnet1651
SL GENI AM
60
50
1
2
4
52
16
55
17
50
SDX
NU Rack
SLRack
StarLightOF
switch
StarLight Network Diagram for SDX
StarLight SDX
Sponsored by the National Science Foundation 12GEC20
Where can we go?
• Lot’s of things we cannot do (or at least only in complicated ways) in today’s Internet
• NDN• Cyber-physical systems• Clean slate• In-network computation and storage• …
Sponsored by the National Science Foundation 13GEC20
GENI: Infrastructure for Experimentation
GENI is a large multi-domain SDN testbed
Sponsored by the National Science Foundation 14GEC20
GENI: Infrastructure for Experimentation
GENI is the largest multi-domain SDN testbed
Sponsored by the National Science Foundation 15GEC20
Setting up an SDX Experiment
Deploy it on a GENI slice
Study the benefits of SDX on NowCast, a time-critical short-
term weather forecast application
Sponsored by the National Science Foundation 16GEC20
Conceptual diagram
GECfloor
SDX SDX
SDN
(SDN)
SDN SDN
SimulatedRadar Traffic
Middlebox
Sponsored by the National Science Foundation 17GEC20
GENI Slice
StarLightOF
switch
NU-IGRack
end hosts(radar traffic)
SoX OF
switch
sdxsdx
SoX-IGRack
middlebox(processing
host)
GT-IGRack
end hosts(view results)
AL2S Switch
AL2S Switch
Resource reservation with standard GENI tools
demo floor
Sponsored by the National Science Foundation 18GEC20
SDN Control
StarLightOF
switch
NU-IGRack
SoX OF
switch
sdxsdx
SoX-IGRack
GT-IGRack
AL2S Switch
AL2S Switch
Experiment choice how to manage SDN resources
Load Balancer Controller
Learning Controller
Sponsored by the National Science Foundation 19GEC20
Nowcast – Processing
Grid & Merge
DARTS
Post-process
Webserver
Dynamically provisioned
SDN
Nowcast VM
New nowcast every one minute!
Sponsored by the National Science Foundation 20GEC20
Nowcast – Experiment
GECfloor
SDX SDX
SDN
(SDN)
SDN SDN
SimulatedRadar Traffic
Middlebox
OF Controller
Monitoring with GIMI tools
Sponsored by the National Science Foundation 21GEC20
Nowcast – Data Flow
GECfloor
SDX SDX
SDN
(SDN)
SDN SDN
SimulatedRadar Traffic
Middlebox
Monitoring with GIMI tools
Sponsored by the National Science Foundation 22GEC20
Example: Adaptive Streaming
Steps:● Video is chunked (broken into segments of equal length)● Each chunk is represented in different quality segments - encoded in 5
different bitrates● Bitrate (quality) of content streamed to client is chosen based on
bandwidth between server and client. ● Client decides the quality which is to be played● Every chunk requested is a new HTTP connection
Features:● Quality of the video “adapts”
to the client’s bandwidth requirements
● Fewer video freezes● Highly likely that client
receives better quality as video progressesRequirements:
● High/consistent bandwidth connection
● Compute-intensive Operation - Live transcoding
● Content availability
SOLUTION : SDX
Sponsored by the National Science Foundation 23GEC20
Instrumentation and Measurement
• Perform repeatable experiment– Automate experiment– Archive data– Share experiments
• Outfit SDXes with measurement infrastructure and tools that can be used by research community– Important for initial research stages– Analysis, verification, validation
• More on the basics in tomorrow’s tutorial
Sponsored by the National Science Foundation 24GEC20
Some wild ideas
• Can you use measurement data for OF controller behavior
• Send measurement data on different flow than production traffic– Isolation– Measurement data collection will not interfere with
production traffic
Sponsored by the National Science Foundation 25GEC20
Separating Measurement & Production
• Inherent in GENI but imposes limitations
Sponsored by the National Science Foundation 26GEC20
Routing
• In between GENI Racks we can implement, test, and evaluate our own routing protocols
• Inter-domain routing not possible• SDXes will allow research in new inter-domain
routing protocols.• E.g. work on BGP:
– SDX: A Software Defined Internet Exchange. Arpit Gupta, Laurent Vanbever, Muhammad Shahbaz, Sean P. Donovan, Brandon Schlinker, Nick Feamster, Jennifer Rexford, Scott Shenker, Russ Clark, Ethan Katz-Bassett
Sponsored by the National Science Foundation 27GEC20
Routing 2.0
• OpenFlow: Flow rules based not only on IP but also type-of-service, port, VLAN priority and so on
• BGP policy• Even BGP traffic could be treated differently• Routing without IP• Routing to avoid DDoS attacks• Routing based on available storage and compute
resources
Sponsored by the National Science Foundation 28GEC20
Education
• Use SDX in the classroom and computer networks/distributed systems labs
• E.g., students can study inter-domain routing in real testbed (not sure if this is possible anywhere else?)
Sponsored by the National Science Foundation 29GEC20
Conclusions
• SDX: They are here (to stay?)• New vehicle for “at-scale”, next-generation
Internet research• Examples for SDX use• Meaningful experimentation• How could you use them for your routing ideas?
Sponsored by the National Science Foundation 30GEC20
Further Reading
• NRTDI SDX Workshop: http://www.nitrd.gov/nitrdgroups/images/3/3d/SDN_Workshop_for_OnVector_Monga_v2.pdf
• NSF SDX Workshop: http://groups.geni.net/geni/wiki/SDXandSDIWorkshop
• Paper on Google B4:http://cseweb.ucsd.edu/~vahdat/papers/b4-sigcomm13.pdf
Sponsored by the National Science Foundation 31GEC20
Acknowledgements
• Niky Riga• Mark Berman• Chip Elliott• Divyashri Bhat• Joe Mambretti• Russ Clark
top related