understanding the evolving internet · 2020. 1. 10. · dark fiber lit fiber conduit. 3 level of...
TRANSCRIPT
![Page 1: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/1.jpg)
UnderstandingtheEvolvingInternet
RamDurairajan
0
Assistant Professor, Computer and Information ScienceCo-director, Oregon Networking Research Group
University of Oregon
![Page 2: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/2.jpg)
1PhysicalInternet
Users, Apps and Data
Datacenters and CDNs
Cloud Services
Mobile Devices
SDNs and NFVs
Internet of Things
Internetisacomplexsystem
![Page 3: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/3.jpg)
PhysicalInternet
2
PointofPresence(POP)
Fiberopticslink
DatacenterColocationfacility…
Submarinecable
ToLondon
LitfiberDarkfiberConduit
![Page 4: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/4.jpg)
3
LevelofRobustness
ExistingMechanisms(e.g.,trafficengineering)
Perfe
ctCon
nectivity
NoCo
nnectivity
Problem
• GiventheclaimthatInternet’sdesignisrobust,whydowehaveoutages?Performanceissues?Bandwidthondemand?
(Robustness:abilityofthephysicalInternettocopewithevolution)
![Page 5: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/5.jpg)
NoonehasacompleteviewoftheInternet
4Source:Lumeta Source:Peer1
Router-levelTopology
AutonomousSystems-levelTopology
![Page 6: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/6.jpg)
5
LevelofRobustness
ExistingMechanisms(e.g.,trafficengineering)
Perfe
ctCon
nectivity
NoCo
nnectivity
Problem
• GiventheclaimthatInternet’sdesignisrobust,whydowehaveoutages?Performanceissues?Bandwidthondemand?
• HowdowetranscendthisrobustnessgaptobuildabetterInternet?
(Robustness:abilityofthephysicalInternettocopewithevolution)
• Whataboutevolvingcomponents?IoTs?Privateinterconnects?
![Page 7: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/7.jpg)
Outline
IntroductionandMotivationUnravellingtheStructuralComplexity
- MappingtheInternetEcosystemProvidingFlexibleDecisionSupport
6
![Page 8: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/8.jpg)
MappingtheInternetecosystem
• XConnects,CloudconnectsandPrivateInterconnects• InternetofThings• Long-haulandMetro
7
![Page 9: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/9.jpg)
MappingtheInternetecosystem
• XConnects,CloudconnectsandPrivateInterconnects• InternetofThings• Long-haulandMetro
8
![Page 10: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/10.jpg)
MappingtheInternetofThings
• MapandCharacterizetheIoT devicesanddeployments• Anactivemeasurements-basedapproach• SpecificfocusonIPv6-enabledIoT devices
• Challenges• IPv6addressspaceislarge.HowtoefficientlyscanIPv6prefixes?• HowtodifferentiateIoT vs.non-IoT devices?
• Applythistoproblemsofinterest• Securityandprivacy,censusandsurvey,businessintelligence,etc.
9
![Page 11: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/11.jpg)
Mappinglong-haulandmetro
• InternetAtlas:acomprehensiverepositoryofthePhysicalInternet• Search-baseddata• Mapsnodes,links,fiberstrands,etc.• Repositoryhasover1,400maps
• Applythistoproblemsofinterest• Robustness,performance,security,resilience,etc.
• PopularScience• BestofWhat’sNew,SecurityCategory,2017• Oneofthe100GreatestInnovationsof2017
10
![Page 12: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/12.jpg)
MapofUSlong-haulfiber
11
![Page 13: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/13.jpg)
Assessinginfrastructuresharing
• Strikingcharacteristicofconstructedmapsisconduitsharing• 20-yearfiberIRUtoreducecosts
12
![Page 14: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/14.jpg)
Connectivity-onlysharedrisk• HowmanyISPsshareaconduit?
13
0
100
200
300
400
500
600
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20
Rawnum
ber
NumberofISPssharingaconduit
542conduits89.67%
63.28%53.50%
12criticalchokepoints
Physical connectivity lacks much diversity that is a hallmark of commonly-known models.
![Page 15: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/15.jpg)
Keyobservation
• ThereisalotofsharingintheInternet• Risksandoutages
• Opticalconnectionscannotbereconfigured• Inflexibility
• Risks+outages+inflexibility=NOTrobust!
14
![Page 16: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/16.jpg)
Outline
IntroductionandMotivationUnravellingtheStructuralComplexityProvidingFlexibleDecisionSupport
- BuildingsystemstocreateabetterInternet
15
![Page 17: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/17.jpg)
Needforflexibledecisionsupport• Flexibledecisionsupportisimportant• Enhancerobustness,resilience,security
• Resilience:removetheinflexibleleasingmodel(andreducesharedrisk)• Security:connectivity/bandwidthondemandtocountervolumetricDDoSattacks
• GiventheunderstandingofthephysicalInternet,whatradicalchangecanweintroducetobuildabetterInternet?• Wide-areaConnectivityasaService
• AgilitymeetstheInternet• E.g.,DeployNFVsinthewild
16
![Page 18: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/18.jpg)
• Objective:asystem(calledGreyFiber)forcloudification ofthephysicalInternet• Cloud:Rentcycles,useresources,andrelease• GreyFiber:Rentconnectivity,transferdata,andreleaseconnectivity
• Systemconsiders• Infrastructureabundance(e.g.,unusedfiber)• Marketeconomics(e.g.,CAPEX,OPEX)• Technologytrends(e.g.,fastremotereconfigurationsinrouters)
• Flexibleaccesstofiber-opticpathsbetweenendpoints(e.g.,IXP)overarangeofusescenarios
17
Wide-areaConnectivityasaService
![Page 19: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/19.jpg)
• GreyFiber consistsofthreecomponents• Globalcontrol,localsitecontrolandphysicalinfrastructuresubstrate
18
GreyFiber systemdesign
![Page 20: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/20.jpg)
FiberExchange
BuyersSellers
GlobalController
GreyFiberGlobalControl
• Controlandcommandcenter• Sellers aremajorfiber/majorcableproviders
• Buyers arethecustomers(e.g.,CDNs,enterprisenetworks)
• Fiberexchange toenableeconomicviability• RunsGSPauctions
• Globalcontroller• Trafficengineering• Time-basedcircuitprovisioning• Networkmanagement• Backuprestoration
![Page 21: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/21.jpg)
SiteALocal
ControllerSiteBLocal
Controller
SiteCLocal
Controller
FiberExchange
BuyersSellers
GlobalController
GreyFiberGlobalControl
GreyFiberLocalSiteControl
• Localcontrolovermarkedgeographicregion(e.g.,IXP)
• Mimicsminimalfunctionalitiesfromglobalcontrol• Configure links• Monitor connectivity• Report statisticstoglobalcontrol
![Page 22: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/22.jpg)
SiteALocal
ControllerSiteBLocal
Controller
SiteCLocal
Controller
FiberExchange
BuyersSellers
GlobalController
GreyFiberGlobalControl
GreyFiberLocalSiteControl
PhysicalInfrastructure
• Composedoftraditionalnodesandlinks(e.g.,fiberpaths)
• Assumption• Fiberisalreadylit
![Page 23: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/23.jpg)
• GreyFiber consistsofthreecomponents• Globalcontrol,localsitecontrolandphysicalinfrastructuresubstrate
• Supportsarangeofusescenarios• Small(secondstominutes),medium(hours),large(daystomonths)andextra-large(years)• Shortlifetimetoaddressunexpectedoutagesanddemands• Medium-to-largetoserviceunexpecteddemandswithoutdeadlines• Extra-largetosupporttraditionallease
22
GreyFiber systemdesign
![Page 24: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/24.jpg)
GreyFiber implementationandevaluation
• Implementedin~22KlinesofPythoncode
• EvaluatedinGENIandCloudLab testbeds
23
![Page 25: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/25.jpg)
Keyresults
• PerformancebenefitsofGreyFiber?
24
1GonGENI 10GonCloudLab
![Page 26: Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of Robustness Existing Mechanisms (e.g., traffic y engineering) y ... •Security: connectivity/bandwidth](https://reader033.vdocument.in/reader033/viewer/2022052019/603276aee30c1d4abb418df6/html5/thumbnails/26.jpg)
Questions?
25
ThankstoRezaRejaie,PaulBarford,JoelSommers,WalterWillinger and“great”students!