![Page 1: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/1.jpg)
Anatomy of a Large European IXP
B. Ager, N. Chatzis, N. Sarrar TU Berlin/Telekom Innovation Laboratories
To appear at ACM SIGCOMM, Helsinki, Finland, August 2012
Anja Feldmann TU Berlin/Telekom Innovation Laboratories
W. Willinger AT&T Labs Research
S. Uhlig Queen Mary
University of London
![Page 2: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/2.jpg)
The changing Internet
❒ What is your mental model of the Internet? ❍ What Internet does it capture? ❍ Today’s Internet?
❒ Some thoughts about local traffic and connectivity: ❍ IXPs can be as large as the top ISPs in the world ❍ Lots of data-centers/hosting locations around the
world
![Page 3: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/3.jpg)
Internet: Accepted mental model
![Page 4: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/4.jpg)
Internet – Network of networks
Accepted mental model of the Internet ❒ 35,000+ networks ❒ Hierarchical structure
❍ Tier-1 (10-20): ATT, L3, Sprint, DTAG, … ❍ Regional ISPs (15%): BT, Telefonica, … ❍ Stubs (85%): small ISPs, universities, enterprise
networks
❒ Known AS connectivity ❍ Customer-provider: 90,000+ ❍ Peer-peer: 35-40,000
![Page 5: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/5.jpg)
Most recent mental model – a 2011
à Flattening of the AS topology
Google, Akamai,
RapidShare, …
Source: Arbor Networks 2009
![Page 6: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/6.jpg)
Question – What about IXPs
à Flattening of the AS topology à What about IXPs impact
Google, Akamai,
RapidShare, … IXP
Source: Arbor Networks 2009
![Page 7: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/7.jpg)
Outline
❒ Motivation ❒ IXP ecosystem ❒ Diversity ❒ Visibility ❒ Conclusion
![Page 8: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/8.jpg)
IXP – architecture/business model
à Offers connectivity à Enables peering
![Page 9: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/9.jpg)
Internet exchange point (IXP)
à Traffic Volume: Same as Tier-1 ISPs à Clear daily patterns
![Page 10: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/10.jpg)
Traffic mix
![Page 11: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/11.jpg)
IXP members
![Page 12: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/12.jpg)
Outline
❒ Motivation ❒ IXP ecosystem ❒ Diversity ❒ Visibility ❒ Conclusion
![Page 13: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/13.jpg)
Members business types
Ac.
net
.
Acc
ess
Con
nect
.
Con
tent
Hos
t
Ser
vice
Tra
nsit
CD
N
Ent
. net
.
Mon
itor
Perc
enta
ge o
f mem
bers
0
10
20
30
40
50
60
70
![Page 14: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/14.jpg)
Peers per member
0 50 100 150 200 250 300 350 400
050
150
250
350
Members
Num
ber o
f pee
rs ●
●
●
●
●●
●●
●
●
●●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●●●●
●
●
●
●
●
●
●
●
●
●
●
●
●●●
●
●
●
●
●
●●
●
●
●
●
●
●
●●●●
●
●
●●
●
●
●●
●
●
●
●
●
●
●
●●
●
●
●
●
●●
●
●
●
●
●
●
●●
●
T1 T2 Leaf●LISP SISP HCDN AEN
![Page 15: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/15.jpg)
HTTP traffic
0 20 40 60 80 100
0.0
0.2
0.4
0.6
0.8
1.0
●
●
●
●
●
●
Percentage of HTTP/HTTPS traffic (bytes)
CD
F of
mem
bers
●
TotalLISPSISPHCDNAEN
![Page 16: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/16.jpg)
Traffic asymmetry
Outgoing traffic per member (Mbit/s)
Inco
min
g tra
ffic
per m
embe
r (M
bit/s
)
100 101 102 103 104
100
101
102
103
104
●
●
●
●
●
●
● ●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●●
Lines at ratios20:1, 3:1, 1:1, 1:3, and 1:20
●
LISPSISPHCDNAEN
![Page 17: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/17.jpg)
Geographic e2e distance
0 2000 4000 6000 8000 10000Distance (km)
Den
sity×
1000
00.
20.
40.
60.
8LISPSISPHCDN
![Page 18: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/18.jpg)
Outline
❒ Motivation ❒ IXP ecosystem ❒ Diversity ❒ Visibility ❒ Conclusion
![Page 19: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/19.jpg)
Public view of P-P peerings à Peering links at IXP: > 50K à ~40K peerings are publicly known so far
![Page 20: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/20.jpg)
Visibility of IXP peerings
![Page 21: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/21.jpg)
Potential visibility of IXP traffic
![Page 22: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/22.jpg)
Network map 2012+ Google, Akamai,
RapidShare, …
Source: Arbor Networks 2009
à Even more flattening of the AS topology à IXPs central component à Lots of local peering
IXP
![Page 23: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/23.jpg)
Outline
❒ Motivation ❒ IXP ecosystem ❒ Visibility ❒ Diversity ❒ Conclusion
![Page 24: Anatomy of a Large European IXP - TU Berlin€¦ · TU Berlin/Telekom Innovation Laboratories To appear at ACM SIGCOMM, Helsinki, Finland, August 2012 Anja Feldmann TU Berlin/Telekom](https://reader033.vdocument.in/reader033/viewer/2022043017/5f39ec61295f1d1c8b6ac078/html5/thumbnails/24.jpg)
Summary
❒ Revisiting mental model of the Internet ❒ Much more P-P peerings out there:
❍ A single IXP with 300+ members more than doubles known P-P peerings
❒ Poor visibility of IXP peerings and traffic ❒ IXP has a rich ecosystem:
❍ Members ❍ Traffic ❍ Geography