internet traffic 2019 - nanog · 2019-06-27 · •netflix and google largest dedicated cdn...
TRANSCRIPT
![Page 2: Internet Traffic 2019 - NANOG · 2019-06-27 · •Netflix and Google largest dedicated CDN •SignificantgrowthinCloudFront andFastly •Traffic nota financial indicator Confidential](https://reader036.vdocument.in/reader036/viewer/2022062917/5ed1aec8ef23f6521d3273e0/html5/thumbnails/2.jpg)
2
• Large-scale study of Internet traffic- Anonymized IPFIX, gRPC, DNS responses, BGP, SNMP
- 32 collaborating Nokia customer ISP / content
- Biased towards NA (with 75% coverage of traffic)
- But significant Asia Pacific and EU presence
• Methodology similar to 2009 NANOG- Preliminary 2019 results
- Data still needs to be normalized, bias, etc.
Internet Traffic
C. Labovitz, S. Iekel-Johnson, D. McPherson, J. Oberheide, F. Jahanian Internet Inter-Domain Traffic. SIGCOMM 2010
![Page 3: Internet Traffic 2019 - NANOG · 2019-06-27 · •Netflix and Google largest dedicated CDN •SignificantgrowthinCloudFront andFastly •Traffic nota financial indicator Confidential](https://reader036.vdocument.in/reader036/viewer/2022062917/5ed1aec8ef23f6521d3273e0/html5/thumbnails/3.jpg)
3
• Internet is getting bigger by traffic volume
• Internet is rapidly getting smaller by concentration of content sources
• By traffic volume, Internet almost entirely completed migration to CDN
• TLS for first time is majority of traffic by February 2019
• IPv6 now at 20% but percentage is no longer growing
• New and long-term existing challenges including regulatory, DDoS, TE time scales
Observations
![Page 4: Internet Traffic 2019 - NANOG · 2019-06-27 · •Netflix and Google largest dedicated CDN •SignificantgrowthinCloudFront andFastly •Traffic nota financial indicator Confidential](https://reader036.vdocument.in/reader036/viewer/2022062917/5ed1aec8ef23f6521d3273e0/html5/thumbnails/4.jpg)
4
Estimates of Internet SizeTraffic volumes between 600-900 Tbps
600 Tbps 2019Cisco VNI
(graph shows exabytes per month)
800 Tbps 2019Nokia Deepfield
Traffic estimate based on linear regression using known “ground-truth” values plotted against weighted ASN percentage of Internet traffic in all providers in study sample. See SIGCOMM 2009 paper for more discussion of estimation
![Page 5: Internet Traffic 2019 - NANOG · 2019-06-27 · •Netflix and Google largest dedicated CDN •SignificantgrowthinCloudFront andFastly •Traffic nota financial indicator Confidential](https://reader036.vdocument.in/reader036/viewer/2022062917/5ed1aec8ef23f6521d3273e0/html5/thumbnails/5.jpg)
5
• Consumer and content 40-50% growth annualized
• Transit growing considerably slower
• Definition of inter-domain traffic increasingly ill-defined (e.g. cloud exchange)
Rate of GrowthExample Three Providers 2009 and 2019
Provider 2009Tbps 2019Tbps Multiplier Region TypeA 1.6 41 25 NA ConsumerB 0.5 6 12 Asia TransitC 0.14 5 28 NA Hosting
![Page 6: Internet Traffic 2019 - NANOG · 2019-06-27 · •Netflix and Google largest dedicated CDN •SignificantgrowthinCloudFront andFastly •Traffic nota financial indicator Confidential](https://reader036.vdocument.in/reader036/viewer/2022062917/5ed1aec8ef23f6521d3273e0/html5/thumbnails/6.jpg)
6
CDN Growth CDN 2009 - 2019
• Globally CDN account for 90% of consumer traffic by 2018
• Definition of CDN blurs as more content providers deploy edge cache and compute
• Nature of traffic changes as adaptive bit rate becomes the norm with automated traffic direction
![Page 7: Internet Traffic 2019 - NANOG · 2019-06-27 · •Netflix and Google largest dedicated CDN •SignificantgrowthinCloudFront andFastly •Traffic nota financial indicator Confidential](https://reader036.vdocument.in/reader036/viewer/2022062917/5ed1aec8ef23f6521d3273e0/html5/thumbnails/7.jpg)
7
• Netflix and Google largest dedicated CDN
• Significant growth in CloudFrontand Fastly
• Traffic not a financial indicator
Confidential
Largest CDN North America by Traffic Volume
P95 total bps in May across 10 NA Providers P95 total de-duplicated traffic to subscribers in
May 2019 across 10 NA providers. Excludes provider CDN / VoD, transparent cache and cache fill / origin server.
20%
17%
13%
6%
5%
![Page 8: Internet Traffic 2019 - NANOG · 2019-06-27 · •Netflix and Google largest dedicated CDN •SignificantgrowthinCloudFront andFastly •Traffic nota financial indicator Confidential](https://reader036.vdocument.in/reader036/viewer/2022062917/5ed1aec8ef23f6521d3273e0/html5/thumbnails/8.jpg)
8
BGP Routing Table
0.00%
10.00%
20.00%
30.00%
40.00%
50.00%
60.00%
70.00%
80.00%
90.00%
100.00%
1 101 201 301 401 501 601 701 801 901 1,001
CumulativePe
rcen
tage
NumberofBGPRoutes
CDF of P95 traffic contribution by unique BGP route May 29, 2019 across multiple North American ISP
~800k routes in default free table but majority traffic due to < 500
![Page 9: Internet Traffic 2019 - NANOG · 2019-06-27 · •Netflix and Google largest dedicated CDN •SignificantgrowthinCloudFront andFastly •Traffic nota financial indicator Confidential](https://reader036.vdocument.in/reader036/viewer/2022062917/5ed1aec8ef23f6521d3273e0/html5/thumbnails/9.jpg)
9
Applications
Asia (anonymous ISP data) North America (anonymous ISP data)
Traffic in EU, NA and Asia dominated by ~10 large sources (though a different 10)
![Page 10: Internet Traffic 2019 - NANOG · 2019-06-27 · •Netflix and Google largest dedicated CDN •SignificantgrowthinCloudFront andFastly •Traffic nota financial indicator Confidential](https://reader036.vdocument.in/reader036/viewer/2022062917/5ed1aec8ef23f6521d3273e0/html5/thumbnails/10.jpg)
10
TLSAcross Global Sample of Providers
• SSL is majority of traffic in NA by February 2019
![Page 11: Internet Traffic 2019 - NANOG · 2019-06-27 · •Netflix and Google largest dedicated CDN •SignificantgrowthinCloudFront andFastly •Traffic nota financial indicator Confidential](https://reader036.vdocument.in/reader036/viewer/2022062917/5ed1aec8ef23f6521d3273e0/html5/thumbnails/11.jpg)
11
• Graph of P95 daily total bps per AF averaged across several smaller NA consumer providers
• IPv6 15-20% of de-duplicated traffic but percentage of IPv4 roughly constant
IPv6 and IPv4Across Global Sample of Providers
![Page 12: Internet Traffic 2019 - NANOG · 2019-06-27 · •Netflix and Google largest dedicated CDN •SignificantgrowthinCloudFront andFastly •Traffic nota financial indicator Confidential](https://reader036.vdocument.in/reader036/viewer/2022062917/5ed1aec8ef23f6521d3273e0/html5/thumbnails/12.jpg)
12
Small Number of Content Responsible for Majority IPv6
0% 5% 10% 15% 20% 25% 30% 35% 40%
youtube.com
netflix.com
apple.com
video.facebook.com
google.com
connect.facebook.com
instagram.com
facebook.com
icloud.apple.com
other.akamai.net
![Page 13: Internet Traffic 2019 - NANOG · 2019-06-27 · •Netflix and Google largest dedicated CDN •SignificantgrowthinCloudFront andFastly •Traffic nota financial indicator Confidential](https://reader036.vdocument.in/reader036/viewer/2022062917/5ed1aec8ef23f6521d3273e0/html5/thumbnails/13.jpg)
13
DNS as Metric of Internet ScaleFor practical purposes the Internet is 3M IPs
And for given ISP, reach 50% traffic with < 100k IPs in a given dayFQDN continues to grow linearly because abuse and used encode signaling
Analysis of ~1 billion DNS queries across four large consumer networks and sampled recursive responses across 24 hours
![Page 14: Internet Traffic 2019 - NANOG · 2019-06-27 · •Netflix and Google largest dedicated CDN •SignificantgrowthinCloudFront andFastly •Traffic nota financial indicator Confidential](https://reader036.vdocument.in/reader036/viewer/2022062917/5ed1aec8ef23f6521d3273e0/html5/thumbnails/14.jpg)
14
• CCPA / GDRP impacting low level probe deployment- QoE and marketing
• DDoS economics- Scale, nature of attacks and response latency
- Improvements vendor / merchant silicon
• QoE
Confidential
Challenges
![Page 15: Internet Traffic 2019 - NANOG · 2019-06-27 · •Netflix and Google largest dedicated CDN •SignificantgrowthinCloudFront andFastly •Traffic nota financial indicator Confidential](https://reader036.vdocument.in/reader036/viewer/2022062917/5ed1aec8ef23f6521d3273e0/html5/thumbnails/15.jpg)
15
Changing DDoS
![Page 16: Internet Traffic 2019 - NANOG · 2019-06-27 · •Netflix and Google largest dedicated CDN •SignificantgrowthinCloudFront andFastly •Traffic nota financial indicator Confidential](https://reader036.vdocument.in/reader036/viewer/2022062917/5ed1aec8ef23f6521d3273e0/html5/thumbnails/16.jpg)
16
• Same IPs seen in multiple IoT and reflector DDoS across set of providers
• Most traffic not synthetic
• Set attacking IPs often fit within TCAM via FlowSpec / NetConf
Continued Growth Amplifiers and Emergence IoT DDoSIPs seen in traffic / DDoS and responding to external crawls
Note: • Directly Internet reachable (i.e. not behind NAT)• Netcraft reports 8,048,899 IPs in 2018
![Page 17: Internet Traffic 2019 - NANOG · 2019-06-27 · •Netflix and Google largest dedicated CDN •SignificantgrowthinCloudFront andFastly •Traffic nota financial indicator Confidential](https://reader036.vdocument.in/reader036/viewer/2022062917/5ed1aec8ef23f6521d3273e0/html5/thumbnails/17.jpg)
17 Confidential
ExampleConstant stream CLDAP 1 Gbps across multiple dozen subscribers
![Page 18: Internet Traffic 2019 - NANOG · 2019-06-27 · •Netflix and Google largest dedicated CDN •SignificantgrowthinCloudFront andFastly •Traffic nota financial indicator Confidential](https://reader036.vdocument.in/reader036/viewer/2022062917/5ed1aec8ef23f6521d3273e0/html5/thumbnails/18.jpg)
18
Questions