network measurement ii...the speed of end points matter os of end-points matter • end points are...
TRANSCRIPT
![Page 1: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/1.jpg)
Network measurement II Sebastian Castro – NZRS 27th May 2015 Victoria University
![Page 2: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/2.jpg)
• Network measurement in the wild • Common pitfalls in methodologies • Network measurement datasets • Stories • Our work
Agenda
May 27, 2015 Network Measurement 2
![Page 3: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/3.jpg)
• Active Measurement Project, Waikato University http://amp.wand.net.nz/ 20+ probes across New Zealand for active network measurement NZRS strong supporter of the project
AMP Project
May 27, 2015 Network Measurement 2
![Page 4: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/4.jpg)
• https://www.truenet.co.nz/ • NZ Organization doing broadband
measurement • Results used by media and government to
decide who’s best
Truenet
May 27, 2015 Network Measurement 2
![Page 5: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/5.jpg)
• ISP speed index http://ispspeedindex.netflix.com/
• Every Netflix client does network measurement: latency, loss, jitter, bandwidth
• Main objective: maximize user experience, minimize buffering
• New Zealand case: Best SNAP, worse Spark
Netflix
May 27, 2015 Network Measurement 2
![Page 6: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/6.jpg)
• Active measurement of critical DNS infrastructure Latency, Packet loss https://atlas.ripe.net/dnsmon/
RIPE DNSMON
May 27, 2015 Network Measurement 2
![Page 7: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/7.jpg)
• Distributed measurement platform • 8200 probes around the world! • Open API to execute measurements • DNS, traceroute, ping, HTTP, HTTPS • Possibilities are endless!
https://labs.ripe.net/Members/wilhelm/cyclone-pam-and-the-internet-in-vanuatu
RIPE Atlas
May 27, 2015 Network Measurement 2
![Page 8: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/8.jpg)
• Consortium of research, industry and public-interest partners
• Platform, data, tools and visualizations • http://www.measurementlab.net/ • Notable tools: NDT, Glasnot
MLab
May 27, 2015 Network Measurement 2
![Page 9: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/9.jpg)
• Throughput != User experience Testing throughput with web traffic
• Delay != Web response Different layers A web request includes: DNS query and response, TCP connection, object request, object transfer
• Use ICMP to test everything Mixed policies how to handle ICMP Could get de-prioritized, dropped, etc. When possible, use application traffic
Common pitfalls
May 27, 2015 Network Measurement 2
![Page 10: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/10.jpg)
• Bandwidth != Throughput Throughput is from an application PoV Bandwidth is a measure of capacity UDP will give you something closer to BW TCP will give you something closer to Throughput. The speed of end points matter OS of end-points matter
• End points are key! ISP X offers plans of 50Mbps download Key question: from where to where?
Common pitfalls
May 27, 2015 Network Measurement 2
![Page 11: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/11.jpg)
• Practical Guide to Correctly troubleshoot with traceroute https://www.nanog.org/meetings/nanog45/presentations/Sunday/RAS_traceroute_N45.pdf Many of the concepts showed before are explained there, excellent read!
Advise
May 27, 2015 Network Measurement 2
![Page 12: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/12.jpg)
• Scans.io From University of Michigan Various Internet wide scans Specific application ports Really useful to avoid doing your own
Datasets
May 27, 2015 Network Measurement 2
![Page 13: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/13.jpg)
• DITL: Day in the Life of the Internet Largest collection of DNS data in the world Two days of packet captures, annually Root servers, TLD, other http://www.caida.org/projects/ditl/ https://www.dns-oarc.net/oarc/data/ditl
Datasets
May 27, 2015 Network Measurement 2
![Page 14: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/14.jpg)
• RouteViews Near real-time archive of Internet routing data Multiple sites, BGP view of the world Datasets at http://archive.routeviews.org/ Nice visualization at http://bgplay.routeviews.org/ Allow us to do stuff like http://bgp.topology.net.nz
Datasets
May 27, 2015 Network Measurement 2
![Page 15: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/15.jpg)
• RIPE RIS Routing Information Service Collection of Internet Routing data by RIPE Similar and complementary to RouteViews Enables query and visualization tools https://stat.ripe.net/widget/looking-glass
Datasets
May 27, 2015 Network Measurement 2
![Page 16: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/16.jpg)
• Measure network characteristics • Determine protocol compliance • Discover support for new features
Like IPv6? DNSSEC?
• Independent data for policy reasons Network neutrality
• Economics of Internet • Security
Stories from network research
May 27, 2015 Network Measurement 2
![Page 17: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/17.jpg)
• Measuring network characteristics How the Internet looks like?
Stories
May 27, 2015 Network Measurement 2
![Page 18: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/18.jpg)
• Internet, Brazil and the World Cup http://research.dyn.com/2014/07/brazil-winning-internet/
• More football and Internet data Internet Traffic During Euro 2012 https://labs.ripe.net/Members/fergalc/internet-traffic-during-euro-2012-final-conclusions
Stories
May 27, 2015 Network Measurement 2
![Page 19: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/19.jpg)
• Protocol compliance Path MTU Discovery
http://wand.net.nz/pmtud/ https://www.usenix.org/conference/imc-05/inferring-and-debugging-path-mtu-discovery-failures
http://www.caida.org/~mjl/pubs/measuring-pmtud.pdf
Stories
May 27, 2015 Network Measurement 2
![Page 20: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/20.jpg)
• New features support IPv6
http://www.ipv6.org.nz/metrics/ https://www.google.com/intl/en/ipv6/statistics.html
http://www.worldipv6launch.org/measurements/ DNSSEC
http://stats.labs.apnic.net/dnssec http://stats.research.icann.org/dns/tld_report/
Stories
May 27, 2015 Network Measurement 2
![Page 21: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/21.jpg)
• Network Neutrality Project Glasnot from Mlab
http://www.measurementlab.net/tools/glasnost Detect if ISP is doing application-specific traffic shaping https://www.battleforthenet.com/internethealthtest/
Stories
May 27, 2015 Network Measurement 2
![Page 22: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/22.jpg)
• Economics Who’s the biggest Internet provider in the world? http://research.dyn.com/2014/01/bakers-dozen-2013-edition/
Stories
May 27, 2015 Network Measurement 2
![Page 23: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/23.jpg)
• HeartBleed vulnerability Internet wide scanners to find vulnerable sites http://heartbleed.com/
• Open Resolvers Internet wide scans to find vulnerable servers http://openresolverproject.org/
• Open NTP No need to repeat http://openntpproject.org/
• Various Internet wide scans https://scans.io/
Security
May 27, 2015 Network Measurement 2
![Page 24: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/24.jpg)
• NZRS: .nz Domain Name Registry • Part of InternetNZ: A better world through
a better Internet • Technical Research
DNS Data Analysis Internet Topology Broadband Map
Our Work
May 27, 2015 Network Measurement 2
![Page 25: Network measurement II...The speed of end points matter OS of end-points matter • End points are key! ISP X offers plans of 50Mbps download Key question: from where to where? Common](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe77655bbf568226e00f025/html5/thumbnails/25.jpg)
• Internet Topology BGP Map: http://bgp.topology.net.nz IP Map: http://ip.topology.net.nz
• DNS Data Analysis Domain popularity ranking: http://domain-rank.nzrs.net.nz/popular.html
• Broadband Map To be announced really soon
• Spark and DNSSEC validation https://nzrs.net.nz/content/dnssec-validation-spark-nz
Our work
May 27, 2015 Network Measurement 2