![Page 1: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/1.jpg)
Internet2 E2EPIEnd-2-End Performance Initiative
Jeff W. BooteInternet2
29 May 2006
![Page 2: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/2.jpg)
2 Jeff W. Boote
Vision: Performance Information is …
• Available•People can find it (Discovery)• “Community of trust” allows access across
administrative domain boundaries (AA)
• Ubiquitous•Widely deployed (Paths of interest covered)•Reliable (Consistently configured correctly)
• Valuable•Actionable (Analysis suggests course of action)•Automatable (Applications act on data)
![Page 3: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/3.jpg)
3 Jeff W. Boote
Getting There: Build & Empower the Community
Decouple the Problem Space:•Analysis and Visualization•Performance Data Sharing•Performance Data GenerationGrow the Footprint:•Clean APIs and protocols between each layer•Widespread deployment of measurement infrastructure•Widespread deployment of common performance measurement tools
Analysis & Visualization
Measurement Infrastructure
Performance Tools Performance
Tools
Analysis & Visualization
Measurement Infrastructure
API
API
![Page 4: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/4.jpg)
4 Jeff W. Boote
Result: No more mystery …
• Increase network awareness•Set user expectations accurately
• Reduce diagnostic costs•Performance problems noticed early •Performance problems addressed efficiently•Network engineers can see & act outside their turf
• Transform application design• Incorporate network intuition into application
behavior
![Page 5: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/5.jpg)
5 Jeff W. Boote
Immediate Game-plan:
• Internet2 is leveraged to help provide diagnostic information for “backbone” portion of problem•Create *some* diagnostic tools•Make Abilene data as public as is reasonable
• Work on efforts to more widely make performance data available (perfSONAR)•Contribute to ‘base’ development• Integrate ‘our’ diagnostic tools as ‘good’ example
MP/MA services
![Page 6: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/6.jpg)
6 Jeff W. Boote
BWCTL (Bandwidth Controller)
• What is it?A resource allocation and scheduling daemon for
arbitration of iperf tests
• Typical Solution•Run “iperf” or similar tool on two endpoints and hosts
on intermediate paths
• Typical road blocks•Need permissions on all systems involved•Need to coordinate testing with others•Need to run software on both sides with specified test
parameters
![Page 7: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/7.jpg)
7 Jeff W. Boote
BWCTL: 3-Party Flow Diagram
bwctlclient
bwctld(request broker)
requests/
results
requests/results
verify time/
return resultsbwctld
(peer agent)
teststream
iperf(test process)
bwctldresource broker
(master daemon)initialconnection
initial
connection
resoure
requests
bwctld(request broker)
bwctld(peer agent)
iperf(test process)
bwctldresource broker
(master daemon)
reso
urce
requ
ests
![Page 8: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/8.jpg)
8 Jeff W. Boote
OWAMP: One-Way Active Measurement Protocol
• What is it?• Measures one-way latency: 1-way ping• Control connection used to broker test
request based upon policy restrictions and available resources. (Bandwidth/disk limits)
• Specification• http://tools.ietf.org/wg/ippm/draft-ietf-ippm-
owdp/draft-ietf-ippm-owdp-14.txt
![Page 9: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/9.jpg)
9 Jeff W. Boote
OWAMP Flow Diagram
Server
owpingclient
[Control]
Requests/
Results
owampd[Resource Broker]
Initialconnection
owampd[Control]
OWD TestEndpoint
OWD TestEndpoint
Requests/
Results
Client
![Page 10: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/10.jpg)
10 Jeff W. Boote
Thrulay Overview
• Network capacity and delay tester• Same class of tools as iperf, netperf, nettest, nuttcp, ttcp,
etc.• Unique features not found in other tools:
• TCP: measures round-trip delay along with goodput• UDP: measures:
• One-way delay, with quantiles• Packet loss• Packet duplication• Reordering
• UDP: ability to send precisely positioned true Poisson streams (microsecond errors in sending times)
• Human and machine-readable (ready to be fed to gnuplot)
![Page 11: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/11.jpg)
11 Jeff W. Boote
Thrulay Update
• New release v0.8• Tests with multiple TCP streams• Set DSCP (a.k.a. first 6 bits of the TOS byte)• Report MTU and/or MSS (whichever the OS makes available)• More UDP statistics: duplication, reordering, quantiles of delay• SPARC/Solaris support• Mac OS X support• IPv6 support• Non-busy-waiting UDP mode (less precise, but can run more
concurrent tests)• Documentation: manual pages have been added• Basic client authorization based on IP address• Integration of TSC timekeeping projects for faster and more
precise timestamping
![Page 12: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/12.jpg)
12 Jeff W. Boote
NDT: Network Diagnostic Tool
• Web100 enhanced server handles testing and diagnostic services
• Java based and command line clients allows testing from any client (local or remote)
• Performance and configuration faults reported back to client
• Drill-down functions provide more details & error reporting capabilities
• Grant from NIH/NLM to explore duplex mismatch detection
![Page 13: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/13.jpg)
13 Jeff W. Boote
NDT Flow Diagram
Client
Web
Browser
Java
Applet
NDT - Server
Web
Server
Testing
Engine
Child
Test Engine
Spawn child
Well KnownNDT Server
Web RequestRedirect msgWeb Page Request
Web page response
Test Request
Control Channel
Specific test channels
![Page 14: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/14.jpg)
14 Jeff W. Boote
Bulk Transport
• Build a library / tool for bulk transport that does not require kernel level modifications yet achieves the performance of such
• VFER library•Congestion control hooks• Implements loss-based congestion control•Working on delay-based version
• File transfer utility•An initial version demoed
![Page 15: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/15.jpg)
15 Jeff W. Boote
Everything we work on is available
• Tools are open source, supported, well-documented
• BWCTL/Iperf, OWAMP, NDT are deployed across Abilene backbone and at many partners
• You can:•See ongoing measurement results at the
Abilene Observatory•Test to/from the Abilene backbone
![Page 16: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/16.jpg)
16 Jeff W. Boote
Network Performance Measurement Workshops
•Example Course Materials:• http://e2epi.internet2.edu/npw/presentations.html
Goals:•Grow installed base of BWCTL/Iperf, OWAMP, and
NDT at GigaPoP and regional campuses.• http://e2epi.internet2.edu/pipes/pmp/pmp-dir.html
•Begin integration into IT support processes.•Create an installed base for perfSONAR
deployment.•Give each participant tool-specific cookbooks.
![Page 17: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/17.jpg)
17 Jeff W. Boote
Network Performance MeasurementWorkshop Locations and Dates
•Completed• SOX / GaTech (03/05)• CENIC / UCLA (06/05)• JT – Vancouver (07/05)• OARNet / OSU (09/05)• MAGPI / FMM (09/05)• MAX / College Park (12/05)• APAN (01/06)• JT - Albuquerque (02/06)• MERIT (02/06)• Columbia / NYSERNet
(04/06)• University of Virginia
(04/06)
•Planned• Wisconsin (07/06)
•Under Consideration• Alaska, …
![Page 18: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/18.jpg)
18 Jeff W. Boote
Collaboration
• Working Groups• Bulk Transport (transport.internet2.edu)
• GGF Network Measurement (nmwg.internet2.edu)
• perfSONAR (www.perfsonar.net)
• Funded Research• “Bridging the Gap” (NSF)• Network Measurement for International Connections
• Google Summer of Code• 2005 very successful• 2006 just beginning
![Page 19: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/19.jpg)
19 Jeff W. Boote
Current and Future work
• LHC OWAMP measurements• AMI/pSonar MA interface (perl)
• AMP MA interface (Ga Tech)• Light Path Control-plan tie-in (Dragon project)
• Do more paths need to be provisioned?• The control-plane issues are similar - can pS services be
leveraged?
![Page 20: Internet2 E2EPI End-2-End Performance Initiative Jeff W. Boote Internet2 29 May 2006](https://reader030.vdocument.in/reader030/viewer/2022032806/56649efb5503460f94c0d64f/html5/thumbnails/20.jpg)
20 Jeff W. Boote