internet2 e2epi end-2-end performance initiative jeff w. boote internet2 29 may 2006

Internet2 E2EPIEnd-2-End Performance Initiative

Jeff W. BooteInternet2

29 May 2006

2 Jeff W. Boote

Vision: Performance Information is …

• Available•People can find it (Discovery)• “Community of trust” allows access across

administrative domain boundaries (AA)

• Ubiquitous•Widely deployed (Paths of interest covered)•Reliable (Consistently configured correctly)

• Valuable•Actionable (Analysis suggests course of action)•Automatable (Applications act on data)

3 Jeff W. Boote

Getting There: Build & Empower the Community

Decouple the Problem Space:•Analysis and Visualization•Performance Data Sharing•Performance Data GenerationGrow the Footprint:•Clean APIs and protocols between each layer•Widespread deployment of measurement infrastructure•Widespread deployment of common performance measurement tools

Analysis & Visualization

Measurement Infrastructure

Performance Tools Performance

Tools

Analysis & Visualization

Measurement Infrastructure

API

API

4 Jeff W. Boote

Result: No more mystery …

• Increase network awareness•Set user expectations accurately

• Reduce diagnostic costs•Performance problems noticed early •Performance problems addressed efficiently•Network engineers can see & act outside their turf

• Transform application design• Incorporate network intuition into application

behavior

5 Jeff W. Boote

Immediate Game-plan:

• Internet2 is leveraged to help provide diagnostic information for “backbone” portion of problem•Create *some* diagnostic tools•Make Abilene data as public as is reasonable

• Work on efforts to more widely make performance data available (perfSONAR)•Contribute to ‘base’ development• Integrate ‘our’ diagnostic tools as ‘good’ example

MP/MA services

6 Jeff W. Boote

BWCTL (Bandwidth Controller)

• What is it?A resource allocation and scheduling daemon for

arbitration of iperf tests

• Typical Solution•Run “iperf” or similar tool on two endpoints and hosts

on intermediate paths

• Typical road blocks•Need permissions on all systems involved•Need to coordinate testing with others•Need to run software on both sides with specified test

parameters

7 Jeff W. Boote

BWCTL: 3-Party Flow Diagram

bwctlclient

bwctld(request broker)

requests/

results

requests/results

verify time/

return resultsbwctld

(peer agent)

teststream

iperf(test process)

bwctldresource broker

(master daemon)initialconnection

initial

connection

resoure

requests

bwctld(request broker)

bwctld(peer agent)

iperf(test process)

bwctldresource broker

(master daemon)

reso

urce

requ

ests

8 Jeff W. Boote

OWAMP: One-Way Active Measurement Protocol

• What is it?• Measures one-way latency: 1-way ping• Control connection used to broker test

request based upon policy restrictions and available resources. (Bandwidth/disk limits)

• Specification• http://tools.ietf.org/wg/ippm/draft-ietf-ippm-

owdp/draft-ietf-ippm-owdp-14.txt

9 Jeff W. Boote

OWAMP Flow Diagram

Server

owpingclient

[Control]

Requests/

Results

owampd[Resource Broker]

Initialconnection

owampd[Control]

OWD TestEndpoint

OWD TestEndpoint

Requests/

Results

Client

10 Jeff W. Boote

Thrulay Overview

• Network capacity and delay tester• Same class of tools as iperf, netperf, nettest, nuttcp, ttcp,

etc.• Unique features not found in other tools:

• TCP: measures round-trip delay along with goodput• UDP: measures:

• One-way delay, with quantiles• Packet loss• Packet duplication• Reordering

• UDP: ability to send precisely positioned true Poisson streams (microsecond errors in sending times)

• Human and machine-readable (ready to be fed to gnuplot)

11 Jeff W. Boote

Thrulay Update

• New release v0.8• Tests with multiple TCP streams• Set DSCP (a.k.a. first 6 bits of the TOS byte)• Report MTU and/or MSS (whichever the OS makes available)• More UDP statistics: duplication, reordering, quantiles of delay• SPARC/Solaris support• Mac OS X support• IPv6 support• Non-busy-waiting UDP mode (less precise, but can run more

concurrent tests)• Documentation: manual pages have been added• Basic client authorization based on IP address• Integration of TSC timekeeping projects for faster and more

precise timestamping

12 Jeff W. Boote

NDT: Network Diagnostic Tool

• Web100 enhanced server handles testing and diagnostic services

• Java based and command line clients allows testing from any client (local or remote)

• Performance and configuration faults reported back to client

• Drill-down functions provide more details & error reporting capabilities

• Grant from NIH/NLM to explore duplex mismatch detection

13 Jeff W. Boote

NDT Flow Diagram

Client

Web

Browser

Java

Applet

NDT - Server

Web

Server

Testing

Engine

Child

Test Engine

Spawn child

Well KnownNDT Server

Web RequestRedirect msgWeb Page Request

Web page response

Test Request

Control Channel

Specific test channels

14 Jeff W. Boote

Bulk Transport

• Build a library / tool for bulk transport that does not require kernel level modifications yet achieves the performance of such

• VFER library•Congestion control hooks• Implements loss-based congestion control•Working on delay-based version

• File transfer utility•An initial version demoed

15 Jeff W. Boote

Everything we work on is available

• Tools are open source, supported, well-documented

• BWCTL/Iperf, OWAMP, NDT are deployed across Abilene backbone and at many partners

• You can:•See ongoing measurement results at the

Abilene Observatory•Test to/from the Abilene backbone

16 Jeff W. Boote

Network Performance Measurement Workshops

•Example Course Materials:• http://e2epi.internet2.edu/npw/presentations.html

Goals:•Grow installed base of BWCTL/Iperf, OWAMP, and

NDT at GigaPoP and regional campuses.• http://e2epi.internet2.edu/pipes/pmp/pmp-dir.html

•Begin integration into IT support processes.•Create an installed base for perfSONAR

deployment.•Give each participant tool-specific cookbooks.

17 Jeff W. Boote

Network Performance MeasurementWorkshop Locations and Dates

•Completed• SOX / GaTech (03/05)• CENIC / UCLA (06/05)• JT – Vancouver (07/05)• OARNet / OSU (09/05)• MAGPI / FMM (09/05)• MAX / College Park (12/05)• APAN (01/06)• JT - Albuquerque (02/06)• MERIT (02/06)• Columbia / NYSERNet

(04/06)• University of Virginia

(04/06)

•Planned• Wisconsin (07/06)

•Under Consideration• Alaska, …

18 Jeff W. Boote

Collaboration

• Working Groups• Bulk Transport (transport.internet2.edu)

• GGF Network Measurement (nmwg.internet2.edu)

• perfSONAR (www.perfsonar.net)

• Funded Research• “Bridging the Gap” (NSF)• Network Measurement for International Connections

• Google Summer of Code• 2005 very successful• 2006 just beginning

19 Jeff W. Boote

Current and Future work

• LHC OWAMP measurements• AMI/pSonar MA interface (perl)

• AMP MA interface (Ga Tech)• Light Path Control-plan tie-in (Dragon project)

• Do more paths need to be provisioned?• The control-plane issues are similar - can pS services be

leveraged?

20 Jeff W. Boote