NMRG BoF GGF11 Hawaii June 2004
Network Measurements Research GroupCharter Discussion BoF
Chairs: Brian Tierney Richard Hughes-Jones
GGF11 Honolulu
NMRG BoF GGF11 Hawaii June 2004
Intellectual Property Policy
I acknowledge that participation in GGF11 is subject to the GGF Intellectual Property Policy. Intellectual Property Notices Note Well: All statements related to the activities of the GGF and addressed to
the GGF are subject to all provisions of Section 17 of GFD-C.1 (.pdf), which grants to the GGF and its participants certain licenses and rights in such statements. Such statements include verbal statements in GGF meetings, as well as written and electronic communications made at any time or place, which are addressed to: the GGF plenary session,
any GGF working group or portion thereof, the GFSG, or any member thereof on behalf of the GFSG, the GFAC, or any member thereof on behalf of the GFAC, any GGF mailing list, including any working group or research group list, or any other list functioning under
GGF auspices, the GFD Editor or the GWD process Statements made outside of a GGF meeting, mailing list or other function, that are clearly not intended to be
input to an GGF activity, group or function, are not subject to these provisions. Excerpt from Section 17 of GFD-C.1 Where the GFSG knows of rights, or claimed rights, the GGF
secretariat shall attempt to obtain from the claimant of such rights, a written assurance that upon approval by the GFSG of the relevant GGF document(s), any party will be able to obtain the right to implement, use and distribute the technology or works when implementing, using or distributing technology based upon the specific specification(s) under openly specified, reasonable, non-discriminatory terms. The working group or research group proposing the use of the technology with respect to which the proprietary rights are claimed may assist the GGF secretariat in this effort. The results of this procedure shall not affect advancement of document, except that the GFSG may defer approval where a delay may facilitate the obtaining of such assurances. The results will, however, be recorded by the GGF Secretariat, and made available. The GFSG may also direct that a summary of the results be included in any GFD published containing the specification. GGF Intellectual Property Policies are adapted from the IETF Intellectual Property Policies that support the Internet Standards Process.
NMRG BoF GGF11 Hawaii June 2004
Agenda for NM-RG Meeting 7 Jun 12:30
Agenda bashing Note Takers Please
Presentation of the Proposed Charter : Brian Some examples of possible study areas: Richard Possible topics for NM-RG: Martin The way forward: Discuss topics of interest: All Charter Wordsmithing and Milestones: Brian
NMRG BoF GGF11 Hawaii June 2004
The Proposed Charter
The Network Measurements Research Group (NM-RG) will focus on the relationship betweennetwork performance characteristics and Grid middleware. The objective of NM-RG is to explorewhat aspects of the network are most important to Grid middleware, and explore how the knowledge of network behaviour such as bandwidth, latency, or jitter, might be used to build network-aware middleware.
Specific topics of interest include, but are not limited to: What network characteristics are most useful to Grid Applications ? What Characteristics are Network aware Grid applications using at the moment? Are there "derived characteristics" (combinations of characteristics) that are even more useful? When can passive monitoring be used, and when must active monitoring be used? Which Grid services should collect and publish passively collected network monitoring data? How to monitor “Next Generation Grid Networks”.
The role of the NM-RG role is related to, yet quite distinct from that of the Network MeasurementWorking Group (NM-WG). The NM-WG is focused on specific mechanisms for publishing network monitoring data. The NM-RG will provide a forum for discussion of how Grid middleware might utilize such information. This is currently an open research question, and one we feel can best beaddressed by the GGF. We expect any specific conclusions reached by the NM-RG to be then standardized by the NM-WG, so some other WG.
NMRG BoF GGF11 Hawaii June 2004
NMRG BoF GGF11 Hawaii June 2004
Relations between Characteristics
Can a light-weight observation give good indication of network conditions ?
From the work of EU DataGrid WorkPackage 7 From the work of IEPM And many others …
More studies required
NMRG BoF GGF11 Hawaii June 2004
RIPE 1-way & TCP throughput UK-SARA
RIPE 1-way time ms
Sara RAL
20 Oct 01
RIPE 1-way time ms
RAL Sara
TCP Iperf + prediction
Mbit/s
UCL Sara
NMRG BoF GGF11 Hawaii June 2004
Ping & UDP throughput MAN-CERNFrom 20 Oct 01
100
80
60
40
20
PingER rtt (ms)
dl – cern
1000 byte packet
Forecast
UDPmon throughput Mbit/s
man – cern
300 * 1400 byte frames
NMRG BoF GGF11 Hawaii June 2004
iperf TCP & UDPmon throughput MAN-SARA From 20 Oct 01
Iperf TCP throughput Mbit/s
ucl – sara
262144 byte buffer
Forecast in Green
UDPmon throughput Mbit/s
man – sara
300 * 1400 byte frames
100
80
60
NMRG BoF GGF11 Hawaii June 2004
NMRG BoF GGF11 Hawaii June 2004
Application scenarios of “Network Cost Functions”
From the Work of EU DataGrid WorkPackage 7 (Tiziana Ferarri) Resource Brokerage :
Identify most suitable Computing Elements (CE) – Storage Elements (SE), according to a combined set of network criteria: packet loss minimization Round Trip Time minimization throughput maximization
Data management: Estimate of the time needed to transfer a file of known size from a source SE to a destination
SE
Aadaptive remote file access: If the file/files needed by a given application are only known at run time, the
Application can optimise access to remote files based on the dynamic selection of the most appropriate Storage Element set.
More studies required
NMRG BoF GGF11 Hawaii June 2004
The “Network Cost Functions”
Example 1:File_size (bits) * Throughput (SourceSE, DestinationSE)
Example 2: Closeness Ci,j (pli,j ,r i,j,th i,j ) Given:
ri,j: Round Trip Time between CEi and SEj Rmax: max s,t rs,t for all CEs and SEt in a given setpli,j : packet loss probability on the network path connecting CEi and SEj
’ th i,j : throughput of data transfer between CEi and SEj THmax: max s,t ths,t
– Ci,j (pli,j ,r i,j ,th i,j ) =1 if CEi is local to SEj – Ci,j (pli,j ,r i,j ,th i,j ) =0 if SE unreachable or if pli,j > P where P
is a configurable threshold– Ci,j (pli,j ,r i,j ,th i,j ) = (th i,j / THmax) * ( r
i,j / R rmax
)
where 0 < < 1 otherwise
NMRG BoF GGF11 Hawaii June 2004
Closeness Ci,j (pli,j ,r i,j,th i,j )
Fig 1: alpha = 1/2 Fig 2: alpha = 1/10
NMRG BoF GGF11 Hawaii June 2004
NMRG BoF GGF11 Hawaii June 2004
Getting Involved in NMRG
Network Measurements Working Group (NMWG) is part of the Performance and Information Systems area.
Mailing list is [email protected] Web-pages:
http://www-didc.lbl.gov/NMWGhttp://forge.gridforum.org/projects/nm-wg/
Join mailing list and participate Send an email to [email protected]
with the body "subscribe nm-wg"