passive aggressive measurement with mgrp › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 pavlos...
TRANSCRIPT
![Page 1: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/1.jpg)
1
Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2
Google1University of Maryland, College Park2
Passive Aggressive Measurementwith MGRP
![Page 2: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/2.jpg)
Choice 1: Passive Measurement
2
Observing existing trafficEfficient but inadequateCannot detect when network conditions improve
Video conference
![Page 3: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/3.jpg)
Choice 2: Active Measurement
3
Standalone measurement toolsInefficient: Bandwidth intensiveIntrusive: Probes can interfere with application data
Video conference
![Page 4: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/4.jpg)
Choice 3: Custom Active Measurement
4
Shape application data for measurementEfficient but not ModularNot Reusable: Cannot interchange algorithms
Video conference
![Page 5: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/5.jpg)
MGRPThe Measurement Manager Protocol
5
MGRP piggybacksapplication data
inside active probes
![Page 6: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/6.jpg)
MGRP Properties
• End-to-end measurement architecture– Schedules probes for transmission– Piggybacks application data on probes
• Transparent to applications• Independent of measurement algorithms• Easy to adapt existing measurement tools• Can piggyback data across applications• sec precision for probe gap
generation 6
Enables aggressive probing with passive-like overhead
![Page 7: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/7.jpg)
Outline
7
Motivation
Why do we needMGRP?
MGRP
ArchitectureImplementation
Step-by-Step Examples
Micro-Benchmarks
Piggybacking is feasibleand improves
network performance
Case Study: MediaNet
![Page 8: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/8.jpg)
MGRP in the Network Stack
8
• Layer 4 transport protocol• Implemented in the Linux kernel
![Page 9: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/9.jpg)
MGRP Sender piggybacks payload on probes
MGRP: Step by Step Example
9
![Page 10: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/10.jpg)
MGRP: Step by Step Example
10
MGRP Sender piggybacks payload on probes
![Page 11: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/11.jpg)
MGRP: Step by Step Example
11
MGRP Sender piggybacks payload on probes
![Page 12: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/12.jpg)
MGRP: Step by Step Example
12
MGRP packets traverse the network
![Page 13: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/13.jpg)
MGRP: Step by Step Example
13
MGRP Receiver reconstitutes probes and payload
![Page 14: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/14.jpg)
MGRP: Step by Step Example
14
MGRP Receiver reconstitutes probes and payload
![Page 15: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/15.jpg)
MGRP: Step by Step Example
15
![Page 16: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/16.jpg)
Outline
16
Motivation
Why do we needMGRP?
MGRP
ArchitectureImplementation
Step-by-Step Examples
Micro-Benchmarks
Piggybacking is feasibleand improves
network performance
Case Study: MediaNet
![Page 17: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/17.jpg)
Available Bandwidth Tool
• Pathload: An active measurement tool• Measures end-to-end available bandwidth• By Jain & Dovrolis at Georgia Tech
• Good candidate for our evaluation– Available bandwidth is a very useful network property– Quite accurate (even for GigE speeds, PAM05)– Non-trivial overhead (we can test probe reuse)
17
![Page 18: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/18.jpg)
Bandwidth Timeseries with Pathload
18STEP: pathload pFAST
![Page 19: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/19.jpg)
STEP: pathload pFAST
Effective Probe Overhead is Minimal
19
![Page 20: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/20.jpg)
Pathload Completes Faster
20
72%
45%
66%
23%
STEP: pathload
![Page 21: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/21.jpg)
Pathload Completes More Often
21
95%
77%
66%
52%
STEP: pathload
![Page 22: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/22.jpg)
Benefits of MGRP
• Saves bandwidth– Reduces measurement overhead– Fewer probes compete with application data
• Allows measurement tools to:– Send more probes– Send probes continuously– Complete faster and be more accurate
22
![Page 23: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/23.jpg)
Lessons Learned
• Measurement tools need to be adjusted– Must account for piggybacked traffic
• Blind piggybacking can be harmful– Pigybacked packets share fate of probes– Some probes have high loss risk
• Long MGRP data buffers may affect TCP– Need to keep latency small fraction of RTT
23
![Page 24: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/24.jpg)
Outline
24
Motivation
Why do we needMGRP?
MGRP
ArchitectureImplementation
Step-by-Step Examples
Micro-Benchmarks
Piggybacking is feasibleand improves
network performance
Case Study: MediaNet
![Page 25: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/25.jpg)
Case Study: MediaNet Overlay
25
Overlaynode
Sender Receiver
(a) MediaNet can modify the streaming rate
• Streams MPEG video at different rates
• Overlay nodes report if they can send at desired rate
• Pathload continuously monitors the paths
Frame Type
Frame Size
(bytes)
Frequency (frames/sec)
High Rate
(Kbps)
MediumRate
(Kbps)
LowRate
(Kbps)I 13500 2
1200700
200
P 7625 8 Dropped
B 2850 20 Dropped Dropped
![Page 26: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/26.jpg)
Without probes MediaNet cannot react
26
![Page 27: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/27.jpg)
But probes interfere without MGRP
27
![Page 28: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/28.jpg)
MGRP improves the stream quality
28
![Page 29: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/29.jpg)
MGRP Improves MediaNetThe aggregate MPEG streaming rate is higher
29
Experiment Runs AverageRun Duration (sec)
Aggregate Streaming Rate (Mbps)
Improvement over
non-MGRPOriginal MediaNet(mgrpOFF/pOFF) 14 337 1.84
PathloadpSLOW
mgrpOFF 22 336 1.96
mgrp10 32 336 2.05 4.40%
PathloadpFAST
mgrpOFF 10 335 1.86
mgrp10 22 336 2.28 22.52%
Related to the quality of the playback
![Page 30: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/30.jpg)
MGRP Improves MediaNetThe number of decoded MPEG frames increases
30
Experiment Runs AverageRun Duration (sec)
Aggregate Frames per
Second
Improvement over
non-MGRPOriginal MediaNet(mgrpOFF/pOFF) 14 337 30.11
PathloadpSLOW
mgrpOFF 22 336 39.58
mgrp10 32 336 43.42 9.69%
PathloadpFAST
mgrpOFF 10 335 39.10
mgrp10 22 336 52.08 33.19%
Directly affects the quality of the playback
![Page 31: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/31.jpg)
How MGRP stands outMGRP is a new protocol that piggybacks application
data inside probes.
Piggybacking reduces bandwidth wasted by probes and enables measurement tools to be more
aggressive, faster and more accurate.
Any measurement algorithm can now be written as if active, but implemented as passive.
MGRP is generic and is transparent to applications31
![Page 32: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/32.jpg)
32
Questions?
![Page 33: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/33.jpg)
33
Additional Slides
![Page 34: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/34.jpg)
MGRP: Next Steps
• Add support for:– ICMP packets– TTL limited packets
• Automatically set piggybacking ratio
• Enable one-way probing with remote timestamp collection
34
![Page 35: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/35.jpg)
MGRP Packet Format
35
MGRP Header MGRP Packet
![Page 36: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/36.jpg)
MGRP Piggybacking
36
![Page 37: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/37.jpg)
Characteristics of Active Probes
• Have varying sizes• Need precise inter-packet gaps• Are largely empty padding• Usually sent in groups• More probes: better/faster results
• Can probing be aggressive without the overhead?
37
![Page 38: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/38.jpg)
Piggybacking requires that we adjust Pathload
38
![Page 39: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/39.jpg)
Piggybacking reduces the probing overhead
39STEP: probe train pk2
![Page 40: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/40.jpg)
Effective Probe Overhead is Minimal
40STEP: probe train pk2
![Page 41: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/41.jpg)
Piggybacking may be too Aggressive
41WEB: pathload pFAST
![Page 42: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/42.jpg)
Too many piggybacked packets get lost
42WEB: pathload pFAST
![Page 43: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/43.jpg)
Solution: Reduce the Piggybacking Ratio
43WEB: pathload pFAST
![Page 44: Passive Aggressive Measurement with MGRP › ~pavlos › papers › sigcomm-mgrp-slides.pdf1 Pavlos Papageorge1,2, Justin McCann2, Michael Hicks2 Google1 University of Maryland, College](https://reader034.vdocument.in/reader034/viewer/2022042408/5f22cbbe1d570534cf4b0338/html5/thumbnails/44.jpg)
So that High Risk Probes are Avoided
44WEB: pathload pFAST