analysis of web caching architectures: hierarchical and distributed caching pablo rodriguez,...
Post on 15-Jan-2016
232 views
TRANSCRIPT
![Page 1: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/1.jpg)
Analysis of Web Caching Architectures: Hierarchical and Distributed Caching
Pablo Rodriguez, Christian Spanner, and Ernst W.
BiersackIEEE/ACM TRANSACTIONS ON
NETWORKINGVOL. 9, NO. 4, Auguest 2001
![Page 2: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/2.jpg)
Abstract Caching architectures
Hierarchical Distributed Hybrid
Analytical models Performance
Connection time Transmission time Total latency Bandwidth Cache load
![Page 3: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/3.jpg)
Caching architectures Hierarchical caching
Institutional cache Intermediate cache National cache
Distributed caching Institutional cache
![Page 4: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/4.jpg)
Network topology
![Page 5: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/5.jpg)
The model Network model
Full O-ary tree Document model
Request – Poisson distribution Popularity - Zipf distribution
Hierarchical caching Caches are placed at the access points
between two different networks. Distributed caching
Caches are placed at the institutional network.
![Page 6: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/6.jpg)
Network model
![Page 7: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/7.jpg)
Document model
1N
1
,
,
1 ,
1
ison distributi Zipf theskewed how determineshat constant t a is
documentpopular most th theof raterequest theis
documents N allfor cache nalinstitutioan from raterequest theis
i
IiI
iI
N
i iII
I
i
i
i
![Page 8: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/8.jpg)
Properties and limitations of the model O-ary trees are good models. Modifying the height or the number of
tiers of the tree can easily model other networks.
The model assumes homogeneous client communities.
Heterogeneous client communities can be easily modeled.
Simulations results in this paper should be considered as relative results.
![Page 9: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/9.jpg)
Connection time Depend on the number of network links
from the client to the cache.
delayn propagatio hop-per the:
travelsidocument for request a that links :
tree theof level the:
noderoot andserver abetween links :
nodesroot between links :
d
L
l
z
H
i
![Page 10: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/10.jpg)
Connection time (cont’d)
zHHHli
hc llLPdTE
2,2,,0
14
H
lii
dc zHzHLPdllLPdTE
2
0
1224124
Distance of transmission
A request first travels up then down
TCP three-way handshake
Server
![Page 11: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/11.jpg)
Transmission time Caches operate in a cut-through mode.
zH
lii
dt
dt
zHHHlii
ht
ht
lLPlLTETE
lLPlLTETE
2
0
2,2,,0
|
|
lNlIld
l
NIH
RIl
IIl
I
hl
hithithitO
zHlHhitO
HlHhitO
HlhitO
l
1
22 ,1
,1
0 ,1
0 ,
2
Request
rate
![Page 12: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/12.jpg)
Comparison O = 4 H = 3 z = 10 N = 250 million
![Page 13: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/13.jpg)
Connection time
![Page 14: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/14.jpg)
Network traffic at every tree level
![Page 15: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/15.jpg)
Expected transmission time
(a) Non-congested national network
(b) Congested national network
![Page 16: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/16.jpg)
Total latency
![Page 17: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/17.jpg)
Heterogeneous client communities
(a) Expected connection time
(b) Expected transmission time
![Page 18: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/18.jpg)
Bandwidth usage The expected number of links traversed to
distribute one packet to the clients.
(a) Regional network
(b) National network
![Page 19: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/19.jpg)
Cache load The filtered request rate
![Page 20: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/20.jpg)
Disk space The average Web document size S
times the average number of copies present in the caching infrastructure.
The average number of copies present in the caching infrastructure can be calculated using the probability that a new document copy is created at every cache level.
![Page 21: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/21.jpg)
Disk space (cont’d)
![Page 22: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/22.jpg)
A hybrid caching scheme A certain number of caches k cooperate
at every network level. When a document cannot be found in a
cache The cache checks if the document resides in
any of the cooperating caches. If multiple caches have a document copy, the
neighbor cache with the lowest latency is selected.
Otherwise, the request is then forwarded to the immediate parent cache or to the server.
![Page 23: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/23.jpg)
Connection time
![Page 24: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/24.jpg)
Connection time (cont’d)
![Page 25: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/25.jpg)
Transmission time
![Page 26: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/26.jpg)
Transmission time (cont’d)
![Page 27: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/27.jpg)
Total latency
![Page 28: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/28.jpg)
Bandwidth usage
(a) National network
(b) Regional network
![Page 29: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/29.jpg)
Cache load
![Page 30: Analysis of Web Caching Architectures: Hierarchical and Distributed Caching Pablo Rodriguez, Christian Spanner, and Ernst W. Biersack IEEE/ACM TRANSACTIONS](https://reader036.vdocument.in/reader036/viewer/2022062406/56649d4c5503460f94a2a61b/html5/thumbnails/30.jpg)
Conclusions Hierarchical caching architecture
Reduce the expected distance to hit a document Decrease the bandwidth usage Reduce the administrative concerns Need powerful intermediate caches or load-
balancing algorithms Distributed caching architecture
Large network distances High bandwidth usages Administrative issues
Hybrid scheme is the best