fog cloud caching at network edge via local hardware awareness spaces
TRANSCRIPT
via Local Hardware Awareness Spaces
Marat Zhanikeev [email protected] maratishe.github.io
2016/06/27@WEC@ICDCS@Nara
Fog Cloud Caching
PDF: bit.do/160627
at Network Edge
#LHAP #localhardware
#resourcediscovery
#caching #MiniCache
#fog #clouds #cdn
#networkedge
.
Cloudification and LHAP
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 2/21...
2/21
.
LHAP : Terminology?
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 3/21...
3/21
.
LHAP(1) Cloudification
WiFi
Scale/size of cloudified items
Timeline
Now (2016)
Probably should not cloudify
Should definitely cloudify Data
Centers Racks IoV > VC
Desktop
Notebook
APs, Beacons
Smartphone Sensor
IoT Delegated networking
Network core Network
edge
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 4/21...
4/21
.
LHAP(2) Local Hardware Awareness
Local hardware
Xen (hypervisor)
Virtual Machine
User Apps
Physical Machine (PM)
Tools …
Virtual Machine
App
Tools
Global Network
HDD SSD
Control Layer
…
Virtual Machine
App
API Layer
Other local hardware
Resource Discovery
API Connection
Cloud
platform
Virtual
machines
Direct hardware access
Local Hardware Awareness Platform (LHAP)
• LHAP [la:p] : LocalHardware AwarenessPlatform 04
• API Layer: resourcediscovery, interfaces, APIsfor VMs/containers
• Control Layer:concurrency control,quotas, billing/accounting,etc.
04 M.Zhanikeev+0 "A Cloud Visitation Platform to Facilitate Cloud Federation and Fog Computing" IEEE Computer (2015)
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 5/21...
5/21
.
LHAP(3) Push vs Pull Deploys• if same provider for box + service, then pull is suitable
• extremely heterogeneous, open federations should go for register/push
Cloud Visitation Platform
App App App …
Pull-Based Installation (of Apps)
End User
Device Provider 3rd Party
Service
Local services
One Cloud Cloud Visitation Platform
App App App …
Cloud/device Owner
3rd Party Service Federated
Clouds
Local services
Federated Cloud
Manager
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 6/21...
6/21
.
LHAP(4) 3 Deploy Modes
1. 3rd party installs the neccesarytools and ships (migrates) theVM
2. VM comes bare, tools areinstalled locally
3. 3rd party selects from a localset of ready-made VM+tools options◦ good if you only want to run a
simple app, not needing a fullerenvironment (a greybox?) 10
10 F.Manco+2 "Towards the super fluid cloud" ACM SIGCOMM (2014)
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 7/21...
7/21
.
LHAP(5) Feature Comparison
• MiniCache08 is the closest rival, but has many flaws by comparison
• LHAP offers several unique features, not found elsewhere
ResourceDiscovery
Multi-VM
Multi-PM
Generics (any
resource) Generics(VM type)
Impl . form
Load balancing (quota,
queue, etc.)
Traditional NO N/A N/A N/A N/A N/A N/A
MiniCache NO YES NO NO (storage only)
MiniOS only driver NO
LHAP (proposed) YES YES YES YES ANY Web
API YES
08 S.Kuenzer+3 "Towards minimalistic, virtualized content caches with minicache" 13th HotMiddlebox (2013)
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 8/21...
8/21
.
LHAP(6) A "Simply Put" Taxonomy
CDN on Federated Clouds (proposal)
P4P, ISP-side Caching (static popular content)
Interactivity / Update frequency
Popularity M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 9/21
...
9/21
.
Modeling
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 10/21...
10/21
.
Service Model (1) Detailed
CDN
Main
many
Manager
Storage Large
Federation, fog clouds VM
Cache 1 Cache 2
Manage content
CDN Traffic (End Users)
many
Cloud
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 11/21...
11/21
.
Service Model (2) Simplified
many
Large/Core
Small/Fog Cloud(s) VM
Cache 1 Cache 2 many
Cloud Original Content
Scale (core to edge)
Local traffic
End Users
Network Provider
Replica (P4P, etc.)
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 12/21...
12/21
.
Hotspot-y Input (1) Theory
0 20 40 60 80 100
Decreasing order
0
0.35
0.7
1.05
1.4
1.75
2.1
2.45
2.8
log(
val
ue)
Class AClass BClass CClass DClass E
• Hotspot Distribution 07:normal + popular + hot/flash items
• modeled as Dirichlet parallelstreams with Bread-Stick (BS)random unit
• key point : number of hotitems, since they causeFlash Events
07 M.Zhanikeev+1 "Popularity-Based Modeling of Flash Events in Synthetic Packet Traces" IEICE CQken (2012)
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 13/21...
13/21
.
Hotspot-y Input (2) Actual Model
0 10 20 30 40 50Random order of items
0
0.4
0.8
1.2
1.6
2
2.4
2.8
3.2
3.6
log(
1 +
pop
ular
ity)
Hot stateFlash state
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 14/21...
14/21
.
Caching Logic• common logic in CDN 02: keep only the top-N popular content• LHAP feature: the large Cache 2 range for for on-site (shared across VMs)
caching◦ lazy caching -- new content is downloaded by individual VMs (Cache 1) but end up
in Cache 2 as well
Popularity
Ordered list (decreasing popularity)
Cache 1 Cache 2 Main (remote) storage
02 S.Sivasubramanian+3 "Analysis of Caching and Replication Strategies for Web Applications" IEEE Internet Computing (2007)
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 15/21...
15/21
.
Analysis
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 16/21...
16/21
.
Results
0.04 0.08 0.12 0.16 0.2Cache 1 volume (ratio of total content)
3.85
3.95
4.05
4.15
4.25
4.35
4.45
log(
tran
sfer
cou
nt)
0.05/0.1 0.05/0.25 0.1/0.2 0.1/0.4 0.2/0.4 0.2/1.0
0
2
4
6
8
10
12
14
16
18
Ratio
of i
nner
/out
er fi
le tr
ansf
ers
Cache configuration (Cache 1 / Cache2 ratios)
3 * varianceband
Pre-saturation
Totalsaturation
Cache 1 at 0.1
TraditionalPerformance(Cache 2 does not exist)
Fog Caching Performance
Inner = outer line
• simple view : proposed methodnear-saturates at 0.1-to-0.2 ratio ofCaches 1-to-2
• vertical scales are different because theeffect is huge!
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 17/21...
17/21
.
Wrapup : the Bigger Picture
• current LHAP prototypes are developed as an add-on on top of XCP1.6 (yum
helps with dependencies)
• working on in-VM APIs as a step towards Docker containers
Large Cloud
Small Cloud
Small Cloud
CDN Manager
CDN
Local clients • load balancing inheterogeneous clouds
• how heterogenous?how about smallstore-and-streamcloudlets running onwirelessly grouped carnavigators? (vehicular groupconnect in
other papers)
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 18/21...
18/21
.
That’s all, thank you ...
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 19/21...
19/21
.
LHAP vs MiniCache (details)
Local hardware
Virtual Machine
Cloud Platform (Xen)
App App App …
Multitenant
environment
Physical Machine (PM)
Tools
API Layer Control Layer
Local Hardware Awareness Platform (LHAP)
…
Virtual Machine
App
Tools …
Virtual Machine
App Virtual Machine
App App App …
Global network (to Internet)
In-box network
…
MiniOS
App
SSD
Operating System
Virtual Machine
App App App …
Multitenancy impossible
Physical Machine (PM)
Cloud Platform (Xen)
Operating System
Global network (to Internet)
HDD Local Network
Global network (to Internet)
Physical Machine (PM)
Cloud Platform (Xen) Operating System
DtL: Direct to Local
Local hardware
SSD HDD
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 20/21...
20/21
.
LHAP Boxes
• LHAP box feels equally at ease withresources on LAN and those runningon VMs within the box itself
• working on the beacon and WiFiDirect versions for IoT as well
Physical Device
LHAP
VM VM Con. Con. Con.
SWITCH OUT IN
Storage
Sensors
Hadoop Isolation
Non-CVP part
Physical Device
LHAP
VM VM Con. Con. Con.
HUB
WiFi
Wireless users
Wired users Wireless
AP
Storage
Sensors
…
WiFi
Wireless users
Wireless AP
Physical Device
LHAP
VM VM Con. Con. Con.
Storage
Sensors
…
Beacon
WiFi AP WiFi Client
P2P WiFi
M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 21/21...
21/21