how to build a generic fog cloud box

PDF: http://bit.do/150609 Screencast: youtube.com/c/MaratZhanikeev

.

Clouds: Big Paradigm Shifts

1. Hybrid Clouds 02 ➔ 　Federated/Fog Clouds 05

◦ heterogeneous environments is the biggest issue 04

2. Live Migration ➔ Population Management 03

3. the blackbox of virtualization ➔ Local Hardware Awareness 01

◦ this one actually breaks the existing practice in clouds

02 K.Keahay+4 "Infrastructure Outsourcing in Multi-Cloud Environment" 8th Open Cirrus Summit (2012)

05 "Fog Computing, Ecosystem, Architecture and Applications" Cisco RFP (2014)

04 "Chameleon project" https://www.chameleoncloud.org (2014)

03 myself+0 "Multi-Source Stream Aggregation in the Cloud" Wiley Book on Advanced Content Delivery (2014)

01 myself+0 "A Cloud Visitation Platform to Facilitate Cloud Federation and Fog Computing" IEEE Computer (2015)

M.Zhanikeev -- [email protected] How to Build a Generic Fog Cloud Box -- http://bit.do/150609 - 2/21...

2/21

.

(1) Fog and Federated Clouds• Cisco CFP 05

• Federated/Fog Clouds require a brand new viewpoint

05 "Fog Computing, Ecosystem, Architecture and Applications" Cisco RFP (2014)


3/21

.

(2) VM/Container Populations• example of CDN 03, clouds can replace P2P networks with higher reliability

VMpopulation

CurrentSources

ServiceProvider

(SP)

Tracker

ServiceProvider

(SP)

Parentpeers

P2Pstreaming

Cloudstreaming

ClientClient

03 myself+0 "Multi-Source Stream Aggregation in the Cloud" Wiley Book on Advanced Content Delivery (2014)


4/21

.

(3) Local Hardware Awareness• traditional: only the Main Storage -- same for offload in hybrid clouds 02

• required: VMs should be able to discover and use local resources --again, the CDN case

CDN

Main

many

Manager

Storage Large

Federation, fog clouds VM

Cache 1 Cache 2

Manage content

CDN Traffic (End Users)

many

Cloud

02 K.Keahay+4 "Infrastructure Outsourcing in Multi-Cloud Environment" 8th Open Cirrus Summit (2012)


5/21

.

LHA [la:]


6/21

.

Cloud Visitation Platform

• a build-up on top of existingcloud platforms (I use xen)

• APIs: split between VMtools and RESTful APIs

• Interfaces: genericabstraction of hardwarefunctionality

• key feature: LocalHardware Awareness(LHA [la:])

• more details in 01

Storage Sensors


Virtual Machine


App App App …

API

…

Multi-

Tenancy

Physical Device

…

Billing, Fairness

Generics, Resilience

Application Specifics

BigData Interfaces

… Virtual Machine

App

Container API

Other local resource

01 myself+0 "A Cloud Visitation Platform to Facilitate Cloud Federation and Fog Computing" IEEE Computer (2015)


7/21

.

LHAP vs MiniCache

Local hardware

Virtual Machine

Cloud Platform (Xen)

App App App …

Multitenant

environment

Physical Machine (PM)

Tools

API Layer Control Layer

Local Hardware Awareness Platform (LHAP)

…

Virtual Machine

App

Tools …

Virtual Machine

App Virtual Machine

App App App …

Global network (to Internet)

In-box network

Fig1a: Conventional Platform

…

MiniOS

App

SSD

Operating System

Virtual Machine

App App App …

Multitenancy impossible


Fig1b: Mini Cache

Cloud Platform (Xen)

Operating System


HDD Local Network



Fig1c: LHAP (proposed)

Cloud Platform (Xen) Operating System

DtL: Direct to Local

Local hardware

SSD HDD


8/21

.

Tired? Too Much Information?


9/21

.

Cloudification Basics


10/21

.

Cloudification Curve

WiFi

Sca

le/s

ize o

f clo

udifi

edite

ms

Timeline

Mid-2015

Probablyshould not

cloudify

Should definitely cloudify

DataCenters

Racks IoV > VC

Desktop

APs,Beacons

Smartphone

Sensor

IoTDelegatednetworking


11/21

.

Level 1: Federation Box

Physical Device

CVP

VM VM Con. Con. Con.

SWITCH OUT IN

Storage

Sensors

Hadoop Isolation

Non-CVP part


12/21

.

Level 1: Federation Box (2)• Possible? yes, easily, already have CVP/LHAP prototype built on topof XCP1.6

• CVP/LHAP is generic, you can use it for any hardware

Physical Device

CVP


SWITCH OUT IN

Storage

Sensors

Hadoop Isolation

Non-CVP part


13/21

.

Level 2: Fog/Pocket Box

Physical Device

CVP


HUB

WiFi

Wireless users

Wired users Wireless

AP Storage

Sensors

…


14/21

.

Level 2: Fog/Pocket Box (2)

• Possible? Yes, same as before, the same CVP/LHAP prototype• unique: all local resources are based on VMs in the same box• current prototype: a Mac Mini box as an educational cloud in classes

Physical Device

CVP


HUB

WiFi

Wireless users

Wired users Wireless

AP

Storage

Sensors

…


15/21

.

Level 3: Fog/Embedded Box

WiFi

Wireless users

Wireless AP

Physical Device

CVP


Storage

Sensors

…

Beacon

WiFi AP WiFi Client

P2P WiFi


16/21

.

Level 3: Fog/Embedded Box (2)

• Possible? Not yet!, but working on it...

• Current status: Android-based, to have easy access to WiFi Direct andBeacon frameworks

WiFi

Wireless users

Wireless AP

Physical Device

CVP


Storage

Sensors

…

Beacon

WiFi AP WiFi Client

P2P WiFi


17/21

.

Fog Box Applications


18/21

.

Usecase 1: Campus Data Hub• features: a cloudified university campus, content delivery as a cloudservice

P2P WiFi HDD +

User A

User B

3G

WiFi

HDD

P2P WiFi

User A

User B User A

move

Campus

WDH

P2P WiFi

P2P WiFi P2P

WiFi

Company/University


19/21

.

Usecase 2: Vehiclular Clouds• cloudified in-car hardware for Vehicular Clouds (VCs) based onBeacons and P2P WiFi -- as part of smart grids

Cloud, BigData

Cloud, BigData Networked

power plants

Standalone power plants

Smart grid by cognitive radio


20/21

.

That’s all, thank you ...


21/21

how to build a generic fog cloud box

Technology