ommunity-lab testbed and loudy distributionpeople.ac.upc.edu/mselimi/slides/slides1.pdf · outline...

19
Mennan Selimi Universitat Politècnica de Catalunya - BarcelonaTECH CLOMMUNITY COMMUNITY-LAB TESTBED AND CLOUDY DISTRIBUTION

Upload: others

Post on 03-Aug-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

Mennan SelimiUniversitat Politècnica de Catalunya - BarcelonaTECH

CLOMMUNITY

COMMUNITY-LAB TESTBED AND CLOUDY DISTRIBUTION

Page 2: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

Outline

• Community networks

• Community-Lab

• Community-Lab Demo

• Motivation

• Community Clouds

• Services in Community Networks

• Cloudy Demo

CLOMMUNITY-PROJECT.EU Decentralized Systems 2015 1

Page 3: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

Community Networks

• What’s this ? A cooperative development of a network

• Where ? Local, community (city, region, area)

• Who? You and your neighbors

Don’t buy the network, be the network !

Scalable, self-organized and decentralized IP networks and services built and operated by citizens for citizens

CLOMMUNITY-PROJECT.EU Decentralized Systems 2015 2

Page 4: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

26.600+ nodes 50.000+ km of links

CLOMMUNITY-PROJECT.EU Decentralized Systems 2015 3

Page 5: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

Community-Lab

• An open, distributed infrastructure for experimentation with Community Networks

• An outdoor testbed with nodes and links embedded in community networks, with many people too

• A realistic environment for experimentation with the best and worst of real community networks

• Research Devices connected to Community Devices

CLOMMUNITY-PROJECT.EU Decentralized Systems 2015 4

Page 6: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

Community-Lab DEMO

206 Nodes

Slice creation Adding slivers

Sliver properties Sliver templates

COMMUNITY-PROJECT.EU Decentralized Systems 2015 5

http://community-lab.net

Page 7: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

26.600+ nodes 50.000+ km of links

What other services can community members provide to each other ?

CLOMMUNITY-PROJECT.EU Decentralized Systems 2015 6

Page 8: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

Motivation

• Wireless networks successful as communication infrastructure in underserved areas

• Opportunity to build community network clouds in wireless mesh networks

• Cooperative deployment and maintenance of clouds

• Saving of uplink bandwidth - no need to consume services from the Internet. They are available within the wireless network

• Storage, Video streaming and service discovery in community clouds

CLOMMUNITY-PROJECT.EU Decentralized Systems 2015 7

Page 9: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

Community Clouds➡ The vision of cloud-based services in community networks

➡ We are talking about specific community cloud:✦ built in community network✦ hosted in community-owned

computing resources✦ providing services of local interest ✦ A P2P cloud made of individual

computers and home gateways

Pros: - no single entity that owns or controls - to join/leave no need for permission or consent - small components, energy-efficient, well distributed

Cons: - can’t provide the QoS of Google, Amazon

CLOMMUNITY-PROJECT.EU Decentralized Systems 2015 8

Page 10: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

Services in community clouds• Technological barrier when deploying services

• Community network cloud distribution

✦ Service Discovery platform

✦ Decentralization

✦ User-friendliness and experience

✦ Free, Open Source Software (FOSS)

• Cloudy

• Debian GNU/Linux distribution aimed to foster the transition and adoption of the CN cloud environment

• can be installed in VMs or “bare metal”

• running on low-resource devices

CLOUDY

http://cloudy.community/CLOMMUNITY-PROJECT.EU Decentralized Systems 2015 9

Page 11: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

Cloudy Architecture• Internal architecture

• overlay to interconnect all nodes in a community cloud

• service announcement and discovery: publish local information to the cloud and receive remote data from neighbor peers

• Services included:

• Database: CouchDB• Storage: Tahoe-LAFS, XtreemFS, etcd, Syncthing• VoIP: Asterisk DUNDi• Video streaming: PeerStreamer• Video on demand: Gvod• Container: OpenVZ• Discovery: and Announcement: Avahi• Network overlay: TincVPN• Proxy, SNP Services, DNS Services Cloudy architecture

CLOMMUNITY-PROJECT.EU Decentralized Systems 2015 10

Page 12: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

Tahoe-LAFS• Open source, secure distributed data storage system

• Provider-independent security (security at the client side)

• Erasure coding generalized to K-of-N nodes (3-of-10)

• Tahoe-LAFS grid consists of:

• Client node: user interface into the grid• Introducer node: publish/subscribe hub• Storage node: stores the shares

Tahoe-LAFS architecture

Introducer

Storage

Client

Client

Client

Storage

Storage

Storage

CLOMMUNITY-PROJECT.EU Decentralized Systems 2015 11

Page 13: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

Experimental Environment

43 nodes in total

VMs in most of the machinesCommunity Lab testbed nodes (LXC)

IoT - Internet of Things boards

Number of nodes Type Location

10 - UPC VMs in a single machine Barcelona, Spain

10 - TAR VMs in a single machine Barcelona North, Spain

10 - UPC VMs in a single machine Barcelona South, Spain

4 - KTH VMs in two machines Stockholm, Sweden

2 - ICTP VMs in a single machine Trieste, Italy

4 - CAT Community-Lab nodes Catalonia

3 - CAT Intel Galileo IoT boards Catalonia

OpenWRT

LXC

CLOUDY

Our topology

CLOMMUNITY-PROJECT.EU Decentralized Systems 2015 12

Page 14: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

Tahoe-LAFS vs. XtreemFS

No replication

5 replicas

Sequential read and write of Tahoe-LAFS and XtreemFSwith different replication factors

CLOMMUNITY-PROJECT.EU Decentralized Systems 2015 13

Page 15: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

Tahoe-LAFS

CLOMMUNITY-PROJECT.EU Decentralized Systems 2015 14

Page 16: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

Lessons learned

demonstration to the end users that cloud services are supported by the community wireless network

provision of platform and application services rather than on infrastructure service time-sensitive services as video live streaming, VoIP, VoD

focus on community cloud services

sustainability of the community cloud

incentives for the users to contribute

Tahoe-LAFS promising secure storage service for community network clouds

CLOMMUNITY-PROJECT.EU Decentralized Systems 2015 15

Page 17: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

Conclusion

• Cloud infrastructures are deployed in a real production wireless community network

• A easy to use community distribution might help for massive uptake and provision of stable key services

• Tahoe-LAFS showed to be promising application for privacy-preserving, secure cloud storage

CLOMMUNITY-PROJECT.EU Decentralized Systems 2015 16

Page 18: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

DEMO

CLOMMUNITY

http://cloudy.community/http://clommunity-project.eu/

A community networking Cloud in a boxCLOMMUNITY

Demo http://84.88.85.42/user/pass: guest/guest

Page 19: OMMUNITY-LAB TESTBED AND LOUDY DISTRIBUTIONpeople.ac.upc.edu/mselimi/slides/Slides1.pdf · Outline • Community ... LXC CLOUDY Our topology CLOMMUNITY-PROJECT.EU Decentralized Systems

Service Discovery• Avahi - system which facilitates the service discovery on a local network via

the mDNS/DNS-SD protocol suite

• In community networks nodes are spread over different broadcast domains, Avahi packets can not reach !

• One solution: TincVPN

✦ Virtual Private Network daemon that uses tunneling and encryption to create a secure private network between hosts

✦ Installed and configured on every Cloudy

Domain ADomain B

CLOMMUNITY-PROJECT.EU Decentralized Systems 2015 1