8/12/2019 Okeanos Project

1/93

Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 1

Public IaaS Cloud @

Nectarios Koziris, GRNET

8/12/2019 Okeanos Project

2/93

Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 2

What is Okeanos?

Okeanos is the Greek word for ocean

Oceans capture, store and deliver energy,

oxygen and life around the planet.

8/12/2019 Okeanos Project

3/93

Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 3

Late 2010: The challenge

Goals

Production-quality IaaS cloud similar to Amazon AWS

Scalability to thousands users/nodes/VMs

Persistent VMs

Commodity components

Everyone can use it

No vendor lock-in

Low admin costs, manageable by a small team

Late 2010: The challenge

8/12/2019 Okeanos Project

4/93

Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 4

Reviewed open source ones

Eucalyptus

Cloudstack

Opennebula

Openstack

..etc..

Stillevolving systems, silo ones (touching every layer)

No turnkey solutions

Late 2010: The available offerings

8/12/2019 Okeanos Project

5/93

Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 5

The okeanos approach

Features: Production-quality IaaScloud

Everything open source:

Persistent VMs

Commodity Hardware No SAN, No exotic network hw

Add plain servers/disks/switches to scale up

Three clicks to start 1 or 10s of VMs, in 15 secs

Simple to operate

Ganeti

byby

Key decision: Decompose the problem into layers

8/12/2019 Okeanos Project

6/93

Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 6

Building a Cloud, cluster by cluster

UI

API

CLOUD

CLUSTER

NODE

HYPERVISOR

SYNNEFOOPENSTACK

OPENSTACKOPENSTACK

SYNNEFO

OPENSTACK

GANETI

LIBVIRT

KVMKVM

8/12/2019 Okeanos Project

7/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 7

A small story: Why Google Ganeti?

No need to reinvent the wheel Scalable, proven software infrastructure

VM cluster management in production is serious business

Built with reliability and redundancy in mind

Combines open components (KVM, LVM, DRBD)

GRNET biggest (worldwide) external contributor to Google Ganeti

(from 2009)

http://code.google.com/p/ganeti

For more, see Running Google on Google by Jeff Bates and Iustin Pop (Google

I/O 2012- https://developers.google.com/io/)

http://code.google.com/p/ganetihttps://developers.google.com/io/https://developers.google.com/io/http://code.google.com/p/ganeti

8/12/2019 Okeanos Project

8/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 8

.to scale up to tens of thousands

VMs and users?

8/12/2019 Okeanos Project

9/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 9

nkoziris@grnet.gr|20130226

simplicity

8/12/2019 Okeanos Project

10/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 10

nkoziris@grnet.gr|20130226

8/12/2019 Okeanos Project

11/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 11

nkoziris@grnet.gr|20130226

flexibility

8/12/2019 Okeanos Project

12/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 12

nkoziris@grnet.gr|20130226

8/12/2019 Okeanos Project

13/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 13

nkoziris@grnet.gr|20130226

okeanos IaaS

Compute

Network

Storage

firewall

8/12/2019 Okeanos Project

14/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 14

1x

2x5x

8x

8/12/2019 Okeanos Project

15/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 15

8/12/2019 Okeanos Project

16/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 16

Compute Network: Cyclades

Thin Compute layer over Ganeti

- Python/Django

- Supports multiple Ganeti clusters, for scaling

- OpenStack Compute API

Networking

- No restrictions on deployment its the Ganeti side

- IPv4/IPv6 public networks, complete isolation among VMs

- Thousands of private networks, private L2 segments over single VLAN

8/12/2019 Okeanos Project

17/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 17

Virtual Machine Actions

My_windows_Desktop

Shutdown

Reboot

Start Console

Shutdown

8/12/2019 Okeanos Project

18/93

8/12/2019 Okeanos Project

19/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 19

nkoziris@grnet.gr|20130226

Virtual Networks

Internet

Private Network 1

Private Network 2

Private Network 3

8/12/2019 Okeanos Project

20/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 20

Cyclades

8/12/2019 Okeanos Project

21/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 21

Storage:

Every file is a collection of blocks

Content-based addressing for blocks

Partial file transfers, deduplication, efficient syncing

Independent of storage backend (NFS, RADOS, )

OpenStack Object Storage API plus extensions

An integral part of Synnefo - Single store for Files, VM Images

- Uses common backend with Archipelago

8/12/2019 Okeanos Project

22/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 22

8/12/2019 Okeanos Project

23/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 23

Storage: Archipelago

Unified storage for Files, Images Volumes

Thin layer over the actual storage cluster

Storage backend agnostic

Efficient syncing / sharing of Images as files on Pithos

Zero-copy cloning of volumes from Images

8/12/2019 Okeanos Project

24/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 24

Spawn

Freeze

Images

my own Ubuntu

8/12/2019 Okeanos Project

25/93Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 25

Clone

Snapshot

Images Storage

Ubuntu + user data

8/12/2019 Okeanos Project

26/93

Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 26

Images Golden Image

8/12/2019 Okeanos Project

27/93

Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 27

See FOSDEM presentation in Brussels, Feb 2013:

INTRODUCING THE SYNNEFO OPEN SOURCE IAAS PLATFORM,

by VANGELIS KOUKIS

GRNETs opensource IaaS platform (Python)

http://www.synnefo.org

8/12/2019 Okeanos Project

28/93

Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 28

Some Numbers (alpha phase-24.2.2012)

2100 users

2941 VMs

10119 Virtual CPUS

8/12/2019 Okeanos Project

29/93

Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 29

5819.76 GBUsed Memory

174273.8 GBUsed Disk

7 Ganeti clusters currently

>100 fat nodes

move to > 10.000 VMs

8/12/2019 Okeanos Project

30/93

Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 30

System OS Images

Windows Server 2012

Windows Server 2008R2

CentOS 6.3

Fedora 17

Ubuntu 12.04 LTS Kubuntu 12.04 LTS

Ubuntu 12.10

Kubuntu 12.10

Debian Desktop Squeeze

Debian Base Squeeze

.more

8/12/2019 Okeanos Project

31/93

Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 31

0

500

1000

1500

2000

2500

3000

Cyclades VMs

VMs

8/12/2019 Okeanos Project

32/93

Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 32

main Datacenter (40 racks)

green architecture PUE

8/12/2019 Okeanos Project

33/93

Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 33

Cloud Facilities (cont.)

Disaster Recovery DC (@procurement stage) Container based solution

Louros river hydroelectric plant area

Up to 320KW

Low PUE (

8/12/2019 Okeanos Project

34/93

Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 34

8/12/2019 Okeanos Project

35/93

Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 35

8/12/2019 Okeanos Project

36/93

Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 36

Design Specs for a Public Cloud

ProviderCommon denominator:

#VM instances (in various VM flavors)

Guaranteed ratios:

VMs/Core, RAM/Core, disks(spindle)/core

/VM?

8/12/2019 Okeanos Project

37/93

Greek Research and Technology Network Cloud Computing Conference 2013 (Plaza, Maroussi) 37

See more on http://okeanos.grnet.gr

GO http://okeanos.io for a quick tryout!

The project is co-financed by Greece and the European Union

@grnet_gr #okeanos

8/12/2019 Okeanos Project

38/93

8/12/2019 Okeanos Project

39/93

8/12/2019 Okeanos Project

40/93

8/12/2019 Okeanos Project

41/93

8/12/2019 Okeanos Project

42/93

8/12/2019 Okeanos Project

43/93

8/12/2019 Okeanos Project

44/93

8/12/2019 Okeanos Project

45/93

8/12/2019 Okeanos Project

46/93

8/12/2019 Okeanos Project

47/93

8/12/2019 Okeanos Project

48/93

8/12/2019 Okeanos Project

49/93

8/12/2019 Okeanos Project

50/93

8/12/2019 Okeanos Project

51/93

8/12/2019 Okeanos Project

52/93

8/12/2019 Okeanos Project

53/93

8/12/2019 Okeanos Project

54/93

8/12/2019 Okeanos Project

55/93

8/12/2019 Okeanos Project

56/93

8/12/2019 Okeanos Project

57/93

8/12/2019 Okeanos Project

58/93

8/12/2019 Okeanos Project

59/93

8/12/2019 Okeanos Project

60/93

8/12/2019 Okeanos Project

61/93

8/12/2019 Okeanos Project

62/93

8/12/2019 Okeanos Project

63/93

8/12/2019 Okeanos Project

64/93

8/12/2019 Okeanos Project

65/93

8/12/2019 Okeanos Project

66/93

8/12/2019 Okeanos Project

67/93

8/12/2019 Okeanos Project

68/93

8/12/2019 Okeanos Project

69/93

8/12/2019 Okeanos Project

70/93

8/12/2019 Okeanos Project

71/93

8/12/2019 Okeanos Project

72/93

8/12/2019 Okeanos Project

73/93

8/12/2019 Okeanos Project

74/93

8/12/2019 Okeanos Project

75/93

8/12/2019 Okeanos Project

76/93

8/12/2019 Okeanos Project

77/93

8/12/2019 Okeanos Project

78/93

8/12/2019 Okeanos Project

79/93

8/12/2019 Okeanos Project

80/93

8/12/2019 Okeanos Project

81/93

8/12/2019 Okeanos Project

82/93

8/12/2019 Okeanos Project

83/93

8/12/2019 Okeanos Project

84/93

8/12/2019 Okeanos Project

85/93

8/12/2019 Okeanos Project

86/93

8/12/2019 Okeanos Project

87/93

8/12/2019 Okeanos Project

88/93

8/12/2019 Okeanos Project

89/93

8/12/2019 Okeanos Project

90/93

8/12/2019 Okeanos Project

91/93

8/12/2019 Okeanos Project

92/93

8/12/2019 Okeanos Project

93/93