nordicloud tutorial - building private cloud with oss for scientific environments-libre

5/23/2018 NordiCloud Tutorial - Building Private Cloud With OSS for Scientific Environments-libre

Zoran Pantic & M. Ali Babar

IT University of Copenhagen, Denar!

"or#ic $yposi% on Clo%# Cop%ting &Internet Technologies "or#iClo%#'

August 21th & 22th, 2012, Helsinki, Finland

Building Private Cloud with Open Source

Software for Scientific Environment


Zoran Pantic

Infrastr%ct%re Architect & $ystes $pecialist

Corporate IT ( University of Copenhagen)*ail+ opa(it%.#! & oran(pantic.#!

Aca#eic profile+ http+--it%.aca#eia.e#%-ZoranPanticBlog+ http+--oranpantic.or#press.co

/in!e#In+ http+--.lin!e#in.co-in-oranpantic


M. Ali Babar


Agenda

"on*technical part+ 0hy Private Clo%#1 0hy 2$$1

Technical part+

3eflections on #iverse IT*infrastr%ct%re aspects 2$$ Private Clo%# sol%tions+

U)C-)%calypt%s

2pen"eb%la

2pen$tac!

Concl%sion 4%estions1 also #%ring the session'


Tutorial oal!

Un#erstan# the role an# %se of private clo%# in specificenvironents, e.g., scientific & aca#eic

5ain !nole#ge of the technologies for setting %p a private

clo%# ith open so%rce softare

/earn abo%t the process for #esigning & ipleenting aprivate clo%# sol%tion

Appreciate the socio*technical & technical challengesinvolve# an# soe potential strategies


Cloud Computing

6Cloud computing is a model for enabling convenient, on-demand netorkaccess to a shared pool of configurable computing resources !e"g", netorks,

servers, storage, applications, and services# that can be rapidl$ provisionedand released ith minimal management effort or service providerinteraction.7

A #efinition by the U$ "ational instit%te of stan#ar#s an# technology *NIST'


Main A!pect! of a Cloud S"!tem

3epro#%ce# fro 8ig%re 9 of The 8%t%re of Clo%# Cop%ting+ 2pport%nities for )%ropean Clo%# Cop%ting beyon# :;9;.


Commercial Effort! # $%&!

8ro The 8%t%re of Clo%# Cop%ting+ 2pport%nities for )%ropean Clo%# Cop%ting beyon# :;9;


Service # 'eplo"ment Model!

Infrastructure as a Service (IaaS)

Amazon EC2 Eucalyptus IBM Computing

On eman! (oC)

"M#are

vSp$ere

%latform as a Service (%aaS)

&oogle App

Engine

Microsoft

Azure

'orcecom a$oo

Open Strategy

Soft*are as a Service (SaaS)

&oogle Apps +o$o Salesforce

C,M

Microsoft Clou!

Services

PublicClouds

Private

CloudsCommunity

Clouds

Virtual Private

Clouds

Hybrid Clouds

ServiceMod

els

DeploymentModels


Private Cloud

Private clo%# has #ifferent eanings to #ifferent people

B%t basically, it


Step! for Setting (p Private Cloud

A#opt a achine virt%aliation strategy

Profile application cop%te,eory, an# storage %sage

an# perforance re=%ireents Design a virt%al achine #evelopent cons%ltancy

Acco%nting an# recharge policies a#apte# to self*service

Architect a #eployent an# #eploy a private clo%#

$o%rce+ 8ive $teps to )nterprise clo%# cop%ting, a 0hite paper of )%calypt%s $ystes, Inc.


)h" Private Cloud* +,-

Us%ally, the b%#get is lo, an# the pro>ect sho%l# start as soon aspossible

5roing strongly+ The nee# for processing large #ata vol%es The nee# to conserve poer by optiiing server %tiliation

"on*stan#ar# highly*a#aptable sol%tion nee#e#

Analying large ao%nts of #ata to get res%lts

Many #ifferent research pro>ects in one organiation


)h" Private Cloud* -,-

%rivate clou!s-

?ave higher 32I than tra#itional infrastr%ct%re

Are ore c%stoiable

Can =%ic!ly respon# to changes in #ean#s $%pport rapi# #eployent

?ave increase# sec%rity

8oc%s on an organiation


)h" OSS*

In general+

/oering the costs !i"e" no licensing headaches%#@ the b%#getsaren


Private Cloud Challenge!

Challenges+

$ocio*technical

Technical


Sociotechnical Challenge!

$ocio*technical challenges+ ostly political an# econoic+

)isting str%ct%res oppose ipleentation of private clo%#

0ea! transparency of ho is in charge of systes an# econoy,

3esearches cannot be ar!et cost*effective,

A#inistrators #e facto in charge * instea# of scientific gro%ps

Ten#ency of ipleenting things beca%se they are interestingan# 6f%n7, hile aybe there is no nee# for those systes.


Technical Challenge!

Private clo%# at%rity,

Probles porting of prograing co#e,

IT #epartents sho%l# be big eno%gh, ith eno%ghepertise,

2$$+ co%nity cannot fi all yo%r probles.


/mplementing Cloud Solution!

Deterine the nee#s an# their nat%re @ etensive interactionith all the a>or sta!ehol#ers, e.g., pro>ect lea#er

Top*#on steering of the process

Design an# ipleent a test case )n# %sers also thoro%ghly test the sol%tion * free of charge,

Ma!e s%re that ipleentation s%ccee#s first tie

5et a very clear pict%re of hat services are to be offere#,

ho ill %se the, hat they ill %se the for, an# ho


Private Cloud in Scientific Environment

Base# on 2pen $o%rce $oftare 2$$'

8oc%s on the logistical an# technical challenges, an#strategies of setting %p a private clo%# for scientificenvironent

5eneral scenarios+

/ocal DI

2$$ Private Clo%#

)nterprise Private Clo%# ith gt sol%tion'

Eirt%al Private Clo%#

... or >%st going P%blic Clo%#


%ocu! on Scientific Environment

Difference in ipleenting for 6infantry7 an# 6s%pply troops7

6Infantry7 * to s%pport research, scientific cop%ting an#?igh Perforance Cop%ting ?PC'

6Supply7 * to s%pport #aily operational systes an# tas!si.e. >oint a#inistration

Boo!!eeping, a#inistration, Co%nications telephony, e*ail, essaging'

6Infantry7 @ stateless instances vs. 6$%pply7 @ statef%l

instances


Scientific Environment0 1/nfantr"2 +,-

Uses non*stan#ar# & a#vance# research instr%ents

Applicable in research, scientific cop%ting an# ?PC, i.e.+

5enerally if %sers nee# EMs that they a#inister theselvesroot access' * ore appropriate to s%pply the ith achines

fro private clo%#, then giving access to virt%al hosts behin#fireall

2rganiations li!e ITU Denar!'+ for n%ero%s #ifferent pro>ects

2rganiations li!e DC$C Denar!'+ 9-F of the >obs o%l# ber%nnable on private clo%#

in ?PC+ 2nly in lo en#, for lo eory an# lo coren%ber >obs


Scientific Environment0 1/nfantr"2 -,-

$%arie# s%ggestions

?ave social psychology in in# as iportant factor Cons%lt the professor in charge of oney for the pro>ect

Ipleent an open so%rce sol%tion @ 2pen$tac!, 2pen"eb%la,U)C base# on )%calypt%s, oyent $art2$, ...


Scientific environment0 1Suppl"2

"ee#s a stable an# s%pporte# sol%tion

$%arie# s%ggestions

?ave social psychology in in# as iportant factor

Cons%lt the syste oner in charge of oney for the pro>ect

Ipleent a proprietary sol%tion fro rep%table provi#er Microsoft ?yper*E, EMare Eirt%al Infrastr%ct%re, G

$ign a s%pport agreeent & negotiate a goo# $/A


CP( and Memor"

Processor architect%re+

Intel & AMD

Definitely H*bit @ for perforance reasons

M%ltiprocessor, %lticore, hyper threa#ing

Eirt%al )tensions enable# har#are is a %st

Intel ET*J or AMD*E virt%aliation etensions @ virt%aliationenable# har#are chec! by vieing /proc/cpuinfo'

?ost


Storage Option!

Dis! intefaces+ parallel & serial

Conteporary #is! types+

$ATA $C$I

$A$

$$D

?ybri# #rives


Storage T"pe! +,3

/ocal vs 3eote storage+

/ocal storage+

#is!s in the host itselv

DA$ @ attache# #irectly to the host

3eote storage+

"A$ * 8ile /evel $torage "8$, $MB-CI8$' Also #istrib%te# file systes see i.e. Moose8$ an# 5l%ster8$'

$A" * Bloc! /evel $torage 8C-8Co), i$C$I'

2$$-free $A"-"A$ appliance eaple+ "app*it , base# onZ8$-"eenta


Storage T"pe! -,3

$torage levels+ Bloc! @ bits store# se=%entially in a bloc! of fie# sieL rea# & rite ra

#ata bloc!sL for file systes or DBM$s 8ile @ aintains physical location of files, apping the to bloc!s i.e.

ino#e n%ber - pointers' 2b>ect @ #ata organie# in fleible sie# containers, ob>ects, consisting

of #ata se=%ence of bytes' an# eta#ata etensible attrib%tes#escribing the ob>ect'L for static #ataL #istrib%te# storage sprea# accross%ltiple #is! #rives an# serversL no central brain6 or aster point6 @scalable, re#%n#ant, #%rable

Partitioning in /in% %sing /ogical Eol%e Manger /EM' Physical Eol%e PE'

/ogical Eol%e /E'+ %ltiple PEs a!e one /E Eol%e 5ro%p E5'+ %ltiple /Es a!e one E5


4irtuali5ation +,-

Different types of virt%aliation+

?ar#are

$torage

"etor! Meory

Application

Des!top

...


4irtuali5ation -,-

?ar#are virt%aliation+

8%ll virt%aliation+ g%est %no#ifie#, %naare ?0*assiste# virt%aliation+ h architect%re s%pports virt%aliation

Partial virt%aliation+ partially si%lates the physical har#are

of a achineL i.e. each g%est has in#epen#ent a##ress space Paravirt%aliation+ g%est is aare that it


T"pe! of 6"pervi!or!

Types of hypervisors+ "ative - bare etal @ r%n #irectly on the hostor virt%aliation ven#ors & technologies %se# in hypervisor layer+http+--.clo%#cop%teinfo.co-virt%aliation so%rce+ Pa%l Morse'

To#ays ost %se# hypervisors+ KEM-4)MU Jen Eirt%alBo EMare

?yper*E $art2$


74M KEM * Kernel*base# Eirt%al Machine6, http+--.lin%*!v.org /in% !ernel o#%le that allos a %ser space progra to %tilie the

har#are virt%aliation feat%res of vario%s processors Intel an# AMDprocessors * H an# HQH, PPC ;, PPC RS;, $-FR;'

KEM incl%#e# in !ernel ore recent !ernel gives %p#ate# KEMfeat%res, b%t is less teste#'

virt%aliation sol%tion that can r%n %ltiple virt%al achines r%nning%no#ifie# /in% or 0in#os g%ests $%pports .ra, .=co: an# .v#! #is! iage forats Available as integrate# part of every /in% #istrib%tion since :.H.:; Coponents+

loa#able !ernel o#%le !v.!o6 that provi#es the core virt%aliation

processor specific o#%le !v*intel.!o6 or !v*a#.!o6 KEM is only an intefrace that is calle# thro%gh a special syste file,

an# re=%ires 4)MU to be a f%ll virt%aliation environent


8EM(

4)MU @ 4%ic! )%lator * http+--i!i.=e%.org

generic open so%rce achine e%lator an# virt%alier+

)%lator+ r%ns 2$


9en

2pen $o%rce virt%alisation technology * http+--.en.org

$tarte# as Jeno$erver pro>ect at Cabri#ge University

Use# as stan#alone hypervisor, or as hypervisor coponent inother clo%# infrastr%ct%re fraeor!s

$%pports .ra an# .v#! #is! iage forats


4irtualBo:

2racle Eirt%alBo * https+--.virt%albo.org

8ree softare release# %n#er 5"U 5P/ A H virt%aliation platfor, create# by Innote!, p%rchase# by

$%n, an# no one# by 2racle

Installe# on a host 2$ as an application


4Mware

EMare * http+--.vare.co

Different hypervisors+ )$J @ ainline pro#%ctL coercial license

)$Ji @ ainline pro#%ct, free not 2$$'L boot fro flash car#s s%pporte# $erver @ free not 2$$', installs on /in% & 0in#os

0or!station-Player @ virt%aliation on %ser PC


4Mware


6"per4

Microsoft ?yper*E http+--.icrosoft.co-en*%s-server*clo%#-in#os*server-hyper*v.asp

3elease# in :;;, ne :;9: release epecte# in "oveber

Eirt%aliation platfor that is integral part of 0in#os $erver

2nly for H*H Can boot fro flash car# on servers otherboar#

Eariants+ $tan#*alone pro#%ct, free, liite# to coan# line interface

As ?yper*E role insi#e 0in#os $erver

$%pports .vh# #is! iage forat


SmartOS

oyent $art2$ * http+--sartos.org 8ree, gone 2pen $o%rce A%g%st :;99, #escent fro

2pen$olars * Ill%os

?ypervisor poering oyent


$etwor;ing Service! +,3

Provi#ing basic netor! services D"$, 50, "AT, ...' is agoo# i#ea

Physical & virt%al netor!s

%$ysical net*or.+ Ipleenting private clo%# %sing : or F netor!s+ 0A",

Clo%# p%blic & Clo%# private

8ireall+ 2$$ base# pf$ense * to a!e the hole environentin#epen#ent of the netor! infrastr%ct%re - environenthere it ill be 6pl%gge# in7


$etwor;ing Service! -,3

"irtual net*or.s+ i.e. "icira, Jsigo'

In#epen#ece fro netor! ?0

3epro#%ction of the physical netor!

2perating o#el of cop%ting virt%aliation

Different hypervior copatibility

Isolation beteen virt%al an# physical netor!, an# controllayer

$calling & perforance clo%#*li!e

Prograatic provisioning & control


$etwor;ing Service! 3,3

"etor! virt%aliation eaple+ "icira'


&edundanc"

A%toatic-an%al failover-failbac!

Cl%sters+ active-active, active-passive =%or%'

Private Clo%# $oe ?A feat%res, b%t local to every provi#er

0or! in progress+Corosync O Pacea!er

Corosync6 @ 2pen $o%rce cl%ster sol%tion

Pacea!er6 @ 2pen $o%rce ?A cl%ster reso%rce anager


Private Cloud Offering!

/ist of 2$$ Private Clo%# offerings+ so%rce+ Pa%l Morse'

http+--.clo%#cop%teinfo.co-private*clo%#s

Covere#+

)%calypt%s Ub%nt% )nterprise Clo%#, U)C'

2pen"eb%la

2pen$tac!


Eucal"ptu!

0as b%n#le# ith Ub%nt% U)C'L no only6 s%pporte#Ub%nt% is b%n#ling 2pen$tac! fro 99.9;'

U)C-)%calypt%s is an on*preise private clo%# 2$$ base#platfor, sponsore# by )%calypt%s $ystes

$tarte# as research pro>ect in :;;S ( UC$B

/in% base# @ 3?)/, Cent2$, Ub%nt%

$%pport for EMare

8or scalable private an# hybri# clo%#s

?ybri# clo%#s achieve# by API copatibility ith Aaon


&e


Component!

Designe# as a #istrib%te# syste ith a set of N H' eleents+

Clo%# Controller C/C'

0alr%s $torage Controller 0$F'

Cl%ster Controller CC'

$torage Controller $C'

"o#e Controller "C'

EMare Bro!er Bro!er or EB' * optional


Architectural =a"er!

Three levels+

9. Clo%# level

Clo%# Controller C/C'

0alr%s $torage Controller0$F'

:. Cl%ster level

Cl%ster Controller CC'

$torage Controller $C'

EMare Bro!er Bro!er or EB'F. Cop%ting level

"o#e Controller "C'


Cloud Controller >C=C?

)ntry point to )%calypt%s clo%#

eb interfaces for a#inistering the infrastr%ct%re

eb services interface )C:-$F copliant' for en# %sers-client tools

8ronten# for anaging the entire U)C infrastr%ct%re

5athers info on %sage an# availability of the reso%rces in theclo%#

Arbitrates the available reso%rces, #ispatching the loa# to the

cl%sters


Clu!ter Controller >CC?

)ntry point to a cl%ster

Manages "Cs an# instances r%nning on the

Controls the virt%al netor! available to the instances Collects inforation on "Cs, reporting it to C/C

2ne or several per clo%#


Storage Controller >SC?

Allos creation of bloc! storage siilar to Aaon


4Mware Bro;er >Bro;er or 4B?

2ptional coponent for )%calypt%s s%bscribers

)nables #eploying EMs on EMare infrastr%ct%re

3esponsible for arbitrating interactions beteen CC an#)$J-)$Ji hypervisors

locate# ith CC


$ode Controller >$C?

Cop%te no#e 6or! horse7', r%ns an# controls the instances $%pporte# hypervisors+

KEM preferre#, open so%rce version'

Jen open so%rce version'

EMare )$J-)$Ji, for s%bscribers'

Co%nicating ith both 2$ an# the hypervisor r%nning on theno#e, an# Cl%ster Controller

5athers the #ata abo%t physical reso%rce availability on the no#ean# their %tiliation, an# #ata abo%t instances r%nning on that

no#e, reporting it to CC 2ne or several per cl%ster


Plan /n!tallation

Integration ith /DAP or AD

$%pport for reote storage $A"-"A$ @ chec! s%pporte# #evices'

Choosing fro 6 installing "C on one server an# all other onanother6, to each of coponents on separate server6

Tra#e*off beteen siplicity an# perforance & ?A


/n!tallation

Using Ub%nt%O)%calypt%s b%n#le# installation not availablein ne versions of Ub%nt%, since version 99.9; Ub%nt% incl%#es2pen$tac! instea#'

Man%ally+ Install 2$

Eerify netor! connectivity, 80, E/A", D"$...' Install hypervisor Config%re bri#ges, "TP an# MTA Install )%calypt%s Config%re )%calypt%s netor! o#es, hypervisors, r%ntie

environent' )vent%ally config%re ?A


Scaleout Po!!ibilitie!

: physical servers $erver 9+

C/C-0$F-CC-$C $erver :+ "C

F physical servers+ $erver 9+ C/C-0$F $erver :+ CC-$C $erver F+ "C

physical servers $erver 9+ C/C $erver :+ 0$F $erver F+ CC-$C $erver + "C

N physical servers $erver 9+ C/C-0$F

$erver :+ CC9-$C9 $erver F+ "C9

$erver + CC:-$C: $erver N+ "C:


Scaling Out

NC NC NC NC NC NC

C/U$T)3 9 C/U$T)3 :C/U$T)3

FC/2UD


$etwor;ing

"etor!ing o#esoffering #ifferent levelof sec%rity an#

fleibility+ Manage#

Manage# "o E/A"

$yste

$tatic


6igh Availabilit"

3e#%n#ancy * )%calypt%s ?A+

By config%ring ?A, priary an# secon#ary clo%# an# cl%stercoponents are intro#%ce#

?ot*sappable coponents+ C/C, 0alr%s, CC, $C, an# EB

M%st have F "ICs if fearing netor! har#are fail%re

8or ?A $Cs, s%pporte# $A"s nee#e#

"Cs are not re#%n#ant

)ternally accessible coponents clo%# level' %st have D"$3o%n#*3obin s%pport

Arbitrator service %ses ICMP essages to test reachability If all arbitrators fails to reach soe coponent, failover is initiate#


)eb(/


(/ u!ing 6"brid%o:


Open$ebula

An 2pen $o%rce pro>ect aiing at ipleenting thein#%stry stan#ar# for b%il#ing an# anaging virt%alie# #atacentres an# clo%# infrastr%ct%re Iaa$'

$ponsors+

)U thro%gh vario%s progras via D$A, 3)$)3E2I3, Caa$t,$trat%s/ab, Bon8I3)'

"ational grants

C9:5 /abs

Microsoft

All fig%res ta!en fro http+--openneb%la.org


6i!tor"


Characteri!tic! +,3

Doesn


Characteri!tic! -,3

?as great o#%larity, hich eases the integration ith othersol%tions

Ipleente# on a pl%gin o#el, a!ing it easy to c%stoie#ifferent aspects virt%aliation, storage, a%thentication &a%thoriation, ...'

Any action is perfore# by a bash scirpt

Doesn


Characteri!tic! 3,3

Uses coon open in#%strial stan#ar#s @ i.e. Aaon )C:API an# 2pen Clo%# Cop%ting Interface 2CCI'

2pen"eb%la


Main component!


Main feature! >v3.@?

User $ec%rity & M%ltitenancy %sing 5ro%p Manageent

Eirt%al Data Centers

Control & Monitoring of Physical & Eirt%al Infrastr%ct%re

$%pports %ltiple hypervisors, #ata stores, netor!integrations, #atacenter onitoring 5anglia'

Distrib%te# 3eso%rce 2ptiiation

?igh Availability

?ybri# Clo%# & B%rsting

$elf*service provisioning portal


/nternal Architecture +,

The three layers of the internal architect%re+


/nternal Architecture -,

Drivers co%nicate #irectly to the 2$

Transfer #river+ anage the #is! iages on the storage

syste, that co%l# be "8$ or i$C$I, or copying %sing $$? Eirt%al Machine #river+ specific to the hypervisor

ipleente#L anage the EM


/nternal Architecture 3,

$et of coponents to control an# onitor EMs, E"s, storage &hosts+

3e=%est Manager+ han#les client re=%ests

Eirt%al Machine Manager+ anages & onitorsEMs

Eirt%al "etor! Manager+ anages virt%al netor!s

?ost Manager+ anages & onitors physical reso%rces Database+ persistent storage state'


/nternal Architecture ,

C/I+ an%al anip%lation of the virt%al infrastr%ct%re

$che#%ler+ invo!es actions on EMs %sing JM/*3PC interface' 2ther+ Fr# party tools %sing JM/*3PC interface or 2pen"eb%la Clo%#

API'


Open$ebula h"pervi!or!

Jen

KEM-4)MU

EMare


Open$ebula hardware

Processor re=%ireent+ CPU ith virt%aliation s%pport

Meory+

?ost+ ini% 5B

5%est+ :NH MB for sallest instance

$torage base# on 3AID+ local #is! for PoC, $A" forpro#%ction systes

"etor!+ gigabit netor! car#s', event%ally b%n#lingseveral car#s together perforance & re#%n#ance'


Open$ebula !"!tem component!

8ronten#

?osts

Iage 3epository

Physical netor!


Open$ebula networ;ing

$ervice "etor! is recoen#e# to be #e#icate#netor!

EM


/n!tallation +,

Installation steps+

Planning an# preparing the installation

Installing 2$

Installing the 2pen"eb%la softare

Config%ring the 2pen"eb%la coponents


/n!tallation -,

Planning & preparing+ 2pen"eb%la is a siple set%p consistingof front en#s' an# hosts cl%ster no#es'.

Basic coponents+

8ront en# ?ost

Datastores

$ervice "etor!

EM netor!s


/n!tallation 3,

$torage types+ share# & non*share#"on*share# storage+

$iple to config%re

Initial start of an EM ill be sloer as iage is copie# to the host

$hare# storage+ Any host has access to the iage repository

Any operation on a EM goes =%ic!er beca%se there is #irect accessto the iages, no copying nee#e#

In saller environents or PoCs, ipleente# on front en#

In bigger environents, ipleente# on "A$-$A"


/n!tallation ,

2$ installation+ Choose /in% #istrib%tion i.e. Ub%nt%'

Choose installation e#ia+ .iso or netor!

Use #efa%lt installation steps, ecept evt. for partitioning

Partitioning+ If ?0 rai# eists, it ill appear as single #is!L if $0 rai# sho%l# be

config%re#, can be #one after creating partitions

Partitions for syste, %ser an# sap files

Defa%lt %ser creation onea#in'

The sae acco%nt an# gro%p nee#e# on both 8ront en# & host All the acco%nts nee# the sae UID an# 5ID %ser & gro%p IDs'


/n!tallation D,

8ront en#+ Install 2pen"eb%la softare

3e=%ireent+ "ee#s access to storage #irect or via netor!' "ee#s access to each host $$? to hosts %sing $$? !eys itho%t passor#s, a%to*a## to !non hosts' 3%by v9..S'

?osts+

"o 2pen"eb%la softare nee#e#

Different hypervisors on #ifferent #istros insi#e a cl%ster possible

3e=%ireents+ ?ypervisor $$? server 3%by v9..S'

?ost sho%l# be registere# in 2pen"eb%la onehost'


/n!tallation @,

Config%ring the 2pen"eb%la coponents+ ?ypervisor+ KEM by #efa%lt an# easiest', b%t other #rivers can be

selecte# - o#ifie# ?ost onitoring $torage+ share# filesyste %se# by #efa%lt, can be change# "etor!ing Users & 5ro%ps a#ins, reg%lar, p%blic & service %sersL integration

ith /DAP infrastr%ct%re possible' $%nstone 0eb 5UI ith sae f%nctionality as C/I' Acco%nting & $tatistics info on %sage, acco%nting, graphs' Zones oZone server, anaging Zones an# EDCs'

?ybri# clo%#s for pea! reso%rce %sages' P%blic clo%#s %sing p%blic interfaces, )C: =%ery an# 2CCI'


/n!tallation ,

Manageent tas!s fter the installation+

Chec! if #eaons are r%nning

Chec! passor#less inter*host connectivity

Chec! - enable K$M Managing hosts+

3egistering a##ing a host to 2pen"eb%la'

Deleting #eleting a host, i.e. #isissing a host'

)nabling-#isabling no onitoring nor la%nc of ne instances'


6"brid cloud

A0$ )C: or copatibile


Public cloud

5iving access to the o%tsi#e orl#6 %sing+

)C: 4%ery interface %sing Aaon )C: 4%ery API

2pen Clo%# Cop%ting Interface 2CCI'

Centralie# anageent %sing oZone Zones+ several physical hosts ith sae or #ifferent

hypervisors, controlle# by one front en#

EDCs Eirt%al Data Centers'+ several hosts fro the saeone logically gro%pe#


&edundanc"

3e#%n#ant fronten#s, b%t no a%toatis

Use separate My$4/ bac!en# tho%gh oZones c%rrently

s%ppors only $4/lite'

$%nstone can be #eploye# on a separate achine notnecessarily on front en#'


OpenStac; +,

Iaa$ platfor for b%il#ing clo%# sol%tions %sing any of the#eployent o#els

2pen $o%rce, release# %n#er Apache license

Co*fo%n#e# by "A$A an# 3ac!space in :;;R in a >oint open

so%rce pro>ect, ith "A$A #elivering clo%# cop%te co#e"eb%la6', an# 3ac!space #elivering clo%# ob>ect storageClo%# 8iles6'

8irst release to p%blic in "oveber :;9; @ A%stin6

Bac!e# by i.e. ?P, Cisco, IBM, 3e#?at, Dell, Citri,Canonical, ...

All fig%res ta!en fro http+--.openstac!.org


OpenStac; -,

?as consi#erable ta!e*off in %se ...

...tho%gh "A$A reporte# oving a part of its infrastr%ct%re toAaon, saving V9 illion-yr

http+--.ire#.co-ire#enterprise-:;9:-;H-nasa*eb*services*openstac!- '

$oe contrib%tors left "A$A going to the private sector"eb%la, Piston Clo%# Cop%ting, 3ac!$pace, ...'

Active co%nity+

http+--for%s.openstac!.org

http+--i!i.openstac!.org

http+--#ocs.openstac!.org


OpenStac; 3,

$%pporte# #istros+ Ub%nt%, Debian, 3?)/, Cent2$, 8e#ora,$U$), Piston )nterprise 2pen$tac!, $ift$tac!,Clo%#scaling & $tac!2ps

3eleases+ A%stin :;9;', Bear, Cact%s, Diablo :;99', )sse:;9:, c%rrent stable', 8olso %n#er #evelopent'

?ypervisors+ KEM, Jen, )$Ji 2$*level virt%aliation also s%pporte#, i.e. /JC

"etor!ing o#es+ 8lat bri#ging', E/A" vlan*sitch'

Trying it one or %ltiple servers'+

on free san#bo6 hoste# environent trystac!.org', or locally %sing a #oc%ente# script #evstac!.org'


OpenStac; ,

0ritten in Python

Consists of+Cop%te, "etor!ing, $torage, $hare# $ervices

Manage# thro%gh a #ashboar#

Ipleents on stan#ar# har#are, s%pporte# on A3M


Compute

Provi#es on*#ean# cop%ting resso%rces by provisioning EMs Access thro%gh APIs an# eb 5UIs

$cales horiontally scale*o%t'

$oe feat%res+ Manage CPU, eory, #is!, netor!

Distrib%te# an# asynchrono%s architect%re /ive EM anageent

8loating IP

$ec%rity gro%ps & 3BAC 3ole Base# Access Control'

API ith rate liiting an# a%thentication

3eso%rce %tiliation+ allocating, trac!ing, liiting EM iage anageent & cashing


Storage

$%pports both 2b>ect $torage an# Bloc! $torage+ 2b>ect $torage @ #istrib%te#, API*accessible, scale*o%t storage %se#

by applications, for bac!%p, archiving an# #ata retention static #ata'

Bloc! $torage * enables bloc! storage to be %se# by EMsL s%pportsintegration ith enterprise storage sol%tions i.e. "etApp, "eenta, ...'

$oe feat%res+ Eertical an# horiontal scalability

?%ge & flat naespace

B%ilt*in replication

3AID not re=%ire#

$napshot & Bac!%p API


$etwor;ing

Managing netor!s an# IP a##resses

Pl%ggable, scalable an# API*#riven syste

8lat netor!s & E/A"s

$tatic Ips, D?CP & 8loating IP


Shared !ervice!

Dashboar#+ 5UI for a#ins an# %sers, bran#able Pl%ggable - Fr# party+ billing, onitoring, a##itional anageentI#entity $ervice+ Central #irectory of %sers appe# to services they can access

4%eryable list of all of the services #eploye#Iage $ervice+ provi#es #iscovery, registration an# #elivery services for #is! an#

server iages $tores iages, snapshots, teplates in 2pen$tac! 2b>ect $torage

$%pports folloing iage forats+ ra, AMI, E?D, EDI, =co:,EMDK, 2E8


Service familie!

"ova * Cop%te $ervice

$ift @ 2b>ect $torage $ervice

5lance @ Iage 3egistry & Delivery $ervice

?orion @ User Interface $ervice, Dashboar#6

Keystone @ I#entity $ervice

4%ant% in #evelopent' @Eirt%al "etor! $ervice


$ova

Main part @ clo%# cop%ting fabric controller 2ne of 9st pro>ects, #escen#s fro "A$Aor coponents can be r%n on %ltiple servers #esigne# as

#istrib%te# application' $%pporte# virt%aliation+ KEM, Jen, Citri Jen, )$J-)$Ji, ?yper*E,

4)MU, /in% User Mo#e & Containers

Uses a $4/*base# central #atabase in f%t%re, for larger #eployents,aggregate# %ltiple #ata stores are planne#'


lance

Discovers, registers an# retrieves EM iages Uses 3)$Tf%l API for =%erying & retrieval

$%pports vario%s bac!*en# storage sol%tions+ EM iage canbe store# on siple file systes an# ob>ect storage systes

$ift' Coponents+ 5lance API server, 3egistry $erver, $tore

A#apter

$%pporte# #is! forats+ ra, E?D, EMDK, =co:, EDI,I$2, AMI, A3I, AKI

$%pporte# container forats+ 2E8, AMI, A3I, AKI


6ori5on


7e"!tone

Clo%# i#entity service

provi#es I#entity, To!en, Catalog an# Policy services

ipleents 2pen$tac! I#entity API


8uantum

Eirt%al netor! service "etor!ing as a $ervice6'

$till %n#er #evelopent, to be release# ith the release of8olso6 :Sth $epteber :;9:

Provi#es API to #ynaically re=%est an# config%re virt%al

netor!s

4%ant% API s%pports etensions provi#ing a#vance#netor!ing i.e. Monitoring, 4o$, AC/s, ...'

Pl%gins for 2pen v$itch, Cisco, /in% Bri#ge, "icira "EP,

3y% 2pen8lo, ")C 2pen8lo, Mi#o"et


Advanced !etup


&edundanc"

Coing ith 8olso6

Corosync6 @ open so%rce cl%ster

?ave %ltiple $ift an# "ova servers

Clo%# controller @ single point of fail%re nova*api, nova*netor!'+

3%n %ltiple instances on %ltiple hosts state is save# in DB'

Use --multi host config%ration in "ova'


&ecommendation!

Altho%gh still at an early stage, easier to install b%t still har#to anage an# aintain for a reg%lar a#in, an# having steeplearning c%rve a#ins & %sers', ipleentation iss%ggeste#, at affor#able, saller scale

Ipleent on a c%rrent-o#ern har#are

Keep the !nole#ge %p#ate# Keep softare platfor an# har#are %p#ate# if possible

Monitor & analye costs, available feat%res an# copleity, copare# to b%#get, nee#s an# internal reso%rces available

Asses the ipleentation possibilities base# on the analyses


Source! of %urther Material +,D

http+--.openstac!.org- http+--openneb%la.org-

http+--.%b%nt%.co-

http+--.e%calypt%s.co

http+--.napp*it.org-in#eQen.htl

http+--.clo%#cop%teinfo.co-virt%aliation

http+--.clo%#cop%teinfo.co-private*clo%#s http+--.lin%*!v.org

http+--i!i.=e%.org

http+--.en.org

https+--.virt%albo.org

http+--.vare.co

http+--.icrosoft.co-en*%s-server*clo%#-in#os*server-hyper*v.asp

http+--sartos.org


Source! of %urther Material -,D

Arbr%st, M., et al., :;9;, A Eie of Clo%# Cop%ting, ACM,NF', pp. N;*N. Zhang, 4., Cheng, /., Bo%taba, 3., Clo%# Coop%ting+ state*of*

the*art an# research challenges, o%rnal of Internet $ervices an#Applications, :;9;, 9+S*9.

The 8%t%re of Clo%# Cop%ting+ 2pport%nities for )%ropeanClo%# Cop%ting Beyon# :;9;.

Chapan et. al. :;9;. $oftare architect%re #efinition for on*#ean# clo%# provisioning. In roceedings of the 1'th AC()nternational *$mposium on High erformance +istributed Computing?PDC W9;', :;9;, A Eie of Clo%# Cop%ting, ACM, NF', pp.N;*N.

Ali Babar, M.L Cha%han M.A.L , A tale of igration to clo%#

cop%ting for sharing eperiences an# observations, $)C/2UDW99, ACM.


Source! of %urther Material 3,D

http+--nicira.co- http+--.sigo.co- http+--.reservoir*fpS.e%- http+--.c9:g.co- http+--#sa*research.org-

http+--portal.%c.es-en-eb-en*%c http+--occi*g.org- http+--openneb%la.org-#oc%entation+relF.H+ganglia http+--.nasa.gov- http+--.rac!space.co-

http+--.neb%la.co- http+--.pistonclo%#.co-


Source! of %urther Material ,D http+--.pistonclo%#.co-openstac!*clo%#*softare http+--siftstac!.co- http+--.clo%#scaling.co- http+--.stac!ops.co- http+--.rabbit=.co- http+--.corosync.org- http+--.cl%sterlabs.org- 2pen"eb%la F Clo%# Cop%ting7, 5iovanni Toral#o, Pac!tp%b,

May :;9: )%calypt%s 5%i#es, )%calypt%s $ystes, %n :;9: 6Deploying 2pen$tac!7, Ken Pepple, 2reilly, %ly :;99

2pen$tac! Man%als, #ocs.openstac!.org, May :;9:


Source! of %urther Material D,D

6Ub%nt% )nterprise Clo%# Architect%re7, Technical 0hite Paper, $ion0ar#ley, )tienne 5oyer & "ic! Barcet @ A%g%st :;;R 6B%il#ing a Private Clo%# ith Ub%nt% $erver 9;.; )nterprise Clo%#

)%calypt%s'7, 2$C2" :;9; 6)%calypt%s BeginnerWs 5%i#e7, U)C )#ition, :F Dec :;9;, ohnson D,

KiranM%rari, M%rthy 3a>%, $%seen#ran 3B, ogesh 5iri!%ar 6Dell releases Ub%nt%*poere# clo%# servers7, oab ac!son, ID5 "es

$ervice, "etor!0orl# Intervie at Danish Center for $cientific Cop%ting DC$C', F;th

March :;99 0hite Paper 6Ub%nt% * An Intro#%ction to Clo%# Cop%ting7 Deployent 5%i#e * Ub%nt% )nterprise Clo%# on Dell $ervers $)

0hite Paper 6Ub%nt% )nterprise Clo%# Architect%re7, 0ar#ley, 5oyer,Barcet, A%g%st :;;R 6Practical Clo%# )val%ation fro a "or#ic e$cience User Perspective7,

)#l%n#, Koopans, "oveber :;99.


8ue!tion!

1


Than; "ou

Than! yo% for yo%r attention

$till having =%estions1aba(it%.#!

opa(it%.#!

nordicloud tutorial - building private cloud with oss for scientific environments-libre

Documents

finlandbuilding private

hy private clo

se of private clo

cloud s

it5232018 nordicloud

scientific aca

ropean clo

ting beyon