160629 matthes next generation data centers matthes...two different cloud models • datacenter...

50
Software Engineering für betriebliche Informationssysteme (sebis) Fakultät für Informatik Technische Universität München wwwmatthes.in.tum.de Next Generation Data Centers 29.06.2016, Prof. Dr. Florian Matthes Presentation: 12.03.2015, Dr. Holger Wittges

Upload: others

Post on 28-Feb-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Software Engineering für betriebliche Informationssysteme (sebis) Fakultät für InformatikTechnische Universität München

wwwmatthes.in.tum.de

Next Generation Data Centers29.06.2016, Prof. Dr. Florian MatthesPresentation: 12.03.2015, Dr. Holger Wittges

Page 2: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

1. Next Generation Data Centers

Outline

© sebis160629 Matthes Next Generation Data Center 2

Page 3: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Next Generation Data Center – The foundation forCloud Computing

Cloud ComputingService Provider

Service Consumer

Next Generation Data Center

Vossen, G., T. Haselmann and T. Hoeren (2012).Cloud-Computing für Unternehmen Technische, wirtschaftliche, rechtliche und organisatorische Aspekte.Heidelberg, Dpunkt.verlag.

© sebis160629 Matthes Next Generation Data Center 3

Page 4: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

The Data Center (DC)

DC Services

Staff

SaaS

PaaS

IaaS

DC ComputeStaff

Hardware

Software

DC SpaceStaff Loca-

tion Power Coo-ling

Net-work

Secu-rity

DC in a broader senseDC in a narrow sense

© sebis160629 Matthes Next Generation Data Center 4

Page 5: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

CloudServices

XaaSData CenterServices

Data Center

The Data Center within the Hybrid Cloud Context

Customer/Partner/

Staff Service

Data Center

Company

Customer / Partner /

Staff

CloudServices

(Smart) Device

1

1 (Smart) Device can offer some data center features like compute power, memory for other (smart) devices asdiscussed in the Cloud 2.0 context.

Communication channel

XaaSData CenterServices

basedon

ServiceDefinition

© sebis160629 Matthes Next Generation Data Center 5

Page 6: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Preliminary Conclusions

Need to reinvent to classical Data Center with its§ Data Center Software*§ Data Center Hardware / (Location, Building**)§ Business Model

In order to address the Next Generation Data Centers challenges driven by the shift to „Cloud Computing“

** Out of scope in this talk

*: It's Not Highlander: There Can Be More Than One Open Source Cloudsee: http://readwrite.com/2012/04/05/its-not-highlander-there-can-b (1.3.2015)

© sebis160629 Matthes Next Generation Data Center 6

Page 7: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Cloud Cube

© sebis160629 Matthes Next Generation Data Center 7

http://www.purposefulclouds.com/home/Cloud-Resources/cube-large.png (1.3.2015)

Page 8: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Open Source “Cloud Cube”

© sebis160629 Matthes Next Generation Data Center 8

http://www.purposefulclouds.com/home/Cloud-Resources/cube (1.3.2015)

Page 9: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Selcection of active OpenSource Projects –developing the “Operating System” for NGDC

© sebis160629 Matthes Next Generation Data Center 9

http://opennebula.org/OpenStack-cloudstack-eucalyptus-and-opennebula-which-cloud-platform-is-the-most-open/ (1.3.2015)

Page 10: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Two Different Cloud Models

• Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension of virtualization in the datacenter; hence looking for a vCloud-like infrastructure automation tool to orchestrate and simplify the management of the virtualized resources.

• Infrastructure Provision: On the other side, there are businesses that understand cloud as an AWS-like cloud on-premise; hence looking for a provisioning tool to supply virtualized resources on-demand.

© sebis160629 Matthes Next Generation Data Center 10

Source: http://opennebula.org/eucalyptus-cloudstack-OpenStack-and-opennebula-a-tale-of-two-cloud-models/ (1.3.2015)

Page 11: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

The Perspective of the (Cloud Platform) Developer

OpenStack CloudStack Eucalyptus OpenNebulaDevelopment Model

Public development

Public development

Public development

Public development

Developer Engagement

Contributor license agreement

Contributor license agreement

Contributor license agreement

Contributor license agreement

Governance Model Foundation Technical

meritocracyBenevolent dictator

Benevolentdictator

© sebis160629 Matthes Next Generation Data Center 11

http://opennebula.org/OpenStack-cloudstack-eucalyptus-and-opennebula-which-cloud-platform-is-the-most-open/ (1.3.2015)

Page 12: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

The Perspective of the User

OpenStack CloudStack Eucalyptus OpenNebulaAPI Ecosystem

OpenStackAPI Amazon API Amazon API Amazon API

Production Readiness

No, only available through any of the several vendor specific “stacks”

Enterprise-ready and direct support from developers

Enterprise-ready and direct support from developers

Enterprise-ready and direct support from developers

© sebis160629 Matthes Next Generation Data Center 12

http://opennebula.org/OpenStack-cloudstack-eucalyptus-and-opennebula-which-cloud-platform-is-the-most-open/ (1.3.2015)

Page 13: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Comparison

While

• Eucalyptus and OpenNebula serve the needs of the users,

• CloudStack better serves the needs of the developers, and

• OpenStack serves the needs of the vendors, so they have a technology base and a marketing brand to build their own cloud stacks.

(Ignacio M. Llorente, http://www.c12g.com/ )

© sebis160629 Matthes Next Generation Data Center 13

http://opennebula.org/OpenStack-cloudstack-eucalyptus-and-opennebula-which-cloud-platform-is-the-most-open/ (1.3.2015)

Page 14: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

http://docs.OpenStack.org/icehouse/install-guide/install/apt/content/ch_overview.html (last access: 22.4.14)

OpenStack Architecture April 2014

© sebis160629 Matthes Next Generation Data Center 14

Page 15: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Example: UltiCloud – Services based on OpenStack

https://ulticloud.com/services/ (last access: 22.4.14)

For simular offeringssee for example:

amazon (aws),Cloudwatt,DreamCompute,eNocloud, HP, IBM, Rackspace, etc.

© sebis160629 Matthes Next Generation Data Center 15

Page 16: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

UltiCloud

https://ulticloud.com/price-list/credit-pricing/ (last access: 22.4.14)

© sebis160629 Matthes Next Generation Data Center 16

Page 17: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

UltiCloud

https://ulticloud.com/price-list/contract-pricing/ (last access: 22.4.14)

© sebis160629 Matthes Next Generation Data Center 17

Page 18: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Open Compute - Mission Statement

The Open Compute Project Foundation is a rapidly growing community of

engineers around the world whose mission is to design and enable the delivery

of the most efficient server, storage and data center hardware designs for scalable computing

http://www.Open Compute.org/about/mission-and-principles/ (25.4.2014)

© sebis160629 Matthes Next Generation Data Center 18

Page 19: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Open Compute - Principles

The technologies behind data centers are understood by their users —they know what they need and want, and can innovate; collaboration between these users and technology developers is the best way to openly create and develop opportunities for innovation in this space. This community should make big plans and aim high.

We strive to enable the development of the most efficient servers, storage and

data center infrastructure from a useful work per total cost perspective, in order to bring computing to people at the lowest cost and widest distribution.

Open Source Software and Hardware will serve to democratize access to the best server, storage and data center technologies available. The focus of this project is on open technologies that can be multi-sourced.Community benefit for all of our participants—contributors, consumers and technology suppliers— is paramount in order to accelerate innovation and maximize opportunity throughout the Open Compute community.

Interoperability and compliance are crucial for scaling effectiveness. We will work with industry standards bodies to help strike a balance between modularity and customization as needed.Transparency of processes, including communications, promotes participation, respect, honesty and trust.

http://www.Open Compute.org/about/mission-and-principles/ (25.4.2014)

© sebis160629 Matthes Next Generation Data Center 19

Page 20: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Example Server – based on Open Compute Specifications

© sebis160629 Matthes Next Generation Data Center 20

http://semiaccurate.com/2013/01/16/amd-details-open-compute-server-ecosystem/ (10.3.2015)

Page 21: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

The Open Compute Project – Areas (1/3)

http://www.Open Compute.org (25.4.2014)

© sebis160629 Matthes Next Generation Data Center 21

Page 22: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

The Open Compute Project – Areas (2/3)

http://www.Open Compute.org (25.4.2014)

© sebis160629 Matthes Next Generation Data Center 22

Page 23: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

The Open Compute Project – Areas (3/3)

http://www.Open Compute.org (25.4.2014)

© sebis160629 Matthes Next Generation Data Center 23

Page 24: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Usage of an enhanced cloud service

Watzl, J. (2013). A Framework for Exchange-Based Trading of Cloud Computing Commodities. Munich, LMU. PhD (Page 31)

Enhancement

© sebis160629 Matthes Next Generation Data Center 24

Page 25: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Switching cloud providers

Watzl, J. (2013). A Framework for Exchange-Based Trading of Cloud Computing Commodities. Munich, LMU. PhD (Page 35)

© sebis160629 Matthes Next Generation Data Center 25

Page 26: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Components of an exchange for cloud computing commodities

Watzl, J. (2013). A Framework for Exchange-Based Trading of Cloud Computing Commodities. Munich, LMU. PhD (Page 73)

© sebis160629 Matthes Next Generation Data Center 26

Page 27: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Deutsche Börse Cloud Exchange (DBCE)

© sebis160629 Matthes Next Generation Data Center 27

Page 28: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

How to buy and use cloud resources from DBCE

Exchange Clearing Settlement Deploy

DBCE Marketplace (Trading & Settlement instruction):Link: https://www.trade-the-cloud.com/cloudex/loginUsername: ####

DBCE ECO (Settlement & VM Management):Link: https://consumer21.dbcloudexchange.netUsername master account: #######

Test access availiblefor TUM until 12/2014

© sebis160629 Matthes Next Generation Data Center 28

Page 29: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Request: 4 PU, 16 GB, 500 GB HDD – openDisplay: Inventory

Real Case:§ 4 CPU§ 16 GB, RAM§ 500 GB, HDD

© sebis160629 Matthes Next Generation Data Center 29

Page 30: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Resources are now availible to create virtualmachines…

© sebis160629 Matthes Next Generation Data Center 30

Page 31: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

VM Overview

© sebis160629 Matthes Next Generation Data Center 31

Page 32: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Create a virtual machine for PlexMedia Server 01

© sebis160629 Matthes Next Generation Data Center 32

Page 33: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

© sebis160629 Matthes Next Generation Data Center 33

Page 34: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Availible Resources @ Heat & Cloud

Default behavior:

Factor 5overprovisioning

© sebis160629 Matthes Next Generation Data Center 34

Page 35: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Create the VM using the Pubic Key

© sebis160629 Matthes Next Generation Data Center 35

Page 36: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

The VM is created…

© sebis160629 Matthes Next Generation Data Center 36

Page 37: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

VM PlexMedia_02 is running in the cloud…

© sebis160629 Matthes Next Generation Data Center 37

Page 38: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Trends for Next Generation Data Centers

Commodity (for example*: OpenStack, Open Compute)

Automatisation (for example: OpenStack, DBCE)

Interoperability (for example: OpenStack, Open Compute, DBCE)Standardisation (for example: OpenStack, Open Compute)

End to End Monitoring (for example: OpenStack, DBCE)

Virtualisation (for example: OpenStack, DBCE)

Service Management (for example: OpenStack, DBCE)

*examples based on this presentation

© sebis160629 Matthes Next Generation Data Center 38

Page 39: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

There is no „One“ Cloud

SAP CloudAmazon Cloud

IBM Cloud

Company ZCloud

Supplier ACloud

Supplier BCloud

Customer XCloud

Customer YCloud

Explanation

FirewallCloud

IP Up-/DownlinkPublic IP Backbone

* own figure© sebis160629 Matthes Next Generation Data Center 39

Page 40: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

There is no „One“ Cloud

SAP CloudAmazon Cloud

IBM Cloud

Company ZCloud

Supplier ACloud

Supplier BCloud

Customer XCloud

Customer YCloud

Explanation

FirewallCloud

IP Up-/DownlinkPublic IP Backbone

* own figure© sebis160629 Matthes Next Generation Data Center 40

Page 41: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

IBM Cloud Services “Cloud Cube”

© sebis160629 Matthes Next Generation Data Center 41

http://purposefulclouds.blogspot.de/ (1.3.2015)

Page 42: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Microsoft Azure “Cloud Cube”

© sebis160629 Matthes Next Generation Data Center 42

http://www.purposefulclouds.com/home/partners/azure-cube.jpg (1.3.2015)

Page 43: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Information model for a cloud computing commodities exchange

Watzl, J. (2013). A Framework for Exchange-Based Trading of Cloud Computing Commodities. Munich, LMU. PhD (Page 75)

© sebis160629 Matthes Next Generation Data Center 43

Page 44: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Usage of aggregated cloud services

Watzl, J. (2013). A Framework for Exchange-Based Trading of Cloud Computing Commodities. Munich, LMU. PhD (Page 31)

© sebis160629 Matthes Next Generation Data Center 44

Page 45: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Github – OpenStack / horizon

© sebis160629 Matthes Next Generation Data Center 45

https://github.com/OpenStack/horizon/graphs/contributors (12.3.2015)

Page 46: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Github – apache / cloudstack

© sebis160629 Matthes Next Generation Data Center 46

https://github.com/apache/cloudstack/graphs/contributors (12.3.2015)

Page 47: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Github – OpenNebula / one

© sebis160629 Matthes Next Generation Data Center 47

https://github.com/OpenNebula/one/graphs/contributors (12.3.2015)

Page 48: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Github – eucalyptus

© sebis160629 Matthes Next Generation Data Center 48

https://github.com/eucalyptus/eucalyptus/graphs/contributors (12.3.2015)

Page 49: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Information model for a cloud computing commodities exchange

Watzl, J. (2013). A Framework for Exchange-Based Trading of Cloud Computing Commodities. Munich, LMU. PhD (Page 75)

© sebis160629 Matthes Next Generation Data Center 49

Page 50: 160629 Matthes Next Generation Data Centers Matthes...Two Different Cloud Models • Datacenter Virtualization: On one side, there are businesses that understand cloud as an extension

Technische Universität MünchenDepartment of InformaticsChair of Software Engineering for Business Information Systems

Boltzmannstraße 385748 Garching bei München

Tel +49.89.289.Fax +49.89.289.17136

wwwmatthes.in.tum.de

Florian MatthesProf.Dr.rer.nat.

17132

[email protected]

Thank you for your attention. Questions?