orran krieger: vmware vcloud deck

1

Cloud Computing

Orran KriegerSenior Staff Engineer, VMware, Inc.Lead Kvetcher VMware Cloud teamAdjunct Professor CMU

Wednesday, April 15, 2009

2

Outline

• Background on VMware• Cloud computing today• What should it be• The vCloud initiative• Research ideas


3

Evolution of VirtualizationPHYSICAL


3

Evolution of VirtualizationVIRTUALIZEDPHYSICAL


3

HW HW HW HW HW

HW HW HW HW HW

HW HW

HW HWHW

HW

HWHW

Evolution of VirtualizationVIRTUALIZEDPHYSICAL POOLED

Logical Resource Pooling (RP)Distributed Resource Scheduler (DRS)


3

HW HW HW HW HW

HW HW HW HW HW

HW HW

HW HWHW

HW

HWHW

Evolution of VirtualizationPOOLED

RP1

RP2

Logical Resource Pooling (RP)Distributed Resource Scheduler (DRS)


4

Power Savings with DPM

0

200

400

600

800

1000

1200

1400

1600

1800

2000

Wat

ts

• 5 hour VMmark run• 110 VMs, 4 server cluster


4


0

200

400

600

800

1000

1200

1400

1600

1800

2000

Wat

ts

No DPM



4


50% Savings during VMmark

0

200

400

600

800

1000

1200

1400

1600

1800

2000

Wat

ts

No DPM

With DPM



5

Distributed Virtual Switch

distribution

core

access

hosts


5


• Network-centric view: virtualization blurs the host/network boundarydistribution

core

access

hosts

VMs


5


• Network-centric view: virtualization blurs the host/network boundary

• Virtual network switches and topologies within a host

• VMs can move anywhere • The virtual network switch is

a new access layer.

distribution

core

access

hosts

VMs


5





a new access layer. • Network administrators can

no longer rely on physical port-based access control

distribution

core

access

hosts

VMs


5





a new access layer. • Network administrators can

no longer rely on physical port-based access control

distribution

core

access

Distributed virtual switch to extend network access control and management to virtual environments

hosts

VMsDistributed Virtual Switch


6

Availability

Hot-plug resources


6

Availability

Hot-plug resources Add/remove capacity on demandImprove application availability


7

Production Recovery

Site Recovery Manager transforms disaster recovery

VMware InfrastructureVMware Infrastructure

Site Recovery Manager


8

Application

Operating SystemProtection

Engine

VMware Infrastructure

Security: VMware VMsafeAPI that enables protection of VMs by inspection of virtual components in conjunction with hypervisor Isolation of protection engine from malwareBroad ranging coverage of virtual machine CPU, memory, storage


9

vApp: A new type of Software

• Properties• Policy-based operations• Multi-tier• Distributed as an OVF

package

• Built by:• ISVs / Virtual Appliance

Vendors• By internal IT shops• By IT administrators• SI/VARs

SAP

TomcatFireWall

Policies1. Product: eCommerce2. Topology3. Resources Req: CPU, Mem,

Disk,Bandwidth4. Only port 80 is used5. DR RPO: 1 hour6. VRM: Encrypt w/ SHA-17. Decommission in 2 month

WebsphereExchange


10

Desktops

VMwareInfrastructure 3

CentralizedVirtual DesktopsVirtual Desktop Infrastructure (VDI)


10

Desktops

VMware VirtualDesktop Manager

VMwareInfrastructure 3

Thick or ThinClients

CentralizedVirtual DesktopsVirtual Desktop Infrastructure (VDI)

• Full desktops run as VMs in the data center • Connect securely to desktop from anywhere• Centralized management• More efficient resource usage• Higher availability• Online and offline mode


11

Evolution of Virtualization

CapacityOn Demand

Hypervisor

Management

VirtualInfrastructure

AutomateSeparate Consolidate Aggregate

Self-Managing Datacenter

Server Consolidation

Test and Development

Cloud ScaleComputing

Hypervisor Hypervisor

Management

Hypervisor

Management


Automation

Liberate

CapEx Savings

OpEx Savings Business Agility

Hypervisor

Management


Automation

No Physical Boundaries


12

The cloud started with SaaS/Web

Develop Test Release Install Configure Operate

Develop Test Operate

Traditional software model

SaaS model


13

The reality: success is very hard

Test OperateDevelop


13


• Most SW companies don’t have the in-house skill to operate at scale: • e.g. loadbalancer, network config, security, disaster recovery, …&

70% of investment spent not enhancing application

Test OperateDevelop


13



70% of investment spent not enhancing application• Enormous investment required in application level to

scale.

Test OperateDevelop


13



70% of investment spent not enhancing application• Enormous investment required in application level to

scale.• So, successful SaaS vendors started building re-usable

platforms…

Test OperateDevelop


14

Cloud offerings• Software as a Service (SaaS):

• Application hosted in the cloud.• e.g., gmail, google apps, salesforce.com, wikipedia…

• Platform as a Service (PaaS): • Application development environment and runtime hosted

in cloud. • e.g., engine yard, Google App Engine, Force.com

• Infrastructure as a Service (IaaS): • Developers/administrators obtain general computing,

storage, messaging services…• e.g., terramark, Amazon AWS, Mosso


15

Example Amazon IaaS


16

Example

• Animoto April 2008: Peak EC2 instances: • Mon 50, Tues 400, Wed 900, Friday 3400


17

The problems with this evolution• Vertical offered by a single vendor

• Just a few hundred/thousand developers enhancing offering• No on-premise offering for enterprise/university/SaaS vendor• Who wants to trust a single company?

• Limited largely to web applications:• Limited support legacy, HPC, hosted client, grid,

• Disintermediates OEMs, infrastructure vendors, traditional management stacks… (VARs for SaaS)

• Ignores the key value in the virtualization needed for general purpose workloads: over provisioning, SRM, DRS, DPM, OVF, SVI …


18

Disclaimer…


18

Disclaimer…

• At this point, there is the mandatory… okay there is a lot of hype here, but…


18

Disclaimer…

• At this point, there is the mandatory… okay there is a lot of hype here, but…

• The transformation is more profound that is yet understood, cloud done right will:• be used for all applications, • change how we deploy and develop applications, • enable new OSes, new programming models, new servers,

new storage solutions• enable new markets for computer services• …, in other words, its gonna change everything


19

What do we really want


19


Original vision of Utility/grid computing:


19


Original vision of Utility/grid computing: ”If computers of the kind I have advocated become the computers of the

future, then computing may someday be organized as a public utility just as the telephone system is a public utility... The computer utility could become the basis of a new and important industry.”


19




John McCarthy, MIT Centennial in 1961


19




John McCarthy, MIT Centennial in 1961

Virtualization converts computation into a fungible commodity


20

Why would this be transformative

• Nicholas Carr: • “As with the factory-owned generators that dominated

electricity production a century ago, today's private IT plants will be supplanted by large-scale, centralized utilities.”

• Gets rid of key impediments to innovation:• Virtual appliance model for distributing installing

applications.• Avoids need for broad HCL, OS support, …• Availability of massive capacity on demand.

• Enables long-tail in SW


21

VMware’s vCloud initiative• Provide SW so that anyone can easily

create cloud: e.g., SP, University, Enterprise• Supports all applications• Controlled programmatically:

• From VMs, from capacity owner, from portal• OVF based API

• Can scale up to massive data centers.• Can scale down to small department.• Can be accessed from VI Client• New end user interface provide simple self

service experience.• Enable broad partner and research

collaboration:• Researchers can replace any part of the service.• Researchers can replace the entire implementation

and clone the API


21







and clone the API

vCloud Software


21







and clone the API

vCloud Software

vCloud API


21







and clone the API

vCloud Software

vCloud API

VI Client


21







and clone the API

vCloud Software

vCloud API

Self-service UI VI Client


21







and clone the API

vCloud Software

vCloud API

Self-service UI VI Client

Alternative Implementation


22

Key abstractions vCloud

Organization 1

vApp

VDC 1

“bar”(isolated)

vApp

VDC 2

“VDCnet”

“VDCnet” (fenced)

ND

Mapped as network adapters into installation

“foo”

“Private”

“Public”

ND

• Organization with users/roles

• Cloud to admin on his own terms:• data centers• L2 networks• Persistent VMs• SLA on vApp• overprovisioning• ...

• OVF based REST API:• multi-tiered applications• serialized using OVF• configuration via OVF


23

Key abstractions vCloud UI & API

Organization 1

vApp

VDC 1

“bar”(isolated)

vApp

VDC 2

“VDCnet”


ND“foo”

“Private”

“Public”

ND

Same color means same network

Organization 2

vApp

VDC 1

“bar”(isolated)

vApp

VDC 2

“VDCnet”


ND“foo”

“Private”

“Public”

ND


24

It should be easy, VMware already has• Rich service provider, OEM, ISV partner

ecosystem• API for controlling virtualization that has

become a defacto standard• Ability to deal with large numbers of hosts as a

pool of resources• Support for backup, DR, resource management,

power management, …• Rich community of users• Rich user interface loved by administrators• …


25

Not so fast…• Problems with our existing technology:

• Core abstractions exposed physical as well as virtual• Scaling up to 10000 hosts & 100K VMs fundamentally different• Security more of a issue in multi-tenancy environment

• Challenges with our approach:• Need to scale down• Need to enable partner ecosystem:

• No one circumscribed approach.• Need to release SW to others to install, configure…• Need to enable others to innovate.


26

Difference between small & large scale


27

Scale up versus down• Large scale service: Service Oriented Architecture

• Each service totally independent with own DB, own set of machines… all communication through interface:

• Advantages• Fails independently & can identify failures• Own reliability based on requirements of data• Can evolve services independently• Can scale them independently

• Small scale: shrink wrapped software• Single general purpose piece of software• Advantages:

• Minimize overhead• Simplified installation


28

Modular designLarge Scale

Modularity also enables extensibility


28

Modular designLarge Scale Small Scale



28

Modular designSmall Scale



29

Key TechnologiesREST API : HTTP based resource oriented interface; All the characteristics of the WWW• Extensible without breaking client.• Client only has to know about what it cares about.• Can route, proxy, cache

Spring: Standard component framework • Injects dependencies and wires together Spring beans• Forces programmer into maintainable design pattern; isolates dependencies

OSGI: Standard dynamic module framework• Global registry of interfaces to instances• Dynamically load, unload, start, stop bundle

Other technology• JMS publish/subscribe messaging bus isolates end points• Hibernate simplifies DB code & DB independence


30

Architecture/Implementation

vCloud OSGIMgmtCell

Self Service UI

VMRCvCloud Client

Substrate Mgmt

Substrate

BillingUser/

AccountMgmt

vCloud API client

Message BusModel DB Inventory DB

Transfer

Loadbalancer

ESX hosts Running VM storage Offline storage

VC InventoryListener Validator Diff

Networking

VMRCProxy

NetworksrvcNetwork

srvcNetwrksrvc

CatalgImagexfer

NetworkHandler

vCloudApplication

Rest dispatcher

TaskMgr

vRPMgr

Blaze DS

StorageMgr

Cloner

VC Invent

VC Control

IP PoolMgr

SecurityMgr

AuthntMgr

SchedTasksDirectory


30


vCloud OSGIMgmtCell

Self Service UI

VMRCvCloud Client

Substrate Mgmt

Substrate

BillingUser/

AccountMgmt

vCloud API client


Transfer

Loadbalancer



Networking

VMRCProxy

NetworksrvcNetwork

srvcNetwrksrvc

CatalgImagexfer

NetworkHandler

vCloudApplication

Rest dispatcher

TaskMgr

vRPMgr

Blaze DS

StorageMgr

Cloner

VC Invent

VC Control

IP PoolMgr

SecurityMgr

AuthntMgr

SchedTasksDirectory



Networking


30


vCloud OSGIMgmtCell

Self Service UI

VMRCvCloud Client

Substrate Mgmt

Substrate

BillingUser/

AccountMgmt

vCloud API client


Transfer

Loadbalancer



Networking

VMRCProxy

NetworksrvcNetwork

srvcNetwrksrvc

CatalgImagexfer

NetworkHandler

vCloudApplication

Rest dispatcher

TaskMgr

vRPMgr

Blaze DS

StorageMgr

Cloner

VC Invent

VC Control

IP PoolMgr

SecurityMgr

AuthntMgr

SchedTasksDirectory



Networking

VMRCProxy

NetworksrvcNetwork

srvcNetwrksrvc

CatalgImagexfer

NetworkHandler

vCloudApplication

Rest dispatcher

TaskMgr

vRPMgr

Blaze DS

StorageMgr

Cloner

VC Invent

VC Control

IP PoolMgr

SecurityMgr

AuthntMgr

SchedTasksDirectory


30


vCloud OSGIMgmtCell

Self Service UI

VMRCvCloud Client

Substrate Mgmt

Substrate

BillingUser/

AccountMgmt

vCloud API client


Transfer

Loadbalancer



Networking

VMRCProxy

NetworksrvcNetwork

srvcNetwrksrvc

CatalgImagexfer

NetworkHandler

vCloudApplication

Rest dispatcher

TaskMgr

vRPMgr

Blaze DS

StorageMgr

Cloner

VC Invent

VC Control

IP PoolMgr

SecurityMgr

AuthntMgr

SchedTasksDirectory

VMRCProxy

NetworksrvcNetwork

srvcNetwrksrvc

CatalgImagexfer

NetworkHandler

vCloudApplication

Rest dispatcher

TaskMgr

vRPMgr

Blaze DS

StorageMgr

Cloner

VC Invent

VC Control

IP PoolMgr

SecurityMgr

AuthntMgr

SchedTasksDirectory


30


vCloud OSGIMgmtCell

Self Service UI

VMRCvCloud Client

Substrate Mgmt

Substrate

BillingUser/

AccountMgmt

vCloud API client


Transfer

Loadbalancer



Networking

VMRCProxy

NetworksrvcNetwork

srvcNetwrksrvc

CatalgImagexfer

NetworkHandler

vCloudApplication

Rest dispatcher

TaskMgr

vRPMgr

Blaze DS

StorageMgr

Cloner

VC Invent

VC Control

IP PoolMgr

SecurityMgr

AuthntMgr

SchedTasksDirectory


30


vCloud OSGIMgmtCell

Self Service UI

VMRCvCloud Client

Substrate Mgmt

Substrate

BillingUser/

AccountMgmt

vCloud API client


Transfer

Loadbalancer



Networking

VMRCProxy

NetworksrvcNetwork

srvcNetwrksrvc

CatalgImagexfer

NetworkHandler

vCloudApplication

Rest dispatcher

TaskMgr

vRPMgr

Blaze DS

StorageMgr

Cloner

VC Invent

VC Control

IP PoolMgr

AuthntMgr

SchedTasksDirectory


30


vCloud OSGIMgmtCell

Self Service UI

VMRCvCloud Client

Substrate Mgmt

Substrate

BillingUser/

AccountMgmt

vCloud API client


Transfer

Loadbalancer



Networking

VMRCProxy

NetworksrvcNetwork

srvcNetwrksrvc

CatalgImagexfer

NetworkHandler

vCloudApplication

Rest dispatcher

TaskMgr

vRPMgr

Blaze DS

StorageMgr

Cloner

VC Invent

VC Control

IP PoolMgr

AuthntMgr

SchedTasksDirectory

SecurityMgr


Research directions• New operating systems:

• e.g., for Java, security services, clustering services, HPC/multi-core, ...

• library OS, multi-core, accelerator to OS, sharing• Fungible computing:

• performance, cost to user, cost to SP• Grid/HPC/batch scheduling, e.g., snowflock• Federation:

• long tail for data de-duplication, encryption/security for data, trading floor/futures market, vmotion to user

• What changes when your desktop is in the cloud?• Mom’s sysadmin, Fusion on steroids, disaster recovery...

31


32

Concluding reports

• Cloud computing is going to be transformative to our industry

• VMware building a platform so that anyone can play

• There are a wealth of research opportunities• We will be providing the SW to universities

this year• This is just the start...


orran krieger: vmware vcloud deck

Technology

virtual environments

network access control

network administrators

host access vms

protection of vms

core virtualization

power savings

availability hot