cloud orchestration - cisco.com orchestration and automated provisioning developers track and manage...

Cisco Confidential© 2010 Cisco and/or its affiliates. All rights reserved. 1

Cloud Orchestration

René Raeber

Datacenter Architect

IEEE-802.1 DCB Architect

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2

Introduction

Architecture Evolution

Cloud

Intelligent Automation Stack

Cisco Private Cloud Example

Summary Conclusion

Q&A


3

Server virtualization —higher performance

LAN and Storage convergence

VM-Level awareness

Workload provisioning

Applications availability

Drive for Green—power, cooling and space

The need to reduce costs and/or maximize profits

IT as business enabler


Highly Virtualized

Atomic Unit Changing

More powerful x86 servers

Networks Converging

Power Efficiency

Cloud Computing


1960 1970 1980 1990 2000

Mainframe

Client Server

ASP/SaaS

Cloud?

Minicomputer/PC


Data Center Networking

Unified Fabric Architecture

Unified Computing

Inter-Cloud

Enterprise-Class Clouds

Consolidation Virtualization Automation Utility Market

Five-Phase Plan


Introduction


Cloud



Summary Conclusion

Q&A


Unified

Fabric

Primary

Network

Secondary

Network

Universal I/O

Ubiquitous Connectivity

Complexity,

Cost, Power

Data Center Framework


UCSLegacy

Server = ResourceServer = Application

Inefficient Complex High Cost Fragile Efficient Agile Transformative

Management and Control

Primary Network

Secondary Network

SAN A

SAN B

The Right Solution at the Right Time


From ad hoc and

inconsistent…

…to structured, but siloed,

complicated and costly…

…to simple, optimized and

automated


SAN LAN

Dynamic resource provisioning

Virtualization at scale


WAN / SP


Servers directly connected to access layer switches

Very little virtualization

Network configuration and policy enforcement for the server done at the switch

All management primarily at the physical element level

Management of Physical ( ) Elements


Shift towards server virtualization

Multiple VMs inside each physical server, connected by virtual switches

Rapid proliferation of logical elements that need to be managed

Feature parity issues between virtual and physical elements

Separate management of physical ( ) and logical ( ) elements

VMs

vNICs

VSwitch

VMs

vNICs

VSwitch

VMs

vNICs

VSwitch

VMs

vNICs

VSwitch

Management Challenges Policy Enforcement Issues


Switch lacks visibility into packets originated by vNICs

Can‟t tie packet back to VM, forcing reliance on the software switch for policy enforcement

Leads to policy enforcement and network management issues

Access layer switch lacks visibility into virtual network elements

VMs

vNICs

VSwitch

VMs

vNICs

VSwitch

VMs

vNICs

VSwitch

VMs

vNICs

VSwitch

Management Challenges Policy Enforcement Issues


Virtual Interfaces within VMs are now visible to the switch

Both network configuration and policy enforcement for these interfaces can now be driven from the switch

This allows consolidated management of physical and virtual elements

Consolidated management of physical ( ) and logical elements

VSwitch VSwitch

VN-Link: Consolidated Management

VMs

vNICs

VSwitch

VMs

vNICs

VSwitch

VMs

vNICs

VMs

vNICs


VN-Link allows the packets to be tagged

Switch has full visibility into which vNIC originated the packet

Allows switch to forward packets between both physical and virtual elements

VN-Link capable adapters allow bypassing software based switches

Full visibility into the virtual network elements from switch

VSwitch VSwitch

VN-Link: Consolidated Policy Enforcement

VMs

vNICs

VSwitch

VMs

vNICs

VSwitch

VMs

vNICs

VMs

vNICs


18

• VEB (Virtual Embedded Bridge)

• VEPA (Virtual Ethernet Port Aggregator) IEEE-802.1Qbg

• PE (Virtual Bridge Port Extension) IEEE-802.1BR

Other Datacenter Standards:

IEEE-802.1Qau Congestion Notification

IEEE-802.1Qaz Enhanced Transmission Selection

IEEE-802.1Qbb Priority based Flow Control

IEEE-802.1Qbg Edge Virtual Bridging

IEEE-802.1BR Virtual Bridge Port Extension

IEEE-802.3bd MAC Control Frame for Priority based Flow control

…


Introduction


Cloud



Summary Conclusion

Q&A


• Lack of agility

• High cost of IT staff

• Business-it dissonance

Long Provisioning Times for New Services

Lack of

IT-Business

Alignment

• Low capacity utilization

• High operating costs

• Overcrowding of datacenter

• Labor-intensive, manual processes for service management

Pressure to Move Towards Proactive SLA Management

Lack of Centralized Control and Governance

• High error rates due to disconnected processes

• Infrastructure sprawl

High Capital Costs Due to Provisioning for Peak Loads


Complex

Inefficient

Inflexible

Costly

72%Maintain

28%Invest


1,240,036,374,697,152,065,225

Data Created Since Jan 1 2010

Bytes.

10 up21 aka sextillion aka trilliard


75,000,000,000 iPads

125,000,000 years


The Tipping Point

17,500,000

Physical Hosts

2006 2007 2008 2009 2010 2011 2012 20132005

VM Cross Over

15,000,000

12,500,000

10,000,000

7,500,000

5,000,000

2,500,000

Virtual Machines


Value

Waste

Value55%

Waste45%


?IT impedes growth IT spends too muchor,

Deploy this Much?

But, need this?

Deploy this Much?

But, need this?


Fixed Cost

Variable Cost


The “Cloud” is the default

symbol of the internet in

diagrams.

The broader term of “Computing”

encompasses:

- Computation

- Coordination logic

- Storage

Cloud Computing is about moving computing from

the single desktop pc/data centers to the internet.

Cloud Computing


Public Cloud

Private Cloud

Infrastructure as a Service

Platform as a Service

Software as a Service

Qo

S M

ete

rin

g

SL

A N

eg

oti

ati

on

Ad

mis

sio

n C

on

tro

l

Pri

cin

g a

nd

Bil

lin

g

Ac

co

un

tin

g

Pro

vis

ion

ing

The entire stack (hw & sw) is leveraged to the internetIaaS VMWare, Amazon EC2, etc.

PaaS Google AppEngine, Microsoft Azure, etc.

SaaS SalesForce, Webex, etc.

Computing becomes a real utility used by all the masses


Introduction


Cloud



Summary Conclusion

Q&A


Cost

Utilization

Consolidation

Scale

Availability

Predictability

IT agility

IT competitiveness

IT as a Service

BU charge Back

Bu

sin

ess D

rive

rs

Cost/ROI

DR/BC

Overflow/

Burst Cap

Server

Virtualization

Hybrid

Cloud

PODs

e.g. Vblock

Private

Cloud

Transition Stages

Simple Application Sophisticated

Resource Provisioning

Orchestration

Security

Compliance

Acceptable SLAs

2 431

2

4

3

1

3rd-Party Integration• ITSM Workflow

• CMDB

Service Assurance

Service Delivery

SP Services

Infrastructure

Dev/Test

R&D

App Testing

Pre-production

Production

DR/BC

Demand Driven

Web Farms

Portals

Infrastructure Services

Critical Apps

By Function

By Department

By Application Type


Cost

Utilization

Consolidation

Scale

Availability

Predictability

IT agility

IT competitiveness

IT as a Service

BU charge Back

Bu

sin

ess D

rive

rs

Cost/ROI

DR/BC

Overflow/

Burst Cap

Server

Virtualization

Hybrid

Cloud

PODs

e.g. Vblock

Private

Cloud

Transition Stages

Simple Application Sophisticated

Resource Provisioning

Orchestration

Security

Compliance

Acceptable SLAs

2 431

2

4

3

1

3rd-Party Integration• ITSM Workflow

• CMDB

Service Assurance

Service Culture

Metering/Billing

Service Catalog

SP Services

Infrastructure

Dev/Test

R&D

App Testing

Pre-production

Production

DR/BC

Demand Driven

Web Farms

Portals

Infrastructure Services

Critical Apps

By Function

By Department

By Application Type

Automation

Requirement

Automation Threshold

Inefficiency Tolerance Zone


• Self-Service Interface: Provides ability for users to order and track metered services

• Service Delivery Automation:Automates provisioning and meters usage of services

• Resource Management:Resources are provisioned and managed as per service needs

• Operational Process Automation:Automates operational processes such as user management, capacity management, service level management, service desk integration, alerting…

• Lifecycle Management Lifecycle Management of Cloud Services

• Dynamic resource allocation

• Capacity management

• Resource utilization

• Performance management

• Maintenance

Standardized

offerings

Very fast

provisioning/

de-provisioning

of resourcesMetered

usage

Web-based

front end

Automated

fulfillment

Broad Network Access

RapidElasticity

Measured Service

On-Demand Self-Service

Resource Pooling


Cisco Intelligent Management Platform

Events/Alerts

Cisco Unified Client Services Framework

• Business Services• Value-Added Services

Cisco Abstraction Layers

Operational & Delivery

Service ModelsConfigurationChanges

Incident Analysis

Pre-Defined Best Practices

Services Orchestration

Policy Driven Automation

Network

OverDrive

Compute

OpenStack, Vmware

Storage

EMC, NetApp

Physical

UCS Profiles

SaaS VDI/VXICloud

IaaS

PaaSUnified

Comm

Enterprise Private

Clouds

Cisco

PartnersProprietary

Clouds

Corrective & Preventive Actions

Services and Applications (TES, SAP, Oracle, Custom, etc)


CMDB

IT Service Management

Tools

Cis

co

In

telli

ge

nt A

uto

ma

tio

n f

or

Clo

ud

Service Catalog and Self-Service Portal Cisco Cloud Portal

Global OrchestrationCisco Process Orchestrator

Integration Framework

OS/Software Provisioning

Cisco Server Provisioner

Virtualization Managers

VMware vCenter, vCloud Director,

HyperV, Xen, AIX, ...

Clo

ud C

onte

nt

Au

tom

ation &

Po

rtal

Compute and Storage

ManagersUCS Manager,

EMC UIM, NetApp DFM, ...

Compute Resources

Virtual Infrastructure

Network Resources

Storage Resources

Billing/Chargeback

Monitoring and Governance

Public Cloud:Amazon, Savvis,

Terremark

Network Container

ProvisioningNetwork Services

Manager


Application Development IT Infrastructure/Ops

Complex, Time-Consuming, Expensive Provisioning Process

Call or email IT Operations

ArchitectureReviews

ApprovalProcess

Track Down Status

?

?

One-OffCustom Server

Builds

IncompleteRequirements

Add Security,Back-UP, etc.

ExceptionManagement

$

?

?

?


Service OrchestrationEnd User Self-Service Governance

Service Requests

Compare Service Tiers and Options

Guided Shopping „Wizard‟

Policy-Based Controls

Rich Interactive

Forms

Ordering and Approvals

Status Updates

Cisco Process Orchestrator

Element Managers

Cisco Cloud Portal

GlobalOrchestration

UCS Manager

VMWarevCenter

EMC/ NetAppStorage

Provisioning

Cisco Server Provisioner


Lifecycle Management

Policies &

GovernanceApprovals & Controls

Management

Security

Operations

DR

Orchestrate

Delivery

Process Orchestration and

Automated Provisioning

Developers

Track and Manage

Management

Self-Service Portal and Service Catalog

Define and Publish

Standard Options

Architecture & IT

Report

Consumption

Chargeback

or Showback

Self-Service Request


4141

1. Automates and virtualizes E-2-E IaaS network infrastructure provisioning

2. API accessible abstraction layer simplifies platform configuration

3. Provides policies that define and control behavior of the Cloud

4. Enables administrators to define the logical constructs of the Cloud (access/security, tiers of service, resources and constraints)

5. Faster cloud setup time and dynamic, fluid network service evolution


4242

• Common abstraction layer

• Standardized API (contribution to OpenStack)

• Flexible, easily consumable interface (Partnering with SM Vendors)

• Ensures network remains viable part of Cloud solution framework

• Fastest deployment, lowest operating cost for cloud

Open REST APIAbstraction Layer

Orchestration

ModuleAutomation

ModuleService Catalog Service Portal

VNMC

Network Services

Manager

SP VMDC POD Ent. VMDC POD


Introduction


Cloud



Summary Conclusion

Q&A


Self-service,

self-managed

personal

infrastructure

on-demand.


Create your own

Virtual Data

Center - acquire

the virtual

resources you

need for as long

as you need

them, with

supporting

network and

storage services.


Design it

Where can we put it?

Procure it

Install it

Configure it

Secure it

Is it ready?

Architect it

Design it

Where can we put it?

Procure it

Install it

Configure it

Secure it

Is it ready?

Architect it

Before CITEIS After CITEIS

• Machine-oriented

• Manual provisioning

• Hard to control utilization

• Service-oriented

• Self-service; automated provisioning

• Elasticity (capacity-on-demand)

• High provisioning & ops cost

• Extended provisioning time

• Configuration risk

• Optimized provisioning & ops cost

• Rapid provisioning

• Increased Resiliency and Availability

Manual

Automated

Self-service

On-demand

CITEIS


Legacy Computer Platform

100% Physical

Average

TCO

Speed of delivery

6-8 WeeksSpeed of Delivery

2-3 WeeksSpeed of Delivery

15 Minutes

-37%

Legacy Computer Platform

46% Physical : 54% Virtual

Average

TCO

Unified Computing Platform

25% Physical : 75% Virtual

100% Automated

Average

TCO

IT Maint / Innovation

70%/30%

-27%

VirtualizationUnified Infrastructure

and Automation

IT Maint / Innovation

60%/40%IT Maint / Innovation

40%/60%


• Need to deploy IT Services faster for Consultants.

• Slow server provisioning cost their clients

• CIAC and UCS beat incumbent

• Development required self service IT Server provisioning

• Fast time to business value with CIAC

• Flexpod Private Cloud to provision IT Infrastructure: UCS, HP, and AIX

• Manage Infrastructure sprawl

• Standardize new “cloud operating model”

• Public cloud for UCS and CIAC

• Building a IaaS & PaaS Service Offering

• Public, Multi-tenant cloud for Infrastructure provisioning

• Vblock and Flexpod

Top 4

Professional

Services Firm

Top 10 On-

line Bank

Top 5

Metropolitan

Area Utility

Top AsiaPac

Telco

Top 10 US

Cloud Service

Provider


Introduction


Cloud



Summary Conclusion

Q&A


Application NetworkingSwitching Management Compute

Open /

Standards

App.

Performance

Energy

EfficiencySecurity Continuity

Workload

Mobility

Cloud DC Service

OrchestrationVirtualizationConsolidation

End-to-end Cloud Solutions (Public, Private, Hybrid)

Efficient Agile Transformative

Security OSStorage

Portal

Automation

Self

Service

Innovative

Cloud Services

(IaaS,VDI, HCS)

IT Services

Delivery

forGovernment

Services

enabling

Cloud

Platform

Builds

TECHNOLOGY

INNOVATION

BUSINESS

VALUE

SOLUTION

DIFFERENTIATION

SYSTEMS

EXCELLENCEUnified

Network Services

Unified

Computing

Business value with Cloud Services

Unified

Fabric


$0

$50

$100

$150

$200

$250

$300

Spending

(US$B)

5

10

15

20

25

30

35

40

45

50

55

60

60

Admin Costs Dominate Budgets

Source: IDC

New server spending Power and cooling costs Server mgmt. and admin. costs

2001 2002 2003 2004 2005 2006 2007 2008 2009 2010

Physical Server Installed Base (Millions)

Logical Server Installed Base (Millions)

Virtualization =

Administrative Avalanche

Impact on the Data CenterOperations and Maintenance Now ~80% of IT Budgets and Growing

Thank you.

cloud orchestration - cisco.com orchestration and automated provisioning developers track and manage...

Documents