utilification redux - wilkes€¦ · 8 november 2006 utilification redux - middleware 2006 less...

© 2006 Hewlett-Packard Development Company, L.P.The information contained herein is subject to change without notice

Utilification reduxMiddleware 2006

John WilkesHP Labs, Palo Alto, California

7 November 2006 Utilification redux - Middleware 2006

UtilificationEuropean SIGOPS workshop 2004

John Wilkes, Jeff Mogul, Jaap SuermondtHP Labs, Palo Alto, California

Some images adapted from the original paper, which is Copyright © ACM.


Lessrisk

Higherbusiness returns

More agility

Q: what does enterprise IT need?

Better performance


Q: what does enterprise IT need?A: utility computing!

Flexible, scalable provisioning of computer-based services−on demand: as and when needed−agile: in response to events

−without all the hassle


“Utility computing” is not enough

utility computing

getting to utility computing


Q: what does enterprise IT need?A: utility computing!OK then. How do you get there?

Transform applications from their standalone version into a utility-computing one

Utilification

“I’m all for progress. It’s change I don’t like.”

– Mark Twain


Utilification: the processIsn’t it simple?


Utilification: the processIsn’t it simple?• Pick the application to migrate• [Shut it down]• Bring it up in the new environment −pick throughput and response times−work out how many resources the app needs− tune things a bit

• Maybe wrap some resource-management stuff around it

• Basically straightforward, even if effort-intensive• Right?


Utilification: the processIsn’t it simple? Sample enterprise IT plan

Call Event Management Training Services

eDelivery

Sales & Marketing

eDelivery

Project Management HW & SW Supply ChainIM & Reporting

FinanceReference Systems

Bluestone App Server

.NET App Environment

CustomerConnectivity

CISL, CPRS, HAO,Predictive, ISEE

Shared Appse.g. Siebel

App Servers(NT)

HP-UXWeblogicJ2EE AppServers

SiteminderSiebel

eChannelPortal (OOTB)

JavaScript/JSP/NTIIS/ ASP.NET, Apache/Javascript, Weblogic/JSP

Uniform Portal/Web Application Framework (One or More Instances)

B2B &Fulfil lment

Partner Major Account SMB Consumer

SoftwareManagementPatches

Other Clients

W2K.NET AppServers

SRS(VendorMaster)

PPCProduct Pricing Central

(Material MasterPurchasing Info Records

PartPricingCost

Consulting ProductsService Master)

CRS(Customer

MasterAP/Japan/

Europe/LA/NA)

Skillpack

PartnersBPS

(CSN & CPN)

Upfront Service Order(pre-paid). For service delivery

& future renewal

IndirectRegistration

ServiceEntitlement

B2BiBulk Rosettanet

eClaims

Entitlement Service

eSupport

eSellingStoresSMB

Major AccountConsumer

Sales CallCenter

InternetMarketplaces

Claim WebService

EDISupportpackRegistration

EDITrans-

formationOrderPacks

OrderePacks

ServiceEntitlement

ServiceEntitlement

ePackRegistration

Obligation Feedfrom HPS SAP

SCA

PostalServiceTeams

Consumer

J2EE App Environment

RegisterConsumer

Packs

OrderPacks

OrderPacks

WWEO

WWSNRS

IntegratedWarranty

Terms Mgmt.& Entitlement

Solution

Obligation/Entitlement ODS

Service Bites,PrintAdvantage,

University, Profiler,PIN

Parts ServicesReportingExcaliburUnit Config

.NET App Environment

XML Cannonicals

PRSPricing

Reference

PMGProduct Master

Armor Aware WMS

WWPACK

SBW

University

Web BasedExams

Training on theWeb

(Enrolement)

E-Testing(CAT)

ExternalCompanies

CA(Compaq Accreditation)

Accredited EngineerWeb Access

Exam UpdatesGeneral UserAccess

LearningUtility

ESB Learning

SAP ODS

WESInterface

(SIS)

GSEMInterface

(SIS)

RosettanetCase

Exchange

DocumentumMinimal KM

Management

ConcentraExtended KMManagement

OperationalData Store

HPCSManagment

ProvisionerXML Extract Heavy UI

SAW Portal

Light UI(xMeTaL)

SearchOffline Server

AnalyticsUI

Spider

Third PartyAcquisition

LegacySources

Legacy UIs

From OpenviewService Desk

CATSW - DeliveryLabor Tracking

EQUATEIC Bill ing

Business Intelligence -TBD

Project Management

Manual

Manual

From MPC

Serv

ice

Laye

r - M

essa

ging

Bac

kbon

e (E

IA) o

r ETL

(Inf

orm

atic

a)

Serv

ice

Laye

r - E

TL (I

nfor

mat

ica)

Serv

ice

Laye

r - E

TL (I

nfor

mat

ica)

iGSO BWFrom HPS SAP

WFM IMODSFrom WFM

OperationalMartsWFM-IMSmart

iGSO (BW)Part Page?

MPC

OdessaODS

Odessa DataSources:

3PL, Tabula, PIPE,etc

WW HPS WarehouseConstellation

StrategicMartsICEMANCalistoWMS

MagnetoAuroraSVR

ExcaliburERGOPSDM

iGSO Mgmt

Other DataSources:

Qspeak, ISEE,Oscar, Kahuna,

Passkey 2000 etc

Master Data: Customer,Product, Supplier, Organ isation,Geography, BOM, Employee,Chart of Accounts, Material

Event Repositories:Service Delivery, Orders &Contracts, Supply Chain, Finance,Engagement Mgmt, Sales &Market ing

ExcaliburExternal

WebReporting

Ad-HocReporting

Operation.Excellence

Tables

BalancedScorecard

Parts Service: CSN Global Business Services

PortableRepair EDI

SONICEDI

Orders / Shipments

VOYAGER/iHUB

XelusPlan / Extend

ProductionRequisitions

Inventory / Costs

UniversityOrdersGAP?

Financial Postings

Tech/Training Orders

Taxware

SAPAPO

PEPs E-Stores

Vendor EDIS-Plus

UPSLG (NA)

APO active but not usedfor Order Routing in Step 1

CWS /Keychain

To iGSO BW

PowerInterface

OrderSupportpackWeb Service

QuoteManagement

QuotePricing

SupportpackRegister Web

Service

Watson

ContractAdmin

QL

GSEM SDK

EIA

WFMClarify

WES InterfaceReference DataLoad (CDO)

IM Extract

University BulkLoad

Technician Info

Skillpack BulkLoad

ScoreHPS SAP "A"Future State

ACI/WTI

Prod DivEscalations

Paging(Case Update)

WFM Copy

Click Schedule

Case - WES+

PGUReferenceAuthoring

Call CenterAuthoring

Agent

eTouch

KM LightAuthoring

Parts Update

OpenView

- Service Level Mgmt- Help Desk Mgmt- Incident Mgmt- Configuration Mgmt- Change Mgmt- Problem Mgmt- Application Monitoring- EvSPlent Detection- Capacity Mgmt- Work Order Mgmt- Reporting- Network Fault Mgmt

To CATSW(Labor Tracking)

eVictor(Request Mgmt)

EASI, ATM, eVictor(Provisioning)

Ruleware(Process Guides,Escalation Mgmt)

JETRouting, Notification,

Work Force Mgmt

RadiaInformation Mgmt

Two-way HPCECase Exchange(WebMethods)

WFM ClientCall Center

Workflow Agent

CustomerSystemConnect

eMaileResponse Mgr

eMailDelano

WFM MobileClient

(Untethered)

WFM ICAClient (Citrix)

Citrix

CWAeSupport

KCSIntegration

CSNBusinessServices

Hotlinks

Entitlement

OM InterfacePer incident

quote

Credit Card(Corporate)

SageTo ServiceNotes ODS

ITRC

ConsumptionUpdates (5.0)GEMS

ProductDivision CHS's

To SAP &WWPack

Bulk Load

Bulk Load

SearchEngine

Analytics

Search UI

Onsite Agents

IntranetPortal

MobileFormats

ServiceNotes

Linkage

HPS SAPEnterprise

Instance "A"

FinanceFI/CO/SPLFuture:SCORE

HPFO SAPEnterprise

Instance "B"

ARAPGL

AP, AR, GL

AP, AR,AP/AR Clearing

Lighthouse GL

HPFO BusinessWarehouse

To SAPODS

EQUATEICO Audit Detail

From SalesSAP Systems

Hyperion

HPFOMaster Data

WWCLASS(Foreign Trade)

HarmonizedCodes

Sprint/007

iGSO CentralHPS SAP

EnterpriseInstance "A"

VISTAPSG "O"

IPG "N"

ESG "M"Sales SAPEnterprise

ARAPGL

HPS SAPEnterprise

Instance "A"

ContractsPartsPacksQuotes

Prophecy [email protected]

Siebel (+MS/C&I)Prophecy

(Sales Funnel)

DirectRegistration

SWATFinW

OMEGASales Comp

IPC

OM

SUMWISDOMIMAGING

Translation

Managed Services eDelivery

Ruleware(Customer

Data)

EMS(Escalation

Mgmt)

Openview(Portal)

JET(Notification)

Support Software, ePro,eCase, Instant Software

(eSupport Portal)

eProKnowledge

Telephone

UDDI

To SageToEntitlement

CDOQuoteObject

Subscribe

ServiceEntitlement

Contract &Quote Lookup

PackObject(CCP?)

PackObject(CCP?)

WarrantyRegistrations

?

CCDB overFAI Warranty Registrations

MS Resource Management

PeoplesoftHR

PORGY(HR Data andOrg Hierarchy

Practices)

Skillpack(Skil ls)

RMMP(Resource Market

Place)

To MPC IM DW

ED(EnpterpriseDirectory)

Consulting //PursuitKnowledge Managementt

Livelink(K-net and KMS)

SPS(Sharepoint Portal

Services)

STS(Sharepoint Team

Services)

Groove(External

Colloboration)

Procurement SAP "A"

VendorTransmission of POs

(Purchase Order)

DTT(Goods Receipt)

DTT(Goods

Movement)

MPC SAP EnterpriseInstance "A"

SD, MM,FI/CO/SPLPS, HR, CATSWCapture OrdersManage OrdersBill / InvoiceProcurementProcess Fin. Trans.Plan / Manage BudgetsManage Cash & LiquidityAnalyze & Report Results

Local DB(Oracle/Unix)

ContractManage

QuoteConfig

Novient(Resource

Management)

HR

ERGO(Consultant Effort

& HR)

Omega(MS Expenses)

MS Project(Small - MIddle

Projects)

Large Projects(TBD)

Sales Omega(Sales Comp)

CRO(Order

Recognition)

VCP(Credit

Management)

DDT(Italy only)

WISDOM(Bill ing Output

Imagiing)COPE/BETBids/Quotes

New Tax?(Worldwide Tax)

ESSEC(Foreign Trade)

Invoice Printing(Offline Printingand Distribution)

RPL(Restricted Parties

List)

FusionHP Products

WatsonHP Products

Config and Quote

Order

From MM

SWSCHPS SAP

EnterpriseInstance "C"

Labs, Mkt,Prod Groups

ISSW(EntitlementGenration)

FTP toShippers

GLiS

eRendezvous

SW Mastering

To HPFO

To CalistoIM

From PPC

SUM(Address Update)

OM

ContractCDO

Internal Portal

SLM(Ext Portal)

IOM/HPOM

GSOIAInterface

iGSOInterface

Central UNASTNT (EMEA)

iGSO CentralHPS SAP 4.6Instance "D"

ESSEC

WWClassFS-SPOC DSPS/

FS50I-COST/CCS/

GPSy

ORION

PPC RIFLESFT98

OMNI

Trade

EMEA Reference

RPL

Eiffel/Heart OREquate

Sub Financials

SAPHPFO

"Tsquared"Taxware

SRS

FinanceKahuna/

3D Comet/Tabular

Sokrates

Returns

HPS Application LandscapeFuture State 2005 - DRAFT

November 12, 2002

MPC ODS

SAPCOPA

WebReports

@IM PMMSPortal

Returns

Multi-domainThin Clients

OrchestrationSales [email protected]

PackCPP

ContractCDO

EventObject Price Product

ConsumptionUpdate

Pub/Sub

WarrantyRegist

SubscribePublish

PackObject(CCP?)

Elf-pack QL

PackObject(CCP?)

CREST

To WES+

PWA


Utilification: the processAssessment


Utilification: the processAssessment (aka blueprinting)


Utilification: the processQoS-based sizing


Utilification: the processQoS-based sizing• Requires mappings from: −offered load + QoS needs resource needs−offered load + resources predicted QoS needs

• This is hard!!−even for the single-element application

• typically lots of knobs and settings

−now add many moving parts• multiple control parameters, which interact

−now add operating in a new environment


Utilification: the processQoS-based sizing• Sample question: what’s the “QoS budget” for

each component?−How should a 100ms response-time be split between

two components?−What if the resource demands of these two alternatives

lead to very different costs? −What if the cheapest solution is the most susceptible to

mis-estimations of the load?


Utilification: the processQoS: resiliency• Maybe now is the time to increase this?−add redundancy and replication−add better predicting, detecting, recovering from failures

• How much application-level resiliency is needed?−availability (percentage uptime)− reliability (resistance to data loss or corruption)−performability (probability of achieving a given

performance level)


Utilification: the processQoS: security• Utility computing shared platform−across mutually-distrusting customers?−not on my watch!!

• How to write a security QoS specification?−probably not just: “time to apply virus patches”

• How to pick the right mechanisms?−predicted efficacy? cost? ROI?


Utilification: the processallocating/assigning resources

• what if there arecompeting needs?

• what if there arecompeting needs?


Utilification: the processtest + deploy

• automated• repeatable• on near-live data

• automated• repeatable• on near-live data


Utilification: the processQoS enforcement

start herestart here



expect control loopsto be nested!expect control loopsto be nested!

how do you specify these?how do you specify these?


Utilification: the processFlexing


Utilification: the processFlexing: scale out

• Add resources (servers, storage, …)−natural choice for “embarrassingly parallel” applications

• Reduce resources−how do you force the app to consume fewer resources?


UtilificationFlexing: scale up• necessary if application

can’t scale out

• Migrate application to faster system(s) −what if the app is still

running?−what if the target

configuration needs to be different?


Utilification: the processTrust• Requires belief in performance, resiliency, and

security properties + the systems that provide them− technical solutions exist: these are not the hard part

• Opportunity: methods to build trust −will the proposed design work? design audit−has the design been deployed? deployment audit−has the design been altered? runtime audit−was it adequate? runtime audit


Call to action: utilification needs you!• Utility computing is coming

• The process of getting there is harder than the end point

• Help make it possible!

2004version!

2004version!

What do I think now?

What do I think now?

much the same, only more so …

What’s changed?

SOA is becoming real


Source: Gartner's Hype Cycle Special Report for 2005,Aug 2005, ID Number: G00130115

What’s changed?SOA is becoming real By 2008, “SOA will provide the

basis for 80 percent of new development projects”

— S. Hayward, Positions 2005: Service-Oriented Architecture Adds Flexibility to Business Processes

Gartner, Inc. Feb. 2005.

By 2008, “SOA will provide the basis for 80 percent of new development projects”

— S. Hayward, Positions 2005: Service-Oriented Architecture Adds Flexibility to Business Processes

Gartner, Inc. Feb. 2005.


Utilification: the processdon’t stop at the “utility” stage

Servification


Utilification: the processturn applications into services

• Utilification allows resource sharing− flexibility in scale and placement−decisions about resource priorities and allocations

• Service equivalent− focuses on service/client relationships, not resources


Utilification: the processturn applications into services

• Software as a service (SaaS):− reuse, multiple customers,

asynchronous development, dynamic invocation, … ☺

• Running a service as a business (service provider)− forces decisions about service/client priorities and

allocationseconomy-based approaches

What’s changed?

IT economics are becoming more important


0

50

100

150

200

250

'02 '03 '04 '05 '06 '07 '08

Storage Servers Management and operations

IT spending: OPEX growing 3x faster than compute capacity spend

Tota

l spe

nd

$B

Sources: IDC, “On-Demand Enterprises and Utility Computing: A Current Market Assessment and Outlook,” July 2004; HP analysis.Storage spend includes storage management SW.


65%

10%

25%

Operations –managementand maintenance

Innovationand newfunctions

Migrationand

upgrades

IT spending: where does all the money go?

Only 10% of the IT budget is left for innovation

Only 10% of the IT budget is left for innovation


IT spending:hardware vs administrator costs

Total cost per terabyte of storage(source: IDC 2005)


IT spending:hardware vs administrator costs• Storage costs are

dropping−1995: ~$5000/GB raw−2005: $0.5/GB raw

• People costs are not:−2004–5 admin salary:

US$68k −growing ~0–6%/year

[SAGE-USA survey]

Total cost per terabyte of storage(source: IDC 2005)


IT spending:Solution: automation

For this to work:• we need to delegate authority

to the system• what do we want it to do?• what may it not do?

For this to work:• we need to delegate authority

to the system• what do we want it to do?• what may it not do?

What’s changed?

running IT like a business


Initiate

Running IT like a businessOptimizing the outcome of SOA

Providers

Build

Can other groups develop against my

services?

Operate

How do I manage changes without disrupting my consumers?

Will others see valuein my services?

CTO office

Can I establish a repeatable

implementation process?

Can I control services in

production?

Does the enterprise work on the right

services?

How do I develop/test against services out of my

control?

Do I get the expected quality of service?

Can I find and trustservices?

Consumers

SOA governance

Case studyTuscany:economy-based service-oriented computing


Tuscanykey ideas• Self-interested service providers

SOA + economic rewards to steer behavior

• Automated self-managementcost-effective, lights-out, agile operation


Physical-resource farmscontrol + management

CPU & storage nodesVLANspower cooling

Trust assurance

analysis

auditing

Job executionservice stack

cust. 2customer 1

Job-execution

run-batch

portal data transfer

Data mining

analysis techniques

customer A


Data miningservice stack

DBMS servicescalable dbms

SOA economyCosimo bank

Tuscany ecosystem

Virtual-resource farmsXen/VMwareTycoon


Trust assurance

analysis

auditing

Physical-resource farmscontrol + management

CPU & storage nodesVLANspower cooling

Virtual-resource farmsXen/VMwareTycoon

Data mining

analysis techniques


Job executionservice stack

cust. 2

Data miningservice stack

customer 1

DBMS servicescalable dbms

Job-execution

run-batch


SOA economyCosimo bank

Tuscany ecosystemPrato: dbms-on-demand service

Customer A


Tuscany ecosystemPrato: dbms-on-demand service• a self-managing service provider

• that offers a dbms-on-demand service−2x capacity for 3 days!

• by providing each client with their ownvirtual dbms appliance−hiding the complexity of:

• setting up the service• managing the service (e.g., if it breaks)


Pratoresearch focus1. representing customer needs

• expressing what they need without dictating the solution

2. translating needs into implementation choices• automatically selecting between different designs

3. automating service provider management• lights-out self-management is the end goal

4. composing service providers• Prato is just one service provider: how does it integrate with

others?


Prato research focusautomatic QoS spec service design

QoS specification(request)for how longproblem scaleavailability, reliability, security

service resourcesavailable resourcesdesign choicescostsfailure rates

contract priceflorins/hr

designsystem configurationdata protection schemes

Prato designer


Recovery Point(go back to when?)

Designing data protectionAnatomy of a failure

updates

time

normal operation

100%

availability

time

operationcontinues

(e.g., at 2nd site)

0%outage

crash!

Recovery Time(duration of outage)

RPO = max allowedrecovery-point time (data loss) RTO = max

outage timeallowed

better idea: use penalty rates instead of hard bounds

better idea: use penalty rates instead of hard bounds


Prato research focusautomatic QoS spec service designClient specifies:• dbms size

− RAM (GB), disk (GB)− “in-memory”

high-performance

• outage and data-loss penalty rates− florins/hour

• contract start-date + duration− date, hours

• data-isolation breach penalty− florins/occurrence

Prato chooses:• capacity + speed

− number of nodes, amount of disk, amount of RAM

• data-protection approach− mirrored disk/dbms RAID-5− reload from remote/local copy− snapshot frequency− dedicated/hot spare nodes− cold/hot standby dbms

• contract price

• security-isolation approach− air-gap; VLANs− virtual machines; dbms-protection


Prato servicedesign driven by use cases

Prato Virtual filesystem

(WX2) DBMSInstance

Virtual DBMS-appliance

Contract pricing

Service manager

Design to spec.

Fault diagnosis

Fault recovery

Self management File system Nodes

Physical infrastructure

Cus

tom

erServiceprovider

Manager

Web service

Requestcontract

Web service

Uploaddata

DBA

ODBC

Query &report

Analyst

Web

ser

vice

Add

nod

es

Ope

rato

r

Web

ser

vice

Nod

eut

ilizat

ion

Man

ager


Prato servicehardware and software


(WX2) DBMSInstance


Contract pricing

Service manager

Design to spec.

Fault diagnosis

Fault recovery



Cus

tom

erServiceprovider

Manager

Web service

Requestcontract

Web service

Uploaddata

DBA

ODBC

Query &report

Analyst

Web

ser

vice

Add

nod

es

Ope

rato

r

Web

ser

vice

Nod

eut

ilizat

ion

Man

ager


Prato serviceDBMS = Kognitio WX2


(WX2) DBMSInstance


Contract pricing

Service manager

Design to spec.

Fault diagnosis

Fault recovery



Cus

tom

erServiceprovider

Manager

Web service

Requestcontract

Web service

Uploaddata

DBA

ODBC

Query &report

Analyst

Web

ser

vice

Add

nod

es

Ope

rato

r

Web

ser

vice

Nod

eut

ilizat

ion

Man

ager


Prato serviceEnigmatec EMS service manager


(WX2) DBMSInstance


Contract pricing

Service manager

Design to spec.

Fault diagnosis

Fault recovery



Cus

tom

erServiceprovider

Manager

Web service

Requestcontract

Web service

Uploaddata

DBA

ODBC

Query &report

Analyst

Web

ser

vice

Add

nod

es

Ope

rato

r

Web

ser

vice

Nod

eut

ilizat

ion

Man

ager

What’s changed?

need Quality of information (Qoi), not just Quality of Service (QoS)


Quality of informationIn-the-middle services

Information consumers

DiscoverTransform

Search/query

Index

CacheCorrelate

Presentation, views

CatalogAnalyze

Compose, aggregateInformation servicesTag

Broker

information-sourcemetadata(Qoi)

information-needsmetadata

Businessservices

Informationservices Applications

info

rmat

ion

flow

Information sources

End users


information-sourcemetadata(Qoi)

information-needsmetadata

Quality of informationIn-the-middle services

Information consumers

info

rmat

ion

flow

DiscoverTransform

Index

Correlate

Catalog

Information services

Broker

Businessservices

Informationservices Applications

Information sources

End users

Search/query

Cache

Presentation, views

Analyze

Compose, aggregateTag


Quality of informationKey observation

• QoS is great – but only addresses half the problem− is the service available? fast? cost-effective?

• Qoi = quality of information− is the information fresh? complete? accurate? clean?−what was its provenance? is it original?− is it believable? why?

key idea: ask for the Qoi you need …and get the information system to deliver it … automatically


Quality of informationA few research opportunities

• how to build the processing DAG?• how to express Qoi?−what metrics to use? how to measure them?− suppose you had the metrics – what would you do?

• how do processing steps affect Qoi?−can we predict their effects?−can we design processing DAGs to meet Qoi goals?

• how much Qoi is needed?−who decides? how?

© 2006 Hewlett-Packard Development Company, L.P.The information contained herein is subject to change without notice

Summary


Summary• Utilification + SOA: still a good idea!−but: many “opportunities” remain

• Trust, trust, trust−automation requires delegation−vital to understand what QoS is wanted−predictability, reassurance

• Going beyond QoS QoiThis is all middleware’s turf!

utilification redux - wilkes€¦ · 8 november 2006 utilification redux - middleware 2006 less...

Documents