what makes a devtest cloud fly? - itko · identify the critical components unique to devtest case...

W W W . I T K O . C O M1 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL

What Makes a DevTest Cloud Fly? (And what is the value?)

John MichelsenNovember, 2010


Dallas-based enterprise software company

Selling to Global 4000

Product Suite: LISA

Focused on Virtualization and Validation of

Complex, Distributed Environments

Resell relationships with HP, IBM, Accenture

& CSC and Partnerships with leading SI

solution providers

150% Annual Revenue Growth over last 4

years

Removing the constraints to software quality and agility.

iTKO Background


Goals

Key Enablers for DevTest CloudIdentify the critical components unique to DevTest

Case Studies of Cloud SuccessYour company doesn’t have the money is no excuse!

The Case for the Cloud in Dev & TestBackgrounder on Cloud for Development use


Complexity is Growing in Today’s Architectures

# of Interconnected

Components

# of Inter-

Dependent TeamsRate of

Change

# of Heterogeneous

Technologies

RMI ObjectsMessaging

Service

BI Tools

Business

Rules

File

System

ESB

Web

Interface

Content

Database

Data

Warehouse

Financials

Mainframe

Web/WAP

Interface

EJB

Virtual

Service

Routing

Service

SOAP

CRM

App

Products

Collaboration

App Portal

Help

Engine

BPMS

Legacy

Infrastructure

Private

Clouds

Public CloudSaaS


Challenges of Cloud for Dev & Test

Production

Infrastructure

Provisioned

Dev & Test Labs

Volatility in Utilization &

Provisioning

Constant Setups &

Teardowns

High Costs and

Environment Sprawl


Volatility of Utilization in Dev and TestVariability even higher and less predictable than in production app use

Aggregate consumption over time

Dev Team A, B, C…

Lab

Utilization

Large scale

performance test

Big

Release

Third Party

Integration Testing


Volatile Utilization Drives Hybrid CloudHigh utilization makes on-premise most effective, low utilization on-premise least

Variable consumption over time

Dev Team A, B, C…

Private Cloud

Public CloudLab

Capacity

& Cost


Cloud

Infrastructure

Catalog

Steps to Deploying a DevTest Cloud

1) Pool Lab Resources Together

(Leverage existing capacity)

2) Implement virtual lab provisioning

2a) Catalog the Virtual Machine Images

2b) Capture Virtual Services off-cloud

3) Start bringing teams onto the cloud

instead of dedicated environments


Virtual Machines

App Server

Order Mgr

Virtual Lab

Manager

Cloud Environment

CRM

VMCatalog

Current Thinking on Cloud for Dev/TestGoals: Elastic Capacity as OpEx and Rapid Provisioning

Dev

Test

Provision Requests

IaaS

-Anonymous Infrastructure on demand

-Large-grained account management

-No Labs Concept

VLM

- Manages things like users, machine catalog,

quotas, charge backs, etc

- Lab definition with machine templates,

advanced setup, ACL, networking


Virtual Machines

App Server

Order Mgr

Virtual Lab

Manager

Cloud Environment

CRM

MainframeSaaS DB System of

Record

System Dependencies

Remain Unanswered

VMCatalog

Dev & Test Cloud Lab Constraints“Wires hanging out” of the Virtual Lab for App Dev

Dev

Test

Provision Requests

Goals: Elastic Capacity &

Rapid Provisioning

Issue: “Wires Hanging Out”of your Cloud


Impact Extends to Off-Cloud, Dependent Systems Cloud costs in dev & test become unpredictable due to unforeseen charges


Lab

Capacity

& Cost

Private Cloud

Public Cloud

$10K usage

charge during one

load test!Big-Bang

Release

Inability to scale

due to off-cloud

constraint (MIPS)


Dev & Test Cloud – Addressing BottlenecksThroughput is always set by the lowest capacity system

Any off-Cloud system nullifies the promise of on-demand capacity

Portal Service/XML

Gateway

ERP Mainframe

(CAN’T

REPLICATE)

Order Mgmt Fulfillment

Actual throughput

Post-Cloud throughput

20 20 10 8

=2

2 =2


Typical Enterprise Apps Have Downstream

Dependencies -- Off-Cloud and/or Data Volatile

Target

Application

“My greatest inhibitor to delivery

is outside my control.”

“I can’t do anything until I have

everything… and I never have

everything!”

JDBC

MQ

ERP

Database

Mainframe

SOAP

Under Construction

Wrong test data

2hr. access window


Virtual Service Environment

in the Cloud

Service Virtualization Solves the Off-Cloud IssueRepresenting the behavior of the off-cloud asset without constraints

Create

Maintain

Live Cloud and

Service I/O TrafficTransaction logs,WSDL definitions, flat files, other

LISA Agents on Systems

LISA Workstation

“Self-Heal” from

Live Systems

Virtual Services are typically

“complete enough” when

created

Consume

Performance Lab

Dev & Test Labs


Time to Productize the Stub/Mock Space

Consumers Need Control: Stubs are usually built by the real

service producer, but the developer’s needs are simple compared

to the consumer -- and consumer often doesn’t have appropriate

skill

Static Data/Performance Only: Stubs are too simplistic so they may

prove one scenario but leave all the rest unavailable

Not Often Possible: How do you stub the database changes that

aren’t made yet? Or the web service that doesn’t have a

development team? Or load test not 100 but 100,000 data

scenarios?

Stubber: “Mr Consumer, here is your customer look-up stub so you

can run in parallel with my development of the real service.”

Consumer: “Yeah, but every customer response in there is the

same customer profile; I need customers with high balances,

old invoices, near their credit limit, long-standing customers

with no balance, … ”


Mainframe

Risk Solution Providers

Credit Bureau

SMS Gateway Providers

Teleconference Service Provider

Card Processing Services

VOIP Phone / Conference Bridges

Bill Payment Services

Motor Vehicle Records (MVR) System

Global Distribution System (GDS)

Almost Any IT Asset in Your DevTest Cloud


Use Case: Accelerate Parallel DevelopmentMajor US Telecommunications Company

Business Problem Client systems waiting for server systems to

deliver first

Software changes taking too long

Business Impact

Reduced Development Cycle by 3

months by modeling dependencies

as Virtual Services

DELAY

DELAY

Billing

Savvion

Siebel

Time Time

VSE

VSE

Before After

Billing

Savvion

Siebel


App 3

App 2

System

Under Test

Use Case: Eliminate Test Data Volatility

Effort = (# Data Sync/Setups) x (# Test Runs)

App 1

Large Insurance Provider

Data Does Not Exist

Sensitive/ Secure Data

Data Volatility

ChallengesHard to sync test data across multiple apps

Dynamic, time sensitive data scenarios

Difficult to use volatile/sensitive live data

Virtualized Test Data

Effort = 1x Virtualized Data Setup

(Repeat and Reset at Will)

System

Under Test

Before After

Results with LISA

TDM costs reduced 80% in 2 weeks

Cycle reduced by 10 weeks (67%

overall reduction)

http://images.google.com/imgres?imgurl=http://www.ontheedgeweddings.com/blog/wp-content/uploads/2009/05/Exclamation.jpg&imgrefurl=http://ontheedgeweddings.com/blog/?p=631&usg=__-ptLUEjtUtOTNSqQfidA64vWW00=&h=346&w=346&sz=31&hl=en&start=1&sig2=bR8rKw4_wQNIHLTMBFkikQ&tbnid=OLx_O3iKW3dleM:&tbnh=120&tbnw=120&prev=/images?q=exclamation&gbv=2&hl=en&ei=G5zgSovgLKLYtAPxuJzaCA




Simplified, Automated Test Data ManagementIntelligent, automated solution that replaces manual, time-intensive approaches

Automatically Desensitizes live

data for security and compliance

Capture directly or import from

transactions, databases, files

Heal the data model from the live

system when invalid or outdated

Dynamically adjusts data for

time or situational relevance


Use Case: Unlimited Capacity in Perf LabsMajor US Bank – Performance Testing

Business Problem

Limited capacity on test instances of Back-

end Services

Unable to sufficiently test ESB for

performance

Business Impact

More complete SLA testing in less time

Avoided $20M lab expansion

Every performance test > 30% faster

VSE

~5000 tps

ESB

Back-end

Services

ESB

Load GeneratorsLoad Generators

Before After~20 tps


Dev & Test Cloud – Bottleneck Gone!Virtualize away capacity limitations with Virtual Services in the Cloud

Realize the promise of Cloud Elasticity

Portal Service/XML

GatewayERP Mainframe [Order Mgmt] [Fulfillment]

Actual throughput

20 20 =20unlimited

Virtual Services

in the Cloud


Virtual Machines

Websphere

Order Mgr

Virtual Lab

Management

CRM

LISA Virtualize(Virtual Services)

MFvs DBvs SaaSvs

Virtual

Service

Catalog

Provision

request

VM

Catalog

LISA Virtualize eliminates dependencies, helps

contain costs, and simplifies provisioning.

Constraint-Free Cloud Environments with LISA


Cost Reduction: After DevTest Cloud


Private Cloud

Public Cloud

Minimize

Public Cloud

usage

Virtual Services in

Dev/Test Private Clouds

Reduce Overall

Private Cloud

investment

Off-Cloud

Capacity/

Constraints

& Costs

Eliminated

Lab

Capacity

& Cost


Virtual Machines

Websphere

Order Mgr

Virtual Lab

Management

CRM

LISA Virtualize(Virtual Services)

MFvs DBvs SaaSvs

Virtual

Service

Catalog

Provision

request

VM

Catalog

Example 1: DevTest Cloud Bill of Materials for a

Global Bank

Yours may vary: DevTest does not demand a specific Cloud

infrastructure, integration or service management solution


Example 2: Working with IBM in the CloudEnd-to-End Test, Defect Collaboration, Service Virtualization

Create RTC work items or ClearQuest defects with detailed, multi-tier trace

information from any LISA test

Auto-generate Virtual Data Sets, Regressions, and Virtual Services for

constraint-free resolution and transparency across services

LISA integrates with Rational Quality Manager built on the Jazz platform to

manage validation in ALM processes

LISA Suite< Alt-Click! >

IBM Rational Quality

Manager

Defect

Resolution

Continuous

Validation &

Test


Example 3: Oracle’s Private DevTest CloudLISA is a key enabler for Fusion, AIA, and Fusion Apps Dev & Test

“We reduced our testing cycle times by 90%”

Objects

(EBO)

Order -to-Cash

Oracle

Financials

Siebel

CRM

Other

Integrations

Repository

Web 2.0

UIs

Oracle DB

Java

Frameworks

PeopleSoft

MainframeWebLogic

ESBProcure-to-Pay

OtherPIPs...

PIPs

Services

(EBS)

Fusion

UIs

Fusion teams test UIs

with LISA

Virtualize test data

Performance test

response times

AIA isolates/virtualizes

PIPs & environments

for dev & test

Virtualize test data

VS of integrations in

private Cloud labs

See case study at http://www.itko.com/resources/oracle.jsp


Example 4: Global Telco

Reduced cycle time by 40-70% over the first 6 months by

eliminating dependency constraints

Accelerated testing 1 to 2 phases earlier in the lifecycle

and expanded test responsibilities

Virtual data mgmt expanded scenarios validated by 5X

Avoided millions of dollars in environment costs

4 weeks to achieve 100%+ ROI

Team Previous Cycle Time Cycle Time with LISA

TeamA 45 5

TeamB 10 5

TeamC 5 .5

TeamD 5 0

TeamE 15 .5

TeamF 5 0

TeamG 20 1

TeamH 20 6

TeamI 15 2


Summary and Q&A

Learn about DevTest Cloud from iTKO:

“The DevTest Cloud: An Essential Platform for App Dev”

“Cloud-Based Test Environments and Benefits”

“Service Virtualization Practices”

http://www.itko.com/cloud

• For more information:

• iTKO Blog: http://blog.itko.com

• Twitter: http://twitter.com/itko

• Email: [email protected]

“Best Cloud

Integration”

Solution 2009

http://www.itko.com/cloud

http://blog.itko.com/

http://www.itko.com/site/company/news_23.jsp

what makes a devtest cloud fly? - itko · identify the critical components unique to devtest case...

Documents