3 12-2013 performance-testing_service_virtualization

© Copyright 2013 Vivit Worldwide© Copyright 2013 Vivit Worldwide

Performance Testing + Service Virtualization: The one-two punch for applications that rockMarch 20, 2013

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

June 11 - 13Las Vegas, Nevada

Save $300. Use code Vivit. Win 2014 conference pass.

© Copyright 2013 Vivit Worldwide

Vivit Advanced Training

Dive deep.

June 11, before HP Discover beginsLas Vegas, Nevada

Add course to your HP Discover registration account.

© Copyright 2013 Vivit Worldwide

Brought to you by

Performance Testing 101 – A webinar series focused on your needs!

http://bit.ly/101performancetesting

© Copyright 2013 Vivit Worldwide

Speakers

Ferhan Kilical, Ph.D.WW Product Marketing Manager

HP Software

Mirek NovotnyWW Product Manager

HP Software

© Copyright 2013 Vivit Worldwide

Housekeeping

• Prize Drawings!

• Q&A

• This “LIVE” session is being recorded

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.7

Question #1

How much do you know about Service Virtualization?

• I have no idea • Just heard about and want to learn how that helps• Some knowledge, have try already• Expert level

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.8

Question #2

What are your current challenges for performance testing?

• No test environment, not enough resources to test• Complex platform, composite applications • Time on scripting• Correlation• Test data preparation

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Performance Testing with Service Virtualization: The one-two punch for applications that rocksFerhan Kilical, WW Sr. Product Marketing ManagerMirek Novotny, Product ManagerSilvia Siqueira, WW Sr. Product Marketing Manager

March 2013

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.10

Shopping Process

Applications have become compositions, representing business processes

Search

Product

Pay

Payment

Buy

Customer Profiles

Ship

Shipping

Track

Track package

Each of these steps are interconnected software

components, also called services

Public CloudTraditional Managed Cloud

Components can run anywhere– in-house

or in the cloud

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.11

Hybrid and Cloud composite applications bring three challengesSpeed, change and complexity stymies delivery

1. It takes too long to develop and deliver applications

2. It’s too costly and risky to use cloud sourced and third party services

3. It’s too difficult to test all scenarios– too many defects leak to production

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.12

Existing Infrastructure

Challenges of a real distributed environment!

• No Availability• Limited Access• Dependency on third party

Single sign on

Application Under Test

Mobile App

JDBC

SOAP

MQ

LDAP

Third Party

Web browser

Composite Application

Application services

Mainframe

Existing database

Web service andLegacy application

REST

JMS

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.13

Existing Infrastructure

Service Virtualization becomes a key answer

• Virtualize for always available services• Virtualize data scenarios• Make available for Dev and Test• Share services-- lower infrastructure

costs Mainframe

JDBC

SOAP

RFC/IDOC

MQ/CICS

Third Party

Application Under Test

Mobile App

Web browser

Composite Application

API

SAP System

Existing database

Web service andLegacy application

RESTPay-per-transaction

Underconstruction

Keep developing and testing moving forward with virtualized services

Service Virtualization

SOAPRESTJDBCMQRFCCICS

Simulation

Data

Perf.

Config

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.14

Existing Infrastructure

Modern Applications and Performance Test In distributed environments

• Software components not ready yet• Speed and performance test is a

major issue• Components/services with limited

access• Dependency on third party– costs• Data too difficult to source• Security and compliance restrict

access

Mainframe

Application Under Test

Mobile App

JDBC

SOAP

RFC/IDOC

CICS

Third Party

Web browser

Composite Application

Existing SAP

Existing database

Web service andLegacy application

REST

Pay-per-transaction

Underconstruction

JMS

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.15

3rd Party servicesLoad generators

Virtual users

Loadrunner controller

Monitors

Equifax Credit Report

PayPal API

How do you test performance characteristics?

SLA

SLA

SLA

2.0s ->0.5s

?

AUT Configuration

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.16

3rd Party servicesLoad generators

Virtual users

Loadrunner controller

Monitors

Equifax Credit Report

PayPal API

Virtualize to Allow Testing of Performance Characteristics

AUT Configuration SV Virtualized

SLA0.5x

SLA

Monitor response time and throughput Control performance profiles

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.17

The complete user experience with Network and Service Virtualization

Mobile Apps? Virtualize services and network to deliver high quality faster

Load Testing: Multi-user and multi-location with Performance Center / LoadRunner

Real-WorldNetwork Conditions

& Performance

Device-Side Functionality / Response

App. server

App. server

Backend Monitoring: Sitescope and

Diagnostics

Services& Systems Service Virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.18

Complete HP Test Automation PlatformAgile Application Delivery with HP Service Virtualization

Application Under Test

Mobile App

Web UI

Composite Application

Service Virtualization

SOAPRESTMQJDBCRFCCICS

Simulation

Data

Perf.

Config

API

Test Automation

Functionality

Performance

Security

state, profiles, metrics

HP Application Lifecycle Management

store, find, deploystore, run, report

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.19

Speeding up release cycles by eliminating testing delays for unlimited testingTTNET is the largest internet service provider in Turkey with more than six million customers providing internet services, IPTV, Voice over IP and mobile phone servicesChallenge Deploy more than 200 apps per year. Major delays in testing and were never able to complete

test on time. Test had a lot of down time. Test blocking issues were: Dependency on third party services, authorization issues, services not

available during working hours, development was always behind.

Results

Reduced test wait time 100%. On average saved 5-8 days/month.

95% of test cases are available through use of HP Service Virtualization.

Increased test cycles and test coverage 45%

Less defects in Production.

“We can start testing earlier without waiting the end to end systems to be ready. Now we can do efficient resource management, predict schedule and launch apps in a timely manner.”

Test and Release Manager, TTNET

Solution

Virtualize 3rd party endpoints to validate coding changes

Multiple development teams started using Service Virtualization to eliminate dependencies

Modify performance factors of the virtualize service to ensure upstream calls

Deploy virtual services as shared resource

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.20

Benefits of service virtualization for performance testing

Start performance testing early

Reduce cost

No wait time for performance testNo late-night performance testing schedules

Improve performance testing analysis and prediction

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.21

Service Virtualisation ROI

75%Reduced Wait Times

50%Increase in Service Availability

23% Decreased Software Cycles

45% Increased Test Coverage

58%Shorter Test Cycle Times

24%Faster Time to Market

22%Fewer Production Defects

Source: voke Research

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

HP Service Virtualization Overview

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.23

HP Service Virtualization

DesignerAuthoring of virtual services Virtual services are stored on file systemEmbedded server included

ServerRuntime for virtual servicesAgents connecting to application environment (HTTP, JMS, CICS…)

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.24

Virtual Service DesignerData Model Performance

Model

Configuration

Virtual Service Control

Virtual Service States

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.25

Wizard based Virtual Service creation

Pre-Set Starting Points

Dialog Based Wizards

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.26

Functional Model

SimulationRules

Service Operations

Functions Rule Detail

StatefulConversations

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.27

Performance Model

Service Operations

Performance Throttles

Performance Parameters

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.28

Virtual Services within Functional and Load testing

VirtualizationControl

Virtual Environment

ProfilesVirtual

Services Real-time

Performance

Virtualization Control

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

HP Service Virtualization Demo

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.30

UC: Load test application for various backend SLAs

Application Under Test

UI

Claim Processing

Existing Infrastructure

JMS

MQ

Third Party

Approval Service

Member Accounts

SOAPExchange Rates

Challenges: How to change backend SLA?• Multiple depending systems• 3rd Party and Production Systems• Cannot replicate in lab environment

Test Automation

Loadrunner ?

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.31

Existing Infrastructure

JMS

MQ

Third Party

Approval Service

Member Accounts

SOAPExchange Rates

Solution: HP Service Virtualization 1. Virtualize depending systems2. Create data model by learning3. Model desired SLA conditions 4. Execute test and collect metrics

Application Under Test

UI

Claim Processing

Test Automation

Loadrunner

Service Virtualization

SOAPMQJMS

Simulation

Data

Perf.

Config

profiles, metrics

SimulateCustom SLA

UC: Load test application for various backend SLAs

1

34 2

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.32

Question #3

How can Service Virtualization accelerate your performance testing?

• Easier the preparation of your test environment • Re-use of scripts • Reduce time to test• Cost savings on resources • Fasten the performance testing results

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Q&A

3

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Thank you!

3

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.35

Your Performance, Our Passion!

Got questions? performancetesting@hp.comMirek.novotny@hp.comFerhan.kilical@hp.com

For more information go to:hp.com/go/svhp.com/go/loadrunner