3 12-2013 performance-testing_service_virtualization

35
© Copyright 2013 Vivit Worldwide © Copyright 2013 Vivit Worldwide Performance Testing + Service Virtualization: The one-two punch for applications that rock March 20, 2013

Upload: silviasiqueirahp

Post on 29-Nov-2014

249 views

Category:

Documents


2 download

DESCRIPTION

New applications are increasingly built on distributed service architectures, including mobile and cloud-based services which increase the complexity and interdependency of the systems to be tested. Teams are forced to do performance test earlier in the application lifecycle, before the application is complete or stable with the increased pressure to operate more efficiently, produce valuable results more quickly, and operate with fewer resources. Learn how Service Virtualization is a critical enabler to allow testers to get started with performance testing from the first sprint. We will demonstrate how Service Virtualization is an easy-to-use solution that integrated with multiple performance testing tools, resulting in an almost seamless solution for performance engineering and validation.

TRANSCRIPT

Page 1: 3 12-2013 performance-testing_service_virtualization

© Copyright 2013 Vivit Worldwide© Copyright 2013 Vivit Worldwide

Performance Testing + Service Virtualization: The one-two punch for applications that rockMarch 20, 2013

Page 2: 3 12-2013 performance-testing_service_virtualization

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

June 11 - 13Las Vegas, Nevada

Save $300. Use code Vivit. Win 2014 conference pass.

Page 3: 3 12-2013 performance-testing_service_virtualization

© Copyright 2013 Vivit Worldwide

Vivit Advanced Training

Dive deep.

June 11, before HP Discover beginsLas Vegas, Nevada

Add course to your HP Discover registration account.

Page 4: 3 12-2013 performance-testing_service_virtualization

© Copyright 2013 Vivit Worldwide

Brought to you by

Performance Testing 101 – A webinar series focused on your needs!

http://bit.ly/101performancetesting

Page 5: 3 12-2013 performance-testing_service_virtualization

© Copyright 2013 Vivit Worldwide

Speakers

Ferhan Kilical, Ph.D.WW Product Marketing Manager

HP Software

Mirek NovotnyWW Product Manager

HP Software

Page 6: 3 12-2013 performance-testing_service_virtualization

© Copyright 2013 Vivit Worldwide

Housekeeping

• Prize Drawings!

• Q&A

• This “LIVE” session is being recorded

Page 7: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.7

Question #1

How much do you know about Service Virtualization?

• I have no idea • Just heard about and want to learn how that helps• Some knowledge, have try already• Expert level

Page 8: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.8

Question #2

What are your current challenges for performance testing?

• No test environment, not enough resources to test• Complex platform, composite applications • Time on scripting• Correlation• Test data preparation

Page 9: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Performance Testing with Service Virtualization: The one-two punch for applications that rocksFerhan Kilical, WW Sr. Product Marketing ManagerMirek Novotny, Product ManagerSilvia Siqueira, WW Sr. Product Marketing Manager

March 2013

Page 10: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.10

Shopping Process

Applications have become compositions, representing business processes

Search

Product

Pay

Payment

Buy

Customer Profiles

Ship

Shipping

Track

Track package

Each of these steps are interconnected software

components, also called services

Public CloudTraditional Managed Cloud

Components can run anywhere– in-house

or in the cloud

Page 11: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.11

Hybrid and Cloud composite applications bring three challengesSpeed, change and complexity stymies delivery

1. It takes too long to develop and deliver applications

2. It’s too costly and risky to use cloud sourced and third party services

3. It’s too difficult to test all scenarios– too many defects leak to production

Page 12: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.12

Existing Infrastructure

Challenges of a real distributed environment!

• No Availability• Limited Access• Dependency on third party

Single sign on

Application Under Test

Mobile App

JDBC

SOAP

MQ

LDAP

Third Party

Web browser

Composite Application

Application services

Mainframe

Existing database

Web service andLegacy application

REST

JMS

Page 13: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.13

Existing Infrastructure

Service Virtualization becomes a key answer

• Virtualize for always available services• Virtualize data scenarios• Make available for Dev and Test• Share services-- lower infrastructure

costs Mainframe

JDBC

SOAP

RFC/IDOC

MQ/CICS

Third Party

Application Under Test

Mobile App

Web browser

Composite Application

API

SAP System

Existing database

Web service andLegacy application

RESTPay-per-transaction

Underconstruction

Keep developing and testing moving forward with virtualized services

Service Virtualization

SOAPRESTJDBCMQRFCCICS

Simulation

Data

Perf.

Config

Page 14: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.14

Existing Infrastructure

Modern Applications and Performance Test In distributed environments

• Software components not ready yet• Speed and performance test is a

major issue• Components/services with limited

access• Dependency on third party– costs• Data too difficult to source• Security and compliance restrict

access

Mainframe

Application Under Test

Mobile App

JDBC

SOAP

RFC/IDOC

CICS

Third Party

Web browser

Composite Application

Existing SAP

Existing database

Web service andLegacy application

REST

Pay-per-transaction

Underconstruction

JMS

Page 15: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.15

3rd Party servicesLoad generators

Virtual users

Loadrunner controller

Monitors

Equifax Credit Report

PayPal API

How do you test performance characteristics?

SLA

SLA

SLA

2.0s ->0.5s

?

AUT Configuration

Page 16: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.16

3rd Party servicesLoad generators

Virtual users

Loadrunner controller

Monitors

Equifax Credit Report

PayPal API

Virtualize to Allow Testing of Performance Characteristics

AUT Configuration SV Virtualized

SLA0.5x

SLA

Monitor response time and throughput Control performance profiles

Page 17: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.17

The complete user experience with Network and Service Virtualization

Mobile Apps? Virtualize services and network to deliver high quality faster

Load Testing: Multi-user and multi-location with Performance Center / LoadRunner

Real-WorldNetwork Conditions

& Performance

Device-Side Functionality / Response

App. server

App. server

Backend Monitoring: Sitescope and

Diagnostics

Services& Systems Service Virtualization

Page 18: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.18

Complete HP Test Automation PlatformAgile Application Delivery with HP Service Virtualization

Application Under Test

Mobile App

Web UI

Composite Application

Service Virtualization

SOAPRESTMQJDBCRFCCICS

Simulation

Data

Perf.

Config

API

Test Automation

Functionality

Performance

Security

state, profiles, metrics

HP Application Lifecycle Management

store, find, deploystore, run, report

Page 19: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.19

Speeding up release cycles by eliminating testing delays for unlimited testingTTNET is the largest internet service provider in Turkey with more than six million customers providing internet services, IPTV, Voice over IP and mobile phone servicesChallenge Deploy more than 200 apps per year. Major delays in testing and were never able to complete

test on time. Test had a lot of down time. Test blocking issues were: Dependency on third party services, authorization issues, services not

available during working hours, development was always behind.

Results

Reduced test wait time 100%. On average saved 5-8 days/month.

95% of test cases are available through use of HP Service Virtualization.

Increased test cycles and test coverage 45%

Less defects in Production.

“We can start testing earlier without waiting the end to end systems to be ready. Now we can do efficient resource management, predict schedule and launch apps in a timely manner.”

Test and Release Manager, TTNET

Solution

Virtualize 3rd party endpoints to validate coding changes

Multiple development teams started using Service Virtualization to eliminate dependencies

Modify performance factors of the virtualize service to ensure upstream calls

Deploy virtual services as shared resource

Page 20: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.20

Benefits of service virtualization for performance testing

Start performance testing early

Reduce cost

No wait time for performance testNo late-night performance testing schedules

Improve performance testing analysis and prediction

Page 21: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.21

Service Virtualisation ROI

75%Reduced Wait Times

50%Increase in Service Availability

23% Decreased Software Cycles

45% Increased Test Coverage

58%Shorter Test Cycle Times

24%Faster Time to Market

22%Fewer Production Defects

Source: voke Research

Page 22: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

HP Service Virtualization Overview

Page 23: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.23

HP Service Virtualization

DesignerAuthoring of virtual services Virtual services are stored on file systemEmbedded server included

ServerRuntime for virtual servicesAgents connecting to application environment (HTTP, JMS, CICS…)

Page 24: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.24

Virtual Service DesignerData Model Performance

Model

Configuration

Virtual Service Control

Virtual Service States

Page 25: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.25

Wizard based Virtual Service creation

Pre-Set Starting Points

Dialog Based Wizards

Page 26: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.26

Functional Model

SimulationRules

Service Operations

Functions Rule Detail

StatefulConversations

Page 27: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.27

Performance Model

Service Operations

Performance Throttles

Performance Parameters

Page 28: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.28

Virtual Services within Functional and Load testing

VirtualizationControl

Virtual Environment

ProfilesVirtual

Services Real-time

Performance

Virtualization Control

Page 29: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

HP Service Virtualization Demo

Page 30: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.30

UC: Load test application for various backend SLAs

Application Under Test

UI

Claim Processing

Existing Infrastructure

JMS

MQ

Third Party

Approval Service

Member Accounts

SOAPExchange Rates

Challenges: How to change backend SLA?• Multiple depending systems• 3rd Party and Production Systems• Cannot replicate in lab environment

Test Automation

Loadrunner ?

Page 31: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.31

Existing Infrastructure

JMS

MQ

Third Party

Approval Service

Member Accounts

SOAPExchange Rates

Solution: HP Service Virtualization 1. Virtualize depending systems2. Create data model by learning3. Model desired SLA conditions 4. Execute test and collect metrics

Application Under Test

UI

Claim Processing

Test Automation

Loadrunner

Service Virtualization

SOAPMQJMS

Simulation

Data

Perf.

Config

profiles, metrics

SimulateCustom SLA

UC: Load test application for various backend SLAs

1

34 2

Page 32: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.32

Question #3

How can Service Virtualization accelerate your performance testing?

• Easier the preparation of your test environment • Re-use of scripts • Reduce time to test• Cost savings on resources • Fasten the performance testing results

Page 33: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Q&A

3

Page 34: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Thank you!

3

Page 35: 3 12-2013 performance-testing_service_virtualization

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.35

Your Performance, Our Passion!

Got questions? [email protected]@[email protected]

For more information go to:hp.com/go/svhp.com/go/loadrunner