3 12-2013 performance-testing_service_virtualization
DESCRIPTION
New applications are increasingly built on distributed service architectures, including mobile and cloud-based services which increase the complexity and interdependency of the systems to be tested. Teams are forced to do performance test earlier in the application lifecycle, before the application is complete or stable with the increased pressure to operate more efficiently, produce valuable results more quickly, and operate with fewer resources. Learn how Service Virtualization is a critical enabler to allow testers to get started with performance testing from the first sprint. We will demonstrate how Service Virtualization is an easy-to-use solution that integrated with multiple performance testing tools, resulting in an almost seamless solution for performance engineering and validation.TRANSCRIPT
© Copyright 2013 Vivit Worldwide© Copyright 2013 Vivit Worldwide
Performance Testing + Service Virtualization: The one-two punch for applications that rockMarch 20, 2013
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
June 11 - 13Las Vegas, Nevada
Save $300. Use code Vivit. Win 2014 conference pass.
© Copyright 2013 Vivit Worldwide
Vivit Advanced Training
Dive deep.
June 11, before HP Discover beginsLas Vegas, Nevada
Add course to your HP Discover registration account.
© Copyright 2013 Vivit Worldwide
Brought to you by
Performance Testing 101 – A webinar series focused on your needs!
http://bit.ly/101performancetesting
© Copyright 2013 Vivit Worldwide
Speakers
Ferhan Kilical, Ph.D.WW Product Marketing Manager
HP Software
Mirek NovotnyWW Product Manager
HP Software
© Copyright 2013 Vivit Worldwide
Housekeeping
• Prize Drawings!
• Q&A
• This “LIVE” session is being recorded
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.7
Question #1
How much do you know about Service Virtualization?
• I have no idea • Just heard about and want to learn how that helps• Some knowledge, have try already• Expert level
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.8
Question #2
What are your current challenges for performance testing?
• No test environment, not enough resources to test• Complex platform, composite applications • Time on scripting• Correlation• Test data preparation
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Performance Testing with Service Virtualization: The one-two punch for applications that rocksFerhan Kilical, WW Sr. Product Marketing ManagerMirek Novotny, Product ManagerSilvia Siqueira, WW Sr. Product Marketing Manager
March 2013
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.10
Shopping Process
Applications have become compositions, representing business processes
Search
Product
Pay
Payment
Buy
Customer Profiles
Ship
Shipping
Track
Track package
Each of these steps are interconnected software
components, also called services
Public CloudTraditional Managed Cloud
Components can run anywhere– in-house
or in the cloud
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.11
Hybrid and Cloud composite applications bring three challengesSpeed, change and complexity stymies delivery
1. It takes too long to develop and deliver applications
2. It’s too costly and risky to use cloud sourced and third party services
3. It’s too difficult to test all scenarios– too many defects leak to production
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.12
Existing Infrastructure
Challenges of a real distributed environment!
• No Availability• Limited Access• Dependency on third party
Single sign on
Application Under Test
Mobile App
JDBC
SOAP
MQ
LDAP
Third Party
Web browser
Composite Application
Application services
Mainframe
Existing database
Web service andLegacy application
REST
JMS
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.13
Existing Infrastructure
Service Virtualization becomes a key answer
• Virtualize for always available services• Virtualize data scenarios• Make available for Dev and Test• Share services-- lower infrastructure
costs Mainframe
JDBC
SOAP
RFC/IDOC
MQ/CICS
Third Party
Application Under Test
Mobile App
Web browser
Composite Application
API
SAP System
Existing database
Web service andLegacy application
RESTPay-per-transaction
Underconstruction
Keep developing and testing moving forward with virtualized services
Service Virtualization
SOAPRESTJDBCMQRFCCICS
Simulation
Data
Perf.
Config
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.14
Existing Infrastructure
Modern Applications and Performance Test In distributed environments
• Software components not ready yet• Speed and performance test is a
major issue• Components/services with limited
access• Dependency on third party– costs• Data too difficult to source• Security and compliance restrict
access
Mainframe
Application Under Test
Mobile App
JDBC
SOAP
RFC/IDOC
CICS
Third Party
Web browser
Composite Application
Existing SAP
Existing database
Web service andLegacy application
REST
Pay-per-transaction
Underconstruction
JMS
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.15
3rd Party servicesLoad generators
Virtual users
Loadrunner controller
Monitors
Equifax Credit Report
PayPal API
How do you test performance characteristics?
SLA
SLA
SLA
2.0s ->0.5s
?
AUT Configuration
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.16
3rd Party servicesLoad generators
Virtual users
Loadrunner controller
Monitors
Equifax Credit Report
PayPal API
Virtualize to Allow Testing of Performance Characteristics
AUT Configuration SV Virtualized
SLA0.5x
SLA
Monitor response time and throughput Control performance profiles
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.17
The complete user experience with Network and Service Virtualization
Mobile Apps? Virtualize services and network to deliver high quality faster
Load Testing: Multi-user and multi-location with Performance Center / LoadRunner
Real-WorldNetwork Conditions
& Performance
Device-Side Functionality / Response
App. server
App. server
Backend Monitoring: Sitescope and
Diagnostics
Services& Systems Service Virtualization
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.18
Complete HP Test Automation PlatformAgile Application Delivery with HP Service Virtualization
Application Under Test
Mobile App
Web UI
Composite Application
Service Virtualization
SOAPRESTMQJDBCRFCCICS
Simulation
Data
Perf.
Config
API
Test Automation
Functionality
Performance
Security
state, profiles, metrics
HP Application Lifecycle Management
store, find, deploystore, run, report
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.19
Speeding up release cycles by eliminating testing delays for unlimited testingTTNET is the largest internet service provider in Turkey with more than six million customers providing internet services, IPTV, Voice over IP and mobile phone servicesChallenge Deploy more than 200 apps per year. Major delays in testing and were never able to complete
test on time. Test had a lot of down time. Test blocking issues were: Dependency on third party services, authorization issues, services not
available during working hours, development was always behind.
Results
Reduced test wait time 100%. On average saved 5-8 days/month.
95% of test cases are available through use of HP Service Virtualization.
Increased test cycles and test coverage 45%
Less defects in Production.
“We can start testing earlier without waiting the end to end systems to be ready. Now we can do efficient resource management, predict schedule and launch apps in a timely manner.”
Test and Release Manager, TTNET
Solution
Virtualize 3rd party endpoints to validate coding changes
Multiple development teams started using Service Virtualization to eliminate dependencies
Modify performance factors of the virtualize service to ensure upstream calls
Deploy virtual services as shared resource
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.20
Benefits of service virtualization for performance testing
Start performance testing early
Reduce cost
No wait time for performance testNo late-night performance testing schedules
Improve performance testing analysis and prediction
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.21
Service Virtualisation ROI
75%Reduced Wait Times
50%Increase in Service Availability
23% Decreased Software Cycles
45% Increased Test Coverage
58%Shorter Test Cycle Times
24%Faster Time to Market
22%Fewer Production Defects
Source: voke Research
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HP Service Virtualization Overview
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.23
HP Service Virtualization
DesignerAuthoring of virtual services Virtual services are stored on file systemEmbedded server included
ServerRuntime for virtual servicesAgents connecting to application environment (HTTP, JMS, CICS…)
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.24
Virtual Service DesignerData Model Performance
Model
Configuration
Virtual Service Control
Virtual Service States
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.25
Wizard based Virtual Service creation
Pre-Set Starting Points
Dialog Based Wizards
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.26
Functional Model
SimulationRules
Service Operations
Functions Rule Detail
StatefulConversations
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.27
Performance Model
Service Operations
Performance Throttles
Performance Parameters
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.28
Virtual Services within Functional and Load testing
VirtualizationControl
Virtual Environment
ProfilesVirtual
Services Real-time
Performance
Virtualization Control
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HP Service Virtualization Demo
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.30
UC: Load test application for various backend SLAs
Application Under Test
UI
Claim Processing
Existing Infrastructure
JMS
MQ
Third Party
Approval Service
Member Accounts
SOAPExchange Rates
Challenges: How to change backend SLA?• Multiple depending systems• 3rd Party and Production Systems• Cannot replicate in lab environment
Test Automation
Loadrunner ?
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.31
Existing Infrastructure
JMS
MQ
Third Party
Approval Service
Member Accounts
SOAPExchange Rates
Solution: HP Service Virtualization 1. Virtualize depending systems2. Create data model by learning3. Model desired SLA conditions 4. Execute test and collect metrics
Application Under Test
UI
Claim Processing
Test Automation
Loadrunner
Service Virtualization
SOAPMQJMS
Simulation
Data
Perf.
Config
profiles, metrics
SimulateCustom SLA
UC: Load test application for various backend SLAs
1
34 2
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.32
Question #3
How can Service Virtualization accelerate your performance testing?
• Easier the preparation of your test environment • Re-use of scripts • Reduce time to test• Cost savings on resources • Fasten the performance testing results
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Q&A
3
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Thank you!
3
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.35
Your Performance, Our Passion!
Got questions? [email protected]@[email protected]
For more information go to:hp.com/go/svhp.com/go/loadrunner