move performance testing to the next level with hp …€¦ · title: title (46 pt. hp simplified...
TRANSCRIPT
© Copyright 2013 Vivit Worldwide
Move Performance Testing to the Next
Level with HP Performance Center
September 11, 2013
© Copyright 2013 Vivit Worldwide
Brought to you by
© Copyright 2013 Vivit Worldwide
Hosted by
Megan Shelton
Vivit Performance Engineering SIG Leader
© Copyright 2013 Vivit Worldwide
Today’s Presenters
Mukulika Kapas
Sr. Product Manager
HP ALM and PC
Or Marom
Software Developer
HP Software
© Copyright 2013 Vivit Worldwide
Housekeeping
• This “LIVE” session is being recorded
Recordings are available to all Vivit members
• Session Q&A:
Please type questions in the Questions Pane
© Copyright 2013 Vivit Worldwide
Webinar Control Panel
Toggle View Window between
Full screen/window mode.
Questions
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 7
What products(s) are you currently utilizing to execute performance tests?
1. HP LoadRunner
2. HP Performance Center
3. HP LoadRunner and HP Performance Center
4. Non-HP solutions
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 8
How much do you know about HP Performance Center?
1. Nothing
2. Enough to be dangerous
3. Understand only the testing components
4. I am expert in the whole application (Center of Excellence, Administration and
Testing components)
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 9
If you are currently utilizing HP solutions, how many controllers do you have?
1. Only 1
2. 2-3
3. 4-6
4. More than 6
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Move Performance Testing to the Next Level with HP Performance Center
Mukulika Kapas & Or Marom
HP Performance Center Team
September 2013
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 11
The challenges of our modern world Agile & modern business require modern and fast applications
Modern, mobile applications
Service-oriented applications Composite applications
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 12
Changes are coming faster
• Cloud and composite applications are increasingly complex
• Customers demand mobile access services
• The pace of change is only increasing
• Project and delivery teams are both agile and global
• Businesses need applications to connect with – Customers – Partners – Suppliers…
Can they depend on your applications to keep up?
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 13
The solution: performance testing
• Simulates real users with thousands of “virtual” users
• Generates accurate, measurable and repeatable load on the system from a single
point of control
• Pinpoints bottlenecks in the system
Web server App. server Database Internet/ WAN
Emulate production workloads end-to-end
Simulates thousands of users
Performance Test
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 14
HP LoadRunner
Load and performance testing tasks are frequently tactical and project focused efforts to ensure that an application will be successful when deployed to production.
• Project testing teams require tools to support their specific performance testing needs and for many years, an industry leader in the project load and performance testing space has been HP LoadRunner.
• LoadRunner is an effective choice when you need to test a handful of projects and applications at a single geographic location before deploying them to production.
Introduction to Performance Testing
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 15
As customers mature, they start encountering a new set of problems…
Multiple projects
Common repository
Auditing
Multiple people
Privilege management
Global teams
Asset sharing
Reporting
Security Collaboration
Best practices
Scheduling
License management
Geo restrictions
Redundancy
…and need an enterprise performance testing solution
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 16
Project based testing challenges—consider 4 projects
Project A HP LoadRunner 11.5 Simulated users: 1500 4 boxes
Project B HP LoadRunner 9.1 Simulated users: 1500 8 boxes
Project C Other load test SW Simulated users: 2500 6 boxes
Project D No load test budget “Hope for the best”
No sharing of best practices & skills – each project is unique and isolated
No global collaboration possible – local only
Duplicated resources (HW and SW) in separate projects
Different solutions means duplicate skills and test cases are not reusable
Unable to maximize utilization of resources
No management visibility across projects
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 17
The platform for enterprise performance testing
Performance Center includes all HP LoadRunner features and takes performance testing to a global enterprise level.
Globally accessible, centralized platform. Enables consistent, repeatable processes to:
• Plan and execute tests across multiple concurrent projects and people
• Identify and eliminate performance bottlenecks
• Track performance requirements and defects, ensure coverage, traceability
Maximize productivity, collaboration, utilization of resources and application quality
HP Performance Center
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 18
HP Performance Center
Project A HP Performance Center
Project B HP Performance Center
Project C HP Performance Center
Project D HP Performance Center
View projects from different locations
Simultaneous browser-based load testing of one or more projects
Pooled load testing resources
Receive test data and analyze results
HP Performance Center
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 19
HP Performance Center customer success
Business benefits
• Payback period of 5.3 months
• Annual six figure “cost avoidance”
• Project throughput double with staff increases of only 20%
• Accelerated application roll-out to the business
IT improvements
• 24x7 performance testing
• Test scenario coverage increased six fold
• Test throughput increased four fold
British Sky Broadcasting (Sky) - BSkyB - EMEA
Throughput
Costs
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 20
HP Performance Center customer success
Cumulative benefit:
$21M over 4-year period
ROI: 240% and payback in 5.6 months after deployment
Annual benefits
• Improved testing flexibility and tester productivity: $3M
• Reduced downtime: $2.4M
Additional benefits:
• 125% increase in number of tests conducted per week
• Errors reduced by 44%
• Monthly unscheduled downtime reduced by 33%
Global finance company
Productivity
Costs
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 21
Main Feature comparison Feature LoadRunner Performance Center
Widest range of supported technologies and protocols
Native and Web based Mobile application recording
Powerful Analysis capabilities
ALM Integration – requirements & defect management
Lab management -Resource and test scheduling
Shared virtual users and controllers
Production metrics used in test design
Trending
Security and Role Based Workflow
24x7 global access
Centralized management –project usage tracking
ROI reporting and auditing
Central repository for scripts, results, and analysis
Available on HP SaaS
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 22
Shared Resources Management of shared resources
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 23
Visibility into shared resource availability
Shared schedule
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 24
• Timeslots provides full visibility into resource utilization
• Schedule maintenance windows and mark load generator configurations
24x7 testing
Timeslots and scheduling
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 25
Result trending
Performance trends over successive tests
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 26
Step-by-step flow
Continuous application performance delivery
Refine load test details
Collect & analyze production data
Load test Analyze load test data
Compare production and load test data
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Performance Application Lifecycle
Demo
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 28
Performance requirements and defect management
• Performance requirements
• Requirement status
• Requirement coverage
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 29
“My Performance Center” Simple Web client for day to day activity of Performance Engineer
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 30
The industry-standard software for performance testing
Inherit all HP LoadRunner functionality Enables consistent, repeatable process to:
• Emulate production workload
• Test a broad range of apps
• Identify performance bottlenecks
• Diagnose root cause of issues
• Optimize performance before deployment
Reduce risk, cost and time
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 31
Enable Agile performance Delivery
Performance testing for continuous delivery
Build Load Test scripts during Dev • Integration with MC Visual Studio and Eclipse
Add Performance Tests as build steps in Jenkins • For automated test scheduling and execution • Report pass/failure by defined SLA
Test
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 32
Complete end-to-end mobile test
Realistic mobile performance testing
• Identify bottlenecks before end users
• Test in both good and BAD network connections
• Understand impact of mobile on entire system
• HP Mobile TruClient or HP Mobile Application Protocol
• Shunra emulates true network conditions
The complete solution for performance testing mobile apps
Analyze Mobile Performance on Network
Backend monitoring: Sitescope/ Diagnostics
Performance mobile protocols:
PC
LR
Mobile Network characteristics
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 33
Complete end-to-end mobile test Solutions for all Mobile Application delivery models
Multiple Protocols • Mobile Applications Protocol
-Supports Native and Hybrid apps -Real and emulated devices
• Mobile TruClient Protocol -Emulates true User Experience -Supports Web based Mobile apps -Ideal for Agile development
• Sybase Unwired Platform (.NET)
New Recording Options • Proxy Recording • Analyze Network Traffic • Device Emulator Recording • On Device Recording (Android) • Mobile Browser Emulation
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 34
Shunra Solution – Network conditions One step further for performance testing
Shunra Network Virtualization solution is an add-on for performance testing to emulate real world network conditions.
It enables customers to virtualize and analyze network conditions and plug it into to the test, making the performance testing even more realistic.
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 35
Why HP Performance Center? • Market leadership and innovation
• Scalable solutions to support any size organization
• Integrated products for the entire application lifecycle
• Expertise and best practices
• Flexible licensing and deployment models
• Broadest technology and platform support in the industry
• Extensive eco-systems of partners and IT professionals for local support and resources
Be prepared for the load!
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Thank you
www.hp.com/go/performancecenter