move performance testing to the next level with hp …€¦ · title: title (46 pt. hp simplified...

36
© Copyright 2013 Vivit Worldwide Move Performance Testing to the Next Level with HP Performance Center September 11, 2013

Upload: others

Post on 29-May-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2013 Vivit Worldwide

Move Performance Testing to the Next

Level with HP Performance Center

September 11, 2013

Page 2: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2013 Vivit Worldwide

Brought to you by

Page 3: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2013 Vivit Worldwide

Hosted by

Megan Shelton

Vivit Performance Engineering SIG Leader

Page 4: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2013 Vivit Worldwide

Today’s Presenters

Mukulika Kapas

Sr. Product Manager

HP ALM and PC

Or Marom

Software Developer

HP Software

Page 5: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2013 Vivit Worldwide

Housekeeping

• This “LIVE” session is being recorded

Recordings are available to all Vivit members

• Session Q&A:

Please type questions in the Questions Pane

Page 6: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2013 Vivit Worldwide

Webinar Control Panel

Toggle View Window between

Full screen/window mode.

Questions

Page 7: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 7

What products(s) are you currently utilizing to execute performance tests?

1. HP LoadRunner

2. HP Performance Center

3. HP LoadRunner and HP Performance Center

4. Non-HP solutions

Page 8: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 8

How much do you know about HP Performance Center?

1. Nothing

2. Enough to be dangerous

3. Understand only the testing components

4. I am expert in the whole application (Center of Excellence, Administration and

Testing components)

Page 9: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 9

If you are currently utilizing HP solutions, how many controllers do you have?

1. Only 1

2. 2-3

3. 4-6

4. More than 6

Page 10: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Move Performance Testing to the Next Level with HP Performance Center

Mukulika Kapas & Or Marom

HP Performance Center Team

September 2013

Page 11: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 11

The challenges of our modern world Agile & modern business require modern and fast applications

Modern, mobile applications

Service-oriented applications Composite applications

Page 12: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 12

Changes are coming faster

• Cloud and composite applications are increasingly complex

• Customers demand mobile access services

• The pace of change is only increasing

• Project and delivery teams are both agile and global

• Businesses need applications to connect with – Customers – Partners – Suppliers…

Can they depend on your applications to keep up?

Page 13: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 13

The solution: performance testing

• Simulates real users with thousands of “virtual” users

• Generates accurate, measurable and repeatable load on the system from a single

point of control

• Pinpoints bottlenecks in the system

Web server App. server Database Internet/ WAN

Emulate production workloads end-to-end

Simulates thousands of users

Performance Test

Page 14: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 14

HP LoadRunner

Load and performance testing tasks are frequently tactical and project focused efforts to ensure that an application will be successful when deployed to production.

• Project testing teams require tools to support their specific performance testing needs and for many years, an industry leader in the project load and performance testing space has been HP LoadRunner.

• LoadRunner is an effective choice when you need to test a handful of projects and applications at a single geographic location before deploying them to production.

Introduction to Performance Testing

Page 15: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 15

As customers mature, they start encountering a new set of problems…

Multiple projects

Common repository

Auditing

Multiple people

Privilege management

Global teams

Asset sharing

Reporting

Security Collaboration

Best practices

Scheduling

License management

Geo restrictions

Redundancy

…and need an enterprise performance testing solution

Page 16: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 16

Project based testing challenges—consider 4 projects

Project A HP LoadRunner 11.5 Simulated users: 1500 4 boxes

Project B HP LoadRunner 9.1 Simulated users: 1500 8 boxes

Project C Other load test SW Simulated users: 2500 6 boxes

Project D No load test budget “Hope for the best”

No sharing of best practices & skills – each project is unique and isolated

No global collaboration possible – local only

Duplicated resources (HW and SW) in separate projects

Different solutions means duplicate skills and test cases are not reusable

Unable to maximize utilization of resources

No management visibility across projects

Page 17: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 17

The platform for enterprise performance testing

Performance Center includes all HP LoadRunner features and takes performance testing to a global enterprise level.

Globally accessible, centralized platform. Enables consistent, repeatable processes to:

• Plan and execute tests across multiple concurrent projects and people

• Identify and eliminate performance bottlenecks

• Track performance requirements and defects, ensure coverage, traceability

Maximize productivity, collaboration, utilization of resources and application quality

HP Performance Center

Page 18: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 18

HP Performance Center

Project A HP Performance Center

Project B HP Performance Center

Project C HP Performance Center

Project D HP Performance Center

View projects from different locations

Simultaneous browser-based load testing of one or more projects

Pooled load testing resources

Receive test data and analyze results

HP Performance Center

Page 19: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 19

HP Performance Center customer success

Business benefits

• Payback period of 5.3 months

• Annual six figure “cost avoidance”

• Project throughput double with staff increases of only 20%

• Accelerated application roll-out to the business

IT improvements

• 24x7 performance testing

• Test scenario coverage increased six fold

• Test throughput increased four fold

British Sky Broadcasting (Sky) - BSkyB - EMEA

Throughput

Costs

Page 20: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 20

HP Performance Center customer success

Cumulative benefit:

$21M over 4-year period

ROI: 240% and payback in 5.6 months after deployment

Annual benefits

• Improved testing flexibility and tester productivity: $3M

• Reduced downtime: $2.4M

Additional benefits:

• 125% increase in number of tests conducted per week

• Errors reduced by 44%

• Monthly unscheduled downtime reduced by 33%

Global finance company

Productivity

Costs

Page 21: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 21

Main Feature comparison Feature LoadRunner Performance Center

Widest range of supported technologies and protocols

Native and Web based Mobile application recording

Powerful Analysis capabilities

ALM Integration – requirements & defect management

Lab management -Resource and test scheduling

Shared virtual users and controllers

Production metrics used in test design

Trending

Security and Role Based Workflow

24x7 global access

Centralized management –project usage tracking

ROI reporting and auditing

Central repository for scripts, results, and analysis

Available on HP SaaS

Page 22: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 22

Shared Resources Management of shared resources

Page 23: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 23

Visibility into shared resource availability

Shared schedule

Page 24: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 24

• Timeslots provides full visibility into resource utilization

• Schedule maintenance windows and mark load generator configurations

24x7 testing

Timeslots and scheduling

Page 25: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 25

Result trending

Performance trends over successive tests

Page 26: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 26

Step-by-step flow

Continuous application performance delivery

Refine load test details

Collect & analyze production data

Load test Analyze load test data

Compare production and load test data

Page 27: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Performance Application Lifecycle

Demo

Page 28: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 28

Performance requirements and defect management

• Performance requirements

• Requirement status

• Requirement coverage

Page 29: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 29

“My Performance Center” Simple Web client for day to day activity of Performance Engineer

Page 30: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 30

The industry-standard software for performance testing

Inherit all HP LoadRunner functionality Enables consistent, repeatable process to:

• Emulate production workload

• Test a broad range of apps

• Identify performance bottlenecks

• Diagnose root cause of issues

• Optimize performance before deployment

Reduce risk, cost and time

Page 31: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 31

Enable Agile performance Delivery

Performance testing for continuous delivery

Build Load Test scripts during Dev • Integration with MC Visual Studio and Eclipse

Add Performance Tests as build steps in Jenkins • For automated test scheduling and execution • Report pass/failure by defined SLA

Test

Page 32: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 32

Complete end-to-end mobile test

Realistic mobile performance testing

• Identify bottlenecks before end users

• Test in both good and BAD network connections

• Understand impact of mobile on entire system

• HP Mobile TruClient or HP Mobile Application Protocol

• Shunra emulates true network conditions

The complete solution for performance testing mobile apps

Analyze Mobile Performance on Network

Backend monitoring: Sitescope/ Diagnostics

Performance mobile protocols:

PC

LR

Mobile Network characteristics

Page 33: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 33

Complete end-to-end mobile test Solutions for all Mobile Application delivery models

Multiple Protocols • Mobile Applications Protocol

-Supports Native and Hybrid apps -Real and emulated devices

• Mobile TruClient Protocol -Emulates true User Experience -Supports Web based Mobile apps -Ideal for Agile development

• Sybase Unwired Platform (.NET)

New Recording Options • Proxy Recording • Analyze Network Traffic • Device Emulator Recording • On Device Recording (Android) • Mobile Browser Emulation

Page 34: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 34

Shunra Solution – Network conditions One step further for performance testing

Shunra Network Virtualization solution is an add-on for performance testing to emulate real world network conditions.

It enables customers to virtualize and analyze network conditions and plug it into to the test, making the performance testing even more realistic.

Page 35: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 35

Why HP Performance Center? • Market leadership and innovation

• Scalable solutions to support any size organization

• Integrated products for the entire application lifecycle

• Expertise and best practices

• Flexible licensing and deployment models

• Broadest technology and platform support in the industry

• Extensive eco-systems of partners and IT professionals for local support and resources

Be prepared for the load!

Page 36: Move Performance Testing to the Next Level with HP …€¦ · Title: Title (46 pt. HP Simplified bold) Author: John Jeremiah Created Date: 9/11/2013 12:00:59 PM

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Thank you

www.hp.com/go/performancecenter