performance testing solutionssolutions.pyramidci.com/wp-content/uploads/2015/07/pyramid... ·...
TRANSCRIPT
Performance Testing Solutions
We get you past the bottlenecks!TM
QA CENTER OFEXCELLENCE SOA SERVICESFDA VALIDATIONFUNCTIONAL
PERFORMANCE AGILEBIG DATASECURITY
AUTOMATION LEGACYCLOUDMOBILE
FUNCTIONAL
QA CENTER OFEXCELLENCE SOA SERVICESFDA VALIDATIONFUNCTIONAL
PERFORMANCE AGILEBIG DATASECURITY
AUTOMATION LEGACYCLOUDMOBILE
FUNCTIONAL
solutions.pyramidci.com 2
Overview
Performance testing is a critical part of application
testing as it affects business revenue, credibility of the
organization, and customer satisfaction. Pyramid’s
Performance Testing Solutions help identify bottlenecks in
a system, establish a baseline for future testing, support
a performance tuning effort, determine compliance with
performance goals and requirements, and/or collect other
performance-related data to help stakeholders make
informed decisions related to the overall quality of the
application being tested.
Performance Testing Challenges
Today’s applications are built on advanced platforms
using technologies such as HTML 5, Web 2.0, CMS,
and Cloud. To ensure application speed, stability,
and scalability, it is critical to address the following
performance testing challenges:
• Inadequate non-functional requirements for performance testing
• Selecting the right tool and inability to customize the tool
output to develop load generation scripts
• Test data collection and analysis of huge data
• Scaled down performance test environment
due to budgetary constraints
• Exhaustive performance testing before go-live
and limited time for testing
• Testing unique application protocols that are
not supported by standard tools
• Testing from multiple geographical locations
• Wide range of user operating environments, e.g.
Windows, Linux, Mobile
Applications
Pyramid’s centralized performance testing center of excellence
integrates web, mobile, cloud, and legacy applications testing.
Tools Expertise
At Pyramid we employ the most widely used performance testing tools
for measuring web application performance and load stress capacity.
Skilled in both open source and licensed performance testing tools,
our performance QA designers will evaluate application under test,
then explore and choose the best suited tools for the applications.
Types of Performance Testing
It is important to understand different performance test types to
reduce risks, minimize cost, and know when to apply the appropriate
test over the course of a given performance testing project. Our
performance test designers have strong experience in resourcing,
estimating, and projecting potential returns on testing efforts.
Performance Test
A performance test is any test that measures stability, performance,
scalability and/or throughput of an application.
> Apache JMeter> LoadRunner> WebLOAD> NeoLoad> LoadUI> Loadster> LoadImpact> Rational Performance Tester> Testing Anywhere> Loadstorm
> Performance Testing> Load Testing> Stress Testing> Soak Testing> Spike Testing> Configuration Testing
> Web Performance> Cloud Performance> Mobile Performance> Legacy Performance
APPLICATION TESTING TYPES
PYRAMID PERFORMANCE TESTING SOLUTIONS
TOOLS
Performance Testing Solution
QA CENTER OFEXCELLENCE SOA SERVICESFDA VALIDATIONFUNCTIONAL
PERFORMANCE AGILEBIG DATASECURITY
AUTOMATION LEGACYCLOUDMOBILE
FUNCTIONAL
QA CENTER OFEXCELLENCE SOA SERVICESFDA VALIDATIONFUNCTIONAL
PERFORMANCE AGILEBIG DATASECURITY
AUTOMATION LEGACYCLOUDMOBILE
FUNCTIONAL
PERFORMANCE TESTING SOLUTIONS
solutions.pyramidci.com 3
THE BEST WAY TO ENSURE
ACCURATE RESULTS IS
TO FOLLOW A PROVEN
PERFORMANCE TESTING
METHODOLOGY. THE DIAGRAM
BELOW SHOWS PYRAMID’S
PERFORMANCE TESTING
METHODOLOGY.
Performance Testing Solution
QA CENTER OFEXCELLENCE SOA SERVICESFDA VALIDATIONFUNCTIONAL
PERFORMANCE AGILEBIG DATASECURITY
AUTOMATION LEGACYCLOUDMOBILE
FUNCTIONAL
QA CENTER OFEXCELLENCE SOA SERVICESFDA VALIDATIONFUNCTIONAL
PERFORMANCE AGILEBIG DATASECURITY
AUTOMATION LEGACYCLOUDMOBILE
FUNCTIONAL
Load Testing
A load test is usually conducted to understand the behavior of
the system under a specific expected load. This load can be
the expected concurrent number of users on the application
performing a specific number of transactions within a set duration.
This test will provide the response times of all of the important
business critical transactions. If the database, application server,
etc. are also monitored, then this simple test can point toward
bottlenecks in the application software.
Stress Testing
Stress testing is normally used to understand the upper limits
of capacity within a system. This test is done to determine the
system’s robustness under extreme load and it helps application
administrators determine if the system will perform sufficiently
when loads go well above the expected maximum.
Soak Testing
Soak testing, also known as endurance testing, is usually done
to determine if the system can sustain the continuous expected
load. During soak tests, memory utilization is monitored to detect
potential leaks.
Spike Testing
Spike testing is done by suddenly increasing the load generated
by a very large number of users, and observing the behavior of the
system. The goal is to determine if performance will suffer, if the
system will fail, or if it will be able to handle dramatic changes in
load.
Configuration Testing
Rather than testing for performance from a load perspective,
tests are created to determine how changes in the configuration
of the system’s components affect the system’s performance
and behavior. A common example would be experimenting with
different methods of load-balancing.
Pyramid Performance Testing Methodology
The best way to ensure accurate results is to follow a proven
performance testing methodology. The diagram on the right
shows Pyramid’s Performance Testing Methodology.
PYRAMID PERFORMANCE METHODOLOGY
IDENTIFY TEST ENVIRONMENT
IDENTIFY PERFORMANCE ACCEPTANCE CRITERIA
PLAN & DESIGN
TESTS
CONFIGURE TEST ENVIRONMENT
EXECUTE TESTS
ANALYZE & REPORT
solutions.pyramidci.com 4
Identify Test Environment
Identify the load generation environment, system under test, and the
tools and resources available.
Identify Performance Acceptance Criteria
Identify the response time, throughput, and resource utilization
goals and constraints. In general, response time is a user concern,
throughput is a business concern, and resource utilization is a system
concern.
Plan and Design Tests
Identify key business processes and load scenarios, determine the
volume of data required, and establish metrics to be collected.
Configure Test Environment
Prepare the test environment, tools, and resources necessary to
execute each strategy as features and components become available
for testing.
Execute Tests
Run and monitor tests. Validate the tests, test data, and results
collected against the test design. Execute validated tests for analysis
while monitoring the test and the test environment.
Analyze and Report
Analyze the data both individually and as a cross-functional team.
The Executive Summary and Performance Goals sections explicitly
summarize the areas that need troubleshooting in an easy-to-read
checklist. All data is charted for additional analysis.
Pyramid Performance Testing Solution Advantages
We run applications through a complete performance evaluation, then
advise the exact number of users a website can support. We pinpoint
potential problem areas and provide a full report detailing what
needs to be fixed. Our performance QA designers (PQAD) work with
your schedule, running tests and performing the analysis. Pyramid’s
Performance Testing Solutions advantages include:
• We centralize performance testing into a single function.
• Our centralized function increases productivity and decreases costs,
preserving investment in performance solutions.
• We increase quality and reduce or eliminate performance defects
prior to production.
• Pyramid’s performance testing and analysis help estimate the
hardware configuration required to support the application(s) at “go
live” to production operation.
• Our Industry-best performance test designers are knowledgeable in
both licensed and open source tools.
• Our performance QA designers have tuned thousands of systems
and know just where to look, saving time to market and money with
our proven testing methodology.
• We provide clear, detailed reports.
Performance Testing Solution
QA CENTER OFEXCELLENCE SOA SERVICESFDA VALIDATIONFUNCTIONAL
PERFORMANCE AGILEBIG DATASECURITY
AUTOMATION LEGACYCLOUDMOBILE
FUNCTIONAL
QA CENTER OFEXCELLENCE SOA SERVICESFDA VALIDATIONFUNCTIONAL
PERFORMANCE AGILEBIG DATASECURITY
AUTOMATION LEGACYCLOUDMOBILE
FUNCTIONAL
PERFORMANCE TESTING IS A CRITICAL PART OF
APPLICATION TESTING AS IT AFFECTS BUSINESS
REVENUE, CREDIBILITY OF THE ORGANIZATION, AND
CUSTOMER SATISFACTION.
Pyramid Consulting Inc. - World Headquarters
11100 Atlantis Place, Alpharetta, GA 30022
Phone: 678.514.3500, Toll Free: 877.248.0024