IBM Software Group

Rational Performance Tester Introduction

Rational Performance Tester: OverviewMulti-user automated performance testing tool for Web-

based applicationsHosted in the IBM Rational Software Development

Platform (RSDP), a version of the Eclipse shellRPTs tests and execution engine based on the Java

programming languageHighly scalablePlatform support

Record and test execution on Windows and Linux Agents (test execution) on some additional Windows Server

platforms

Rational Performance Tester: ArchitectureBuilt on top of the IBM Rational Software

Development Platform (RSDP), TPTP, and custom components

IBM Rational Software Development Platform (RSDP)

Eclipse Test and Performance Tools Platform (TPTP)

IBM Rational Performance Tester (RPT)

IBM Rational Software Development Platform (RSDP)Workbench - The user interface and integrated

development environment (IDE) in Eclipse and in the Rational Developer products, which are based on Eclipse.

Workspace - In Eclipse, the collection of projects and other resources that the user is currently developing in the workbench. Metadata about these resources resides in a directory on the file system; the resources might reside in the same directory.

Powered by Eclipse Technology

Relationship of the Workbench and Workspace

WORKSPACE

ProjectSuppo

rtFiles

Test Assets

FoldersWorkbenc

h

Specify a Workspace to run the Workbench

Workbench

Eclipse Test and Performance Tools Platform (TPTP)Test Perspective - Common set of views and editorsHTTP Proxy Recorder - Test capture and generation

toolsetExecution framework - Test suites, deployments and

locationsAgent Controller - A daemon process that resides on

each deployment host and provides the mechanism by which client applications either launch new host processes or attach to agents that coexist within existing processes on the host

Reporting framework

Test Perspective: Default Layout

Default Views

Perspective Indicators

Hierarchical project browser

Display area for: Test Editor Schedule Editor Real-time test run

stats Test Execution

History Report Viewer

Rational Performance Tester: FeaturesHTTP and HTTPS protocol support and captureGraphical test editing and workload modelingBuilt-in Verification Points (VPs)Data substitution with datapoolsReal-time monitoring and reportingReport customization and export capabilityProgramming extensibility with Java custom code

RPT and the Performance Testing Framework (PTF)

Set up Test Environment

Test Development and Validation

Execute Tests and Gather

Measurements

Test Planning and Design

Performance Test PlanWorkload Analysis

Record TransactionsModify TestsDesign WorkloadsValidate and Debug Tests

Test Lab HardwareSystem Software

Data Set Test and Monitoring Tools

Reset System and Data StateRun Monitoring ToolsRun TestsEvaluate Results

IBM Rational Performance Tester

Rational Performance Tester: Test Development

Project and file browser

Test editor

Protocol Data view

Rational Performance Tester: Workload Design

Schedule editor

Schedule Run Settings

Schedule

Rational Performance Tester: Test Execution

Change Log Level

Add Virtual Users

Stop Test Run

Run-Time Test Control

Rational Performance Tester: Test Monitoring

Default Real-Time Reports

Rational Performance Tester: Results Analysis

Reports

Execution History

Log of Events

Key Terms View - In Eclipse-based user interfaces, any pane in the

workbench that is outside the editor area and can be stacked (dragged and dropped) on top of other views. Views provide different ways to look at or work with the resources in the workbench.

Perspective - A group of views that show various aspects of the resources in the workbench. The workbench user can switch perspectives, depending on the task at hand, and customize the layout of views and editors within the perspective.

Projects - In Eclipse, a unit of organization used to group folders or packages. Projects are used for building, version management, sharing, and organizing resources.

Views Contained within the Test PerspectiveTest-related Views

Test NavigatorRecorder ControlProtocol DataPerformance Test

RunsOther Views

PropertiesTasks (rarely used)Outline (not used)

Customize your perspective close views

to minimize clutter

Editors and ViewersTest and Schedule EditorsReport and History Viewers

Editor and Viewer area

Other Perspectives and ViewsPerspectives

JavaResource

ViewsNavigator

Helpful to add this view to the Test Perspective

Package Explorer

Navigator View exposes file

extensions and hidden files

Window > Show View > Other > Basic > Navigator

Working with PerspectivesWindow > Open PerspectiveSwitch between open Perspectives using the shortcut bar

Managing Perspectives

Manage Perspectives Reset to restore

Perspective Shortcut Bar

Or click Other

Working with ViewsWindow > Show ViewCustomize the layout of your views

Group, dock, and layer using drag and dropMinimize, maximize, and resizeShow, close, move to Fast View

Resize

Min/Max

Or click Other

Fast View Toolbar An alternative to closing views

is to move them to the Fast View toolbar.

Click an icon in the Fast View toolbar to open the View.

Click anything else in the Perspective to close the View.

Fast View toolbarTo create a Fast View,

click a view (tab), drag the view to the toolbar.

Rational Performance Tester: Data StorageWorkspace

Default location: C:\Documents and Settings\user\IBM\rationalsdp6.0\workspace

Maintains perspectives and view settings (.metadata)Project

Storage location for:Recordings (trace files)Test Suites (Performance Tests and Schedules)Test logs and resultsDatapools

Performance Test ProjectSpecialized Java project

Specific directory structure for housing and running RPT tests

Template provided out-of-the-box for manual creationAuto-created on first record if no project exists

Default name: testprojProjects can reside inside the Eclipse Workspace

or in another location

Create a Performance Test Project ManuallyFile > New > Performance Test Project

Create a Performance Test Project Manually (cont.) Creates a Java project

customized for performance testing

By default, it is created in the Eclipse workspace

Project name cannot include

/ \ * : < > | ? Names ending with a

period

Test Navigator View: Project and File ManagementProject browser tool

Create and browse objects

Open or close projectsDelete objects

Functions enabled using shortcut menuRPT specificWorkbench tools

Filtered view

Default project structure

Test Navigator View: File FilteringShows only commonly

edited and viewed files such as:Performance Tests and

SchedulesDatapoolsLocations

Supporting files not shownSome directories appear

empty

Tip: File Management Using ViewsTest Navigator view

filters many file typesPerformance Test Runs

only show test results filesNavigator View exposes additional project files

Navigator View: Alternate File BrowserNo filteringTest files

Recordings (trace files)Test and SchedulesSource and compiled

filesReport source files

Raw test run dataProject files

.classpath, and so on

Testproj Default Project: Directory Structure

Default location for all projects is the

workspace directory

Testproj Default Project: Directory Structure (cont.)Default

binsrc

SuggestedTestsSchedulesTest ResultsDatapoolsDeployments or

LocationsSuggested

Directory Structure

DefaultDirectory Structure

Creating FoldersTest Navigator view; shortcut menu

File > New > FolderWorkbench

menuFile > New

> FolderSpecify

LocationName

Default Directory Structure and Test Execution

Test Navigator does not display test source or

compiled files

Before Test Execution

\bin

\src

After Test Execution

\bin\test.class files

\src\test.java files

Overall Page It contains a progress

indicator and bar chartsThe bar charts show

Overall success of run % Page element status

code success % Page status code

success Optionally, % Verification

Points passed (Title, Page or Size)

Summary Report It contains Run Summary,

Page Summary and Page Element summary

Each summary explains Run Status Duration Active/completed/total user Max/Min/Avg response time Total Hits % VP passed

Page Performance It contains two section i.e.

graph and table Avg. response time for each

pageThe table contains

Min response time Avg. response time Max response time No of attempts/Sec No. of total attempts

Response Vs Time Summary Report It shows avg. response

time through time It contains two line graphs

and related summary table One line graph shows the

avg. response time for all page during the run

Other line graph shows the avg. response time for all page element during the run

The tables shows total avg. response time

Response Vs Time Details It shows the response

trend through time It contains a graph and a

table Graph shows the avg.

response of each page through time

Min. response time Max response time Avg. response time No of page attempts per

interval Rate of page attempts per

interval

Page Throughput It gives the overview of

the frequency of the requests being transferred per interval Page attempts rate and

page hit rate per interval Summary tables shows total

hit rates and counts for each page

Active and completed users over the course of run

Summary table Sample interval

Server Health Summary Report Overall indication about the

server response to the user load

The bar charts (left) Total Page attempts Page hits Status code success

The bar chart (right) Total Page elements attempts Page element hits Page element status code

success The tables gives the same info

as the charts

Server Health DetailsProvides specific details

about 10 least successful pages

The table contains No of attempts Hits Success Attempts per second

Transaction Report OverallContains a line graph and

summary tableLine graph shows avg.

execution time for all transaction within interval

The table shows Avg. execution time Std deviation of the avg.

response time Longest transaction Shortest transaction

Transaction Report Duration Vs TimeAvg. response time of

each transaction during an interval

The table contains Min execution time Avg. execution time Std deviation of avg.

response time Max execution time Rate per second No. of attempts

Transaction Report Transaction Throughput Page Overview of the transaction

frequency and the no of user adding load over the run

Graph (left) overall rates for starting and completing transaction during interval

Table (left) shows Transaction rate per sec No of transaction

Graph (right) no of active and completed user over the course

Table contains Active user Completed user Total users

Verification Point ReportSummary (Graph and Table)

% verification point passed per interval Page verification Point (Table)

No of VP passed No of VP failed % of VP passed

Page Element Verification Point (Table) No of page and element No of VP passed No of VP failed % of VP passed

Resource MonitoringUsed to capture data such as CPU usage, Memory etc.Comprehensive view of a system to aid in problem

determinationCan be done by

Test agent Tivoli Monitoring agent Windows Performance Monitor UNIX rstatd monitor

How to perform Enabling resource monitoring Adding resource monitoring data source

Resource Monitoring Enabling

Enabling resource monitoringEnable resource monitoring from scheduler tab

Adding resource monitoring data sourceConfigure the time intervalConfigure the counters

View reportA separate tab generated with the details log

Performance Scheduler

GeneralRun DurationThink TimeResource MonitoringStatisticsTest LogResponse time Break downProblem Determination

Response Time BreakDown

Response time breakdown lets you drill down into the response time statistics on any HTTP page element.

The statistics show how much time was spent in each part of the system under test.

Which application on which server is the performance bottleneck, and then drill down further

to determine exactly which package, class, or method is causing the problem.