what’s new in hp testing

©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice

Session ID: BTOT-TU-1700/1Twitter hashtag #HPSWU

©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice

Speaker Name: Gal Tunik & Peter HavensDate: November 30th 2010Session ID: BTOT-TU-1700/1

What's new in HP Unified Functional Testing, HP Functional Testing , HP Service Test and HP Business Process Testing

Modern applications bring new testing challenges

Development Iteration

API API GUI

Major Project Lifespan

2 – 3 weeks 2 – 3 weeks 2 – 3 weeks

First point where QA

injects testing

First point where Dev might inject

defect

Test & automate as early as possible

C1 C1

C2

C1

C2

C3

G2

C1

C2G1 G1

C3

C1

C2G1

G3

G2

C3

C1

C2G1

… …BP1

BP2

G3

G2

C3

C1

C2G1

Automate tests when available

components become stable

C GUI-less component G GUI element BP business process

stable component

Modern applications have many layersProcess Layer

A new transaction

ExchangeScreen 5 (Java)

Screen 6 (.NET)

SAPScreen 3 (.NET)

Screen 4 (Ajax)

Web 2.0 BillingScreen 1

(Ajax)Screen 2 (Java)

End to end

business processGraphical

user interface

layer

Headless Layer

Interact with modern GUI interfaces, Web 2.0Continue the scenario to the headless layer; test the integration between the layersReport on the quality of the entire end to end process

Component 1(.Net API)

Component 2(Java API)

Component 3(web service)

Component 4(JMS service)

Component 5(web service)

Component 6(REST service)

Unified Functional Testing

HP Service TestHP Functional Testing

(QuickTest Professional& all the add-ins)

Call activities from the other

product

Transfer complex data

structuresUnified report

HP Unified Functional Testing 11.00

HP QuickTest Pro script to call HP Service Test

HP Unified Functional Testing integration

HP Service Test call in QTP

Unified report showing HP Service Test step

Shows activities from bothHP Functional Testing & HP Service Test

Multiple views of the flow

Full traceability for easier debugging

What’s new with HP Functional Testing 11.00? (QuickTest Pro)

GUI and headless testing with Unified Functional Testing

Visual Object Identification

Web 2.0 and RIA support

Dev-QA collaboration with application log verification

Enhanced Reporting

Data Awareness to help Prepare and Manage Test Data

And More….

Visual Identification of Objects

Harden test scripts against changes in the application GUI

Visual Identification of Objects

Record a test script to buy a Ferrari – yeah!

But! The object is in different position the nextday… you’re about to buy a Fiat – boo!

QTP allows you to identify “key” and “fragile” objects and express a geometric relationship between them

BUYBUYBUYBUY

FordHonda

FiatFerrari

// index = 0// index = 1// index = 2// index = 3BUY

BUYBUYBUY

FordHonda

FerrariFiat

// index = 0// index = 1// index = 2// index = 3

MondayTuesday

TopGearCars.com

Schematic Representation

Visual Identification of Objects

Configure Relation

Visual Identification of Objects

Object Relation Preview on AUT

‘Static’ object

Testing Web 2.0 & RIA

Out of the box support

Community

Testing Web 2.0 and RIA with QTP

• Simpler & faster• Harness the power of community• Aimed for Web 2.0 controls

Extensibility Accelerator

RIA

Ajax Toolkitsand more…

2.0 & 3.0(4.0 soon)

Extensibility

Easy, wizard-like interface

Extends HP Functional Testing fast; uses Intellisense

Automated deployment

Free for anyone? Yes, FREE!

Opening web extensibility to the online community: Extensibility Accelerator

Improved debugging capabilities

Collaboration Between Dev & QA AUT Log Verification

Leverage application log into the Functional Testing effort

Application Under Test (AUT) Log Verification

Detects issues of the AUT Internal State

Pass or fail a test according to log errors

Enhances the test

reports Detailed defect

description

Supports

Log4Net and

Log4J

Test Setting for HP Functional Testing Log TrackingLog Tracking

Log Tracking Pane

Log tracking Report in the Run Results Viewer

Enhanced Reporting

Enhanced reporting and Run Results Viewer

Customizable Panes to cover viewing needs of different audiencesQuick high level overview with multi- level details to allow better effect analysisCollaborative report viewer for easier collaboration around test results. No need for a FT license

Recovery for corrupted reports to help save re-run time

Executive Summary

Previous Run

Data

Customizable panes and an enhanced layout

Provides a single platform to view results

Single unified report for UFT products report

Free, stand alone installation

Backward compatibility with older version reports

Can be exported to HTML, PDF, Excel and MS Word

Results

Managers / Leads

Test Writers

Developers

Software testers

Collaborative Report Viewer

Additional report enhancements

– View Previous Run– View Result While Executing the Test– Can view a “Step Status”•Details•Data that was used•HP Screen recorder•Step image•Local System Monitor•Log Tracking

Functional Testing – Quality Center IntegrationData Awareness Capability

Improved data management capabilities with HP Quality Center + HP Functional Testing

Share test data across tests and test scenariosRun tests on a subset of the data; reporting is granular to the data row levelRequirements coverage can be granular to the test data level

Data source

Req 1

Req 2

Req 3 Test 3

Test 2

Test 1 Data set 1

Data set 2

Data Set 3

Addititional FeaturesSubtitle goes here

Improved regular expressions New Regular Expression Evaluator

aids in writing and validating regular

expressions.

Works with the Object Repository,

Checkpoints and Recovery Scenarios

…and more

– Loading Function Libraries at Run-Time– Import/export XML for Checkpoints,

Output values, Verify Objects(in addition to Test Objects)

– New Object Spy Functionality– Hide the Keyword View– Compare, Merge Object Repository

Assets – New HP Update Tool– Web Add-in Extensibility Enhancements

What’s new with HP Service Test

“If I don’t see it, it doesn’t exist.”

The most common response...Why aren’t you

testing services directly?

Enables earlier testing in the SDLC

Easier to test all aspects than through the GUI

Perform component-level validation

Harden the quality of the building blocks of your AUT

Reduce risk in all layers of the application

FlexAJAXWPF

AquaLogic

BPMS

Tibco

TradingLogistics

Rules EnginesReservations

JMS

Java .Net

WCF

XML JSON

Fix / Swift

Web servicesSOAP

Why focus on testing the back end

A long time ago in a dev team far, far away….

Code centric, tedious

High learning curve

Closed, not extensible

Script based testing

SERVICETEST

The Future ofService Testing

Design Principles…

Visual Test Designer

Codeless Testing

Extensible Framework

Modern Standard

IDE

NEW!

(Almost) codeless testing!

Extensive Toolbox

Powerful Data Handling!

Supports text-based data tables, Excel

and XML

Visual Test Flow Designer

Drag & drop canvas

Activity Properties

Unified Functional Testing

Unified Functional Testing

Service TestQuick Test Professional

calling activities from one

product to the other

Transferring complex data

structures

Integration Points

Unified Report

Web 2.0 New VTD

Integration Towards Unification

Managing Changes withService Test Management

Effective Dev-QA need to handle dependencies and test what has changed

Change Impact Analysis

The Integrated System

G2G1

M5

G3 G4

M6 M7

BP1 BP2 BP3

EP1 EP2

P1

EP3

P2

Change Here

Requires new and regression here

Regression here

Validation here

Some validation here

But nothing here

HP Restricted and for HP & Channel Partner internal use. Document not for distribution. Content may be presented to customers upon request.

HP Service Test Management 10.5

Customer Problems• QA cannot catch up with

dev changes

• QA and Dev do not have 1 place to collaborate

• Agile drives Dev to make more changes

STM solution• Application Component

Management

• JIT dependencies modeling

• Fully integrated with QA and ST (UFT)

• Helps QA by suggesting required tests

• Will integrate into Dev IDEs

Nirvana

Service Test Management - handling composite application dependencies

HP Restricted and for HP & Channel Partner internal use. Document not for distribution. Content may be presented to customers upon request.

HP Service Test Management 10.5

HP Restricted and for HP & Channel Partner internal use. Document not for distribution. Content may be presented to customers upon request.

Application Component Change Impact

Make Testing Headless Components Easy

Improving the agility of QA with STM

Briding the divide between Dev & QA

Changing the way you test the back end

What’s new with HP Business Process Testing

Improved performance

Built an intuitive user interface

Ability to leverage QC 11.0 Capabilities

Enhanced Traceability via Component Criteria

Rapid Manual Testing with Sprinter Integration

Logout

Transfer Money

Login

Performance Issues in BPT 10?

Start

Stop

QTP

Login

Transfer Money

Logout

Execute Test

Complete Test

BPT 10

More Components = Slower Performance

BPT

10

Start

Stop

Logout

Transfer Money

Login

All New Execution Engine for Better PerformanceBPT 11 QTP

Login

Transfer Money

Logout

Execute Test

Complete Test

More Components = Better Performance

BPT

11

Key UI Enhancements

Test Script view – New look & Feel

• All new redesigned UI that provides a intuitive view of business flows, components, input/output parameters, test iterations and comments

• Improved navigation and drill down capabilities

• The new UI blends easily with the test of the HP Quality Center UI

Component Parameters in BPT 11

• Independent input and output parameter tabs for better identification of data requirements

• Smart data fields that allows to define static and dynamic values

• If the parameter is used in a script, we will see a ‘V’ checked next to it

Clean and Simple Iteration View

• Improved Iteration view to display ‘multiple iterations at once’ or ‘single iteration view’

• Groups are displayed in a tree hierarchy

• Realigned parameter and iteration views for simplicity

• New find and replace feature inside iterations dialog box

Component parameter summary

• New feature to display component parameter summary

• Easy to understand which parameters are linked to which component and flows

Cleaner UI showing all BPT Resources and Dependencies

• A complete UI overhaul to show dependencies in a HP Quality Center standard mechanism

• HP Quality Center UI can show the resources of BPT

• Component shows all the tests that it is participating in

Simpler Test-Level Parameter View

• Reduced the number of columns to clearly explain which component parameter in the test (may be 1:N) are linked to each test parameter

• Provides the ability to link several different component parameters to the same test parameter

One-step Component Creation ProcessSimplified the component creation process from three steps to just one step

Enhanced Drag and Drop FeatureProving the ability to drag and drop multiple test components into the test script area

New Features

Leveraging QC 11.0 Test configurations/Data-Awareness

• BPT tests support ‘Configurations’• Both ‘Static’ and ‘Dynamic’ Data can be attached as ‘test-parameter’ values

Improved Traceability via Component CriteriaGranular Coverage of requirements. Requirements can be linked to the pass\fail status of each component in a test

When dragging a BPT test to create coverage, user can create more accurate coverage by dragging components from the test.

Application Area is a Standard Test Resource

• Application Area entity was inserted to the ‘Test Resources’ module in QC• Allows full traceability of the Application Area Resources.

Continue the conversation with your peers at the HP Software Community hp.com/go/swcommunity