accelerating quality assurance quality management ... · the premiere software and product delivery...

The premiere software and product delivery event.June 6–10 Orlando, Florida

Accelerating Quality Assurance

Quality ManagementPortfolio Update

Brian BrysonTechnology Evangelist, IBM

[email protected]

Before we Begin…

© Copyright IBM Corporation 2010. All rights reserved. These materials are intended solely to outline our general product direction and should not be relied on in making a purchasing decision. Information pertaining to new product is for informational purposes only, is not a commitment, promise, or legal obligation to deliver any material, code or functionality, and may not be incorporated into any contract. The development, release, and timing of any features or functionality described for our products remains at our sole discretion. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM products. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others.

2

Where we’ve been

Where we’re going

3

AgendaAccelerating Quality Management

Where we’ve been

Where we’re going

4


Simplified Usage Model

5

KISS

6

Pervasive Throughout the Quality Management Portfolio

9

Service Tester

Simplified Recording

Performance Tester

Simplified Reporting

Simplified Editing Simplified Manual Scripting

Quality ManagerFunctional Tester

10

Test Management As the Hub

11

Delivering greater value from your

investments in software

Addressing the needs of QM Teams

Cut risk and costEnable teams to do more with less without sacrificing quality

Speed time to marketImprove the productivity of the entire team

Make confident decisions Provide qualitative information for project status and decisions

12

✔ Stakeholder and team coordination reduces mistakes

✔ Risk identification and management leads to educated prioritization decisions

✔ Test traceability linked to business requirements improves customer satisfaction

✔ Reducing manual labour leads to fewer testing errors

✔ Lab configuration automation improves efficiency and asset utilization

✔ Dynamic test plan coordinates test activities

✔ Real-time dashboards enable proactive risk management

✔ Customizable reports facilitate ongoing process improvement

Mitigate Risk and Cost through Collaboration

Improve operational efficiency with automation

Make confident decisions with effortless reporting

IBM Rational Quality ManagerA central hub for business-driven software quality

IBM Rational Quality Manager

CONTINUOUS test plan participateAUTOMATED context GOVERNANCEuse case distributed access dashboardssynchronize EASY HANDOFF trace LABUTILIZATION functional PERFORMANCEsecurity compliance

Rational Quality Manager 2.0.1

13

Master Test Plan

Project Templates

Audit enhancements

Snapshots for execution result records

Expanded PDF Print

Copy of manual test steps

Duplication of test artifacts

Artifact section management

Full text search

Test artifact filtering

Performance improvements

Suite categories

Support for OSLC QM 1.0 specification

Master Test Plan

14

RequirementsDriven Quality

15

Know you are testing the right things

Requirements driven testingKnowing what to test

Requirements tracking built into the test management toolingCustomizable attributes enable you to track what is important to your team

Real-time impact analysis of requirements changesTraceability of test results to user needs

16

Collaboration fosters business alignment & high qualityRequirement links foster clarity

16

Analyst

Developer

TesterRational Quality Manager v2.0

Rational Team Concert

Rational Requirements Composer

Testers link to requirements from test plans and test cases

Analysts communicate requirements with links to development and test plans

Developers link to requirements from work-items

Risk Based TestingEnsure Quality Management goals address Business Objectives

17

Risk assessments captured in Test Plan and Test Cases

Base project decisions on qualitative risk analysis

Test Case will contain a risk failure score and a risk priority score

Environment Support

18

EnvironmentSupport

Keeping up with the Jones’

19

Agile Testing

Agile Testing focuses on meeting quality from the customer’s perspective and centers on application capabilities that are really being used.

Whole Team must be responsible for quality

Agile Testing Focuses on quickness, lightness, and helping the team deliver demonstrable quality code

Starts as early as possible, tests often as code becomes stable

Requires combination of manual and automated testing approaches to be effective

Is performed at multiple levels where unit, integration and acceptance tests are executed

Quality Manager and Agile

Points, Work Items, Milestones, Exit Criteria, Agile Template, Child Test Plans, Weight, Risk

21

WorkingTogether

Design Partner Program

IBM and Customers working together to design the Quality Management portfolio

Currently 30+ partners

In Lab Design sessions

Beta program

22

Rational Quality Manager Open Ecosystem Today

Quality Manager

Managing mobile applications testing across a global handset test environment

Supporting bidirectional integration with the Jira change management system

Requirements

Rational Requirements Composer

Rational DOORS

Builds, WorkItems and Defects

Rational ClearQuest

Rational Team Concert

Rational BuildForge

Enabling greater quality and productivity with automated SOA governance supportAccelerating test cycles with virtual machine

management and execution

Quick Test ProfessionalLoadRunner

Provisioning

Tivoli Provisioning Manager (TPM)

Tivoli Service Request Manager

TADDM

Reporting

Rational Insight

RapidRep

Certify

TMAP Process

23

Automated Testing

Rational Functional Tester

Rational Performance Tester

Rational Service Tester for SOA Quality

Rational AppScan Tester Edition

Test RealTime

Rational Robot

Rational Rhapsody

http://www.surgient.com/

http://www.cm-logic.com/

Where we’ve beenFive Things We’ve done

24

Simplification

Test Management as the Hub

Requirements Driven Quality

Enterprise Support

Working Together


Where we’ve been

Where we’re going

25


26

CollaborativeLifecycle Management

Transforming software and systems quality

Rational Workbench for Quality Management

RationalQuality

Manager

RationalPerformance

TesterRational

FunctionalTester

RationalServiceTester

Quality Professional

Quality ManagerPerformance

Analyst

28

Transforming software & systems lifecycle management


Analyst

Rational Workbench for Collaborative Lifecycle Management

Developer

RationalQuality

Manager

RationalDOORS

RequirementsProfessional

RationalTeam

Concert

IBM provides a Workbench for Collaborative Lifecycle ManagementA robust, extensible solution for analysts, developers and quality professionals

StorageCollaboration

QueryDiscovery

Administration: Users, projects, process

Best Practice Processes

Presentation:Mashups

3rd-PartyJazz

Capabilities

RequirementsManagement

Configuration& Change

ManagementBuild & Deploy

Management

QualityManagementAsset

ManagementArchitectureManagement

QualityProfessional

ArchitectAnalyst DeveloperProduct/Project

Manager


31

PartnershipSAP & Systems

32

Application Lifecycle Management with SAP Solution Manager

SAP Solution Manager

End-to-end Quality Management is a key element of effective Application Lifecycle Management to help lower costs and improve deployment success

IBM Rational

33

SAP Solution Manager – IBM Rational Integration

SAP Solution Manager Connector for IBM Rational

Business BlueprintBusiness Blueprint

Incident ManagementIncident Management

RequirementsRequirements

QualityQuality

Change/DefectChange/Defect

New Quality Management option for joint SAP and IBM customers

Functional ViewImport SAP Solution Manager Business

Blueprint into Rational Quality Manager & RequisitePro

Update test results into SAP Solution Manager

Integrate with SAP Service Desk

Customer BenefitsCombine SAP & IBM best practices & standards

Combine SAP Solution Manager life-cycle

management capabilities with IBM Rational‘s

integrated governance and quality management capabilities

Enables end to end business process testing

Aligns enterprise architecture and requirements with SAP-centric Solutions

Change Impact Analysis

Change Impact Analysis

System of Systems: Instrumented, Interconnected and Intelligent

Testing a System of Systems requires:• LifeCycle Quality Management, with traceability to Requirements•Testing in the context of the IT applications it is interacting with• Business Intelligence and Business Analytics• Management Dashboards rolling up test data from all levels

GPS ServiceProvider

GPS ServiceProvider

Fleet / TrafficManagementFleet / TrafficManagement

Vehicle Inspection Station

Vehicle Inspection Station

EmergencyServices

EmergencyServices

Vehicle InsuranceProvider

Vehicle InsuranceProvider

Smart VehicleCharging StationSmart Vehicle

Charging Station

A modern car is more like 30

computers on wheels,

Now being interconnected to 45+ systems

35

SmartAutomations

Smarter Testing Vs. More Better TestingWork Smarter Not Harder

Simple Truth: It is Impossible to Test Everything.The logical approach is to focus on the “right” tests

Research shows that…About 80% of the defects come from 20% of the modules -- Barry Boehm20% of test cases cover 80% of business value – Boehm

The Real Question becomes:

What’s the right 20% to pick?

Applying automation where it matters the most

Test Suites covering critical Requirementsi.e. high business value.No. of High Priority Requirements

“20% of Test cases covering 80% of Business value”

“80% of the defects come from 20% of the modules”

Better Quality Process from Historical TrendsProcess Improvement from past experiences

Collect Data over Time

Intelligence gathered from Data Analysis

Real time Process Adjustments

Trend shows mid milestone defect spike

Goal – Minimize spike and contain release

Release ImpactAdd time and additional milestoneRemove content to contain scheduleContinuous

Improvement

Release ImpactNo major defect backlog per any milestoneShip on timeShip with all planned content

Organizational Quality OptimizationCoordinated Quality Process and Teams

Project Quality Organizational Quality

Organizational Transformation

Coordinated effort across OrganizationStandard Process and Measures across All ProjectsCentralized expertise, shareable assets and best practices Maximize asset reuse and Test Lab utilization

40

Simplification

Simplifying the User Experience for the Quality Professional

Use familiar web and collaborative technologies to deliver an intuitive quality workbench

Provide a simple test representation that speaks to all stakeholders

Leverage your test narrative in multiple ways

41

Providing solutions that can leverage the skills of the broader quality community

Bringing together business and technical expertise for successful software delivery

Subject Matter Experts

Implementers

Coders

Business E

xpertise

Tech

nica

l Exp

ertis

e

Rational Functional Tester: Storyboard Testing

Describe Once, Use Throughout the Quality Lifecycle

Capture your test from the earliest stages of development

Leverage as a manual test asset as the application is refined

Transition to automated regression testing when the code stabilizes

43

A common narrative serving multiple stakeholders and needs

RequirementsRequirements

DesignDesign

TestTest

CodeCode

Manual TestManual Test Automated TestAutomated Test

Describe Once, Use Throughout the Quality LifecycleA common view of data to support all testing needs

Understand the data that is relevant to the business process

Use that view of data to support many test scenarios

Identify the right set of data that validates the quality objectives

44

Business Application

Business Data

Test Narrative

Test Data

TestTest

User Acceptance

Functional Verification

Stress Testing

Optimize your use of data to test the right things instead of testing everything

45

DeliveryModels

Deploying a flexible and affordable infrastructure is KEY

Term/Token License Pools

Cloud Service Provisioning

IBM agility@scaleTM

Integrated Infrastructure

“Stacks”

47

2010: Jazz "on the cloud"Delivering an "instant on" collaborative ALM solution

Gain immediate access to a fully integrated collaborative application lifecycle management (ALM) environment.

Best Practice Processes

BusinessPlanning &Alignment

Product& Project

Management

RequirementsDefinition &Management

Configuration& Change

ManagementBuild &Deploy

ManagementAsset

ManagementQuality

Management

Compliance& Security

IBM Rational Software Delivery Services for Cloud

Dramatically reduce up front costs by reducing acquisition costs.

Cost effectively test solutions in the cloud to optimize your software delivery life cycle

More Testing with Less!Overflow Test Workloads on the Cloud

Leverage the elasticity of the cloud to run one-off large scale performance testing with additional load generating RPT agents in

the Cloud to go beyond their standard capacity.

48

RPT Agents

RPT Agents

Application/System Under Load Test

Load Generation

Rational Performance

TesterLoad Generation

Provision / Tear-down VMs on-demandDynamically adjust configurationFailover support

IBM CONFIDENTIAL

49

Transforming software & systems lifecycle management


Analyst


Developer

RationalQuality

Manager

RationalTeam

Concert

RationalDOORS

RequirementsProfessional

Five Things We’re DoingFive Things We’ve done

50

Collaborative Lifecycle Management

Partnership: SAP & Systems

Smart Automations

Simplification

Delivery Models


51

Where we’ve been

Where we’re going

Final Thoughts....


Software Delivery is a Team Sport

52

“It is not a question of how well each process

works.

The question is how well they all work

together.

And Finally – Next Week…

53

Keep the Conversation Goinghttp://rationaltester.wordpress.comhttp://qualitymanager.wordpress.comhttp://twitter.com/rationaltesterhttp://youtube.com/rationaltester

The premiere software and product delivery event.June 6–10 Orlando, Florida

Accelerating Quality Assurance

Quality ManagementPortfolio Update

Brian BrysonTechnology Evangelist, IBM

[email protected]

accelerating quality assurance quality management ... · the premiere software and product delivery...

Documents