1 ©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice

Using HP Quality Center 10.0 Premier to introduce processes and control into existing testing Michael Deady, CPCTest Tool Administrator

JC Penney Inc.

2 ©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice

Introduction About JCPenney Inc JCPenney Application Testing Center Business Problem

Quality Center 10 Premier ATC & Quality Center Decision Process

The Implementation Plan Plan, Train, Design and Development

In Closing Things to Know Hints and Tips Other Premier advantages Summary

3

About JCPenneyAbout JCPenney

Department Store Retailer with 1,110 stores

Locations in United States and Puerto Rico

Largest Apparel & Home Furnishing site on the internet (JCP.COM)

Stores also provide styling salon, optical, portrait photography, and custom decorating services

Corporate Headquarters: Plano, Texas

Employees: 150,000

4

• Other Benefits• Centralized administration• Framework creation• Vendor management• Aggregated purchase

• Other Benefits• Centralized administration• Framework creation• Vendor management• Aggregated purchase

JCPenney Application Testing CenterJCPenney Application Testing Center

• What we Provide JCP I.T.• Processes • Services

• Test automation engineers• Performance engineers

• Training• Templates• Forum for best practices sharing

• What we Provide JCP I.T.• Processes • Services

• Test automation engineers• Performance engineers

• Training• Templates• Forum for best practices sharing

The Application Testing Center (ATC) was founded to create a Center of Excellence (COE) for JCPenney I.T. division by providing the Application Testing Teams, the best tools, services, and resources to improve the quality and consistency of application testing across JCPenney.

The Application Testing Center (ATC) was founded to create a Center of Excellence (COE) for JCPenney I.T. division by providing the Application Testing Teams, the best tools, services, and resources to improve the quality and consistency of application testing across JCPenney.

5

Test Management JCP Business ProblemTest Management JCP Business Problem

Pitfalls:• After consolidating Quality

Center into a single environment, we had over 250 projects, several housing 10 defects or less. ???

• Each Quality Center project was unique, and highly customized

• Testing groups were very isolated and had very little interaction with peers or staff

• High use of Excel upload processes

• A lot of manual rework causing user frustration with the tools

• No training around the tools• Contractor-driven testing

Pitfalls:• After consolidating Quality

Center into a single environment, we had over 250 projects, several housing 10 defects or less. ???

• Each Quality Center project was unique, and highly customized

• Testing groups were very isolated and had very little interaction with peers or staff

• High use of Excel upload processes

• A lot of manual rework causing user frustration with the tools

• No training around the tools• Contractor-driven testing

Huddles:• Most of the QC projects were still

active• Admin permissions were very loose• Most Admin personnel had no formal

training• The level of understanding of the tool

was limited• No environment management• An understanding of the tools

• Defect vs. Test Management

Huddles:• Most of the QC projects were still

active• Admin permissions were very loose• Most Admin personnel had no formal

training• The level of understanding of the tool

was limited• No environment management• An understanding of the tools

• Defect vs. Test Management

6

JCPenney Application Testing Teams Top Ten (Why HP-QCP)JCPenney Application Testing Teams Top Ten (Why HP-QCP)

1. Keep It Simple or K.I.S. - A.T.C.

2. Sharing information across projects and development tools

3. The capability goes back in time or compares historic information (Version Control)

4. The ability to customize an individual HP Quality Center project to better fit the Development project, while maintaining a level of uniformity.

5. Consistent KPI's across projects

6. Use templates and build a process.

7. Reduce the level of duplication and redundancy

8. Customize control capability

9. The ability to test in any environment (Production, Test, and Development) at the same time -- (baselines)

10.The capability to manage every facet of QDLC and/or SDLC

1. Keep It Simple or K.I.S. - A.T.C.

2. Sharing information across projects and development tools

3. The capability goes back in time or compares historic information (Version Control)

4. The ability to customize an individual HP Quality Center project to better fit the Development project, while maintaining a level of uniformity.

5. Consistent KPI's across projects

6. Use templates and build a process.

7. Reduce the level of duplication and redundancy

8. Customize control capability

9. The ability to test in any environment (Production, Test, and Development) at the same time -- (baselines)

10.The capability to manage every facet of QDLC and/or SDLC

What ATT’s want in a (Test) Management System?What ATT’s want in a (Test) Management System?

7

Relation between ATC & Quality Center Relation between ATC & Quality Center

 In 2008 ATC selected HP’s Quality Center as the enterprise solution for test management to ensure continuity and consistency across JC Penney. ATC was tasked with aiding our IT and business partners in the conversion and consolidation of all leagues of defect tracking and testing repository systems and/or test applications into the Approved Test Management system.

ATC has been so successful at integration of the testing tools into the approved testing process and methodology that if you login into the newer QC projects you are more than likely following ATC’s Processes.

“Quality Center acts as the Backbone to our

Methodology”

“Quality Center acts as the Backbone to our

Methodology”

8

Decision ProcessDecision Process

Why Quality Center 10.0?JCP needed the ability version artifacts and establish points reference

Why Quality Center 10.0?JCP needed the ability version artifacts and establish points reference

Why Quality Center Premier• Structure and best practices into the environments

that could not afford the cost or the time to implement.

• The capability to share information across several projects to eliminate the duplication of artifacts and reduce test development time (Test Case, Requirements, Resources, etc.)

Why Quality Center Premier• Structure and best practices into the environments

that could not afford the cost or the time to implement.

• The capability to share information across several projects to eliminate the duplication of artifacts and reduce test development time (Test Case, Requirements, Resources, etc.)

ATC Objectives• Upgrade legacy Quality Center projects • Lower maintenance model for 2010• To better align the Quality Center projects with the

AUT • Reduce the amount of training across JCPenney

ATC Objectives• Upgrade legacy Quality Center projects • Lower maintenance model for 2010• To better align the Quality Center projects with the

AUT • Reduce the amount of training across JCPenney

9

Quality Center 10.0 Premier’s Point of Interest for ATCQuality Center 10.0 Premier’s Point of Interest for ATC

• The ability to enforce processes and methodology • The capability to change the process, fields or workflow

without negatively impacting the project• The ease of moving information from one project to

another • The ability to introduce change with speed and accuracy • The capacity to share and control the flow of data across

projects• Built-in cross project reporting• Real-time dashboard• The new friendly dashboard user interface• Etc..

• The ability to enforce processes and methodology • The capability to change the process, fields or workflow

without negatively impacting the project• The ease of moving information from one project to

another • The ability to introduce change with speed and accuracy • The capacity to share and control the flow of data across

projects• Built-in cross project reporting• Real-time dashboard• The new friendly dashboard user interface• Etc..

• Then attract the Projects to the new template by enticing them with QC Premier’s new functionality

• Then attract the Projects to the new template by enticing them with QC Premier’s new functionality

• Create the template which incorporated the ATC methodology and processes

• Create the template which incorporated the ATC methodology and processes

10

The Implementation PlanThe Implementation Plan

The plan was straightforwardThe plan was straightforward

Brown Bags including Tool Overview by HP and Open Deep Dive training

Brown Bags including Tool Overview by HP and Open Deep Dive training

One on One Meeting with the Application Testing Team

DemosDemos

Meet with the business user

Open Brainstorming ForumsOpen Brainstorming Forums

11

The Road ShowThe Road Show

Application• A program that gives a computer instructions that provide the user

with tools to accomplish a task

System• A group of interacting, interrelated, or interdependent elements

forming a complex whole.

Application• A program that gives a computer instructions that provide the user

with tools to accomplish a task

System• A group of interacting, interrelated, or interdependent elements

forming a complex whole.

Step 1: Define what is a Quality Center ProjectStep 1: Define what is a Quality Center Project

QC Project • Is the logical collection of data relevant to a set of applications that

interacts to serve a business purpose. This data may refer to hardware, software, requirements, tests, defects, and/or any other artifacts used in the validation of the system. The Quality Center project documents the complete lifecycle of the application or system from concept to decommission.

QC Project • Is the logical collection of data relevant to a set of applications that

interacts to serve a business purpose. This data may refer to hardware, software, requirements, tests, defects, and/or any other artifacts used in the validation of the system. The Quality Center project documents the complete lifecycle of the application or system from concept to decommission.

12

13

___ _ ____ ______ ____________ _______ ___ _ ____ ______ ____________ _______Step 1A: HP’s QC Cross-Project Customization OverviewStep 1A: HP’s QC Cross-Project Customization Overview

Creating a Template Project

Linking the Template to

Projects

Customizing the Template Project

Verifying Cross Project

Customization

Applying Customization to Linked Projects

Creating a Template Project Creating a Template Project

Linking the Template to ProjectsLinking the Template to Projects

Customizing the Template ProjectCustomizing the Template Project

Verifying Cross-Project Customization

Applying Customization to Linked ProjectsApplying Customization to Linked Projects

Quality Center Help File 2009 Hewlett-Packard Development Company, L.P.

14

Step 1B: HP’s QC Cross Project Customization ExamplesStep 1B: HP’s QC Cross Project Customization Examples

Set a standard for working with defectsSet a standard for working with defects

Enable consistent reporting by managers. Enable consistent reporting by managers.

Create corporate Policies and Processes for separate sectors of an organization

Create corporate Policies and Processes for separate sectors of an organization

15

Step 2: Training and Planning Step 2: Training and Planning

• Spend some time on understanding all the new features• Warning: the template tool has a large

foot print on the projects and access should be controlled

• Take note of the what the template will or will not change at the project level

• Create a template that reflects your workflow, and can generate the required information for reporting metrics

• Tools and Skills• A understanding of Quality Center project

backend, especially workflow • Quality Center 10.0 Premier• A well documented testing process• Access to both SA and TD • An understanding of roles and

responsibilities within Quality Center

• Spend some time on understanding all the new features• Warning: the template tool has a large

foot print on the projects and access should be controlled

• Take note of the what the template will or will not change at the project level

• Create a template that reflects your workflow, and can generate the required information for reporting metrics

• Tools and Skills• A understanding of Quality Center project

backend, especially workflow • Quality Center 10.0 Premier• A well documented testing process• Access to both SA and TD • An understanding of roles and

responsibilities within Quality Center

16

Step 3: Design and DevelopmentStep 3: Design and Development

• Development of Template Workflow• Template Entity vs. Local Entity• Levels of Access• Version Control• Template Reports• Presentation Layers

• Development of Template Workflow• Template Entity vs. Local Entity• Levels of Access• Version Control• Template Reports• Presentation Layers

17

Create unique policiesCreate unique policies

Enable consistent reporting by managers.

Enable consistent reporting by managers.

Set standardsSet standards

Process using QC Premier Template (Workflow)Process using QC Premier Template (Workflow)

NOT REPORTED

REPORTING CLOSED

REPORTING OPEN

NEW

IS DEFECT VALID

OPEN

ACCEPT DEFECT?

ASSIGNED

FIXED

DEFERRED

DEFECT RETEST SUCCESSFULLY?

REOPEN

CLOSED

RETESTED SUCCESSFULLY

PERMANENT WORKAROUND

No

YES

REJECTED

No

YES

NO

YES

A DEFECT/ENHANCEMENT CAN ENTER DEFERRED STATUS FROM ANY POINT ALONG THE LIFECYCLE AS THIS STATUS USUALLY REQUIRES A RISK

ANALYSIS

INVALID TEST

INVALID REQUIREMENTS

EXTERNAL ISSUE

DUPLICATE

USER ERROR

PENDING REVIEW

FUTURE ENHANCEMENT

PENDING ASSIGNMENT

WAITING FOR VENDOR

WORKING

RESEARCHING

SENT TO VENDOR

PENDING ASSIGNMENT

Clarification

READY FOR QA TEST

Key

DISPOSITION

STATUS

DECISION

DOCUMENTATION FOR

WORKAROUNDS

Operations Impact

Technical Impact

Customer Impact

TEMPORARY WORKAROUND

• Project Entities (Shared) link to customize system fields and create user-defined fields.

• Project Entities (Shared) link to customize system fields and create user-defined fields.

18

Process using QC Premier Template (Entities)Process using QC Premier Template (Entities)

19

What Templates updateWhat Templates update

TaskTemplate UpdateSharing

Local update Only

User Properties

Project Users

Groups

Module Access

Project Entities

Requirement Types

Risk-Based Quality Management.

Project Lists

Auto mail

Alert Rules

Workflow Template With Calls only

Cross Project Customization Linked Projects Linked Template

20

Step 3: ImplementationStep 3: Implementation

To add a project to a template you need to be in the Site Admin screen

To add a project to a template you need to be in the Site Admin screen

To push changes to the projects you need to be in the Project template customization screen

To push changes to the projects you need to be in the Project template customization screen

21

Template VerificationTemplate Verification

Verification Report

Provides results of verification for the linked project.

Verification Report

Provides results of verification for the linked project.

Applied Customization Report

Provides results of template customization applied to the linked project.

Applied Customization Report

Provides results of template customization applied to the linked project.

22

Detailed ReportingDetailed Reporting

Result category

Verification Report

Successful The change can be successfully applied to the linked project.

Warning The change can be applied to the linked project, but may result in data loss.

Failure The change cannot be applied to the linked project.

23

Project Level CustomizationProject Level Customization

Cross-Project Customization • Linked Template page.

• View details about template customization • Send email to the template administrator • Check for conflicts between customization in the

project and customization in the template project• Request to block template customization updates

Cross-Project Customization • Linked Template page.

• View details about template customization • Send email to the template administrator • Check for conflicts between customization in the

project and customization in the template project• Request to block template customization updates

24

Project Update (Pushing)Project Update (Pushing)

• Update one or all of the projects

• Update time stamp• Contact Help • Easy to follow

instructions

• Update one or all of the projects

• Update time stamp• Contact Help • Easy to follow

instructions

• Updates pushed while people logon

• Detail reporting for users• Email Notification• Built-in Process

• Updates pushed while people logon

• Detail reporting for users• Email Notification• Built-in Process

25

Other Premier AdvantagesOther Premier Advantages

Dashboard allows the different Application Testing Teams to consolidate reporting

Dashboard allows the different Application Testing Teams to consolidate reporting

Defect Synchronizer allows users to send defects across projects and external applications (JIRA)

Defect Synchronizer allows users to send defects across projects and external applications (JIRA)

Requirements sharing has helped ATC make the business case that the development and management of business requirements should be managed in Quality Center

Requirements sharing has helped ATC make the business case that the development and management of business requirements should be managed in Quality Center

Sharing test cases and business components development, track, and execute across several projects reducing redundancy and duplication

Sharing test cases and business components development, track, and execute across several projects reducing redundancy and duplication

Resource sharing has greatly added to the automation of applications by drawing on existing functional libraries, object repositories, and data

Resource sharing has greatly added to the automation of applications by drawing on existing functional libraries, object repositories, and data

26

Quality Center Synchronizer Quality Center Synchronizer

The Synchronizer enables you to synchronize data between Quality Center and other applications, or between two Quality Center projects.

The Synchronizer enables you to synchronize data between Quality Center and other applications, or between two Quality Center projects.

Integrity ChecksIntegrity Checks

Incremental SynchronizationsIncremental Synchronizations

Full SynchronizationsFull Synchronizations

Working with Quality Center Version ControlWorking with Quality Center Version Control

QC Project B

QC Project F

QC ProjectJCP

QC Project E

QC Project D

QC Project C

QC Project A

QC Project H

Quality Center

Synchronizer

27

QC 10 Premier Baseline (sharing across SDLC) QC 10 Premier Baseline (sharing across SDLC)

QC Project B

QC Project A

Update

SystemEnd

to E

nd

UAT UNIT

&

Inte

grat

ionRelease 1.0

Develop

Cycle Unit

Cycle SystemCycle Functional

Cycle End to End

Cycle UAT

Update

Syste

mEnd to End

UATUNIT &

Integration

Develop

BaselineProject A

Update

SystemEnd

to E

nd

UAT UNIT

&

Inte

grat

ion

Develop

BaselineProject B

Share Project B

Release 1.1

Update

Syste

mEnd to End

UATUNIT &

Integration

Develop

BaselineProject B

Share Project A

BaselineProject A

BaselineProject B

Share Project B

Update

Syste

mEnd to End

UATUNIT &

Integration

Develop

BaselineProject B

Share Project A

Release 3.10

Release 3.11 Release

4.00

28

Sharing of documents

Incorporated technical and functional documents

Traceability

Sharing of documents

Incorporated technical and functional documents

Traceability

Reduce rework and duplication

Version control documentation

Easy to modify existing documentation

Single repository

Reduce training costs

Easily customized

Reduce rework and duplication

Version control documentation

Easy to modify existing documentation

Single repository

Reduce training costs

Easily customized

Quality Center as part of the SDLC ProcessQuality Center as part of the SDLC Process

29

Things to KnowThings to Know

Key Note: Purge all local workflow before adding project to template - this may cause errors later

Key Note: Purge all local workflow before adding project to template - this may cause errors later

Module access is handled at the Project Level Module access is handled at the Project Level

I recommend that you standup the Synchronizer on independent hardware to avoid any issues.

I recommend that you standup the Synchronizer on independent hardware to avoid any issues.

Remember that sharing defects uses the Quality Center Synchronizer.

Remember that sharing defects uses the Quality Center Synchronizer.

Sharing information from two projects relies on base lining functionality

Sharing information from two projects relies on base lining functionality

(Migration) uses the QC Synchronizer to move Defects from older projects to updated projects using QC 10 Templates

(Migration) uses the QC Synchronizer to move Defects from older projects to updated projects using QC 10 Templates

Limit your support for Excel Add-in Limit your support for Excel Add-in

Backup code manually before making changes to the Template project

Backup code manually before making changes to the Template project

30

Tricks and TipsTricks and Tips

Plan a phased rollout of all the new functionality

This can be overwhelming for the local project administrator and can cause training issues as well.

Plan a phased rollout of all the new functionality

This can be overwhelming for the local project administrator and can cause training issues as well.

Uses Brown Bags or short training sessions

Introduce the new functionality (what’s new)

Uses Brown Bags or short training sessions

Introduce the new functionality (what’s new)

Keep your Template Simple

The number of templates can also be an issue

Keep your Template Simple

The number of templates can also be an issue

Follow best practices

When coding workflow and document everything

Follow best practices

When coding workflow and document everything

Try to keep information and defect sharing inside one templateTry to keep information and defect sharing inside one template

Create a process flow before attempting to share information

Defects, Requirements, Resources, Test cases

Create a process flow before attempting to share information

Defects, Requirements, Resources, Test cases

31

Introducing Processes and Control Into Existing Testing Environments Using HP Quality Center 10.0 Premier

Introducing Processes and Control Into Existing Testing Environments Using HP Quality Center 10.0 Premier

32