mtm test management system

41
Immucor, Inc. All Content ©2010 Immucor, Inc. Microsoft Test Manager Test Management Tool Immucor, Inc. By: Minu Mishra

Upload: minu-mishra

Post on 16-Aug-2015

43 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Microsoft Test Manager Test Management Tool

Immucor, Inc.By: Minu Mishra

Page 2: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

• Benefits• Modules and Microsoft Test

Manager Demo

Agenda

Page 3: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Centralized Storage & Repository Usage

Supports the entire testing lifecycle

Easy browser interface & accessibility

Requirement Traceability

Problem Management /Defect

Supports Test Script Automation

Report Generation (Graphs & Reports)

Status Tracking (Testing Progress / Defects)

Sorting & Filtering ability providing various views

Benefits

Page 4: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

MTM uses following the modules, as illustrated below,To manage requirements, plan tests, execute tests andManage defects for remediation. Each module can be accessed by clicking on the New tab at the top of theMTM main screen:

– Requirements Management; – Test Case management;– Bug Tracking and Reporting; – Risk Management;– Change Management;– Issue Management;– Task

Modules

Page 5: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Add/Modify/Delete the requirement.

Overall status of the requirement (Reviewed/Not Covered)

Requirements are linked to the test case(s).

Requirements Module

Page 6: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Connecting To the Microsoft Test ManagerPre-Requisite: Visual Studio 2010 must be installed before using MTM.Microsoft Test Manager is accessible from any Immucor web browser using the following URL: http:atl-tfs01\

Page 7: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Getting Connected to MTM:

1. Ensure that the proper Project is selected from the Project List.

2. Click on

Note: The first time MTM is accessed; there will be a short delay while the required web objects are downloaded to the browser. This is a one-time activity as the objects are permanently stored in the browser once they are downloaded.

Page 8: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Getting Started With Microsoft Test Manager

Microsoft Test Manager

Microsoft Test Manager is an application that allows the user to control the following major facets of the testing process:

•Requirements Management; •Risk Management•Change Management•Issue Management•Test Planning: •Test Execution; and •Bug Tracking and Reporting.

All are controlled through a single browser-based application.

Page 9: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Select Work ItemsMicrosoft Test Manager uses multiple Work Items, as illustrated below, toManage requirements, plan tests, Issue, Task and manage Bugs for remediation. Each Work Item can be accessed by clicking on the New tab located on the Right

atthe top of the Microsoft Test Manager main screen: NEW

Page 10: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Once user is connected with the project click the New Tab located in upperright corner. When user click the “New” tab, a drop down list of work items isdisplayed.

Open Bug Work Item

New Work Items List

Page 11: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Requirements Module

A

B

C

D

E

Select the Requirement work item from the New drop down list.

Page 12: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

• Requirement Item has Requirement Priority A which is based upon Criticality of the Requirement Risk – B.

• If the requirement is associated with the ETQ Document and has ETQ Reference Number C, enter that number in the field for traceability purposes.

• One or more Test Case(s) D can be attached by clicking on the Test Case Tab.• If the requirement has attachment(s) E the user will have the ability to attach

multiple documents, Screen prints, files, etc., as needed.• • Note: One Requirement can have multiple Test Cases attached but a Test case can

be attached or refer to only one Requirement. A Test Case can’t be associated or attached to multiple Requirements.

Requirements Module

REQUIREMENTREQUIREMENT

Test Case

Test Case

Test Case

Test Case

Test Case

Test Case

Test Case

Page 13: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

• Test PlanningMicrosoft Test Manager can act as the centralized repositoryof all testing artifacts. The Testing Team scope includes thefollowing testing activities, all of which are managed usingMTM:

– Unit Testing;– Integration(code-based) Testing;– System Integration Testing;– Regression Testing; and– Data Integrity Testing;

Test Plan Module

Page 14: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Planning Tests Using Microsoft Test Manager

Page 15: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Add Test Plan window appears after Selection of Project,click on the Add Test Plan tab.

Test Plan Module

Page 16: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Enter a descriptive name of Test Plan. And click on The pre-populated folder structure for each functional area within the scopeof the application-testing project will be displayed.

Test Plan Module

Page 17: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

A test suite can be added by Right clicking on theTest Plan;

Adding Test Suite to the Test Plan

Page 18: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Right Click on the Test Suite and Rename it if needed. User canEither add an existing test case(s) or create and add a new testcase by selecting the option to the Test Suite.

Adding Test Cases to a Test Suite

Page 19: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Right click on The Test Suite and select add a Test Case. Onceuser clicks on add Test Case from the Right Click drop down thena Query window pops up for the “Add Test Cases to Suite”.

Test Plan Module

Page 20: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Test Plan Module

Page 21: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Select or highlight Test Suite and click on button.“Add existingRequirement to this Test Plan” Query window will be displayed. Provideappropriate criteria and Run Query. Result will display the list of

Requirements.Select the Requirement and click on “Add Requirement to Plan” button.

Associating Requirement to the Test Suite

Page 22: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Open an existing Test Case or write a new test case then click on “TestedRequirement” Tab then click on icon. A pop window of “Add link to

theTest Case” will open up. Provide required information and add requirementsto the Test Case.

Linking Requirement to the Test case

Page 23: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Linking Requirement to the Test case

Page 24: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

The status flag is used to track the position of each test case throughout thereview process. The diagram below illustrates the workflow for the change ofStatus of each test case:

Test Case Status Workflow

Page 25: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

The Test module of Microsoft Test Manager Application will be used tocoordinate and track the execution of the test cases that were designed usingthe Test Plan module.

Test Run

Page 26: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

–Bug Work Item(Defect Management)

Add/Modify/Delete the Bugs

Two ways to add a Bug: During test execution Manually

A test condition can be associated to multiple bugs but a bug can only be associated to one test condition.

Status tracking & reporting on the defects

Filtering capability will be extremely useful when searching for the bugs on a particular criteria. (e.g., High priority/Open bugs).

Bug Tracking Tool using Microsoft Test Manager

Page 27: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Bug Form

Page 28: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

The testing Team will utilize the Bug work Items in the event of test failure or iferrors are detected during Testing.

Bug Work Item

Page 29: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Start the Microsoft Test Manager’s Test Run Utility• Click the button. • Start Test Window will appear. Click on Start Test in order to start the test

execution manually.

Test Execution

Page 30: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Bug Identification

Bugs should be captured when any application anomaly is encountered,unless the Bug is identical to one that has been previously identified andrecorded during the testing process. If there is a question as to whether theBug is the same as a previous Bug, the user should record the Bug and allowthe Test Lead to determine if there is duplication.

Bugs should be captured and recorded if:

o The actual result of a test step does not match the expected result;o A function of the application being tested is not working according to

specifications; oro A general problem, which is non-bug related, is observed within the

application.

Capturing and Recording a Bug

Page 31: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

if the user is unable to record a Bug during test execution, the Bug may be submittedlater as follows:• Click on the New Button on the MTM main Screen. (A)• Select Bug from the List and highlight it. (B)• Click on OK.

Capturing and Recording a Bug

A B

Page 32: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Bug tracking form has mandatory fields which are highlighted. Dates arepopulated automatically. Text fields will be entered manually.

Bug Tracking Form

Page 33: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

The Tracking Phase provides important information for evaluating the progressof current projects as well as for monitoring the overall quality process of anorganization resolved.

Bug Management Cycle

Page 34: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

The Bug Status Management process begins with the detection of the bugand ends with the re-testing and closing Bug.

Bug Status Management Process

Page 35: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Bug tracking has following status:– New– Open– Fixed– Test– Passed

• Closed– Failed

• Open / Reopen

Bug Status

Page 36: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

New: Once user enters a new bug in tracking tool, tool automatically assigns the statuscalled NEW. It means just entered or not reviewed by assignee.Open: When status is labeled “OPEN’, it means it has been reviewed and validated.Reviewed: Once assignee Reviews the Bug, Status gets changed to Reviewed.Fixed: After bug gets fixed and is compiled, Status changes to Fixed.Test: After compilation, Fixed gets assigned back to testing team to test. The Statuschanges to “Test”. It means it is ready for the test.Passed: Once assigned tester executes the fixed Bug and if it gets passed, the Status willbe changed to “Passed”. It means that the defect can be closed.Closed: When the Bug pass the test, then either the assigned tester or an Authorizedperson (either lead or manager) will close that bug by changing the status to “Closed”.Failed: If Bug doesn’t pass, means error remains the same as entered then Statuschanges to Failed.Reopen: Since this defect was fixed and tested against in new build or Releaseenvironment, it will be re-entered as “Reopen” status.

Bug Status

Page 37: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

The following table lists the fields that must be completed when recording Bugs and providesnotes to assist the end-user on the meaning of the content within the specific field.

Bug Fields and Values

Field Type Notes

*Summary Text Brief one-line description of the submitted Bug

*Assigned To Name Name of the Responsible Developer

*Status Drop down list Status of Bug like; New, Open, Reviewed, etc.,

-Resolved by Name Default to the System

*Resolved Reason Drop down list Reason for the Bug Fix

*Resolved Date Date Bug fix date

*Closed by Name Name of the person who closed the bug. (Team Lead)

*Functional Area Drop down list The category of the Bug as it relates to the application

*Status Change Date Date Date, when Bug status was changed.

*Created by Name of the person of Entered the Bug

Defaults to your Computer

*Created Date Date Defaulted with current date

*Closed Date Date Bug closed date

*Priority Drop down list Depending on the Bug and the impact/risk to the business that the Bug poses

*Severity Drop down list Depending on the Bug and the impact/risk to the Application that the Bug poses

*Found in Version Drop down list Actual application under test version

Fixed In Version Drop down list Bug Fixed version number

*Detail Description Text Enter the details of the test step that the Bug was detected

*Step to Reproducible Text Enter the Test Steps to Reproduce the Bug if entering bug manually.

Page 38: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

The user should include as much information as possible to allowthe Bug to be diagnosed, and re-mediated where appropriate,including:

Name of test case and test step Summary of the Bug – typically a one-line description of the Bug Screen shots Data used Test step that Bug was raised Assigned to Modified or changed by Project Status

Detail Information:

Page 39: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Bug Reports will be generated to measure Traceabilityon following basis:

By Requirement Coverage,By Test Script Execution Coverage,By Number of Bugs found,By Priority of the Bug(s), Etc.’

Customized reports can be created as per the need ofthe Management or team.

Bug Reports

Page 40: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

As Bugs are updated into MTM, updatemessages should be sent to all appropriatestakeholders within testing and applicationdevelopment groups. The appropriate Teammember will compare the Bug updateinformation in MTM with the Bug informationThis Bug process should be performed on aregularly scheduled basis.

Disposition of Bugs

Page 41: MTM Test Management System

Immucor, Inc. All Content ©2010 Immucor, Inc.

Thank you