Software Testing with Microsoft Test Manager 2012 and Lab ManagementBrian KellerSr. Technical EvangelistMicrosoft Corporation

DEV337

I work here…

…on this…

…and this.

http://bit.ly/ThisWeekC9

I blog here:http://blogs.msdn.com/briankel

http://tinyurl.com/ALM2010Book http://tinyurl.com/TFSBook

Agenda

Manual TestingFormal Test Case ManagementExploratory Testing

Lab ManagementStandard EnvironmentsBuild-Deploy-Test Workflows

Tracking Quality

USS Yorktown, SmartShip

crew member entered 0 in a data entry field, caused a “divide by 0” error that shut down propulsion

dead in the water for 2hrs 45mins

Ariane 5 Flight 501

re-used code from Ariane 4, but took a different flight path because of different booster design

conversation from 64bit float to 16bit signed int caused overflow (exception handler was disabled for perf reasons)

cost: > $370 million @ 1996 prices

Vasa

sank after sailing less than 1 nautical mile out of Stockholm

specifications were faulty, failing to take into account enough ballast to keep the ship upright

test teams revealed that it was unstable, but launch was rushed, and QA was ignored

Training

Conditioning

Climbing

Training Phase

Cost of Failure

Development

Test

Release

Software Phase

Cost of Bugs

Generalist Specialist

Manual Testing Some scripting

Creates scripts to set up lab, create data

Strong scripting skills

Some coding skills

Strong coding

Develops automated testing procedures

Expert coding skills

Tester Segmentation

Black Box Testing

White Box Testing

API Testing

70% of testing happens here

majority of test tools target here

What usually happens when a testerfinds a bug?

Graphic by Jeff Atwood (CodingHorror.com)

Visual Studio

demo

Microsoft Test Manager 2012

Manual Testing Improvements

Exploratory TestingRich text test stepsHTML5 automationMetro style application testingPass / Fail tests from Test Activity

http://www.speakflow.com/View.aspx?presentationID=ac460729-6cce-4deb-8f09-5faa5873f027&mode=presentLocally

Environments

SCVMM Environment Standard Environment

Build-Deploy-Test

Snapshot / Restore

Share Bug Snapshots

Network Fencing

3rd Party Virtualization

Physical Machines

demo

Lab Management

Lord Kelvin, 1824-1907

“…you cannot manage what you cannot measure.”

– INTERNAL ONLY

– INTERNAL ONLY

– INTERNAL ONLY

– INTERNAL ONLY

– INTERNAL ONLY

– INTERNAL ONLY

Go get started!

Download the RC: www.microsoft.com/VisualStudio/11 Download the ALM VM: http://aka.ms/VS11ALMVMAsk the Experts, TLC area

tfspreview.com

Related Content

Breakout Sessions

DEV214 Introducing the New Visual Studio 2012 Unit Testing Experience

DEV344 Developer Collaboration with Team Foundation Server 2012

AAP309 Making Agile Estimation Work

DEV337 Software testing with Microsoft Test Manager 2012 and Lab Management

DEV317 Going Beyond F11: Debug Better and Faster with Visual Studio 2012

DEV340 Taking ALM to the Cloud with the Team Foundation Service

AAP313 Scrum Under a Waterfall

DEV362 From Development to Production: Optimizing for Continuous Delivery

DEV363 Dev-Ops Best Practices on the Microsoft Stack

DEV212 Implementing Scrum Using Team Foundation Server 2012

Related Content

Breakout Sessions

DEV346 All Aboard the Team Foundation Server Express

DEV217 Deep Dive into the Team Foundation Server 2012 Agile Planning Tools

DEV365 Advanced IntelliTrace in Production with Visual Studio 2012

DEV316 Application Lifecycle Management Tools for C++ in Visual Studio 2012

DEV343 Implementing Team Foundation Server in the Enterprise

DEV321 Continuous Feedback in Agile Teams

DEV243 Demystifying Team Foundation Server Builds

DEV411 Testing Un-testable Code with Fakes in Visual Studio 2012

DEV410 Deep Dive into Team Foundation Server 2012 Reporting

DEV412 Identify and Fix Performance Problems with Visual Studio 2012 Ultimate

DEV345 The Accidental Team Foundation Server Admin

Related Content

Breakout Sessions

DEV318 Working on an Agile team with Visual Studio 2012 and Team Foundation Server 2012

DEV339 Metrics That Matter: Improving Lean and Agile, Kanban and Scrum

AAP204 Introduction to Kanban

Hands-on Labs (session codes and titles)

DEV11-HOL

Agile Project Management in Team Foundation Server 2012

DEV12-HOL

Build the Right Software and Collaborate Effectively Using Storyboarding and Feedback Tools in Visual Studio 2012

DEV13-HOL

Using IntelliTrace with Production Systems to Quickly Diagnose and Fix Issues

DEV16-HOL

Learn How Microsoft Test Manager 2012 Will Embrace an Exploratory Testing Approach

DEV17-HOL

Explore the New Unit Testing and Code Clone Capabilities of Visual Studio 2012

DEV19-HOL

Discover How the New Features of Team Foundation Server 2012 Can Improve Collaboration in Your Development Team

Resources

Connect. Share. Discuss.

http://europe.msteched.com

Learning

Microsoft Certification & Training Resources

www.microsoft.com/learning

TechNet

Resources for IT Professionals

http://microsoft.com/technet

Resources for Developers

http://microsoft.com/msdn

Evaluations

http://europe.msteched.com/sessions

Submit your evals online

© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to

be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS

PRESENTATION.