advanced diagnostics, intellitrace™ and test automation
DESCRIPTION
PDC09-FT16. Advanced Diagnostics, IntelliTrace™ and Test Automation. Habib Heydarian ( [email protected] ) http://blogs.msdn.com/habibh Program Manager Microsoft Corporation. VS2010: Quality as a 1 st Class Citizen. 1. 2. 4. 3. It Works on My Machine!. Write Code. - PowerPoint PPT PresentationTRANSCRIPT
Advanced Diagnostics, IntelliTrace™ and Test AutomationHabib Heydarian ([email protected])http://blogs.msdn.com/habibhProgram ManagerMicrosoft Corporation
PDC09-FT16
VS2010: Quality as a 1st Class Citizen
1 2
34
It Works on My Machine!
File Bug
Resolve as“No Repro”
Hand-offto Test
Test Code Hand-offto Dev
Investigate Bug
Write Code
What is IntelliTrace?
+ =
Application Instrumentation Log File
Today
+ ==
IntelliTrace • Record• Playback• Rewind
IntelliTrace
IntelliTrace: How Did I Get Here?
Habib HeydarianProgram ManagerVisual Studio
demo
IntelliTrace Capabilities> Code is instrumented dynamically> Records program execution flow
> Method Enter & Exit> Records program data
> Parameters> Return values
> Low overhead for collection> Supports Dev, Test and Staging
environments> Pay-as-you-go collection model> 1st class debugging experience in VS
IntelliTrace: Why did this Build Verification Test (BVT) test fail?
Habib HeydarianProgram ManagerVisual Studio
demo
How IntelliTrace WorksApplication
IntelliTrace File
CollectionPlan.xml
IntelliTrace Recorder
Choose the Right Tests
Automated
Testing
Manual Testing
User Testing
Choosing the Right TestsThe Problem
Application Functionality
Q: Which tests should the developer and tester run to verify this code change?A) Automated Tests
onlyB) Manual Tests onlyC) All of the aboveD) Don’t knowE) Trick question??
Δ
Code Change
Choosing the Right TestsThe ConsequenceThe world of Developers> Run more tests than
needed> Run too few tests than
needed
The world of Testers> Verify more tests than
needed> Verify too few tests than
needed
1. Less Productivity• Effort wasted on tests that don’t need to be
run2. Lower quality• Not enough testing to verify code change
What is Test Impact Analysis?> Automatically pinpoint which tests are
impacted as a result of a code change What is the impact
of this bug fix?
Test Impact Analysis: A One Line Bug Fix
Habib HeydarianProgram ManagerVisual Studio
demo
How Test Impact Analysis Works
Automated Impacted Tests
Test Impact View
TFSTeam Build
Manual Impacted Tests
Microsoft Team & Lab Mgr
Team Build Report
A B
C
Multi-Tier Performance Analysis
Client-side Script Database calls
Multi-Tier Performance AnalysisUser: “Why is it taking so long to load the Orders
page?”
Developer: “I wonder where the
problem could be???”
Front End?
Mid Tier?
Back End?
Performance Analysis Across Multiple Tiers
Habib HeydarianProgram ManagerVisual Studio
demo
Solve Complex Debugging Tasks
Collaborative Debugging
Habib HeydarianProgram ManagerVisual Studio
demo
DataTipsPin the DataTip to the source code
DataTip stays in sync with the source code
Toolbar allows the user to pin/unpin a DataTip
Context menu for managing values/expressions in the DataTip
Floating DataTips can be dragged anywhere, and can’t be pinned unless over source code
Space provided for comments in the DataTip which can be collapsed/expanded as desired
DataTip changes color to indicate it is a floating window
Debugging a Crash in a Deployed Application using Dump Files
Habib HeydarianProgram ManagerVisual Studio
demo
Dump File Summary PageDump file summary information
Support for mixed-mode dump files
IL Interpreter for managed property evaluation
Operating system and CLR version information
Module Information
Search modules
Summary
• IntelliTrace • Test Impact Analysis
• Tier Interaction Profiling• Client-side Script Profiling
• Collaborative Debugging• Debugging Dump Files
YOUR FEEDBACK IS IMPORTANT TO US! Please fill out session evaluation
forms online atMicrosoftPDC.com
Learn More On Channel 9> Expand your PDC experience through
Channel 9
> Explore videos, hands-on labs, sample code and demos through the new Channel 9 training courses
channel9.msdn.com/learnBuilt by Developers for Developers….
© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.