testing tools using visual studio - windows - microsoft studio... · visual studio are now created...

31
Testing Tools using Visual Studio Randy Pagels Sr. Developer Technology Specialist Microsoft Corporation

Upload: dothien

Post on 26-Mar-2018

216 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

Testing Tools usingVisual Studio

Randy PagelsSr. Developer Technology SpecialistMicrosoft Corporation

Page 2: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

ProductionDevelopment

Collaboration

BACKLOG

REQUIREMENTS Monitor + LearnPlan

Develop + Test Release

Page 3: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

Agenda

• Web Performance Testing

• Load Testing

• Unit Testing

• Manual Testing

• Exploratory Testing

• Coded UI Testing

• Lab Management

Page 4: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

• Coded UI Tests

• Web Performance Tests

• Load Tests

• Generic Tests

• Ordered Tests

• Developer Unit Tests

• Database Unit Tests

• Test Plan Management

• Test Case Management

• Shared Steps Management

• Exploratory Testing

• Test Configuration Management

• Test Fast Forwarding

• Test Data Collection

• Test Lab Management

Test Manager

Manual Testing Tools

Visual Studio

Automated Testing Tools

Page 5: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

New Test Runner

Page 6: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

Unit Testing with Code Coverage

Page 7: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager
Page 8: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

Exploratory Testing

• Exploratory testing is the testing of an application without a set of tests defined in advance. During an exploratory test session, you are not restricted to a script or a set of predetermined steps. Some improvements have been made to the exploratory testing in Microsoft Test Manager.

Page 9: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

Coded UI Testing

• Coded UI tests provide a way to create fully automated tests to validate the functionality and behavior of your application’s user interface. You can create coded UI tests directly from existing action recordings. Action recordings contain the steps taken during manual testing of an application.

Page 10: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

Web Performance Testing

• Any new Web performance and load testing efforts you create in Visual Studio are now created in a Web performance and load test project type instead of a test project. A Web performance test consists of a series of HTTP requests. Web performance tests work at the protocol layer by issuing HTTP requests.

Page 11: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

Load Testing

• Load tests consist of a series of Web performance tests or unit tests which operate under multiple simulated users over a period of time. Load tests can also include automated coded UI tests. Coded UI tests should be included only under specific circumstances. All the scenarios that use coded UI tests in load tests involve using the coded UI tests as performance tests.

Page 12: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager
Page 13: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

View the performancedata from Application Insights

Application counters are correlated with the user load

Understand what issuesmay be causing any performance problems

Easily go to Application Insights if you need to do a more detailed analysis

Page 14: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

Load Test Manager

Page 15: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

Testing Tools using Visual Studio

Demo

Page 16: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager
Page 17: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

REST APIs for tags

Query on Tag

Tags in Visual Studio

Tag Permissions

Exclude non-working days

Cumulative Flow Start Dates

Pinning of Work Item Charts

Page 18: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager
Page 19: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

Export your test plan to HTML

Choose the level of detail you want

Page 20: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

Create sets of test data

Reference by various test cases

Easily bind to automated tests

Page 21: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

Permissions Reference

Page 22: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager
Page 23: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager
Page 24: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

Set alerts, get notified when changes occur

Page 25: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

Lab Management

• Testing a complex multi-tiered application and creating different configurations in a user-flow can be challenging. Lab Management provides teams a powerful and flexible development and test lab environment to enable scalable build-deploy-test workflow and continuous integration through environment templates.

Page 26: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

Testing Architecture

VM Template Library SCVMM Environment Standard Environment

VM Template 2VM Template 1

Test Agent Test Agent Test AgentTest AgentVMMAgent

Web Server

VMDatabase Server

VMVM Host Web Server Database Server

Test AgentTest Agent

Team Foundation Server

System Center Virtual Machine Manager (SCVMM)

Team Build

Test Controller

Page 27: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

Build-Deploy-Test

SCVMM Environment

Test AgentTest AgentVMMAgent

Web Server

VMDatabase Server

VMVM Host

Team Foundation Server

Test Controller

Team Build

(1) Get Source Code (2) Compile projects

(7) Send test

results

(6) Execute

automated tests

(3) Copy build to running

environment

(4) Run deployment scripts for

each machine

(5) Create environment snapshot

(8) Publish results to

Team Foundation Server

Page 28: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

Related Content

http://msdn.microsoft.com/en-us/library/tfs/bb385901%28v=vs.110%29

http://blogs.msdn.com/b/visualstudioalm/archive/2012/06/04/getting-started-with-load-testing-in-visual-studio-2012.aspx

http://msdn.microsoft.com/en-us/library/tfs/dd293547%28v=vs.110%29

http://blogs.msdn.com/b/visualstudioalm/archive/2012/07/09/javascript-unit-tests-on-team-foundation-service-with-chutzpah.aspx

http://blogs.msdn.com/b/visualstudioalm/archive/2012/07/31/writing-a-visual-studio-2012-unit-test-adapter.aspx

http://msdn.microsoft.com/en-us/library/tfs/ms182539%28v=vs.110%29.aspx

Page 29: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

Visit Team System Café Today!The door is open 24/7 at the café! Stop by for a cup of joe and delicious tidbits on AppDev topics!

http://www.teamsystemcafe.net

Page 30: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager

What's New for Application Lifecycle Management in Visual Studio 2012

http://bit.ly/baSMz5

What's new for Microsoft Test Manager 2012

http://bit.ly/wN2JrH

Quick Start Guide for Manual Testing using Microsoft Test Manager 2012

http://bit.ly/d4l9qN

Test Scribe for Visual Studio 2012

http://bit.ly/Nim0gH

What is new in Coded UI Tests 2012

http://bit.ly/zWIbVf

Platforms for Coded UI Tests and Action Recordings

http://bit.ly/b5m32u

Resources

Page 31: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager