beneath, between, and behind the lines of test excellence at microsoft

16
Beneath, Between, and Behind the lines of Test Excellence at Microsoft Alan Page Director, Test Excellence Microsoft

Upload: maia-dorsey

Post on 02-Jan-2016

27 views

Category:

Documents


0 download

DESCRIPTION

Beneath, Between, and Behind the lines of Test Excellence at Microsoft. Alan Page Director, Test Excellence Microsoft. Agenda. A little about the book A little about the “SDET” A little about me Some other stuff. Why another book about testing?. Microsoft Testers. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Beneath, Between, and Behind the lines of Test Excellence at Microsoft

Beneath, Between, and Behind the lines of Test Excellence at Microsoft Alan PageDirector, Test ExcellenceMicrosoft

Page 2: Beneath, Between, and Behind the lines of Test Excellence at Microsoft
Page 3: Beneath, Between, and Behind the lines of Test Excellence at Microsoft

AgendaA little about the bookA little about the “SDET”A little about meSome other stuff

Page 4: Beneath, Between, and Behind the lines of Test Excellence at Microsoft

Why another book about testing?

Page 5: Beneath, Between, and Behind the lines of Test Excellence at Microsoft

Microsoft Testers

Software Design Engineers in TestTesters (SDETs) can code, but systems knowledge and technical problem solving are the key attributes of testers at Microsoft

Ten-thousand testersRatio of Developers to Testers is roughly 1:1Everyone owns quality

almost…

Page 6: Beneath, Between, and Behind the lines of Test Excellence at Microsoft

Testing at Microsoft

Page 7: Beneath, Between, and Behind the lines of Test Excellence at Microsoft

My Story

Page 8: Beneath, Between, and Behind the lines of Test Excellence at Microsoft

Testing at Microsoft – the beginning

First tester hired in 1979 (high school intern)First full-time tester hired in 1983Wave of tester hiring in 1985

Page 9: Beneath, Between, and Behind the lines of Test Excellence at Microsoft

Help Wanted …

“You will design, execute and document tests of application software”Requirements: background in math, computers, programming

Page 10: Beneath, Between, and Behind the lines of Test Excellence at Microsoft

SDET Profile - 2009Mostly Computer Science Graduates & Industry HiresAlso

Electrical EngineeringMathPhysicsOther EngineeringOther non-Engineering (Test Apprentice Program)

We look forProblem Decomposition SkillsDrive for ResultsPassion for QualityProgramming Skills

Page 11: Beneath, Between, and Behind the lines of Test Excellence at Microsoft

…from James Whittaker’s blog

http://blogs.msdn.com/james_whittaker/archive/2008/08/11/if-microsoft-is-so-good-at-testing-why-does-your-software-suck.aspx

So …

Page 12: Beneath, Between, and Behind the lines of Test Excellence at Microsoft

Some Numbers

More than 90,000 Employees World Wide

More than 38,000 Engineers

Nearly 10,000 Testers

Test to Developer Ratio – (roughly) 1:1

Flagship projects have 10’s of Millions of lines of codeMillions of tests

Nearly 15 Million entries into bug and project management tools every year

Page 13: Beneath, Between, and Behind the lines of Test Excellence at Microsoft

How do you get 10,000 testers to work together?

Test Leadership TeamSenior test leaders of every product line

Test Architect GroupTop technical contributors from across the company

Engineering Excellence Small central organization responsible for training, shared practices and moreSharing, helping, communicating

Page 14: Beneath, Between, and Behind the lines of Test Excellence at Microsoft

Engineering Excellence

Product-impartial senior engineersTechnical TrainingBest PracticesCommon ToolsLightweight consultingFacilitationCommunication

Page 15: Beneath, Between, and Behind the lines of Test Excellence at Microsoft

Shared Source & Tools

Internal adaptation of codeplex.com

Source control, issue tracking, and discussions are integrated

Over 500 distinct projects

Page 16: Beneath, Between, and Behind the lines of Test Excellence at Microsoft

Questions / Links

http://blogs.msdn.com/alanpahttp://www.hwtsam.com

How We Test Software at Microsoft