Presentation

Fredrik Rydberg AddQ Consulting

Started employment in 2001 at the Med Tech

company Maquet Critical Care

(Stockholm Sweden) as Test Manager and later Unit Manager for testing.

During the last 3 years Fredrik has been a Test Management consultant within sectors as Banking & Finance, Utilities (electricity) and Transport.

Can exploratory testing

save lives?

Fredrik Rydbergfredrik.rydberg@addq.se

+46 735 142 143

Experiences from MAQUET

Product Descriptions

Anesthesia System

Ventilator ( =Respirator)http://www.youtube.com/watch?v=NbxxITf-N2Q

Description Ventilator Testning

Measuredvalue

Set value

P

Flow

V

Scripted requirement based testing at Maquet

• Authorities/ standards

• A ”Must” forced by security and quality

• Easy to evaluate when exit criteria is met

• Large amount of requirements to test – time consuming!

• Mostly manual test cases

• Old test cases result in few new defects!

Detailed requirements and

scripted testing is absolutely

needed but is not sufficient to

fully verify the requirements !

Exploratory testing at Maquet

• Started spontaneously approx. 16 years ago

• Both requirements and parts not specified as req’s

• Also non functional tests

• User oriented

• Cost effective

• Intellectual

• Suitable method for clinical experts and other expertise

Comparison Scripted testing - ET

Scripted testing1. Test Design with Test Steps

2. Execution

3. Logging in protocol

Exploratory Testing

• Parallel test design and execution

• Level of documentation is varying

Fully scriptedLess guidence

Fragmentic test cases charters

Freestyle exploratory testing

Exploratory testing

Comparison Scripted testing - ET

Pitfalls/ experiences ET at Maquet

• Different testers have different ET skills

• Risk of decreased motivation without management and control…

• …But management and control may influence creativity negatively

• Difficult to monitor what has been tested without SBTM

Important capabilities for ET, Maquet

• Clinical competence

• Domain and technical knowledge

• Experience of previous testing/ project

• Test competence (testing techniques)

• Curious, patient, communication and networking skills

Variation in the project cycle (ET/ scripted)

ET

Scripted

Time (months)

Test

Tim

e /

m

on

th (

ho

urs

)

Scripted testing

YINSlow, cold and calm

Exploratorytesting

YANGFocused, warm and aggressive

Important to find the right mix!

Time distribution

ET execution

18%Automatic execution (scripted)

10%

Script execution

27%Script test

reports5%

Designing Scripted

Test cases25%

Other15%

Efficient more times7 ET

7)urdefects/ho(5.0

)rdefect/hou(1

) test timeET%(18

) test timeScripted%(67

:Efficiency Comparison

Visit by James Bach (spring 2007)

• 2 days visit

• Inspiration talk for employees

• Participation in testing

• ”pep talk”

• Improvement advice

• Target of ET clearer

General Test tool support

• Maquet developed tool for session based testing (“Session Based Tester”)

• IBM Clear Quest, Requisite Pro

• Capture Replay tool

• Automatic loggings tool statistics

IBM Requisite Pro

SBTM- Session Based Test Management (Method)

• General method to manage, report and follow up ET

• Time box approx. 90 min (60-120 min)

• Supported by charters

• A result possible to evaluate

• Often combined with debriefing (approx. 15 min)

Session-based testing is developed by Jonathan and James Bach (first presented in year 2000).

See http://www.satisfice.com/sbtm for more info.

Session Based Testing Tool (Open Source)

•Maquet developed tool

•Started in use Aug. 2008

•Developed in Perl using SQL server

•Example field New session:

•Project

•Duration

•Which tests to be done?

•Which have been tested?

Example functionality:•Add new session• Report session• Metrics: Fault intensity• Archiving• Test Reports

Session Based Testing Tool (Open Source)

Advantage SBTM Maquet

• Easier to manage and follow up ET

• Reuse of sessions

• Statistics

• Complementing the Test Report

• Participation from other departments

• Learn from other test sessions

• Common ET process

ET today at Maquet

• ET recognized and powerful test approach

• ET has resulted in an increased test focus at Maquet

• ET is the most efficient test approach

• ET contribution to Market Leading product

Future possibilities

• Continue to improve ET/ SBTM• Improved debriefing/reporting• ET + SBTM training for new employees

Suggestions future functionality (SBTM):• Dynamic Metrics (parameter list)• Validation / write protection of sessions• iPhone/ Android version?• Other tools?

Inspiration Exploratory testing

Inspiration links:

www.satisfice.com

www.developsense.com

www.kaner.com

http://testingeducation.org/wp/

Maquet SBT Open Source:

http://sites.google.com/site/sessionbasedtester/

Join the “Linked in” group “Session based testing”:

http://www.linkedin.com/groups?mostPopular=&gid=3316116

Fredrik Rydberg

fredrik.rydberg@addq.se

Summary• ET needed to fully verify requirements• Other defects with ET compared to ST• Important to find the right mix• Increased efficiency with ET• SBTM (with tool) made ET more

structured• ET significant quality contribution