“create tests automatically? it’s possible!” practical model-based testing

ALM User Group

© Copyright SELA software & Education Labs Ltd. | 14-18 Baruch Hirsch St Bnei Brak, 51202 Israel | www.selagroup.com

May 2016

Natalia Meergus, Ilia German

“Create Tests Automatically? It’s possible!”Practical Model-Based Testing

AgendaMBT in a nutshell

Demo with Conformiq Creator

Q&A

Test automation evolutionManual

Automatic

Testdesign

Testexecution

Testing skills + Scripting skills + Modeling skills

Trad

ition

al m

anua

l te

stin

g

Trad

ition

al a

utom

atic

test

ing

Mod

el-

base

d te

stin

g

MBT idea

MBT output

Test SUT

Test Step

Expected Result

Test Step

Test Step

…Expected Result

A model

A model and testsvoid test1(){ StartBrowser(); VerifyBrowserStarted(); EnterBaseUrl(); VerifyBaseUrl(); Login(); VerifyLogin(); Logout(); VerifyBaseUrl(); Close();}

A model and testsvoid test1(){ StartBrowser(); VerifyBrowserStarted(); EnterBaseUrl(); VerifyBaseUrl(); Login(); VerifyLogin(); Logout(); VerifyBaseUrl(); Close();}

void test3(){ StartBrowser(); VerifyBrowserStarted(); EnterBaseUrl(); VerifyBaseUrl(); Login(); VerifyLogin(); Close();}

void test2(){ StartBrowser(); VerifyBrowserStarted(); EnterBaseUrl(); VerifyBaseUrl(); Close();}

void test4(){ StartBrowser(); VerifyBrowserStarted(); EnterBaseUrl(); VerifyBaseUrl(); Login(); VerifyLogin(); Logout(); VerifyBaseUrl(); Login(); VerifyLogin(); Logout(); VerifyBaseUrl(); Close();}

MBT workflow

MBT tools

MaTeLo Conformiq Designer TestOptimal Atos TEMPPO Smartesting CertifyIt Conformiq Creator Elvior MOTES/TestCast MBTReactis MBTsuite Bender RBTGraphWalker NModel Microsoft SpecExplorer

ISTQB Certification MBT Extension

MBT benefits/ROIOrganizations using MBTreport reduction of:

escaped bugs by 27%testing costs by 35%testing duration by 31%

(on average, source: MBT User Survey 2014 by Robert Binder)

Demo

Main pointsTests can be automatically generated (given a model of the system and a test harness)MBT is finding bugs missed by manually designed testsMBT makes test coverage systematic, visible and measurableMBT takes an upfront modeling effort but considerably accelerates extension of test suites and their maintenanceMaintaining a system model improves overall process and benefits all disciplines

[ ]/Thanks;