tmap hd. test engineer. - sogeti.nl tester staat centraal... · 10-9-2015 werken met de tmap suite...

10-9-2015

Werken met de TMap Suite 1

Sogeti Testing University

TMap® HD.

Test Engineer.

|

Working with the TMap Suite for Test Engineers

Confidence through built-in Quality

Vianen, 3 september 2015

2 Working with the TMap Suite

10-9-2015


|

Agenda:

• Welkom en introductie • TMap HD en de TMap Suite • Workshop: Testen met testontwerptechnieken

(maar niet met de hand!!) • Terugkoppeling en conclusie • Afsluiting


|

Wie van jullie is:

Test Analist / Test Engineer

Test Manager

Overig (Wat dan?)

Wie van jullie heeft:

TMap Test Engineer certificaat

TMap Test Manager certificaat


Even kort kennis maken…

10-9-2015


|

Even voorstellen: Rik Marselis


Management Consultant Quality & Testing bij

Zo’n 35 jaar IT ervaring, zo’n 17 jaar kwaliteit & testen

Adviseur, procesverbeteraar & coach bij vele organisaties Prince2 Practitioner, CMMI en CISA

Docent voor diverse trainingen, bijv. Agile testen

TMap, TPI en ISTQB geaccrediteerd

Research Auteur div. boeken en artikelen Fellow van SogetiLabs, Spreker op div. conferenties

En daarnaast:

Voorzitter (vereniging voor & door testers, 1700 leden)

@rikmarselis

|

TMap’s evolution: TMap HD & the TMap Suite



10-9-2015


|

TMap’s evolution


TMap ‘blue’

TMap NEXT

TMap HD

Application

variant Adaptive Pattern

Process driven Business driven Human driven

|

TMap Suite


The TMap Suite

TMap NEXT certificates remain valid! www.TMap.net

10-9-2015


|

TMap HD:

What’s new?



|

TMap HD: What’s new?

10

10-9-2015


|

New: the Elements

11

Mr. Mikkel introduces Neil to the elements…

|

New: the Elements

Mr. Mikkel introduces Neil to the elements…

12

10-9-2015


| 13 Working with the TMap Suite

TMap HD: The Elements

People

Integrate

Simplify

Industrialize

Confidence

Human driven Quality driven


How testing is often perceived

Two IT people are cycling up a hill on a tandem-bike. When they finally reach the summit the one in front, the developer, says: ‘It was hard but we made it!’ Then the one at the back, the tester, comments: ‘Yes and I hope you appreciate that I was using the brakes all the time because otherwise we would have rolled down the hill backwards’

Use TMap HD to make sure you are a tester that helps cycling up the hill !!

10-9-2015


|

Human Driven as opposed to Process

Driven

Skills, Knowledge and Experience of

the individual are crucial

Team responsibility

vs.

Personal responsibility


Element People: the T-shaped professional

The difference between failure and success is in… the People involved

|

The modern tester

… must be:

Curious

Creative

Quality driven

Willing to learn

Multi-disciplinary


… needs to possess:

People-skills

Testing-skills

Tooling-skills

Observational skills

Domain knowledge

10-9-2015


|

Element: Integrate


Collaboration across the entire Application LifeCycle • Reviews and clear handovers in

traditional lifecycle • Integrated cross-functional teams

in iterative lifecycles

|

Element: Simplify

IT is rapidly becoming more complex and more difficult to manage. To reverse this trend we must simplify. By using standard components the process and product become simpler. As a tester we can use test design techniques to make sure we have just enough test cases. Don’t do unnecessary activities. Work in short cycles with clear goals.


10-9-2015


|

Automate and Standardize

The tester needs to develop an additional skill set

Recognize opportunities, even if you can’t realize them yourself


Element: Industrialize

|

Element: Industrialize

Industrialize is about being efficient and effective Automated test design Automated test execution Automated test data management Automated test environment management But also: Checklists Comparators Tools to specify expected outcomes Etc.


10-9-2015


|

Quality Driven


TMap HD

Quality-Driven

|

The overarching result!

Confidence in: The quality of the end product The team By the team members and By ‘the organization’!

One self


The Final Element: Confidence

10-9-2015



The Elements & Continuous improvement

People

Integrate

Simplify

Industrialize

Confidence

Human driven Quality driven

continuous improvement

|

Building Blocks



10-9-2015


| Working with the TMap Suite

TMap HD: Building Blocks

25

|

Building Block:

Test varieties



10-9-2015


|

Testing needs different angles and views

Today people are hesitant to use the word ‘Test Level’ since it seems to imply hierarchy.

Testers often struggle to distinguish between Test Levels and Test Types. What should the focus of testing should be? What stakeholders should be involved in testing? Do they have different

needs? Inexperienced Agile teams often do unit testing only, they forget the

need to look from other perspectives


|

Test varieties

TM

ap

da

g

30

10-9-2015


|

Traditional lifecycles

Test levels Test types

Iterative lifecycles

Test approaches


Implementing test varieties

Blended model

|

Test approaches - Experience based - Coverage based



10-9-2015


|

Test approaches


• What do these terms mean?

• What is the difference?

|

Test approaches with TMap HD


Experience based Coverage based

1. Checklist

Used for static & dynamic testing

1. Process

e.g. Proces Cycle Test

2. Error guessing

Based on previously encountered defects

2. Conditions

e.g. Elementary Comparison Test of

Decision table

3. Exploratory testing

Learn, design and execute in parallel

3. Data

e.g. Data Combination Test

4. Appearance

e.g. Syntactic or using user profile

10-9-2015


|

Coverage based testing



|

Welke testontwerptechnieken ken je?

Exp

lora

tory

Test

45

https://kadaster-on-line.kadaster.nl/na.asp

10-9-2015


|

Test design techniques & coverage types

TMap NEXT • Equivalence classes • Boundary value analysis

• Decision points (CC, DC, CDC, MCDC, MCC)

• Orthogonal arrays

• Pairwise testing • Data cycle test (CRUD)

• Statistical usage (op.prof. • Right paths / Fault paths • Checklist

• Decision table • Data Combination Test

• Elementary comparison tst • Process Cycle test • Real-life test

• Semantic test • Syntactic test

• Use case test • Error Guessing • Exploratory testing

• Reviews • Walkthroughs

• Inspections

46

ISTQB • Equivalence partitioning • Boundary value analysis • Decision table testing

• Cause Effect graphing • State transition testing

• Use case testing • User story testing • Structure based (SC, CC, DC,

CDC, MCDC, MCC) • Error Guessing

• Exploratory testing • Orthogonal arrays • Pairwise testing

• Domain analysis • Defect based techniques

• Checklist • Combinatorial / Class. tree • Informal review

• Technical review • Walkthrough

• Inspection • Static analysis

Torbjorn Ryber • Exploratory testing

(this is an approach, not a technique)

• Inspection • Walkthrough

• Technical review • Informal review • Modelling

• Equivalence partitions • Boundary values

• Domain tests • Business process testing • Use case testing

• State based testing • Decision tables & trees

• Elementary comparison • Combinatorial testing • Data cycle testing

• Syntax testing • Time cycle testing

• Program Logic (SC, BC, PC) • Data flow testing

Boris Beizer • Control-flow testing

• Loop testing

• Data-flow testing

• Transaction-flow testing

• Domain testing

• Syntax testing

• Finite-state testing

And more…

|

Select from 4 groups of Coverage types


Better know & use one technique

of each group

than

all techniques of only one group

10-9-2015


|

Zo werkt “testen met een testontwerptechniek”

Ontwerp alle testgevallen met een bepaalde techniek

Voer alle testgevallen uit

Rapporteer over de resultaten


|

Waaruit bestaat een testgeval?

Uitgangssituatie

Actie & Input

Verwacht resultaat


10-9-2015


|

Coverage based testing + Industrialize = COVER



|

COVER: de testontwerptool van Sogeti

Ontwerpen van:

• testsituaties,

• testgevallen en

• fysieke testgevallen

Diverse technieken


10-9-2015


|

COVER

Demo


|

Workshop



10-9-2015


|

Workshop; De OV-korting-case


|

Voorbeeld


COVER Condities

Elementaire Vergelijkingen Test

10-9-2015


|

Uitleg workshop

In teams van + 4 mensen:

Ontwerp testgevallen, m.b.v. COVER met PCT en DCT

Noteer de testgevallen op de logsheet Voer de testgevallen uit

Rapporteer je resultaten

Als je klaar bent: vraag om de exploratory testing charter


|

Workshop; De OV-korting-case


10-9-2015


|

Toelichting PCT

PCT: - Teken de procesflow met www.draw.io - Exporteer de flow als XML (plain) - Importeer de XML in COVER - Genereer de logische testgevallen - Maak op een logsheet de fysieke testgevallen - Voer de fysieke testgevallen uit


|

Toelichting DCT

DCT: - Bepaal de verschillende gegevens - Bepaal per gegeven de equivalentieklassen - Ga naar “data” in COVER, en kies “genereer testgevallen” - Vul de gegevens in en de verschillende klassen - Genereer de testgevallen - Maak op een logsheet de fysieke testgevallen - Voer de fysieke testgevallen uit


http://www.draw.io/

10-9-2015


|

Terugkoppeling

Hoeveel testgevallen heb je gemaakt?

Wat zijn je testresultaten (passed/failed/observations)

Heb je bevindingen?

Met welk testgeval heb je de bevinding gevonden?


|

Terugkoppeling en conclusie

Coverage based testen met tooling zodat je op een efficiënte manier een aantoonbare dekking hebt

Experience based testen om aanvullende dekking, en

vooral vertrouwen te krijgen

Combinatie van gegenereerde dekking en hersenkracht

geeft optimaal testen.


10-9-2015


|

Omgaan met een complete gereedschapskist


|

Conclusie


Met de TMap Suite ga je van: Werken volgens TMap

Naar:

Werken met TMap

10-9-2015


|

TMap HD and TMap NEXT and tmap.net

Confidence through

built-in Quality

Not just for ‘true’ Lean or Agile environments, but also in traditional and hybrid environments.

Human Driven Quality Driven

Elements

People

Simplify

Integrate

Industrialize

Building Blocks

Patterns

Tooling (bijv. COVER)


The TMap Suite summarized

Confidence

|

Download vanaf www.marselis.eu

of neem een printje mee.


Meer lezen?

http://www.marselis.eu/

10-9-2015


The end. Happy Testing!

tmap hd. test engineer. - sogeti.nl tester staat centraal... · 10-9-2015 werken met de tmap suite...

Documents