the big three

40

Upload: river

Post on 09-Feb-2016

26 views

Category:

Documents


0 download

DESCRIPTION

The Big Three. What are the three most common complaints we hear about testing?. Problem 1. Missing or incomplete requirements Why? legacy application: cannot find the old documentation Modified application: original requirements not kept up to date. Impact ? Difficult to maintain - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: The Big Three
Page 2: The Big Three

The Big ThreeWhat are the three most common

complaints we hear about testing?

Page 3: The Big Three

Problem 1• Missing or incomplete requirements

• Why? legacy application: cannot find the old

documentation Modified application: original requirements not

kept up to date.

• Impact? Difficult to maintain Difficult to test

Page 4: The Big Three

Solution 1• Behavioral Modeling creates a

communication vehicle between the business and test engineers.

• Result: Common understanding of the application Reverse engineered requirements Easier to maintain and modify

Page 5: The Big Three

Problem 2• Testing takes too long!

• Why? Too many test cases Redundant tests

• Impact? Cost of testing is too high Applications delayed into production

Page 6: The Big Three

Solution 2• Behavior Modeling identifies the minimum

necessary number of test cases.

• In case studies, the number of test cases reduced by 75 to 90%

• Result: Less testing Less delay Less cost

Page 7: The Big Three

Problem 3• Testing can miss bugs!

• Why? Test Suites are missing some functional

paths or conditions

• Impact? Defects deployed to production Costs to repair MUCH higher

Page 8: The Big Three

Solution 3• Behavioral Modeling identifies all the

functional paths of an application.

• Result: Test suite will not miss any bugs Fewer production problems Less cost

Page 9: The Big Three

Behavioral Modeling: What is it?

• A graphical representation…• ...of the functional behavior…• …of the software article.

Page 10: The Big Three

What does it buy us?

• Allows the behavior to be specified at any level of detail.

• Allows different people to work on different sections at the same time.

• Limited “vocabulary” enforces a high level of consistency in the models.

• Allows understanding (and review) by people with a wide variety of experience.

Page 11: The Big Three

VocabularyBeginning or End Process

Choice Case

Result Displayed Result

Manual Action Representative Sample

Curved Line Connector

Note

Straight Line Connector

Page 12: The Big Three

How do we do it?

• What does it do?– “Do” in the active sense

• What influences it?

There are only two questions --

Page 13: The Big Three

Sample Problem 1• Externals only• Example –

Bigger:

Two numbers inOne number out

+1 if 1st number bigger than 2nd

-1 if 1st number smaller than 2nd

0 if the numbers are equal

Page 14: The Big Three

Bigger

1st Number

result =+1 result = 0 result = -1

bigger than 2nd

equals 2nd

less than 2nd

End

Page 15: The Big Three

Bigger

1st Number

bigger than 2nd

equals 2nd

less than 2nd

End

2 values input

no1st number

valid

no

2nd number valid

no

yes

yes

yes

result =+1 result = 0 result =-1

UNSPECIFIED!!

Page 16: The Big Three

Sample Problem 2• FAST

– The Functionally Advanced Sidewalk Teller• Deposit• Withdraw• Transfer• Check Balance

Page 17: The Big Three

FAST

Deposit Withdraw Transfer Balance

End

Page 18: The Big Three

FAST

Deposit Withdraw Transfer Balance

End

Signon

Page 19: The Big Three

FAST

Deposit Withdraw Transfer Balance

End

Signon Exceptions

Page 20: The Big Three

FAST

Deposit

WithdrawTransfer

Balance

End

Sign On ExceptionsString

Page 21: The Big Three

FAST

Deposit

Withdraw

Transfer

Balance

End

Sign On

Exceptions

String

Page 22: The Big Three

Sign-on

End

Valid FASTcard

"This is not aFAST card."

Card returned

No

Account(s) stillopen

Yes

"This card is nolonger valid."

Card retained byFAST

No

User signed on.Main menudisplayed.

Yes

From FAST

Page 23: The Big Three

Deposit

Exists Exists

"Requested Account Does Not Exist. Re-

enter"

Checking Savings

No No

YesYes

End

Account Updated

To account

From FAST

Page 24: The Big Three

Deposit

Exists

"Requested Account Does Not Exist. Re-enter or exit"

Checking Savings

No

yes

Yes

End

To account

Account Updated

continue

no

From FAST

Page 25: The Big Three

Withdraw

Exists

"Requested Account Does Not Exist. Re-

enter"

No

yes

Yes

Yes

End

Enough in account

"Insufficient Funds in

account. Re-enter or quit"

No

yes

Enough in FAST

"Insufficient Funds in

FAST. Reenter or quit" No

yes

Yes

yes

Money dispensed and

account Updated

Amount entered

continue

no

continue

no

From FAST

continue

no

No

Checking Savings

To account

Page 26: The Big Three

Transfer

From account

Exists

Checking Savings

"From account does

not exist

no

To account

Exists

Checking Savings

"To account does not exist

no

yes

same as from

"To and From accounts cannot

be the same. Reenter or quit."

yes

yes

no

enougn in account

yes "Insufficient funds in ‘From’

account. Reenter or quit."

no

yes

money transferred and

accounts updated.

yes

End

continue

no

Amount entered

continue

no

From FAST

Page 27: The Big Three

Balance

End

account

exists

Checking Savings

Balance displayed

yes no

"Requested account does

not exist."

From FAST

Page 28: The Big Three

Exceptions

End

"This machine is temporarily

out of service."

Out of paper

FAST out of cashCancel

Transaction canceled.

Display returns to main menu.

during balance during

deposit during sign-on

duringtransfer

duringwithdraw

From FAST

Page 29: The Big Three

balance

deposit

withdraw

String

End

deposit

withdraw

balance

Everything is lovely

From FAST

signon signon

Page 30: The Big Three

• Issues?• Questions?• Comments?• Concerns?

– On anything we have covered so far

Page 31: The Big Three

Attributes of Good Test Suites• Effective • Efficient

Page 32: The Big Three

Deposit

Exists

"Requested Account Does Not Exist. Re-enter or exit"

Checking Savings

No

yes

Yes

End

To account

Account Updated

continue

no

From FAST

Page 33: The Big Three

Deposit

Exists

"Requested Account Does Not Exist. Re-enter or exit"

Checking Savings

No

yes

Yes

End

To account

Account Updated

continue

no

From FAST

Page 34: The Big Three

Deposit

Exists

"Requested Account Does Not Exist. Re-enter or exit"

Checking Savings

No

yes

Yes

End

To account

Account Updated

continue

no

From FAST

Page 35: The Big Three

Deposit

Exists

"Requested Account Does Not Exist. Re-enter or exit"

Checking Savings

No

yes

Yes

End

To account

Account Updated

continue

no

From FAST

1st pass

1st pass

Page 36: The Big Three

Next Steps

• Test Design Review

• Test Case Design

Page 37: The Big Three

TCD ID:Description:

Author: Original Release: Date:

Test Case:Control Points:

Expected Results

Test Case Design Template

Page 38: The Big Three

Test Case Design SampleTCD ID: FD

Description: FAST DepositAuthor: Shel Prince

Original Release: 1.0 Date: 9/6/20xx

Test case: FD01 FD02 FD03Control Points:To Account: * * *

Checking * * *Savings *

Account exists? Y N N/YContinue: * * *

yes * *no *

FAS

T ex

it; c

ard

is r

etur

ned.

Afte

r th

e ac

coun

t cho

ice

is

corr

ecte

d, th

e ac

coun

t bal

ance

is

upda

ted

with

the

depo

site

d am

ount

.

Expected Results

Acco

unt b

alan

ce u

pdat

ed w

ith th

e de

posi

ted

amou

nt.

Msg: "requested account does not exist. Reenter

or Quit."

Page 39: The Big Three

Test Case Specification– Test Case ID– Test Items– Input– Expected Output– Environmental Needs– Special Procedural Requirements– Inter-test case Dependencies– Actual Steps…

Page 40: The Big Three

• Issues?• Questions?• Comments?• Concerns?