whose test is it anyway - lw&cn v0.3

WHOSE TEST IS IT ANYWAY?

Lauren Wagstaff & Clinton Nobrega

Victoria Park Plaza

London, UK

WEDS.AT 3.00 P.M.

SEPT .

21

BUSINESS ANALYSIS

at Sheffield Hallam UniversitySheffield Hallam'sTESTING APPROACH

WITH SPECIAL GUESTS

&OUR EXPERIENCE

WHAT WORKS AND WHAT DOESN'T

KEYS TO SUCCESS!

WHOSE TEST IS IT ANYWAY?Featuring..

THEN2 BA based in ITNo RequirementsNo UAT

NOW11 based centrallyProject funded onlyDefined standards & methodologySkills transferBA toolkit

NEXTRestructureCorporate projects & local initiativesDemand for Continuous Improvement

2007

BUSINESS ANALYSISat Sheffield Hallam University

2017

BUSINESS ANALYSISat Sheffield Hallam University

NEXT

Validate solution against

requirements

Cost/Benefits analysis

Propose a solution

Communicaterequirements

Analyse and document

requirements

Gather requirements

Define & scope business area

Project Training & documentation

Process improvement

& redesign

Project planning

Project definition & business case

Activity based costing

Continuous Improvement

initiatives

Knowledge Transfer training

Checkpoint reports

Metrics

TESTING

BUSINESS ANALYSISat Sheffield Hallam University

What is your current role?

A. Business AnalystB. Programme/Project ManagerC. Programme/Project SupportD. Test SpecialistE. IT SpecialistF. Other

Business

Analyst

Programme/P

roject

Ma...

Programme/P

roject

Sup...

Test Sp

ecialis

t

IT Specia

listOther

0% 0% 0%0%0%0%

BUSINESS ANALYSISat Sheffield Hallam University

Have you been involved with testing?

A. YesB. No

0%0%

BUSINESS ANALYSISat Sheffield Hallam University

• Fundamental approach to all work

• Logical and bespoke solution to unique problem

• Each project is different and is resourced in different ways

• The BAs in our team are ALWAYS involved with testing for a number of reasons

Sheffield Hallam'sTESTING APPROACH

Sheffield Hallam'sTESTING APPROACH

Write test scripts

Manage testing (incl. allocation)

TestingManage defects

Training and engagementSHU TESTING CYCLE

Who should complete ?

A. Test team memberB. Business analystC. Users/ business areaD. IT

Test team m

e...

Business

analyst

Users/ busin

es... IT

0% 0%0%0%

Sheffield Hallam'sTESTING APPROACH

Write test scripts

Who should ?

A. Test team memberB. Business analystC. Users/ business areaD. IT 0% 0%0%0%

Sheffield Hallam'sTESTING APPROACH

Manage testing (incl. allocation)

Who should carry out ?

A. Test team memberB. Business analystC. Users/ business areaD. IT 0% 0%0%0%

Sheffield Hallam'sTESTING APPROACH

Testing

Who should identified through testing?

A. Test team memberB. Business analystC. Users/ business areaD. IT

0% 0%0%0%

Sheffield Hallam'sTESTING APPROACHManage defects

1. What is the project?

2. What is the context of the project?

3. Who is available to work on the project?

Sheffield Hallam'sTESTING APPROACH

So how do we decide on an approach to testing?

OUR EXPERIENCEWHAT WORKS AND WHAT DOESN'T

THE ONE MAN BAND: EXTERNAL EXAMINERS

• 6 months, movement of Excel log to corporate system

• Objective: consistent management & increased accessibility

• Small change project, few stakeholders

• One business user and BA involved

• Limited time available for testing

OUR EXPERIENCEWHAT WORKS AND WHAT DOESN'T

THE ONE MAN BAND: EXTERNAL EXAMINERS

OUR EXPERIENCEWHAT WORKS AND WHAT DOESN'T

• Simple and straightforward excel test scripts

• Test scripts quick to produce and change

• Detailed knowledge of requirements by "testers"

• Easy to manage and assign test incidents based on only 2 testers

• Risk - single point of contact

• Frequent changes to requirements throughout testing process

• Test scripts not descriptive enough

• Not enough time dedicated to testing

• No formal feedback loop with developers

THE PUB BAND: PAPERLIGHT

OUR EXPERIENCEWHAT WORKS AND WHAT DOESN'T

• Large change project, lots of stakeholders

• 3 years, online application and supporting back-office processing (160 requirements)

• Dedicated test team managed writing and management of tests

• BA = QA

THE PUB BAND: PAPERLIGHT

OUR EXPERIENCEWHAT WORKS AND WHAT DOESN'T

• Dedicated test team

• Process users run the tests

• Testing process easily managed through test management software (SpiraTeam)

• Large volume of requirements to test in limited time

• Poor communication and visibility of product delivery from IT

• Test team not involved with requirements gathering

• More time required for liaison between BA and test team

• Poor quality of testing from process users

THE ROCK STARS: UPGRADE

OUR EXPERIENCEWHAT WORKS AND WHAT DOESN'T

• Business users conduct the testing

• Upgrade of Systems in Tuition (SITS:Vision), University's Student Management System

• Standard, established business activity

• Managed by IT Project Office using SpiraTeam

• BA Role: facilitation and training

THE ROCK STARS: UPGRADE

OUR EXPERIENCEWHAT WORKS AND WHAT DOESN'T

• Test leads in each business area

• Kick-off meetings and full training given to all users involved in testing process

• Continuous improvement of process throughout testing cycle

• Managed through test management software (SpiraTeam)

• Dedicated test and defect management windows (4 weeks each)

• Resource intensive - higher cost due to number of staff involved

• No technical involvement in testing

Write test scripts

Manage testing (incl. allocation)

TestingManage defects

Training and engagement

BEST PEOPLE FOR JOB

OUR EXPERIENCEWHAT WORKS AND WHAT DOESN'T

oles and responsibilities are clear

nforce benefits of completing process successfully

lear communications at important milestones

mprovement of testing quality through use of review meetings throughout process

raining and named point of contact for queries

ccountability and ownership

essons learnt and feedback

COMMUNICATION & ENGAGEMENT

KEYS TO SUCCESS!

RECI

TAL

KEYS TO SUCCESS!

Convention?

THANK YOU!

CLINTON NOBREGA+44 114 225 4887

c.nobrega@shu.ac.uk

Secretary & Registrar's DirectorateSheffield Hallam University

S1 1WB

LAUREN WAGSTAFF+44 114 225 3778

l.wagstaff@shu.ac.uk