![Page 1: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/1.jpg)
EuroSTAR webinar
Creating Agile Test Strategies for Larger EnterprisesDerk-Jan de Grood/ Valori
February 20171
![Page 2: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/2.jpg)
Questions this webinar addresses
2
What should it address in order to
add valueIs there a need for
Agile Test
strategiesWho owns the agile test strategy
![Page 3: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/3.jpg)
3
Testing is declining
![Page 4: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/4.jpg)
Business[Agility]
4
![Page 5: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/5.jpg)
Testing is on the rebound
5
Testing is embedded in development and quality is crucial, team exceeding and not trivial
![Page 6: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/6.jpg)
Testing and business agility
Effective testing ensures that the organization can extend and change software products whilst retaining confidence in the quality and correct operation of what is delivered
[ING orange book on testing and Quality]
6
![Page 7: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/7.jpg)
[http://www.slideshare.net/janetgregoryca]7
![Page 8: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/8.jpg)
Some statements from Janet’s talk
Agile wants small co-located teams, but in large organizations this is not always possible. Culture: A blame culture kills innovationTesting is a team problem, but in large organization there are a lot people outside the team (Note the keynote by Diane Larsen- the Boundary Interaction map) In large projects, many projects are concurrently active and not seldom people are managed as resources (iso humans)Typical testing issues in larger enterprises are: Throwing over the wall, not knowing who to ask, integration, testers that are working in more than one team, Failing to look at release total.
8
![Page 9: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/9.jpg)
9
![Page 10: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/10.jpg)
Gojko Adzic on ATD 2016
10
Development Testing
e2e testing
Approval testing
Testing after deployment
Unit testing becomes less
important
Code as a service
Deploy to multiple Environments
Services over Apps
![Page 11: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/11.jpg)
Click !
Testing is VITAL, But we
need to organize it in a way
that it clearly adds value
11
![Page 12: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/12.jpg)
12
Needs !
![Page 13: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/13.jpg)
Case 1: Focus on acceptance
13
![Page 14: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/14.jpg)
14
![Page 15: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/15.jpg)
It ain’t done until its accepted
15
![Page 16: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/16.jpg)
Witness report: 2 outcomes
Advice to accept solution• Professional testing• Good process• Good test results
Advice to not accept solution• No professional testing• No Good process• No good test results
16
![Page 17: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/17.jpg)
Witness proces
17
Introduce Agile
techniques
![Page 18: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/18.jpg)
Case 2: the need for status info
18
![Page 19: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/19.jpg)
19
It ain’t done until it’s tested
![Page 20: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/20.jpg)
20
Testing a Central Topic Has the train arrived at the station?
![Page 21: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/21.jpg)
Case 3: It ain’t done until it’s integrated
21
![Page 22: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/22.jpg)
Multi team setting
22
![Page 23: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/23.jpg)
Architecture• What are the
business processes?
• What are the components?
• What are the interfaces?
Acceptance criteria• What is the
Minimal Viable Product?
• What integrations are needed to make it work?
Requirements traceability• When are we
complete?• How do test
results add up to acceptance?
23
Missing
![Page 24: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/24.jpg)
What should a car minimally do?
24
![Page 25: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/25.jpg)
Planned Integration Tests
25
Integration tests
Release Date
![Page 26: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/26.jpg)
Ensuring Integration (rough sketch)
26
Organization
Component
System
Service
Continuously(in the sprint)
Occasionally(e.g. prior to a release)
CI/C
D
MBT
Service
Virtualization
Stubbing
e2e
ST
Test
Automation
UT
Integration
sprint
Manual RT
Interface
testing
Annotation: Increasing the system (e.g from Units tot Systems) results in less frequent integration, because it becomes harder to test the integration. This has impact on the time-to-market.
![Page 27: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/27.jpg)
Click !
27
We need to organize
something
Who will own
quality
![Page 28: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/28.jpg)
Agile Test Strategy
28
What needs to be tested?
Feedback, steering and progress
Auditing the test work
Coaching the testing team members
Organizing tests that do not fit the sprint
![Page 29: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/29.jpg)
29
What needs to be tested
25
Goal
Succes factors
Challenges
Unc
erta
intie
s
Worries
Fears
Does it work as a
whole?
Hygienic
tests done?
Should I accept?
![Page 30: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/30.jpg)
Acceptance driven Test Report
30
Lot 1
Lot 3
Lot 5
Lot 4
Lot 6
Lot 2
![Page 31: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/31.jpg)
Test reporting
31
Lot 1
Lot 3
Lot 5
Lot 4
Lot 6
Lot 2
Tell the testing story
• Do you know what is tested in the various teams?
• Do you know how well they did it?
• Do you have proof?• How do you rate the quality?• What concerns do you have
(combine the bugs and translate to business impact)?
![Page 32: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/32.jpg)
Janet’s test matrix32
![Page 33: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/33.jpg)
Testing is a team responsibility33
Do you know how well they did it?
![Page 34: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/34.jpg)
Levels of strategy
Policy
Strategic
Operational
34
![Page 35: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/35.jpg)
What could be in an operational test strategy?
EnvironmentsToolsRisk analysisOrganisition and rolesHow you use CI/CDInterpretation of (A)TDDRelation between through away & regression testsHow to do test automationFinding procedureManagement processesEtc…
35
![Page 36: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/36.jpg)
Test Driven Development (TDD)
36
1. Business is actively involved with
defining acceptance criteria, Examples
and Scenarios
2. Development process is adopted
to fit TDD
3. Release and deployment cycles
are established
4. Backlog of (automated)
regression tests is minimal
5. Teams have sufficient test, tool
and automation knowledge
6. Tools are configured and
running on controlled environment
7. It is defined what tests need to be run at what level in the
pyramid
8. Management commits to solution and stimulates the
team to fail forward
![Page 37: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/37.jpg)
CI/CD requisites
37
Teams Collaborate Integration is Continue
Tests are Automated
Deployment is hands-off process
No Automation Backlog
Clear Acceptance Criteria
Feedback loop to improve Testing
Frequent Product Launch
![Page 38: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/38.jpg)
Who owns the Quality?
44
![Page 39: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/39.jpg)
45
A job for the• Test manager• Quality master • For you?
![Page 40: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/40.jpg)
WRAP-UP
46
![Page 41: Creating Agile Test Strategies for Larger Enterprises](https://reader034.vdocument.in/reader034/viewer/2022042722/58a64e761a28ab6e368b62e9/html5/thumbnails/41.jpg)
Derk-Jan
ValoriColtbaan 4a3439 NG NIEUWEGEINThe Netherlands
• [email protected]• +31(0)651807878• www.valori.nl• @DerkJanDeGrood• http://djdegrood.wordpress.com
Derk-Jan
47
SuccessWith your strategy !