continuous feedback from testing - continuous delivery meetup - amsterdam, 14-7-2016
TRANSCRIPT
![Page 1: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/1.jpg)
Feedback in Continuous Delivery
Feedback from Testing in Continuous Delivery Processby Pavel Chunyayev, 14-7-2016
Amsterdam, ABN AMROContinuous Delivery meetup
![Page 2: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/2.jpg)
@PavelChunyayev
Amsterdam
Levi9 HQAmsterdam – 2005
25 people
Novi Sad
SerbiaNovi Sad – 2005
350+ people
Zrenjanin
SerbiaZrenjanin– 2014
50+ people
Iasi
RomaniaIasi – 2007
100+ people
Kyiv
UkraineKyiv – 2008
160+ people
Lviv
Belgrade
UkraineLviv– 201620+ people
![Page 3: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/3.jpg)
@PavelChunyayev
E-Retail Digital Marketing Traffic and Transport FinTech Software Services
![Page 4: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/4.jpg)
@PavelChunyayev
Customer satisfaction 2015
• 4th year great results in Outsourcing Performance study
• 2015: 100% customer recommendation scoreExcellent trust score
![Page 5: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/5.jpg)
@PavelChunyayev
About me
• 12 years of IT experience• Lived and worked in Ukraine and Estonia • Two years ago moved to the Netherlands
• Love cycling• Love Dutch language• Love software development processes• Love working with people
![Page 7: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/7.jpg)
@PavelChunyayev
Feedback is information about actions returned to the source of the actions.
— Wikipedia
![Page 9: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/9.jpg)
@PavelChunyayev
Continuous Delivery
![Page 10: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/10.jpg)
@PavelChunyayev
Continuous Delivery
Plan Code Build Test Release OperateEnvision
![Page 11: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/11.jpg)
@PavelChunyayev
Quality > Speed
![Page 12: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/12.jpg)
@PavelChunyayev
Keep the product releasableBuild quality in
![Page 13: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/13.jpg)
@PavelChunyayev
Continuous Delivery
Plan Code Build Test Release OperateEnvision
![Page 14: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/14.jpg)
@PavelChunyayev
Continuous Delivery
Plan Code Build Test Release OperateEnvision
![Page 22: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/22.jpg)
@PavelChunyayev
What kind of feedback is possible in CD?
Plan Code Build Test Release OperateEnvision
![Page 23: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/23.jpg)
@PavelChunyayev
What kind of feedback does development need?
Plan Code Build Test Release OperateEnvision
![Page 24: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/24.jpg)
@PavelChunyayev
Plan Code Build Test Release OperateEnvision
![Page 25: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/25.jpg)
@PavelChunyayev
What kind of feedback does business need?
Plan Code Build Test Release OperateEnvision
![Page 26: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/26.jpg)
@PavelChunyayev
Plan Code Build Test Release OperateEnvision
![Page 27: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/27.jpg)
@PavelChunyayev
Plan Code Build Test Release OperateEnvision
![Page 29: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/29.jpg)
@PavelChunyayev
Testing pyramid
Exec
ution
tim
e
Mor
e bu
sines
s fee
dbac
k
Mor
e de
velo
pmen
t fee
dbac
k
![Page 30: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/30.jpg)
@PavelChunyayev
Feedback from unit testing
![Page 31: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/31.jpg)
@PavelChunyayev
Feedback from integration testing
![Page 32: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/32.jpg)
@PavelChunyayev
Feedback from contract testing
![Page 33: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/33.jpg)
@PavelChunyayev
Feedback from end-to-end testing
![Page 35: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/35.jpg)
@PavelChunyayev
Contracts testing
![Page 36: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/36.jpg)
@PavelChunyayev
Updating the contract
![Page 37: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/37.jpg)
@PavelChunyayev
Updating the contract
![Page 38: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/38.jpg)
@PavelChunyayev
Updating the contract
![Page 39: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/39.jpg)
@PavelChunyayev
Updating the contract
![Page 40: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/40.jpg)
@PavelChunyayev
Updating the contract
![Page 41: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/41.jpg)
@PavelChunyayev
Don’t break the contract!
![Page 42: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/42.jpg)
@PavelChunyayev
Contracts testingPerformance testing
![Page 43: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/43.jpg)
@PavelChunyayev
Contracts testingPerformance testingManual testing
![Page 44: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/44.jpg)
@PavelChunyayev
Contracts testingPerformance testingExploratory testing
![Page 45: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/45.jpg)
@PavelChunyayev
Contracts testingPerformance testingExploratory testingResilience testing
![Page 52: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/52.jpg)
@PavelChunyayev
Who creates tests?
![Page 53: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/53.jpg)
@PavelChunyayev
Who creates tests?Instability and slowliness
![Page 54: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/54.jpg)
@PavelChunyayev
Who creates tests?Instability and slowlinessRelease vs deployment
![Page 56: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/56.jpg)
@PavelChunyayev
Continuous DeliveryKeep the product releasable
Build quality in
Frequent, incremental releasesContinuous improvement
Plan Code Build Test Release OperateEnvision
![Page 57: Continuous Feedback from Testing - Continuous Delivery meetup - Amsterdam, 14-7-2016](https://reader038.vdocument.in/reader038/viewer/2022103104/58a1e5761a28ab531e8b4d41/html5/thumbnails/57.jpg)
@PavelChunyayev
Thank you :)Keep the product releasable
Build quality in
Frequent, incremental releasesContinuous feedback +31 6 2117 5817
Plan Code Build Test Release OperateEnvision