escape from the automation hell
TRANSCRIPT
![Page 1: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/1.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
ESCAPE FROM THE AUTOMATION HELL• By Yan Drugalya
![Page 2: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/2.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
KID DREAMS
![Page 3: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/3.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
WHO I BECAME
![Page 4: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/4.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
HOW OTHERS SEE ME
![Page 5: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/5.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
NOW
![Page 6: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/6.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
NOW
![Page 7: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/7.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
AUTOMATION
![Page 8: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/8.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
![Page 9: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/9.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
![Page 10: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/10.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
CHALLENGES• Slow tests• Unstable tests• Hard to run tests locally• Hard to reproduce failure locally
![Page 11: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/11.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
FIRST THERE WERE THE SCOUTS
![Page 12: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/12.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
AFTER ½ YEARS OF SCOUTING
![Page 13: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/13.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
THE HOPE
![Page 14: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/14.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
![Page 15: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/15.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
UNIFIED TEST RUNNER• A Simple command line that changed a lot
test -suite=<runtime|integration…>
![Page 16: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/16.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
TDD IN PERL?
![Page 17: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/17.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
ISSUES• Slow tests• Unstable tests• Hard to run tests locally• Hard to reproduce failure locally
![Page 18: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/18.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
NEXT STEP• Build farm started to use UTR
![Page 19: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/19.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
ISSUES• Slow tests• Unstable tests• Hard to run tests locally• Hard to reproduce failure locally
![Page 20: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/20.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
HOARDER
![Page 21: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/21.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
BuildAgents&Humans Hoarder WS
![Page 22: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/22.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
![Page 23: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/23.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
![Page 24: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/24.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
NICE DISCOVERIES• 16 559 749 tests run in Aug 2015!• Never failed tests• Compare performance regressions• How people use UTR to run tests locally• Automatic discovery of unstable test• ....
![Page 25: Escape from the automation hell](https://reader035.vdocument.in/reader035/viewer/2022081604/58a909f91a28ab6d2d8b4735/html5/thumbnails/25.jpg)
COPYRIGHT 2014 @ UNITY TECHNOLOGIES
FUTURE• Immediately get an overview of the state of our test
automation• Automatically find and assign test failures• Extend the REST API interface to make it easier to
integrate with other tools we use at Unity