50 production deployments a day, at least
TRANSCRIPT
![Page 1: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/1.jpg)
www.techarchday.fiwww.techarchday.fi
50 production deployments a day, at least
Oscar RenaliasSenior Technology Architect
v10
![Page 2: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/2.jpg)
@oscarrenaliasgithub.com/oscarrenaliasgithub.com/[email protected]/oscarrenaliaswww.slideshare.net/oscarrenalias
![Page 3: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/3.jpg)
2009 2014 2015
50+ deploys per day10 deploys per day
Deploys to production every
11.6 seconds
![Page 4: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/4.jpg)
Why?
![Page 5: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/5.jpg)
Requirements
Design &Build
QA &Test
Operate
![Page 6: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/6.jpg)
QA &Test
Operate Best Guess
Design &Build
![Page 7: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/7.jpg)
Design &Build
QA &Test
Operate Best Guess
Feedback
Experiments
![Page 8: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/8.jpg)
QA &Test
Operate Best Guess
Design &Build
1 YEAR6 MONTHS1 MONTH2 WEEKS1 WEEKS1 DAY1 HOURMINUTES
![Page 9: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/9.jpg)
Run over200 concurrent
experiments on any given day
http://www.exp-platform.com/Pages/ControlledExperimentsAtLargeScale.aspx
![Page 10: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/10.jpg)
THIS MANY EXPERIMENTS
![Page 11: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/11.jpg)
Our objective: 50 deployments a day with no service impact
![Page 12: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/12.jpg)
Requirements
Design &Build
QA &Test
Operate
ContinuousImprovement
![Page 13: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/13.jpg)
Requirements
Design &Build
QA &Test
Operate
ContinuousImprovement
![Page 14: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/14.jpg)
SAY CONTINUOUS IMPROVEMENT
ONE MORE TIME
![Page 15: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/15.jpg)
How?
![Page 16: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/16.jpg)
Continuous Delivery
AutomationArchitecture
Culture
![Page 17: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/17.jpg)
Value Stream
Idea Value
![Page 18: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/18.jpg)
Release
Ideas Values
![Page 19: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/19.jpg)
Release
Ideas Values
![Page 20: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/20.jpg)
Release
Ideas Values
![Page 21: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/21.jpg)
Value Released
Time
Guessed Well
![Page 22: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/22.jpg)
Release
Ideas Values
![Page 23: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/23.jpg)
Value Released
Time
Guessed Well
Guessed Badly
![Page 24: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/24.jpg)
Value Released
Time
Value Stream
Idea Value
Value Stream
Idea Value
Value Stream
Idea Value
Rapid Feedback
Optimise
![Page 25: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/25.jpg)
Release
Ideas Value
“Hotfixes”
"Release""Release"
"Release" "Release"
"Release"
"Release""Release""Release"
"Release"
"Release"merg
e
merge mer
ge
mergemerge
merge
merge
mergemerge
![Page 26: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/26.jpg)
Ideas Value
OverheadRelease
![Page 27: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/27.jpg)
Requirements
QA &Test
Operate
Design &Build
ContinuousIntegration
![Page 28: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/28.jpg)
CI – what good looks like…
Changes constantly pushed to version control
Fixing a broken build is always the priority
Nobody goes home on a broken build
![Page 29: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/29.jpg)
Requirements
29
Design &Build
Operate
`ContinuousTest
QA &Test
![Page 30: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/30.jpg)
Pipeline! Pipeline! Pipeline!
Build Static Analysis ST Regression
Build Static Analysis ST Regression
Build Static Analysis ST Regression
PerformanceTest Security Test
![Page 31: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/31.jpg)
Pipeline! Pipeline! Pipeline!
Build Static Analysis ST Regression
Build Static Analysis ST Regression
Build Static Analysis ST Regression
PerformanceTest Security Test
Effort and schedule
Test Phase
Comprehensive
Fast
![Page 32: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/32.jpg)
Pipeline! Pipeline! Pipeline!
Build Static Analysis ST Regression
Build Static Analysis ST Regression
Build Static Analysis ST Regression
PerformanceTest Security Test
Effort and schedule
Test Phase
Pre-commit1 min
Component1 hour
Acceptance4-8 hours
Commit10 mins
![Page 33: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/33.jpg)
Pipeline! Pipeline! Pipeline!
Build Static Analysis ST Regression
Build Static Analysis ST Regression
Build Static Analysis ST Regression
PerformanceTest Security Test
Effort and schedule
Test Phase
Stop the assembly
line!
![Page 34: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/34.jpg)
What about tools?
![Page 35: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/35.jpg)
THEY WANTED MORE AGILITY,SO WE SOLD THEM $2M IN DEVOPS TOOLS
![Page 36: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/36.jpg)
Continuous Delivery PrinciplesEach check-in is a candidate production release
The same processes and tools in ALL environments
A failure at any stage stops the production line
It’s not about the tools!
![Page 37: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/37.jpg)
Continuous Delivery
AutomationArchitecture
Culture
![Page 38: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/38.jpg)
I CAN HAZ CONTINUOUS DELIVERY?
![Page 39: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/39.jpg)
Fail-fast
Microservices
Metrics and Logs
Independently deployable and
scalable components
Failure is unavoidable. Deal with it.
Proactive monitoring
![Page 40: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/40.jpg)
Continuous Delivery
AutomationArchitecture
Culture
![Page 41: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/41.jpg)
RELEASE TIME!
![Page 42: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/42.jpg)
Oscar’s unscientific observations of release failures
Human failures
![Page 43: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/43.jpg)
ELIMINATE ALL HUMANS
![Page 44: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/44.jpg)
Pets vs Cattle
![Page 45: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/45.jpg)
![Page 46: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/46.jpg)
Build Static Analysis ST Regression PerformanceTest Security Test Deployment
Test & QA
![Page 47: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/47.jpg)
Automation
Infrastructure as codeTest, test, test
Eliminate the human factor
![Page 48: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/48.jpg)
Continuous Delivery
AutomationArchitecture
Culture
![Page 49: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/49.jpg)
WORKED FINE IN DEV
OPS PROBLEM NOW
![Page 50: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/50.jpg)
Smooth Collaboration Fully Embedded Infrastructure-as-a-Service
DevOps as a Service Separate DevOps Team
DevOps Culture: Which one is right for you?
Source: http://www.devopstopologies.com
![Page 51: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/51.jpg)
FIRED YOUR EXISTING TEAM ANDREPLACED THEM WITH A DEVOPS
TOOL?
THAT MUST BE GOING WELL
![Page 52: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/52.jpg)
Organisation and Culture
Align to business priorities
Quality is everybody’s responsibilityDefine your own DevOps Culture
People over processes and tools
![Page 53: 50 production deployments a day, at least](https://reader034.vdocument.in/reader034/viewer/2022050719/587203441a28ab176b8b57b1/html5/thumbnails/53.jpg)
http://bit.ly/AccentureDevOpsPlatform