dwx2015 - von bayern in die cloud
TRANSCRIPT
![Page 1: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/1.jpg)
AutoScout24’s Technology Change
www.autoscout24.de
Von Bayern in die Cloud
![Page 2: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/2.jpg)
2014
![Page 3: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/3.jpg)
Architecture
Operations
Stack
Culture
Monolith
Services (aka Swimlanes)
Windows
.NET
Oracle
C#
VMware
DevOps
Developer
Operations
Self-operated Data Centers
![Page 4: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/4.jpg)
Tatsu
![Page 5: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/5.jpg)
![Page 7: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/7.jpg)
2 Million Vehicles
![Page 8: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/8.jpg)
100 in IT
![Page 9: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/9.jpg)
3.250.000.000Page Impressions per Month
![Page 10: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/10.jpg)
Architecture
Operations
Stack
Culture
Monolith
Services (aka Swimlanes)
Windows
.NET
Oracle
C#
VMware
DevOps
Developer
Operations
Self-operated Data Centers
![Page 11: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/11.jpg)
Monolith
~40 devs
Feature / code freeze
2010
2010
4 weeks release cycle
Release time: hours
![Page 12: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/12.jpg)
Monolith
~40 devs
Feature / code freeze
2010
2011
2 weeks release cycle
Release time: hours
![Page 13: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/13.jpg)
Architecture
UI Layer
Business Logic Layer
Database Layer
Featu
re
C
Featu
re A
Featu
re B Fe
atu
re
D
Featu
re E
![Page 14: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/14.jpg)
TeamCity log
![Page 15: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/15.jpg)
Monolithic Apps - Failure & Availability
![Page 16: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/16.jpg)
Release features as fast as possible!
![Page 17: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/17.jpg)
“When will feature XYZ be released?”
“Why not just after finishing it?”
Teams were trying to release as many changes as they could.
![Page 18: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/18.jpg)
2012 - Cutting the Monolith
![Page 19: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/19.jpg)
Services (aka Swimlanes)
Team App
Team App
Team App...
Feature Feature
Feature
![Page 20: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/20.jpg)
...FeatureB
FeatureA
FeatureX
Team 1 Team N
Architecture vision
![Page 21: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/21.jpg)
Architecture vision
Goals:
● Reduce time-to-market, allow fast feedback
Principles:
● Support team autonomy by building independent things● Organize around products, not projects, keep ownership● Build things for change and replacement, not for re-use● Decentralized data management
![Page 22: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/22.jpg)
3rd generation todayMonolithic Rails > JS / Rails / Scala > Microservices
![Page 23: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/23.jpg)
5th generation todayMonolithic Perl > Monolithic C++ > Java >
Microservices
![Page 24: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/24.jpg)
Nth generation todayMonolithic C++ > Perl / C++ > Java / Scala >
Microservices
![Page 25: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/25.jpg)
![Page 26: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/26.jpg)
Monolithic C# > Swimlanes C# > ???
![Page 27: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/27.jpg)
![Page 28: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/28.jpg)
Microservices
BusinessLogic
BusinessLogic
UI
BusinessLogic
UI
![Page 29: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/29.jpg)
Domain architecture
What are the main systems / services, their responsibilities and dependencies?
![Page 30: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/30.jpg)
Macro architecture
How systems / services talk to each other? What platform are they run on?
![Page 31: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/31.jpg)
Micro architecture
How and using which language and runtime every system is implemented? Which database is used?
![Page 32: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/32.jpg)
Architecture guidelines
Macro architecture Micro architecture
● Continuous Delivery
(principles)● Share nothing model● UI (+ integration)● Replicated data● Logging, Monitoring● Communication protocols● Resilience
● Continuous Delivery
(implementation)● Free to choose technology● Optimization points● Testable integration
![Page 33: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/33.jpg)
Architecture
Operations
Stack
Culture
Micro
services
Windows
.NET
Oracle
C#
VMware
DevOps
Developer
Operations
Self-operated Data Centers
![Page 34: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/34.jpg)
2000 Servers
2 Data Centers
![Page 35: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/35.jpg)
![Page 36: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/36.jpg)
http://en.wikipedia.org/wiki/Programming_languages_used_in_most_popular_websites
![Page 37: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/37.jpg)
Giants
Stand on the Shoulders of
![Page 38: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/38.jpg)
![Page 39: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/39.jpg)
![Page 40: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/40.jpg)
Architecture
Operations
Stack
Culture
Micro
services
Linux
JVM
DynamoDB
Scala
VMware
DevOps
Developer
Operations
Self-operated Data Centers
![Page 41: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/41.jpg)
Self-operated data centers
● Two own data centers (main and backup) in Munich & Nuremberg● Virtualization based on VMware infrastructure
Pains:
● Slow provisioning involving manual steps● “Pet” servers, only partially automated● Infrastructure (LB, etc.) with lots of manual configuration● Backup DC is not serving traffic most of the time● It’s challenging to keep backup DC up-to-date and make sure it will
work
![Page 42: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/42.jpg)
Cloud?
● “Don’t reinvent the wheel!”
Pros:
● Self-service● Fast provisioning● Infrastructure as code, automate everything● Immutable servers thanks to fast provisioning● Try things in production thanks to fast provisioning● No over-provisioning thanks to scaling functionality
![Page 43: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/43.jpg)
Architecture
Operations
Stack
Culture
Micro
services
Linux
JVM
DynamoDB
Scala
Cloud
EC2
DevOps
Developer
Operations
![Page 44: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/44.jpg)
Dev/Ops
Ops
![Page 45: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/45.jpg)
Team
![Page 46: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/46.jpg)
![Page 47: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/47.jpg)
Architecture
Operations
Stack
Culture
Micro
services
Linux
JVM
DynamoDB
Scala
Cloud
EC2
Engineers
You run it
You build it
![Page 48: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/48.jpg)
Re-built it all...
![Page 49: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/49.jpg)
...while keeping the platform running!
![Page 50: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/50.jpg)
Progress
1
2
3
![Page 51: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/51.jpg)
Progress
2 months 1 team Infrastructure only
5 months 2 teams 3 microservices
8 months 4 teams 10 microservices
... ... ...
![Page 52: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/52.jpg)
It’s just...
...a beginning
![Page 53: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/53.jpg)
![Page 54: DWX2015 - Von Bayern in die Cloud](https://reader030.vdocument.in/reader030/viewer/2022032620/55cd9e24bb61ebff2d8b46e7/html5/thumbnails/54.jpg)
Picture Credits• Slide 4: "Tatsu Sign" by Martin Lewison, licensed under CC BY-SA 2.0• Slide 7: "HotWheels - '69 Ford Torino Talladega“ by Leap Kye, licensed under CC BY-ND 2.0
Alexey [email protected]@gravanov
Philipp [email protected]@pgarbe