scale-out data center architecture · 2017. 12. 20. · scale-out data center architecture ukuug...
TRANSCRIPT
![Page 1: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/1.jpg)
Scale-Out Data Center Architecture
UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk
![Page 2: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/2.jpg)
Agenda
INTRODUCTION TO NETWAYS
SCALABILITY DEFINITION
TYPICAL SCENARIO
- DATABASE
- WEB AND APPLICATION SERVERS
GROWTH DIFFICULTIES
ON TIME
ON TIME
ON TIME
ON TIME
ON TIME
ON TIME
4 SLIDES
3 SLIDES
6 SLIDES
6 SLIDES
2 SLIDES
6 SLIDES
DESTINATION TIME REMARK
- FILE AND BLOCK-I/O
SUMMARY ON TIME
ON TIME
2 SLIDES
6 SLIDES
Q & A ON TIME 1 SLIDE
![Page 3: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/3.jpg)
INTRODUCTION TO NETWAYS BOARDING
![Page 4: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/4.jpg)
Introduction to NETWAYS
§ Founded in 1995 § GmbH since 2001 § Open Source since 1997
§ 30 full time employees
§ Specialized in Open Source Systems Management and Open Source Data Center Infrastructure
![Page 5: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/5.jpg)
Skills
– Monitoring – Performance Management – Configuration Management – Service Management – Knowledge Management – Asset Management – Identity Management – Backup & Recovery
– High Availability Solutions – Cluster Solutions – Load balancing – Virtualization – Storage Solutions – Firewalls – Databases – Voice over IP
Open Source Systems Management
Open Source Data Center Solutions
Managed Services Consultancy Conferences
![Page 6: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/6.jpg)
§ Open Source Data Center Conference 2011 § 6 - 7 April 2011 in Nuremberg
§ http://www.netways.de/osdc
§ Open Source Monitoring Conference § 5 tracks with speeches & workshops
§ 29 - 30 November 2011 in Nuremberg § http://www.netways.de/osmc
Conferences
![Page 7: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/7.jpg)
§ 33 years old
§ Head of Operations at NETWAYS § Responsible for Consulting, Development
and Managed Services § Background in Database Infrastructure and
Service Oriented Architecture
§ Open Source Projects – Icinga team member
Introduction to Bernd Erk
![Page 8: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/8.jpg)
Root of „all“ evil
SOAP
REST
![Page 9: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/9.jpg)
SCALABILITY DEFINITION BOARDING
![Page 10: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/10.jpg)
Scaling Methods
§ Scale-Up
– add as many resources as possible to a single node system
§ Scale-Out
– add as many resources as required, to your application using additional nodes
§ “Mixed Mode”
– add nodes based on virtualized platform to optimize hardware usage
![Page 11: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/11.jpg)
Scaling Methods - Pictured
§ Scale-Up
§ Scale-Out
§ “Mixed Mode”
![Page 12: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/12.jpg)
Scale-Out Challenges
§ Management
§ Bottlenecks
§ Workload Distribution
![Page 13: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/13.jpg)
TYPICAL SCENARIO BOARDING
![Page 14: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/14.jpg)
Typical Scenario
Firewall Firewall
SRV 1
Framework
Database
WebServer
Shared Firewall
![Page 15: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/15.jpg)
Typical Scenario
§ WebServer / Application Server – Apache – Lighttpd – ?? Tomcat / JBoss
§ “Framework” – PHP – Ruby – Python – ?? Java
§ Database – MySQL – PostgreSQL – NoSQL
SERVER
Framework
Database
WebServer
![Page 16: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/16.jpg)
GROWTH DIFFICULTIES BOARDING
![Page 17: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/17.jpg)
DATABASE BOARDING
![Page 18: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/18.jpg)
Database Bottlenecks
SRV 1
Framework
Database
Webserver
Shared Firewall
• SQL/Model • QPS • Disk-IO
![Page 19: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/19.jpg)
Database Solutions
§ Database Tuning
§ Query- and Index-Optimization
§ Slow Query Analysis
§ Reduce number of QPS
– Application Tuning
– Caching (Memcache)
§ Scale-Out
![Page 20: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/20.jpg)
Database-Facility
Database Scale-Out
SRV 1
Framework
Webserver
Shared Firewall
DB1 DB2
Database Database
Replication
![Page 21: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/21.jpg)
Database Scale-Out Problems
§ Separate Read / Write Queries
§ Replication Lag
§ Failover Detection
§ High Availability
§ Load balancing
§ Replication Bottlenecks
![Page 22: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/22.jpg)
Database Scale-Out Solutions
SRV 1
Framework
DB-Master DB-Slave
Database Database
Master-Slave
SRV 1
Framework
DB-Master DB-Slave
Database Database
Master-Slave
„MySQL“-Proxy
SRV 1
Framework
DB-Master DB-Master
Database Database
Master-Master
![Page 23: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/23.jpg)
Database Scaleout Extended
Database-Facility
Master-Slave Master-Slave
Master - Master
DB M1 DB M2
DB M1S1
DB M1S2
DB M2S1
![Page 24: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/24.jpg)
Database-Facility
Master - Slave
Database Sharding
Master - Slave
DB Products DB Customers
Products-Slave
Products-Slave
Customers-Slave
![Page 25: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/25.jpg)
WEB & APPLICATION SERVERS
BOARDING
![Page 26: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/26.jpg)
Database-Facility
Web Server Bottlenecks
SRV 1
Framework
Webserver
Shared Firewall
DB1 DB2
Database Database
• RPS • Session-Handling • Memory
![Page 27: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/27.jpg)
Web Server Solutions
§ Web Server Tuning
§ Try a different Webserver
– Apache
– Lighttpd
– Nginx
§ Scale-Out
![Page 28: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/28.jpg)
Database Facility
Web Server Scale-Out
SRV 1
Framework
Webserver
Shared Firewall
DB1 DB2
Database Database
SRV 2
Framework
Webserver
![Page 29: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/29.jpg)
Web Server Scale-Out Problems
§ Deployment
§ Synchronous Files
§ High Availability
§ Session-Handling
![Page 30: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/30.jpg)
Web Server Scale-Out Solutions
Loadbalancer Loadbalancer
SAN Storage
App Server Facility
Database Facility
SRV 1
Framework
Webserver
SRV 2
Framework
Webserver
Shared Load balancer and
Firewall
![Page 31: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/31.jpg)
Web Server Scale-Out „Mixed“
App Server Facility
XEN A1 XEN A2 XEN A3 XEN A4
Application
App 2 App 1 App 3 App 4
App 5 App 6
Search
Search 1 Search 2
Memcached
Memcached 1 Memcached 2
![Page 32: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/32.jpg)
FILE- AND BLOCK-I/O BOARDING
![Page 33: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/33.jpg)
I/O Bottlenecks
SAN Storage
App Server Facility
Database Facility
SRV 1
Framework
Web Server
SRV 2
Framework
Web Server
Shared Load balancer and
Firewall
• File-I/O • Disk-I/O
![Page 34: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/34.jpg)
Image-Delivery Bottleneck
App Server Facility
SRV 1
Framework
Web Server
SRV 2
Framework
Web Server
Shared Load balancer and
Firewall
SAN Storage
![Page 35: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/35.jpg)
Image-Delivery Solution
Image Facility
Image 1 Image 2
Ningx
Varnish
Ningx
Varnish
SAN Storage
![Page 36: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/36.jpg)
SAN Storage SAN Storage
Storage Scale-Out
SAN Storage SAN Storage
SAN Storage
DAS DAS
SSD DISKS SSD DISKS
![Page 37: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/37.jpg)
SUMMARY BOARDING BOARDING
![Page 38: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/38.jpg)
Tool Facility
Image Facility
Database Facility
App Server Facility
Architecture Overview
XEN A1
DB1 DB2 SAN Storage
Image 1
DB3
Image 1
DB4
XEN A2 XEN A3 XEN A4
XEN T1
Shared Firewall and Load balancer
![Page 39: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/39.jpg)
Bernd‘s 5 Scale-Out Rules
§ Rule 1: Prevent I/O § Rule 2: Isolate application facilites § Rule 3: Prepare for sharding § Rule 4: Don‘t handle sessions in file system
§ Rule 5: BE FAST - DON‘T BE SLOW
![Page 40: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/40.jpg)
Q & A BOARDING BOARDING
![Page 41: Scale-Out Data Center Architecture · 2017. 12. 20. · Scale-Out Data Center Architecture UKUUG Spring 2011 Conference Leeds – 24.03.2011 Bernd Erk](https://reader036.vdocument.in/reader036/viewer/2022071107/5fe1a2d2d41c301f1d3a8b5e/html5/thumbnails/41.jpg)
Questions and Answers NETWAYS GmbH Deutschherrnstrasse 15-19 90429 Nuremberg [email protected] http://www.twitter.com/netways www.netways.de blog.netways.de