webinar: management and automation of mariadb galera clusters
DESCRIPTION
This webinar was presented at 30. September 2014 by MariaDB and Severalnines. Speakers: Ralf Gebhardt, Jean-Jérôme Schmidt and Vinay JooseryTRANSCRIPT
![Page 1: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/1.jpg)
© MariaDB Corpora,on Ab
Management & Automa,on of MariaDB Galera Clusters
Vinay Joosery, CEO -‐ [email protected]
Jean-‐Jérôme Schmidt, VP Marke,ng -‐ [email protected] Ralf Gebhardt, Sales Engineer -‐ [email protected]
* * 02.10.14 1
![Page 2: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/2.jpg)
© MariaDB Corpora,on Ab
Agenda
• Introduc,on • MariaDB Galera Cluster Essen,als • Partner presenta,on: Severalnines • MariaDB Enterprise and MariaDB Enterprise Cluster
02.10.14 2
![Page 3: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/3.jpg)
© MariaDB Corpora,on Ab
About MariaDB Corpora,on
● Home for the founders and original developers of the core of MySQL
● Home for the commercial offering of MariaDB
● Provides support and services for MySQL and derived databases like MariaDB
● Flagship product is MariaDB Enterprise: It includes support, tools and services for MariaDB
02.10.14 3
mariadb.com
![Page 4: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/4.jpg)
© MariaDB Corpora,on Ab
Data Redundancy with MariaDB
• MariaDB Internal Replica,on • Asynchronous • Semi-‐Synchronous • Storage based redundancy (Ac,ve/Passive) • DRBD (Distributed Replicated Block Device) • SAN (Storage Area Network) • VMWare replica,on • MariaDB Galera Cluster
02.10.14 4
![Page 5: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/5.jpg)
© MariaDB Corpora,on Ab
HA using MariaDB Replica,on
• This is in many cases a good enough solu,on, but it has some issues
• The cluster is very loosely coupled, not all nodes are aware of all the other nodes for example
• Replica,on is asynchronous, so failing over is more difficult than usually
• Adding a slave is difficult
02.10.14 5
![Page 6: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/6.jpg)
© MariaDB Corpora,on Ab
MariaDB Galera Cluster Architecture
• MariaDB Galera Cluster is a so_ware-‐only solu,on with many advantages
• No failover requirements -‐ the nodes are all ac,ve and are all masters
• “Proper” Cluster with built-‐in failover, locking and split-‐brain protec,on
• Synchronous replica,on with low overhead due to op,mis,c locking
• Automated online add node • No applica,on change scale out
02.10.14 6
![Page 7: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/7.jpg)
© MariaDB Corpora,on Ab
HA using MariaDB Replica,on
02.10.14 7
MariaDB Galera Cluster
MariaDB Server MariaDB Server MariaDB Server
Galera wsrep Library Galera wsrep Library Galera wsrep Library
Synchronous Replication
Load Balancer / Failover
Application / Application Server
![Page 8: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/8.jpg)
© MariaDB Corpora,on Ab
Secng up MariaDB Galera Cluster
• MariaDB Galera Cluster consists of the MariaDB binary that in turns talks to the Galera wsrep library
• Once set up, Galera is configured using the usual my.cnf file, and is monitored / managed per node using SHOW GLOBAL STATUS and SHOW GLOBAL VARIABLES commands
02.10.14 8
![Page 9: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/9.jpg)
Confidential
Automation and Management of Database Clusters
September 30, 2014
Vinay Joosery & Jean-Jérôme Schmidt
Severalnines
![Page 10: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/10.jpg)
Confidential
Agenda
¤ Database Infrastructure Lifecycle ¤ Deploy, Monitor, Manage, Scale
¤ ClusterControl Overview
¤ Introducing ClusterControl 1.2.8
¤ Live Demo
10
Copyright Severalnines AB
![Page 11: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/11.jpg)
Confidential
Database Infrastructure Lifecycle
11
Copyright 2013 Severalnines AB
![Page 12: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/12.jpg)
Confidential
Database TCO
12
Copyright Severalnines AB
Source: IDC, Maximizing the Business Value of Enterprise Database Applications
![Page 13: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/13.jpg)
Confidential
Infrastructure Lifecycle
13
Copyright 2012 Severalnines AB
Manage Scale
Monitor Deploy
![Page 14: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/14.jpg)
Confidential
Deployment - Beyond Puppet or Chef
¤ Puppet/Chef are appropriate for a group of single-node components ¤ E.g. web servers can be clones of each other..
¤ Distributed databases are complex ¤ Different node types & roles
¤ Orchestration of procedures in a specific order
¤ Using e.g. Chef for deploying a distributed database ¤ Yes, it is possible
¤ Not much Chef functionality is leveraged
¤ Prepare to write code
14
Copyright Severalnines AB
![Page 15: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/15.jpg)
Confidential
Monitoring - Beyond Nagios
¤ What do you do when the application is slow?
¤ Is it Disk? CPU? RAM? Badly written queries?
¤ What are the symptoms? (Replication queues, Page Faults, locks, # connections, …)
¤ How do you avoid problems?
¤ How do you plan for capacity?
15
Copyright Severalnines AB
![Page 16: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/16.jpg)
Confidential
Management - Beyond Monitoring
16
Copyright Severalnines AB
![Page 17: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/17.jpg)
Confidential
Scaling - Beyond Manual Operations
17
Copyright 2012 Severalnines AB
![Page 18: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/18.jpg)
Confidential
ClusterControl Overview
18
Copyright 2013 Severalnines AB
![Page 19: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/19.jpg)
Confidential
ClusterControl In a nutshell
19
Copyright 2012 Severalnines AB
Manage Scale
Monitor Deploy
![Page 20: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/20.jpg)
Confidential
Supported Databases
SQL
¤ MariaDB Cluster
¤ MySQL Galera Cluster (Codership)
¤ Percona XtraDB Cluster
¤ MySQL Cluster (NDB)
¤ MySQL Replication – with GTID
¤ Standalone MySQL/MariaDB
NoSQL
¤ MongoDB Sharded Cluster
¤ MongoDB Replica Set
¤ TokuMX Cluster
Copyright Severalnines AB
20
![Page 21: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/21.jpg)
Confidential
ClusterControl Automation & Management
¤ Provisioning ¤ Deploy a cluster in minutes
¤ On-premises or in the cloud (AWS & OpenStack)
¤ Monitoring ¤ Systems view
¤ 1sec resolution
¤ DB / OS stats & performance advisors
¤ Configurable dashboards
¤ Query Analyzer
¤ Real-time / historical
21
Copyright Severalnines AB
![Page 22: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/22.jpg)
Confidential
ClusterControl Automation & Management
¤ Management ¤ Multi cluster/data-center
¤ Automate repair/recovery
¤ Database upgrades
¤ Backups
¤ Configuration management
¤ Cloning
¤ One-click scaling
22
Copyright Severalnines AB
![Page 23: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/23.jpg)
Confidential
Getting Started
¤ Dedicated VM for the controller
¤ Specs ¤ 2 CPU cores ¤ 2-4GB RAM ¤ 20GB diskspace
¤ No agents ¤ Host stats gathered via SSH
¤ Installation ¤ YUM/APT ¤ Setup SSH access to DB nodes
23
Copyright Severalnines AB
![Page 24: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/24.jpg)
Confidential
Example Architecture
24
Copyright Severalnines AB
![Page 25: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/25.jpg)
Confidential 25
Copyright 2013 Severalnines AB
![Page 26: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/26.jpg)
Confidential
Introducing ClusterControl 1.2.8
26
Copyright 2013 Severalnines AB
![Page 27: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/27.jpg)
Confidential
ClusterControl 1.2.8 - Highlights ¤ YUM/APT repositories for ClusterControl
¤ Deployment and scaling of single-node MySQL, MariaDB and MongoDB
¤ Alerts and incident tracking with PagerDuty
¤ Unified Event Viewer
¤ New flexible alarms/email notification system
¤ Audit logging - Administrator activity tracking
¤ Global MySQL User Management
¤ New default dashboards for MySQL/MariaDB
¤ Puppet Module for ClusterControl
¤ Improved LDAP support for Active Directory and FreeIPA
27
Copyright Severalnines AB
![Page 28: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/28.jpg)
Confidential
Deployment of single-node MariaDB, MySQL & MongoDB
¤ Deploy single DB nodes
¤ Scale into clusters with a single click
28
Copyright Severalnines AB
![Page 29: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/29.jpg)
Confidential
Alert & Incident Tracking: PagerDuty Integration
¤ Integrate ClusterControl alerting with PagerDuty
¤ Add phone and SMS alerting to ClusterControl
29
Copyright Severalnines AB
![Page 30: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/30.jpg)
Confidential
Cluster-Wide MariaDB / MySQL User Management
¤ Easily create MySQL users across multiple clusters,
¤ Manage all privileges
30
Copyright Severalnines AB
![Page 31: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/31.jpg)
Confidential
New Default Dashboards for MariaDB & MySQL ¤ InnoDB IO - shows IO read/write stats for InnoDB
¤ Query Performance - for queries such as table scans and joins without indexes
¤ Galera Flow Control - shows the replication performance
31
Copyright Severalnines AB
![Page 32: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/32.jpg)
Confidential
Demo
32
Copyright 2013 Severalnines AB
![Page 33: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/33.jpg)
Confidential
Customers
33
Copyright Severalnines AB
![Page 34: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/34.jpg)
Confidential
Thank You!
¤ Cluster Configurator ¤ www.severalnines.com/config
¤ ClusterControl ¤ www.severalnines.com/clustercontrol
¤ Severalnines Blog ¤ www.severalnines.com/blog
¤ Contact: jj@severalnines
34
![Page 35: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/35.jpg)
© MariaDB Corpora,on Ab
Full product and service offering for MariaDB and MySQL available today
• MariaDB & MySQL Server
• MySQL compa,ble
• Fully open source
• Feature enhanced
• Galera Cluster
• NoSQL compa,ble (Cassandra, LevelDB)
• Tools for MariaDB & MySQL
• Monitor, manage, backup
• High availability
• Cloud deployment
• Clients for Java and C
• Services for MariaDB & MySQL
• Opera,ons support
• Developer support
• Consul,ng, training, remote DBA
02.10.14 35
Enterprise Subscrip,ons Annually renewed bundle of DB tools and services
MariaDB/MySQL Server
Services Tools
![Page 36: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/36.jpg)
© MariaDB Corpora,on Ab
MariaDB Enterprise Subscrip,on Offers
02.10.14 36
MariaDB Enterprise MariaDB Enterprise Cluster
Summary Powerful enterprise data management. Highly available database cluster for the most demanding use cases.
Supported Database Pla?orms
● MariaDB (Included) ● MySQL ● Percona XtraDB
● MariaDB Galera Cluster (Included) ● MySQL + Galera ● Percona XtraDB Cluster
Comprehensive Benefits: ● 30 min. support response ● Unlimited incidents ● Updates and bug fixes ● Security patches ● Advice, hot-‐fixes ● InstallaMon, configuraMon help ● Email, web, remote login ● Exclusive content ● Roadmaps ● OpMonal enterprise products ● OpMonal services including
Remote DBA, ConsulMng, Training, NRE
✔ ✔
Included Third-‐party Products
● Monitoring: MONyog ● Query Editor: SQLyog ● Backup: XtraBackup, Zmanda Backup
● Cluster Deployment, Management & Monitoring : SeveralNines ClusterControl
● Monitoring: MONyog ● Query Editor: SQLyog ● Backup: XtraBackup, Zmanda Backup
![Page 37: Webinar: Management and Automation of MariaDB Galera Clusters](https://reader034.vdocument.in/reader034/viewer/2022042607/55976d701a28abd5318b482f/html5/thumbnails/37.jpg)
© MariaDB Corpora,on Ab
Ques,ons?
www.mariadb.com www.facebook.com/mariadb.dbms
www.twiker.com/mariadb