mysql ha solutions





MySQL Solutions for High Availability Mat Keep MySQL Product Management






The following is intended to outline our general product direction. It is

intended for information purposes only, and may not be incorporated

into any contract. It is not a commitment to deliver any material, code,

or functionality, and should not be relied upon in making purchasing

decision. The development, release, and timing of any features or

functionality described for Oracle’s products remains at the sole

discretion of Oracle.

Safe Harbor Statement





Program Agenda

§  Causes, Effects and Impacts of Downtime

§  Methodology to Select Right HA Solution

§  Guided Tour of MySQL HA Solutions

§  Operational Best Practices






40% DATA GROWTH PER YEAR

5.9BN MOBILE SUBS IN 2011

1 BILLION iOS & ANDROID APPS DOWNLOADED PER WEEK

85% HANDSETS SHIPPED WITH A BROWSER

$1TR BY 2014

$700BN IN 2011

2.1BN USERS

8X DATA GROWTH IN 5 YRS

70+ NEW DOMAINS EVERY 60 SECONDS

350m TWEETS PER DAY

955M USERS

20M APPS PER DAY

60 HOURS UPLOADED EVERY

MINUTE






ELASTIC SCALABILITY REAL TIME USER EXPERIENCE

ROCK SOLID RELIABILITY RAPID SERVICE INNOVATION

Driving new Database Demands






Cloud

Web & Enterprise OEM & ISVs

Industry Leaders Rely on MySQL





Copyright © 2012, Oracle and/or its affiliates. All rights reserved. September 29th, 2012

The Lowdown on Downtime…. Maintenance Failures Disasters Operator / User

Revenue Customer Sat Employee Regulatory

CAUSE

EFFECT

IMPACT






HA Considerations

•  SLA requirements to support business objectives • Operational capabilities •  Service agility & time to market •  Budgetary constraints






Not Everything Needs 99.999% Uptime •  Recovery Time Objective

–  Maximum length of downtime before there is break in “business continuity”

•  Recovery Point Objective –  Point in time to which data must be recovered when service is re-established

•  Tier 1, Mission-critical services •  Tier 2, Business-critical services •  Tier 3, Task-critical services •  Tier 4, Non-critical services






Mapping Uptime to Availability

!"#" #" #" #"#"35 days 4 days 50 mins 5 mins 8 hours

Cos

t & C

ompl

exity

SPs & Line of

Business

Web & Cloud

Services

eCommerce Telecoms Military

.

Shared-Nothing, Geo-Replicated

Clusters

Clustered & Virtualized Systems

Replicated Systems






MySQL HA Solutions

!"#" #" #" #"#"35 days 4 days 50 mins 8 hours

Ope

ratio

nal C

ompl

exity

SPs & Line of

Business

Web & Cloud

Services

eCommerce Telecoms Military

.

Replication

5 mins






Why Replicate? •  Duplicates database from a “master” to a “slave”

–  Redundant copies of the data provide foundation for High Availability –  Scale out by distributing queries across the replication cluster

Master

Slaves

Web / App Servers

Writes & Reads Reads






Slave Database

Replication Workflow

•  Session thread: processes queries from the application – writes data to master database & associated events to binary log

•  Dump thread: reads events from binary log and sends them to a slave

•  I/O thread: receives replication events and stores them in slave’s relay log

•  SQL thread: reads replication events from slave’s relay log and applies them to slave database

Session

Binary Log

Master Database

Dump I/O

Relay Log

SQL






Pros §  Simple to configure §  Heterogeneous §  Low TCO – no shared storage §  Configure over LAN and WAN §  Fast failover

Cons §  Asynchronous: risk of of data loss §  Semi-Synchronous is configurable §  No automated failover or

switchover §  Performance overhead to master

Current Generation of MySQL Replication






MySQL 5.6: Evolving Replication

•  Multi-Threaded Slaves •  Binary Log Group Commit •  Optimized Row-Based Replication

PERFORMANCE

•  Global Transaction Identifiers •  Replication Failover & Admin Utilities •  Crash Safe Slaves & Binlogs

FAILOVER & RECOVERY

•  Replication Event Checksums DATA INTEGRITY

•  Replication Utilities •  Time-Delayed Replication •  Remote Binlog Backup •  Informational Log Events •  Server UUIDs

DEV/OPS AGILITY






Global Transaction Identifiers •  Simple to track & compare replication across the cluster

– Unique identifier for each transaction written to the Binlog •  Automatically identify the most up-to-date slave for failover •  Deploy n-tier replication hierarchies

Master

GTID=123456

GTID=123456

GTID=123456 GTID=123456






•  Enabling self-healing replication topologies •  Automated failover & recovery

–  mysqlfailover Utility •  Switchover & administration

–  mysqlrpladmin Utility •  Delivers HA within the core MySQL

distribution

HA Utilities Monitoring

Failed Master

Slaves

Promoted Master

Replication HA Utilities






Evaluate MySQL 5.6RC TODAY

dev.mysql.com/downloads/mysql Select Development Release tab






Clustering Overview •  Tightly coupled clusters of servers/storage providing service to an

application –  Use heartbeating and management software to monitor hardware, OS,

database and network –  Node failures detected and failover automatically initiated to redundant

systems –  Implements Virtual IP (VIP) so failover is transparent to the application

•  Couple with Virtualization for higher agility –  Migrate between servers with load balancing






Oracle Certified Solutions

Oracle VM Template

Solaris Cluster

Windows Cluster DRBD

Auto-‐Failover & Migra1on ✔ ✔ ✔ ✔

Zero Data Loss ✔ ✔ ✔ ✔

Ac1ve / Passive ✔ ✔ ✔ ✔

Pla:orm Support Linux Solaris Windows Linux

Shared Storage ✔ ✔ ✔ ✖

Single Vendor Support ✔ ✔ ✖ ✔






Oracle VM Template for MySQL Integrated & Tested OS, VM and Database Stack

•  Oracle Linux

•  Oracle VM

•  Oracle VM Manager

•  Oracle Cluster File System 2 (OCFS2)

•  MySQL Database 5.5 (Enterprise Edition)

Pre-Installed & Pre-Configured Full Integration & QA Testing Single Point of Support

Oracle VM Servers

Oracle VM Server Pool

ocfs2

Oracle VM Manager

iSCSI / FC-AL

Oracle VM

Secure Live Migration (SSL)

Oracle VM Automatic Fault Detection & Recovery

hEp://mysql.com/why-‐mysql/white-‐papers/mysql_wp_oracle-‐vm-‐template-‐for-‐mee.php






VM Server Pool

VM VM VM VM

Oracle VM Servers

SAN, iSCSI

VM Server Pool

VM VM VM VM

Oracle VM Servers

SAN, iSCSI

Oracle VM Manager

Browser

Oracle VM Template for MySQL Protecting Against Planned and Unplanned Downtime

Planned Events: •  Maintenance or upgrades •  Secure Live Migration •  Zero interruption

SSL Migration

X Failures •  Server, VM or database failure •  HA Auto-restart in pool •  Automatic failure detection & recovery

X HA Auto Restart

m m

Pool Masters assure Secure Migration or HA restarts complete in the event of a Manager outage






Oracle Linux and DRBD Stack

•  Based on distributed storage, not a SAN –  Synchronous replication eliminates risk of data

loss

•  Open source, mature & proven •  Certified and fully supported by Oracle

–  DRBD integrated into Oracle Linux Unbreakable Enterprise Kernel R2

–  Pacemaker and Corosync for clustering / failover –  Updates to stack via ULN channel

•  Whitepaper: –  http://www.mysql.com/why-mysql/white-papers/

mysql_wp_drbd.php






•  Native Windows HA clustering with MySQL •  Failures & Planned Maintenance

•  Quorum (3rd vote), data (InnoDB + schema) & binaries (optional) stored in shared storage (iSCSI & FCAL)

•  Loss of service = couple of seconds + InnoDB recovery time –  App sees temporary loss of connection and reconnects on same

IP address –  Replication slave recovers automatically

•  Cluster managed through MS Failover Cluster Management snap-in GUI

•  No new software/scripts required

Windows Server Failover Clustering

** Technical support for Windows Server Failover Clustering must be sourced from Microsoft.

Download the Guide: http://bit.ly/w3rSoP

App

Virtual IP

Data Bin

Slave App App

Vote






Oracle Solaris Clustering

•  Kernel based heartbeating and monitoring •  SPARC and x86. Solaris Virtualization-aware •  MySQL agent included with Oracle Solaris Cluster •  Learn more: http://www.oracle.com/technetwork/server-storage/solaris-cluster/overview/index.html

!






3rd Party HA Solutions

• Oracle supports MySQL on open source and commercial HA technologies – Support for HA mechanisms from respective communities or

vendors

•  Symantec Veritas Cluster • Red Hat Cluster Suite






Who’s Using MySQL Cluster?





MySQL Cluster Architecture: High Performance

MySQL Cluster Data Nodes

Data Layer

Clients

Applica1on Layer


Management Management





MySQL Cluster Architecture: Extreme Resilience

MySQL Cluster Data Nodes

Data Layer

Clients

Applica1on Layer


Management Management






Multi-Data Availability Geographic Replication

•  DR and Data Locality •  Replicate complete clusters

across data centers –  Fully active/active –  No passive resources

•  Split individual clusters across data centers –  Synchronous replication &

auto-failover between sites

Geographic Replication






Handling Scheduled Maintenance On-Line Operations

Scale

Upgrade

Backup

Evolve






SLAs Platforms Application requirements (storage engines) Performance expectations vs tolerance to data loss Skill sets






Certified MySQL HA Solutions

MySQL 5.6 ReplicaAon

Oracle VM Template

Solaris Cluster

Windows Cluster DRBD MySQL

Cluster

Auto-‐Failover & Migra1on ✔ ✔ ✔ ✔ ✔ ✔

No Data Loss @ Failover Semi-‐Sync ✔ ✔ ✔ ✔ ✔

Pla:orm Support All Linux Solaris Windows Linux All

Clustering Mode Master + Slaves

Ac1ve/Passive

Ac1ve/Passive

Ac1ve/Passive

Ac1ve/Passive

Mul1-‐Master

Shared Storage ✖ ✔ ✔ ✔ ✖ ✖

Availability Design 99.9% 99.99% 99.99% 99.95% 99.99% 99.999%

Single Vendor Support ✔ ✔ ✔ ✖ ✔ ✔






Operational Best Practices Training

Consul1ng

24 x 7 x 365 Global Support

Database Management & Monitoring






Oracle Premier Lifetime Support

Oracle Product Certifications/Integrations

MySQL Enterprise High Availability

MySQL Enterprise Security

MySQL Enterprise Scalability

MySQL Enterprise Backup

MySQL Enterprise Monitor/Query Analyzer

MySQL Workbench

MySQL Enterprise Edition Highest Levels of Security, Performance and Availability

MySQL Enterprise Audit






•  Web-based, global view of MySQL/Cluster applications (on-premise and Cloud deployments)

•  Automated, rules-based monitoring and alerts (SMTP, SNMP enabled)

•  Query capture, monitoring, analysis and tuning, correlated with Monitor graphs

•  Real-time Replication Monitor with auto-discovery of master-slave topologies

•  Integrated with Oracle Support

MySQL Enterprise Monitor

A Virtual MySQL DevOps + Admin!






§  Online Backup for InnoDB (scriptable interface) §  Full, Incremental, Partial Backups (with compression) §  Point in Time, Full, Partial Recovery options §  Parallel, multi-threaded backup/recovery operations §  Metadata on status, progress, history §  Unlimited Database Size §  Cross-Platform

-  Windows, Linux, Unix

§  Certified with Oracle Secure Backup

MEB Backup Files

MySQL Database Files

mysqlbackup

Ensures quick, online backup and recovery of your on premise and Cloud based MySQL applications.

MySQL Enterprise Backup






•  Straight from the Source •  Largest Team of MySQL Experts •  Backed by MySQL Developers •  Forward Compatible Hot Fixes •  MySQL Maintenance Releases •  MySQL Support in 29 Languages •  24/7/365 •  Unlimited Incidents •  Knowledge Base •  MySQL Consultative Support

Oracle Premier Support for MySQL Rely on The Experts - Get Unique Benefits

"The MySQL support service has been essential in helping us with troubleshooting and providing recommendations for the production cluster, Thanks." -- Carlos Morales – Playfulplay.com

Only From Oracle






Next Steps Learn More

Evaluate MySQL 5.6 Book a Workshop

HA Solutions Guide http://bit.ly/NB8up1

Download Today http://dev.mysql.com/downloads/mysql/

High Availability Jumpstart http://www.mysql.com/consulting/

Copyright 2011 Oracle Corporation 44






[email protected]






Design Goals

•  Auto-Sharding, Multi-Master •  ACID Compliant, OLTP + Real-Time Analytics

HIGH SCALE, READS + WRITES

•  Shared nothing, no Single Point of Failure •  Self Healing + On-Line Operations

99.999% AVAILABILITY

•  Open Source + Commercial Editions •  Commodity hardware + Management, Monitoring Tools

LOW TCO

•  Key/Value + Complex, Relational Queries •  SQL + Memcached + Java + JPA + HTTP/REST + C++

SQL + NoSQL

•  High Load, Real Time Performance •  Predictable Low-Latency, Bounded Access Time

REAL-TIME






Mapping Applications to HA Technology !""#$%&'()* +&,&-&*./

0."#$%&'() 1#2*,.3.4/5/6$3,2&#$7.4

89&3.4:;(,9$)<=/>.(:0."#$%&,.4/

1#2*,.3

!"#$%%&'(&)*)+',-./0 ))))))))))))))))123)4&55.$/)6,/,0&%&/7 ))))))))))))))))123)

85&')9:7;&/<(,<$/)*)9(($:/</0 )))))))))))))))))123)=&&-5>)?@$05>)A.B.5

CD+E )))))))))))))))))123)F,7,)A,'&;$:5&*?G

#$/7&/7)6,/,0&%&/7

#H6

#$@@,I$',<$/

E,(B,0&-)4$JK,'&

L&7K$'B)G/M',57':(7:'&)

#$'&)+&@($)9NN5)1ODH*O44*4FEP3)

1: Replication used in combination with cluster or virtualization – based HA






Reasons for Unplanned Downtime

People 40%

Process 40%

Products 20%

http://www.gartner.com/DisplayDocument?id=334197






MySQL Expert Advisors

140+ Rules, 40+ MySQL, OS specific Graphs

Administration •  Monitors and Advises on

Optimal Configuration

Security •  Monitors and Advises

on Unplanned Security Changes/Loopholes

Upgrade •  Monitors and Advises on

Bugs/Upgrades that affect current installation

Replication

•  Monitors and Advises on Master/Slave Latency.

Memory Usage

•  Monitors and advises on optimal memory/cache settings

Schema •  Monitors and Advises

on Unplanned Schema Change

Performance •  Monitors and Advises

on Optimal Performance Variable Settings

•  Built by DBA to Enforce Organization specific best practices.

Custom

MySQL Cluster •  Monitors and Advises on

status/ performance of MySQL Cluster Data Nodes.

160+ Rules, 60+ MySQL, OS specific Graphs

Backup/Recovery •  Monitors and Advises on backup/recovery operations.