mysql: crash course - sqlhjalp.orginsert picture here> mysql: crash course keith larson...

85
<Insert Picture Here> MySQL: Crash Course Keith Larson [email protected] MySQL Community Manager http://sqlhjalp.com/pdf/MySQL_crashcourse_2012.pdf

Upload: lamlien

Post on 11-Mar-2018

237 views

Category:

Documents


0 download

TRANSCRIPT

<Insert Picture Here>

MySQL: Crash CourseKeith [email protected] Community Managerhttp://sqlhjalp.com/pdf/MySQL_crashcourse_2012.pdf

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.

The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Safe Harbor Statement

Who am I and who are you?

Keith [email protected] MySQL Community Managerhttp://www.sqlhjalp.com/

Started with MySQL during the dot.com days. Primary real world work was with a MySQL InnoDB replicated chain environment that easily held over 4 billion rows of user data.Numerous other sites developed on LAMP stack over the last 13 years.

Who are you?DBAs?Developers?

Copyright Oracle Corporation 2012 3

• Oracle's Investment into MySQL• A high-level overview• Familiarize with the key concepts• MySQL Editions

Session Agenda

Copyright Oracle Corporation 2012 4

Copyright Oracle Corporation 2012 5

The official way to pronounce “MySQL” is “My Ess Que Ell”

but we do not mind if you pronounce it as “my sequel”

It was named after Monty's Daughter Maria.

Pronunciation

Copyright Oracle Corporation 2012 6

Sakila is the official name of the MySQL dolphin (the logo).

The name comes from a competition to namethe dolphin. The winning name was submitted by Ambrose Twebaze, an Open Source software developer from Swaziland, Africa.

According to Ambrose, the name Sakila has its roots in SiSwati, the local language of Swaziland.

Sakila is also the name of a town in Arusha,Tanzania, near Ambrose's country of origin, Uganda.

What do you think of when you think of a dolphin?

Fast Love-able Agile Intelligent Social Everyone loves a dolphin

What is Sakila?

https://wikis.oracle.com/pages/viewpage.action?pageId=27394602

Copyright Oracle Corporation 2012 7

MySQL AB founded 1995 by Michael Widenius, David Axmark, and Allan Larsson

Initial release : 23 May 1995

Marten Mickos was CEO January 2001 to February 2008

2005 - Oracle Acquires Innobase (founded by Heikki Tuuri)

A little background

Copyright Oracle Corporation 2012 8

Acquired by SUN Microsystems in 2008 for 1B USD

Acquired by Oracle in 2009

Dual licensing: GPL v.2 + commercial

Easy of use: the 15 minute rule has been cut down to 3 mins on windows

“M” in “LAMP” stack

A little background

http://www.mysql.com/news-and-events/sun-to-acquire-mysql.html

Marten Mickos CEO MySQL AB Jonathan Schwartz CEO SUN Larry Ellison CEO Oracle

Copyright Oracle Corporation 2012 9

• Oracle's Investment into MySQL

Session Agenda

Copyright Oracle Corporation 2012 10

>70% of Oracle Shops run MySQL

Copyright Oracle Corporation 2012 11

Fast Agile Ease of use Scalable Enterprise Ready

Q2 CY2010 Q3 CY2010 Q4 CY2010 Q1 CY2011

• MySQL Workbench 5.2

GA!

• MySQL Database 5.5 • MySQL Enterprise Backup 3.5• MySQL Enterprise Monitor 2.3• MySQL Cluster Manager 1.1

All GA!

A Better MySQL

Q2 CY2011

•MySQL Enterprise Monitor 2.2•MySQL Cluster 7.1• MySQL Cluster Manager 1.0

All GA!

• MySQL Database 5.6

• MySQL Cluster 7.2

DMR*

and MySQL Labs!

(“early and often”)

*Development Milestone Release

Continuous Innovation with more product releases than ever before

Copyright Oracle Corporation 2012 12

MySQL On the Cover

http://www.oracle.com/technetwork/issue-archive/2011/11-jan/index-191276.html

Copyright Oracle Corporation 2012 13

Enterprise 2.0SaaS, Cloud

Web OEM / ISV’s

Telecommunications

Rely on MySQL

Industry Leading Customers

Copyright Oracle Corporation 2012 14

• A high-level overview

Session Agenda

Copyright Oracle Corporation 2012 15

MySQL Terminology

• Database ( Files )

• Database Instance ( memory)memory• Schema

• User• Table Space

• Database Server Instance

• Database Server Instance

• Database• User• Table Space• Storage Engine

Copyright Oracle Corporation 2012 16

Error Log– log-error

Binary Log– Log-bin custom set via my.cnf

Slow Query Log– Log-slow-queries– Slow-query-time– log-queries-not-using-indexes

General Log– Log

http://dev.mysql.com/doc/refman/5.5/en/server-logs.html

MySQL Logs

Copyright Oracle Corporation 2012 17

SHOW VARIABLES like '%log%';

+-----------------------------------------+-------------------------------------+

| Variable_name | Value |

+-----------------------------------------+-------------------------------------+

| back_log | 50 |

| binlog_cache_size | 32768 |

| binlog_checksum | NONE |

| binlog_direct_non_transactional_updates | OFF |

| binlog_format | MIXED |

| binlog_row_image | FULL |

| binlog_rows_query_log_events | OFF |

| binlog_stmt_cache_size | 32768 |

| expire_logs_days | 0 |

| general_log | OFF |

| general_log_file | /var/lib/mysql/kdlarson-pc.log |

…...

Copyright Oracle Corporation 2012 18

MySQL Logs

• Centralized monitoring of queries without Slow Query Log, SHOW PROCESSLIST;

• Enabled via MySQL Connectors• Aggregated view of query execution

counts, time, and rows• Visual “grab and go” correlation with

Monitor graphs• Traces query executions back to

source code

Saves you time parsing atomic executions from logs. Finds problems you cannot find yourself.

MySQL Query Analyzer

Copyright Oracle Corporation 2012 19

http://carlos.syr.edu/oracle-database-architecture/

Oracle Database Architecture

Copyright Oracle Corporation 2012 20

MySQL Database Architecture

Copyright Oracle Corporation 2012 21

Standalone (mysqld)UNIX daemon

Windows service

Regular process on UNIX or Windows

Embedded (libmysqld)Shared / Dynamic library

MySQL Server

Copyright Oracle Corporation 2012 22

InnoDB

DB1

InnoDB

DB2

MyISAM

DB3

InnoDB MyISAM

CoreSQL-query processing, …

Plugin 1 Plugin 2 Plugin 3

The Core

PluginsStorage Engines

Full-text search plugins

Audit plugins

Authentication plugins

MySQL Server Components

Copyright Oracle Corporation 2012 23

The Storage Engine (SE) defines data storage and retrieval

Every regular table belongs to some SE

Most notable Storage Engines:

InnoDB (default since 5.5)

– fully transactional SE

MyISAM (default prior to 5.5)

– NON-transactional SE

Default Storage Engine used it not defined

MySQL Storage Engines

CREATE TABLE `City` ( `ID` int(11) NOT NULL AUTO_INCREMENT, `Name` char(35) NOT NULL DEFAULT '', `CountryCode` char(3) NOT NULL DEFAULT '', `District` char(20) NOT NULL DEFAULT '', `Population` int(11) NOT NULL DEFAULT '0', PRIMARY KEY (`ID`), KEY `CountryCode` (`CountryCode`)) ENGINE=InnoDB DEFAULT CHARSET=latin1

Copyright Oracle Corporation 2012 24

Select a specialized storage engine for a particular application need.

InnoDB: a high-reliability and high-performance storage engine for MySQL designed for transaction processing. It follows the ACID model. Row-level locking and Oracle-style consistent reads increase multi-user concurrency and performance

MyISAM: -oldest storage engine has many features

that have been developed over years.

Memory: creates tables with contents that are stored in memory. MySQL Cluster offers the same features as the MEMORY engine with higher performance levels, and provides

additional features

MySQL Storage Engines

Copyright Oracle Corporation 2012 25

CSV: data file is a plain text file

ARCHIVE: is used for storing large amounts of data without indexes in a very small footprint.

BLACKHOLE:accepts data but throws

it away and does not store it but the

binary log is enabled.

MySQL Storage Engines

Copyright Oracle Corporation 2012 26

Open Source

Limitations Relating to Storage Engines

Horizontal partitioning

(distribute rows, not columns)

Partitioning functions:

The modulus

Range

Internal hashing function

Linear hashing function

MySQL Partitioning

http://dev.mysql.com/doc/refman/5.1/en/partitioning-overview.html http://dev.mysql.com/tech-resources/articles/mysql_55_partitioning.html

Copyright Oracle Corporation 2012 27

CREATE TABLE members ( firstname VARCHAR(25) NOT NULL, lastname VARCHAR(25) NOT NULL, username VARCHAR(16) NOT NULL, email VARCHAR(35), joined DATE NOT NULL)PARTITION BY RANGE( YEAR(joined) ) ( PARTITION p0 VALUES LESS THAN (1960), PARTITION p1 VALUES LESS THAN (1970), PARTITION p2 VALUES LESS THAN (1980), PARTITION p3 VALUES LESS THAN (1990), PARTITION p4 VALUES LESS THAN MAXVALUE);

MySQL Replication

Copyright Oracle Corporation 2012 28

Top used Feature in MySQL Used for Scalability and HA

Write to one masterRead from many slaves, easily add more as

neededPerfect for read/write intensive apps Asynchronous as standardSemi-Synchronous support added in MySQL 5.5Each slave adds minimal load on master

Replication formats:

Statement-based replication (SBR): propagate SQL statements

Row-based replication (RBR): propagate row changes

Mixed-based replication: SBR or RBR depending on the query

http://sqlhjalp.com/pdf/2012_Scale_Replication.pdf

MySQL Replication Overview

Copyright Oracle Corporation 2012 29

sqlhjalp.com/pdf/2012_Scale_Replication.pdf available for review

MySQL Replication Topologies

Copyright Oracle Corporation 2012 30

http://sqlhjalp.com/pdf/2012_Scale_Replication.pdf

MySQL Replication Overview

Copyright Oracle Corporation 2012 31

Replication Threads Binlog dump thread Slave I/O thread Slave SQL thread

Replication Files relay log master info log relay log info log

http://sqlhjalp.com/pdf/2012_Scale_Replication.pdf

MySQL Replication Overview

Copyright Oracle Corporation 2012 32

http://sqlhjalp.com/pdf/2012_Scale_Replication.pdf

MySQL Replication Overview

Copyright Oracle Corporation 2012 33

Oracle Integrations: Golden Gate

Heterogeneous Replication between MySQL, OracleMySQL specific optimizations Hybrid web, enterprise applications (Sabre Holdings)Offload, scale query activity to MySQL read-only slavesReal-time access to web-based analytics, reportingMigration path from/to MySQL from other databases with minimal downtime

MySQL Replication

Copyright Oracle Corporation 2012 34

Not on a cluster but MySQL Cluster

Different source tree, different versioning (7.x)

Developed from Erickson

In-memory, shared-nothing architecture

“Synchronous, multi-master replication”

Availability

99.999% (<5 min downtime / year)

Performance

Response Time 2-5 millisecond (with synchronous replication and access via NDB API

Throughput of 10,000+ replicated transactions/sec on a 2 Node Cluster, with 1 CPU Per Node (minimal configuration)

Throughput of 100,000 replicated transactions/sec on 4 Node Cluster, with 2 CPU Per Node (low-end configuration)

Failover

Sub-second failover enables you to deliver service without interruption

MySQL Cluster

Copyright Oracle Corporation 2012 35

http://www.mysql.com/products/cluster/

Node Failure Detection & Self-Healing RecoveryMySQL Cluster

Copyright Oracle Corporation 2012 36

http://www.mysql.com/products/cluster/

The way depends on the application

Possible solutions:

Replication?

mysqldump

MySQL Enterprise Backup

Best solution is using all three.

# mysqldump -p --all-databases --master-data=1 > /tmp/example_dump.sql

Not an online solution. Can/will lock tables.

MySQL Backup

http://www.amazon.com/Effective-MySQL-Backup-Recovery-Oracle/dp/0071788573

Copyright Oracle Corporation 2012 37

Online Backup for InnoDBSupport for MyISAM (Read-only)High Performance Backup & RestoreCompressed BackupFull BackupIncremental BackupPartial BackupsPoint in Time RecoveryUnlimited Database SizeCross-PlatformWindows, Linux, Unix

Ensures quick, online backup and recovery of your MySQL apps.

MySQL Enterprise Backup

Copyright Oracle Corporation 2012 38

Usage:

ibbackup [--incremental lsn] [--sleep ms] [--suspend-at-end] [--compress [level]] [--include regexp] my.cnf backup-my.cnf

or

ibbackup --apply-log [--use-memory mb] [--uncompress] backup-my.cnf

or

ibbackup --apply-log --incremental [--use-memory mb] [--uncompress] incremental-backup-my.cnf full-backup-my.cnf

The backup program does NOT make a backup of the .frm files of the tables,

and it does not make backups of MyISAM tables. To back up these items, either:

- Use the mysqlbackup program.

- Make backups of the .frm files with the Unix 'tar' or the Windows WinZip or an equivalent tool both BEFORE and AFTER ibbackup finishes its work,and also store the MySQL binlog segment that is generated between the moment

you copy the .frm files to a backup and the moment ibbackup finishes its work.

For extra safety, also use:

mysqldump -l -d yourdatabasename

to dump the table CREATE statements in a human-readable form before

ibbackup finishes its work.

Copyright Oracle Corporation 2012 39

MySQL Enterprise Backup

• Familiarize with the key concepts

Session Agenda

Copyright Oracle Corporation 2012 40

MySQL products support unicode.

Full Unicode 5.0 is supported for data, and for metadata we support only characters for Basic Multilingual Plane (BMP).

Database or schema in Oracle world.

Current database (per connection)

Database – a set of files in “the data directory”

System database (mysql)

Virtual databases:

INFORMATION_SCHEMA

PERFORMANCE_SCHEMA

MySQL Concepts

Copyright Oracle Corporation 2012 41

User: username@hostname

Precisely: ‘user-name-mask’@’host-name-mask’

Host name – client host name (“from” host name)

User name mask:

can be empty (anonymous user) – all users

Host name mask:

can be empty – all host names (%)

can have ‘%’ (e.g.: %.foo.com)

MySQL Privileges

Copyright Oracle Corporation 2012 42

Connecting as foo from localhost…

Should be foo@%, right ?

The most specific values are used

BUT: host name matching is done before user name

mysql -u foo -h localhost -p

‘’@localhost will be chosen !

MySQL Privileges

+-----------+-------------------+

| Host | User |

+-----------+-------------------+

| localhost | |

| localhost | bar |

| % | foo |

| localhost | root |

+-----------+-------------------+

Copyright Oracle Corporation 2012 43

$ mysql -u root

ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: NO)

$ mysql -u root -p

Enter password:

$ mysqladmin -u root -p password <passwordhere>

mysql> UPDATE mysql.user

SET Password=PASSWORD('<passwordhere>')

WHERE User='root';

mysql> FLUSH PRIVILEGES;

Copyright Oracle Corporation 2012 44

MySQL Privileges -- Root

Do not know the root password?

Stop the service: # /etc/init.d/mysql stop

Restart with skip grand: # mysqld_safe --skip-grant-tables &

Connect as root: # mysql -u root

Set new password :

use mysql;

mysql> update user set password=PASSWORD("NEW-ROOT-PASSWORD") where User='root';

mysql> flush privileges;

mysql> quit

Stop the service: # /etc/init.d/mysql stop

Start the service: # /etc/init.d/mysql start

Log in as root with password. # mysql -u root -p

Copyright Oracle Corporation 2012 45

http://dev.mysql.com/doc/refman/5.5/en/resetting-permissions.html

MySQL Privileges

mysql> CREATE USER 'monty'@'localhost' IDENTIFIED BY 'some_pass';

mysql> GRANT ALTER, CREATE VIEW, CREATE, DELETE, DROP, GRANT OPTION, INDEX, INSERT, SELECT, SHOW VIEW, TRIGGER, UPDATE ON *.* TO 'monty'@'localhost'

WITH GRANT OPTION;

mysql> CREATE USER 'monty'@'%' IDENTIFIED BY 'some_pass';

mysql> GRANT ALTER, CREATE VIEW, CREATE, DELETE, DROP, GRANT OPTION, INDEX, INSERT, SELECT, SHOW VIEW, TRIGGER, UPDATE ON *.* TO 'monty'@'%'

WITH GRANT OPTION;

mysql> flush privileges ;

Copyright Oracle Corporation 2012 46

MySQL Privileges -- users

http://dev.mysql.com/doc/refman/5.6/en/grant.html

mysql> CREATE USER 'admin'@'localhost' IDENTIFIED BY 'admin_pass';

GRANT ALL ON *.* TO 'admin'@'localhost';

mysql> flush privileges ;

MySQL Super User Accounts

Copyright Oracle Corporation 2012 47

http://dev.mysql.com/doc/refman/5.6/en/grant.html

SHOW CREATE TABLE tbl_name

SHOW CREATE PROCEDURE proc_name

SHOW CREATE TRIGGER trigger_name

SHOW CREATE VIEW view_name

SHOW PROCEDURE CODE proc_name

SHOW PROCEDURE STATUS [like_or_where]

SHOW [FULL] PROCESSLIST

SHOW GRANTS [FOR user]

SHOW WARNINGS [LIMIT [offset,] row_count]

SHOW {DATABASES | SCHEMAS} [LIKE 'pattern' | WHERE expr]

SHOW OPEN TABLES [{FROM | IN} db_name] [LIKE 'pattern' | WHERE expr]

SHOW BINARY LOGS

SHOW MASTER LOGS

MySQL Show Commands

Copyright Oracle Corporation 2012 48

http://dev.mysql.com/doc/refman/5.6/en/show.html

Use SHOW processlist to find out what is going on:+----+-------+-----------+----+---------+------+--------------+-------------------------------------+

| Id | User | Host | db | Command | Time | State | Info |

+----+-------+-----------+----+---------+------+--------------+-------------------------------------+

| 6 | monty | localhost | bp | Query | 15 | Sending data | select * from station,station as s1 |

| 8 | monty | localhost | | Query | 0 | | show processlist |

+----+-------+-----------+----+---------+------+--------------+-------------------------------------+

Use KILL in mysql or mysqladmin to kill off runaway threads.

How to find out how MySQL solves a query

Run the following commands and try to understand the output:

* SHOW VARIABLES;

* SHOW COLUMNS FROM ...\G

* EXPLAIN SELECT ...\G

* FLUSH STATUS;

* SELECT ...;

* SHOW STATUS;

MySQL Show Processlist

Copyright Oracle Corporation 2012 49

A few ways to see what databases you have on your system:– cd /var/lib/mysql

• Review the directories– Log in to MySQL server

• Show databases– mysql -u root -p

» Enter password: – show databases;– +--------------------+

– | Database |

– +--------------------+

– | information_schema |

– | db_example |

– | employees |

– | exampledb |

– | mysql |

– | orig |

– | performance_schema |

– +--------------------+

MySQL Databases/Schema

Copyright Oracle Corporation 2012 50

mysql> use world; ---- DATABASE / SCHEMA

mysql> show tables; ---- TABLE SPACE

+-----------------+

| Tables_in_world |

+-----------------+

| City |

| Country |

| CountryLanguage |

+-----------------+

3 rows in set (0.00 sec)

MySQL Table Space

Copyright Oracle Corporation 2012 51

mysql> show create table City;

CREATE TABLE `City` (

`ID` int(11) NOT NULL AUTO_INCREMENT,

`Name` char(35) NOT NULL DEFAULT '',

`CountryCode` char(3) NOT NULL DEFAULT '',

`District` char(20) NOT NULL DEFAULT '',

`Population` int(11) NOT NULL DEFAULT '0',

PRIMARY KEY (`ID`),

KEY `CountryCode` (`CountryCode`),

CONSTRAINT `city_ibfk_1` FOREIGN KEY (`CountryCode`) REFERENCES `Country` (`Code`)

) ENGINE=InnoDB AUTO_INCREMENT=1 DEFAULT CHARSET=latin1

Copyright Oracle Corporation 2012 52

MySQL Table Space

mysql > desc City;

+-------------+----------+------+-----+---------+----------------+

| Field | Type | Null | Key | Default | Extra |

+-------------+----------+------+-----+---------+----------------+

| ID | int(11) | NO | PRI | NULL | auto_increment |

| Name | char(35) | NO | | | |

| CountryCode | char(3) | NO | MUL | | |

| District | char(20) | NO | | | |

| Population | int(11) | NO | | 0 | |

+-------------+----------+------+-----+---------+----------------+

5 rows in set (0.06 sec)

Copyright Oracle Corporation 2012 53

MySQL Table Space

TEXT TYPESCHAR( )A fixed section from 0 to 255 characters long.

VARCHAR( )A variable section from 0 to 255 characters long.

TINYTEXT A string with a maximum length of 255 characters.

TEXT A string with a maximum length of 65535 characters.

BLOB A string with a maximum length of 65535 characters.

MEDIUMTEXT A string with a maximum length of 16777215 characters.

MEDIUMBLOB A string with a maximum length of 16777215 characters.

LONGTEXT A string with a maximum length of 4294967295 characters.

LONGBLOB A string with a maximum length of 4294967295 characters.

CREATE TABLE `example_table` (

...

`value` varchar(100) DEFAULT NULL,

...

MySQL Datatypes

Copyright Oracle Corporation 2012 54

http://dev.mysql.com/doc/refman/5.5/en/data-types.html

NUMBER TYPESTINYINT( ) -128 to 127 normal 0 to 255 UNSIGNED.

SMALLINT( ) -32768 to 32767 normal 0 to 65535 UNSIGNED.

MEDIUMINT( )-8388608 to 8388607 normal 0 to 16777215 UNSIGNED.

INT( ) -2147483648 to 2147483647 normal 0 to 4294967295 UNSIGNED.

BIGINT( ) -9223372036854775808 to 9223372036854775807 normal

0 to 18446744073709551615 UNSIGNED.

FLOAT A small number with a floating decimal point.

DOUBLE( , ) A large number with a floating decimal point.

DECIMAL( , ) A DOUBLE stored as a string , allowing for a fixed decimal point.

Create Table: CREATE TABLE `example_table` (

`example_table_id` int(10) unsigned NOT NULL AUTO_INCREMENT,

.....or

`example_table_id` bigint(12) unsigned NOT NULL auto_increment

Copyright Oracle Corporation 2012 55

http://dev.mysql.com/doc/refman/5.5/en/data-types.html

MySQL Datatypes

DATE TYPES

DATE YYYY-MM-DD.

DATETIME YYYY-MM-DD HH:MM:SS.

TIMESTAMP YYYYMMDDHHMMSS.

TIME HH:MM:SS.

Create Table: CREATE TABLE `example_table` (

`example_table_id` int(10) unsigned NOT NULL AUTO_INCREMENT,

`user_id` int(9) unsigned DEFAULT NULL,

`date_recorded` datetime DEFAULT NULL,

PRIMARY KEY (`example_table_id`),

UNIQUE KEY `user_id` (`user_id`),

KEY `date_recorded` (`date_recorded`)

) ENGINE=InnoDB

Copyright Oracle Corporation 2012 56

http://dev.mysql.com/doc/refman/5.5/en/data-types.html

MySQL Datatypes

MISC TYPES

ENUM ( ) Short for ENUMERATION which means that each column may have one of a specified possible values.

SET Similar to ENUM except each column may have more than one of the specified possible values.

…..

`transfer_method` enum('OFF','EMAIL','FTP','BATCH POST','FTP-SSL','REAL TIME POST','CUSTOM') default NULL,

….

Copyright Oracle Corporation 2012 57

http://dev.mysql.com/doc/refman/5.5/en/data-types.html

MySQL Datatypes

URLS to help for later:

http://dev.mysql.com/doc/refman/5.6/en/mysql-indexes.html

http://dev.mysql.com/doc/refman/5.6/en/show-index.html

http://dev.mysql.com/doc/refman/5.6/en/create-index.html

http://learnmysql.blogspot.com/2010/11/mysql-query-and-index-tuning.html

http://www.slideshare.net/manikandakumar/mysql-query-and-index-tuning

http://www.slideshare.net/osscube/indexing-the-mysql-index-key-to-performance-tuning

http://effectivemysql.com/downloads/ImprovingPerformanceWithBetterIndexes-OOW-2011.pdf

http://prajwal-tuladhar.net.np/2009/09/23/474/things-you-should-know-about-mysql-index/

http://dev.mysql.com/doc/refman/5.5/en/innodb-monitors.html

http://dev.mysql.com/doc/refman/5.5/en/innodb-parameters.html

http://dev.mysql.com/doc/refman/5.5/en/innodb-buffer-pool.html

http://www.mysqlperformanceblog.com/2006/07/17/show-innodb-status-walk-through/

http://dev.mysql.com/doc/refman/5.5/en/server-parameters.html

http://dev.mysql.com/doc/refman/5.5/en/server-system-variables.html#sysvar_key_buffer_size

http://dev.mysql.com/doc/refman/5.5/en/server-system-variables.html#sysvar_table_open_cache

http://www.mysqlperformanceblog.com/2007/11/01/innodb-performance-optimization-basics/

http://www.mysqlperformanceblog.com/2007/11/03/choosing-innodb_buffer_pool_size/

MySQL Indexes

Index Cards' "DNA" By ayalan

http://prajwal-tuladhar.net.np/2009/09/23/474/things-you-should-know-about-mysql-index/

Copyright Oracle Corporation 2012 58

MySQL Index options

MySQL startup options

When tuning a MySQL server, the two most important variables to configure are key_buffer_size and table_open_cache.

The buffer pool is for caching data and indexes in memory so set the following to < 80% of the machine physical memory.

Important options are:

innodb_buffer_pool_size < 80% of memory. # default value is 8M

innodb_log_file_size=2G. #dependent on recovery speed required.

innodb_log_buffer_size=4M

innodb_thread_concurrency=8 # Default

innodb_flush_method=O_DIRECT # double buffering and swap are bad

# innodb_file_per_table #depends on how many tables used. Get the big picture 1st.

Copyright Oracle Corporation 2012 59

MySQL Indexes (keys)

When MySQL uses indexesUsing >, >=, =, <, <=, IF NULL and BETWEEN on a key.

o SELECT * FROM table_name WHERE key_part1=1 and key_part2 > 5;

o SELECT * FROM table_name WHERE key_part1 IS NULL;

* When you use a LIKE that doesn't start with a wildcard.

o SELECT * FROM table_name WHERE key_part1 LIKE 'jani%'

* Retrieving rows from other tables when performing joins.

o SELECT * from t1,t2 where t1.col=t2.key_part

* Find the MAX() or MIN() value for a specific index.

o SELECT MIN(key_part2),MAX(key_part2) FROM table_name where key_part1=10

* ORDER BY or GROUP BY on a prefix of a key.

o SELECT * FROM foo ORDER BY key_part1,key_part2,key_part3

* When all columns used in the query are part of one key.

o SELECT key_part3 FROM table_name WHERE key_part1=1

Copyright Oracle Corporation 2012 60

MySQL Indexes (keys)

When MySQL doesn't use an index * Indexes are NOT used if MySQL can calculate that it will probably be faster to

scan the whole table.

For example if key_part1 is evenly distributed between 1 and 100, it's not good to use an index in the following query:

o SELECT * FROM table_name where key_part1 > 1 and key_part1 < 90

* If you are using HEAP tables and you don't search on all key parts with =

* When you use ORDER BY on a HEAP table

* If you are not using the first key part

o SELECT * FROM table_name WHERE key_part2=1

* If you are using LIKE that starts with a wildcard

o SELECT * FROM table_name WHERE key_part1 LIKE '%jani%'

* When you search on one index and do an ORDER BY on another

o SELECT * from table_name WHERE key_part1 = # ORDER BY key2

Copyright Oracle Corporation 2012 61

MySQL Indexes (keys)

Optimizing tables Use NOT NULL for columns which will not store null values. This is particularly

important for columns which you index.

`e_id` bigint(12) unsigned NOT NULL

Don't create indexes you are not going to use.

Use the fact that MySQL can search on a prefix of an index; If you have and INDEX (a,b), you don't need an index on (a).

UNIQUE KEY `uq_id` (`u_id`,`q_id`),

KEY `q_id` (`q_id`),

Instead of creating an index on long CHAR/VARCHAR column, index just a prefix of the column to save space.

CREATE TABLE `table_name` (

`hostname` char(255) NOT NULL,

KEY `hostname` (`hostname`(10))

) ENGINE=InnoDB

Copyright Oracle Corporation 2012 62

Use EXPLAIN on every query that you think is too slow!

mysql> explain select t3.DateOfAction, t1.TransactionID

-> from t1 join t2 join t3

-> where t2.ID = t1.TransactionID and t3.ID = t2.GroupID

-> order by t3.DateOfAction, t1.TransactionID;+-------+--------+---------------+---------+---------+------------------+------+---------------------------------+

| table | type | possible_keys | key | key_len | ref | rows | Extra |

+-------+--------+---------------+---------+---------+------------------+------+---------------------------------+

| t1 | ALL | NULL | NULL | NULL | NULL | 11 | Using temporary; Using filesort |

| t2 | ref | ID | ID | 4 | t1.TransactionID | 13 | |

| t3 | eq_ref | PRIMARY | PRIMARY | 4 | t2.GroupID | 1 | |

+-------+--------+---------------+---------+---------+------------------+------+---------------------------------+

Types ALL and range signal a potential problem.

MySQL Index – Use Explain!

Copyright Oracle Corporation 2012 63

mysql> EXPLAIN SELECT C.Name , T.Name FROM world.City C INNER JOIN world.Country T ON C.CountryCode = T.Code;

+----+-------------+-------+------+---------------+-------------+---------+--------------+------+-------+

| id | select_type | table | type | possible_keys | key | key_len | ref | rows | Extra |

+----+-------------+-------+------+---------------+-------------+---------+--------------+------+-------+

| 1 | SIMPLE | T | ALL | PRIMARY | NULL | NULL | NULL | 264 | |

| 1 | SIMPLE | C | ref | CountryCode | CountryCode | 3 | world.T.Code | 8 | |

+----+-------------+-------+------+---------------+-------------+---------+--------------+------+-------+

MySQL Index – Use Explain!

Copyright Oracle Corporation 2012 64

More Urls for you to use later about Explain

http://dev.mysql.com/doc/refman/5.5/en/explain.html

http://effectivemysql.com/downloads/ExplainingTheMySQLEXPLAIN-OOW-2011.pdf

http://prajwal-tuladhar.net.np/2009/09/26/481/know-more-about-mysql-explain/

http://www.slideshare.net/ligaya/explain

MySQL Index – Use Explain!

Copyright Oracle Corporation 2012 65

The CREATE ROUTINE , ALTER ROUTINE , EXECUTE privilege is needed for stored routines.

mysql> delimiter //

mysql> CREATE PROCEDURE simpleproc (OUT param1 INT)

BEGIN

SELECT COUNT(*) INTO param1 FROM t;

END//

Query OK, 0 rows affected (0.00 sec)

mysql> delimiter ;

mysql> CALL simpleproc(@a);

Query OK, 0 rows affected (0.00 sec)

mysql> SELECT @a;

+------+

| @a |

+------+

| 3 |

+------+

1 row in set (0.00 sec)

MySQL Stored Routines

Copyright Oracle Corporation 2012 66

http://dev.mysql.com/doc/refman/5.5/en/stored-routines.html

CREATE TABLE test1(a1 INT);

CREATE TABLE test2(a2 INT);

CREATE TABLE test3(a3 INT NOT NULL AUTO_INCREMENT PRIMARY KEY);

CREATE TABLE test4(

a4 INT NOT NULL AUTO_INCREMENT PRIMARY KEY,

b4 INT DEFAULT 0

);

delimiter |

CREATE TRIGGER testref BEFORE INSERT ON test1

FOR EACH ROW BEGIN

INSERT INTO test2 SET a2 = NEW.a1;

DELETE FROM test3 WHERE a3 = NEW.a1;

UPDATE test4 SET b4 = b4 + 1 WHERE a4 = NEW.a1;

END; |

delimiter ;

MySQL Triggers

Copyright Oracle Corporation 2012 67

http://dev.mysql.com/doc/refman/5.5/en/create-trigger.html

mysql> INSERT INTO test3 (a3)

VALUES (NULL), (NULL), (NULL), (NULL), (NULL), (NULL), (NULL), (NULL), (NULL), (NULL);

Query OK, 10 rows affected (0.04 sec)

Records: 10 Duplicates: 0 Warnings: 0

mysql> INSERT INTO test4 (a4) VALUES (0), (0), (0), (0), (0), (0), (0), (0), (0), (0);

Query OK, 10 rows affected (0.01 sec)

Records: 10 Duplicates: 0 Warnings: 0

INSERT INTO test1 VALUES (1), (3), (1), (7), (1), (8), (4), (4);

Query OK, 8 rows affected (0.01 sec)

Records: 8 Duplicates: 0 Warnings: 0

## Warnings: 1

Statement is unsafe because it invokes a trigger or a stored function that inserts into an AUTO_INCREMENT column. Inserted values cannot be logged correctly.

set BINLOG_FORMAT = MIXED;

MySQL Triggers

Copyright Oracle Corporation 2012 68

http://dev.mysql.com/doc/refman/5.5/en/create-trigger.html

mysql> SELECT * FROM test1;

+------+

| a1 |

+------+

| 1 |

| 3 |

| 1 |

| 7 |

| 1 |

| 8 |

| 4 |

| 4 |

+------+

8 rows in set (0.00 sec)

MySQL Triggers

mysql> SELECT * FROM test3;

+----+

| a3 |

+----+

| 2 |

| 5 |

| 6 |

| 9 |

| 10 |

+----+

5 rows in set (0.00 sec)

mysql> SELECT * FROM test4;

+----+------+

| a4 | b4 |

+----+------+

| 1 | 3 |

| 2 | 0 |

| 3 | 1 |

| 4 | 2 |

| 5 | 0 |

| 6 | 0 |

| 7 | 1 |

| 8 | 1 |

| 9 | 0 |

| 10 | 0 |

+----+------+

10 rows in set (0.00 sec)

mysql> SELECT * FROM test2;

+------+

| a2 |

+------+

| 1 |

| 3 |

| 1 |

| 7 |

| 1 |

| 8 |

| 4 |

| 4 |

+------+

8 rows in set (0.00 s

Copyright Oracle Corporation 2012 69

http://dev.mysql.com/doc/refman/5.5/en/create-trigger.html

> CREATE VIEW `world`.`city_view` AS

SELECT C.Name as cityname , T.Name as countryname

FROM world.City C

INNER JOIN world.Country T ON C.CountryCode = T.Code;

Query OK, 0 rows affected (0.16 sec)

SELECT cityname , countryname from city_view where countryname = "Zimbabwe";

+--------------+-------------+

| cityname | countryname |

+--------------+-------------+

| Harare | Zimbabwe |

| Bulawayo | Zimbabwe |

| Chitungwiza | Zimbabwe |

| Mount Darwin | Zimbabwe |

| Mutare | Zimbabwe |

| Gweru | Zimbabwe |

+--------------+-------------+

6 rows in set (0.13 sec)

MySQL Views

Copyright Oracle Corporation 2012 70

http://dev.mysql.com/doc/refman/5.5/en/views.html

To disable autocommit mode, use the following statement: mysql> show variables like '%autocommit%';

+---------------+-------+

| Variable_name | Value |

+---------------+-------+

| autocommit | ON |

+---------------+-------+

1 row in set (0.00 sec)

mysql> SET autocommit=0;

Query OK, 0 rows affected (0.00 sec)

mysql> show variables like '%autocommit%';

+---------------+-------+

| Variable_name | Value |

+---------------+-------+

| autocommit | OFF |

+---------------+-------+

1 row in set (0.01 sec)

MySQL Transactions

Copyright Oracle Corporation 2012 71

http://dev.mysql.com/doc/refman/5.5/en/commit.html

To disable autocommit mode for a single series of statements

use the START TRANSACTION statement:

START TRANSACTION;SELECT @A:=SUM(salary) FROM table1 WHERE type=1;

UPDATE table2 SET summary=@A WHERE type=1;

COMMIT;

MySQL Transactions

Copyright Oracle Corporation 2012 72

http://dev.mysql.com/doc/refman/5.5/en/commit.html

• MySQL Editions

Session Agenda

Copyright Oracle Corporation 2012 73

Workbench – visual database design application that can be used to efficiently design, manage and document database schemata

Connectors – ODBC, Java, .Net, MXJ, C/C++, DBI, Ruby, Python, etc.

Community: -- http://dev.mysql.com/downloads/

Freely downloadable version of the world's most popular open source database. It is available under the GPL license and is supported by a huge and active community of open source developers.

Enterprise: -- eDelivery.com (Free for 30 days)Paid subscription includes support and the following

• MySQL Enterprise Backup

• MySQL Enterprise Security

– External Authentication

• MySQL Enterprise Scalability

– Thread Pool

• MySQL Enterprise High Availability

– Oracle VM Template

– Windows Clustering

• MySQL Enterprise Monitor

Free for 30 day evaluation

MySQL Versions

Copyright Oracle Corporation 2012 74

Choosing the version5.1 – previous GA version

5.5 – the latest GA version

5.6 – development release

Choosing the editionCommunity Edition (Community Server)

Enterprise Editions (even MySQL Classic and MySQL Standard)

Source or Binary

Download

MySQL

Highly configurable

Command line options

Configuration files (plain-text, INI-like files with groups)

Several configuration files (/etc, $HOME, …)

The last value takes precedence

Default configuration are examples and might be not so good for Performance, ...

MySQL Configuration

Copyright Oracle Corporation 2012 76

One example: SQL MODE

Very important variable

Affects data consistency!

It might be remembered …

… or it might be not

Thus: set it once for all

Recommended value:

STRICT_ALL_TABLES |NO_ZERO_DATE |NO_ZERO_IN_DATE |NO_ENGINE_SUBSTITUTION |NO_AUTO_CREATE_USER |IGNORE_SPACE |ERROR_FOR_DIVISION_BY_ZERO

Secure the installationDon’t run under ‘root’

Have separate directories (configuration, data, binary logs, …)

Change ‘root’ password

Remove default accounts

Post-installation steps: Security

MySQL

Copyright Oracle Corporation 2012 77

• Reach out to the community– Irc on freenode– Forums.mysql.com

• Oracle Support• Certifications

How can I get help ?MySQL Support

Copyright Oracle Corporation 2012 78Copyright Oracle Corporation 2012 78

• 24 X 7 Problem Resolution Services

• Unlimited Support Incidents• Knowledge Base• Maintenance Releases, Bug

fixes, Patches, Updates• MySQL Consultative Support• Staffed by experienced,

seasoned MySQL Engineers

Oracle Premier Support for MySQLMySQL Support

Most secure, scalable MySQL Database, Online Backup, Development/Monitoring Tools, backed by Oracle Premier Lifetime Support

Oracle Premier Support

Oracle Product Certifications/Integrations

MySQL Enterprise High Availability

MySQL Enterprise Security

MySQL Enterprise Scalability

MySQL Enterprise Backup

MySQL Enterprise Monitor/Query Analyzer

MySQL Workbench

MySQL Enterprise Edition

Copyright Oracle Corporation 2012 80

mysql.com TCO calculator: http://www.mysql.com/tcosavings/ White Papers: http://www.mysql.com/why-mysql/white-papers/ Customer use cases and success stories:

http://www.mysql.com/why-mysql/case-studies/

dev.mysql.com Downloads: http://dev.mysql.com/downloads/ Documentation: http://dev.mysql.com/doc/ Forums: http://forums.mysql.com/ PlanetMySQL: http://planet.mysql.com List of resources (books) : http://dev.mysql.com/resources/

MySQL Resources

eDelivery.com Download and evaluate all MySQL products

Wiki: https://wikis.oracle.com/display/mysql/Home

http://forge.mysql.com/wiki/Main_Page – Older Not used as much--

50 things to know before migrating Oracle to MySQLIt is a little old but worth the read

www.xaprb.com/blog/2009/03/13/50-things-to-know-before-migrating-oracle-to-mysql/

MySQL Resources

Copyright Oracle Corporation 2012 82

Copyright Oracle Corporation 2012 83

http://1.bp.blogspot.com/-WmD-U4CwYwc/TwJIc4qp_hI/AAAAAAAAADY/Bj2_8cQFXOw/s1600/First_things_first_.jpghttp://www.techcn.com.cn/index.php?doc-view-131262.htmlhttp://jeremylq.files.wordpress.com/2008/10/davidaxmark-larrysyacht-2005-08-15-l.jpghttp://blogs.oracle.com/barton808/entry/mysql_conf08_marten_mickos_tellshttp://www.bytebot.net/blog/archives/2008/04/14/mysql-community-dinner-a-great-successhttp://www.fayerwayer.com/2010/05/larry-ellison-critica-fuertemente-a-jonathan-schwartz/http://www.devside.net/server/webdeveloperhttp://www.curtoons.com/superman-logo/http://systems.takizo.com/2009/08/23/how-to-remove-mysql-binary-log/http://carlos.syr.edu/oracle-database-architecture/http://images-4.findicons.com/files/icons/977/rrze/720/database_mysql.pnghttp://bhaveshvala.wordpress.com/2009/09/15/mysqls-blackhole-storage-engine/http://www.erm.ecs.soton.ac.uk/theme3/managing_your_references.html

External Image Credits

Copyright Oracle Corporation 2012 84

<Insert Picture Here>

Thanks for attending!

[email protected]://sqlhjalp.com/pdf/MySQL_crashcourse_2012.pdf