mariadb und linux auf ibm power8

© MariaDB Corpora,on Ab

MariaDB und Linux auf IBM POWER8

Dr. Michael Perzl, Technical Sales IBM Power Systems

IBM Deutschland GmbH

Ralf Gebhardt, Sales Engineer MariaDB Corpora,on Ab

* * 17.02.15 1


Agenda

• Introduc,on • MariaDB for Power8 • Partner presenta,on: IBM, Linux auf POWER8 • MariaDB Services

17.02.15 2


MariaDB Corpora,on and MariaDB

• MariaDB Corpora,on, formerly SkySQL •  Strong team of MariaDB/MySQL experts •  Provides support and services for

MariaDB, MySQL and derived databases •  Strong Supporter of MariaDB Founda,on

• MariaDB •  Compa,ble with MySQL •  Superior replica,on and scalability for cloud •  Addresses Big Data and IoT needs •  MariaDB is becoming the leading database plaTorm for cloud •  MariaDB is adopted by key open source communi,es

17.02.15 3

mariadb.com


Serving over 500 Customers in 35 Countries

17.02.15 4

Finance Travel Retail

Telecom Technology & .gov/.edu Media


Internet is built on LAMP

• Linux – opera,ng system • Apache – web server • MySQL/MariaDB -‐ database • PHP/Python – scrip,ng language

17.02.15 5

+


The „Turbo LAMP Stack“

17.02.15 6


The open source community is switching from MySQL to MariaDB

17.02.15 7


Contribu,ng To MariaDB, Driving Enterprise Adop,on

17.02.15 8

Products and Subscrip0ons

24/7 Support

Technical Services

Engineering

Community

Enterprise Open Source Engagement

Awareness

Adop0on

Innova0on

</>


MariaDB Enterprise An Architecture Of Collabora,on

17.02.15 9

Partner Products

Availability

Management

Scalability

Backup

Applica0on

Storage Engines

Plug-Ins

Tools

Documentation

MaxScale Proxy

Connectors

MariaDB Enterprise

Community


MariaDB & IBM POWER8


Op,miza,ons + economic impact

• MariaDB op,mized for System z and POWER8

• Power8 -‐ Big + Li^le Endian architectures have been made part of the build system of MariaDB

17.02.15 11

•  Preliminary benchmarking results shows that MariaDB performance on POWER8 per core is 2.2x more than on x86!



• MariaDB built with “IBM’s Advance Toolchain for POWER8”

•  Be^er performances because libraries are op,mised for POWER8

• MariaDB makes full use of the 8 threads per core provided by POWER8

•  12 cores @4.5Ghz x 8 threads per core = 96 parallel processing threads

• Intel – only 2 threads per core 17.02.15 12



• Leveraging larger on-‐board memory, 8-‐way threading and scale up capabili,es of POWER8

• Lower opera,ng costs • fewer cores are required compared with other plaTorms

• reduced soiware and support costs • Improved scalability, reliability & security • Plus: reduced dependence on Oracle

17.02.15 13


Partner Presenta,on: IBM, Linux auf POWER8

© 2012 IBM Corporation © 2015 IBM Corporation

Dr. Michael Perzl Technical Sales Power Systems IBM Deutschland GmbH [email protected] MariaDB und Linux auf IBM Power8 Webcast, 11. Februar 2015

Linux on Power ist Linux recompiled

© 2015 IBM Corporation 16 Webcast MariaDB und Linux auf IBM POWER8, 11. Februar 2015

Agenda

§  POWER8 Technology §  OpenPOWER Foundation §  IBM Power Systems and Linux §  Considered migration scenarios §  Possible migration/compiling issues §  Optimizing for Power §  Summary

© 2015 IBM Corporation

POWER8 Technology


Cores • 12 cores (SMT8)

8 threads per core •  3.0 - 4.x GHz clock

rates • 8 dispatch, 10 issue,

16 exec pipe • 2× internal data flows/

queues • Enhanced prefetching • 64K data cache,

32K instruction cache Accelerators • Crypto & memory

expansion • Transactional Memory • VMM assist • Data Move /

VM Mobility

Caches • 512 KB SRAM L2 / core • 96 MB eDRAM shared L3 • Up to 128 MB eDRAM L4

(off-chip) Memory • Up to 230 GB/s sustained

bandwidth • 25% memory latency

improvement via on-chip fastpath interconnect

Bus Interfaces • Durable open memory

attach interface • Integrated PCIe Gen3 • SMP Interconnect • CAPI (Coherent

Accelerator Processor Interface)

Technology • 22nm SOI, eDRAM, 15 ML 650mm2

Energy Management • On-chip Power Management Micro-controller • Integrated Per-core VRM • Critical Path Monitors

POWER8 processor highlights – innova,on across the whole chip


POWER7

I/O Bridge

GX Bus

PCIe Gen2 PCI

Devices

PCIe Gen3

PCI Device

Na0ve PCIe Gen3 Support •  Direct Processor Integra,on •  Replaces proprietary GX/Bridge •  Low Latency •  Gen3 x16 Bandwidth (16 Gb/s)

POWER8

CAPI Accelerator

x8 x16

POWER8 integrates PCIe Gen3


FPGA

PowerPC Core

CA

PP PC

Ie

IBM Supplied PSL

Power Processor

Memory (Coherent)

•  Coherent AJached Processor Proxy (CAPP) –  Unit on processor that extends coherency to an a^ached

device –  On processor directory responds on behalf of off-‐chip

device (Filtering snoops)

•  Processor Service Layer (PSL) –  Present robust, durable interfaces to applica,ons –  Offload complexity / content from CAPP

•  Coherency protocol tunneled over standard PCIe –  Eliminates the need for special I/Os and protocol logic –  Reduces the complexity and bandwidth requirements of

the a^ached device

•  Enables aJached device to be a peer to the processor –  Simplifies programming model between applica,on –  Enables device to use same effec,ve address as

applica,on running in processor –  Eliminates the cumbersome I/O Device Driver

requirements

CAPI – an open invita,on to innovate on POWER


OpenPOWER Founda,on


The Founda,on

The goal of the OpenPOWER Foundation is to create an open ecosystem, using the POWER Architecture to share expertise, investment, and

server-class intellectual property to serve the evolving needs of customers.

Founding Members

Open ecosystem based on the IBM POWER Architecture.

Allows the industry to innovate across the full Hardware and Software stack.

Provide customers with the flexibility to build servers best suited to the Power architecture.


Welcoming new members in all areas of the ecosystem 100+ inquiries and numerous active dialogues underway

I/O / Storage / Acceleration

Chip / SoC

System / Software / Services

Implementation / HPC / Research

Huaxun Zhongxing Tech. Co.

89 members now

Boards / Systems


System Operating Environment Software Stack

A modern development environment is emerging based on tools and services

Cloud Software

Operating System / KVM

Standard Operating Environment

(System Mgmt)

Software

Power Open Source Software Stack Components

Existing Open Source

Software Communities

Firmware

Hardware

New OSS Community

OpenPOWER Technology

OpenPOWER Firmware

CAPP

PCIe

POWER8

CAPI over PCIe

“Standard POWER Products” – 2014

Hardw

are

“Custom POWER SoC” – Future

Customizable

Framework to Integrate System IP on Chip Industry IP License Model

Multiple Options to Design with POWER Technology within OpenPOWER

OpenPOWER Proposed Ecosystem Enablement


Non-‐IBM POWER8 products

http://www.enterprisetech.com/2014/04/28/inside-google-tyan-power8-server-boards/

The Tyan reference (ATX) board, measures 12”×9.6”

Ø  one single-chip module (SCM) Ø  four DDR3 memory slots Ø  four 6 Gb/sec SATA peripheral connectors Ø  two USB 3.0 ports Ø  two Gigabit Ethernet network interfaces Ø  keyboard and video Ø  intended for developers

The Google reference board Ø  two single-chip module (SCM) Ø  four modified SATA ports Ø  Google use only


TYAN's OpenPOWER Customer Reference System

http://www.tyan.com/campaign/openpower/


IBM Power Systems and Linux


Scal

e U

p

Scale Out

IBM Pureflex

Large SMP Power 795

Power E870

Power S824L

Power S824

Power S812L

Power S814 Power S822

Power S822L

Power 760 Power 750

Power E870 Power E870

Power E880

Infrastructure architectures: Scale up and Scale out


IBM Systems SoQware

S812L

10, 12 Cores 3.02 – 3.42 GHz

S822L

20, 24 Cores 3.02 – 3.42 GHz

Linux-‐only Machines (Entry-‐Level) IFL (High-‐End)

70 PVU-‐per-‐core for IBM SW for any Core running Linux

S824L

20, 24 Cores 3.02 – 3.42 GHz (1-‐2 NVidia GPU)

Power E870

32 to 80 Cores 4.02 -‐ 4.19 GHz

Power E880

64 cores 4.35 GHz

IBM POWER8 Systems Family on Linux (1Q2015)


Endianness – why do I care about it?

§  Linux on Power has chosen to exploit little endian (LE) processor mode based on OpenPOWER partner feedback instead of big endian (BE).

–  Eases the migration of applications from Linux on x86.

–  Enables simple data migration from Linux on x86.

12

12 34 56 78

34 56 78 Register

n+3 n+2 n+1

n

Memory

12

78 56 34 12

34 56 78 Register

n+3 n+2 n+1 n

Memory Big endian Little endian

–  Simplifies data sharing (interoperability) with Linux on x86. –  Improves Power I/O offerings with modern I/O adapters and devices, e.g. GPUs.

§  Creation of an LE operating system for Linux on Power means creating a whole new software “platform” (ppc64le) (in addition to BE ppc (32-bit) and BE ppc64 (64-bit)).

§  LE distributions for Linux on Power does NOT mean x86 applications magically run: applications must still be compiled for Power.

§  Power8 CPU can be either big or little endian è mixed endianness (big and little) on same system is possible.


§  RHEL 7 (BE) l  POWER8 (native mode) and

POWER 7/7+

§  RHEL 6 (BE) •  POWER8 supported with U5

(P7-compatibility mode) •  Full support of POWER6 and

POWER7 (native mode)

§  Fedora (LE + BE) •  Fedora 16 was first release to

re-launch POWER •  Fedora 20 has POWER8

support •  Fedora 21 has LE and BE

support

n  Supported add-ons •  JBoss •  High Performance Network Add-

on

Ø  Built from the same source as x86 Ø  Delivered on the same schedule as x86 Ø  Supported at the same time as x86

§  SLES 12 (LE) •  POWER8 (native mode) and

POWER 7/7+ §  SLES 11 (BE)

l  POWER8 with SP3 (P7-compatibility mode)

l  POWER7+ encryption, RNG accelerators with SP3

l  Full support of POWER7 (native mode)

§  openSUSE (LE + BE) •  openSUSE 12.2 re-launched for

IBM POWER •  openSUSE 13.2 includes

POWER8 support

n  Supported add-ons •  SUSE Linux Enterprise High

Availability Extension

§  Ubuntu 14.10 (LE) §  POWER8 (native mode)

§  Ubuntu 14.04 (LE) l  POWER8 enabled (native

mode) l  No official support for

POWER7+ and older systems l  No support for 32-bit

applications. 64-bit only. l  Supported in KVM only at this

time

§  Supported add-ons •  JuJu Charms •  MaaS (Metal as a Service) •  Landscape

§  Debian (LE + BE) •  Debian community now

supports Power as of Sid release

Linux support for POWER


POWER8 endianness and OS choices

§  POWER8 CPU can run big or little endian code –  determined by value stored in MSR register

§  Mixed endianness (big and little) on same system possible

Little endian 64-bit (ppc64le, ppc64el) §  Ubuntu 14.04 / 14.10 §  RHEL >= 7.1 §  SLES 12.X

§  Fedora >= 21 §  Debian 7.X §  openSUSE >= 13.2

Big endian (ppc, ppc64) §  AIX / VIOS / IBM i §  RHEL 6.X / RHEL <= 7.1 §  SLES 11.X

§  Fedora <= 21 §  Debian 7.X §  openSUSE <= 13.2


PowerVM

BE BE BE April 2014

PowerKVM

BE BE BE

PowerKVM

LE LE LE

PowerVM

BE LE BE Strategic outlook

2015 PowerKVM

LE BE LE

Transition to strategic state may involve multiple interim steps as product testing completes.

PowerVM

BE BE 4Q 2014

PowerKVM

LE BE LE BE

Hypervisor support for endianness


Considered migra,on scenarios


Script languages and interpreted languages

§  All script languages and interpreted languages should be platform-independent once they are compiled for the particular platform.

§  Also compiled code should be platform-independent (e.g., Perl, Python etc.). §  Examples include:

–  Perl –  Python –  PHP –  Ruby –  Lua –  Tcl –  etc.


Java migra,ons

§  Java compiled byte-code is platform-independent and thus portable across different platform if the Java specification has been adhered to, i.e., no APIs/syscalls beyond the specification have been used.

§  For PowerLinux the Java JVM options are: –  IBM JVM –  OpenJDK

§  For Linux/x86 multiple different JVMs are available. §  Differences in behavior between the IBM JVM and the Oracle JVM exist.

§  Problems in migrating Java code typically arise only if Java extensions were

used that are not part of the standard Java specification: –  For instance, lots of security-relevant Java code differs between JVMs of different

vendors.

§  For the remainder only C/C++ code now considered!


Considered migra,on scenarios C/C++ (1/2)

Other Linux RHEL, SLES, or Ubuntu (not RHEL, SLES, Ubuntu) RHEL RHEL

SLES SLES

Ubuntu Ubuntu


Considered migra,on scenarios C/C++ (2/2)

Not considered here: §  Changing the address space for the application, i.e.,

converting it from a 32-bit to a 64-bit application –  Might be required if porting 32-bit application to 64-bit only

like Ubuntu (ppc64le) §  A 32-bit Linux/Intel application can always be recompiled

as a 32-bit Linux/Power application, no need to change anything here!

–  The exception is new ppc64le platform (e.g., Ubuntu) §  Converting a 32-bit application to 64-bit address space

can present a big challenge depending on the code quality!

§  Please see the redbook “AIX5L Porting Guide“ for details:


Possible migra,on/compiling issues


Dealing with endianness

Sources of endianness problems: §  Nonuniform data referencing

–  It is often featured by data type mismatches resulting from either data element casting, use of a union data structure, or the use and manipulation of bit fields.

§  Sharing data across platforms –  For example, a big-endian system retrieves database data stored by a little-endian

system.

§  Exchanging of data between devices of different endianness and devices on a network

–  For example, AIX on Power systems uses the big-endian model, but the PCI bus uses the little-endian model.

–  TCP/IP protocols requires data to be sent in network byte order, which is the big-endian model.


IBM Soiware Development Kit for Linux on Power

§  The IBM Software Development Kit for Linux on Power (SDK) is a free, Eclipse-based Integrated Development Environment (IDE) and integrates

–  C/C++ source development with the Advance Toolchain –  Post-Link Optimization –  classic Linux performance analysis tools, including oprofile, perf and valgrind

The IBM SDK for Linux on Power package includes: §  IBM Advance Toolchain for Linux on Power integration, Versions 7.0-5, 7.1-0,

and 8.0-0 §  IBM SDK for Linux on Power, Version 1.6.1 §  Feedback Directed Program Restructuring (FDPR), Version 5.6.2-6c §  Pthread Monitoring tool for Linux on Power (pthread-mon), Version 0.5.10-1 §  IBM SDK Java Technology Edition Version 7.1 §  IBM POWER8 Functional Simulator


IBM Soiware Development Kit for Linux on Power

§  The IBM Software Development Kit for PowerLinux includes a Migration Advisor to help in moving Linux applications from x86 systems to Power systems.

§  The advisor uses the Eclipse C/C++ Development Tools code analysis tool. §  The code analysis tool locates potential migration problems within a project,

such as source code that might produce different results when run on Power systems.

§  It contains several checkers that look for code in the project that might produce a different result in Power systems.

§  Warnings are displayed showing the kind of problem found.


Linux/x86 to Linux on Power applica,on migra,on

Linux on Power Migration Advisor checkers: §  x86-specific compiler built-in checker §  x86-specific assembly checker §  Struct with bitfields checker §  Cast with endianness issues checker §  Union with endianness issues checker §  Long double usage checker §  Performance degradation checker §  System call not available for PowerLinux checker §  Linux/x86-specific API checker §  Hardware Transaction Memory checker §  Non-portable Pthreads implementation checker


Op,mizing for Linux on Power


GCC versions for RHEL, SLES and Ubuntu

Facts: §  Linux distributors select a base GCC version as their “default“ version. §  During the lifetime of that Linux enterprise distribution version they typically

stick with that specific GCC version. §  Unfortunately, GCC development keeps going at a fast pace. §  Newer GCC technology and features mostly only available with latest version

of GCC. §  Selective new GCC features and bug fixes from the current GCC development

version are being backported to their base GCC versions.

Consequence: §  Best exploitation of newest Power systems not always guaranteed with older

GCC versions!


GCC versions that come with RHEL, SLES and Ubuntu

Red Hat Enterprise Linux

§  RHEL 6 – gcc-4.4.4-13.el6.ppc64.rpm

§  RHEL 6 Update 1 – gcc-4.4.5-6.el6.ppc64.rpm






§  RHEL 7 – gcc-4.8.2-16.el7.ppc64.rpm

SUSE Linux Enterprise Server

§  SLES 11 – gcc-4.3-62.198.ppc64.rpm

§  SLES 11 Service Pack 1 – gcc-4.3-62.198.ppc64.rpm



§  SLES 12 – gcc-4.8-6.189.ppc64le.rpm

Ubuntu §  14.04

– gcc-4.8_4.8.2-19ubuntu1_ppc64el.deb

§  14.10 – gcc-4.9_4.9.1-16ubuntu6_ppc64el.deb


IBM Advance Toolchain for PowerLinux

URLs: §  PowerLinux Community wiki §  IBM Advance Toolchain for PowerLinux Documentation §  Improving performance with IBM Advance Toolchain for PowerLinux

Description: §  The IBM Advance Toolchain for PowerLinuxTM provides early and easy access

to libraries and the latest compiler technologies for Linux distributions. §  Over time, these libraries and latest compiler technologies are integrated into

the shipping distributions. §  However, the IBM Advance Toolchain for PowerLinux contains the latest tested

and supported GNU Compiler Collection (GCC) compiler versions, tailored for Power systems, and packaged together with an expanding set of processor-tuned libraries, allowing you to take advantage of the latest technology without waiting..


The value of the IBM Advance Toolchain

RHEL 6.X GCC version

V4.4.[4-7]

Ubuntu 14.04 GCC version V4.8.2

IBM Advance Toolchain GCC version V4.9.2

RHEL 7.X GCC version

V4.8.2 SLES 12.X

GCC version V4.8

SLES 11.X GCC version V4.3

Ubuntu 14.10 GCC version V4.9.1


Summary


Summary

§  Source code based on script languages should be no problem / easy to port. §  Recompiling C/C++ source code from Linux/Intel on Linux/Power is pretty

straight forward. §  Portability issues typically arise only with regards to

–  endianness (Linux is little endian, Power used to be big endian only). –  using x86-specific

•  APIs. •  assembly code. •  compiler built-ins.

§  The Migration Advisor as part of the Linux on Power SDK can assist in identifying possible migration issues.

§  The majority of commonly used open source code is pretty portable across different platforms, more problems could be expected with custom code that has only been running on one platform (Intel).


§ Technische Workshops zu aktuellen Themen

§ Unterstützung bei Portierung, Design, Test Ihrer Anwendung, z.B. •  Linux on Power Portierungen •  MariaDB auf POWER8 Tests

§ Zugang zu neuester IBM HW und SW vor Ort und Remote

§  IIC Services sind kostenlos

§ Beantragung der Services unter ibm.com/partnerworld/iic/ehningen

§ Ansprechpartner vor Ort: Beate Melcher [email protected] 07034-274-1911 oder 0160-93986778

IBM Innova,on Center (IIC): Unterstützung für Ihre Kundensitua,on

Das IBM Innovation Center in Ehningen ist eines von über 40 weltweit


MariaDB Services

MariaDB Enterprise: Integra,ng the Complete Solu,on

MariaDB Enterprise

24/7 Support,TechnicalServices

Partner Products

Enterprise Products

MariaDB Enterprise: Choose From Two Product Subscrip,ons

MariaDB Enterprise Everything you need: a packaged, enterprise RDBMS product based on the popular MariaDB open source project, along with robust technical services and support.

MariaDB Enterprise Cluster A highly available database cluster product that combines MariaDB with advanced, multi-master clustering, along with expert support for demanding production applications.


MariaDB Enterprise Subscrip,on Offers

17.02.15 55

MariaDB Enterprise MariaDB Enterprise Cluster

Summary Powerful enterprise data management. Highly available database cluster for the most demanding use cases.

Supported Database PlaYorms

●  MariaDB (Included) ●  MySQL

●  MariaDB Galera Cluster (Included) ●  MySQL + Galera

Comprehensive Benefits: ●  30 min. support response ●  Unlimited incidents ●  Updates and bug fixes ●  Security patches ●  Advice, hot-‐fixes ●  Installa0on, configura0on help ●  Email, web, remote login ●  Exclusive content ●  Roadmaps ●  Op0onal enterprise products ●  Op0onal services including

Remote DBA, Consul0ng, Training, Custom Development

✔ ✔

Included Third-‐party Products

●  Monitoring: MONyog ●  Query Editor: SQLyog ●  Backup: XtraBackup, Zmanda Backup

●  Cluster Deployment, Management & Monitoring : SeveralNines ClusterControl

●  Monitoring: MONyog ●  Query Editor: SQLyog ●  Backup: XtraBackup, Zmanda Backup

●  Whitepapersmariadb.com/resources/guides-whitepapers

○  IBM Power Systems solution for MariaDB

○  Best Practices IBM Power Systems Solution for MariaDB

○  Turbo LAMP Whitepaper

●  Turbo LAMP informationwww.ibm.com/developerworks/community/groups/community/turbolamp

MariaDB Resources

●  MariaDB Portal ○  https://mariadb.com/resources/mariadb-portal

●  MariaDB Enterprise ○  mariadb.com/products/mariadb-enterprise

●  MariaDB Enterprise Cluster ○  mariadb.com/products/mariadb-enterprise-cluster

●  Guides and White Papers ○  mariadb.com/resources/guides-whitepapers

●  Downloads ○  https://mariadb.com/resources/downloads

●  Contact Us ○  mariadb.com/about/contact

MariaDB Resources

●  Webseminar: Spider Speicher-Engine25. Februar

●  CeBIT: Open-Source-Park, Halle 6, Stand 412Hannover, 16. – 20. März

●  MariaDB Roadshow mit IBM: ○  Düsseldorf: 16. April ○  München: 20. April ○  Wien: 22. April ○  Zürich: 29. April

●  Einzelheiten und Anmeldung:https://mariadb.com/news-events

Veranstaltungshinweise


Ques,ons?

www.mariadb.com

[email protected] [email protected]

mariadb und linux auf ibm power8

Software

mariadb mariadb corpora

ab mariadb corpora

cloud mariadb

mariadb compa

mariadb performance

ab mariadb enterprise

media mariadb corpora

sales engineer mariadb