exploring the open source linux ecosystem
TRANSCRIPT
IBM OS CONIBM IBM OS CON
Case studies
in success:
July 23, 2015IBM
Exploiting the open source Linux ecosystem
to drive rapid innovation and higher value
Troy Peterson
Technical Solutions Architect
IBM Systems Group
[email protected]@troypeteoss
IBM OS CON
Agenda
27/22/2015
Why Linux on POWER?
Why Little Endian POWER?
Open Source is a Foundation
A quick word on Virtualization on POWER 8
Beyond the Distribution – Open Source Software for POWER 8 LE
Building solutions on POWER 8
Embracing the broader open source communities
How to get started on POWER8
IBM OS CONIBM IBM OS CON 7/22/2015 3
Open and
Collaborative
Ecosystem
An open server ecosystem delivering continuous innovation
Consumable for hyperscaledatacenters
Growing Linux Ecosystem
An open technology
platform Built with Linux portability,
OpenStack and KVM
Designed with Open Source
Technologies
POWER8: An Open Innovation Platform
IBM OS CONIBM IBM OS CON
Processors
flexible, fast execution
of analytics algorithms
Memory
large, fast workspace to
maximize business
insight
Cache
ensure continuous data
load for fast responses
4Xthreads per core vs. x86
(up to 1536 threads per
system)
4Xmemory bandwidth vs. x86
(up to 16TB of memory)
5Xmore cache vs. x86
(up to 224MB cache per
socket)
Power Systems with POWER8, are built with open innovation to
accelerate big data insights and hybrid cloud deployment
Flash for extreme performance
Massive IO bandwidth
Continuous data load
Parallel
processing
Large-scale
memory processing
4
IBM OS CONIBM IBM OS CON
Up to TWICE the performance per core across key workloadscompared to the top 5 Intel vendors
0
100
200
300
400
500
600
700
800
900
1000
ERP – SAP 2-Tier (Users)
1.9x Performance
0
10
20
30
40
50
60
70
80
POWER S824
2s/24c/192t
IBM POWER8
Dell
PowerEdge
T620
2s/36c/72t
Intel Xeon
Haswell
SPECint_rate2006
1.8x Performance
0
10
20
30
40
50
60
SPECfp_rate2006
2.1x Performance
1) Results are based on best published results on Xeon E5-2697 v2 and E5-2699 v3 from the top 5 Intel system vendors (HP, Oracle, IBM, Dell, Fujitsu).
2) Dell PowerEdge R730, on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 2 processors/36 cores/72 threads, Intel Xeon Processor 2699v3; 2.30 GHz, 256 GB memory;
16,500 SD benchmark users, running RHEL 7 and SAP ASE 16; Certification # 2014033. Source: http://www.sap.com/benchmark.
3) IBM Power System S824 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 4 processors / 24 cores / 96 threads, POWER8; 3.52GHz, 512 GB memory, 21,212 SD
benchmark users, running AIX® 7.1 and DB2® 10.5, Certification # 2014016. Source: http://www.sap.com/benchmark All results valid as of October 3, 2014
4) SPECjbb2013 results are valid as of 11/19/2014 For more information go to http://www.specbench.org/jEnterprise2010/results/
5) SPECcpu2006 results are submitted as of 9/8/2014. For more information go to http://www.specbench.org/cpu2006/results/
AIX LoP (RHEL)
POWER S824
2s/24c/192t
IBM POWER8
AIX LoP (RHEL)
Nearly Equal
Performance
with both
AIX and LINUX
on POWER8
Nearly Equal
Performance
with both
AIX and LINUX
on POWER8
Dell
PowerEdge
T620
2s/36c/72t
Intel Xeon
Haswell
IBM S824
POWER8
AIX / DB2
4p/24c/192t
Dell PowerEdge R730
E5-2699 v3
RHEL / SAP ASE
2p/36c/72t
Intel Xeon Haswell
0
50000
100000
150000
200000
250000
300000
350000
400000
POWER S824
2s/24c/192t
IBM POWER8
Lenovo IBM Flex240 M5
2s/36c/72t
Intel Xeon Haswell
Java – SPECjbb2013 (Max-jOPS)
2.2x Performance
5
IBM OS CONIBM IBM OS CON
Power S822L
versus
Haswell EP
Linux on Intel
Haswell EP
with VMware
VersusLinux on POWER8
with PowerVM
Dell PowerEdge
R730HP ProLiant
DL380 G9
IBM Power
S822L
97330 SAPS 97330 SAPS 99008 SAPS
Server list price*-3-year 24x7 warranty, on-site
$24,783 $26,606 $25,555 $33,136
Virtualization
- OTC + 3yr. 24x7 sub./supp.
$9,356
VMware vSphere
Enterprise 5.5
$9,356
VMware vSphere
Enterprise 5.5
$9,356
VMware vSphere
Enterprise 5.5
$10,450
PowerVM for IBM
PowerLinux
Linux OS list price
- RHEL, 2 sockets, unlimited guests,
24x7, 3 yr. premium sub./ supp.
$9,259
Red Hat subscription
and Red Hat support
$9,259
Red Hat subscription
and Red Hat support
$9,259
Red Hat subscription
and Red Hat support
$6,895
Red Hat subscription
and IBM support
Total list price/server: $43,398 $45,221 $44,170 $51,109
Quantity 3 3 3 2
Total list price $130,194 $135,663 $132,510 $102,218
* Based on US pricing for Power S822L matching configuration s on following page. Source: lenovo.com , hp.com, dell.com, vmware.com. Configuration details in speaker notes
Lenovo
x3650 M5
97330 SAPS
$130,194 $135,663 $132,510 $102,218
Total Cost of Acquisition Linux on Power ($US) vs. Haswell EP
6
IBM OS CONIBM IBM OS CON
IBM Power has superior Reliability Availability Serviceability
Power delivers higher RAS
• Redundant components
• Autonomic computing
• Advanced Error detection
and fault isolation
Resulting in:
• Fewer failures
• Quicker repairs
• Lower operational costs
7
IBM OS CONIBM IBM OS CON 8
Power 8 Support Little Endian
Same as Intel Byte Order
Makes application ports trivial
PPC64 Little Endian distro from most major providers
•Ubuntu
•RHEL
•SLES
Full support for KVM
PowerKVM guests can be either Big Endian or Little Endian
Data can be easily exchanged with other LE systems
IBM OS CONIBM IBM OS CON
Most x86/Linux applications written in C/C++ will require no source code change, only a recompile2
Moving Linux apps to Power has never been easier
Well-written Java applications
written in scripting or interpretive
languages will run as is1
95%Require no source code change
+
1. Interpretive languages include PHP, Python, Perl, Ruby, Java, etc. Assumes 8 hours of dedicated time and prior experience with the application code and its
dependencies (e.g. language, libraries, web application, database) and that dependencies already ported and installed. Assumes no platform or device specific
dependencies.
2. Includes C/C++ and other compiled languages. Assumes 16 hours of dedicated time and prior experience with the application code and its dependencies (e.g.
language, libraries, web application, database) and that dependencies already ported and installed. Assumes no platform or device specific dependencies.
9
Fostering open innovation with Linux and POWER Systems
IBM OS CONIBM IBM OS CON 10
Virtualization on Linux on POWER
•Legacy Virtualization ManagerPowerVM
•Linux + KVM, Shipped with POWER8PowerKVM
•Industry standard KVM – same as for any architecture or cihpsetKVM
•Containers
•Docker infrastructureDocker
•Cloud Stack, Virtualization management, Guest VMs and Docker containersOpenStack
•Open Source Platform as a Serivce (PaaS) SolutionCloud Foundry
•IBM Open Cloud Architecture based on Cloud Foundry, including easy access to a broad ecosystem of servicesBluemix
OpenPOWER promotes collaboration at all levels
IBM OS CONIBM IBM OS CON
Robust solutions from IBM, ISVs & the Open Source Community
Software Solutions
POWER ISVs
Linux Open Source
WebSphere Application Server
Powered by
Linux Distributors
We have over 1400
ISVs deployed on
Linux on Power ….
12
IBM OS CONIBM IBM OS CON
Big Data
& Analytics
Cloud
Managemnt
Stack
DatabasesDev. Env
/Tools
Other
HA,
Security
etc.
Technical
Computing
Available:Backbone, Bootstrap, Docker , Eigen libErlang, Ganglia, GCC, GDB, Jenkins, Jruby, keepalived, LLVM, Lucene, Maven, Nagios, NGINX, node.jsOpenJDK, PHP, phpMyAdmin, Perl, Python, Python-Django, Python-Pip ecosystem, R/R, rsyslog, Ruby, Ruby on Rails (rbenv), Ruby Gems, scala, snappy,Socket.io (npmjs)SystemTap, Vagrant, V8, wireshark,
Port In Progress:GoLang, gccgoPubsub.io (3Q)Logstash
Available:Accumulo (column), CassandraCouchDB (document)DerbyMariaDB (v10 optimized)
Memcached (KVS)MongoDB (document)MySQLPostgreSQLRabbitMQRedis (KVS)SQLiteVirtuoso (graph)
Port In Progress:Voldemort (KVS)Neo4J (graph)
Available:
Hadoop Core,
Hive, HBase,
Accumolo,
Ambari, Avro,
Falcon, Flume,
Hue, Knox,
Lucene-Solr,
Mahout, Oozie,
Parquet, Phoenix
Pig, Sqoop, Storm
Tez, Zookeeper
Port In Progress:
Spark
Available:Apache Web ServerApache tomcatCeph, Chef serverJuju & Juju guiLandscape clientMAAS, OpenStackPuppetApache QpidThrift
Port In Progress:Ceilometer client
Available:BTRFSBootstrapChroma-keyCluster GlueDRBDEvolution data svrHAProxyHeartbeatkeepalivedLdirectordOpenSSLPacemakersambaTophatWordPress
Port In Progress:
Available:
ALLPATH-LG, Bedtools,
bfast, BioConductor,
BioConductor-base,
BLAST, BOOST, Bowtie,
Bowtie2, BWA, bzip2,
Cufflinks - 2.2.1, FASTA,
FastQC, HMMER, HTSeq,
LibGD(partial), libpng,
Mothur, nose, NumPy,
OpenSSL, PICARD, PLINK,
Python, SAMTools,
SAMTools 1.0, SeqAn,
setuptools(Python),
SHRiMP,
SOAP3-DP, SOAPDenovo
tabix, TopHat, Trinity,
Velvet/Oases, Zlib
ABySS, Balsa,
Bioconductor, GMP,
GROMACS, NAMD, spice,
Quantum Espresso
Port in Progress:
IGV, iRODS, RNAStar,
ISAAC, SOAPAligner
Available: Open source application is ported and
available on distro (Ubuntu or RHEL or SLES)
(black), in community (purple), Lab7 (green) or
Veristorm (orange). Does not mean it is optimized.
Does not mean that a commercial ISV version is
available.
Evaluating: Needs to be vetted in new business
development prioritization process. Some of these
are available codes that need optimization to be
competitive with x86.
13
Expanding the Open Source Ecosystem (1)
IBM OS CONIBM IBM OS CON
Big Data
& Analytics
Cloud
Managemnt
Stack
DatabasesDev. Env
/Tools
Other
HA,
Security
etc.
Technical
Computing
Optimizing:
Evaluating:OpenJDK - optimizePHP - optimizePython - optimizeRuby - optimize
Optimizing:MongoDB (1Q)PostgresSQL (1.86x)Redis (1Q - Surelock)
Evaluating:Couchbase (noSQL)InfiniSQLMarkLogic(document,
ISV)
Riak (KVS)OrientDB
Optimizing:Hadoop (1Q15)
Evaluating:ClusterpointElasticSearch
Optimizing:
Evaluating:BigFix (ISV)MesosTosca Heat
Optimizing:
Evaluating:CentOS (RHEL depend)Cluster-NetworkCoreOS (distro)MondoRescueOpen Identity Stack (forgerock.com)
Optimizing:
NAMD, GROMACS, ABYSS
Evaluating:
CP2K, HOOMD, Milc,
miRdeep2, Galaxy, GATK,
Terachem (ISV), ucsctools,
ViennaRNA,
AMBER14 (plan 2015)
14
Expanding the Open Source Ecosystem (2)
Available: Open source application is ported and
available on distro (Ubuntu or RHEL or SLES)
(black), in community (purple), Lab7 (green) or
Veristorm (orange). Does not mean it is optimized.
Does not mean that a commercial ISV version is
available.
Evaluating: Needs to be vetted in new business
development prioritization process. Some of these
are available codes that need optimization to be
competitive with x86.
IBM OS CONIBM IBM OS CON
Up to 2.2x better per core performance
Up to 1.9x better per system performance
S822L – 10 core POWER8, 3.42 GHz vs.
x3650 M4 – 12 core Ivy Bridge, 2.7 GHz
* Source: http://blog.jelastic.com/2014/08/28/software-stacks-market-share-july-2014/
MariaDB Business Description• Provider and main contributor for MariaDB RDBMS which
is considered an enhanced, drop-in replacement for MySQL• Founded by the team that created MySQL. MariaDB is the
2nd most popular open source DB after MySQL (13%)*
Final results and more information on solution configuration:IBM Power Systems Solution for MariaDB whitepaper link
IBM Power S822L vs. IBM x3650 M4 – per core(Both running Ubuntu as KVM guest – Sysbench benchmark)
Read-
only
Read-
WriteTra
nsacti
on
/
seco
nd
/ c
ore
Read-
only
Read-
Write
Tra
nsacti
on
/
seco
nd
/ s
yste
m
IBM Power S822L vs. IBM x3650 M4 - per system(Both running Ubuntu as KVM guest – Sysbench benchmark)
2.2x
2.1xCore – Core
1.7x
1.9x System – System
Read-
only
Read-
Write
Read-
only
Read-
Write
IBM worked with MariaDB to optimize on Linux on Power
15
IBM OS CONIBM IBM OS CON
Turbo LAMP: LAMP Stack for today’s demanding workloads
PowerKVM
High Speed Data Transfer (Mellanox)
Linux (RHEL or Ubuntu)
Apache Web Server (Zend) MariaDB
PHP (Zend)
Turb
o L
AM
P
Turbo LAMP White Paper: https://www.ibm.com/developerworks/community/groups/community/turbolamp
Orc
he
str
atio
n -
Ju
ju
(Ub
un
tu)
16
IBM OS CONIBM IBM OS CON 17
No-Cost Access to Linux on Power for IBM Partners and
Open Source Developers
• Power Development Cloud
• IBM Innovation Center
• OSU Open Source Lab
Fee Based and Sponsored Access
• Site Ox
• OVH
• IBM Center Express
• IBM Client Centers
• IBM Lease and Discount Program
Accessing Linux on POWER8 Hardware
https://ibm.biz/LoP_Access
IBM OS CONIBM IBM OS CON
15+ Years of
Collaboration on
Open Source+
20071999 2007 2011 2011 2012 20132001 20132000
400+ software products
500patents donated
600+developers
18
IBM: Industry-leading collaboration on open technology
July 20th 2015
IBM is a founding
member of
Cloud Native
Computing
Foundation
New
Visit IBM at booth #501
to talk to an IBM
Recruiter @ OSCON
IBM OS CONIBM IBM OS CON
Thank You!
Troy Peterson
Technical Solutions Architect
IBM Systems Group
@troypeteoss
IBM OS CON
Backup
IBM OS CONIBM IBM OS CON
Linux support for IBM Power Systems
RHEL 7.1 (BE and LE) POWER8 (native mode)
and POWER 7/7+ LE is 64-bit only – P8 only Available March 2015
RHEL 6 • POWER8 supported with U5
(P7-compatibility mode)• Full support of POWER6
and POWER7 (native mode)
Fedora• Fedora 16 was first release
to re-launch POWER• Fedora 20 has POWER8
support
Supported add-ons• JBoss• High Performance Network
Add-on
SLES 12 (LE) POWER8 (native mode, LE) LE is 64-bit only – P8 only Available October 2014
SLES 11 (BE) Selected POWER8 with SP4 SP3 = P7-compatibility POWER7+ encryption, RNG
accelerators with SP3 Full support of POWER7
(native mode)
openSUSE• openSUSE 12.2 re-
launched for IBM POWER• openSUSE 13.2 includes
POWER8 support
Supported add-ons• SUSE Linux Enterprise High
Availability Extension
Ubuntu 14.04 LTS (LE) POWER8 (native mode, LE) LE is 64-bit only – P8 only Available Apr 2014.
Updated regularly
Ubuntu 14.10 and 15.04 (LE) S824L GPU enablement Rapid introduction of new
technologies Available Oct 2014 / Apr
2015
Supported add-ons• JuJu Charms• MaaS (Metal as a Service)• Landscape
Debian• Debian community now
supports Power
Built from the same source as x86 in mainline communities. Delivered on the same schedule as x86 by the Linux vendors themselves.
Supported at the same time as x86 from the vendors and IBM. Over time, LE distros are expected to be supported PowerVM LPARs, PowerKVM guests, bare-metal
22
IBM OS CONIBM IBM OS CON 23
Linux on Power Distribution Roadmap Today
20092006 2007 2008 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019
Standard Release Support Extended Release Support Self-support Release/update
See for more details:Red Hat lifecycle information - https://access.redhat.com/support/policy/updates/errata/SUSE lifecycle information – http://support.novell.com/inc/lifecycle/linux.htm/ l Ubuntu lifecycle information - https://wiki.ubuntu.com/Releases
SLES 10 (7/06)
RHEL 5 (3/07)
RHEL 7 (06/14)
SLES 12 LE (10/14)
15.04 LE (04/15)
14.04 LE LTS (04/14)
15.10 LE (10/15)
14.10 LE (10/14)
16.04 LE LTS (04/16)
RHEL 6 (11/10)
SLES 11 (3/09)
Information concerning SUSE Linux Enterprise Server was obtained from SUSE.
Information concerning Red Hat Enterprise Linux was obtained from Red Hat.