vt445-1: linux on power8 trends and directions mitec june 2016 smith/linuxonpowertrends2016 .pdf ·...

© Copyright IBM Corporation 2016.

VT445-1:Linux on POWER8Trends and Directions

Tracy SmithStrategic InitiativesClient Technical ExecutiveIBM - [email protected]

MITEC June 2016

© 2016 IBM Corporation

Welcome to the waitless world

2

New Enterprise value is coming from the use of IT to engage clients & leverages the confluence of 5 important technology trends



3

Enterprise value is rapidly changing. Computing continues to evolve from Data Center systems and Databases.

Cross Platform Operating System of choice: Linux

Operating Systems:Unix/AIX, IBM i, z/OS, MVS, VM, Windows

Windows, iOS, Linux



4Source: IDC Forecast

Linux servers will account for 38% of all server revenue - Windows servers will be 50% by 2019Linux is growing at 8% while Windows is growing at only 3% a year through 2019

CGR

3%

8%

Unix

38%

50%

Share2019

8%CGR



5

Topics

The Linux on POWER strategies Software: Standardize around open source Hardware: Disrupt the industry with open innovation

The Linux distributions RedHat RHEL, Canonical Ubuntu, SUSE SLES, CentOS

IBM’s Power Systems KVM on Power Docker on Power Accelerators on Power – FPGA, GPUs



6

Linux on Power Strategy - Same Linux Experience, Better Results

Ecosystem

• OpenSource and ISV support • Little endian base - OpenStack API support• The Three Major Linux Distros • OpenPOWER Foundation• Digital purchasing enabled from IBM

Linux is a common base

Value add Infrastructure

Supported by Canonical

• Comprehensive Portfolio• Price/performance advantaged Linux only offerings• POWER8 Processor built for data• CAPI technology• OpenPOWER Community Innovation

Solutions Differentiated for Client Value

• Big Data and Analytics• Delivering differentiated integrated

solutions leveraging in-memory, flash, and acceleration technologies

• Cloud• Delivering tailored offerings and reference

configurations to Services Providers and MSPs

• Open Source• Deliver optimized e-Commerce and Big

Data business application stacks from operating systems to scripting languages and databases

Infrastructure matters



77

5 IBMers contributing to Linux and Apache Projects

1999

IBM is investing in ecosystems and open innovation

100+ OpenPOWER-based innovations under way

2015 50k+ IBMers contributing to 150+ open organizations

1. Source: https://developer.ibm.com/start/


1

1



8

IBM Linux engineering assertions for Power

Virtualization / Containers

Linux Operating Systems

Cloud Infrastructure

Supported by Canonical

Linux = Common LinuxKVM = Common KVM

Containers = ContainersOpenStack = OpenStack

Bare-metal supportKVM guest support

PowerVM LPAR support



9

Linux rolling out – latest statusRHEL 7.2 available (BE & LE)

• Announced and available - November 2015• Continues to deliver both LE and BE versions – LE is where the investments continue• Both LE and BE runs in PowerVM LPARs and in KVM guests• LE supports “L” and “LC” systems bare-metal• LE supports Nvidia K80 GPUs bare-metal in the S822LC• LE introduces RHEL support for CAPI adapters (phase 1 support)

CentOS 7.2 ppc64le now available • Normal “community supported” operating system. No formal IBM support.

Ubuntu 16.04 LTS (LE only) now available - April 2016

Ubuntu 15.10 (LE only) available • Continues to be POWER8 LE only.• Delivers an updated CAPI interface (phase 2 support)• Supports “L” and “LC” systems bare-metal• Selected features will roll into Ubuntu 14.04.x LTS release in the future

SLES 11 SP4 (BE only) being updated for larger memory footprint on E880 systems • Up to 32TB in a single LPAR

SLES 12 SP1 (LE only) available • Continues to be Power8 LE only• Support “L” systems bare-metal – “LC” expected to be added in next update



10

RHEL 7.2 (BE and LE)• RHEL 7.2 now available • Runs in POWER8 exploit mode on P8• BE with POWER7 in p7compat mode• LE now exploits P8 bare-metal “L” and “LC”• CentOS 7.2 ppc64le now available • RHEV for Power available

RHEL 6 (BE only)• RHEL 6 U5 on POWER8 (P7compat mode)• Full support of POWER6 and POWER7 (native mode)

Fedora (LE)• Power support since Fedora 16• Fedora 20 introduces Power8 support• Fedora 25 actively being worked – LE is the focus• Docker enabled in Rawhide, Fedora 23

Supported Add-ons• Jboss, High performance network add-on

➢

➢

➢

Same Linux source and distribution release schedules as x86.Simplified x86 application porting and migration with little endian distributions.Enterprise support for all three Enterprise Offerings – available from IBM or distributors.

Power Linux support

New

SLES 12 SP1 (LE only)• SLES 12 SP1 now available • Runs in POWER8 exploit mode on P8 • LE not supported on POWER7 systems• Exploits P8 bare-metal “L”

SLES 11 SP4 (BE only)• Runs in selective POWER8 exploit mode on P8• Full support of POWER6 and POWER7 (native mode)• Current base for SAP HANA engagements

OpenSUSE (LE)• openSUSE 12.2 introduced updated POWER support• openSUSE 13.2 introduces POWER8 support• Docker now enabled in “Tumbleweed”

Supported Add-ons• SUSE Linux Enterprise HA

Ubuntu 16.04 LTS (LE only)• 16.04 available now - April 2016• Runs in POWER8 exploit mode on P8• LE not supported on POWER7 system• Exploits P8 bare-metal “L” and “LC”• Delivers KVM host capability

Ubuntu 14.04.x LTS (LE only)• 14.04.4 available today. “.5” will be last update.• Exploits P8 bare-metal “L” and “LC”• KVM hosting enabled (14.04.2)

Ubuntu standard releases (LE only)• 15.10: “LC” enablement, CAPI enhancements• 15.04: Docker enablement, initial FPGA support• 14.10: Nvidia K80 GPU support

Debian (LE) • POWER8 LE supported with Jessie (v8) release

Supported Add-ons• JuJu charms, MaaS (metal as a service), Landscape



11

Partnering to provide a complete support solution for implementing and managing the Linux operating system in enterprise server and cloud

environments

• IBM now delivers consistent little endian support for the enterprise across leading Linux distributors: Red Hat, SUSE, Ubuntu

• One Contract, One Phone Number for Linux environment support

• IBM’s support approach focuses on speed to resolution

• Seamless collaboration on multi-vendor products as your single source provider

LE LE LE

IBM Supports Linux for the Enterprise



12

Hypervisor/OS Support for POWER8 Scale-Out Servers

•As of 10/5/15 announce2015

2015



13

Linux on Power transitions to little endian

Standard Release Support Extended Release Support Release/updateRed Hat lifecycle information - https://access.redhat.com/support/policy/updates/errata/SUSE lifecycle information – https://www.suse.com/lifecycle/Ubuntu lifecycle information - https://wiki.ubuntu.com/Releases

Today20092006 2007 2008 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019

SLES 12 (4Q14)

14.04 LTS (4/14) LE

LE

RHEL 7 (6/14) BE

Projected release/update

14.10 (10/14) LE

7.1LE

15.04 (4/15) LE15.10 (10/15) LE

RHEL 6 (11/10)BE

SLES 11 (3/09)BE

7.2

16.04 LTS LE

LE17.04LE

LE 17.10

16.10



14

Little endian simplifies software on Power POWER8 processors support execution in both big endian (BE) and little endian mode (LE) Most compiled open source software is designed (defacto) to run in little endian mode. Linux on Power has chosen to exploit little endian (LE) processor mode based on OpenPOWER partner feedback.

Eases the migration of applications from Linux on x86. Enables simple data migration from Linux on x86. Simplifies data sharing (interoperability) with Linux on x86. Improves Power I/O offerings with modern I/O adapters and devices, e.g. GPUs.

LE distributions for Linux on Power does NOT mean x86 applications magically run: applications must still be compiled for Power. LE enablement is facilitating discussions with new partners and software providers for Linux on Power AIX and IBM i will remain BE

BE and LE are simply different ways of ordering of how data is stored. Important in 1980.Not as important in 2013.Market has moved.



15

What is the deal with Big Endian (BE) and Little Endian (LE)?It is how you store values (bytes) in memory

For example: 2427130573 (in Decimal) 90AB12CD (in Hexadecimal)• It will take 4 bytes of memory to store this number

Big Endian (“Big End First”)Memory 1000 1001 1002 1003Value 90 AB 12 CD

90 AB 12 CD

Memory 1000 1001 1002 1003Value CD 12 AB 90

Little Endian (“Little End First”)

More Info: http://en.wikipedia.org/wiki/Endianness

POWER8 is Bi-Endian. The system supports both Big Endian and Little Endian operating Systems on

the same system, at the same time, in LPARs or in KVM guests. The latest Ubuntu, RHEL and SLES releases all support LE.

Used by mainframe, pre-POWER8 with Linux, SPARC, Macintosh AIX and IBM i have been and will remain “BE”

Used by Intel x86, VAX/VMS and now POWER8 with Linux



16

Where is Linux LE and BE going?The latest operating systems from SUSE and Canonical and Red Hat are available in LE mode -- starting with POWER8-based systems

• SLES 12, all Ubuntu ppc64le releases, RHEL 7 • Footnotes:

• Ubuntu has an older BE powerpc release originally targeted for older processors and Power-Mac • RHEL 7 continues to be currently available as a BE based operating system

Future new Enterprise Linux versions are expected to continue on a LE focused approach• IBM’s product, technology, software, and solution offerings for Linux on Power are expected to

continue to focus on LE more strongly in the future

• Bare-metal boot on POWER8 and future POWER9 systems are developed on the LE base

• Nvidia’s GPU adapters are dependent exclusively on the LE base

There are numerous examples of other Linux offerings which continue to have community advocates and enthusiasts for BE based versions (powerpc, ppc64, etc) which demonstrates the depth and interest from the Power ecosystem. See next chart.



17

Big Endian and Little Endian LinuxBE

powerpcBE

ppc64LE

Ppc64le (or el)Debian in general Yes Yes Yes

Debian v9 (“stretch”) Yes No Yes

Fedora No Yes Yes

RHEL 6.x No Yes No

RHEL 7.x No Yes Yes

Future RHEL new version for Power9 No No Yes

SLES 11 No Yes No

SLES 12 No No Yes

Future SLES new version for Power9 No No Yes

Ubuntu 14.04.x Yes No Yes

Ubuntu 14.10, 15.04, 15.10 Yes No Yes

Ubuntu 16.04.x Yes No Yes

Future Ubuntu new version for Power9 tbd No Yes



18

Built with open innovationput your data to work across the enterprise

Designed forBig Data

Open Innovation Platform

Superior Cloud Economics

IBM Power Systems built on



19

Unstructured Content / Data Analytics• Content Analytics• Discovery• Search• Text Mining• Cognitive Platforms• Rich Media Analytics• Language Analytics• Hadoop

Structured Data Analytics• End-User Query• Reporting and Analysis Tools• Predictive Analytics• GIS

Structured Data Management• Relational Database Management Systems

(RDBMS)• Non-relational Database Management

Systems (NRDBMS)• Database Development and Management• Data Integration and Access

CGR

13%

11%

10%

8%

Source: IDC 2015 Workload Study and Forecast

Data management workloads are the fastest growing in the Linux market Leading that growth is the use of Linux for unstructured data

13%CGR



20

RELATIONALOracle SQL Server

DB2 MySQL

The world of data is changing

Growth Drivers

• Open Source Databases

• Big Data / Unstructured data

• Large volume of transactions

• Scalability and agility

• Cost and efficiency

NoSQL is the Fastest Growing Sector

Redis

In MemoryNoSQL

Addressing changing data paradigms

Open Source Alternatives for traditional Relational DB

“By 2018, more than 70% of new in-house applications will be developed on an OSDBMS and…”

“50% of existing commercial RDBMS instances will have been converted or will be in process.”

GARTNER



21

• Majority of ISVs in the Gartner Challenger or Leaders Quadrant are on Power and have been or are being optimized – with compelling price/performance

• Additional ISVs in the Gartner MQ that are on Linux on Power, showing strong promise

• Another 6 being recruited: Percona, Marklogic, Basho, Areospike, Couchbase

Gartner Magic Quadrant for Operational DBMS – Linux on Power availability

Gartner Magic Quadrant for Operational Database Management Systems (10/12/15)

*

**

** Available as IOP instead of Hortonworks* Available in Open Source as CassandraPorted or Porting on LOP

Recruiting

Key

*** Oracle on AIX, DB2 and SAP on both AIX and LoP

***

***

Focus on a prioritized set of Data Providers for optimization and ecosystem development

CHALLENGERS LEADERS

VISIONARIESNICHE PLAYERS



22

Why Power Systems?



23

4XThreads per core*

4X Mem. Bandwidth*

5XMore cache*

SMT=Simultaneous Multi-Threading

These design decisions result in best performance for data centric workloads like: Database, NoSQL, Big Data Analytics, e-Commerce, Machine Learning

POWER8: Designed for data to deliver breakthrough performance

POWER8SMT8

x86Hyperthread

Parallel Processing

POWER8pipe

Data flow

x86 pipe POWER8

x86 POWER8 + OpenPOWER

x86



24

What's the hardware technology strategy?Open is good: disrupt the industry with open innovation

XC ATXC AT

System Operating Environment Software Stack

A modern development environment is emerging based on tools and services

CloudSoftware

OperatingSystem / KVM

Standard OperatingEnvironment

(System Mgmt)

Software

Power Open Source Software Stack Components

ExistingOpen Source

Software Communities

Firmware

Hardware

New OSS Community

OpenPOWERTechnology

OpenPOWERFirmware

CAPP

PCIe

POWER8

CAPI over PCIe

“Standard Power Products” – 2014

Hardw

are

“Custom Power SoC” – Future

Customizable

Framework to Integrate System IP on Chip

Industry IP License Model

Multiple Options to Design with Power Technology Within OpenPOWER



25

Business Applications

Web, Java Apps and Infrastructure

Database

Analytics & ResearchWorkload requirements

Compute intensive High memory bandwidth Floating point High I/O rates

Workload requirements HPC/HP

A apps

High quality of service Scalability Flexible infrastructure Resiliency and security

Workload requirements

Handle peak workloads Scalability High quality of service Large memory footprint

Workload requirements

IBM InfoSphere BigInsightsBig Data Big Data

Critical workloads run on Linux on Power

Highly threaded Throughput oriented Scale out capable High quality of service



26

The OpenPOWER Foundation is an open ecosystem,

using thePOWER Architecture to serve

the evolving needs of customers.

• Moore’s law no longer satisfies performance gain

• Numerous IT consumption models

• Mature Open software ecosystem

Open Developmentopen software, open hardware

Collaboration of thought leaderssimultaneous innovation, multiple disciplines

Performance of POWER architecture amplified capability

• Rich software ecosystem

• Spectrum of power servers

• Multiple hardware options

• Derivative POWER chips

Market Shifts New Open Innovation

26

The OpenPOWER Foundation

Technology FAB

I/O Networking Storage

FW Open Source SYS

ODM OEM

SW Linux ISV Open Source

Chip SoC Dev IP Dev Technology

FAB

I/O Networking Storage

FW Open Source SYS

ODM OEM

SW Linux ISV Open Source

Chip SoC Dev IP Dev

WEB 2.0 Data Center MSP Cloud

Members And growing ….

120+



27

IBM, Mellanox, and NVIDIA awarded $325M

U.S. Department of Energy’s CORAL Supercomputers

IBM & UK’s STFC Partner for Big Data & Cognitive Computing Research in £313M Partnership

CORAL: Leadership Class Supercomputers

5X – 10X HIGHER APP PERF THAN CURRENT SYSTEMS5X – 10X HIGHER APP PERF THAN CURRENT SYSTEMS

US & UK Research Establishments Select OpenPOWER Based Supercomputers

http://www.stfc.ac.uk/news/new-facility-helps-uk-business-exploit-high-performance-computing/

http://energy.gov/articles/department-energy-awards-425-million-next-generation-supercomputing-technologies



28

28



29

Power S8xx1‐2 sockets, 2U‐4U

Scale‐out

POWER8 Virtualization

Power E8xx4‐8 sockets

PurePower

Linux BE Apps mainly in market but LE is future and strategic focusWith all virtualization enabled for LE Distros SLES 12, Ubuntu & RHEL 7.1LE PowerVM June 2015 release finished complete LE enablement on P8 systems

IFLs

Power S8xx LLinux Scale‐out

RHEV for Power

Power S8xx LCLinux Scale‐out

Bare Metal Supported w/Ubuntu 14.04.3, RHEL 7.2LE, SLES 12 SP1, Ubuntu 16.04

Bare Metal Supported w/Ubuntu 14.04.3, RHEL 7.2LE

Ubuntu 16.04

2015

RHEV for Power



30

Software SolutionsSoftware Solutions

Power ISVsPower ISVs

Linux Open SourceLinux Open Source

WebSphere Application Server

Powered by

Linux Distributions(with KVM)

Linux Distributions(with KVM)

Robust solutions from IBM, ISVs & the Open Source Community



31

The IBM SDK for Linux on PowerIntegrated Development Environment (IDE)

Includes IBM Advance Toolchain Integrates classic Linux performance analysis tools Plus, value‐added tools for Linux on Power !

For developing, porting, and optimizing C/C++ applications for Linux onPower Provides tips and fixes on migrating and optimizing Available for x86_64, ppc64, and ppc64le Works on most Linux distributions (Red Hat, SUSE, Ubuntu, Fedora, ...)

“Built on Eclipse” is a registered trademark of the Eclipse Foundation



32

IBM is the real threat to Intel’s server dominance“The level of support behind the OpenPOWER Foundation leads me to believe that IBM has a real chance at ending Intel's server chip monopoly.” [Motley Fool]

“If you need to handle massive amounts of computational data faster than you are now, IBM has rolled out new systems just for you.”[CIO-Today]

On Nov. 17th, CRN announced that IBM Power Systems S822L won a 2014 Tech Innovator award. [CRN]

OpenPower Sees Momentum Going Into 2015 [eWeek]

Rackspace to Reduce Intel Reliance With IBM-Led Group [Bloomberg]

POWER8 is everything Intel's Xeon wants to be when it grows up[Seeking Alpha]

What the industry is saying



33

POWER8 Linux Only scale-out servers for clusters, cloud and Enterprise RAS

S822L2 socket, 2U, Up to 24 cores



“L”Server line

PowerVM or PowerKVM PowerVM or PowerKVM PowerVM or PowerKVM

Clients value RAS & price/performance

S822LC2 socket, 2U, Up to 20 cores

S812LC1 socket, 2U, Up to 10 cores, 14 HDDs

“LC”Server line

For Big Data For Commercial Computing

S822LC2 socket, 2U, Up to 20 cores

For High Performance Computing2015

PowerKVM

Clients value open innovation and TCA

* Pricing is based on web pricing for S812LC http://www-03.ibm.com/systems/power/hardware/s812lc/buy.html

PowerKVM PowerKVM



34

Server model IBM Power S822LC HP DL380 Gen9

Processor / cores Two 3.32 GHz, 8-core POWER8 processor

Two 2.3 GHz, 18-core, Intel E5-2699 v3 Haswell processors

Configuration 128 GB, 2 x 1TB SATA 7.2K rpm HDD, 1 Gb 2-port, 2 x 16gbps FCA

System Cost-Server + RHEL OS + EDB Annual Subscription @ $1,750 per core

$47,446($18,147 + $1,299 + $28,000)

$93,539($29,240 + $1,299 + $63,000)

EDB pgbenchTotal Transactions per Second 406.6k 500.2k

TPS per dollar 8.57 tps/$ 5.35 tps/$

60% better

IBM Power S822LC

(16-core, 128GB)

$18,147

HP DL380 Gen9(36-core, 128GB)

$29,240

EnterpriseDB 9.4and

Linux on POWER8Vs.

Linux on Intel Haswell

Pricing is based on web pricing for S822LC http://www-03.ibm.com/systems/power/hardware/s822lc-commercial/buy.htmlEDB 9.4 http://www.enterprisedb.com/products-services-training/subscriptions-powerand HP DL380 Gen9 https://h22174.www2.hp.com/SimplifiedConfig/Index

EnterpriseDB 9.4 - IBM Power S822LC ($US) - vs. HP with Haswell

•Results are based on IBM internal testing of single system and OS image running with pgbench work load at scale factor of 1000 and are current as of March 16, 2016. Individual results will vary depending on individual workloads, configurations and conditions. OS and EDB support price is for 1 year duration and Hardware is 3 yr standard support.•IBM Power System S822LC; 16 cores / 64 threads, POWER8; 3.3 GHz, 128 GB memory, EDB 9.4, RHEL 7.1•Competitive stack: HP Proliant DL380 Gen9; 36 cores / 72 threads; Intel E5-2699 v3; 2.3 GHz; 128 GB memory, EDB 9.4, RHEL 7.1•Both tested configurations represent the highest processor frequency for that specific processor

1.8XBetter per

core

Higher POWER8 per-core performance generates

significant TCO savings

WebPrices



35

• 10, 12 Cores• 3.0 – 3.52 GHz• KVM, PowerVM, Bare metal

• 16, 20, 24 Cores• 3.0 – 4.15 GHz• KVM, PowerVM, Bare metal

70 PVUs for IBM SW on any Core running Linux70 PVUs for IBM SW on any Core running Linux

• 20, 24 Cores• 3.0 GHz, 3.42• (1‐2 NVidia GPUs)• Bare metal

PowerE870

• 8 to 80 Cores• 4.0 ‐ 4.19 GHz• 8TB memory• PowerVM

PowerE880

• 8 ‐ 192 Cores• 4 ‐ 4.35 GHz• 16TB memory• PowerVM

PowerE850

• 16 to 48 Cores• 3.0 – 3.7 GHz• 4TB memory• PowerVM

Clients value performance and reliability and TCO in

the Scale‐Out Space

Clients value enterprise class features, robustness

Clients value converged

infrastructure

Power S824L

Power S822L • S822/S822L nodes

• Storwize V7000• OpenStack Mgmt• PowerVM, KVM (1H16)

Linux on POWER8 – Winning with Clients Across the Portfolio

• 16, 20, 24 Cores• 3.0 – 4.15 GHz• 0‐2 NVidia GPUs• KVM, PowerVM, Bare metal

Power S822LC

Power S812LC

• 16, 20 Cores• 2.92 – 3.32 GHz• 0‐2 NVidia GPUs• KVM, Bare metal

• 8, 10 Cores• 2.92 – 3.32 GHz• 14 LFF drives• KVM, Bare metal

Clients value open innovation and TCA/TCO

Power S812L

2015

2015

2015

Designed for big data

Ideal for data in the

cloud



36

KVM on Power enables open deployment

H/W Management- Custom scripting- Heavily Automated- Open technologies

Platform Management- Custom management- Cloud based

– Bring base components in parity with KVM on x86 – “KVM should be KVM”– Co-exists peacefully with other end-points, whenever makes sense.– Enables hybrid clouds with common management environments

Manage

Provision

Deploy

Procure

xCat, PuppetChef, custom scriptsPXE, IPMI

OpenStackCustom Scripts

IBM product (PowerKVM) provides integration with IBM Cloud products

Enables KVM products from Linux vendors –Ubuntu KVM, RHEV, others

Manage

Provision

Deploy

Procure

Strategy:



37

PowerKVM feature / function deliveredGA 2.1

June 2014“Open Cloud”

Bug fixes Full host I/O Adapter support PCI Passthrough Support Guest Dynamic DMA support Guest EEH oVirt/VDSM 3.4 tech preview ESA agent integration PMLinux integration Mixed Mode BE & LE Guests EnergyStar SW enablement

Fast sleep, Deep Winkle In-band power throttle notification

Open vSwitch GRE tunneling Transparent Huge Page (thp) Guest support P8 Micro Partition Prefetch (mpp) exploitation

PCI passthru for nVIDIA (Tech. Preview) Guest hot add / remove (CPU and Memory) Dynamic Micro-Threading PowerKVM bare metal management via

OpenStack OpenStack Ceilometer support for Power

platform sensors and hardware counters Install improvements – automated installations Storage mobility Performance Improvements – Interrupt

Optimizations

GA 2.1.1Oct. 2014

“Refresh”

GA 3.1Nov. 2015

“Enterprise virtualization”

Supported GuestsBE – RHEL 6.5, SLES 11 SP3, RHEL 7.0LE – Ubuntu 14.04 LTS

Supported Hardware with GA 2.xS812L, S822L

Additional Supported GuestsBE – RHEL 6.6LE – SLES 12.0, Ubuntu 14.10

New

Dynamically create/delete VM's ST, SMT2, SMT4 guests P8 basic support

Static split core support SMT=8 host/guest enablement

CPU, memory, I/O affinity Memory over-commit Memory sharing – data dedup (KSM) Limited host I/O adapters Platform RAS

Memory error handling, Error logs, EEH, Power RAS tools

Host hot plug I/O VM migration PAPR-style paravirt interface Linux “virtio” virtual I/O devices USB emulation Guest VGA over VNC Livbirt, virsh Guest boot firmware (SLOF) All BE or all LE guests Kimchi virtualization management PowerVC SCE



38

PowerKVM 3.1

Customer benefits•Enables ecosystem for simpler porting of I/O drivers and host software•Provides new I/O options with improved performance and quality of service controls•Provides more flexibility for dynamically adding VM resources•Automatically sets Micro-Threading on the system based on the workload requirements

What’s new / key features•PowerKVM Host now runs in Little Endian Mode•SRIOV NIC Adapter Support•vCPU and Memory Hot plug support•Dynamic Micro-Threading

PowerKVM is the Open Choice for Power Systems Virtualization and is being enhanced to support new improved I/O and improved availability, performance and reliability.

New



39

KVM on Power directions1.Encouraging KVM across the operating systems and partners

• IBM PowerKVM -- RHEV for Power -- Ubuntu KVM -- others 2.Expand the ecosystem - OpenPower

• Deliver repository for KVM on Power technologyopen-power.org based. Presented at April 2016 OpenPOWER summit Base HostOS support for successive generations of processors, platforms, technologiesVirtualization layer to support legacy OS on new platforms – HAL like layer

3.Expand and extend KVM and technology virtualization• SRIOV enablement and exploitation • Research and extend accelerator technologies - FPGA and GPU virtualization• Performance optimizations



40

Docker Availability on POWER

• Docker Engine available as part of base distribution packages from Ubuntu 15.04 and Fedora 23 onwards

• Docker can be built from source on various Linux distros on POWER

• Ubuntu, RHEL 7, SLES 12 etc• Master builds are available here: https://master.dockerproject.org

• Refer for more info - https://www.ibm.com/developerworks/library/l-docker

• Docker image registry can be compiled on different Linux on POWER distributions

• Multi-arch registry is work in progress https://gist.github.com/estesp/a3546f3cf24d2fc9cecc

• IBM is working with the community to make additional images available for POWER in Docker Hub

• https://hub.docker.com/u/ppc64le/• Ubuntu, Debian, gcc are already available



41

IBM Power team creating Docker images for Power

• Starting from the general porting work for Open Source on Power, the team is also creating Docker images for Power

• Target is to have the top 100 most popular1 Docker containers available on Power by YE15, currently in the 70's

• Once dockerfiles are created, the changes are being merged back into the open source communities

• We are working with the Dockerhub image build community to have Power container images built for and available in DockerHub

• Base images have already gone through this process and are available today https://hub.docker.com/u/ppc64le/

Note 1: driven by DockerHub usage metrics



42

Docker on POWER: SummaryDocker is available to use on POWER platforms today

• Same code and open source model as used in the industry today• Exact Same Usability and Experience as on other platforms for developers• Same Build process as other platforms in the indsutry• Same tool chains and Modern Scripting Languages available for Power• Growing ecosystem of dockerized applications for POWER and increasing

community engagement

Docker is Better on POWER– Greater System Capacity to run Typical Cloud Native Docker Workloads– More containers per system lowers cost of operations for service providers– Power excels at data oriented workloads running in containers

You can run thousands Docker containers on a single POWER system



43

Workload Accelerators and Power

Field ProgrammableGate Array

GraphicsProcessingUnit

FlashSystem

Description

Reconfigurable hardware

Task customized, low latency, low power

1000s of simple cores

High bandwidth, floating point, and parallelism

Fast non-volatile storage

High IOP storage access

ExampleUse Cases

Compression, encryption, high speed streaming, search, Monte Carlo simulations

Deep neural networks, simulations, JAVA, Hadoop, graphics

In memory databases, data aggregation

Power ChipIntegration

Coherent Accelerator Processor Interface(CAPI)

PCIe (today);NVIDIA NVLink (SOD*)

Coherent Accelerator Processor Interface(CAPI)

*All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.



44

Coherent Accelerator Processor Interface

Non-CAPI

Off-ChipAccelerator

Core

Memory

PC

IP

CI

CAPI

FPGAw/CAPI

AcceleratorP8Core

MemoryP

CI

PC

I

CAPI is a platform to enable accelerationCAPI provides an infrastructure to improve performance of an application through FPGA acceleration

Enables customer-defined acceleration within the processor complexCAPI allows implementation of a wide range of accelerators to optimally address many different challenges

Each implementation is a unique CAPI Solution



45

CAPI and GPU directions – OpenPower technologies

OpenPower technologies continue to drive innovation for Power systems

Linux LE distros deliver the support for FPGA CAPI, Flash CAPI, and GPU implementations

POWER9 will improve the CAPI implementation

Nvidia’s GPU roadmap for K80, Pascal with NVLink, and Volta with enhanced NVLink is supported by Power systems and Linux.

In the future, research teams are working on the challenges of virtualizing – sharing – FPGA and GPU resources.



46

1. Migration from Intel

3. Proprietary technology

4. Application performance

2. Software availability

5. Cost of solution

Little Endian support makes porting Linux on x86 applications even easier

OpenPower Foundation brings innovative solutions to Power Platform

Cutting edge open source technologies such as dockerand Apache Spark are available on POWER8 today

POWER8 Delivers Over 2x Performance Compared to x86

POWER8 Solutions Are 2x Cost Effective than x86

Summary: All Perceived Barriers Removed



47

Linux on Power Community(developerWorks)

Power Systems Linux Portal(Product Information)

www.ibm.com/systems/power/software/linux/

@ibmpowerlinuxplus.google.com/communities/100156952249293416679

http://openpowerfoundation.org/

The OpenPOWER Foundation

Learn more about Linux on Power Systems



48

Thank You!

vt445-1: linux on power8 trends and directions mitec june 2016 smith/linuxonpowertrends2016 .pdf ·...

Documents