openpower update for linux on power revolution event

30
© 2015 IBM Corporation OpenPOWER Foundation An update Mandie Quartly Linux on Power technical lead UK&I [email protected] Twitter: @mandieq 020 8818 5283 #LoPnow

Upload: mandie-quartly

Post on 12-Aug-2015

350 views

Category:

Technology


1 download

TRANSCRIPT

© 2015 IBM Corporation

OpenPOWER FoundationAn update

Mandie QuartlyLinux on Power technical lead UK&[email protected]: @mandieq020 8818 5283

#LoPnow

© 2015 IBM Corporation

Moore's Law meets the law of physics

“Moore's law is the observation that, over the history of computing hardware, the number of transistors in a dense integrated circuit doubles approximately every two years.” Wikipedia

© 2015 IBM Corporation

For almost 5 decades we have relied on exponential technology change

If cars were like chips:

1970 − 15 mpg

1980 − 1,500 mpg

1990 − 150,000 mpg

2000 − 15 Million mpg

2010 − 150 Million mpg

2020 − 1 Billion mpg

...

© 2015 IBM Corporation

And at the same time.. an emerging data challenge

1990’s 2020’s

Exa

Peta

Tera

Giga

2000’s 2010’s

Med

High

Low

Co

mpu

tatio

nal N

eeds

So

phis

ticat

ion

of A

naly

sis

Exp

ress

ive

ness

© 2015 IBM Corporation

• Moore’s law no longer satisfies performance gain

• Growing workload demands

• Numerous IT consumption models

• Mature Open software ecosystem

• Rich software ecosystem

• Spectrum of power servers

• Multiple hardware options

• Derivative POWER chips

OpenPOWER is an open development community, using the POWER Architecture to serve the evolving needs of customers.

Performance of POWER architecture

amplified capability

Open Development

open software, open hardware

Collaboration of thought leaders

simultaneous innovation, multiple disciplines

Feeds back … resulting in client choice

OpenPOWER, a catalyst for Open Innovation

© 2015 IBM Corporation

The road ahead

AugustAnnounced intent to form OpenPOWER

DecemberIncorporated Foundation and elected officers;5 members

AprilPublic launch in San Francisco and Beijing with 6 demos and first hardware from Google and Tyan26 members

JulyIBM, with contributions from Google, released 420,000 lines of firmware code44 members

OctoberMultiple offerings available from Altera, Canonical, IBM, NVIDIA, OVH, Redis Labs, and Tyan70 members

OctoberChina government endorsed OpenPOWER ecosystem through formation of the China Power Technology Alliance

• Collaborative solutions, standards, and reference designs available• Independent members solutions and systems• Sector growth in technical computing and cloud• Global growth with increasing depth in all layers• Broad adoption across hardware, software, and end users

NovemberDepartment of Energy chose OpenPOWER design for $325M supercomputing contract; Nallatech CAPI developer kit released77 members

2013 2014

DecemberRackspace declares Open Compute, OpenPOWER strategy; Seven work groups chartered84 members

MarchFirst OpenPOWER Summit•50+ member presentations and solution demos•15 hardware reveals•100+ member projects 112 members

MarchSoftLayer announces first OpenPOWER bare metal as a service offering

2015

Amazing member engagement with incredible progress

MayChartered nine work groups, major HPC deals to be announced; Member solutions promoted at 6k attendee Edge event, announced systems now available130 members

June£313m collaboration announced with STFC in UK; China Cloud Computing Conference, 13K attendingFirst China OpenPOWER Summit , 500+ attendees130+ members

© 2015 IBM Corporation

What a difference a year makes...

Fueling an Open Development Community

9

So what?What difference does it make?

© 2015 IBM Corporation

OpenPOWER Summit Hardware Announcement - March 2015

More details available at http://openpowersummit2015.tumblr.com/factsheet

Chuanghe 1S / 1U POWER8 server

Collaborators: Chuanghe

Cirrascale RM4950

Collaborators: Cirrascale, NVIDIAVirtex 7 CAPI-based Adapter Kit

Collaborators: Convey, Xilinx

TYAN TN71-BP012

Collaborators: Tyan, Mellanox

IBM Memory Technology Innovation Utilizing Altera FPGAs

Collaborators: IBM, Altera

IBM 2U/2S POWER8 / NVIDIA GPU Server “Firestone”

Collaborators: IBM, Wistron,NVIDIA, Mellanox

Inspur 2S / 2U server

Collaborators: Inspur

Mellanox ConnectX-4 CAPI-adapter

Collaborators: Mellanox

Open server specification and Open Compute motherboard mock-up

Collaborators: Rackspace

Suzhou PowerCore CP1 mechanical sample

Collaborators: POWERCORE

Zoom 2S / 2U POWER8 System Planar &

Memory Riser

Collaborators: Zoom Netcom, Byosoft, Unisource

© 2015 IBM Corporation

Happening today! OpenPOWER Summit China

● SuperVessel: https://ptopenlab.com/cloudlabconsole/index.html

– R&D environment for Open Source community, professors and students – already expanded to 30 universities in 6 months

– FGPA and GPU accelerators, built with OpenStack– Create, test and pilot applications on POWER architecture

● Alpha Data and fellow OpenPOWER member Xilinx announce acceleration development kit

● Suzhou PowerCore announce general availability of CP1, the first derivative POWER chip

● Zoom Netcom formally introduce RedPOWER, incorporating PowerCore's CP1 processor and China's first two socket "all domestic made" server.

● Tyan’s previously sold out GN70-BP010 OpenPOWER customer reference systems are available for immediate shipment.

● Plus! Last week - IBM joined China’s Open Data Center Committee (ODCC), a consortium in China creating new server specifications for hyperscale China data centers

© 2015 IBM Corporation

8x faster than x86 Ivy Bridge on pattern extraction

10x faster text search than CPU only

NVIDIA acceleration + IBM Power Systems

© 2015 IBM Corporation

Load Balancer

500GB Cache Node

10Gb Uplink

POWER8 Server

Flash Array w/ up to 40TB

After: NoSQL POWER8 + CAPI Flash

WWW

10Gb Uplink

WWW

Backup Nodes

500GB Cache Node500GB Cache

Node500GB Cache Node500GB Cache

Node

Before: NoSQL in memory (x86)

24U 4U

Less is More24:1 physical server consolidation =

6x less rack space

24:1 server consolidation

3x lower cost per user

IBM Data Engine for NoSQL

© 2015 IBM Corporation

IBM, Mellanox, and NVIDIA awarded $325M U.S. Department of Energy’s Super Computer bids

Two supercomputers for Oak Ridge and Lawrence Livermore Labs in 2017. Sequoia (LLNL)

2012 - 2017Mira (ANL)2012 - 2017

Titan (ORNL) 2012 - 2017

Current DOE Leadership Computers

5x – 10x Higher Application Performance versus Current Systems

>100 PF, 2 GB/core main memory, local NVRAM, Mellanox EDR 100Gb/s InfiniBand,

IBM POWER CPUs, NVIDIA Tesla GPUs

© 2015 IBM Corporationhttps://www.stfc.ac.uk/3583.aspx

£313 million collaboration to boost Big Data research in the UK

The research programme will use OpenPOWER high performance computing innovations to enable complex analytics on massive amounts of data.

IBM contributions• Latest data-centric and cognitive computing technologies,

including ‘Watson’ cognitive computing platform• 24 IBM researchers to be based at the Hartree Centre• Joint commercialisation of intellectual property produced in

partnership with STFC

© 2015 IBM Corporation

The sky is the limit...

© 2015 IBM Corporation18

The level of support behind the OpenPOWER Foundation leads me to believe that IBM has a real chance at ending Intel's server chip monopoly.” [IBM is the real threat to Intel’s server dominance, Motley Fool] “

http://www.rackspace.com/blog/openpower-opening-the-stack-all-the-way-down/

Both the current results and future potential are so promising that we are preparing to build an OpenPOWER-based, Open Compute platform. And it will run OpenStack services.

Up to 100x the power of a classic x86 setup

“ The new systems incorporate technologies from IBM and other providers that are part of OpenPOWER…which allow you to achieve unprecedented computing performance. [Cloud Times]

http://labs.runabove.com/power8/

… doubling the performance of its already powerful predecessor, Power7+. The POWER8 specs are mind boggling. [Microprocessor report]

“IBM’s huge advantages in multithreading and memory bandwidth favor POWER8 when running larger test suites that more closely reflect real-world enterprise applications.

http://www.linleygroup.com/newsletters/newsletter_detail.php?num=5275

Data-centric supercomputers based on POWER for Department of Energy, Oak Ridge National Labs & Lawrence Livermore to advance innovation and discovery in science, engineering and national defense in $325M deal

““

““

“People ask me if we would switch to Power, and the answer is absolutely,” Urs Hölzle, Google, said emphatically and unequivocally. “Even for a single generation.” [The Platform]

What is the market saying?

© 2015 IBM Corporation

ReferenceMaterial

© 2015 IBM Corporation

Membership Level

Annual Fee$ USD

FTEs Technical Steering Committee Board / Voting position

Platinum $100k 10 One seat per member not otherwise represented

Includes board positionIncludes TSC position

Gold $60k 3 May be on TSC if Work group lead

Gold members may elect one board representative per three gold members

Silver $20k $5k if <300 employees 0 May be on TSC if

Work group leadSliver members may elect one board representative for all silver members

Associate & Academic $0 0 May be on TSC if

Work group leadMay be elected to one community observer, non-voting Board seat

The OpenPOWER Foundation is a Not-for-profit entity with a Board of Directors and a Technical Steering Committee.• Membership levels provide either a default Board of Director position (Platinum) or an opportunity to be elected to the Board (Gold,

Silver, and Assoc/Academic members). The Bylaws include additional governance detail.• Technical Steering Committee is formed from Work group Leads and Platinum members.

Membership options include Platinum, Gold, Silver, and Associate / Academic memberships• Annual fee and dedicated full-time equivalent (FTEs) - verification of FTEs on honor system• Contributors, committers, Work group leads and project leads influence Technical Steering Committee• Associate / Academic level is not available to corporations

Membership agreement, Bylaws, and IP Rights Policy available for reviewwww.openpowerfoundation.org

Anyone may participate in OpenPOWER. Membership levels are designed for those that are investing to grow and enhance the OpenPOWER community and its proliferation within the industry.

Membership Options

© 2015 IBM Corporation

Engage in the OpenPOWER communityA

CT

ION

AC

TIO

NO

UT

CO

ME

OU

TC

OM

EIN

TE

RE

SIN

TE

RE

STT

Technology and Software Innovators

Discuss areas of collaboration and synergy in

OpenPOWER.

Sign up for membership and join a work group.

Build technical and business relationships.

Develop collaborative innovations

with compelling value

Innovators, Integrators, and Partners

Deep understanding of workload demands and

consumption preferences of end users.

Team with innovators and end users to drive

requirements, engage in specific projects.

Deliver collaborative innovations

with compelling value

End Users

Strategic imperatives and workload demands for performance and cost

optimization.

Require open software and systems with choice and

flexibility.

Engage directly on system design options.

Deploy collaborative innovations

with compelling value

© 2015 IBM Corporation

OpenPOWER Work Group Roadmap

2014 2015 2016

Developer Platform

System SW

HW Architecture

Accelerator

Compliance

Proposed Work Groups Integrated Solutions

Pers Med

SP010 – Tyan OpenPOWER Customer Reference System CAPI – Coherent Accelerator Processor InterfaceABI – Application Binary Interface

AFU – Accelerator Function UnitFSI – Field Replaceable Unit (FRU) Service InterfaceSDK – Software Developer Kit

25g IO Compatibility

FSI Spec

Memory

OpenPOWER I/O

Work Group

Charter Compliance SpecificationDraft Review WG Spec

CompSTD

CharterOpenPOWER ISA Profile V1IO Device Architecture V2Coherent Accel Intf Arch

OpenPOWER ISA Profile V2IO Device Architecture V3Coherent Accel Intf Arch

Charter P8 SP010Data

P8 2U2SReference

P8+ 1U1SReference

P8+ 2U2SReference

OPMB Intf. Spec V1Charter

Charter CAPI AFU Intf Spec V1

OpenCL SDK

CAPI AFU Intf Spec V2

Charter

CAPI LinuxSDK 64b ABI

Platform Ref

Sys I/O Enablement GuideCharter

Charter 25g IO Spec

OPMB – OpenPOWER Memory Bus

© 2015 IBM Corporation

Monte Carlo 250x faster

than POWER8 core alone, reduced C code 40x over non-CAPI FPGA

Altera FPGA acceleration and IBM CAPI

© 2015 IBM Corporation

Best-in-class ingredients • IBM POWER8• IBM Java• NVIDIA CUDA GPU acceleration• Ubuntu Little Endian Linux for POWER

8x performanceimprovementGPU acceleration for Java onsegmentation using accelerated machine learning for clustering with Hadoop / Mahout

© 2015 IBM Corporation

• Accelerated appliance with novel data-flow implementation of Memcached on FPGA.

• Up to 36x improved performance and power response times in microsecond range.

• CAPI integration of memory allows both host memory and coherent-attached flash to be used as value store.

Up to 36x performance improvement for Key-Value Store acceleration

© 2015 IBM Corporation

Superior Cloud Economics

New: SoftLayer Bare Metal POWER cloud

New: Rackspace joins OpenPOWER, declares Open Compute OpenPOWER system

New: Docker for Power Systems

Update: OpenStack HEAT and Chef Server for Power

New: Bluemix Cloud Integration and SQLDB Services with Power Systems for SOE/SOR integration

http://labs.runabove.com/power8/

Up to 100xthe power of a classic x86 setup

© 2015 IBM Corporation

• Support for little endian applications

• PoCs available through the Power Development Platform

• 50 IBM Innovation Centers and Client Centers Worldwide

Over 1,400 Linux ISVs developing on Power

© 2015 IBM Corporation

Critical workloads run on Linux on Power

• Compute intensive• High memory bandwidth• Floating point• High I/O rates

• High quality of service• Scalability• Flexible infrastructure• Large memory footprint

Business Applications

• Highly threaded• Throughput oriented• Scale out capable• High quality of service

Web, Java Apps and Infrastructure

• Handle peak workloads• Scalability• High quality of service• Resiliency and security

HPC applications for Life Sciences

Database

Analytics & Research

© 2015 IBM Corporation

10x higher throughput, 10x lower latency accelerating NoSQL workloads

with high speed RDMA networking

PHP (Zend)PHP (Zend)

PHP (Zend)PHP (Zend)

Linux (Ubuntu)Linux (Ubuntu)

Apache Web Server (Ubuntu)Apache Web Server (Ubuntu) MariaDB (MariaDB)MariaDB (MariaDB)

PHP (Zend)PHP (Zend)

Orchestration - Juju

(Ubuntu)

Orchestration - Juju

(Ubuntu)

High Speed Data Transfer (Mellanox)High Speed Data Transfer (Mellanox)

Turbo LAMP Stack for mobile and web apps

Future

Turb

o LA

MP

Dramatically less data center infrastructureDramatically faster responsiveness to customers