© 2016 OpenPOWER Foundation
Revolutionizing Data-Centric Transformation April 2016
Sumit Gupta Vice President, High Performance Computing and Analytics
IBM Power Systems
2
Accelerated innovation through collaboration of partners
Accelerators for driving industry performance leadership
Vibrant ecosystem through open collaborative, development
Cloud Computing Hyperscale & Large scale
Datacenters
High Performance Computing & Analytics
Domestic IT Agendas
OpenPOWER Strategy
Processors Not Keeping up with Workload Performance
Needs
Numerous IT consumption models
Fast Growing Open Software Ecosystem
Market Shifts
OpenPOWER: Catalyst for Open Innovation
OpenPOWER Development Community
3
4
200+ OpenPOWER Members
5
December Incorporated Foundation and elected officers 5 members
April Public launch in San Francisco and Beijing with 6 demos and first hardware from Google and Tyan 26 members
July IBM, with Google, released 420,00 lines of firmware code 44 members
October Offerings from Canonical, IBM, NVIDIA, OVH, Redis Labs, and Tyan 70 members
October China gov endorsed OP with formation of China Power Tech Alliance 70 members
November DoE chose OpenPOWER design for CORAL supercomputers; Nallatech CAPI developer kit released 77 members
2013 2014
December Rackspace declares Open Compute, OpenPOWER strategy; 7 work groups chartered 84 members
March First OpenPOWER Summit •50+ presentations and solution demos •15 hardware reveals •100+ projects 112 members
March SoftLayer announces 1st OpenPOWER bare metal as a service offering 112 members
2015
Fast Progress Leading to 200+ Members
May Chartered nine work groups; Member solutions unveiled at 6k attendee IT event 130 members
June £313m UK collaboration with STFC; 630+ attendees at China OP Summit 136 members
September GENCI OpenPOWER HPC investment; chartered 11 workgroups; 1600 ISVs developing Linux on POWER 153 members
November 46 member solutions at SC15, numerous accelerated computing announcements 170+ members
New Chips &
Components
Components
& Systems
New Systems &
Platforms
Bringing It
All Together
6
First Open server specification and motherboard combining OpenPOWER, Open Compute and OpenStack (mock-up)
First GPU-accelerated OpenPOWER developer platform
Prototype of a new high-performance server on the path to exascale
First commercially available OpenPOWER server RedPower, the first China OpenPOWER
2-socket system coming in 2015 Inspur 2-socket POWER8 Server
ChuangHe China-branded OpenPOWER system with POWER8
Data Engine for NoSQL with 40TB CAPI-attached flash
Open Source Redis
Clustering 192 Vcores + CAPI
40TB in 2U
First China “local” POWER derivative chip, CP1 Convey’s CAPI developer kit based on the company’s Xilinix-based co-processors
DMI connection between an Altera Stratix V FPGA accelerator and a POWER8 CPU
First commercially available OpenPOWER third-party server
New CAPI-based solution: the ConnectX-4 adapter card by Mellanox
Nallatech’s OpenPOWER CAPI Developer Kit
24:1 Server consolidation for 3x lower cost per user
7
11 Workgroups Evolving Infrastructure Standards
2014 2015 2016
Developer Platform
System SW
HW Architecture
Accelerator
Compliance
SP010 – Tyan OpenPOWER Customer Reference System
CAPI – Coherent Accelerator Processor Interface
AFU – Accelerator Function Unit
FSI – Field Replaceable Unit (FRU) Service Interface
25g IO Compatibility
Memory
OpenPOWER I/O
11 Work Groups
Charter Compliance Specification Draft Review WG Spec
Comp STD
Charter
OpenPOWER ISA Profile V1 IO Device Architecture V2 Coherent Accel Intf Arch
OpenPOWER ISA Profile V2 IO Device Architecture V3 Coherent Accel Intf Arch
Charter P8 SP010 Data
P8 2U2S Reference
P8+ 1U1S Reference
P8+ 2U2S Reference
OPMB Intf. Spec V1 Charter
Charter CAPI AFU Intf Spec V1
OpenCL SDK
CAPI AFU Intf Spec V2
Charter
CAPI Linux SDK
64b ABI Platform Ref
Sys I/O Enablement Guide Charter
Charter 25g IO Spec
OPMB – OpenPOWER Memory Bus
ABI – Application Binary Interface
FSI Specification FSI Spec Charter
SDK – Software Developer Kit
Charter Pers Med
Charter Integrated Solutions Integrated Solutions
Personalized Medicine
8
continents
50+ Innovations members 200+
24 6 countries
OpenPOWER Foundation reach
9
UNICAMP Brazil, SA http://openpower.ic.unicamp.br/mini
cloud/index.html
Oregon State North America
http://osuosl.org/services/powerdev
Brno University / RedHat. Czech Republic
https://fit-rhlab.rhcloud.com
SuperVessel USA and China www.ptopenlab.com
IIT Bombay, India
HPC Center University of Texas- TACC
OpenPOWER Open Software and University Cloud Environments
• OpenPOWER Platforms
• Open Stack Software
• University research
• Open Development &
Ecosystem Support
OpenPOWER Developer
Ecosystem Growing Fast
11
Engage in the OpenPOWER community
AC
TIO
N
OU
TC
OM
E
INT
ER
ES
T
Technology and Software
Innovators
Discuss areas of collaboration
and synergy in OpenPOWER.
Sign up for membership and
join a work group.
Build technical and business
relationships.
Develop
collaborative innovations with
compelling value
Innovators, Integrators,
and Partners
Deep understanding of workload
demands and consumption
preferences of end users.
Team with innovators and end
users to drive requirements,
engage in specific projects.
Deliver
collaborative innovations with
compelling value
End Users
Strategic imperatives and
workload demands for
performance and cost
optimization.
Require open software and
systems with choice and
flexibility.
Engage directly on system
design options.
Deploy collaborative innovations with
compelling value
12
OpenPOWER For Data Analytics and High Performance Computing
13
POWER8: Processor Performance Leadership
Memory Buffer
DRAM Chips
POWER8
12 Cores, 96 Threads 4 Level Large Caches Up to 1 TB per socket
Up to 230 GB/s sustained
Faster Cores 8 Threads Per Core
Larger Caches Direct Accelerator
Interconnect
3x Higher Memory Bandwidth, 1 TB
Memory per Socket
14
POWER8
Graphics Memory
System Memory
Graphics Memory
PCIe GPU CPU
Graphics Memory
System Memory
16 GB/s
40
GB
/s
2.5x Faster CPU-GPU Connection via NVLink
GPUs Limited by PCIe Bandwidth From CPU-System Memory
NVLink Enables Fast Unified Memory Access between CPU & GPU Memories
NV
Lin
k
System
bottleneck
GPU
GPU
15
US & UK Research Establishments Select OpenPOWER-Based Supercomputers
IBM, Mellanox, and NVIDIA awarded $325M
U.S. Department of Energy’s CORAL Supercomputers
IBM & UK’s STFC Partner for Big Data & Cognitive Computing Research in
£313M Partnership
CORAL: Leadership Class Supercomputers
5X – 10X HIGHER APP PERF THAN CURRENT SYSTEMS
After: NoSQL POWER8 + CAPI Flash
Load Balancer
500GB Cache
Node
Backup Nodes
500GB Cache
Node 500GB Cache
Node 500GB Cache
Node 500GB Cache
Server Node
Before: NoSQL In-Memory (x86)
24U 4U
3x Lower Cost for NoSQL Databases using CAPI-Attached Flash
POWER8 Server
Flash Array w/ up
to 40TB
CAPI Device
Flash Acts As Extension of System Memory
17
Application Benchmarks
18
Compelling Solution Performance on Power
Data Engine for NoSQL with Redis Labs
• POWER8 + CAPI FLASH as RAM
• 24:1 server consolidation
• Up to 3x lower TCA
Turbo LAMP on Linux on Power
• Next generation integrated LAMP stack
• Accelerated Dev/Ops for Mobile Apps
• 53% less $$ per user / hour with Magento running on Turbo LAMP
MariaDB on Linux on Power
• Up to 2.2x better per core performance
• Up to 1.9x better per system performance
SAP HANA on Linux on Power
• Designed for mission critical 7X24 Enterprise customer operations
• Outstanding throughput per core
• Virtualization out of the box
19
• In-memory distributed database using GPUs for processing
• Order of magnitude gains:
• Performance over CPU solutions
• Power reduction
• Cost savings
• Anticipate order of magnitude gains with POWER based NVLink solutions in 2016
GPUdb in-memory Accelerated Database
Ultrafast ingest and analysis of billions of objects
20
Over 2350 Linux ISVs on Power
100,000+ Open-Source Packages
Big Data & Machine Learning
Cloud Mobile Enterprise
Major Linux Distros
HPC
miniDFT
CTH
BLAST
Bowtie
BWA
FASTA
HMMER
GATK
SOAP3
STAC-A2
SHOC
Graph500
Ilog
CHARMM
GROMACS
NAMD
AMBER
RTM
GAMESS
WRF
HYCOM
HOMME
LES
MiniGhost
AMG2013
OpenFOAM
21
Superior Cloud Economics
SoftLayer Bare Metal POWER cloud
Rackspace declares Open Compute OpenPOWER system
Docker, OpenStack HEAT, and Chef Server for Power
Bluemix Cloud Integration and SQLDB Services with Power Systems for SOE/SOR integration
Power Cloud environments in Europe
IBM Watson Developer’s Cloud for cognitive computing www.ibm.com/smarterplanet/us/en/ibmwatson/developers.html
New IBM “LC” Power Systems for Linux
812LC CPU
Memory
1x POWER8 CPU 10 cores, 2.9-3.3 GHz
Up to 1 TeraByte Memory 115 GB/s Memory Bandwith 14 Drives (84TB, HDD, SSD)
Optimized for Hadoop, Spark, In-Memory
Analytics
822LC
CPU
Memory
Optimized for Databases and Cloud Workloads
CPU 2x POWER8 CPU
10 cores each, 2.9-3.3 GHz Up to 1 TeraByte Memory
230 GB/s Memory Bandwith 2 Drives (2 TB, HDD, SSD)
822LC HPC
CPU
Memory Built for HPC and Deep
Learning
CPU 2x POWER8 CPU
10 cores each, 2.9-3.3 GHz Up to 1 TeraByte Memory
230 GB/s Memory Bandwith 2x NVIDIA Tesla K80 GPUs
GPU GPU
© 2016 OpenPOWER Foundation 23
Leading Technology roadmap
2015 2016 2017
POWER8 POWER8 with NVLink POWER9 OpenPower CAPI Interface NVLink Enhanced
CAPI & NVLink
Connect-IB FDR Infiniband
PCIe Gen3
ConnectX-4 EDR Infiniband
CAPI over PCIe Gen3
ConnectX-5 Next-Gen Infiniband
Enhanced CAPI over PCIe Gen4
Mellanox Interconnect
IBM CPUs
NVIDIA GPUs Kepler PCIe Gen3
Volta Enhanced NVLink
Pascal NVLink
IBM Systems
24
Portfolio of HPC & HPDA Offerings
• Platform LSF & Symphony workflow and resource management
• Compilers: gcc, IBM XLC, PGI Fortran/C/C++, Java, OpenACC, OpenMP
• Debuggers, Profilers, Math libraries, MPI & HPC apps
Processors & Systems
Cluster & Development
Software
High Performance File System &
Storage
• High Performance Processors & Systems
• Accelerator, networking, storage integration via CAPI & NVLink
• Innovative solutions like CAPI Flash
• Highest Performance HPC Storage: Elastic Storage Server
• High Performance Spectrum Scale (GPFS) Parallel File System
• Flash Storage
Two tracks to challenge and win:
1. The Open Road Test
– Port and optimize for OpenPOWER
– Go faster with accelerators (optional)
2. The Spark Rally
– Train accelerated DNN and recognize objects
with greater accuracy
– Show you can scale with Spark
Key Dates
Register at openpower.devpost.com
Sun May 1st:
Submission periods opens
Tue Aug 2nd: Submission period closes
Grand prizes include a trip to Supercomputing 2016
Other prizes include iPads, Apple Watches
Join the conversation at
#OpenPOWERSummit
26
Thank you.