welcome to the waitless world high performance computing ... · “de-mystifying cognitive: ......

© 2016 IBM Corporation

Welcome to the waitless world

© 2017 OpenPOWER Foundation

High Performance Computing & Analytics...“De-Mystifying Cognitive: HPC/HPDA/AI”

Georgia Power User Group Atlanta, GA, 20 April 2017

Stuart AlexanderCognitive Systems Sales Manager, N. America

[email protected]

(919) 280-1956

20 April 2017

mailto:[email protected]




The Broader HPC Market ($ Millions)




Data holds competitive valueFull system and stack

open innovation required

You are here

44 zettabytes

unstructured data

2010 2020

structured data

Data

Gro

wth

Pri

ce/P

erf

orm

ance

Moore’s Law

Processor

Technology

2000 2020

Firmware / OS

Accelerators

Software

Storage

Network

Today’s challenges demand innovation




Accelerated innovation through

collaboration of partners

Amplified capabilities driving

industry performance leadership

Vibrant ecosystem through open

development

Cloud ComputingHyperscale & Large scale

Datacenters

High PerformanceComputing & Analytics

Domestic

IT Agendas

Industry adoption, Open choice

OpenPOWER Strategy

Moore’s law no longer satisfies

performance gain

Numerous IT consumption

models

Growing workload

demands

Mature Open software

ecosystem

Market Shifts

OpenPOWER is an open development community,

using the POWER Architecture to serve the evolving needs of customers.

OpenPOWER, a catalyst for Open Innovation



5

330+ OpenPOWER Foundation Members

Implementation, HPC & Research

Software

System Integration

I/O, Storage & Acceleration

Boards & Systems

Chips & SoCs




HPC Touches Our Everyday Lives

HPC is a critical element of product

development, research, discovery and

breakthrough science.




Defining HPC…and How It Is Changing

o “High Performance Computing most generally refers to the practice of aggregating computing

power in a way that delivers much higher performance than one could get out of a typical

desktop computer or workstation in order to solve large problems in science, engineering, or

business.” – insideHPC.com

o “Classic HPC”: large, powerful, mathematical modeling systems• Used for running large, complex physics codes, etc.; still largely true

• Linux clusters: “commodity-level” supercomputing – each processor/core does its piece of the total

compute job (many hands make light work), aggregate the results for analysis on workstations

o HPC Today: Evolving rapidly• HPC technology now being used in other areas such as data analytics (HPDA) and AI/DL/ML

o HPC/HPDA/AI – gives us more to sell, broader basis for discussions with prospects

o HPC consolidation in play…..important industry changes• HPE: post-split “uproar” not over; SGI acquisition, possibly others; Dell’s EMC acquisition, etc.

• Fewer players all dealing with such corporate changes plus “Intel fatigue” among users: opportunity

for IBM and POWER




What do HPC, HPDA, AI, Accelerated db’s, etc. have in

common?

They largely draw upon the same technologies to accomplish their tasks….technologies honed

over the years in “classic” HPC.

Three different cars built for different purposes…..but with the same

chassis, drive train




The IBM HPC Evolution

Data-Centric

Cognitive

Data Analytics Business Intelligence

Social AnalyticsFinancial Analytics

High Performance Data

Analysis

Life SciencesMaterial Science

Research ClustersOil and Gas

HPC Simulation

(Acceleration)




Your Clients Use HPC for a Competitive Advantage …and So Do Their Competitors

Oil & Gas

Seismic Data Processing, Reservoir Simulation &

Modeling, Geospatial analytics, Terrain/ topology

mapping, CFD-aerodynamic modeling, Wind

simulation

Retail

Inventory analysis, logistics & supply chain

optimization, sentiment analysis, marketing offers

Film, Media & Gaming

Rendering, Computer Aided Graphics, Computer

Generated Images (CGI), Transcoding/ Encoding,

Image Analysis and Processing

Telecommunications

High Performance Data Analytics

Derive Insights From Vast Volumes Of Data &

Streaming Data In Milliseconds.

Fast Location-based Data Analytics – Reducing

Customer Churn, Network Optimization, & Subscriber

Monetization




HPC is Not Just for Rocket Scientists…

Utilities

Processing streaming data from smart meters &

multi-billion row datasets in real time to optimize

energy generation and uptime, predict & prevent

power outages, chart energy trends, understand

customer energy usage, and improve load

forecasts.

Banking, Financial Markets &

Insurance

Monte Carlo simulations, Risk analysis, Fraud

detection.

Calculate this now! 100,000s scenarios,

100s of instruments & time steps

Government & Defense

Intelligence agency, fraud analysis, climate modeling,

weather forecasting, energy, nuclear

stewardship, exploration

Life Sciences

Genome processing & sequencing, Drug design,

Molecular modeling & biology simulation, Protein

docking.

Assemble & map large genomes in hours

instead of days & weeks




Main Components of Representative HPC Systems

Compute nodes and

High Performance Switch

Support:

Management

Servers

Support:

Login Nodes

Primary

Network

SAN, Direct Connect

or Storage Nodes

Storage

(Disk and Tape)

Management

Network




• Spectrum Compute (LSF, Conductor) Cluster Management Tools• Compilers: gcc, IBM XLC, LLVM OpenMP4, PGI Fortran/C/C++, Java,

OpenACC, OpenMP• Debuggers, Profilers, Math libraries, MPI & HPC apps

Processors &

Systems

HPC

Software

High Performance

File System &

Storage

• High Performance Processors & Systems• Accelerator, networking, storage integration via NVLink & OpenCAPI• Highest memory throughput

• Highest Performance HPC Storage: Elastic Storage Server• High Performance Spectrum Scale (GPFS) Parallel File System

High Speed

Interconnect

• High speed network fabric from Mellanox• MPI acceleration in the IB fabric, reducing CPU overhead• Support for GPUDirect, NVMe over fabric

IBM: Complete Portfolio of HPC Solutions

High Performance Computing

Accelerated Databases Machine Learning




Why All the Hype About Minsky (S822LC)?

P100GPU

POWER8CPU

GPUMemory

System Memory

P100GPU

80 GB/s

GPUMemory

NVLink

115 GB/s

P100GPU

POWER8CPU

GPUMemory

System Memory

P100GPU

80 GB/s

GPUMemory

115 GB/s

http://www.nvidia.com/object/nvlink.html




High Performance Data Analytics

Sometimes requires 1/10 the hardware & 1/20 the

power compared to other in memory analytics solutions

www.kinetica.com/




Advanced HPC in the Cloud o Public Cloud For High Performance Workloads & Cloud Supercomputing

o World’s Fastest & Easiest To Use Cloud For Machine Learning, AI, & HPC Applications

o Operates Industry Leading HPC Infrastructure In Multiple Datacenters




How We Sell…Positioning Positioning Positioning

o We focus on IBM’s strengthsWe avoid “chip level” discussions, at least initially (“shift the customers’ eyes upward”)

• Customers want and need stability in their technology provider (~400K employees =

“depth on the bench”; in business over 100 years, etc.)

• What we do best, we do better than anyone……demonstrably

• IBM will be a true technology partner, walking the journey with them the entire way

• HPC shops being asked to be “experts” on HPDA, AI/DL/ML, accelerated db’s,

even cloud…..we can do it all

o We fight where we can win• Workloads (codes/apps) that take advantage of our superior memory bandwidth

(~4X over x86)

• Workloads that take advantage of our superior multi-threaded capability

(SMT8; 8 threads per core vs. 2 for x86; great for codes like Hadoop/Spark, etc.)

• Accelerated computing….NVIDIA GPUs or FPGAs…..NVLink technology a huge edge for us

• Look for home-grown, Open Source codes

o “What about my workloads/codes that don’t run on Power?”• Very common….Solution: hybrid (Power/x86) clusters; we offer choice beyond commodity

• Same Mellanox IB, same cluster mgmt. environment (Platform), same parallel file system (Spectrum)




Let’s talk some AI: Through experience, exposure, and

repetition, we learn to perceive the world around us




PowerAI…allows systems to learn much as we do

World’s Fastest AI Platform for Enterprise




Machine Learning (ML) vs. Deep Learning (DL)




Target Industries – Deep Learning

Utilities Security and PublicSafety

Consumer Web, Mobile, Retail

Medicine and Biology Broadcast, Media and Entertainment

• Visual inspections of transmission towers to identify maintenance issues (improving worker safety & productivity)

Utility companies that own and operate large power grids and transmission networks.

Titles: Directors of Maintenance, Employee Safety,

• Video Surveillance• Image analysis• Facial recognition and

detection

Local and national police, public and private safety/ security (ADT, IViz, Pinkerton, Sentry)

Titles: Head of Analytics

• Image tagging• Speech recognition• Natural language • Sentiment analysis

Hyperscale web companies, large retail (Google photos, Twitter, Woolworths, Aeon)

Titles: VP/Dir Marketing, Chief Customer Officer, New Application Research

• Drug discovery• Diagnostic assistance• Cancer cell detection

Pharmaceutical, Medical equipment, Diagnostic labs (Takeda, Asian Pharma, Pfizer)

Titles: Principal investigators, Dir of Scientific research

• Captioning• Search• Recommendations• Real time translation

Consumer facing companies with large streaming of existing media, or real time content

Titles: VP/Dir of Marketing, Closed captioning roles, Dir Translation services




More Industry-Specific Use Cases for PowerAI




N. America HPC/HPDA Sales Team Contactso Stuart Alexander, HPC Sales Manager, N. America

[email protected] (919) 280-1956

o Terry Duff, Public Sector


o Cynthia Hanssen, Federal


o Ian Watts, Industrial and Canada


o Harry Parks, Distribution and Comm/CSI


o Dave Parker, Storage (ESS), FSS


o Steve Edel, Spectrum and Platform












Summary

o We’re back in the game…..and totally committed to it

o We focus on IBM’s strengths; we know our positioning

in this space

o We fight where we can win

o HPC has evolved, continues to evolve (“classic” HPC, HPDA, AI, accelerated db’s, etc.)

o IBM continues to innovate; we control our own destiny (unlike our competitors)

o Identify opportunities, ask for help (& don’t forget your NVIDIA, Mellanox reps!)…we need you

o Let’s take maximum advantage of consolidation, confusion in the industry to capture market

share

o No one wins alone in this business! Let’s work together and WIN!




Questions?

welcome to the waitless world high performance computing ... · “de-mystifying cognitive: ......

Documents