BOK Tuang SengSales LeaderIBM Cognitive Systems, ASEAN

IBM Cognitive Systems- A Machine Learning JourneyOutthink limits thru accelerated innovation, ecosystems and remodernization

Cognitive Solutions

Cognitive solutions ingest data of all forms, structured and unstructured, understandthat data, reason through it, learn from it, and interact with humans

Centralized Mainframes

Cognitive EraE-Business

Distributed Computing

Smarter Planet

Office Productivity

Client/Server

Personal Computer

Data Warehousing

Big Data &Predictive Analytics

Cognitive(AI – Machine Learning,

Deep Learning)

Data InsightContextTransactional

DatabaseBusiness

IntelligenceBig Data & Analytics

Actionable Insight in context

Reporting

Digital transformation drives new innovations

Influx of high data volumefrom various data sources- Devices, IoT, Social, etc

Machine Learning Journey

Machine Learning

Deep LearningBreak tasks into Artificial

Neural Networks

New Data SourcesIoT Devices, Big Data, NoSQL, Hadoop &Analytics

Human Intelligence Exhibited by MachinesCognitive/ML/DL

“Trained” using large amounts of data & ability to learn how to perform the task

Growing across Compute, Middleware, Network and Storage

New class of applicationsOpportunity in ML Training§ Pattern matching§ Image matching (Consumer Photos)§ Real-time decision support§ Complex workflows§ Data Lakes

Extend Enterprise applications § Finance: Fraud detection / prevention§ Retail: shopping advisors § Healthcare: Diagnostics and treatment§ Supply chain and logistics

Extend Predictive Analytics to Advance Analytics with AI

• Billions of intelligent devices & machines

• Recognition, reasoning, problem solving

• Inference: real-time accurate response

DEVICE INFERENCING

Deep Learning is new computing modelfor Machine Learning

Training

Device

Datacenter

• 10s of billions of image, voice, video queries per day

• GPU inference for fast response, maximize datacenter throughput

DATACENTER INFERENCING

TRAINING

• Billions of Trillions of Operations

• GPU train larger models, accelerating time to market

• Data intensive• Compute intensive• Develop a model for use

on the edge as inference

Cognitive Era demands datacenter innovationPr

ice/

Perfo

rman

ce

Full system stack innovation required

Moore’s Law

Innovation beyondprocessor and commodity server

Technology&

Processors

2000 2020

Firmware / OSAcceleratorsSoftwareStorageNetworkFull Stack

Acceleration(Lower is better)

Next era of innovation needsAccelerated Computing

thru Open Solutions & Ecosystems“We can't solve problems by using the same kind of thinking we used when we created them.” – Albert Einstein.

Accelerators

I/O Attach Devices

Software Optimization

IBM OpenPower Systems Offering

IBM Cognitive Systems Portfolio

IBM S822LC Serverfor Big Data

IBM S822LC Serverfor Commercial

Computing

IBM S822LC Server (”Minsky”)for HPC & AI (ML/DL)

IBM PowerAI Deep Learning Software Distribution

IBM Power HPC Software Stack

IBM Spectrum Computing Software

• IBM Spectrum LSF• IBM Spectrum Cluster Foundation• IBM Spectrum MPI

• IBM Spectrum Conductor• IBM Spectrum Symphony

IBM Data Storage• IBM Spectrum Scale Software • IBM Elastic Storage Server

IBM Systems Compilers• IBM XL C/C++• IBM XL Fortran Compiler

• IBM Parallel Performance Toolkit• IBM Engineering & Scientific Subroutine Library (ESSL)• IBM Parallel ESSL

IBM Accelerated Cluster Switch

Deep Learning Frameworks• Caffe• NVCaffe

• IBMCaffe• TensorFlow

• Torch• Theano

• Chainer• DL4J

Supporting Libraries• OpenBLAS • Bazel • NCCL • DIGITS • Distributed Frameworks

• Selected Systems Compilers + Spectrum Computing Software

AcceleratedNVLink

Linux

(GPU-GPU & GPU-CPU)

CognitiveComputes Systems

CognitiveHPC Enabler

Cognitive Software DefinedInfrastructure Solutions

Cognitive DataStorage Solutions

Cognitive High Performance Interconnect

IBM S812LC Server

IBM Research

IBM OpenPower

Development

IBMLinux

Technology Center

IBM Lab Services

IBM Technical Support Services

IBM Cognitive Cluster Offering

(aka IBM Power HPC Cluster)

Cognitive Workloads Artificial Intelligence (ML/DL)

High Performance Data Analytics (HPDA)

High Performance Computing (HPC)

IBM OpenPower Systems Offerings

S822LC For High Performance Computing8335-GTB (aka “Minsky”

•CPU-GPU NVLink, delivering >2.5X the bandwidth to GPUs

•PowerAI SW

•Power HPC Stacks

•Up to 4 integrated NVIDIA “Pascal” GPUs

S822LC For Big Data8001-22C

• Ideal for storage-centric and high data through-put workloads

•Brings 2 POWER8 sockets for Big Data workloads

•Big data acceleration with work CAPI and GPUs

S821LC8001-21C

S822LC8335-GCA

•Up to 2.2X memory bandwidth of Intel x86 systems

•Memory Intensive workloads

•2 POWER8 sockets in a 1U form factor

• Ideal for environments requiring dense computing

HPC & AI Big Data Commercial Computing

Linux

Systems designed to take Data/Compute Intense cognitive workloads to the next level

AI/ML/Deep Learning StrategyFor IBM Cognitive Systems

§ Embrace and Extend open source: add innovations, optimizations, new algorithms

§ Add system-level optimizations. Take advantage of NVLink on Power platform, better cluster (scale-out) performance, simplify the process of getting started

§ Build differentiated GPU-accelerated system solutions, using NVLink

IBM Version of DL Frameworks

Deep Learning Frameworks

New algorithmic techniques,

optimizations

Power / NVLink specific optimizations

Built with Collaborative Open InnovationOpenPOWER

299 OpenPOWER members contribute to 87 OpenPOWERready products and 17 servers delivering choice to industry

Close partnership with major AI/accelerator industry leader Nvidia

Open Frameworks for AI

Highly optimized & accelerated Cognitive/AI frameworks

Cognitive/AI SDK for deployment and deployment tools

Open Source Workloads

Now hyper-focused on expanding Cognitive industry applications

Enterprise Support/Subscription model

OpenCAPI

High bandwidth open interconnect to attach to accelerators and SCM

IBM PowerAI Platform

Deep Learning Frameworks

Supporting Libraries

PowerAI Software Distribution

DIGITS OpenBLAS Distributed Frameworks Bazel NCCL

IBM OpenPower S822LC, with NVLink(aka “Minsky Server”)

Breakthrough performance for GPU accelerated applications,including Deep Learning and Machine Learning.

Package of Pre-Compiled Major Deep Learning Frameworks

Easy to install & get started with Deep Learning with Enterprise-Class Support

Performance Optimized to Take

Advantage of NVLink

Enabled by High Performance Computing Infrastructure

Differentiated Value onIBM OpenPower S822LC (aka “Minsky Server”)

System Bottleneck

Graphics Memory

New POWER8

CPUDDR4

P100Tesla GPU

NVLink

115GB/s

80 GB/s

CPUDDR4

PCIe

32 G

B/s

Graphics Memory

Graphics Memory

POWER8 with NVLink delivers

2.8X the bandwidthPCIe Data Pipe

POWER8 NVLink Data Pipe

P100Tesla GPUGPU

Current CPU to GPU PCIe Attachment (x86)

New POWER8 with NVLinkProcessor Technology

Only IBM has NVLink for GPU-GPU direct communication

Cross-industries benefits of PowerAI

For Marketing executivesBetter understanding of client perspectives, recommendations, improve interaction.

For IT ExecutivesEnterprise class support, better price performance and a shared infrastructure.

For Data Scientists and DevelopersNVLink means new opportunities for innovation, faster access to larger memory, execute larger training models and more iteration … refine, improve.

Research ScientistsExplore new ways to understand existing datasets and faster access to results.

IBM OpenPower Systems- Best Systems for Cognitive and data-compute intensive workloads

High memory bandwidth and Processor designed to crush compute intensive workloads– AI (ML/DL), HPC & HPDA.

Truly open ecosystem and collaboration for extreme accelerator innovation with industry-leading technology partners

World-class service and support from IBM, the premier Cognitive Expert

Leading enterprise distribution and support for open-source machine and deep learning frameworks used to build cognitive applications

Outthink Limits with IBM Cognitive Systems