deep learning mit powerai - ein Überblick...deep learning mit powerai - ein Überblick stephen lutz...
TRANSCRIPT
Deep Learning mit PowerAI -
Ein Überblick
Stephen Lutz
Open Group Master Certified IT Specialist
Technical Sales IBM Cognitive InfrastructureIBM Germany
What‘s that?
… and what‘s that?
… and what‘s that?
Overall Artificial Intelligence (AI) Space
Machine Learning
Deep LearningBreak tasks into
Artificial Neural
Networks
New Data
Sources:
NoSQL,
Hadoop &
Analytics
New class of applications
Opportunity in ML Training
▪ Pattern matching
▪ Image matching (Consumer Photos)
▪ Real-time decision support
▪ Complex workflows
▪ Data Lakes
Extend Enterprise applications
▪ Finance: Fraud detection /
prevention
▪ Retail: shopping advisors
▪ Healthcare: Diagnostics and
treatment
▪ Supply chain and logistics
Extend Predictive Analytics to
Advance Analytics with AI
Human Intelligence Exhibited by Machines
Cognitive /
ML/DL
“Trained” using large amounts of data &
ability to learn how to perform the task
Growing across Compute, Middleware, and Storage
Target Industries – Deep Learning
Automotive and Transportation
Security and PublicSafety
Consumer Web, Mobile, Retail
Medicine and Biology Broadcast, Media and Entertainment
• Autonomous driving:• Pedestrian detection• Accident avoidance
Auto, trucking, heavy equipment, Tier 1 suppliers
• Video Surveillance• Image analysis• Facial recognition and
detection
Local and national police, public and private safety/ security
• Image tagging• Speech recognition• Natural language • Sentiment analysis
Hyperscale web companies, large retail
• Drug discovery• Diagnostic assistance• Cancer cell detection
Pharmaceutical, Medical equipment, Diagnostic labs
• Captioning• Search• Recommendations• Real time translation
Consumer facing companies with large streaming of existing media, or real time content
Introducing PowerAI: Get Started Fast with Deep Learning
Enabled by High Performance Computing Infrastructure
Package of Pre-Compiled Major Deep Learning
Frameworks
Easy to install & get started with Deep Learning with Enterprise-Class Support
Optimized for Performance To Take Advantage of
NVLink
PowerAI Platform
Deep Learning
Frameworks
Accelerated
Servers and
Infrastructure
for Scaling
Spectrum Scale:High-Speed Parallel
File System
Scale toCloud
Cluster of NVLinkServers
Supporting
Libraries
Caffe NVCaffe TorchIBMCaffe
Distributed TensorFlowTensorFlow
OpenBLAS
Theano
Bazel DIGITSNCCLDistributed
Communications
Chainer
PowerAI
PowerAI Enterprise: Enhancing Developer Experience
DL Frameworks + Libraries(TensorFlow, CAFFE, ..)
Data Science
Experience (DSX)
Distributed Computing
with Spark & MPI
DL Developer Tools
Spectrum Scale High-Speed File System via HDFS APIs
Scale to CloudCluster of NVLink Servers
PowerAI Enterprise (Coming)
IBM Enterprise
Support
Application Dev
Services
Fastest GPU Server with NVLink: S822LC for HPC
2.5x Faster Data Throughput
2.5x Faster CPU-GPU Data Communication via NVLink
NVLink80 GB/s (3x)
GPU
P8
GPU GPU
P8
GPU
PCIe32 GB/s
GPU
x86
GPU GPU
x86
GPU
No NVLink between CPU & GPU for x86 Servers: PCIe Bottleneck
NVIDIA P100 Pascal GPU
“Minsky”POWER8 NVLink Server
x86 Servers with PCIe
▪ High-Speed NVLink Connections between CPUs & GPUs and among GPUs
▪ Features Latest NVIDIA P100 Pascal GPU
NVIDIA P100 “Pascal” GPUs inside a Minsky system
S822LC for HPC: recommended configuration for PowerAI2 Socket, 4 GPU System with NVLink
▪ Required:– 2 POWER8 10 Core CPUs
– 4 NVIDIA P100 ”Pascal” GPUs
– 256 GB System Memory
– 2 SSD storage devices
– High-speed interconnect (IB or Ethernet, depending on infrastructure)
▪ Optional:– Up to 1 TB System Memory
– PCIe attached NVMe storage
Introducing the IBM Power Systems LC Line
S822LC For High
Performance Computing
• Incorporates the new
POWER8 processor with
NVIDIA NVLink
• Delivers 2.8X the bandwidth
to GPUs accelerators
• Up to 4 integrated NVIDIA
“Pascal” GPUs
S822LC For Big Data
• Ideal for storage-centric
and high data through-
put workloads
• Brings 2 POWER8
sockets for Big Data
workloads
• Big data acceleration
with work CAPI and
GPUs
S821LC
• Storage rich single
socket system for big
data applications
• Memory Intensive
workloads
S822LC
• 2X memory bandwidth
of Intel x86 systems
• Memory Intensive
workloads
S812LC
• 2 POWER8 sockets in a
1U form factor
• Ideal for environments
requiring dense
computing
NEWNEW
NEW
High Performance
Computing
OpenPOWER servers for cloud and cluster deployments that are different by design
Performance Leadership Roadmap for HPC / HPDA
2015 2016 2017
POWER8
POWER8 with NVLink
POWER9
OpenPowerCAPI Interface
PowerAccelInterfaces:NVLink, CAPI, PCIeGen3
PowerAccel:OpenCAPI, NVLink 2.0, PCIe Gen4
Connect-IBFDR Infiniband
PCIe Gen3
ConnectX-4EDR Infiniband
CAPI over PCIe Gen3
ConnectX-5Next-Gen Infiniband
Enhanced CAPI over PCIe Gen4
MellanoxInterconnect Technology
IBM CPUs
NVIDIA GPUsKepler
PCIe Gen3Volta
NVLink Next GenPascalNVLink
IBM Nodes
Getting Started with PowerAI
▪ Install PowerAI on your existing S822LC for HPC server
http://ibm.biz/powerai
▪ Don’t have an S822LC for HPC?– Reference architecture / system requirements are available for
the first system shipping with POWER8, NVLink, and Tesla P100
– Visit IBM POWER HPC Cloud partners to test drive these frameworks on POWER8/P100 today
• https://power.jarvice.com/ (Nimbix HPC Cloud)
IBM Systems for Cognitive Solutions
Registration:https://www-
01.ibm.com/events/wwe/grp/grp308.nsf/Agenda.xsp?openform&seminar=A98AJKES&locale=de_DE
Die Anmeldung zum DLI-Workshop am 13.07. ist nur per Mail möglich!Bitte schreiben Sie eine E-Mail mit dem Subject "Anmeldung DLI Workshop" an folgende E-Mail-Adresse:
Questions?
Stephen Lutz
Open Group Master Certified IT Specialist
Technical Sales IBM Cognitive InfrastructureIBM Germany