accelerated, any-scale ai solutions from...

©2018 DataDirect Networks, Inc. DDN Confidential

How Would it Impact Your Business if You Could

Seamlessly Extract a Lot More Answers per

Hour From Your Data at Any Scale?

A3IACCELERATED, ANY-SCALE AI SOLUTIONS FROM DDN

Ran Pergamin, Storage Solution Architect

[email protected] - 052-722-0080

DDN ConfidentialDDN Storage | ©2018 DataDirect Networks, Inc.

Enterprise Analytics & Big Data

Digital Content Solutions

Energy ExplorationOpenstack,

Containers, VM at Scale

Govt. and Digital Security

AI & Machine Learning

Research Big Data

Technical Computing

Supercomputing

Scalable Storage Platforms

Data-at-Scale Services

► Performance Storage Platforms designed for scale

► All Aspects of Scale: IOPs, Throughput, Latency, Capacity, Distribution

► Flexible Architecture Design

► Global Services and Support from Storage Specialists

World-Renowned & Award Winning

DDN | Scalable Storage Solutions for Your Specific Applications


DDN Parallel AI solutions are all-round

performers able to saturate GPUs for training

at the same time as inference and data

movements and preparation

DDN COMPLETE AI DATA LIFECYCLE SOLUTIONS

YOUR AI WORKFLOW

CONCURRENTLY,

CONTINUOUSLY,

IN-PLACE


FLEXIBLE SCALING

ULTIMATE FLEXIBILITY

DDN

Disk

DDN Flash

Competitor limitations

With data volumes continuing to rise, AI is getting

smarter and learning faster, enabling organizations

such as yours to leverage more-advanced Machine

Learning (ML) and Deep Learning (DL) solutions.

Match your business growth

with flexible all flash or

hybrid scale-out

Pe

rfo

rman

ce

Capacity

©2018 DataDirect Networks, Inc.

ACCELERATED ANY-SCALE AI SOLUTIONS FROM DDN

Optimized and integrated data

solutions for your AI

frameworks

x

AI Frameworks

A3I

DDN brings you to production faster by creating

a fully optimized and integrated data platform

for AI frameworks, managing data efficiently

whatever your choice of AI framework


BUILD YOUR AI DATACENTER WITH DDN’S DATA PLATFORMS FOR AI

AI200 - 20GB/S

2RU, 24 NVME DRIVES AI200

Capacities: 20TB to 368TB in 2-RU

Start with 1 system, Scale out to 100+

InfiniBand - EDR or Ethernet 100Gb


BUILD YOUR AI DATACENTER WITH DDN’S DATA PLATFORMS FOR AI

Hybrid Configurations : SSDs and NL-SAS

Start with 1 system, Scale to 100+

InfiniBand - EDR or Ethernet 100Gb

AI7900 - 20GB/S

4RU

90 DRIVES IN BASE + 360 MORE

6.3PB RAW IN 20-US

AI7990


DGX-1 server

DDN AI200Simple, Fully-Packaged Solution

for DGX

Start with a single AI200 storage appliance

and a single DGX-1 server

Pre-configured solutions that are easy to

deploy and manage, fully-integrated and

optimized for maximum DGX server

productivity

support: EDR IB and 100 GbE networking

DDN A3I Solutions: Turnkey, integrated and optimized for NVIDIA DGX-1

DDN ConfidentialDDN Storage | ©2018 DataDirect Networks, Inc. 4 or more DGX-1 servers

8

8

8

8

DDN AI200

Scalable, End-to-End

Solution for DGX

Flexible architecture scales seamlessly in

capacity, performance and capacity to match

evolving workflow requirements

Additional DGX-1 servers and AI200 storage

appliances can be integrated rapidly, and

immediately provisioned to applications

Architecture performance scales linearly and

delivers optimized, extremely cost-effective

solution with multi-DGX deployments

DDN A3I Solutions: Massive scale with multiple NVIDIA DGX-1


Full NVMe Performance,

In-Container

Extreme amounts of performance and

capacity through a tight integration between

DDN and NVIDIA platforms

Every layer of hardware and software

engaged is optimized for fast, responsive and

reliable file access

Highly optimized parallel data paths run from

containerized applications, all the way to disk

drives

DDN A3I Solutions: Fully integrated and optimized for NVIDIA DGX-1


Over 100K IOPs and

10GB/s to 1 Container

EXAScaler client demonstrates over 10GB

per second to a singlecontainer and over

100K IOPs.

Typical Deep Learning Codes will perform IOs

around 128K IOs – Scale up to 38GB/s with

4 Containers in a single DGX-1 System.

DDN A3I Solutions: Performance to a single container


60% Faster - Consistent, Linear AI PerformanceAI benchmarking of AI Frameworks with popular test sets demonstrates images per second rates

60% higher than competing systems

DDN A3I Solutions: Fully-optimized and Qualified with Popular AI Frameworks

DDN Confidential DDN ConfidentialDDN Storage | ©2018 DataDirect Networks, Inc.

DDN PARALLEL ARCHITECTURE AND PROTOCOL vs NFS

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

GPU GPU

FULL GPU SATURATION

MAXIMUM AI PRODUCTIVITY

GPU STARVATION

CRIPPLED AI PERFORMANCE

DDN AI200NFS


DDN FULL GPU

SATURATION

MAX GPUUTILIZATION

DGX-1 GPU UTILIZATION (%) AI200 READ (MB/S)

DGX-1 GPU UTILIZATION (%) NFS STORAGE READ (MB/S)

2X FASTER

Consistent DL performance

Achieves full GPU utilization

Efficient loading of data set

NFS GPU

STARVATION

MAX GPUUTILIZATION



73

543

0 100 200 300 400 500 600

Ima

ges

Per

Se

con

d

CAFFE GOOGLENET TRAINING THROUGHPUT7.5X MORE IMAGES WITH DDN STORAGE

DDN Storage NFS Storage

16

3

0 2 4 6 8 10 12 14 16 18

Tim

e (

in m

inu

tes)

CAFFE GOOGLENETTRAINING TIME5.5X FASTER WITH DDN STORAGE

DDN Storage NFS Storage



AI Benchmarking: Optimized TensorFlow Data Sets

67

23

0 10 20 30 40 50 60 70 80

Tim

e (in

min

utes

)

TFRECORD CONVERSION BENCHMARK3X FASTER WITH DDN STORAGE

DDN Storage Other Storage Products

1614

671

0 200 400 600 800 1000 1200 1400 1600 1800

Tim

e (in

se

cond

s)

TENSORFLOW RESNET-50 TRAINING PERFORMANCE2.5X FASTER WITH TFRECORDS

TFRecord Data Set Discrete Data Set

Optimized Data Sets,

Accelerated Training

Convert discrete data and metadata asset

collections into series of streamlined binary

files for TensorFlow

Maximize DL training and validation

efficiency while minimizing data

management and preparation overhead

Achieve more accurate results by

eliminating manual data shuffle bias


DDN – Large Autonomous car company deplyoment


DDN A3I SOLUTIONS FOR END-TO-END AI ENABLEMENT

Maximize efficiencyProfit from greatest technical and economic benefits

Accelerate AI performanceAchieve full GPU saturation for greatest AI productivity

Ensure data availabilityTrust in robust data protection, integrity and access

Scale seamlesslyIncrease performance, capacity and capability at any scale

Streamline DL workflowsEngage all workloads concurrently and continuously

Deploy and manage easilyFully-integrated and optimized solutions from DDN


THANK YOU

CONTACTS:

NIR TALMOR, REGIONAL SALES DIRECTOR, [email protected] – 052-722-0070

RAN PERGAMIN, SOLUTION ARCHITECT, [email protected] - – 052-722-0080

mailto:[email protected]

mailto:[email protected]

accelerated, any-scale ai solutions from...

Documents