seagate implementation of dense storage utilizing hdds and ssds

Tony Afshary – October 2015

Seagate implementation of dense storage utilizing HDDs and SSDs

Seagate Confidential 2 Sources: Reinsel, David. “Where in the World Is Storage: A Look at Byte Density Across the Globe” IDC October 2013, IDC/EMC Digital Universe, April 2014 + Seagate Estimates and Marketing & Research

Demand GROWING at Exponential RATE

Bigger Different $-Constrained

Created

Location SHIFTING dramatically to the CLOUD

Stored

Capacity

Data Center System Spend

Stable but SLOW growth

Data is… Big Data is Bigger than MORE Data

Seagate Confidential

SYSTEMS

DEVICES

ARRAYS

Seagate is Evolving to Address Trends

Converged Infrastructure High Performance Storage

Hybrid Data Systems

Software-defined Storage

Flash Arrays

NAND PCIe Traditional Enterprise

NAND SAS Hyperscale

Desktop Notebook / Tablet

Branded NAND SATA Hybrid Kinetic

Still Growing

Expanded Offerings

Started with Our Core Products

The Intelligent Information Infrastructure

Flash Controllers

Seagate Confidential 4

Seagate Enterprise Device Portfolio H

ighe

st P

erfo

rman

ce/$

Highest GB/$ Supported by end-to-end silicon capabilities across Flash and HDDs; >1 Billion ARM CPUs shipped

Silicon technology/IP spans Flash and HDD Portfolio across PCIe, SAS and SATA

Archival HDDs Capacity

HDDs

Performance HDDs

with TurboBoost™ Flash Caching

Nytro® PCIe Flash

Accelerators with SandForce®

Technology

SAS SSDs

Mar

kets

Hyperscale

Traditional-IT

HPC

Mission-Critical/Compute Business-Critical/Near-Line

Archival

JBODs Storage Arrays

Servers

Latency

Density

Thermal

Service

PCIe M.2, 2.5

SAS 2.5, 1.8

15K/10K 2.5

NL 2.5 NL/Value 3.5

Kinetic 3.5 Archive 3.5

Perf. 3.5

Nytro PCIe SSDs

Seagate Confidential 5

Next generation storage deployment:

Seagate Confidential 6

Ceph Deployment Object Storage Daemons (OSDs): • 10s to 10000s of OSDs in a cluster • One per disk or SSD • Serves stored objects to clients • Intelligently peers to perform replication

and recovery tasks • Support for erasure encoding of objects • Support for strong consistency leveraging

write journals

DISK

FS

DISK DISK

OSD

DISK DISK

OSD OSD OSD OSD

FS FS FS FS btrfs xfs ext4

M M M

Advanced Storage: • Shingled Magnetic Recording (SMR)

Drives (drive managed) • Excellent density, cost, read performance,

and sequential write streaming. • Poor random write performance.

• PCIe Flash • Excellent performance, in server integration • Poor cost per GB.

Seagate Confidential 7

Featuring: Nytro XP6302 flash accelerator

card Nytro XD—tuned caching SW 12x 8TB SMR HDDs

Benefits Accelerate Ceph journals and Metadata

with flash

By moving this data onto flash, cost-effective SMR drives are well-suited for extremely dense object storage systems reducing storage costs by 25%.

Nearly triples Ceph object storage performance

Storage component deployment in Ceph Video recording of a live demo hosted at UTSA

Ceph RADOS Benchmarks • SMR only vs. • SMR with Journals on SSD vs. • SMR Cache Tier vs. • SMR Caching With Nytro XD

SMR only SMR withSSD

SMR CacheTier

SMR withNytro XD

MB/s 2.53 2.56 5.9 28.19

05

1015202530

MB

/s

4K Writes – 16 Threads

SMR only SMR withSSD

SMR CacheTier

SMR withNytro XD

Latency/s 0.0246 0.024 0.01 0.0022

00.005

0.010.015

0.020.025

0.03

Seco

nds

4K Writes – 16 Threads

SMR only SMR withSSD

SMR CacheTier

SMR withNytro XD

MB/s 135.532 194.556 590.4 777.05

0200400600800

1000

MB

/s

4M writes - 16 threads

SMR only SMR withSSD

SMR CacheTier

SMR withNytro XD

Latency/s 0.471 0.328 0.108 0.082

00.10.20.30.40.5

Seco

nds

4M writes - 16 threads

Seagate Confidential 9

Scaled-Up Hardware Configuration Fully Populated Open Rack:

• 18 Winterfell Servers • 33.5 TBs of Flash

• 2.2 PBs of SMR Storage