Confidential

© 2016 Supermicro

Supermicro SuperStorage

Red Hat Storage Day Seattle

October 18, 2016

Paul McLeodSr. Product ManagerPaulM@Supermicro.com

Confidential

Confidential

Supermicro Total Solution Evolution

Subsystem Innovation

1993 - 2003

Server/Storage Innovation

IPO2007

Total Solution Innovation

• Motherboard & Building Blocks Expertise • Period of Vertical Integration

• Product Line Growth & System Optimization • Twin & GPU Architectures Breakthrough

• Software & Total Solution Optimization• Service & Global Expansion

2004 - 2013 2014 - 2016

ConfidentialSuperStorage Product Evolution

Supermicro Product Portfolio Evolution

Expanding from Compute to Storage with the emergence of <Software/Defined> Storage

<Custom Storage Software>S

tora

ge A

pplia

nce

<Software/Defined> Storage

ConfidentialComprehensive Portfolio: <Software/Defined> Storage

Capacity/Density

Thro

ughp

ut/L

aten

cy

Flexibility / S

calability

Performance SAS 3.0 - 12Gb/s NVDIMM All Flash NVMe

Capacity / Density Up to 90 Hot-swap bays in 4U Simply Double Top-loading Servers Double-sided Servers

Scale-out

Scale-up

Scalability

ConfidentialAll Flash Summary

SYS-1028U-TN10RT+ SYS-2028U-TN24R4T+ SSG-2028R-NR48N

24 hot-swap 2.5” NVMe drives

32 PCIe lanes to 24 NVMe drives

Performance IOPS (4K Random Read):

up to 5.6M

1600W Titanium level high efficiency digital power supply

Quad Port 10G Base-T

2 Rear hot-swap 2.5” SATA drives

48 hot-swap 2.5” NVMe drives

32 PCIe lanes to 48 NVMe drives

Performance IOPS (4K Random Read):

5.6M

1620W Titanium level high efficiency digital power supply

SIOM

2 Rear hot-swap 2.5” SATA drives

10 hot-swap 2.5” NVMe drives

40 PCIe lanes to 10 NVMe drives

Performance IOPS (4K Random Read):

up to 7M

1000W Titanium level high efficiency digital power supply

Dual Port 10G Base-T

Confidentialx10-Series Storage Server – 2U/24

SSG-6028R-E1CR24 N/LPROCESSORDual Intel Xeon E5-2600 v3/V4 socket RCHIPSETIntel® C612 Express chipset

MEMORY24 DIMM, Up to 3TB ECC 3DS LRDIMM, 768GB ECC RDIMM

Available for EXPANSION2x PCI-E 3.0 x16 & 1x PCI-E 3.0 x8

EXTERNAL I/O SUPPORTSIOM support for flexible networking options; 2x USB 3.0 ports

DRIVE BAYS24x Hot-Swap 3.5” SAS3/SATA3 drive bays 2x 2.5” rear hot-swap drive bays

STORAGE CONTROLLERLSISAS3108 HW RAID (N-series) or 3008 IT mode (L-series)

POWER SUPPLY1620W Redundant Power, 80PLUS Titanium

ADDITIONALIPMI 2.0 w/ dedicated LAN port & KVM; 4 Pin PWM Fan Speed control; Thermal and voltage monitoring;

KEY FEATURES Dual Intel E5-2600 v3/v4 (Socket R) Server 24x Hot-Swap 3.5” SAS3/SATA3 bays ( 12Gb/sec ) IT mode LSI 3008 (L-series) / 3108 HW RAID (N-series) 24x DIMM Slots (DDR4) SIOM for flexible networking options IPMI 2.0 (dedicated LAN) with Virtual Media/KVM over LAN Cable-arm for hot-swap access of second row

APPLICATIONS Storage Appliance File servers Virtual tape library Active Archive and Backup

34”

Confidential

https://www.supermicro.com/solutions/storage_ceph.cfm

Software Defined Solutions

Confidential

Generate well-balanced solutions without compromising on availability, performance and cost

Derive configurations from empirical data during the testing.

Provide reference architectures to prime opportunities and accelerate sales and deployment

Solution Objectives

Confidential

Red Hat Ceph Reference Architecture(s)

http://www.redhat.com/en/resources/red-hat-ceph-storage-clusters-supermicro-storage-servershttps://www.redhat.com/en/resources/mysql-databases-ceph-storage-reference-architecture

Confidential

Workload Optimization

Workload IO Profiles

WorkloadExamples

Searchable Examples

Workload IO Characteristics

HardwareCharacteristics

IOPS MySQLMariaDBPostgreSQL

Medallia High IOPS/GBLow latency IOSmall random IO70/30 read/write mix

Compute serversHigh core:drive ratio10GbENVMe SSD

Throughput Digital media servingServer virtualization(OpenStack Cinder)

Acquia, BloombergTarget, Walmartyahoo!, Facebook, Intuit

High MB/Sec/GBLatency consistencyLarge sequential IOBalanced read/write

Storage serversBalanced core:drive ratio10GbE -> 40GbEHDD -> SSD

Capacity-Archive

Digital media archiveObject archiveBig Data archive

yahoo!CERN

Low cost/GBHigh write volume/hrSequential IO90/10 write/read mix

Dense storage serversLow core:drive ratio40GbEHDD

Where Ceph and Gluster are used

Confidential

Supermicro: TIME TO VALUE

RackCluster

Workload Requirement

input

IOP per GB(Provisioned IOP)

Throughput(MB per Second)

Capacity(Price / Capacity)

output

Or

Turn-key Cluster Solutions

From Public Cloud to On-premise Storage

Sizing / Guidance

Workload Defined

Building Blocks Structure

Deterministic Performance

Best TCO Speeds and Feeds

Confidential

ARCHITECTURAL CONSIDERATIONSUNDERSTANDING THE WORKLOAD

Traditional Ceph Workload• $/GB• PBs• Unstructured data• MB/sec

MySQL Ceph Workload• $/IOP• TBs• Structured data• IOPS

Confidential

ARCHITECTURAL CONSIDERATIONSFUNDAMENTALLY DIFFERENT DESIGN

Traditional Ceph Workload• 50-300+ TB per server• Magnetic Media (HDD)• Low CPU-core:OSD ratio• 10GbE->40GbE

MySQL Ceph Workload• < 10 TB per server• Flash (SSD -> NVMe)• High CPU-core:OSD ratio• 10GbE

Confidential

Supermicro/Red Hat: Ceph IOP testing SetupOSD Storage Server Systems5x SuperStorage SSG-6028R-OSDXXX

Dual Intel Xeon E5-2650v3 (10x core)32GB of 1866 MHz DDR3 ECC SDRAM DIMMs2x 80GB boot drives 4x 800GB Intel DC D3700 (Hot-swap U.2 NVMe)1x dual port 10GbE network adaptors AOC-STGN-i2S 8x Seagate 6TB 7200 RPM SAS (ST600MN00347200)Mellanox Networking installed but not used in test

Client Systems3x Super Server 2UTwin2 (12 nodes)

Dual Intel Xeon E5-2670v264GB SDRAM DIMMs

Storage Server Software:Red Hat Ceph Storage 1.3Red Hat Enterprise Linux 7.1

5x OSD Nodes 12x Client Nodes

Shared 10G

SFP

+ Netw

orking

Monitor Nodes

Confidential

Optimal

FULL

EFFECT OF CEPH CLUSTER LOADING ON IOPS/GB

04080

120160

78

37 25 19

134

7237 36

100% Write70/30 RW

IOPS

/GB

Confidential

Optimal

FULL

010203040

18 18 19

6

34 34 36

8

100% Write70/30 RWIO

PS/G

B

CONSIDERING CORE-TO-FLASH RATIOCore and NVMe count based on 4x node cluster –Capacity Full

Confidential

Optimal

Scale-out IOP per GB4x Node Cluster Comparison

80 Cores 4x NVMe

40 Cores 4x NVMe

80 Cores 8x NVMe

80 Cores 12x NVMe

Confidential

8x Nodes in 3U chassisModel: SYS-5038MR-OSD006P

Per Node Configuration:CPU: Single Intel Xeon E5-2630 v4Memory: 32GB NVMe Storage: Single 800GB Intel P3700 Networking: 1x single-port 10G SFP+

+ +

1x CPU + 1x NVMe + 1x SFP

OPTIMAL PERFORMANCE

MicroCloud for Ceph/MySQL

https://www.redhat.com/en/resources/mysql-databases-ceph-storage-reference-architecture

Confidential

Supermicro’s Ceph Ready Nodes

X10 Models CPU/MemDrive Config

SSG-6018R-MON2Dual Intel Xeon

E5-2630 v364GB

Ix 800GB PCI-flash / NVMe

SYS-5038MR-OSD006P8x Nodes with single Intel Xeon

E5-2630 v432GB

8x Nodes, 1x NVMe per node

SSG-6028R-OSD072P Single Intel Xeon E5-2620 v364GB

(12+1)12x 6TB HDD + 1x NVMe

SSG-6048R-OSD216PDual Intel Xeon

E5-2630 v3128GB

(36+2)36x 6TB HDD + 2x NVMe

SSG-6048R-OSD360PDual Intel Xeon

E5-2690 v3256GB

(60+12)60x 6TB HDD + 12x SSD

IOP per GB(Provisioned IOP)

Throughput(MB/s)

Capacity(Cost Per GB)

Monitor Node

Confidential

Supermicro’s Red Hat Storage Ready Racks

OpenStack Starter Digital Media Serving Digital Media ArchiveStorage Nodes 10x 2U 12-Bay SSG 9x 4U 36-Bay SSG 9x 4U 60-Bay SSGInstalled OSD Drives 120 324 540HDD Bays Per Node 12x 3.5” 36x 3.5” 60x 3.5”Supported Media Types SATA, SAS, SSD, NVMe SATA, SAS, SSD, NVMe SATA, SAS, SSD, NVMeRaw Capacity (if using 8TB HDD) 960TB 2.5PB 4.3PBMemory Per Node (Ceph) 64GB DDR4 – 2133Mhz 128GB DDR4 – 2133Mhz 256GB DDR4 -2133MhzMonitor Nodes (Ceph) 3x 1U Servers (6018R-MON2) 3x 1U Servers (6018R-MON2) 3x 1U Servers (6018R-MON2)Network Switches (10G SFP+) 1x 24 Port GbE

1x 24 port 10GbE 1x 24 Port 1GbE 2x 48 Port 10GbE

1x 24 Port 1GbE 2x 48 Port 10GbE

Cabinet Dimensions 42U (82.4"Hx 23.5"Wx 48"D)Power Distribution Unit 2x 3-Phase 30A, L6-30P 2x 3-Phase 30A, L6-30P 2x 3-Phase 50A, L6-30P

10 node | Half-Rack240TB (3-way replication)

Featuring 2U/12-Bay servers

9 node | Full-Rack1.5PB usable (7+2 EC)

Featuring 4U/36-Bay servers

9 node | Full-Rack2.4PB usable (7+2 EC)

Featuring 4U/72-Bay servers

Confidential

Supermicro’s Total Solutions

Turn-key Cluster Level Solutions Validated Hardware Red Hat Storage Subscription (Turn-key) 24x7x4-Hour Service

Ready Hardware Validated Hardware Bare Metal Flexible Hardware Service Options

Ready Nodes Ready Racks Turn-key Racks Turn-key Clusters

Total SolutionReady HardwareFlexibility

Confidential

© 2016 Supermicro

Q&A

Thank you

Confidential

© 2016 Supermicro

Backup

Confidential

Supermicro FatTwin And SuperStorage Systems Power BlackMesh Managed Services

Challenges: To deliver the best customer experience and the highest degree of security to its

users in the public and private sectors Looking for an infrastructure vendor that meets all of its requirements –

particularly in regards to TCO and short product fulfillment lead times

Solutions: A 100% Supermicro server farm with over 500 systems deployed in three

highest rated Tier 4 data centers. Total capacity 1.5 PB High density and high performance FatTwin servers and SuperStorage RHEL, Red Hat Ceph, OpenStack, OpenShift, Ansible all deployed on

Supermicro

Results: Exponential growth and continuous uptime Gaining more clients, the most significant being the federal agencies that

require the highest degree of network security and reliability

“By leveraging Supermicro hardware, BlackMesh is able to maintain its goal of unlimited, on-demand support while producing cost-effective savings.”

Jason Ford, CTO of BlackMesh

Las VegasReston, VA

Toronto, ON

SuperStorage SSG-6027R-E1R12N FatTwin™

SYS-F617R2-R72+