“psam”, necpciessd appliance for microsoft sqlserver · capacity per node * •max capacity...

“PSAM”, NEC PCIe SSD Appliance for Microsoft® SQL Server®

(Reference Architecture)

September 4th, 2014NEC Corporation

© NEC Corporation 2014

1. Overview ofNEC PCIe SSD Appliance for Microsoft® SQL Server®


NEC PCIe SSD Appliance for Microsoft SQL Server- Customer’s Pain : Background of the Solution -

▌System bottleneck from performance gap between in-box memory / storage and external disksl Performance tuning is getting more

complicated, needs a lot of external storage and Host Bus Adapters to provide enough IO bandwidth for ahigh-performance system

▌Balanced CPU-IO configuration restricted by the latest QPI architecture-based processorsl The architecture requires extra CPU

sockets, even if customer just wants to have more IO slots (or memory). The extra CPU sockets contribute to increased power consumption and system cost

PCIe

slot

DIMM DIMMDIMM DIMMDIMM DIMMDIMM DIMM

DIMM DIMMDIMM DIMMDIMM DIMMDIMM DIMM

PCIe

slot

PCIe

slot

Mem

ory

Con

trolle

rM

emor

yC

ontro

ller

IO Controller

CPUQPIQPIQPI

QPI based CPU

* QPI = Quick Path Interconnect(Interconnect between CPUs)

1TB

10TB

100TB

1PB

<ns <1us <150us ~2ms ~8ms ~20ms

SATADisk Array

SASDisk Array

SASSSDPCIe

SSD

CPU Cache

(Access latency)

(Storage Capacity)

Huge Performance gap

DRAM

“PCIe SSD (server-mounted flash storage)” and “Rich IO slots (per CPU)” are the keys to solve those issues


NEC Solution Platformsの露出用記載文言は検討中

l High-performance and high availability appliance system (reference architecture) with no external storageü NEC Express5800 Scalable Enterprise Server-based “all in a box” solution combined

with high-performance HGST FlashMAX II PCIe server-mounted flash storagel Best practice configuration fully utilizing NEC’s knowledge of SQL Server

ü Support the latest Microsoft SQL Server “SQL Server 2014” ü Balanced CPU-IO performance depending on number of Flash MAX II

(i.e., depending on data size )ü No data lost by utilizing mirrored storage pool feature of Windows OS

Proven performance reference architecture for TCO optimization- Best fit for High-Performance & Scalable DWH/BI/OLTP system -

High band widthLow Latency

10G Ether

AlwaysOn AG two node cluster model

NEC PCIe SSD Appliance for Microsoft SQL Server- Overview -

Single Node model

Express5800 Scalable Enterprise Server • Max. 4 Intel® Xeon® Processor

E7 v2 family CPU• Max. 4TB memory • Max. 16 slots of PCI-Express 3.0

(Class No.1 rich IO slots)


2. Reference configuration ofNEC PCIe SSD Appliance for Microsoft® SQL Server®


Ø Optimized performance combining fast clock CPU (E7-8893 v2:6C, 3.4GHz) and high-performance HGST FlashMAX II PCIe server-mounted flash storage (FM2)

Ø No data loss by utilizing software-mirrored storage pool feature of Windows OSØ Balanced CPU-IO performance depending on number of FM2 (i.e., data size )

• 1CPU (3.4GHz, 6C)• 128GB RAM • 2x FM2 in mirrored

storage poolExpress5800 Scalable Enterprise Server

Internal Drive

QPI

128GBRAM

FlashMAX II

FlashMAX II

E7-8893

v2SW Mirroring

128GBRAM

FlashMAX II

FlashMAX II

E7-8893

v2SW Mirroring


storage pool

Scale Up


storage poolScale Up


storage pool

Scale Up

SW Mirroring

128GBRAM

FlashMAX II

FlashMAX II

E7-8893

v2

128GBRAM

E7-8893

v2SW Mirroring

FlashMAX II

FlashMAX II

NEC PCIe SSD Appliance for Microsoft SQL Server- Reference configuration per node -


CPU and Memory1CPU128GB RAM

2CPU256GB RAM

3CPU384GB RAM

4CPU512GB RAM

Express5800 Scalable Enterprise Server 1 1 1 1Built-in DVD-ROM Drive 1 1 1 1Additional CPU （E7-8893 v2, 6 core） 1 2 3 4Memory Riser 2 4 6 8

16GB additional memory (8GB DIMM x2) 8 16 24 3210KRPM 600GB HDD 3 5 5 7RAID SAs-Controller (1GB, RAID 0/1/5/6) 1 1 1 11000BASE-T Network Adopter (4 port) 1 2 3 4

1.1TB FlashMAX II

# of card 2 4 6 8Maximum Physical Storage Capacity per node *•Max capacity mode•Mirrored Storage Pool

1.1TB 2.2TB 3.3TB 4.4TB

Reference configuration as single node Data Warehouse system

* Data capacity after compression. About 1/3.5 of logical user data capacity before compression



2CPU256GB RAM

3CPU384GB RAM

4CPU512GB RAM

Express5800 Scalable Enterprise Server 1 1 1 1Built-in DVD-ROM drive 1 1 1 1Additional CPU （E7-8893 v2, 6 core） 1 2 3 4Memory Riser 2 4 6 816GB additional memory (8GB DIMMx2) 8 16 24 3210krpm 600GB SAS-HDD 3 5 5 7RAID SAS-Controller (1GB, RAID 0/1/5/6) 1 1 1 11000BASE-T Network Adopter (4 port) 1 2 3 4

1.1TB Flash MAXII

# of card 2 4 6 8Maximum Physical Storage Capacity per node• Max Performance mode•Mirrored Storage Pool

0.9TB 1.7TB 2.6TB 3.4TB

Reference configuration as single node OLTP system



3CPU384GB RAM

4CPU512GB RAM

Express5800 Scalable Enterprise Server 1 1 1Built-in DVD-ROM drive 1 1 1Additional CPU （E7-8893 v2, 6 core） 2 3 4Memory Riser 4 6 816GB additional memory (8GB DIMMx2) 16 24 3210krpm 600GB SAS-HDD 5 5 7RAID SAS-Controller (1GB, RAID 0/1/5/6) 1 1 11000BASE-T Network Adopter (4 port) 2 3 4

1.1TB FlashMAXII

# of card 4 6 8Maximum Physical Storage Capacity per node• Max Performance mode•Mirrored Storage Pool

1.7TB 2.6TB 3.4TB

10GBASE Network Adopter (SFP+/2 port) 1 1 1

Reference configuration as two node OLTP system

(configuration per node)


3. Performance of NEC PCIe SSD Appliance for Microsoft® SQL Server®

as Dara Warehouse system


Configuration for DWH performance comparison

NEC PCIe SSD Appliance for Microsoft® SQL Server®

Express5800/A1080a-SFTRA DWH

CPU E7-8893 v2 (6C, 3.4GHz) E7-8870 (10C, 2.4GHz)

CPU socket count 1 2 3 4 2

Total core count 6 12 18 24 20

Physical memory capacity 128GB 256GB 384GB 512GB 128GB

Storage configuration1.1TB FlashMAX II (Max Capacity Mode)

Mirrored storage pool configurationiStorage M100 x3

(72 450GB 10krpm SAS-HDD)RAID-10 18 pair1set 2 sets 3sets 4 sets

Physical Storage Capacity 1.1TB 2.2TB 3.3TB 4.4TB 16.2TB

PhysicalCapacity

perUsage

User data** Data capacity after compression

About 1/3.5 of logical user data capacity before compression.

~0.5TB ~1.0TB ~1.5TB ~2.0TB 8.0TB

Transaction log ~0.2TB ~0.4TB ~0.6TB ~0.8TB 3.5TB

tempdb ~0.3TB 0.6TB ~0.9TB ~1.2TB 4.5TB

DWH performance comparison with Express5800/A1080a based FTRA DWH using Microsoft Fast-track Data Warehouse Benchmark tool.

（FTRA DWH =Microsoft SQL Server Fast Track Data Warehouse)

Single Node DWH Performance (1/2)


Performance comparison using Microsoft Fast-track Data Warehouse benchmark tool

Single Node DWH Performance (2/2)

1,425

3,422

4,820

8,234

4,759

0.36 0.30 0.32 0.25 1.72 0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

0

1,000

2,000

3,000

4,000

5,000

6,000

7,000

8,000

1P6C 2P12C 3P18C 4P24C 2P20C

Benchmark Logical Scan rate [MB/s]

Read time to scan all user data [s]

NEC PCIe SSD Appliance for Microsoft SQL Server（E7-8893v2 3.4GHz）

Fast-track Data ware house NEC Express5800 A1080a-S

（E7-8870 2.4GHz）


Express5800 A1080a-S baseMicrosoft Fast-track Data Warehouse

NEC PCIe SSD Appliance forMicrosoft® SQL Server ®

4P24C (3.4GHz) + 512GB RAM

Total 72 SAS-HDD drives

8G-FC channels x12(2p 8G-FC HBA x6)

Performance boost with significant TCO saving

All-n-a-boxSolution

To Balance CPU power and IO bandwidth,

12 FC channels and 72 HDDs are required

69% less rack space13U 4U

173% better performance

Rack space

27% less power consumption2,125W 1,551WPower Consumption

Benchmark logical scan rate • Microsoft Fast-track Data ware

house benchmark tool

4,759MB/s 8,234MB/s

Benefit as Data Warehouse system

2P20C (2.4GHz) + 128GB RAM


4. Performance ofNEC PCIe SSD Appliance for Microsoft® SQL Server®

as single node OLTP system


Configuration for OLTP performance

Comparison


Express5800/A1080a-S+ External FC storage

CPU E7-8893 v2 (6C, 3.4GHz) E7-8870 (10C, 2.4GHz)

CPU socket count 1 2 3 4 2

Total core count 6 12 18 24 20

Physical memory capacity 128GB 256GB 384GB 512GB 256GB

Storage configuration1.1TB FlashMAX II (Max Performance Mode)

Mirrored storage pool configurationiStorage M100 x1

(24 450GB 10krpm SAS-HDD)RAID-10 6 pair1set 2 sets 3sets 4 sets

Physical Storage Capacity 0.9TB 1.7TB 2.6TB 3.4TB 5.4TBPhysical

Capacityper

Usage

User data ~0.5TB ~1.0TB ~1.5TB ~2.0TB 3.6TB

Transaction log ~0.2TB ~0.4TB ~0.6TB ~0.8TB 1.0TB

tempdb ~0.2TB ~0.3TB ~0.5TB ~0.6TB 0.8TB

Single Node OLTP Performance (1/2)

OLTP performance comparison with “Express5800/A1080a-S + external FC storage system” using “Hammer DB” benchmark tool.


54

95

131

178

100

27 50

71 91

4

50% 47% 46%49%

96%

0%

25%

50%

75%

100%

0

50

100

150

200

1P6C 2P12C 3P18C 4P24C 2P20C

Relative performance of Optimized I/O scenarioRelative performance of Non-Optimized I/O scenarioPerformance down rate between 2 scenarios （%）

ü NEC Express5800 A1080a-S performance of optimized I/O scenario is the base performance of the relative performance comparisonü Optimized IO scenario ： Minimize IO by enabling Server side memory caches and Storage side cache.ü Non-optimized IO scenario： Maximize IO by disabling Server side memory caches and Storage side cache.

Performance comparison using HammerDB benchmark toolRelative performance Performance down rate

Single Node OLTP Performance (2/2)

NEC PCIe SSD Appliancefor Microsoft SQL Server（E7-8893v2 3.4GHz）

NEC Express5800 A1080a-S(E7-8870 2.4GHz）+ iStorage M100 x1


Express5800 A1080a-S+iStorage M100


2P20C (2.4GHz) + 256GB RAM


4P24C (3.4GHz) + 512GB RAM

8G-FC channels x 4 (2p 8G-FC HBA x 2)

Achieve high performance even in heavy IO stress, requires less DB tuning cost (i.e., less system integration cost)

53% less impact of IO96% 49％OLTP performance down ratio between the optimized IO scenarioAnd Non-optimized IO scenarios ＊1,3

178% better performanceRelative OLTP performance (TPS) comparison for optimized I/O scenario *1, *2

100 178

*1 Relative performance comparison using HammerDB benchmark tool*2 Optimized IO scenario ： Minimize IO by enabling Server side memory caches and Storage side cache.*3 Non-optimized IO scenario： Maximize IO by disabling Server side memory caches and Storage side cache.

All-in-a-boxsolution

Benefit as single node OLTP system


5. Performance ofNEC PCIe SSD Appliance for Microsoft® SQL Server®

as two node cluster OLTP system


Configuration (per node)for OLTP performance

Comparison


Express5800/A1080a-S+ External FC storage

CPU E7-8893 v2 (6C, 3.4GHz) E7-8870 (10C, 2.4GHz)

CPU socket count 2 3 4 2

Total core count 12 18 24 20

Physical memory capacity 256GB 384GB 512GB 256GB

Storage configuration

1.1TB FlashMAX II (Max Performance Mode)

Mirrored storage pool configuration

iStorage M100 x1(24 450GB 10krpm SAS-HDD)

RAID-10 6 pair2 sets 3sets 4 sets

Physical Storage Capacity 1.7TB 2.6TB 3.4TB 5.4TBPhysical

Capacityper

Usage

User data ~1.0TB ~1.5TB ~2.0TB 3.6TB

Transaction log ~0.4TB ~0.6TB ~0.8TB 1.0TB

tempdb ~0.3TB ~0.5TB ~0.6TB 0.8TB

Two Node OLTP Performance (1/2)

OLTP performance comparison with “Express5800/A1080a-S + external FC storage system” using “Hammer DB” benchmark tool.


80

124

165

100

57

88

113

2

29% 29% 32%

98%

0%

25%

50%

75%

100%

0

50

100

150

200

2P12C 3P18C 4P24C 2P20C

Relative performance of Optimized I/O scenarioRelative performance of Non-Optimized I/O scenarioPerformance down rate between 2 scenarios (%)

Performance comparison using HammerDB benchmark tool

ü NEC Express5800 A1080a-S performance of optimized I/O scenario is the base performance of the relative performance comparisonü Optimized IO scenario ： Minimize IO by enabling Server side memory caches and Storage side cache.ü Non-optimized IO scenario： Maximize IO by disabling Server side memory caches and Storage side cache.

Two Node OLTP Performance (2/2)

Relative performance Performance down rate

NEC PCIe SSD Appliancefor Microsoft SQL Server（E7-8893v2 3.4GHz）

NEC Express5800 A1080a-S(E7-8870 2.4GHz）+ iStorage M100 x1


Express5800 A1080a-S+iStorage M100


2P20C (2.4GHz) + 256GB RAM


4P24C (3.4GHz) + 512GB RAM

8G-FC channels x 4 (2p 8G-FC HBA x 2)

Achieve high performance even in heavy IO stress, requires less DB tuning cost (i.e., less system integration cost)

34% less impact of IO98% 32％OLTP performance down ratio between the optimized IO scenarioAnd Non-optimized IO scenarios ＊1,3

165% better performanceRelative OLTP performance (TPS) comparison for optimized I/O scenario *1, *2

100 165

*1 Relative performance comparison using HammerDB benchmark tool*2 Optimized IO scenario ： Minimize IO by enabling Server side memory caches and Storage side cache.*3 Non-optimized IO scenario： Maximize IO by disabling Server side memory caches and Storage side cache.

All-in-a-boxsolution

Benefit as two node OLTP system


6. Recommendation to improve availability of the system


EXPRESSCLUSTER X SingleServerSafe （SSS)

▌What is EXPRESSCLUSTER X SSS ?

lEXPRESSCLUSTER X SSS is a program product which monitors abnormality of HW & SW, recovers them from failure, and improves availability of the system.

lEXPRESSCLUSTER X SSS contributes to reinforce fault resiliency of 2 node AlwaysON AG system also.üAdditional to monitoring targets of the AlwaysOn, improve

fault resiliency of the 2 node system by monitoring• Disk failure:

Restarts the node, then fail over to the secondary node to continue operation.

• LAN failure of the secondary “read only” node: Change routing of “read only access” from the faulty node to the other heathy node (in 2 node system, primary node) to continue system operation.

Router, other network devices

Application layer

OS layer

Hardware layer NIC

NIC

Monitoring agent

App

Systemdisk

OS space

Presence monitoring

Stall monitoring

Ping check monitoring

Link-down monitoring

Access Check

Response monitoring

X SingleServerSafe

To reinforce availability of the system, it is recommended to install EXPRESSSLUSTER X SSS

PCIeSSD


▌Application layer:lPresence monitoring of process

•Restarts when process abnormality is detected

lMonitoring agent•Restarts when abnormality in SQL, HTTP and so on is detected

▌OS layerlUser space monitoring

•Restarts when abnormality in AP layer such as hang-up is detected.

▌Hardware layerlAccess check

•Restarts when disk/PCIeSSD access abnormality is detected.

lPing monitoring•Restarts when ping abnormality is detected.

lNIC Link UP/DOWN monitoring•Restarts when link-down is detected.•Availability can be improved by NIC duplication.

▌Accurate monitoring to check the actual statusRouter, other network devices

Application layer

OS layer

Hardware layer NICNIC

Monitoring agent

App

Systemdisk

OS space

Presence monitoring

Stall monitoring

Ping check monitoring

Link-down monitoring

Access check

Response monitoring

X SingleServerSafe

EXPRESSCLUSTER X SSS’s target of monitoring

PCIeSSD


7. SummaryBenefit ofNEC PCIe SSD Appliance for Microsoft® SQL Server®


Benefit of NEC PCIe SSD Appliance for Microsoft® SQL Server ®

Balanced and Predictable Performance Easy to introduce TCO reduction

Initial Cost

Operating Cost

Time to introductionDown

• Balanced and Proven CPU-IO Performance depending on number of Flash MAX II.

• Consistent high-performance even under heavy IO load.

• Customer can choose bestpractice configurationdepending on data size.

• Cook book (Configuration guide, including best parameter setting) will be available *

• Less platform integration cost• Less Rack apace• Less Power Consumption

Express5800Scalable Enterprise Server

High-performancePCIe server-mounted flash storage

Ｘ

* Pre-configurationand Pre-installationAre subject of discussion


Image of Big Data Analytics Solution built on NEC PCIe SSD Appliance for Microsoft® SQL Server®

EnterpriseSystem

Customer Data

Web site Blog

SMS

TARO SUZUKITARO SUZUKI 08/07

Smart Device

SQL Server 2014Analysis Services

INPUT Big Data Analytics PlatformStore data into High-Performance

PCIe server-mounted flash storageProcess &

Aggregation

Data Scientist

End userData Extract

NEC PCIe SSD Appliancefor Microsoft® SQL Server®

“Microsoft SQL Server 2014” equipped with ETL, DB, BI, Data Mining, easy-to-use “Excel & Power BI” and “NEC PCIe SSD Appliance for Microsoft® SQL Server®” provide Low-Cost All-in-One Big Data Analysis Platform


NEC brings together and integrates technology and expertise to create the ICT-enabled society of tomorrow.

We collaborate closely with partners and customers around the world, orchestrating each project to ensure all its parts are fine-tuned to local needs.

Every day, our innovative solutions for society contribute to greater safety, security, efficiency and equality, and enable people to live brighter lives.

“psam”, necpciessd appliance for microsoft sqlserver · capacity per node * •max capacity...

Documents