next generation datacenter xtremio and …...xtremio controller xtremio –no system level tax •...

1© Copyright 2015 EMC Corporation. All rights reserved.

Aleksandr Shvadtshenko, Sr Systems Engineer, EMC Baltic States

NEXT GENERATION DATACENTERXTREMIO and SCALEIO


EVERY BUSINESS WILL BE REDEFINED


NEW DIGITAL ERA APPS

IMAGES

VIDEO

LOCATION

DOCUMENTS

EACH USER =1,000X MOREDATA

“Catch people or things in the act of doing something and affect the outcome”

EACH APP HAS1,000X MORE

USERS


3RD PLATFORM

BILLIONS OF USERS MILLIONS OF APPS

LAN/Internet Client/Server

PC

2ND PLATFORM

HUNDREDS OF MILLIONS OF USERS TENS OF THOUSANDS OF APPS

Mainframe, Mini Computer

Terminals

1ST PLATFORM

MILLIONS OF USERS

THOUSANDS OF APPS

Mobile Cloud Big Data Social

Mobile Devices

BUILT ON A NEW PLATFORM


HYPERCONVERGED INFRASTRUCTURE


HYPERCONVERGED INFRASTRUCTURE

+

MEMORYCOMPUTE NETWORK

+

MANAGEMENT

+

6

STORAGE

+

VIRTUAL VIRTUAL VIRTUAL VIRTUAL VIRTUAL

EMC

SIMPLE TO MANAGE

SOFTWARE DEFINED

SCALE OUT ARCHITECTURE

EMCEMC


INDUSTRY TRENDS:

BUILDING BLOCKS FOR NEXT GENERATION DATACENTER

Flash TrendNew Levels of Performance

COTS TrendNew Levels of Efficiency

Software-Defined Data Center Trend

Hybrid Cloud Trend

Next Generation Applications TrendPaaS, Mobile, Hadoop

Converged Infrastructure Trend

2 Key Changes To The Underlying Storage Market

Elastic, Agile, Data Center Running Next Generation Apps

Which Will Be Deployed In CI

Which Will Be Used As Building Blocks

Which Will Enable Hybrid Clouds


All-Flash Arrays (AFA)


• This research shows that

flash will become the lowest

cost media for almost all

storage from 2016 and

beyond, and that a shared

data philosophy is required

to maximize the potential

from both storage cost and

application functionality

perspectives.

Evolution of All-Flash Array Architectures

http://wikibon.org/wiki/v/Evolution_of_All-Flash_Array_Architectures

http://wikibon.org/wiki/v/Evolution_of_All-Flash_Array_Architectures


Why Flash?

Challenge #1:

• Latency– Bad user experience

– Application timeout

– Lost time = money


Why Flash?

Latency cause: CPU – HDD performance gap

2000 2010 2020

LATENCY

10000x100x 800x

CPU IS FAST AND GETS FASTER×DISK IS SLOW AND DOES NOT GET ANY FASTER


Why Flash?

Solution: Flash will close the performance gap

2000 2010 2020

10000x100x 800x

CPU IS FAST AND GETS FASTERFLASH IS FAST AND GETS FASTER


XtremIO Sudden Impact - SQL Server


Business Value of next generation All-Flash-Array:

• Faster Applications -> Happier users

• More Transactions -> More sales

• Faster reports -> Instant business decisions

lu’re business will run faster

Able to trade for 40 minutes

extra per day = £156,000 per day


The Evolution of “FLASH” Arrays

Flash Optimized Hybrids• Dual Controller

• Limited Scale

• Single Workloads

• Some Data Services

Gen 2

Scale Up All Flash Arrays• Dual Controller

• Limited Scale

• Single Workloads

• “Sometimes” Data Services

• Compromise Between

• Performance &

• Efficiency - Data Svcs

Gen 3

Scale Out All Flash Arrays

• Multi Controller (16-XtremIO)

• Petabyte Scale

• Mixed Workloads

• In-Line Data Services

• Lowest TCO

• Highest Performance

• All Flash Data Center

Gen 4

Gen 1

Fla

sh S

yste

ms

Legacy D

isk A

rrays

Gen 1

Source: Wikibon December 2014


Avoiding Bad Design Choices

5 Common Things AFAs Borrow from Disk

Log Structuring

Metadata De-stage

RAID

Post-Process

Parity

Parity

Parity

Parity

Uneven SSD wear

Performance inconsistency

SSD Wear - Write Amplification

Performance inconsistency

XTREMIO DOES NOT USE ANY OF THESE

Asymmetric Controllers Uneven Resource UtilizationPA

17© Copyright 2014 EMC Corporation. All rights reserved. 17© Copyright 2014 EMC Corporation. All rights reserved.

XTREMIO DATA PROTECTION

• Designed for SSD

• No legacy RAID baggage

• Highly efficient- only 8% overhead

• Lowest write amplification

• SSDs may fail in place

• No configuration

• No hot spares

• Adapts to failures

Good CapacityUtilizationRAID 5

HighPerformance

RAID 1

SuperiorProtection

RAID 6

XDP


Array Controller

Typical AFA System Level Garbage Collection

• Huge back-end I/O amplification initiated by array controller• Cannot defer process when array must free up space• Big tax on array controllers to manage – limits capacity


XtremIO Controller

XtremIO – No System Level Tax

• SSD controllers have ideal knowledge of the NAND• Zero back-end I/O initiated by the array controllers • No tax on array controllers

ASIC ASIC ASIC ASIC ASIC ASIC ASIC ASIC ASIC

Performed by Each SSD Controller ASIC

No Garbage Collection


Why Customers Choose XtremIO

Consistent High Performance & Low LatencyActual customer data | Workload: OLTP with 8KB Block Size

Traditional Flash ArrayXtremIO ‘X-Brick’

Late

ncy Latency Spikes • 2-4.5ms = Gen 3 Flash

• Various latency spikes

• <1ms = XtremIO• Consistent & Predictable (~0.5ms)

Late

ncy • 20-40ms = Gen 3 Flash

• Latency increases with capacity

• <1ms = XtremIO• Always Consistent & Predictable

System-Level Garbage Collection Impact

Worse than Disk Latency


Architecture Matters Part 2

TYPE

1Scale Up

• Dual Controller• Shared Meta-Data

• Mid-Tier Architecture

TYPE

2Tightly CoupledScale-Out

• Multi-Controller Grid• Shared Meta-Data

• Enterprise Architecture

TYPE

3Loosely CoupledScale Out

• Independent Controllers• Distributed Meta-Data• Large Content Repositories

TYPE

4DistributedShare Nothing

• Independent Controllers• Distributed Meta-Data• Non-Transactional Commits

VNX Isilon vSANIsilonVMAXXtremIO

Why Scale-Out is Critical for AFAs

• Controllers are the Bottleneck• No front-end relief in Scale Up

• Limited CPU for Data Services

• Linear Scaling – Iops & Latency

• 7+ Year Asset Lifecycle• No performance tech refreshes

• Xpect More Program

• Superior Resiliency & Performance• N-Way Active/Active Architecture


Scale Up XtremIO Scale Out

Controller 2

Controller 1

Controller 4

Controller 3

Controller 6

Controller 5

Controller 8

Controller 7

Controller 10

Controller 9

Controller 14

Controller 13

Controller 16

Controller 15

Controller 12

Controller 11

SC

ALE

AC

TIV

E

SC

ALE

AC

TIV

E

15

0K

IO

PS

2

M I

OP

S

16

AC

TIV

E C

ON

TR

OLLER

S

Passive Active

Flash

Flash

Flash

SAN


5–320TB physical, PBs effective capacity based on 10, 20, & 40 TB X-Bricks

NO TUNINGSCALE-OUT RICH DATA SERVICES<1ms LATENCY

© Copyright 2015 EMC Corporation. All rights reserved.

Starter 5TB

Product Family,

On-Demand Linear Scale-Out

150K mixed IOPS250K read IOPS<1ms Latency

From 2 – 16 N-way Active Controllers1.2M mixed IOPS

2M read IOPS<1ms LatencyPBs Capacity


ACTIVE CONTROLLER 1

Infiniband RDMA

2 x FC2 x iSCSI

2 x FC2 x iSCSI

ControllerRAM

ACTIVE CONTROLLER 2

Cluster Building Block

XtremIO X-Brick

32CPU

Cores

512GB RAM

4Host Ports

25eMCLSSDs

SAS 2.0 SAS 2.0

ControllerRAM


XtremIO In-MEMORY Metadata

XtremIO scales-out. Granular metadata is distributed across controllers in a shared memory fabric.

USER DATA USER DATA USER DATA USER DATA

PERFORMANCEConsistent & predictable

AMAZINGMetadata heavy operations

REMOTE DIRECT MEMORY ACCESS FABRIC


Efficient IN-MEMORY VM cloning with XtremIO

X-COPY / ODX COMMAND

IN-MEMORY METADATA

UNIQUE, COMPRESSED USER

DATA ON SSDBLOCK BLOCK BLOCK BLOCK

• Instantly provision 1000s of VMs• Metadata only operation; no disc IOs• No storage sprawlHypervisor


Today’s Applications Environment

PRODUCTION

6DATABASECOPIES 3 ARRAYS/POOLS 1

USE CASE FOR FLASH

LIMITEDTEST/DEVCOPIES

BruteForceCopy

BruteForceCopy

DATAMARTCOPIES

JUST

ONEAPPLICATION


Game-Changing Consolidation, Agility

1 XTREMIO CLUSTER1 0DATABASEINSTANCES 0

BRUTE FORCE COPIESx

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

TEST/DEV COPIES HIGH PERFORMANCE PRODUCTION

FREE, FAST DEV/TEST

DATAMART COPIES

FIN COPY

OPS COPY

SALES COPY

FREE, FAST ANALYTICS

FIN COPY

OPS COPY

SALES COPY

REPORTS

ANALYTICS

TRENDS

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

SCALE-OUTIOPS IN

ABUNDANCE

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

DEV INST 1

DEV INST 2

DEV INST 3

XTREMIOFLASH FOR

ENTIREAPPLICATION

FASTERAPPLICATIONDEVELOPMENT

TIMES

MOREBUSINESS

PRODUCTIVITY

FIN COPY

OPS COPY

SALES COPY

FIN COPY

OPS COPY

SALES COPY

REPORTS

ANALYTICS

TRENDS


Business Value#2 of next generation All-Flash-Array

• Faster Development Copies -> Faster development

• More Testing Copies -> More testing and improved quality

• More & Faster Develoment Resources -> Better code and less bugs

lu’re business will run faster


HA/BC, App Management, Converged Infrastructure

DATA CENTER SERVICES

Linear Scale IOPS, Bandwidth & Capacity

XtremIO’s Unique ArchitectureConsistent Predictable Performance + Efficiency

SCALE OUT

INLINE AND UNSTOPPABLE DATA SERVICES

Data Reduction Efficiencies, In-Memory Metadata

linear scale out sub 1ms latency

Self Service Provisioning and Orchestration

Storage Resource

Management

Enterprise Multi

Pathing

Converged Infrastructure

VSI, DB, VDI

2-3 Site Continuous

Availability

Virtualization Management

Integration (VMW & MS)

EMC Storage Analytics

Vmware vRealize Ops

Database Consistent Snapshot Management

Continuous Data Protection and

Disaster Recovery

Validated ReferenceArchitectures

Intelligent vSphere

VAAI Integration

Thin Provisioning

Deduplication

Compression

Flash Data Protection

Encryption

Writeable Copies


MAINTENANCE PRICE PROTECTION

7 YEARS

3-YEAR MONEY-BACK WARRANTY

2015-2018

FLASH ENDURANCE PROTECTION

7 YEAR

S

* For qualifying customers through December 31, 2015. See EMC.com/XpectMore for details, terms and conditions.

XPECT MORE PROGRAM*

EMC IS REDEFINING THE STORAGE LIFECYCLE

http://emc.com/XpectMore


The Rise of Server SAN


The Rise of Server SAN

http://wikibon.org/wiki/v/The_Rise_of_Server_SAN

http://wikibon.org/wiki/v/The_Rise_of_Server_SAN


Hyper-converged, software-defined block storage for commodity hardware

Software that creates a server-based SAN from local storage to deliver performance and capacity on demand

Run storage and applications in the same server(s)

Leverages any media (HDDs, SSDs, & PCIe flash)

Runs on physical & virtual servers

Introducing EMC ScaleIOSoftware Defined, Scale-Out SAN

© Copyright 2015 EMC Corporation. All rights reserved.


ScaleIO SDC & SDS

ScaleIO Data Client

• Lightweight device driver

• Allows ScaleIO block devices to be presented to application server

ScaleIO Data Server

• Manages storage capacity on the application/storage server

• Provides backend access of devices to the SDCs


scaleIO hyperconvergance: resource utilization

ScaleIO architecture

• Impact on server is below 10% CPU load

Maximum IOPS load on 10K pool

Maximum IOPS load on SSD pool


PERFORMANCE Scales Linearly

ScaleIO

• ~31M IOPs is about 8X better than the latest high-end HDS storage (G1000) for a fraction of the cost

• If we were to extrapolate the lines, we would get ~180M IOPs for 1024 Nodes (~46 G1000 systems…)


• Auto-balance of resources across nodes/clusters

• Auto-rebalance when resources are added

• Auto-rebuild when resources fail or removed

Elastic architectureAdd, remove, re-allocate, on the fly

BALANCED

BALANCED

BALANCED

BALANCED

BALANCED

Easier Capacity Planning No Migrations

40© Copyright 2015 EMC Corporation. All rights reserved.© Copyright 2015 EMC Corporation. All rights reserved.© Copyright 2015 EMC Corporation. All rights reserved.

ENTERPRISE GRADE

PERFORMANCE INTEROPERABILITY MONITORING FAULT TOLERANCE RESILIENCY

MULTI-TENANCY PROTECTION SECURITY ELASTICITY EFFICIENCY

SNMP &Call Home

Openstack CinderRestful API

Data maskingMDM & SDC

IOP and QoSControls

Flash Cache RecoverPointRack LevelHigh Availability

Automatic Rebalance

Thin ProvisioningWriteableSnapshots

APP 1

APP 2

APP 3


PERFORMANCE

MB/S & IOPS

READS/WRITES

VIEW AGGREGATE

CAPACITY

SCALEIO NODE COUNT

• Automated installation scripts and easy configuration

• Manage the entire data center stack from single UI

• Monitor HW/SW failure recovery—no administrative intervention required

• Options: CLI, UI, REST, ViPRController, ViPR SRM, vSphere, OpenStack

• Call-home and incident reporting

System wide visibility, cost effective management at scale

ScaleIO


VCE VxRack

ScaleIO NodeScaleIO SW

3 SCALEIO CONSUMPTION MODELS

Ultra Scale-Out SDS

Scale-Out Block Storage Node

Turnkey Fully Engineered Solution

Software DefinedMaximum flexibility

Software DefinedControlled Environment

Software Only Complete flexibility End user supplies server End user supplies switch

HW + SW Bundle Package High degree of flexibility/

choice Primarily a SAN.Next Use

Case

Fully integrated Application platform

Primarily Infrastructure.Next Use Case


ScaleIO SW + commodity Server bundle

ScaleIO node

Software• Proprietary EMC

SW• Fully supported

by EMC

ScaleIO Node• Bundled ScaleIO

SW + EMC commodity server

• Full EMC supported SW and HW

EMC Commodity Server Node• Fully tested by

EMC• Fully supported

by EMC

Available but optional: switches, mgmt. server, EMC rack and Network Interconnects


SUPREMEELASTICITY

MASSIVESCALABILITY

UNPARALLELED FLEXIBILITY

EXTREME PERFORMANCE

COMPELLING ECONOMICS

30-60%

TCO Savings

Up To

1k+NODES

Scales To

EFFICIENCY

50%

Over Traditional SAN

8xATTAIN

better performance than

TRADITIONAL SAN

Benefits of Software-defined-storage:


www.emc.com/products-solutions/trial-software-download/

Free Software Downloads

http://www.emc.com/products-solutions/trial-software-download/


HOW TO BRIDGE 2ND AND 3RD PLATFORM ARCHITECTURE?

COTS, Storage SoftwareBlades, Virtualization, Arrays


ViPR CONTROLLER CLOAKS & MANAGES ALL

Control

Abstraction

IsilonVMAXEMC

ScaleIOVNX VBLOCK XtremIO

DIAMOND

GOLD

SILVER

BRONZE


ViPR service catalog


CoPRHD @ emccode.github.io

{code}

[email protected]

@EMCCode

http://emccode.github.io

http://blog.emccode.com

http://dasboard.emccode.com


TOP 3 STRATEGIC TRENDS

1. Converged and Hyperconverged Infrastructure

2. The Rise of Server SAN

3. All-Flash Arrays

next generation datacenter xtremio and …...xtremio controller xtremio –no system level tax •...

Documents