storage challenges storage today = complex & expensive storage cost and infrastructure sprawl...

31
Hybrid Storage with Storsimple Marin Frankovic Datacenter TSP [email protected]

Upload: amos-lester

Post on 18-Jan-2016

219 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

Hybrid Storage with Storsimple

Marin FrankovicDatacenter [email protected]

Page 2: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

Storage challenges

Storage Today = Complex & Expensive

Storage cost and

infrastructure sprawl

Complex data protection &

recovery

Resource constraints

Rapid data growth - 40% YoY*

* Source: EMC Digital Universe with Research and Analysis by IDC, 2014

Page 3: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

StorSimple 8000 series: Where they fit in

Applications in Physical or Virtual Servers

StorSimple Hybrid Storage Array

Customer Data Center

StorSimple 810015TB - 40TB local200TB with cloud

StorSimple 860040TB – 100TB local500TB with cloud

Consolidated storage and data

management

Access in Azure to enterprise data

StorSimple 8100, StorSimple 8600 with Microsoft Azure StorSimple Manager and Microsoft Azure StorSimple Virtual Appliance

Microsoft Azure StorSimple Manager

Microsoft AzureStorSimple Virtual Appliance

Applications in Virtual Servers

Azure Data Center

1 8000 series storage arrays are built and distributed by Seagate

Page 4: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

Tiering to Azure versus other clouds, with StorSimple

4

Features Microsoft Azure AWS, OpenStack, HP

Cloud Storage √ √

StorSimple Manager Service (in Azure)

√ √

Disaster Recovery with StorSimple Virtual

Appliance (Failover)

Applications in Azure with StorSimple Virtual

Appliance (Clone)

Migration Tool Kit √

Page 5: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

Microsoft Azure StorSimple Big PictureON-PREMISES DATA

CENTER

iSCSIInternet

connection

StorSimple Virtual Applianc

e

Administrator

CLOUD DATACENTER

Server

StorSimple Snapshot Manager Plug-in

Series 8000 Hybrid Storage

Array

StorSimple Manager

Cloud

Page 6: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

StorSimple 8000 series: Hardware specs

summaryModel Number 81001 86001

Usable Capacity 15TB 40TB

Usable SSD Capacity 800GB 2TB

Effective Local Capacity2 15-75TB 40-200TB

Max Capacity (including cloud) 200TB 500TB

Network Interface Cards 2 x 10G and 4 x 1G

Enclosure Form Factor 1 X 2U 2 X 2U

1 Storage arrays built and distributed by Xyratex; Full specifications can be found at http://storsimple.seagate.com/specifications-80002 Based on deduplication and compression; may vary by workloads and data types

Page 7: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

StorSimple 8000 series: StorSimple Virtual

ApplianceModel Number 1100

Maximum Capacity 30TB

Storage Azure BLOB

NetworkConnects to VMs via a virtual

network in Azure* No MPIO

Page 8: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

Fault tolerance of enterprise class storage

Software Feature

Protects Against?

How is works?

Controller failover

Protection against the failure of a controller.

The dual controllers are active/passive. In the event the active controller fails the passive controller automatically takes over. NVRAM mirrored across controllers via NTB.

Storage Spaces

Protection in the event of one or more drive failures.

Disk insert into and removal from pools.

Nondisruptive software upgrades (NDU)

Allows updates to be made to the operating system without taking downtime.

The software is downloaded and updated on each controller. One controller is up at all times to continue processing and serving data.

Redundant Power

Supplies

Dual Controllers

Network Interfaces

Page 9: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

Networking Physical,

Virtual Servers

VLAN1

VLAN2

Switch 1 Switch 2

Switch 3

Internet/WAN connection

CONTROLLER 1

CONTROLLER 2

NICD3

NICD3

NICMGMT

NICMGMT

NICD1

NICD2

NICD1

NICD2

NIC NIC

WAN (Corporat

e)

iSCSI should be on the storage network and it is not recommended to route the iSCSI traffic

To access azure, the firewall should allow HTTPS port (443)

If external DNS server is used, ports for DNS should be open

If external SMTP server is used for notification, port 25 should be open

Page 10: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

Local, Zone, and Geo Redundant Storage Options

Primary Location

Secondary Location

Data protection for

data in the cloud

Asynchronous replication between

Azure data centers

Replicated data does not count against data limit for the account

Prevents against a partial or complete

data center failure

Makes 3 copies of data

across separate fault

domains

Failover to alternate location

determined by Azure

operations

Page 11: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

Automatic tiering

Low Threshol

d

High Threshol

dTime

0

1

2

3

4

Oldest

DataData exceeds high watermark

Old data spills to next tier

Tier is empty in the beginning

New data is written at start of free space

Tier returns to low watermark level

DATA

DATA

DATA

DATA

Page 12: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

DeduplicationSSD HD

D4MB

64KB ChunksDedupe Algorithm

0xaab123

0xccc123

0xabc123

0xaaa123

0xbbb123

0xccc123

0xaac123

0xbbc123

0xbcc123

0xabb123

Record of hash keys already generated0xaab12

3

0xccc123

0xabc123

Page 13: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

Compression

HDD

0xaab123

0xccc123

Compress Data

Performed on data already deduplicated

Heuristics based compression to reduce CPU overhead when data is not compressible

Default algorithm is the standard DEFLATE (loss less compression)

Deduped Data

Page 14: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

Encryption

0xabc12..

Data chunk before

encryption

Data chunk after

encryption

0xabc12..

Performed deduped and compressed data

Encryption key is generated based on the seed value provided

Encryption algorithm is AES-256 with CBC

Security keys maintained by the customer, stored securely on the appliance

Compress Data

Page 15: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

Secure data throughout the solution

Account authentication with User ID, Password

StorSimple Customer defined encryption keys stored on device 2 x 512 bit keys

Account Access

Data In-flight

IT administrator

AES-256 bit encryption

Data At-restAES-256 bit encryption

StorSimple Virtual Appliance

Cloud

Page 16: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

Consolidated management of appliances

Microsoft Confidential

(Service Data Encryption Key is generated, on device console, when first device is registered)

Physical Appliance

StorSimple Manager

Physical Appliance

Virtual Appliance

StorSimple Service in Azure Management Portal

Simple, integrated workflows with other Azure entities

Manages multiple devices from a single management interface

Page 17: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

StorSimple Virtual Appliance

VM

Data

The Virtual Appliance is a software version of the physical array that runs on a VM in Azure and can be provisioned and turned-on as needed.

The StorSimple Virtual Appliance is an iSCSI target for the VMs in Azure.

A virtual network joins VMs and the StorSimple Virtual Appliance.

iSCSI Initiator

iSCSI Target

Page 18: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

IT agility in Azure with StorSimple Virtual Appliance

The StorSimple Virtual Appliance facilitates data mobility of production datasets for the purpose of disaster recovery, on-demand development and test infrastructure, and Cloud applications.

The StorSimple Manager service provides workflows for failover of datasets for disaster recovery and clone workflows for replicating production datasets in Azure for Cloud applications and development and test scenarios

Clone/Failover

Microsoft Azure

iSCSI Internet

StorSimple Manager

iSCSI

iSCSI Vol D

Vol A Vol B Vol C Vol D

Page 19: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

Local and Cloud snapshots

SSD

SAS

Local Snapshot

Cloud Snapshot

Example Group Of Data Protection Policies

Backup Type

Snapshot Type

Frequency Retention Period

Short-term backup

Local & Cloud

Daily ~1 week

Medium-term

backup

Cloud Weekly ~4 weeks

Long-term Backup

Cloud Monthly ~52 weeks

Page 20: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

StorSimple Snapshot Manager

MMC UI snap-in that lives on

application host and

communicates with

appliance(s)

Orchestrates application consistent snapshots

Manages backup policies

Restores volumes and mounts them

as NTFS folders/drives

Page 21: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

Disaster recovery

Cloud Snapshot

Secondary Datacenter

or Provisioned StorSimple

Virtual Appliance

• Thin restores provides fast recovery of data, downloading a small subset of data necessary data bring applications online. Not dependent on volume size.

• Recover data anyway: a secondary datacenter or a StorSimple Virtual Appliance in Azure

• A volume container is failed over to the destination appliance. Time to recover is the same for physical and virtual appliance

What is

needed?

Page 22: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

DR to secondary datacenter or Virtual Appliance

Microsoft Azure

Production Data Production Data

Cloud Snapshots

Datacenter-1 Datacenter-2

Periodic VSS consistent cloud snapshots of production data

Location independent recovery from cloud snapshot

Thin Instant PredictableStorSimple Virtual

Appliance

Page 23: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

File shares and archives

Before

Applications (Tier 2, & Tier

3 data)

FC/iSCSI

iSCSI

On-premise footprint

Capacity on-demand

Applications

Primary Storage

Disk-based Backup Storage

Tape Infrastructure

Archival Storage

After

Page 24: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

Remote Blob Storage repository for SharePoint

Before

AfterSharePoint

Farm

FC/iSCSI

iSCSI

On-premise footprint

Capacity on-demand

SharePoint Farm

Primary Storage

Disk-based Backup Storage

Tape Infrastructure

Archival Storage

Offsite Facility

SharePoint metadata

BLOB data

SSABLOB data

SharePoint

metadata

(SQL)

Page 25: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

Virtual machines and eliminating VM sprawl

Before

After

Primary Storage

Disk-based Backup Storage

Tape Infrastructure & Management

Archival Storage

FC/iSCSI

VMs forTier 2/Tier 3 workloads

iSCSI

Active VM data (VHDs, VMDKs)

Inactive VM data

Storage migration/

vMotion

Active VM data (VHDs, VMDKs)

Free space

InactiveSpin up

On-premise footprint

Capacity on-demand

Page 26: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

SQL for Tier-2 and Tier-3 applications

Before

Applications (Tier 2, & Tier

3 data)

FC/iSCSI

iSCSI

On-premise footprint

StorSimple Virtual Appliance and Cloud backup and DR

Applications

Primary Storage

Disk-based Backup Storage

Tape Infrastructure

Archival Storage

After

Page 27: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

Customer References

Page 28: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

28

StorSimple: Well-proven enterprise storage solution

Page 29: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

StorSimple Success in the EPG & SMS&P

Military and Aerospace

“We are saving $1M per month

with StorSimple”

-Les RowlandChief Architect of Architects, Textron (Microsoft Ignite, 2015)

British Fashion DesignerManufacturing

“Prior to StorSimple, Paul

Smith simply added more and more

storage to accommodate

growing data. Now they are using StorSimple to

create policies that archives data to

Azure storage if it hasn’t been

accessed in 12 months. “

-Richard Proud Director at Microsoft Partner, Risual, U.K.

Recent Wins!

“With StorSimple, data is copied to the

cloud in half the time, and files can be brought back

from Azure in minutes instead of

24 hours.”

-Kai SookwongseGroup Manager, Mazda North American Operations

Page 30: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

Resources for Customer engagement• Microsoft Technology Center

• StorSimple is located in 30 MTC locations globally• http://www.Microsoft.com/mtc

• Microsoft Datacenter • Tour Microsoft Datacenter with customers• http://www.Microsoft.com/datacenters

• Total Datacenter Immersion • StorSimple customer experience through immersion• http://

www.microsoft.com/enterprise/en-bd/transform-the-datacentre-immersion/default.aspx#fbid=X6845JFjYCE

Page 31: Storage challenges Storage Today = Complex & Expensive Storage cost and infrastructure sprawl Complex data protection & recovery Resource constraints

© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.