An Industrial View of Storage,

Cloud Computing, and Big Data Cloud Computing, and Big Data

Development

Version: 1.5

12/11/2013 1

Cloud Computing Looking Back (2011–2013) Looking Back (2011–2013)

12/11/2013 2

Back In Beginning of 2011

� Amazon AWS dominated the public cloud world, with some

second tiers like Rackspace, GoGrid, competing

� Open (Web) Cloud camp, Cloudstack (Citrix), Openstack, etc.,

came on scene and thought they will dominate the world

� Big Data will be every where and storage vendors will

benefit big time from Big Data adoptionbenefit big time from Big Data adoption

� Storage cloud became popular with Dropbox service and

new entries from big and small vendors just showing up

12/11/2013 3

Now End Of 2013

� Amazon AWS dominated the public cloud world

� AWS continues dominating the public cloud space

� Big guns such as Google and VMware are moving in to compete

� Second tiers SP’s such as Rackspace, GoGrid are in danger of loosing ground

due to economics of scale

� Not many public cloud service providers, including new entries from Telco’s,

based on incumbent technologies are making moneybased on incumbent technologies are making money

� Open/Web Cloud camp, Cloudstack (Citrix), Openstack, etc.,

came on scene and thought they will dominate the world

� Open/Web cloud has made significant inroads in public cloud for new wave

applications such as Web and mobile (Baidu, Sina, etc.)

� Some incumbents such as VMware, ATT, and HP, are betting on two horses,

their proprietary and Open/Web clouds (all Openstack based)

� Adoption of Open/Web cloud for enterprise applications has been slow.

Incumbents continue their dominance within enterprise

12/11/2013 4

Now End Of 2013

� Big Data will be every where and storage vendors will

benefit big time from Big Data

� The adoption of Big Data has been relatively slow

� Storage vendors still try to find a way to make storage relevant to Big

Data

� Storage cloud became popular with Dropbox service and

new entries from big and small vendors just showing upnew entries from big and small vendors just showing up

� Dropblox becomes an analogy of storage cloud and continues its

dominance; 50M users in 2011, 100M users in 2012, and 200M users

in 2013

� Google Drive, Microsoft SkyDrive, Apple iCloud are sharing smaller

piece of pie

� Smaller storage cloud service providers are loosing ground and

struggling

� All SP’s are moving to look for opportunity in business space 12/11/2013 5

Recent Technology And Market MovementsMarket Movements

12/11/2013 6

Technology Advancements

�Commodity hardware pooling resources

�Virtualization abstracting the resources

�Automation with policy-driven provisioning and

service-level agreement

SDN/SDS – Software Defined Network and Storage

12/11/2013 7

Technology AdvancementSDN – Software Defined Networks

IDS/IPS

SLB

FW

Switch

IDS/IPS

SLB

FW

Switch

Switch

SLB

Virtual Network 2

Virtual Network 1

12/11/2013 8

Spine Switch

Leaf SwitchLeaf Switch

Storage

ServerNetwork Services

ServerServer Server

Storage Storage

Servers ServersSwitch

ServersFW

Physical Network

Technology AdvancementSDS – Software Defined Storage

MemoryCPU

High Performance

VDC with all SSD drives

SSD

MemoryCPU

SATA

Medium Performance

VDC with all SATA drives

High Performance

VDC with mixed drives

MemoryCPU

Mixed

12/11/2013 9Physical Storage Pool

Technology AdvancementsSDDS – Software Defined Data Center)

Cloud Federation

Various Application Clouds

Software-defined Dada Center•All virtualized data center resources

•Virtual server

Private Cloud• Government cloud

• Enterprise cloudPublic Cloud

• Web application

• Mobile application

• Media application

• Storage cloud

• Compute cloud

12/11/2013 10

•Virtual server

•Virtual network

•Virtual storage

Physical Data Center•All x86 commodity hardware

SDDC Example - Media Cloud

Media

Feed

Media

Ingest

Service

Streaming

ServiceVideo

Service

Storage subsystem

Media

Applications Big Data Analytics cloud

12/11/2013 11

Physical

Data

Center

Storage

Virtualization

SDDC

Abstraction

LayerNetwork

Virtualization Server

Virtualization

SDDC Abstraction

MSO

SDDC2

MSO

SDDC1 SDDC3

App

Store

SDDC5

Development/Testing

SDDC4

Incumbent vs. Open/Web Cloud

12/11/2013 12

Source: Cloudscaling

Incumbent and Open/Web Clouds Can Co-

exist Peacefully

12/11/2013 13Source: Cloudscaling

Matching Apps to Infrastructure

12/11/2013 14

Source: Cloudscaling

Big Data And StorageBig Data And Storage

12/11/2013 15

Driving Forces

Social

Networking

Internet of

Web/Mobile

12/11/2013 16

Internet of

Things

Structured

• Database

• Spreadsheet

• File in record format

Semi-structured

• XML Docs

• Logs

• Click-stream

• Equipment/ Device, RFID tag

Unstructured

• Web Pages

• E-mail

• Multimedia

• Instant Messages

• Documents

Challenges And Obstacles

Huge amount of space, both on-

line and second tier storageStorageStorageStorageStorage

Different processing model and

capability with time constrain

ProcessProcess

inging

ProcessProcess

inging

Breaking existing IT infrastructure

Lack of domain expertise and

knowledge

12/11/2013 17

capability with time constraininginginging

New infrastructure setup and

needs management skill and

expertise

ManageManage

mentment

ManageManage

mentment

New tools/workflow for analysisAnalysisAnalysisAnalysisAnalysisIntroducing new business model

and workflow

High CAPEX with uncertain return

knowledge

To Accelerate The Adoption

Public Cloud Solution Need Public Cloud Solution Need To Happen FirstTo Happen First

• Experiment it without high CAPEX investment

• Better understanding of technologies, practice, and potential returns

• More solutions are showing up, including AWS, VMware vCloud, and others

Give time to enterprise for Give time to enterprise for • Most enterprise IT infrastructure still

12/11/2013 18

Give time to enterprise for Give time to enterprise for transitioning IT transitioning IT infrastructureinfrastructure

• Most enterprise IT infrastructure still based on legacy setup; server virtualization along doesn’t cut it

• Storage infrastructure is a big part of it; it is not just for on-line compute; regulation/compliance practice need to be part of movement

Deeper integration solution Deeper integration solution with lower TCO need to with lower TCO need to

happenhappen

• Deeper hardware and software, including platform, analysis, and application, integration

• Much lower TCO

Architecture Questions To Be Answered

� Big Data To Virtualized Environment

� Dedicated Physical Compute Resource

� Low latency and high performance

� Hard to manage and provisioning when offered in public cloud setup

� Virtualized Compute Resource

� Higher latency and lower performance

� Easier to manage and provisioning when offered in public cloud setup� Easier to manage and provisioning when offered in public cloud setup

� DAS or Shared Storage For Big Data

� Direct Attached Storage

� Lower latency and higher performance

� Hard to share raw data and need to duplicate data

� Governance and compliance issues

� Shared Storage

� Higher latency and lower performance

� Easier to share raw data and no need to duplicate data

� Generally fit into existing IT infrastructure for governance and compliance

12/11/2013 19

ConclusionConclusion

12/11/2013 20

Summary

� Multiple Cloud Architectures Will Co-Exist

� Incumbent (Enterprise) cloud for legacy applications

� Open/Web cloud for Web/Mobile applications

� Software defined data center will play a key role, but not the only

solution

� Big Data Will Shine Eventually

� Enterprise IT infrastructure needs to catch up

� Fully integrated solution, from infrastructure to analysis

tools/applications, need to happen

� Storage will be a key factors to lower the cost and accelerate adoption

� Storage Cloud Needs To Move Beyond Storage Space And

Basic File Service

� Provide multiple services, file access, backup, archiving, etc.

� Need to Targeting at Business Opportunity

12/11/2013 21

Thanks & QuestionsThanks & Questions

PROMISE Technology., 2013 22