vmworld 2013: software-defined storage: the vcdx way
DESCRIPTION
VMworld 2013 Wade Holmes VCDX, VMware Rawlinson Rivera VCDX, VMware Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshareTRANSCRIPT
![Page 1: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/1.jpg)
Software-Defined Storage: The VCDX Way
Wade Holmes VCDX, VMware
Rawlinson Rivera VCDX, VMware
STO4798
#STO4798
![Page 2: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/2.jpg)
2 2
Session Objectives
3
2
1 Provide an overview of software-defined storage
capabilities
Articulate the potential business impact of a
software-defined storage architecture through
the VCDX approach
Provide an example design scenario of how to
leverage software-defined storage to meet the
needs of your datacenter
![Page 3: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/3.jpg)
3 3
Agenda
Overview Solution Areas Q/A Design
Scenario
![Page 4: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/4.jpg)
4 4
Customer Pain Points With Storage
Too much guesswork
Too many silos
Operational mismatch between virtualization and
storage
Performance degrades with time
Lack of end-to-end visibility
Trouble shooting is hard
Overprovisioning for performance
Management inefficiencies
Missed opportunities with DAS
How do we break silos?
How do we align application
requirements to storage capabilites?
How do we increase efficiency?
![Page 5: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/5.jpg)
5 5
Software-Defined Storage - A New Approach to Storage
SAN
HDD SSD
DAS NAS
Software-Defined
Storage
Hypervisor
Virtual
Software-defined Storage
SAN NAS
Hypervisor
SAN NAS
Physical
App App App
• VAAI
• VASA
• S-VMotion
• SDRS
• vSphere
Replication
• vSphere Storage
Appliance
![Page 6: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/6.jpg)
6 6
The VCDX Way
Methodology to enable efficient technology solution design,
implementation and adoption, meeting YOUR business
requirements.
![Page 7: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/7.jpg)
7 7
The VCDX Way
Business requirements drive solution architecture
Business Requirements
Solution Architecture
Engineering Specifications
Availability Manageability Performance Recoverability Security
![Page 8: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/8.jpg)
8 8
Software-Defined Storage
Automation with policy-driven storage provisioning - with SLAs
replacing technology details
Virtual volumes - transparent mapping between large volumes and
the VM disk images within them, to enable performance and data
management optimizations
Commodity hardware with storage logic abstracted into a software
layer and scale-out architecture
Programmability - management interfaces that span traditional
storage array products, separating "control plane" from "data plane”
![Page 9: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/9.jpg)
9 9
Software-Defined Storage
Automation with policy-driven storage
provisioning - SLAs replacing technology details
Virtual volumes - transparent mapping between large
volumes and the VM disk images within them, to allow better
performance and data management optimizations
Commodity hardware with storage logic abstracted into
a software layer and scale-out architecture
Programmability - management interfaces that span traditional
storage array products, separating "control plane"
from "data plane”
![Page 10: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/10.jpg)
10 10
Software-Defined Storage
Virtualized Data Plane
App-centric Data Services
Policy-Driven Control Plane
VMware Approach to Software-Defined Storage
Extensible framework
leveraged by ecosystem
to deliver VM-centric
snapshots, clones,
replication, backup, etc.
Common management
model based on VM-level
policies for automated
placement, balancing,
data services provisioning
Hypervisor-based pooling
of heterogeneous storage
resources optimized for
VM consumption
SAN /
NAS
All SSD
Array
Object /
BLOB DAS
![Page 11: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/11.jpg)
11 11
Converged Infrastructure
VMware Path to Software-Defined Storage
Hypervisor
Policy-Driven Management Policy-driven
Control Plane
Virtual Data
Plane
Ecosystem of
App-Centric Data
Services
Backup
…
App-centric Data
Services
External Storage Pool
![Page 12: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/12.jpg)
12 12
Agenda
Overview Solution Areas Q/A Design
Scenario
![Page 13: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/13.jpg)
13 13
Solution Impact
Availability Manageability Performance Recoverability Security
Virtualized Data Plane
App-centric Data Services
Policy-Driven Control Plane
Hypervisor
Virtual Pools
SAN
HDD SSD
DAS NAS
![Page 14: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/14.jpg)
14 14
Scale-Out Architecture
Availability Manageability Performance Recoverability Security
HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD
Virtual Pools
![Page 15: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/15.jpg)
15 15
Scale-Out Architecture
Availability Manageability Performance Recoverability Security
HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD
VSAN
10GigE
VSAN VASA
Provider
VC VASA
Client SMS
![Page 16: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/16.jpg)
16 16
Tolerating Component Failures
HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD
VSAN
✗
✗
![Page 17: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/17.jpg)
17 17
Scaling Out VSAN
![Page 18: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/18.jpg)
18 18
Storage Policy-Based Management
Availability Manageability Performance Recoverability Security
Compute
Compute-centric Storage Tier
Data-centric Storage Tier
Data
Plane
Policy-Based Management Control
Plane
Data Services
External
Storage
Scale out
storage
![Page 19: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/19.jpg)
19 19
Storage Management Pre-SDS
Datastore
Datastore
Datastore
Datastore
Datastore
Cluster Cluster Cluster Cluster
Physical storage management with proprietary vendor tools
VMs inherit
properties of
datastore
VM Management
Hypervisor UI
Which LUNs
have the right
performance
and
availability for
each VM?
Here are
your LUNs.
vSphere
Admin
Storage
Admin
![Page 20: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/20.jpg)
20 20
VM Storage Provisioning Pre-SDS…
Day 1 Day N Day N++
Setting up storage requires:
1. Spreadsheet black-magic
to determine right
configuration
2. Several additional steps:
• Build disk pools
• Assign RAID levels
• Create LUN/volumes
• Zone and map LUNs
• Format LUN/Volumes
• Assign data services
(Replication, etc.)
vSphere
Admin
Storage
Admin
I need more
storage for
my VMs.
Exactly what
performance do
you need?
Which LUNs
have the right
performance and
availability for
each VM?
Here are
your LUNs.
It should just
be fast.
![Page 21: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/21.jpg)
21 21
Da
ta S
erv
ice
s A
nd
Po
licy
Inte
gr
atio
n
Da
ta M
ob
ility
Existing Capabilities Help, But…..
Storage vMotion: zero downtime
migration of virtual disks between
datastores
VAAI: APIs for storage array integration
to offload native storage data services
like cloning/snapshots
Storage DRS: automated virtual disk
initial placement and ongoing balancing
Profile Driven Storage: VMs and
datastores tagging for provisioning
based on SLA profiles
vSphere data services: snapshots,
cloning, replication, data protection, thin
provisioning
vSphere 5.1 Storage Features
Storage I/O Control: access
prioritization to storage based on
established business rules
VA
AI
Compute
External Storage
FC FC FC
![Page 22: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/22.jpg)
22 22
Storage Management with SDS
Tomorrow
Compute
Compute-centric Storage Tier
Data-centric Storage Tier Data
Plane
Policy-based Management Control
Plane
Data Services
External
Storage
Scale out
storage
Cloud Service Provisioning
![Page 23: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/23.jpg)
23 23
Storage Management with SDS
VI Web Client
Storage Policy-Based Management Service vCenter
External Tier
1 Storage
VSAN Enabled Cluster
Scale-Out
Storage
Aggregated
Capabilities
External Tier 1
Storage
vVOL vVOL vVOL
Virtual Volumes
vVOL
Capabilities
(VASA 2.0)
VSAN
Capabilities
(VASA 1.5)
System
Labels
(VASA 1.0)
Tags
![Page 24: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/24.jpg)
24 24
Storage Policy-Based Management
![Page 25: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/25.jpg)
25 25
VM Storage Provisioning with SDS
Provision VM
storage using simple
policies
vSphere
Hard disks SSD
VSAN
Hard disks SSD
…………….
Hard disks SSD Hard disks SSD
Distributed VSAN Datastore
Each VM maintains
its unique policy in
the clustered VSAN
datastore
Storage capacity
and performance
scale dynamically
with your cluster
Hard disks SSD Hard disks SSD
VSAN
vSphere
Distributed VSAN Datastore
![Page 26: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/26.jpg)
26 26
What about the OpenStack Framework?
Nova (compute)
vSphere driver
Cinder (block storage)
VMDK driver
Neutron (network)
NSX driver
vSphere
NSX vSwitch
vSAN
CPU 1
CPU n …
vCenter
NSX Controller
Scale-Out
Storage External Tier 1
Storage
vVOL vVOL vVOL
OpenStack API
AMQP Message
Bus
![Page 27: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/27.jpg)
27 27
Policy-Based Management Futures
Nova (compute)
vSphere
driver
Cinder (block storage)
VMDK
driver
Neutron (network)
NSX
driver
AMQP
Message
Bus
vCloud Automation
Center
Business Policy
Entitlements
Permissions
Policy
vSphere
NSX vSwitch
vSAN
CPU 1
CPU n …
vCenter
NSX Controller
Scale-Out
Storage External Tier 1
Storage
vVOL vVOL vVOL
![Page 28: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/28.jpg)
28 28
Scaling Out for Performance
Availability Manageability Performance Recoverability Security
HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD
Virtual Pools
10GigE
![Page 29: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/29.jpg)
29 29
Number of Disk Stripes
![Page 30: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/30.jpg)
33 33
VMware Virsto IO Acceleration
Availability Manageability Performance Recoverability Security
Tiered vSpace vLog (one per host)
De-stages to vSpace
Writes to vLog are sequential
Reads from vSpace
vDisk vDisk vDisk vDisk
Hypervisor
![Page 31: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/31.jpg)
34 34
VMware Flash Read Cache
Availability Manageability Performance Recoverability Security
Virtual Flash Resource
vSphere Flash Read Cache
vSphere
![Page 32: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/32.jpg)
35 35
Disaster Recovery
Availability Manageability Performance Recoverability Security
VMware
vCenter Server
Site Recovery
Manager
VMware
vCenter Server
Site Recovery
Manager
VMware vSphere
Site A (Primary) Site B (Recovery)
Servers Servers
VMware vSphere
![Page 33: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/33.jpg)
36 36
Local Backup and Recovery
Availability Manageability Performance Recoverability Security
VMware vSphere
Data deduplicated
VDP
From
Powered by
![Page 34: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/34.jpg)
37 37
Trusted Storage Platform
Availability Manageability Performance Recoverability Security
Compute-centric Storage Tier
TPM Boot
Instantiation
Policy-Based Management
HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD
VSAN
![Page 35: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/35.jpg)
38 38
Agenda
Overview Solution Areas Q/A Design
Scenario
![Page 36: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/36.jpg)
39 39
Design Scenario
You have been asked to plan a storage design for the rapidly growing
software development company, PunchingClouds Inc.
PunchingClouds Inc. is currently in discussions with their storage
vendor on pricing for new storage arrays to accommodate a variety of
workloads, but want to assess all options in moving towards a SDDC
Performance is critical for some application tiers, but not others
The need to maintain manageability as the organization grows, as no
additional staff will be hired in the short-term future
Regulatory compliance is critical for a subset of applications
Currently a single storage admin handles operations for the
enterprise
![Page 37: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/37.jpg)
40 40
Current Storage Design
Storage Pool
Fabric Switch A Fabric Switch B
SP / FA A SP / FA B
HBA 1 HBA 2
VMFS Datastore
for APP Tier VMFS Datastore
for MGMT Tier
Storage Pool
VMFS Datastore
For DMZ
VMFS Datastore
For APP Tier
Physical Tier 1 Storage Array
HBA 1 HBA 2
Hypervisor
HBA 1 HBA 2
VMFS Datastore
for DMZ VMFS Datastore
for MGMT Tier
Hypervisor Hypervisor
PunchingClouds
Storage Admin
![Page 38: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/38.jpg)
41 41
Step 1: Assess
Current State
Average storage capacity for typical workloads?
What are the application I/O profiles?
Are multiple tiers of storage needed?
Are there existing SLAs for storage performance?
Project budget?
Preferred storage vendor?
Preferred storage protocol?
Can existing storage be used?
DEFINE DESIGN ASSESS
![Page 39: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/39.jpg)
42 42
Business Requirements
Provide differentiated storage tiers to match application profiles
Different tiers can be charged at different rates
Allow end-user to choose the right storage tier/cost for type of
workload
Flexible way to control or ensure storage performance
Minimize the capacity and cost of storage
Constraints
Existing storage vendor
Minimal storage staff
Re-use existing storage infrastructure
Step 2: Define DEFINE DESIGN ASSESS
![Page 40: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/40.jpg)
43 43
Step 3: SDS Solution Design
PunchingClouds
Storage Admin
Storage Pool App Tier
Fabric Fabric
SP SP
HBA 1 HBA 2
Storage Pool App Tier
Physical Tier 1 Storage Array
HBA 1 HBA 2
Hypervisor
HBA 1 HBA
Hypervisor Hypervisor
vVOL vVOL vVOL vVOL vVOL vVOL
Policy-Based Management
DMZ Tier
HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD
VSAN
Management Tier
HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD HDD SSD
VSAN
App Tier
PunchingClouds
Virtualization Admin
DEFINE DESIGN ASSESS
![Page 41: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/41.jpg)
44 44
Key Takeaways
3
2
1
Software-Defined storage can enable
efficiencies across multiple solution pillars within
your datacenter
Using an architectural methodology (i.e. “The
VCDX Way”) can help ensure successful
adoption of the right solution for your datacenter
4
VMware enables Software-defined storage
through both native solutions and eco-system
partnering
Software-Defined storage solutions can provide
both capex and opex savings as your
datacenter grows
![Page 42: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/42.jpg)
45 45
• It’s free
• It’s as easy as installing vSphere
• It gives you the chance to win an iPad!
Register for Virtual SAN Beta Now!
![Page 43: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/43.jpg)
46 46
Questions???
Overview Solution Areas Q/A Design
Scenario
Wade Holmes
@wholmes
Rawlinson Rivera
@PunchingClouds
![Page 44: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/44.jpg)
47 47
Other VMware Activities Related to This Session
HOL:
HOL-SDC-1308
Virtual Storage Solutions
STO4798
![Page 45: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/45.jpg)
THANK YOU
![Page 46: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/46.jpg)
![Page 47: VMworld 2013: Software-Defined Storage: The VCDX Way](https://reader034.vdocument.in/reader034/viewer/2022051818/54b7aaa54a79590e468b4590/html5/thumbnails/47.jpg)
Software-Defined Storage: The VCDX Way
Wade Holmes, VMware
Rawlinson Rivera, VMware
STO4798
#STO4798